So cool. And you thought you knew your field. Pffft.
“By training a neural network on a word, you get representations of words that can actually confer knowledge.”
Confer knowledge? To whom - certainly not the machine which could not distinguish knowledge from garbage, and could care less.. There is a big confusion these days between knowledge and merely having huge amounts of data on which mechanical systems perform data processing, in my opinion (let's not forget - that's what computers are and what they do, end of story). This may even be promoted knowingly to be in accordance with someone's agenda to demonstrate and prove products they like to sell, but I am skeptical AI could ever exceed humans at inventivity for example, to name just one aspect of man - machine differences. I would be very curious what "conclusions" would the algorithm Word2vec "discover" after being pointed to read this:
I may be wrong, but in a nutshell, I believe there are some arrogant folks who love to claim that the act of thinking can be delegated to machines, not only that, be performed better.