Ben Chuanlong Du's Blog

It is never too late to learn.

Tips on Word2Vec

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

Word2Vec

https://code.google.com/archive/p/word2vec/

Hierarchical Softmasx

Negative Sampling

Google Word2Vec claims that hierarchical softmax is better for infrequent words while negative sampling is better for frequent words …