Another Word For It Patrick Durusau on Topic Maps and Semantic Diversity

February 18, 2015

Efficient Estimation of Word Representations in Vector Space

Filed under: Machine Learning — Patrick Durusau @ 3:59 pm

Efficient Estimation of Word Representations in Vector Space by Tomas Mikolov, Kai Chen, Greg Corrado, Jeffrey Dean.

Abstract:

We propose two novel model architectures for computing continuous vector representations of words from very large data sets. The quality of these representations is measured in a word similarity task, and the results are compared to the previously best performing techniques based on different types of neural networks. We observe large improvements in accuracy at much lower computational cost, i.e. it takes less than a day to learn high quality word vectors from a 1.6 billion words data set. Furthermore, we show that these vectors provide state-of-the-art performance on our test set for measuring syntactic and semantic word similarities.

The technical side of Learning the meaning behind words, where we reported the open sourcing of Google’s word2vec toolkit.

A must read.

I first saw this in a tweet by onepaperperday.

No Comments

No comments yet.

RSS feed for comments on this post.

Sorry, the comment form is closed at this time.

Powered by WordPress