Continuous embedding of words.
Can we also think of word embedding in cerebral cortex? Huth2016natural explored this idea and Goldstein2020thinking may offer a more concrete connection. Liang2021can is uses Fruit fly brain network to see whether it can learn word embedding. See also Using biological neural network for machine learning.
The impact of token frequency in embedding.
- Word Embeddings: Explaining their properties
- Vector Space Models for the Digital Humanities
- 📚The Current Best of Universal Word Embeddings and Sentence Embeddings see also Sentence embedding
Science of science
- Tshitoyan2019unsupervised - Unsupervised word embeddings capture latent knowledge from materials science literature