Re-visiting Skip-Gram Negative Sampling: Dimension Regularization for More Efficient Dissimilarity Preservation in Graph Embeddings
- https://arxiv.org/abs/2405.00172
- David Liu, Arjun Seshadri, Tina Eliassi-Rad, Johan Ugander
Negative sampling, Contrastive learning
Why does penalizing non-zero dimension mean work?