Topic model

Methods

• Meta-package
  • https://github.com/mind-lab/octis
• Statistical inference
  • LDA
• Matrix factorization methods
  • NMF
    • TF-IDF weighted bag of words -> NMF with SVD initialization.
• Network-based approaches
  • Topic mapping
  • A network approach to topic models
    • @DanLarremore: I very much enjoyed reading “A network approach to topic models.” The math is really fun, and the results are compelling. Here’s a summary of why I liked the paper, and why I’d like to use it for topic modeling applications going forward. 1/n
• Continuous embedding approaches: Embedded topic model
• Structural topic model

Visualization

• https://github.com/StanfordHCI/termite
• Using Word Clouds for Topic Modeling Results

Evaluation

• Evaluation Methods for Topic Models
• Optimizing semantic coherence in topic models
• https://www.quora.com/What-are-good-ways-of-evaluating-the-topics-generated-by-running-LDA-on-a-corpus
• America’s Next Topic Model at PyData Berlin August 2016
• Is Automated Topic Model Evaluation Broken?: The Incoherence of Coherence

Tools

• http://radimrehurek.com/gensim/
• Termite: Visualization Techniques for Assessing Textual Topic Models
  • https://github.com/StanfordHCI/termite

Twitter

• Unsupervised Modeling of Twitter Conversations
• Characterizing Microblogs with Topic Models
• TwitterRank: finding topic-sensitive influential twitterers
• Large-Scale High-Precision Topic Modeling on Twitter by Twitter people.

Science

• Finding scientific topics

Articles

• Topic modeling with network regularization
  • Connections between the lines: augmenting social networks with text
  • Hierarchical relational models for document networks
  • Topic-link LDA: joint models of topic and author community
  • iTopicModel: Information Network-Integrated Topic Modeling
  • Named entity mining from click-through data using weakly supervised latent dirichlet allocation
  • Detecting topic evolution in scientific literature: how can citations help?
  • Multirelational Topic Models
  • Gibbs Sampling for Logistic Normal Topic Models with Graph-Based Priors
  • Coauthor Network Topic Models with Application to Expert Finding
  • Hierarchical Topic-Based Communities Construction for Authors in a Literature Database
  • The web of topics: discovering the topology of topic evolution in a corpus
  • Topic Models Conditioned on Relations
  • Inferring the Diffusion and Evolution of Topics in Social Communities

References

• Topic Modeling Bibliography