Language model

A probability distribution over possible documents. See also Neural language models.

It refers to statistical models of documents. Usually, it is about the conditional probability of the next word given the previous words seen so far.

where is the ‘th word in the sequence and is the subsequence .

If we have a good language model, we can do Natural language generation.

Powerful language models can generate human-like contents, which can poses various risks. See Risks of language models.


Natural Language Processing | Natural language understanding < > Neural language models