Katz's back-off model https://en.wikipedia.org/wiki/Katz%27s_back-off_model Set a threshold , and if the occurrence of a given n-gram is smaller than , “back off” by using n-1-gram. Usage examples Danescu Niculescu Mizil2013