Language model N-gram

Table Of Contents

Documentation
Applications
Reasions
Formula
N-Grams common
Smoothings

Documentation

1. N-gram Language Models
2. Modeling Natural Language with N-Gram Models
3. N-Gram Language Models Explained with Examples
4. N-gram-language models
5. N-gram Language Modeling Tutorial
6. Big exercise
7. Edit fomula in mydocument
8. video Ngram 2
9. PP làm mịn Add-one(Laplace)
10. PP làm mịn Good-turing
11. Báo cáo tiến độ

Applications

• automated machine translation
• predict the next most likely word to occur in a sentence
• automatically generate text from speech
• automate spelling correction
• determine the relative sentiment of a piece of text

Reasions

• identify words in noisy, ambiguous input, like speech recognition or handwriting recognition
• cho biết phân bố xác xuất trên các tập văn bản là bao nhiêu

Fomula

1. Công thức Bayes:
   

• 
• 

2. Xấp xỉ Markov:
   

• 

N-Grams

1. Unigram
2. Bigram
3. Trigram

Smoothings

1. Chiếc khấu (Discounting)

• Add-one (Laplace):
  • 
  • 
    
  • 
    
• Writen-Bell
  • 
  • 
• Good - turing

2. Truy hồi (Back-off)
3. Nội suy (Interpolation)