/var/logmarcus chiu

/var/log

❯

Computer

❯

Artificial Intelligence (AI) - Cognitive Computing - Machine Intelligence

❯

AI - Subfields

❯

Natural Language Processing (NLP) - Computational Linguistics

❯

Language Models

N-Grams (Monograms/Unigrams - Bigrams)

Created on Aug 23, 2020 · Last Modified on Jun 20, 2022

N-Grams
  • is a contiguous sequence of n items from a given sample of text or speech (items can be phonemes, syllables, letters, words, or base pairs)

Language Model - Representation

  • TODO

Estimating N-Gram Probabilities

  • Maximum Likelihood Estimation (MLE)

Smoothing

  • N-Gram Smoothing

Resources

  • Dan Jurafsky - Video Lectures