Introduction to Natural Language Processing (600.465)Language Modeling (and the Noisy Channel)

The Noisy Channel

Noisy Channel Applications

Noisy Channel: The Golden Rule of ...

The Perfect Language Model

Markov Chain

n-gram Language Models

LM: Observations

The Length Issue

Parameter Estimation

Maximum Likelihood Estimate

Character Language Model

LM: an Example

LM: an Example (The Problem)