Introduction to Natural Language Processing (600.465)Language Modeling (and the Noisy Channel)

Table of Contents

Introduction to Natural Language Processing (600.465)Language Modeling (and the Noisy Channel)

The Noisy Channel

Noisy Channel Applications

Noisy Channel: The Golden Rule of ...

The Perfect Language Model

Markov Chain

n-gram Language Models

LM: Observations

The Length Issue

Parameter Estimation

Maximum Likelihood Estimate

Character Language Model

LM: an Example

LM: an Example (The Problem)

Email: hajic@cs.jhu.edu

Home Page: http://www.cs.jhu.edu/~hajic/courses/cs465/syllabus.html