Date 
Lecture 
Notes etc 
Wed. January 19th 
Lecture 1: Introduction, hidden Markov models, loglinear models

Slides part 1
(introduction, hidden Markov models),
Slides part 2 (loglinear
models).
Background reading: J&M Chapter 5 on partofspeech tagging, J&M
sections 6.16.4 (HMMs), J&M 6.66.7 (Loglinear models). Note that
there are a couple of typos in section 6.7 in loglinear models, described
here.

Wed. January 26th 
Lecture 2: Loglinear models, MEMMs, CRFs

Slides
(loglinear models, MEMMs, CRFs)
Required reading:
note on loglinear models, MEMMs, and CRFs

Wed. February 2nd 
Lecture 3: Discriminative Dependency Parsing

Slides
(Discriminative dependency parsing)
Readings:
McDonald, Crammer and Pereira, 2005 (on projective discriminative
dependency parsing)
McDonald, Pereira, Ribarov, Hajic, 2005
(on nonprojective discriminative
dependency parsing, including a description of the decoding algorithm
for directed spanning trees)
Koo, Globerson, Carreras, Collins, 2007
(on calculating marginals using the matrixtree theorem).

Wed. February 9th 
Lecture 4: CRFs for CFG parsing, the
structured perceptron, belief propagation

Slides

Wed. February 16th 
Lecture 5:
Dual Decomposition (part I)

Slides (4 per page),
Slides (1 per page), with animations
Reading:
Koo et al., EMNLP 2010

Wed. February 23rd 
Lecture 6:
Dual Decomposition (part II)

Slides (part 1),
Slides (part 2)
Reading:
Rush et al., EMNLP 2010

Wed. March 2nd 
Lecture 7

Student project proposal presentations.

Wed. March 9th 
Lecture 8:
Statistical Machine Translation

Slides on phrasebased models(4 per page),
Slides on Hiero,
Koehn and Knight tutorial.
Readings:
Chiang, 2007,
Koehn et al., 2003.

Wed. March 16th 
Lecture 9:


Wed. March 30th 
Lecture 10:
Lagrangian relaxation for MT decoding

Slides

Wed. April 6th 
Lecture 11: Discriminative models for MT/Brown
clustering and semisupervised learning

Slides part 1,
Slides part 2

Wed. April 13th 
Lecture 12: Yarowsky's algorithm, cotraining

Slides part 1,
Slides part 2

Wed. April 20th 
Lecture 13:


Wed. April 27th 
Lecture 14:

