Instructor: Robert C. Berwick | TA: Karen Kohl |
Email: berwick@ai.mit.edu | Email: ktkohl@ai.mit.edu |
Office: 35-423 | Office: NE43-809 |
Phone: (617) 253-8918 | Phone: (617) 253-0778 |
Office hours: Weds 1-3 and by appointment | Office hours: Tu 4-6pm |
No. | DUE DATE | Task | Resources |
---|---|---|---|
|
Feb 26 | Word Parsing | Laboratory 1 material is here. |
|
Mar 05 | Word Tagging | Brill part of speech tagger; web version of Brill tagger here. Paper on Brill tagger here. Hmm tagger paper here. |
|
Mar 12 | Phrase Parsing | deMarcken parser; documentation here |
|
Apr 02 | Semantic Interpretation | Syntax-directed semantic interpretation system |
|
Apr 09 | Probabilistic methods; IR | Probabilistic parsers and extensions of HMM, other association methods |
#6 | Apr 23 | Enrichment Report | Your own choice, an 'engineering evaluation' reporting on an extension to any of the labs/topics in the course |
#7 | May 14 | Final Project | Your own design with team partners |
Open to submissions | Closed to submissions |
Week 1 |
|
or Notes |
W 02/05 | Introduction, Organization, Laboratories. Course Overview: Intro to NLP. Main Issues; fsa's [pdf] [4slides/page for printing] For fun, try this link: postmodern. Reference for this generation program is here. |
|
Week 2 |
|
|
M 02/10 | Linguistics: Phonology and Morphology I.; 2-level morphology, Kimmo [pdf] [2slides/page for printing] Lab 1 intro: processing words |
|
W 02/12 | Linguistics: Phonology and Morphology II. [pdf] [2slides/page for printing] Lab 1b : processing Spanish words |
|
Week 3 |
|
|
T 02/18 | President's Day Class (MIT turns Tuesday into Monday) OOPS SNOW DAY!! |
|
W 02/19 | HMM Tagging;
Statistical Transformation Rule-Based Tagging; Precision, Recall,
Accuracy For fun (and learning) try this link to an online Brill tagger here. Note: Default tagging is for Swedish! Click 'English' and click tracing 'on' if you want to see how it works. |
|
Week 4 |
|
|
M 02/24 | Part of Speech Tagging: the Brill Tagger. Lab 1 due; Lab 2 handed out. |
|
W 02/26 | Introduction to Parsing; Linguistics: Syntax & Parsing . | |
Week 5 |
|
|
M 03/03 | Shift-Reduce Parsers in Detail. Earley's Algorithm and Chart Parsing | |
W 03/05 | Context-free Parsing and Beyond: Efficiency Issues; Feature-based parsing; NL system design Lab 2 due. |
|
F 03/07 | Add Date | |
Week 6 |
|
|
M 03/10 | Shift-Reduce Parsers in Detail. Earley's Algorithm and Chart Parsing Lab 3 handed out | |
W 03/12 | Parsing with an integrated lexicon - the question of syntactic features. | |
Week 7 |
|
|
M 03/17 | Semantic Interpretation I: compositionality | |
W 03/19 | Semantic Interpretation II: compositionality and quantifiers Lab 3 due, Lab 4 handed out. | |
3/24-3/28 | No classes - Spring Break. Go to someplace warm if you can. | |
Week 8 |
|
|
M 03/31 | Feature Grammars Probabilistic grammars. | |
W 04/02 | PCFGs continued. inside-outside algorithm. Lab 4 due (roughly!), Lab 5 handed out |
|
Week 9 |
|
|
M 04/07 | Conclusions of Probabilistic methods. |
|
W 04/09 | Semantic Interpretation III: Lab 5 due. | |
Week 10 |
|
|
M 04/14 | Lexical Semantics I | |
W 04/16 | Determiners and Quantifiers | |
Week 11 |
|
|
M 04/21 | No class - Patriot's Day. Run the Boston Marathon if you can. | |
W 04/23 | Determiners & Quantifiers, II . "Enrichment" Lab 6 due (on or before) |
|
Th 04/24 | Drop Date | |
Week 12 |
|
|
M 04/28 | Principle-based Parsing | |
W 04/30 | Classical Models of Machine Translation: an Overview |
|
Week 13 |
|
|
M 05/05 | Statistical Machine Translation (MT).Alignment and Parameter Estimation for MT, | |
W 05/07 | Language learning I | |
Week 14 |
|
|
M 05/12 | Language Learning II: Computational Models of Language Learning | |
W 05/14 | Final project due. Computational Models of Language Change and the Origins of Language |
Assignments | 70% |
Final Project | 20% |
Class Participation | 10% |