Computers process massive amounts of information every day in the form of human language. Although they do not understand it, they can learn how to do things like answer questions about it, or translate it into other languages. This course is a systematic introduction to the ideas that form the foundation of current language technologies and research into future language technologies.
The official prerequisites for the course are Data Structures (CSE 30331) and Theory of Computing (CSE 30151); the latter can be taken concurrently. Programming assignments will be done in Python. Familiarity with basic linear algebra, multivariable (differential) calculus, and probability theory are advised.
The best way to contact the teaching staff is by Piazza. You can also try our Slack channel, #cse-40657-fa16.
| Week | Assignment | Mon | Wed | Fri |
| 1 | Read Chapter 1 | 08/24 |
08/26 Probability |
|
| 2 | Submit project idea Read Chapter 2 |
08/29 Naive Bayes |
08/31 Logistic regression |
09/02 continued |
| 3 | Read Chapter 3, Chapter 4 | 09/05 Latent variables |
09/07 Neural networks |
09/09 continued |
| 4 | Submit HW1 (Text classification) Read Chapter 5 |
09/12 Weighted finite automata |
09/14 Language modeling |
09/16 continued |
| 5 | Read Chapter 6 | 09/19 Weighted finite transducers |
09/21 Viterbi algorithm |
09/23 continued |
| 6 | Submit HW2 (Language modeling) | 09/26 Sequence labeling |
09/28 Conditional random fields |
09/30 continued |
| 7 | Read Chapter 7, Chapter 8 | 10/03 Unsupervised training |
10/05 continued |
10/07 continued |
| 8 | Read Chapter 9, Chapter 10 Submit project baseline |
10/10 Recurrent neural networks |
10/12 continued |
10/14 continued |
| Fall break | ||||
| 9 | Read Chapter 11, Chapter 12 | 10/24 Context-free grammars |
10/26 continued |
10/28 continued |
| 10 | Submit HW3 (Tagging) Read Chapter 13 |
10/31 Parsing |
11/02 continued |
11/04 continued |
| 11 | Read Chapter 14 | 11/07 Translation |
11/09 continued |
11/11 Projects |
| 12 | Submit HW4 (Parsing) | 11/14 Translation |
11/16 Semantics |
11/18 Projects/More semantics |
| 13 | 11/21 Projects |
Thanksgiving | ||
| 14 | 11/28 Projects/More semantics |
11/30 Projects |
12/02 Digital Humanities |
|
| 15 | Submit HW5 (Translation) | 12/05 Projects |
12/07 Projects |
|
| Final | Submit project report | |||
Your work in this course consists of five homework assignments, a research project, and participation (whether you come to class, whether you appear to be paying attention, and whether you appear to have done the readings).
| requirement | points |
| homeworks | 5 × 30 |
| project | 4 × 30 |
| participation | 30 |
| total | 300 |
| letter grade | points |
| A | 280–300 |
| A− | 270–279 |
| B+ | 260–269 |
| B | 250–259 |
| B− | 240–249 |
| C+ | 230–239 |
| C | 220–229 |
| C− | 210–219 |
| D | 180–209 |
| F | 0–179 |
All work that you submit must be your own. You may discuss assignments with other students or refer to books or websites as long as you cite your sources. You may not write solutions or code with other students or anyone else, nor may you copy solutions or code from any source.
In the case of a serious illness or other excused absence, as defined by university policies, coursework submissions will be accepted late by the same number of days as the excused absence. Otherwise, you may submit part of an assignment on time for full credit and part of the assignment late, for a penalty of 10% per week. No work may be submitted after the final project due date.
Any student who has a documented disability and is registered with Disability Services should speak with the professor as soon as possible regarding accommodations. Students who are not registered should contact the Office of Disability Services.