CS6998: Topics in Speech Processing: Computational Approaches to Emotional Speech, Fall 2011
Time: TBD
Place: TBD
Professor Julia Hirschberg (Office Hours: TBD)
julia@cs.columbia.edu, 212-939-7114
Teaching Assistant TBD
Announcements | Academic Integrity | Description
Readings | Resources | Requirements | Syllabus
Description
Requirements
Students will lead one class discussion, and prepare weekly discussion questions based on assigned readings, and prepare a term project. The Columbia Speech Lab is available for use in homeworks on a signup basis.
All students are required to have a Computer Science Account for this class. To sign up for one, go to the CRF website and then click on "Apply for an Account".
Academic Integrity
Readings
Required readings will be available on line.
Announcements
Resources
- Praat - Praat resources
- Wavesurfer
- Help using ToBI - ToBI Annotation Environments
- Whissel's Dictionary of Affect
- Feeltrace download
- FACS facial coding system
- Linguistic Inquiry and Word Count (LIWC)
- Synface demo
- Draft Standard for Emotional Speech Markup Language
- Mary Emotional TTS
Syllabus
Date | Topic | Readings | Reports & HW |
---|---|---|---|
Week 1 |
Introduction | The Love Detector; Emotional Synthetic Speech |
|
Week 2 |
Evidence of Emotion: Theory, Experiments and Corpora
|
Wiltingetal06; Enos&Hirschberg06; Nisimuraelal06; Cornelius00 |
|
Week 3 |
Cues to Emotion: Face, Body, Brain |
Johnstoneetal06,Ekman video; Ekman bio; cf FACS |
|
Week 4 |
Cues to Emotion: Language ; Introduction to Praat | Gupta&Rajput07; cf DAL; Praat; Yanushevskayaetal05 | Project Ideas/Description |
Week 5 | Techniques for Emotion Classification |
Kumaretal06; Satohetal07; Cowie00; cf. Feeltrace |
|
Week 6 |
Cultural Differences |
Braun&Katerbow05; Shahidetal07; Ekman&Friesen03 |
Change in weekly assignments |
Week 7 |
Producing Emotional Speech |
Cahn90; Eideetal04; Beskow&Nordenberg06 cf Synface demo, Mary TTS |
|
Week 8 |
Emotion in IVR Systems: Anger and Frustration |
Liscombeetal05; Devillers&Vidrascu06 |
|
Week 9 |
Emotion in Tutoring Systems: Confidence and Confusion |
Aietal06; Liscombeetal05b |
|
Week 10 |
Emotion in Meetings: Hot Spots and Laughter |
Wrede&Shriberg03; Laskowski&Burger07 |
|
Week 11 |
Deception Detection |
Hirschbergetal05; Eriksson&Lacerda07 YouDecide |
|
Week 12 |
Medical Diagnosis |
Luoetal06;
Levitetal01;
Kalioubyetal06;
Zei_Pollermann00
|
|
Week 13 |
Modeling Other Speaker State:
Sarcasm, Charisma, Urgent/Personal |
Teppermanetal06; Biadsyetal08; Ringel&Hirschberg02 |
|
Finals |
Projects due |