COMS 6998: Advanced Topics in Spoken Language Processing

Note: Schedule and readings are subject to change.

Date Topic Readings Assignments
Week 1: 9/5 Introduction to SLP
Week 2: 9/12 From Sounds to Language Jurafsky & Martin Chapter 7 (sections 1-3)
Week 3: 9/19 Acoustics of Speech Jurafsky & Martin Chapter 7 (sections 4-7)
Praat tutorial
Download Praat and bring laptop to class
HW1 Assigned
Week 4: 9/26 Analyzing Speech Prosody ToBI Conventions
Modeling Prosody
Prosody and Meaning
HW1 Due
Week 5: 10/3 Spoken Dialogue Systems Jurafsky & Martin Chapter 24
Jurafsky & Martin Chapter 25
HW2 Assigned
Week 6: 10/10 Text-to-Speech Synthesis Jurafsky & Martin Chapter 8
Merlin Tutorial
HW2 Due
Week 7: 10/17 Automatic Speech Recognition Jurafsky & Martin Chapter 9
Deng & Yu Chapter 7
Week 8: 10/24 Speech Analysis: Personality and Mental State Automatic Recognition of Personality in Conversation
Detecting late-life depression in Alzheimer's disease through analysis of speech and languaage
Project Proposals Due
Week 9: 10/31 Speech Analysis: Deception and Trust Acoustic-Prosodic Indicators of Deception and Trust in Interview Dialogues
The sound of trustworthiness: Acoustic-based modulation of perceived voice personality
(*optional*) Actual and Perceived Cues to Deception: A Closer Look at Speech
Week 10: 11/7 Speech Analysis: Sarcasm and Humor "Sure, I did the right thing": A system for sarcasm detection in speech
"Yeah, right": Sarcasm recognition for spoken dialogue systems
Multimodal Indicators of Humor in Videos
Week 11: 11/14 Speech Analysis: Emotion Classifying Subject Ratings of Emotional Speech Using Acoustic Features
Using Context to Improve Emotion Detection in Spoken Dialog Systems
Adieu features? end-to-end speech emotion recognition using a deep convolutional recurrent network
Literature Review Due
Week 12: 11/21 Speech Analysis: Entrainment Measuring acoustic-prosodic entrainment with respect to multiple levels and dimensions
Mark My Words! Linguistic Style Accommodation in Social Media
Prosodic entrainment in Mandarin and English: a cross-linguistic comparison
Week 13: 11/28 Thanksgiving; no class
Week 14: 12/5 Final Project Presentations