Deep Learning

Boston University - Spring 2024

Class is held in CAS 211 on Monday and Wednesday 6:30-7:45pm

Course staff and office hours

Instructor: Prof. Iddo Drori, Wednesday 5:15-6:15pm, CDS 839

Teaching Fellow: Aoming Liu, Tuesday 4-5pm, CDS 802

Textbooks

The Science of Deep Learning, Iddo Drori, Cambridge University Press, 2022

Understanding Deep Learning, Simon Prince, MIT Press, 2023

Deep Learning Foundations and Concepts, Bishop, Springer, 2023

Dive into Deep Learning, Zhang, Lipton, Li, Smola, 2023

First Day of Classes (Thursday, January 18)

Lecture 1 (Monday, January 22): Introduction

Lecture 2 (Wednesday, January 24): Forward and backpropagation

Lecture 3 (Monday, January 29): Optimization

Lecture 4 (Wednesday, January 31): Regularization

Lecture 5 (Monday, February 5): Convolutional neural networks

Lecture 6 (Wednesday, February 7): Sequence models

Lecture 7 (Monday, February 12): Graph neural networks

Lecture 8 (Wednesday, February 14): Transformers

Presidents' Day Holiday (Monday, February 19) No classes

Lecture 9 (Wednesday, February 21): Autoencoders

Lecture 10 (Monday, February 26): Diffusion models

Lecture 11 (Wednesday, February 28): Latent diffusion models

Lecture 12 (Monday, March 4): Decision making

Lecture 13 (Wednesday, March 6): Agents

Spring Recess (March 9 - March 17)

Lecture 14 (Monday, March 18): Building a foundation model, Text

Lecture 15 (Wednesday, March 20): Building a foundation model, Vision and Audio

Lecture 16 (Monday, March 25): Building a foundation model, Data

Lecture 17 (Wednesday, March 27): Building a foundation model, Fine-tuning

Lecture 18 (Monday, April 1): Building a foundation model, RL

Lecture 19 (Wednesday, April 3): Building a foundation model, Code and Tools

Lecture 20 (Monday, April 8): Building a foundation model, Evaluation

Lecture 21 (Wednesday, April 10): Building a foundatoin model, Safety

Patriots' Day Holiday (Monday, April 15) No classes

Lecture 22 (Wednesday, April 17):

Lecture 23 (Monday, April 22):

Lecture 24 (Wednesday, April 24):

Lecture 25 (Monday, April 29):

Last Day of Classes (Wednesday, May 1)