Course Schedule

Unless otherwise specified, the course lectures and meeting times are:

Event TypeDateDescriptionCourse Materials
Lecture short Jan 10 Introduction to deep learning I
Course info, syllabus and tutorials 		[slides]
Lecture long Jan 12 Introduction to deep learning II
Applications
Lecture short Jan 17 Machine learning basics I
Supervised learning, capacity, descriminative model		 [slides]
Lecture long Jan 19 Machine learning basics II
Classification, regression, k-nearest neighbor
Lecture short Jan 24 Multilayer neural network I
Gradient descent, target functions 		[slides]
Lectue long Jan 26 Multilayer neural network II Neural Nets notes 1
Neural Nets notes 2
Neural Nets notes 3
tips/tricks: [1], [2], [3] (optional)
Deep Learning [Nature] (optional)
A1 Due Jan 26 Assignment #1 Due date
kNN/SVM/Softmax/2-Layer Net 		[Assignment #1]
Feb 2 Lunar New Year Vacation; no class
Lecture short Feb 7 Convolutional neural networks (CNN) I
Efficient convolution algorithms, BP for CNN 		[slides]
Lecture long Feb 9 Convolutional neural networks (CNN) II
Lecture short Feb 14 Optimization for training deep neural networks I [slides]
Lecture long Feb 16 Optimization for training deep neural networks II
Exam short Feb 21 Quiz 1
Coverage from Intro to Opt. for deep models
Lecture long Feb 23 Network structures [Slides]
A2 Due Feb 23 Assignment #2 Due date
CNN and optimization 		[Assignment #2]
Lecture short Feb 28 Recurrent Neural Networks (RNN) [slides]
DL book RNN chapter (optional)
min-char-rnn, char-rnn, neuraltalk2
Lecture long Mar 2 Long Short Term Memory (LSTM)
Language models, Image captioning 		[slides]
Lecture short Mar 7 Deep belief net and auto-encoder I
 [slides]
Lecture long Mar 9 Deep belief net and auto-encoder II
Lecture short Mar 14 Deep reinforcement learning I
Q-value network, DQN 		[slides]
Lecture long Mar 16 Deep reinforcement learning II
A3 Due Mar 16 Assignment #3 Due date
RNN and LSTM 		[Assignment #3]
Lecture short Mar 21 Attention models I
 [slides]
Milestone Mar 21 Discussion on final project proposal
Held in the tutorial session
Lecture long Mar 23 Attention models II
Lecture short Mar 28 Generative adversarial network (GAN) I
 [slides]
Lecture long Mar 30 Generative adversarial network (GAN) II
Lecture long Apr 6 Structured deep learning
 [Slides]
Lecture short Apr 11 Course sum-up [Slides]
Exam short Apr 18 Quiz 2
Milestone TBD Poster and presentation session
Details will be announced later 		[link]
Final Project TBD Final Project Report Due date
[reports]