|
Date |
Topics |
Readings |
|
|
Introduction |
|||
|
M 8/29 |
Machine Learning Foundations Overview, applications, settings |
Bishop 1 |
|
|
W 8/31 |
Math Review Calculus, linear algebra, optimization |
Linear algebra Bishop Appendix C |
|
|
M 9/5 |
Labor Day No Class |
||
|
W 9/7 |
Probability Probability, stats |
You do NOT need to read all Probability: Bishop Chapter 2 Bishop Appendix B |
|
|
M 9/12 |
Decision Trees Construction, pruining, over-fitting |
||
|
W 9/14 |
TBA TBA |
||
|
Supervised Learning: Linear Methods |
|||
|
M 9/19 |
Regression Least squares and regression |
Bishop 3 |
|
|
W 9/21 |
Classification Logistic Regression |
Bishop 4 |
|
|
M 9/26 |
Generative vs. discriminative Naive Bayes and Logistic Regression |
||
|
W 9/28 |
Online methods Perceptron, multi-class, structured |
Blum. On-Line Algorithms in Machine Learning. 1996 Bishop 4.1.2 Reducing Multiclass to Binary (Sections 1, 2, 3) |
|
|
Supervised Learning: Non-Linear Methods |
|||
|
M 10/3 |
Support Vector Machines Max-margin classification and optimization |
Bishop 7.1 Bishop Appendix E |
|
|
W 10/5 |
Kernel Methods Dual optmization, kernel trick |
Bishop 6.1, 6.2 |
|
|
Tue 10/11 |
Instance based learning Nearest-neighbors |
Bishop 2.5 Mitchell 8-8.4 |
|
|
W 10/12 |
Neural Networks Neural Network models |
Bishop 5.1,5.2,5.3,5.5 |
|
|
M 10/17 |
Ensemble Methods Boosting |
Bishop 14.1,14.2,14.3 |
|
|
W 10/19 |
Current Trends in Supervised Learning |
||
|
Unsupervised Learning |
|||
|
M 10/24 |
Clustering Expectation-Maximization and k-means |
Bishop 9 |
|
|
W 10/26 |
EM and Clustering 1 Gaussian mixture models |
Bishop 9 |
|
|
M 10/31 |
EM and Clustering 2 The EM Algorithm |
Bishop 9 |
|
|
Graphical Models |
|||
|
W 11/2 |
Graphical models 1 Bayesian networks and conditional independence |
Bishop 8.1, 8.2 |
|
|
M 11/7 |
Graphical models 2 MRFs and Exact inference |
Bishop 8.3, 8.4 |
|
|
W 11/9 |
Graphical models 3 Inference |
Bishop 8.3, 8.4 |
|
|
M 11/14 |
Sequential graphical models 1 Max Sum and Max Product |
Bishop 13.1,13.2 |
|
|
W 11/16 |
Sequential graphical models 2 HMMs and CRFs |
||
|
Other Topics |
|||
|
M 11/21 |
Dimensionality reduction PCA, probabilistic PCA, LDA |
Bishop 12.1,12.2,12.3 |
|
|
W 11/23 |
Thanksgiving Break No class |
|
|
|
M 11/28 |
Special Topic |
||
|
W 11/30 |
Semi-supervised learning Guest Lecture |
||
|
Thu 12/15 2pm-5pm |
(Day and time subject to change) Final Poster Session Time Project presentations |
|
|