## ECE, CS 4501/6501: Statistical Learning and Graphical Models (Fall 2020)

Welcome to statistical learning and graphical models! This course is focused on the foundations of estimation theory, statistical learning, probabilistic graphical models, and relevant computational algorithms. The course maintains a probabilistic view of these topics, aiming to represent complex systems via probabilistic models and using these models to draw conclusions about hidden values from observation and data.

We will start with the fundamentals of inference, including frequentist and Bayesian estimation methods, and explore these further in the context of regression and classification problems. We will then turn our attention to probabilistic graphical models, which provide a flexible mechanism for representing statistical relationships between variables and processes. Finally, we will study computational methods for inference and learning, enabling us to analyze, interpret, and explain patterns in complex data.

**Pre-requisites:** Fluency in basic probability (e.g., APMA 3100) is needed for the course as is familiarity with linear algebra. For probability, you should be already comfortable with 70-80% of these Probability Review Notes. The programming exercises are based on Python.

**Tentative Grading Scheme: **HW/Labs = 50%; Quizzes/In-class activities = 20%; Midterm Exam = 20%; Project = 10%

**Notes (from previous offering):**

- Review of Probability
- Probability, Inference, and Learning
- Frequentist Parameter Estimation (partial *)
- Bayesian Parameter Estimation
- Multivariate random variables
- Linear Regression
- Linear Classification
- Expectation-Maximization *
- Basics of Graphical Models
- Independence in Graphical Models
- Parameter Estimation in Graphical Models
- Inference in Graphical Models
- Inference in Hidden Markov Models
- Factor Graphs and Sum/Max-product Algorithms **
- Markov Chains
- Sampling Methods
- Appendix

*: material only for graduate students. **: optional material for completeness (not part of the course)

**Other Material:**

- Notes (OneNote)
- Probability Review Test
- Lab 0: Probability and Python (IPython Notebook)
- Assignment 1
- Lab 1: Graphical Models
- Assignment 2
- Lab 2: Frequentist and Bayesian Estimation
- Assignment 3
- Lab 3: Regression and SGD, data: BoxOffice2017.csv
- Miniproject
- Lab 4: Classification
- Lab 5: EM
- Assignment 4
- Lab 6: HMM
- Assignment 5
- Lab 7: MCMC