DATA303: Advanced Machine Learning
Information
Instructor: Sungwoong Kim
TA: Donghwan Chi, Hyomin Kim
Time: Fri 13:30 - 16:15 (break time: 14:45 - 15:00)
Room: Woojung B101
Contact: swkim01@korea.ac.kr or khmiee@korea.ac.kr or LMS
Outline
This course will cover advanced algorithms and models in machine learning and deep learning to understand how cutting-edge AI models are being developed. In particular, it introduces not only theoretical contents but also practical implementation methods, including hands-on projects for actual implementation of training and evaluation codes. Furthermore, it focuses on generative modeling, which is central to recent AI research and development, exploring how the algorithms and underlying technologies of different generative models are related and how they are applied to real-world data such as natural language and images.
Objective
Throughout the course, students will learn the backgrounds and key factors of advanced machine learning algorithms and models focusing on generative modeling. In particular, the course will cover a basic generative modeling, Bayesian modeling, and current trend based on diffusion modeling and GPT-based language modeling. Eventually, the course aims students to have enough knowledge and moreover an insight and practical implementation skills for the corresponding researches.
Pre-requisites
Basic knowledges in probability, machine learning, and deep learning are required.
Material
Lecture notes will be the main material of the course, and these do not come from a single textbook. However, the following reference text books will be useful.
Toni Ramchandani, “A Generative Journey to AI: Mastering the foundations and frontiers of generative deep learning”, BPB Publications, 2024.
Mark Liu, "Learn Generative AI with PyTorch", MANNING, 2024.
Grading
Attendance (20%)
Team Project (30%)
Midterm Exam (25%)
Final Exam (25%)