Instructor: Sungwoong Kim
TA: Hanbum Ko
Time: Tue 13:30 - 16:15 (break time: 14:45 - 15:00)
Room: Woojung 201
Contact: swkim01@korea.ac.kr or hanbumko95@korea.ac.kr or blackboard
Recently, large language models (LLMs) for natural language processing have been extensively used and has brought significant attention to the AI field. And very recently, chatbots based on these LLMs such as ChatGPT, Bard, and Llama 2-Chat have become the hottest AI systems in the world. Basically, through natural language processing, AI agent can communicate deeply and tightly with a human, leading to a massive amount of real applications. In addition, LLMs have shown powerful general intelligence, and lots of current AI domains try to leverage it. Therefore, natural language processing is one of the most important topics especially in recent and future AI. This course will focus on recent representative tasks and algorithms of natural language processing including LLMs.
Throughout the course, students will understand the key factors in cutting-edge algorithms for recent natural language processing, especially related to large and generative language models. In particular, the team project could be an opportunity for students to apply newly acquired skills towards an in-depth application and research problem. Eventually, the course aims students to develop practical knowledge and skills and moreover an insight for the corresponding researches.
Basic knowledges in deep learning and natural language processing are required.
Lecture notes will be the main material of the course, and these do not come from a single textbook.
Participation (20%)
Attendance (20%)
Team Project (30%)
Final Exam (30%)
Research-level project of your choice
In groups of 1 or 2 (breakdown of individual contributions if more than one)
You can pick one or multiple papers related to the main topics covered in this course.
Not just reproduce it but perform your own analysis, propose your own idea, and validate it empirically.
You can use your ongoing research as long as it is related to the main topics covered in this course.
Can share the project with other courses.
Proposal presentation, final presentation, and final report (+codes).
Schedule
Deadline to form a project group: 9/25
Proposal presentation: 10/24
Final presentation: 12/12
Deadline to submit a final report: 12/24
Grading (for 30% of the course grade, broken down as follows)
Proposal presentation: 10%
Final presentation: 10%
Final report: 10%
Contact (mentor): TA