XAI508: Natural Language Processing

Information

Outline

Recently, large language models for natural language processing have been extensively used and has brought significant attention to the AI field. And very recently, chatbots based on these large language models such as ChatGPT have become the hottest AI systems in the world. Basically, through natural language processing, AI agent can communicate deeply and tightly with a human, leading to a massive amount of real applications. Therefore, natural language processing is one of the most important topics especially in recent and future AI. This course will introduce an overview of natural language processing and recent representative tasks, algorithms, and architectures, including large language models.

Objective

Throughout the course, students will learn the backgrounds of natural language processing and understand the key factors in cutting-edge algorithms for natural language processing. In particular, the course will cover the current trend based on large-scale language models and alignment with human values. Eventually, the course aims students to have enough knowledge and moreover an insight for the corresponding researches.

Pre-requisites

Basic knowledges in calculus, linear algebra, probability, machine learning, and deep learning are preferred but not required.

Material

Lecture notes will be the main material of the course, and these do not come from a single textbook. 

Grading

Schedule