XAI609: Advanced Natural Language Processing

Information

Outline

Recently, large language models (LLMs) for natural language processing have been extensively used and has brought significant attention to the AI field. And very recently, chatbots based on these LLMs such as ChatGPT, Gemini, Claude, and LLaMA have become the hottest AI systems in the world. Basically, through natural language processing, AI agent can communicate deeply and tightly with a human, leading to a massive amount of real applications. In addition, LLMs have shown powerful general intelligence, and lots of current AI domains try to leverage it. This course will focus on various cutting-edge researches on natural language processing based on LLMs and Multi-modal LLMs.

Objective

Throughout the course, students will comprehensively understand key factors in cutting-edge algorithms for recent natural language processing based on large and generative language models. In particular, this course will discuss and delve deeply into the latest papers and research studies on LLM-based natural language processing including RAG, ToolLLM, advanced human alignment algorithms, Efficient LLM, Multi-Modal LLM, Non-Autoregressive LLM, and Mixture-of-Experts LLM. Eventually, the course aims students to develop practical knowledge and skills and moreover an insight for latest researches to leverage those for their own research.

Pre-requisites

Basic knowledges in deep learning and natural language processing are required.

Material

Lecture notes will be the main material of the course, and these do not come from a single textbook.

Grading

Schedule