10-202: Introduction to Modern AI
Logistics
Course Instructor: Zico Kolter
Zico Kolter Lectures: MW[F] 9:30–10:50 Tepper 1403 (note: Friday lectures will only be used for review sessions or makeup lectures when needed)
Online Course
all content
two weeks
Syllabus Overview
This course provides an introduction to how modern AI systems work. By “modern AI”, we specifically mean the machine learning methods and large language models (LLMs) behind systems like ChatGPT, Gemini, and Claude. [Note] Despite their seemingly amazing generality, the basic techniques that underlie these AI models are surprisingly simple: a minimal LLM implementation leverages a fairly small set of machine learning methods and architectures, and can be written in a few hundred lines of code.
This course will guide you through the basic methods that will let you implement a basic AI chatbot. You will learn the basics of supervised machine learning, large language models, and post-training. By the end of the course you will be able to write the code that runs an open source LLM from scratch, as well as train these models based upon a corpus of data. The material we cover will include:
... continue reading