Take The Course

Want to teach a robot how to roll over?

In 2022 Pieter Abbeel and a team of researchers taught a robot to roll over, stand up, and walk after one hour of training using Reinforcement Learning. During this course, you'll learn about the foundational theory and concepts of Reinforcement Learning that enabled this accomplishment

Instructor Spotlight

Bio: Pieter Abbeel

Professor Pieter Abbeel is Director of the Berkeley Robot Learning Lab and Co-Director of the Berkeley Artificial Intelligence (BAIR) Lab. Abbeel’s research strives to build ever more intelligent systems, which has his lab push the frontiers of deep reinforcement learning, deep unsupervised learning, especially as it pertains to robotics. Abbeel has received many awards and honors, including ACM Prize, IEEE Fellow, PECASE, NSF-CAREER, ONR-YIP, AFOSR-YIP, Darpa-YFA, TR35, and 10+ best paper awards/finalists. His work is frequently featured in the press, including the New York Times, Wall Street Journal, BBC, Rolling Stone, Wired, and Tech Review.

What's the course?

Foundations of Deep Reinforcement Learning

Deep Reinforcement Learning equips AI agents with the ability to learn from their own trial and error. Success stories include learning to play Atari games, Go, Dota2, robots learning to run, jump, manipulate. This tutorial will cover the foundations of Deep Reinforcement Learning, including MDPs, DQN, Policy Gradients, TRPO, PPO, DDPG, SAC, TD3, model-based RL, as well as current research frontiers.

Before You Get Started

Outline and Prerequisite

Module 1: Introduction to Markov Decision Processes (MDPs) and Exact Solution Methods (which only apply to small problems)

Module 2: Deep Q Networks and Application to Atari

Module 3: Policy Gradients, Trust Region Policy Optimization (TRPO), Proximal Policy Optimization (PPO), Deep Deterministic Policy Gradients (DDPG), Twin Delayed Deep Deterministic Policy Gradients (TD3), Soft Actor Critic (SAC) and Application to Robot Learning

Module 4: Model-based Reinforcement Learning

Module 5: Current Research Frontier

*Background Knowledge: Familiarity with Deep Supervised Learning is a major plus; general familiarity with calculus is a plus, too

  • 1

    Spotlight - Pieter Abbeel

    • Bio

  • 2

    Foundations of Deep Reinforcement Learning

    • Foundations of Deep Reinforcement Learning