Description

""" RSVP HERE - https://hubs.li/Q02rF3Gl0 """

______________________________________________

Reinforcement learning (RL) is famously powerful but difficult to wield, and until recently, had demonstrated impressive results on games, but little real world impact. I will start the talk with a discussion of RL for Large Language Models (LLMs), including scalable supervision techniques to better align models with human preferences (Constitutional AI / RLAIF). Next, I will discuss RL for chip floorplanning, one of the first examples of RL solving a real world engineering problem. This learning-based method can generate placements that are superhuman or comparable on modern accelerator chips in a matter of hours, whereas the strongest baselines require human experts in the loop and can take several weeks. This method was published in Nature and used in production to generate superhuman chip layouts for the last four generations of Google’s flagship AI accelerator (TPU).


Local ODSC chapter in NYC, USA

Hybrid ODSC East 2024 on 23rd-25th April - https://hubs.li/Q027_nYw0 

Use COMMUNITY-EAST2024 - code for extra discount on any pass of your choice.

Instructor's Bio

Anna Goldie

Senior Staff Research Scientist at Google DeepMind 

Anna works on Large Language Model (LLM) research in Gemini & Bard. Previously, she worked on RL for LLMs and retrieval-augmented LLMs at Anthropic and was co-founder/lead of the ML for Systems team in Google Brain. Her RL methods have been used in multiple generations of Google's flagship AI accelerator (TPU). She graduated from MIT with a Bachelors in Computer Science, a Bachelors in Linguistics, and a Master of Computer Science, and is a CS PhD Candidate in the Stanford NLP Group. She has published peer-reviewed articles in top scientific venues, including Nature, NeurIPS, ICLR, EMNLP, ISPD, ASPLOS, and MLCAD. She was named one of MIT Technology Review's 35 Innovators Under 35, and her work has been covered in various media outlets, including CNBC, IBTimes, IEEE Spectrum, MIT Technology Review, WIRED. and ABC News.

Webinar

  • 1

    ODSC East 2024 Keynote: "Deep Reinforcement Learning in the Real World: From Chip Design to LLMs"

    • Ai+ Training

    • RSVP HERE

UPCOMING LIVE TRAINING

Register now to save 30%