The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
Applying RL to Real-World Robotics with Abhishek Gupta
https://cdn.twimlai.com/wp-content/uploads/2021/03/22155150/TWIML_COVER_800x800_AG2-2.jpg800800The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)https://cdn.twimlai.com/wp-content/uploads/2021/03/22155150/TWIML_COVER_800x800_AG2-2.jpg
Abhishek, a member of the BAIR Lab, joined us to talk about his recent robotics and reinforcement learning research and interests, which focus on applying RL to real-world robotics applications. We explore the concept of reward supervision, and how to get robots to learn these reward functions from videos, and the rationale behind supervised experts in these experiments.
We also discuss the use of simulation for experiments, data collection, and the path to scalable robotic learning. Finally, we discuss gradient surgery vs gradient sledgehammering, and his ecological RL paper, which focuses on the “phenomena that exist in the real world” and how humans and robotics systems interface in those situations.