One Brain, Any Body: Google DeepMind's Keerthana on Gemini Robotics 2, Cross-Embodiment & Humanoids
Keerthana Gopalakrishnan, Research Lead for Gemini Robotics at Google DeepMind, returns to discuss the release of Gemini Robotics 2, whole-body intelligence, and the pursuit of generalist humanoid robots. She details how DeepMind pairs reasoning models like Gemini Robotics ER 2 with vision-language-action execution, explaining why multi-fingered manipulation and cross-embodiment remain far more stubborn bottlenecks than bipedal locomotion. Together, they examine the real-world stakes of bringing physical AI into human environments, addressing crucial trade-offs across inference latency, sensor failures, and operational safety where errors carry immediate physical consequences.
For full show notes, links, and references, read the episode page:
https://www.cognitiverevolution.ai/one-brain-any-body-google-deepmind-s-keerthana-on-gemini-robotics-2-cross-embodiment-humanoids/
Sponsors:
Athena: Athena matches you with a dedicated, top 1% executive assistant to handle your inbox, calendar, and daily workflows so you can save an average of 15 hours a week. Get matched with your EA today at https://athena.com/cognitive
Parallel: Parallel provides enterprise-grade web search APIs for AI agents, offering the optimal balance of quality, speed, and cost. Get started for free at https://parallel.ai/tcr
Deepgram Flux TTS: Deepgram Flux TTS is a streaming text-to-speech model built for voice agents with natural tone, context awareness, and interruption handling. Try it free until September 12 at https://deepgram.com/keep-talking
OutSystems: OutSystems is the leading agentic systems platform, helping enterprises build, modernize, and operate mission-critical applications at the speed of AI. Learn more and start owning your agentic future at https://outsystems.com/tcr
Claude: Claude is the AI collaborator for problem solvers, helping with writing, coding, financial models, strategy, and more. Get started with Claude and explore Claude Pro at https://claude.ai/tcr
CHAPTERS:
(00:00) About the Episode
(04:22) Humanoid Olympics and simulation
(11:11) Generalization versus task mastery
(21:22) Gemini Robotics 2 architecture (Part 1)
(21:28) Sponsors: Athena | Parallel
(24:19) Gemini Robotics 2 architecture (Part 2) (Part 1)
(36:02) Sponsors: Deepgram Flux TTS | OutSystems | Claude
(40:00) Gemini Robotics 2 architecture (Part 2) (Part 2)
(48:28) Whole body humanoid control
(57:03) Progress in robotic hands
(01:03:26) Safety and robot interaction
(01:12:11) Future of robotics data
(01:18:47) Interacting with robot fleets
(01:26:56) Episode Outro
(01:30:05) Outro
PRODUCED BY:
https://aipodcast.ing
Gemini Robotics – AI for the Physical World, with Keerthana Gopalakrishnan and Ted Xiao of Google DeepMind
In this engaging episode of the Cognitive Revolution, host Nathan Labenz welcomes guests Keerthana Gopalakrishnan and Ted Xiao to revisit significant advancements in robotics over the past year. Key themes discussed include the proliferation of new robotics companies, the emergence of humanoid robots, and the development of sophisticated foundation models. The conversation highlights the transformative potential of imitation learning, the evolution from simple lab-based tasks to complex, real-world deployments, and the critical role of hardware in pushing the boundaries of AI capabilities. With insights on various aspects of robot dexterity, safety, and the practical steps towards deploying robots in everyday environments, the episode provides a comprehensive overview of the current state and future directions of the robotics landscape.
Upcoming Major AI Events Featuring Nathan Labenz as a Keynote Speaker
https://www.imagineai.live/
https://adapta.org/adapta-summit
https://itrevolution.com/product/enterprise-tech-leadership-summit-las-vegas/
SPONSORS:
ElevenLabs: ElevenLabs gives your app a natural voice. Pick from 5,000+ voices in 31 languages, or clone your own, and launch lifelike agents for support, scheduling, learning, and games. Full server and client SDKs, dynamic tools, and monitoring keep you in control. Start free at https://elevenlabs.io/cognitive-revolution
Oracle Cloud Infrastructure (OCI): Oracle Cloud Infrastructure offers next-generation cloud solutions that cut costs and boost performance. With OCI, you can run AI projects and applications faster and more securely for less. New U.S. customers can save 50% on compute, 70% on storage, and 80% on networking by switching to OCI before May 31, 2024. See if you qualify at https://oracle.com/cognitive
The AGNTCY: The AGNTCY is an open-source collective dedicated to building the Internet of Agents, enabling AI agents to communicate and collaborate seamlessly across frameworks. Join a community of engineers focused on high-quality multi-agent software and support the initiative at https://agntcy.org/
Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive
NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive
PRODUCED BY:
https://aipodcast.ing
Robotics Research Update, with Keerthana Gopalakrishnan and Ted Xiao of Google DeepMind
Google DeepMind researchers Keerthana Gopalakrishnan and Ted Xiao discuss their latest breakthroughs in AI robotics. Including models that enable robots to understand novel objects, learn from human demonstrations, and operate under ethical constraints. The conversation covers six groundbreaking papers that showcase rapid progress towards general-purpose robotics.
SPONSORS:
The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/
Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access.
Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.
CHAPTERS :
(00:00) Introduction
(04:44) The Future of Robotics
(14:40) Sponsors : Brave / Omneky
(16:04) Inputs and Outputs
(24:03) A Leap Towards Generalist Robots
(32:08) Sponsors : Plumb / Squad
(33:52) Learning in Robotics
(41:12) Learning from On-the-Fly Examples
(41:57) Annotating Robot Actions
(50:17) Scaling and Safety
(01:03:05) Learning to Learn Faster
(01:08:43) Zero-Shot Learning
(01:15:15) Future Directions
E12: The Robot Revolution with Keerthana Gopalakrishnan of Google Robotics
Nathan Labenz talks to Google Robotics researcher Keerthana Gopalakrishnan (@keerthanpg) about how they train robots at Google, and how robots contextualize their environment and complete tasks through supervised learning. They go deep on integrating language models for commands and how to approach translating them, as well as the importance of robotics safety. Keerthana also shares how we’re using robots to better understand ourselves, personal experiences using AI, and her hopes and fears about AI's impact on society.
This episode provides valuable insights into the current state and potential future of robotics and AI, with Keerthana's expertise offering unique perspectives on these fascinating topics.
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
RECOMMENDED PODCAST:
The HR industry is at a crossroads. What will it take to construct the next generation of incredible businesses – and where can people leaders have the most business impact? Hosts Nolan Church and Kelli Dragovich have been through it all, the highs and the lows – IPOs, layoffs, executive turnover, board meetings, culture changes, and more. With a lineup of industry vets and experts, Nolan and Kelli break down the nitty-gritty details, trade offs, and dynamics of constructing high performing companies. Through unfiltered conversations that can only happen between seasoned practitioners, Kelli and Nolan dive deep into the kind of leadership-level strategy that often happens behind closed doors. Check out the first episode with the architect of Netflix’s culture deck Patty McCord.
https://link.chtbl.com/hrheretics
(0:00) Preview to episode
(0:51) Sponsor
(1:09) Intro
(5:20) GPT analogy for robotics
(6:51) Domestic robots
(10:53) Description of Google robotics
(15:17) Controlling robots and supervised learning
(18:50) How robots complete tasks
(26:17) Using data to train robots
(30:45) Data operability
(36:02) Integrating language models for commands
(38:58) How to approach translating commands
(42:49) How robots contextualize their environment
(47:02) Approach to robotics safety
(51:02) Tasks that robots can’t/shouldn’t do
(54:08) The hard bounds of robotics
(59:17) Frequency of inference
(1:03:50) Form factor in robotics
(1:08:38) Using robots to better understand ourselves
(1:12:23) Having robot friends and spouses
(1:17:44) Inference and latency
(1:19:17) The Google Robotics team
(1:21:07) AI tools Keerthana uses in her personal life
SPONSORS:
Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive
*Thank you Omneky* for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
Twitter:
@CogRev_Podcast
@keerthanpg (Keerthana)
@labenz (Nathan)
Join 1000's of subscribers of our Substack: https://cognitiverevolution.substack
Websites:
cognitivervolution.ai
omneky.com
https://research.google/research-areas/robotics/
https://research.google/teams/brain/