Try OCI for free at http://oracle.com/eyeonai
This episode is sponsored by Oracle. OCI is the next-generation cloud designed for every workload – where you can run any application, including any AI projects, faster and more securely for less. On average, OCI costs 50% less for compute, 70% less for storage, and 80% less for networking.
Join Modal, Skydance Animation, and today's innovative AI tech companies who upgraded to OCI…and saved.
Why is AI moving from the cloud to our devices, and what makes on device intelligence finally practical at scale?
In this episode of Eye on AI, host Craig Smith speaks with Christopher Bergey, Executive Vice President of Arm's Edge AI Business Unit, about how edge AI is reshaping computing across smartphones, PCs, wearables, cars, and everyday devices.
We explore how Arm v9 enables AI inference at the edge, why heterogeneous computing across CPUs, GPUs, and NPUs matters, and how developers can balance performance, power, memory, and latency. Learn why memory bandwidth has become the biggest bottleneck for AI, how Arm approaches scalable matrix extensions, and what trade offs exist between accelerators and traditional CPU based AI workloads.
You will also hear real world examples of edge AI in action, from smart cameras and hearing aids to XR devices, robotics, and in car systems. The conversation looks ahead to a future where intelligence is embedded into everything you use, where AI becomes the default interface, and why reliable, low latency, on device AI is essential for creating experiences users actually trust.
Stay Updated: Craig Smith on X: https://x.com/craigss Eye on A.I. on X: https://x.com/EyeOn_AI
(0:00) Introducing Arm CEO Rene Haas
(1:08) Lessons from working with Jensen Huang
(3:20) Arm's history, understanding Nvidia's dominance in AI, training vs inference, physical AI market size
(10:01) China's AI ecosystem, the US-Intel deal, rare earths, creating a US "national champion"
(15:35) Manufacturing in America: how to create a culture of excellence?
(18:34) US export controls, building in the UK
(23:42) US-China AI arms race
Thanks to our partners for making this happen!
Solana - Solana is the high performance network powering internet capital markets, payments, and crypto applications. Connect with investors, crypto founders, and entrepreneurs at Solana's global flagship event during Abu Dhabi Finance Week & F1: https://solana.com/breakpoint
OKX - The new way to build your crypto portfolio and use it in daily life. We call it the new money app. https://www.okx.com/
Google Cloud - The next generation of unicorns is building on Google Cloud's industry-leading, fully integrated AI stack: infrastructure, platform, models, agents, and data. https://cloud.google.com/
IREN - IREN AI Cloud, powered by NVIDIA GPUs, provides the scale, performance, and reliability to accelerate your AI journey. https://iren.com/
Oracle - Step into the future of enterprise productivity at Oracle AI Experience Live. https://www.oracle.com/artificial-intelligence/data-ai-events/
Circle - The America-based company behind USDC — a fully-reserved, enterprise-grade stablecoin at the core of the emerging internet financial system. https://www.circle.com/
BVNK - Building stablecoin-powered financial infrastructure that helps businesses send, store, and spend value instantly, anywhere in the world. https://www.bvnk.com/
Polymarket: https://www.polymarket.com
Follow Rene: https://x.com/renehaas237
Follow the besties:
https://x.com/chamath
https://x.com/Jason
https://x.com/DavidSacks
https://x.com/friedberg
Follow on X:
https://x.com/theallinpod
Follow on Instagram:
https://www.instagram.com/theallinpod
Follow on TikTok:
https://www.tiktok.com/@theallinpod
Follow on LinkedIn:
https://www.linkedin.com/company/allinpod
Intro Music Credit:
https://rb.gy/tppkzl
https://x.com/yung_spielburg
Ryan welcomes Geraint North, AI and developer platforms fellow at Arm, to dive into the impact of GenAI on chip design, Arm’s approach to designing flexible CPU architectures, and the challenges of optimizing large language models at the chip level for edge devices.
Episode notes:
Arm is a global compute platform that allows the world’s leading technology companies to innovate and deliver AI experiences.
Arm just announced their Lumex CSS Platform, which provides a complete compute subsystem platform for mobile and desktop providers to enable efficient AI workloads.
Connect with Geraint on LinkedIn.
Congrats to Lifejacket badge winner I.sh., who won the badge for answering How to take screenshot on failure.
See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.
At Arm, open source is the default approach, with proprietary software requiring justification, says Andrew Wafaa, fellow and senior director of software communities. Speaking at KubeCon + CloudNativeCon Europe, Wafaa emphasized Arm’s decade-long commitment to open source, highlighting its investment in key projects like the Linux kernel, GCC, and LLVM. This investment is strategic, ensuring strong support for Arm’s architecture through vital tools and system software.
Wafaa also challenged the hype around GPUs in AI, asserting that CPUs—especially those enhanced with Arm’s Scalable Matrix Extension (SME2) and Scalable Vector Extension (SVE2)—are often more suitable for inference workloads. CPUs offer greater flexibility, and Arm’s innovations aim to reduce dependency on expensive GPU fleets.
On the AI framework front, Wafaa pointed to PyTorch as the emerging hub, likening its ecosystem-building potential to Kubernetes. As a PyTorch Foundation board member, he sees PyTorch becoming the central open source platform in AI development, with broad community and industry backing.
Learn more from The New Stack about the latest insights about Arm:
Edge Wars Heat Up as Arm Aims to Outflank Intel, Qualcomm
Arm: See a Demo About Migrating a x86-Based App to ARM64
Join our community of newsletter subscribers to stay on top of the news and at the top of your game.
Open Source bi-weekly convo w/ Bill Gurley and Brad Gerstner on all things tech, markets, investing & capitalism. This week they are joined by a surprise guest, and discuss Stargate, executive orders, TikTok, DOGE, Public Valuations & more. Enjoy another episode of BG2!
Timestamps:
(00:00) Intro
(01:21) Stargate
(15:07) Dylan Patel and Semianalysis take on Stargate
(17:56) Stargate’s Impact on AI Competitive Landscape
(29:03) DeepSeek
(32:03) Special Guest Rene Haas (CEO of ARM Holdings)
(49:46) DeepSeek continued
(51:53) Trumps Executive Orders & Regulatory Freeze
(54:10) Coordination in AI Legistlation
(59:38) US National Debt and Balancing the Budget
(1:01:08) TikTok
(1:05:48) Tech Check
Produced by Benny Beausoleil
Music by Yung Spielberg
Available on Apple, Spotify, www.bg2pod.com
Follow:
Brad Gerstner @altcap
Bill Gurley @bgurley
Rene Haas @renehaas237
BG2 Pod @bg2pod https://x.com/BG2Pod
The hardware industry is surging, driven by AI's demanding workloads, with Arm—a 35-year-old pioneer in processor IP—playing a pivotal role. In an episode ofThe New Stack Makersrecorded at KubeCon + CloudNativeCon North America, Pranay Bakre, principal solutions engineer at Arm, discussed how Arm is helping organizations migrate and run applications on its technology.
Bakre highlighted Arm’s partnership with hyperscalers like AWS, Google, Microsoft, and Oracle, showcasing processors such as AWS Graviton and Google Axion, built on Arm’s power-efficient, cost-effective Neoverse IP. This design ethos has spurred wide adoption, with 90-95% of CNCF projects supporting native Arm binaries.
Attendees at Arm’s booth frequently inquired about its plans to support AI workloads. Bakre noted the performance advantages of Arm-based infrastructure, delivering up to 60% workload improvements over legacy architectures. The episode also features a demo on migrating x86 applications to ARM64 in both cloud and containerized environments, emphasizing Arm’s readiness for the AI era.
Learn more from The New Stack about Arm:
Arm Eyes AI with Its Latest Neoverse Cores and Subsystem
Big Three in Cloud Prompts ARM to Rethink Software
Join our community of newsletter subscribers to stay on top of the news and at the top of your game.
Alex Heath, Deputy Editor at The Verge, guest hosts this episode of Decoder featuring a live interview with Arm CEO Rene Haas about the future of AI and the semiconductor industry. The two discuss his thoughts on the struggles of Intel, the rumors Arm is developing its own AI chips to rival Nvidia’s, and his thoughts on the incoming Trump administration.
Links:
What Arm’s CEO makes of the Intel debacle | Command Line
How Arm conquered the chip market without making a single chip | Decoder
Arm could be the unexpected winner of the AI investment boom | FT
Arm to reportedly launch AI chips by 2025 to capture explosive demand | CNBC
Intel’s CEO is out after only three years | The Verge
What happened to Intel? | The Verge
Nvidia plans ARM-based PC platform to rival Intel, AMD | DigiTimes
Qualcomm x Arm beef escalates | The Verge
Transcript: https://www.theverge.com/e/24084728
Credits:
Decoder is a production of The Verge and part of the Vox Media Podcast Network.
Our producers are Kate Cox and Nick Statt. Our editor is Callie Wright. Our supervising producer is Liam James.
The Decoder music is by Breakmaster Cylinder.
Learn more about your ad choices. Visit podcastchoices.com/adchoices
ARM is an incredibly unlikely story. They were founded in Cambridge, England in 1990 to design a new chip architecture just for low-power devices (like the Apple Newton!), leaving the “serious computing” on desktop and servers to Intel’s x86. Now, nearly three decades later, ARM is the dominant architecture in all of computing today.
ARM is in your phone, your car, data centers, the most advanced AI chips… there are hundreds (or thousands!) of ARM chips you encounter in your everyday life. In this episode, ARM Holdings CEO Rene Haas joins us to tell the story of how ARM become so dominant, weaving through the through the iPod, smartphone, and AI eras. Plus, their wild corporate story of going public, getting bought by SoftBank, going public again, and nearly being acquired by NVIDIA!
Sponsors:
Sierra: https://bit.ly/acquiredsierra
One of the more interesting quirks of the modern tech world is that there’s a really important company at the center of it all that doesn’t make anything. But its work is in your phone, in your TV, your car and maybe even your laptop. I’m talking about ARM, a chip design company that’s been through quite a lot these past few years, and I'm talking to Arm CEO Rene Haas.
Arm designs the instruction sets for modern chips: Qualcomm’s chips are Arm chips. Apple’s chips are Arm chips. Samsung’s chips are Arm chips. It’s the heart of modern computing. Arm licenses the instruction set to those companies, who then go off and actually make chips with all sorts of customizations. Basically every smartphone runs an Arm processor, Apple’s Macs now run arm processors, and everything from cars to coffee machines are showing up with more and more arm processors in them.
We want to know what you think about Decoder. Take our listener survey!
Transcript:
https://www.theverge.com/e/23137412
Links:
The Vergecast: The HDMI Holiday Spec-tacular on Apple Podcasts
Biden signs $280 billion CHIPS and Science Act
Intel needs 7,000 workers to build its $20 billion chip plant in Ohio - The Verge
What comes after the smartphone, with Qualcomm CEO Cristiano Amon - The Verge
Why the global chip shortage is making it so hard to buy a PS5
Nvidia’s huge Arm deal has just been scrapped
What is a SoC?
What is an ECU?
Credits:
Decoder is a production of The Verge, and part of the Vox Media Podcast Network.
Today’s episode was produced by Creighton DeSimone and Jackie McDermott and it was edited by Callie Wright.
The Decoder music is by Breakmaster Cylinder. Our Sr Audio Director is Andrew Marino. Our Editorial Director is Brooke Minters. And our Executive Producer is Eleanor Donovan.
Learn more about your ad choices. Visit podcastchoices.com/adchoices
Rene Haas is the CEO @ Arm. The technologies that Arm creates are used in over 230+ Bn devices with everything from sensors to smartphones to servers. In 2016 Softbank made Arm it's largest ever acquisition with a reported price of $32Bn. As for Rene, he was appointed CEO in February 2022 having spent the last 8 years in numerous different roles within the company. Before Arm, Rene was Vice President & General Manager of the Computing Products Business Unit at Nvidia where he enjoyed a very successful 7 years with the team there.
In Today's Episode with Rene Haas We Discuss:
1.) Entry into Tech from Eastman Kodak:
How did Rene make his way into the world of technology and innovation?
What are 1-2 of the biggest takeaways from his 7 years at Nvidia?
How did working with Jensen impact his leadership approach and philosophy?
2.) Decision-Making in Leadership:
What is the single biggest mistake leaders make when making decisions today?
How does Rene balance the trade-off between speed vs quality of decision?
At what point does Rene believe leaders have enough data to make a decision?
What does Rene know now that he wishes he had known when he started on decisions?
3.) Scaling the Org and Remaining Nimble:
Agile: How does one retain the speed and agility of a startup when one is the size that Arm is today?
Ambition: How does Rene as a leader inspire the same level of ambition and vision in his team when Arm is as large as it is?
Risk: How does Rene encourage his teams to take large risks when they have so much more to lose?
Breakage: What are the first things to break in scaling? What can leaders do to get ahead of them?
4.) Leadership 101:
What really is strategy? What is it not? What mistakes do all leaders make when it comes to strategy?
How does Rene define "high performance" in leadership? How has his style of leadership changed over time?
How does Rene approach vulnerability in leadership? What are the pros and cons?
