The Future of AI Infrastructure with CoreWeave
As AI applications become more complex, the infrastructure powering them needs to evolve. Corey Sanders, SVP of Product at CoreWeave, joins Chris to discuss why AI requires a fundamentally different approach than traditional cloud computing. They explore AI-native infrastructure, training and inference workloads, the rise of agentic development, optimizing GPU performance, AI research workflows, and why the future of software will be built around AI-first experiences rather than websites and apps.
Featuring:
Corey Sanders – LinkedIn
Chris Benson – Website, LinkedIn, Bluesky, GitHub, X
Links:
CoreWeave
Sponsors:
Framer: The enterprise-grade website builder that lets your team ship faster. Get 30% off at framer.com/practicalai
Upcoming Events:
Register for upcoming webinars here!
Midwest AI Summit 2026
How CoreWeave Sees the Market for Compute Right Now
When we last spoke to Brannin McBee, the co-founder and chief development officer of cloud company CoreWeave, his business was not yet public and sourcing GPUs was a key constraint on growth. But three years later, things look pretty different. CoreWeave IPOed and has been raising money in the bond market too, as well as signing more deals with chipmaker Nvidia. In fact, investors have basically been throwing money at all-things-AI. But there are persistent bottlenecks to further growth. Chip supply is still scarce, but so are transformers and electricity. In this episode, we catch up with Brannin on everything he's seeing in the market for compute right now, including leases, Nvidia's new Vera Rubin systems, demand for training versus inference, and the possibility of standardizing the market for compute.
Read more:Trump Officials Worry US Loophole Let Chinese Firms Buy Nvidia Blackwell ChipsBroadcom Slides Most Since January 2025 on AI Outlook Miss
Only http://Bloomberg.com subscribers can get the Odd Lots newsletter in their inbox each week, plus unlimited access to the site and app. Subscribe at bloomberg.com/subscriptions/oddlots
Subscribe to the Odd Lots NewsletterJoin the conversation: discord.gg/oddlots
See omnystudio.com/listener for privacy information.
Do you have what it takes to run AI in production?
From the floor of HumanX, Ryan Donovan is joined by Peter Salanki, CTO and co-founder of CoreWeave, to chat about what it really takes to run AI in production; the growing importance of observability, utilization, and scheduling; and Peter’s advice for avoiding the trap of over-architecting too early.
Episode note:
CoreWeave is the AI-native platform cloud that’s purpose-built for AI, combining next-generation infrastructure and intelligent tools to power the world’s most complex AI workloads.
Connect with Peter on X.
See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.
Four CEOs on the Future of AI: CoreWeave, Perplexity, Mistral, and IREN
(0:00) Intro live from Nvidia GTC
(0:37) CoreWeave CEO, Michael Intrator
(32:58) Perplexity CEO, Aravind Srinivas
(1:07:11) Mistral CEO, Arthur Mensch
(1:18:57) IREN CEO, Daniel Roberts
Our episode is sponsored by the New York Stock Exchange - a modern marketplace and exchange for building the future. It all happens at the NYSE - https://nyse.com
Follow the besties:
https://x.com/chamath
https://x.com/Jason
https://x.com/DavidSacks
https://x.com/friedberg
Follow on X:
https://x.com/theallinpod
Follow on Instagram:
https://www.instagram.com/theallinpod
Follow on TikTok:
https://www.tiktok.com/@theallinpod
Follow on LinkedIn:
https://www.linkedin.com/company/allinpod
Intro Music Credit:
https://rb.gy/tppkzl
https://x.com/yung_spielburg
Intro Video Credit:
https://x.com/TheZachEffect
Coreweave: AI Bubble Poster Child Or The Next Tech Giant? — With Michael Intrator and Brian Venturo
Michael Intrator is the CEO of Coreweave. Brian Venturo is the chief strategy officer at Coreweave. The two join Big Technology Podcast to discuss the company's rapid rise amid the AI boom and the criticisms of its business model. In this episode, we cover what it takes to build so many datacenters in such a short time, what happens to Coreweave if the AI boom flattens out, why the company uses debt to build its infrastructure, and how AI chips depreciate over time. Tune in to hear an in-depth, illuminating interview with the founding team of one of the AI moment's most fascinating and controversial companies.
---
Enjoying Big Technology Podcast? Please rate us five stars ⭐⭐⭐⭐⭐ in your podcast app of choice.
Want a discount for Big Technology on Substack + Discord? Here’s 25% off for the first year: https://www.bigtechnology.com/subscribe?coupon=0843016b
Learn more about your ad choices. Visit megaphone.fm/adchoices
Inside the $41B AI Cloud Challenging Big Tech | CoreWeave SVP
The future of AI training is shaped by one constraint: keeping GPUs fed.
In this episode, Lukas Biewald talks with CoreWeave SVP Corey Sanders about why general-purpose clouds start to break down under large-scale AI workloads.
According to Corey, the industry is shifting toward a "Neo Cloud" model to handle the unique demands of modern models.
They dive into the hardware and software stack required to maximize GPU utilization and achieve high goodput.
Corey’s conclusion is clear: AI demands specialization.
Connect with us here:
Corey Sanders: https://www.linkedin.com/in/corey-sanders-842b72/
CoreWeave: https://www.linkedin.com/company/coreweave/
Lukas Biewald: https://www.linkedin.com/in/lbiewald/
Weights & Biases: https://www.linkedin.com/company/wandb/
(00:00) Trailer
(00:57) Introduction
(02:51) The Evolution of AI Workloads
(06:22) Core Weave's Technological Innovations
(13:58) Customer Engagement and Future Prospects
(28:49) Comparing Cloud Approaches
(33:50) Balancing Executive Roles and Hands-On Projects
(46:44) Product Development and Customer Feedback
CoreWeave's CSO on the Business of Building AI Datacenters
Everyone knows that the AI boom is built upon the voracious consumption of chips (largely sold by Nvidia) and electricity. And while the legacy cloud operators, like Amazon or Microsoft, are in this space, the nature of the computing shift is opening up new space for new players in the market. One of the hottest companies is CoreWeave, a company backed in part by Nvidia, which has grown its datacenter business massively. So how does their business actually work? How do they get energy? Where do they locate operations? How are they financed? What's the difference between a cloud AI and a legacy cloud? On this episode, we speak with CoreWeave's Chief Strategy Officer Brian Venturo about what it takes to build out operations at this scale.
See omnystudio.com/listener for privacy information.
CoreWeave’s Brannin McBee on the future of AI infrastructure, GPU economics, & data centers | E1925
This Week in Startups is brought to you by…
OpenPhone. Create business phone numbers for you and your team that work through an app on your smartphone or desktop. TWiST listeners can get an extra 20% off any plan for your first 6 months at http://www.openphone.com/twist
Gusto is easy online payroll, benefits, and HR built for modern small businesses. Get three months free when you run your first payroll at Gusto.com/twist.
*Gusto pricing shown in ad is based on pricing prior to March 2025
Northwest Registered Agent. Northwest Registered Agent will form your business quickly and easily. For just $39 plus state fees, Northwest will handle your complete business identity. Visit https://www.northwestregisteredagent.com/twist today.
*
Todays show:
Brannin McBee joins Jason to discuss CoreWeave’s transition from cryptocurrency to AI (3:36), the energy dynamics of GPUs (14:04), innovations in data center cooling (19:28), and the future challenges and impacts of AI infrastructure on industries like search, advertising, and e-commerce (45:36).
*
Timestamps:
(00:00) CoreWeave’s Brannin McBee joins Jason
(3:36) The founding story of CoreWeave and the transition from the cryptocurrency market to AI
(12:49) OpenPhone - Get 20% off your first six months at http://www.openphone.com/twist
(14:04) Energy reliance of GPUs, the future of data centers, and the cost and efficiency of GPU cloud infrastructure
(19:28) Direct-to-chip liquid cooling and other cooling solutions for GPUs
(24:52) Demand trends for GPU capacity and the growth of inference linked to user growth
(29:06) Gusto - Get three months free when you run your first payroll at http://gusto.com/twist
(30:28) LPUs Vs. GPUs
(34:13) Dominance of Nvidia in training models, implications of open source chips and chip architecture
(39:01) Northwest Registered Agent - For just $39 plus state fees, Northwest will handle your complete business identity. Visit https://www.northwestregisteredagent.com/twist today.
(40:00) Challenges in training large language models and the use of infrastructure as a weapon by big tech
(45:36) The potential impact of AI on search engines, advertising sector, and ecommerce
(52:46) Timeline for supply-demand balance in AI infrastructure and the operational feat of running multiple data centers
*
Subscribe to This Week in Startups on Apple: https://rb.gy/v19fcp
*
Follow Brannin:
X: https://twitter.com/branninmcbee
LinkedIn: https://www.linkedin.com/in/branninmcbee
*
Follow Jason:
X: https://twitter.com/Jason
LinkedIn: https://www.linkedin.com/in/jasoncalacanis
*
Thank you to our partners:
(12:49) OpenPhone - Get 20% off your first six months at http://www.openphone.com/twist
(29:06) Gusto - Get three months free when you run your first payroll at http://gusto.com/twist
*Gusto pricing shown in ad is based on pricing prior to March 2025
(39:01) Northwest Registered Agent - For just $39 plus state fees, Northwest will handle your complete business identity. Visit https://www.northwestregisteredagent.com/twist today.|
*
Great 2023 interviews: Steve Huffman, Brian Chesky, Aaron Levie, Sophia Amoruso, Reid Hoffman, Frank Slootman, Billy McFarland
*
Check out Jason’s suite of newsletters: https://substack.com/@calacanis
*
Follow TWiST:
Substack: https://twistartups.substack.com
Twitter: https://twitter.com/TWiStartups
YouTube: https://www.youtube.com/thisweekin
Instagram: https://www.instagram.com/thisweekinstartups
TikTok: https://www.tiktok.com/@thisweekinstartups
*
Subscribe to the Founder University Podcast: https://www.founder.university/podcast
How to Build the Ultimate GPU Cloud to Power AI
Artificial Intelligence is all the rage right now and most of the investor excitement has so far been focused on the companies providing the hardware and computing power to actually run this new technology. So how does it all work and what does it actually take to run these complex models? On this episode, we speak with Brannin McBee, co-founder of CoreWeave, which provides cloud computing services based on GPUs, the type of chips pioneered by Nvidia and which have now become immensely popular for generative AI. He walks us through the infrastructure involved in powering AI, how difficult it is to get chips right now, who has them, and how the landscape might change in the future.
See omnystudio.com/listener for privacy information.
Data Centers, Crypto Miners, and Gamers Are All Battling for Semiconductors
These days, there's a shortage of chips everywhere you look. Some of it is related to idiosyncratic events specifically related to logistics. Some of it is related to production challenges relating to long, pre-existing trends. And other aspects are simply related to the fierce battle for chips among a range of players. On this episode, we speak with Brian Venturo, the CTO of CoreWeave, a cloud services provider about serving his clients, the role of crypto mining in tightening the chip market, and other players, like gamers, who are looking for more computing power.
See omnystudio.com/listener for privacy information.
Microsoft & the Next Level of Transformation with Corey Sanders
About Corey Sanders:
Corey Sanders is the Corporate Vice President for Microsoft Solutions, an organization dedicated to partnering with customers as they transform into successful digital businesses.
He is responsible for sales strategy and corporate technical sales across Solution Areas and Teams that include Azure Applications & Infrastructure, Azure Data & AI, Business Applications, Cybersecurity Solutions Group, and Modern Workplace. His focus also includes selling the full value of Microsoft cross-cloud solutions and advancing the technical depth of the Microsoft Solutions team.
Prior to this role, Corey was Head of Product for Azure Compute and the founder of Microsoft Azure’s infrastructure as a service (IaaS) business. During that time, he was responsible for products, strategy and technical vision aligned to core Azure compute services. He also previously led program management for multiple Azure services. Earlier in his career, Corey was a developer in the Windows Serviceability team with ownership across the networking and kernel stack for Windows.
Corey joined Microsoft in 2004 after graduating from Princeton University and resides in New Jersey.
Links Referenced:
Microsoft: https://www.microsoft.com/
Twitter: https://twitter.com/coreysanderswa
LinkedIn: https://www.linkedin.com/in/corey-sanders-842b72/
Episode 65: Cloud Coreyography Mark 2 with Azure’s Corey Sanders
About Corey Sanders
Corey Sanders has 15 years of experience at Microsoft with 13 years of managerial experience. In the last 9 years, Corey has been in the Azure team building the Azure Compute service, and he recently moved into a new role as Corporate Vice President for Microsoft Solutions.
Links Referenced
Twitter: @CoreySandersWA
Microsoft Azure
The impact of AI at Microsoft (Interview)
We’re on location at Microsoft Build 2018 talking with Corey Sanders and Steve Guggenheimer — two Microsoft veterans focused on artificial intelligence and cloud computing. We talked about the direction and convergence of AI, ethics, cloud computing, and how the day to day lives of developers will change because of the advancements in AI.
Join the discussion
Changelog++ members support our work, get closer to the metal, and make the ads disappear. Join today!
Sponsors:
Airbrake – Airbrake is an exception reporting service, currently providing error monitoring for 50,000 applications with support for 18 programming languages.
Linode – Our cloud server of choice. Deploy a fast, efficient, native SSD cloud server for only $5/month. Get 4 months free using the code changelog2018. Start your server - head to linode.com/changelog
GoCD – GoCD is an on-premise open source continuous delivery server created by ThoughtWorks that lets you automate and streamline your build-test-release cycle for reliable, continuous delivery of your product.
Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com.
Featuring:
Corey Sanders – GitHub, X
Steve Guggenheimer – Website, X
Adam Stacoviak – Website, GitHub, LinkedIn, Mastodon, X
Jerod Santo – Website, GitHub, LinkedIn, Mastodon, X
Show Notes:
We’re releasing this AI focused show in conjunction with the launch of Practical AI — our newest podcast, hosted by Chris Benson and Daniel Whitenack. This show is focused on making artificial intelligence practical, productive, and accessible to everyone.
Learn more and subscribe at changelog.com/practicalai.
Microsoft Build 2018
Microsoft AI
Azure Compute
The Future Computed: Artificial Intelligence and its role in society
Corey Sanders on the Azure blog
OpenAI
Something missing or broken? PRs welcome!
Episode 9: Cloud Coreyography
Microsoft has experienced a renaissance. By everything that we've seen coming out of Microsoft over the past few years, it feels like the company is really walking the walk. Instead of just talking about how it’s innovative, it’s demonstrating that. Microsoft has been on an amazing journey, making the progression from telling customers what they need to listening to them and responding by building what they ask for.
Today, we’re talking to Corey Sanders, Corporate Vice President of Azure Compute at Microsoft.
Some of the highlights of the show include:
Customers are asking for Microsoft to help them through support and enabling platforms
Storytelling efforts through advocates, who play a double role – engaging and defending Microsoft
Customers moving to the Cloud are focused on a continuum and progression; they have stuff to move from one location to another and want all the benefits–better agility, faster startup time, etc.
Virtual serial console into existing VMs; this is how people are using this and Microsoft is going to, if not encourage this behavior, at least support it
Microsoft is the only Cloud with a single-instance SLA
Serial consoles: Windows' has seen less usage, partly due to operational aspects of Windows vs. Linux. It's not a GUI; it's scripting.
Does the operating system matter? From a Cloud perspective, it shouldn't have to matter; you should be able to deploy it the way you want
Edge enables much more complex and segregated scenarios; that combination with cognitive searches running locally will make it accessible anywhere
Branding challenge as customers start to notice that devices are smarter and more complex; will they lose awareness that Microsoft Azure is powering most of these things - they shouldn’t care
An awareness of not just what's possible, but what's coming; the democratization of AI
Education and fear gap of trying something new and taking that first step; make products and services stupid and simple to use
Customers return to add cognitive services and AI capabilities to existing, running deployments, environments, and applications
Multi-Cloud solutions can be successful, but there's a caveat; they’re actually built on a service-by-service perspective
Azure Stack, offers consistency, but some people may place blame on it for poor data center management practices; some expectations and regulations may be frustrating to some customers, but lets Microsoft offer a consistent experience
Freedom and flexibility have been challenges for Microsoft and other products for private Clouds
What people need to understand about Azure, including from a durability and reliability experience
To some extent, scale becomes a necessary prerequisite for some applications
Microsoft has taken many steps and is the leader in various areas
Links:
ReactiveOps
Microsoft Azure
Corey Sanders on Twitter
The Robot Uprising Will Have Very Clean Floors
Kubernetes
Cassandra
Azure Stack
.
