Inside Anthropic’s trillion-dollar AI gamble
Today, I’m joined by Joey Brookhart, an analyst at the chip and AI research firm SemiAnalysis, to help me dig into the story inside the massive Anthropic IPO filing.
This isn’t just about a single company’s financials, or its lofty ambitions or frankly ludicrous risk factors, which include maybe automating every job or, you know, killing everyone. It’s also the clearest look yet at how the business of frontier AI actually works and who’s really paying for it.
Read the full interview transcript on The Verge.
Links:
Anthropic files for its IPO | The Verge
Five weird details from Anthropic’s IPO filing | The Verge
Anthropic’s elaborate plan to keep Wall Street at bay | The Verge
Anthropic revenue jumps to $16.8B in quarter before IPO | Bloomberg
Anthropic raises concerns | Matt Levine
Anthropic reveals skyrocketing growth in IPO filing | NYT
The Anthropic IPO financials sneak peak | SemiAnalysis
Subscribe to The Verge to access the ad-free version of Decoder!
Credits:
Decoder is a production of The Verge and part of the Vox Media Podcast Network.
Decoder’s producers are Greg Ott, Kate Cox, and Nick Statt. This episode was edited by Ursa Wright. Our editorial director is Kevin McShane.
The Decoder music is by Breakmaster Cylinder.
Learn more about your ad choices. Visit podcastchoices.com/adchoices
Can AI Keep Growing Exponentially? Let’s Ask SemiAnalysis — With Dylan Patel and Jordan Nanos
Dylan Patel is founder and CEO of SemiAnalysis, Jordan Nanos is a member of its technical staff. Patel and Nanos join Big Technology to discuss whether AI’s massive infrastructure buildout can justify the trillions of dollars being spent on compute. Tune in to hear how big the boom could get, where the revenue needed to support it will come from, and what it could mean for knowledge work and the broader economy. We also cover Nvidia’s role in financing AI infrastructure, the economics and security of neoclouds, Anthropic’s potential IPO, Oracle’s AI bet, and whether frontier labs are keeping their best models to themselves. Hit play for a deep look at the financial and technical machinery powering the AI boom, and what could happen if it keeps accelerating.
---
Enjoying Big Technology Podcast? Please rate us five stars ⭐⭐⭐⭐⭐ in your podcast app of choice.
Want a discount for Big Technology on Substack + Discord? Here’s 25% off for the first year: https://www.bigtechnology.com/subscribe?coupon=0843016b
Learn more about your ad choices. Visit megaphone.fm/adchoices
What could slowing the AI frontier mean for the economy?
The AI industry appears to be getting more serious about safety.
Leaders of top companies signed a non-binding agreement at the White House Sept. 30, laying out standards and best practices for responsible development of advanced AI. OpenAI delayed the release of its latest model due to safety concerns. And Anthropic CEO Dario Amodei called on the sector to slow things down and "pace the frontier."
Wall Street initially wasn't too happy about that push and stocks related to the AI buildout took a momentary tumble.
But Jordan Nanos, at the chip research and consulting firm SemiAnalysis, argues that greater investment in AI security could actually drive more demand for computing power.
Dylan Patel – Anthropic & OpenAI will have most of the world’s compute by 2028
Had a lot of fun chatting again with my twin brother Dylan Patel.
We went through lab economics over the next few years - the shift from inference to training as RSI draws near; and how Anthropic and OpenAI are on track to control most of the world’s usable FLOPs within the next few years (because they can monetize compute better and thus outbid everyone).
And then we discuss whether the >$10T of total AI capex we’ll see by the end of the decade will cause a sovereign debt crisis, where hyperscaler debt raises interest rates, drives non-AI exposed countries into bankruptcy, and crashes non-AI equities.
One question we weren’t able to resolve is whether there’s anything that can counter all the forces barrelling towards centralization in this industry - the economies of scale in training, the scarcity of compute, and eventually continual learning and RSI.
Watch on YouTube; read the transcript.
Sponsors
* Grok Bot has been quite helpful with my search for a new editor. I created a recruiter bot and described the type of editor I was looking for. That bot then spun up a handful of subagents that combed through my emails and X DMs, read the end credits of various documentaries I like, and figured out who edits for some of my favorite YouTubers. It took all of those results, and then delivered me a shortlist of candidates that matched my criteria. Try Grok Bot for yourself at x.ai/bot
* Antithesis lets you add time travel to your software testing toolkit. Since the Antithesis platform is fully deterministic, everything that happens inside of it is perfectly reproducible. So if your software crashes, you can rewind to the exact right moment, freeze time, and investigate. Or you can test different hypotheses by perturbing the system: kill a node or disable a feature, see what happens, then reset the trajectory and try something else. Learn more at antithesis.com/dwarkesh
* Jane Street is hiring for two separate ML internships right now, one focused primarily on research and one focused on engineering. In both cases, interns are expected to contribute to real work, not contrived exercises: one common project is adapting a frontier LLM paper to financial markets, which tend to come with a ton of different gnarly challenges. Importantly, you don’t need any finance background to apply. 2027 applications are open now at janestreet.com/dwarkesh
Timestamps
(00:00:00) – Two labs will soon control most of the world’s compute
(00:07:01) – $6 billion in fab capex enables $1t+ of end revenue
(00:13:08) – Compute prices will rise if the labs outbid everyone
(00:18:22) – Which layer will capture most of the surplus?
(00:25:40) – What could slow down progress?
(00:29:43) – Labs are shifting compute from inference to R&D
(00:33:27) – China gets less than 10% of new compute, but its labs need less
(00:48:48) – Will AI cause a sovereign debt crisis?
(01:07:52) – Will the world’s future workforce belong to a few companies?
This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit www.dwarkesh.com
From the Archive: Can Anyone Catch NVIDIA? | The Future of Chips and Infrastructure
As part of our summer replay series, we're revisiting one of our favorite conversations on the future of AI infrastructure.
SemiAnalysis founder Dylan Patel joins Erin Price-Wright, Guido Appenzeller, and Erik Torenberg to examine the rapidly evolving economics of AI hardware, from GPUs and custom silicon to data centers, power, and the global race for compute.
The conversation explores NVIDIA's competitive advantages, the rise of custom chips from Google, Amazon, and Meta, the economics of frontier AI models, and the infrastructure constraints shaping the industry's next phase. They also discuss AI startups, export controls, robotics, enterprise software, and why simply copying NVIDIA isn't enough to build a winning AI hardware company.
Whether you're building AI products, investing in infrastructure, or trying to understand where the industry is headed, this conversation offers a practical look at the forces shaping the future of compute.
Resources:
Follow Dylan Patel on X: https://x.com/dylan522p
Follow Erin Price-Wright on X: https://x.com/espricewright
Follow Guido Appenzeller on X: https://x.com/appenz
Learn more about SemiAnalysis: https://semianalysis.com/dylan-patel/
Stay Updated:
Find a16z on YouTube: YouTube
Find a16z on X
Find a16z on LinkedIn
Listen to the a16z Show on Spotify
Listen to the a16z Show on Apple Podcasts
Follow our host: https://twitter.com/eriktorenberg
Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.
Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.
Why Hardware-Software Co-Design Is AI's Real 100x: Dylan Patel of SemiAnalysis
Dylan Patel, founder of SemiAnalysis, argues the biggest gains in AI don't come from faster chips, they come from software-hardware co-design. Optimizing the model, the kernels, and the silicon together turns a 2x here and a 2x there into 100x. He explains why DeepSeek's experts were shaped for Nvidia's Hopper (and why TPUs struggle to run it), why OpenAI's sparser models and Anthropic's denser ones pull them toward different hardware, and why the so-called CUDA moat was never really about CUDA. Dylan breaks down InferenceX, his living benchmark that runs the latest models on over $50M of donated hardware daily, tracking a roughly 60x annual drop in cost per unit of quality. He makes the case that inference will be a bigger market than oil, that the compute crunch persists because models expand the value of useful work faster than compute grows, and why Jensen Huang is bankrolling neoclouds to engineer a multipolar world.
Hosted by Shaun Maguire and Sonya Huang, Sequoia Capital
Dylan Patel - The Infinite Demand for Tokens, Claude Mythos, and Supply Constraints - [Invest Like the Best, EP.469]
This is my second conversation with Dylan Patel. Dylan is the founder and CEO of SemiAnalysis, where he tracks the semiconductor supply chain and AI infrastructure buildout.
This conversation is about the supply and demand of tokens. On demand, Dylan describes something completely explosive. He explains why the frontier model is the only model anyone wants, and willingness to pay for it is nearly unbounded. His own firm has gone from tens of thousands of dollars in AI spend last year to seven million this year.
On supply, we walk through the bottlenecks across memory, logic, and fab equipment that will determine how fast any of this can scale.
We also cover Claude Mythos and what the leading labs need to do to fix their growing public perception problem.
For the full show notes, transcript, and links to mentioned content, check out the episode page here.
-----
Become a Colossus member to get our quarterly print magazine and private audio experience, including exclusive profiles and early access to select episodes. Subscribe at colossus.com/subscribe.
-----
Ramp’s mission is to help companies manage their spend in a way that reduces expenses and frees up time for teams to work on more valuable projects. Go to ramp.com/invest to sign up for free and get a $250 welcome bonus.
-----
Trusted by thousands of businesses, Vanta continuously monitors your security posture and streamlines audits so you can win enterprise deals and build customer trust without the traditional overhead. Visit vanta.com/invest.
-----
WorkOS is the infrastructure B2B and AI-native companies use to sell to enterprise. It covers everything enterprise security requires: SSO, SCIM, RBAC, Audit Logs, AI governance, and more. Trusted by 2,000+ fast-growing companies, including OpenAI, Anthropic, Cursor, and Vercel.
-----
Rogo is the AI platform for finance. They're building agents for Wall Street that are trained to understand how bankers and investors actually do work: from diligence and modeling, to turning analysis into deliverables. To learn more, visit rogo.ai/invest.
-----
Ridgeline has built a complete, real-time, modern operating system for investment managers. It handles trading, portfolio management, compliance, customer reporting, and much more through an all-in-one real-time cloud platform. Visit ridgelineapps.com.
-----
Editing and post-production work for this episode was provided by The Podcast Consultant (https://thepodcastconsultant.com).
Timestamps:
(00:00:00) Welcome to Invest Like The Best
(00:02:29) Intro: Dylan Patel
(00:03:09) Semi Analysis AI Spend: Zero to $7M
(00:05:16) Real-World Examples of Claude Code
(00:11:41) Token Demand: “Completely Explosive”
(00:14:48) Why Everyone Wants the Frontier Model
(00:15:36) Mythos: Biggest Model Capability Jump in Two Years
(00:20:54) Fear of Rapid Model Progress
(00:23:45) Robotics as the Next Demand Wave
(00:26:03) Scaling Laws & Compute Efficiency
(00:27:24) OpenAI vs. Anthropic
(00:31:33) Supply Side: Bottlenecks Across the Stack
(00:33:26) TSMC CapEx Could Cause a Shortage
(00:36:45) CPUs, ASICs, and FPGAs
(00:40:12) Tokenomics
(00:42:20) Protests & AI Backlash
Dylan Patel — Deep dive on the 3 big bottlenecks to scaling AI compute
Dylan Patel, founder of SemiAnalysis, provides a deep dive into the 3 big bottlenecks to scaling AI compute: logic, memory, and power.
And walks through the economics of labs, hyperscalers, foundries, and fab equipment manufacturers.
Learned a ton about every single level of the stack. Enjoy!
Watch on YouTube; read the transcript.
Sponsors
* Mercury has already saved me a bunch of time this tax season. Last year, I used Mercury to request W-9s from all the contractors I worked with. Then, when it came time to issue 1099s this year, I literally just clicked a button and Mercury sent them out. Learn more at mercury.com.
* Labelbox noticed that even when voice models appear to take interruptions in stride, their performance degrades. To figure out why, they built a new evaluation pipeline called EchoChain. EchoChain diagnoses voice models’ specific failure modes, letting you understand what your model needs to truly handle interruptions. Check it out at labelbox.com/dwarkesh.
* Jane Street is basically a research lab with a trading desk attached – and their infrastructure backs this up. They’ve got tens of thousands of GPUs, hundreds of thousands of CPU cores, and exabytes of storage. This is what it takes to find subtle signals hidden deep within noisy market data. If this sounds interesting, you can explore open positions at janestreet.com/dwarkesh.
Timestamps
(00:00:00) – Why an H100 is worth more today than 3 years ago
(00:24:52) – Nvidia secured TSMC allocation early; Google is getting squeezed
(00:34:34) – ASML will be the #1 constraint for AI compute scaling by 2030
(00:55:47) – Can't we just use TSMC's older fabs?
(01:05:37) – When will China outscale the West in semis?
(01:16:01) – The enormous incoming memory crunch
(01:42:34) – Scaling power in the US will not be a problem
(01:54:44) – Space GPUs aren't happening this decade
(02:14:07) – Why aren't more hedge funds making the AGI trade?
(02:18:30) – Will TSMC kick Apple out from N2?
(02:24:16) – Robots and Taiwan risk
Get full access to Dwarkesh Podcast at www.dwarkesh.com/subscribe
Claude Code for Finance + The Global Memory Shortage: Doug O'Laughlin, SemiAnalysis
This is a free preview of a paid episode. To hear more, visit www.latent.space
First speakers for AIE Europe and AIEi Miami have been announced. If you’re in Asia/Aus, come by Singapore and Melbourne. AI Engineering is going global!
One year ago today, Anthropic launched Claude Code, to not much fanfare:
The word of mouth was incredibly strong however, and so we were glad to be one of the first podcasts to invite Boris and Cat on in early May:
As we discussed on the pod, all CC usage was API-based and therefore it was ridiculously expensive to do anything. This was then fixed by the team including Claude Code in the Claude Pro plan in early June, and then the virality caused us to make a rare trend call in late June:
Now, 6 months on, Doug has just calculated that around 4% of GitHub is written by Claude Code:
We talk about how Doug uses Claude Code to do SemiAnalysis work.
Memory Mania
In the second part of this episode, we also check in on Memory Mania, which is going to affect you (yes, you) at home if it hasn’t already:
Full Episode on YouTube
Timestamps
00:00 AI as Junior Analyst00:59 Meet Swyx and Doug03:30 From Value Mule to Semis06:28 Moore’s Law Ends Thesis12:02 Claude Code Awakening32:02 Agent Swarms Reality Check32:53 Kimi Swarm Benchmarks37:31 Bots vs Zapier Automation39:44 Claude Code Workflow Setup57:54 AGI Metrics and GDP01:04:48 Railroad CapEx Analogy01:06:00 Funding Bubbles and Demand01:08:11 Agents Replace Work Tools01:13:56 Codex vs Claude Race01:21:15 Microsoft and TPU Strategy01:34:13 TPU Window vs Nvidia01:36:30 HBM Supply Chain Squeeze01:39:41 Memory Shock and CXL01:45:20 Context Rationing Future01:54:37 Writing and Trail Lessons
Transcript
[00:00:00] AI as Junior Analyst
[00:00:00] Doug: This crap makes mistakes all the time. All the time. It is still just like a, like I think of it once again as like a junior analyst, right? The analyst goes and does all this like really pain in the ass information and you bring it all together to make a good decision at the top. Historically what happens is that junior analyst, who I once was, went and gathered all that information, and after doing this enough times, there’s a meta level thinking that’s happening where it’s like, okay, here’s what I really understand and how this type of analysis, I’m an expert in, actually I’m very good at, I consistently have a hit rate.
[00:00:28] Now I’m the expert, right? I don’t think that meta level learning is there yet. We’ll see if l ones do it, right? Everyone who’s spending one quadrillion dollars in the world thinks it will, it better, it better happen by if you’re spending, you know, a trillion dollars and there’s not meta level learning.
[00:00:44] But for me, in our firm, that massively amplifies everyone who is an expert. ‘cause like you have to still do something that you can just like lop it up. It’s very obvious to me. What It’s slop.
[00:00:59] Meet Swyx and Doug
Ray Wang on How AI Is Causing DRAM Prices to Surge
For years, DRAM -- or Dynamic Random Access Memory -- was kind of a sleepy, commoditized aspect of chip industry. Growth was steady, but modest, and prices just generally drifted lower. Suddenly all that's changed. AI has created voracious demand for DRAM and consumer facing companies are being forced to either curtail supply or raise prices due to exploding costs. But what is it about AI that consumes so much memory, and when will the market rebalance itself? On this episode, we speak with Ray Wang, an analyst at SemiAnalysis, who recently co-authored a report titled, Memory Mania: How a Once-in-Four-Decades Shortage Is Fueling a Memory Boom. We discuss the implications of this memory boom, how producers are responding to surging prices, and whether or not the Chinese companies in the space can catch up to the Korean giants, such as Samsung and Hynix.
Subscribe to the Odd Lots Newsletter
Join the conversation: discord.gg/oddlots
See omnystudio.com/listener for privacy information.
Dylan Patel - Inside the Trillion-Dollar AI Buildout - [Invest Like the Best, EP.442]
My guest today is Dylan Patel. Dylan is the founder and CEO of SemiAnalysis. At SemiAnalysis Dylan tracks the semiconductor supply chain and AI infrastructure buildout with unmatched granularity—literally watching data centers get built through satellite imagery and mapping hundreds of billions in capital flows. Our conversation explores the massive industrial buildout powering AI, from the strategic chess game between OpenAI, Nvidia, and Oracle to why we're still in the first innings of post-training and reinforcement learning. Dylan explains infrastructure realities like electrician wages doubling and companies using diesel truck engines for emergency power, while making a sobering case about US-China competition and why America needs AI to succeed. We discuss his framework for where value will accrue in the stack, why traditional SaaS economics are breaking down under AI's high cost of goods sold, and which hardware bottlenecks matter most. This is one of the most comprehensive views of the physical reality underlying the AI revolution you'll hear anywhere. Please enjoy my conversation with Dylan Patel.
For the full show notes, transcript, and links to mentioned content, check out the episode page here.
-----
This episode is brought to you by Ramp. Ramp’s mission is to help companies manage their spend in a way that reduces expenses and frees up time for teams to work on more valuable projects. Go to Ramp.com/invest to sign up for free and get a $250 welcome bonus.
–
This episode is brought to you by Ridgeline. Ridgeline has built a complete, real-time, modern operating system for investment managers. It handles trading, portfolio management, compliance, customer reporting, and much more through an all-in-one real-time cloud platform. Head to ridgelineapps.com to learn more about the platform.
–
This episode is brought to you by AlphaSense. AlphaSense has completely transformed the research process with cutting-edge AI technology and a vast collection of top-tier, reliable business content. Invest Like the Best listeners can get a free trial now at Alpha-Sense.com/Invest and experience firsthand how AlphaSense and Tegus help you make smarter decisions faster.
-----
Editing and post-production work for this episode was provided by The Podcast Consultant (https://thepodcastconsultant.com).
Show Notes:
(00:00:00) Welcome to Invest Like the Best
(00:05:12) The AI Infrastructure Buildout
(00:08:25) Scaling AI Models and Compute Needs
(00:11:44) Reinforcement Learning and AI Training
(00:14:07) The Future of AI and Compute
(00:17:47) AI in Practical Applications
(00:22:29) The Importance of Data and Environments in AI Training
(00:29:45) Human Analogies in AI Development
(00:40:34) The Challenge of Infinite Context in AI Models
(00:44:08) The Bullish and Bearish Perspectives on AI
(00:48:25) The Talent Wars in AI Research
(00:56:54) The Power Dynamics in AI and Tech
(01:13:29) The Future of AI and Its Economic Impact
(01:18:55) The Gigawatt Data Center Boom
(01:21:12) Supply Chain and Workforce Dynamics
(01:24:23) US vs. China: AI and Power Dynamics
(01:37:16) AI Startups and Innovations
(01:52:44) The Changing Economics of Software
(01:58:12) The Kindest Thing
Dylan Patel on the AI Chip Race - NVIDIA, Intel & the US Government vs. China
Nvidia’s $5 billion investment in Intel is one of the biggest surprises in semiconductors in years. Two longtime rivals are now teaming up, and the ripple effects could reshape AI, cloud, and the global chip race.
To make sense of it all, Erik Torenberg is joined by Dylan Patel, chief analyst at SemiAnalysis, joins Sarah Wang, general partner at a16z, and Guido Appenzeller, a16z partner and former CTO of Intel’s Data Center and AI business unit. Together, they dig into what the deal means for Nvidia, Intel, AMD, ARM, and Huawei; the state of US-China tech bans; Nvidia’s moat and Jensen Huang’s leadership; and the future of GPUs, mega data centers, and AI infrastructure.
Resources:
Find Dylan on X: https://x.com/dylan522p
Find Sarah on X: https://x.com/sarahdingwang
Find Guido on X: https://x.com/appenz
Learn more about SemiAnalysis: https://semianalysis.com/dylan-patel/
Stay Updated:
If you enjoyed this episode, be sure to like, subscribe, and share with your friends!
Find a16z on X: https://x.com/a16z
Find a16z on LinkedIn: https://www.linkedin.com/company/a16z
Listen to the a16z Podcast on Spotify: https://open.spotify.com/show/5bC65RDvs3oxnLyqqvkUYX
Listen to the a16z Podcast on Apple Podcasts: https://podcasts.apple.com/us/podcast/a16z-podcast/id842818711
Follow our host: https://x.com/eriktorenberg
Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.
Stay Updated:
Find a16z on YouTube: YouTube
Find a16z on X
Find a16z on LinkedIn
Listen to the a16z Show on Spotify
Listen to the a16z Show on Apple Podcasts
Follow our host: https://twitter.com/eriktorenberg
Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.
Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.