Building AI for Creators | Luma & Phota Labs
Yoko Li speaks with Luma's Head of Applied Research Matt Tancik and Phota Labs cofounder and CTO Zach Xia about how AI is changing creativity, photography, and the tools people use to make art.
The conversation explores the evolving relationship between artists and AI, from image generation and personalization to creative workflows, controllability, and agentic design tools.
They discuss personalization, photography, creative software, model design, evaluation, and why the future of creative tools may depend less on generating content and more on helping people express ideas they couldn't easily realize before. Along the way, they explore AI agents, interfaces, and how creators are already using these tools in unexpected ways.
Resources:
Follow Matt on LinkedIn: https://www.linkedin.com/in/matthewtancik/
Follow Zach on LinkedIn: https://www.linkedin.com/in/zhihao-zach-xia/
Follow Yoko Li on X: https://x.com/stuffyokodraws
Stay Updated:
Find a16z on YouTube: YouTube
Find a16z on X
Find a16z on LinkedIn
Listen to the a16z Show on Spotify
Listen to the a16z Show on Apple Podcasts
Follow our host: https://twitter.com/eriktorenberg
Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.
Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.
Luma AI's Amit Jain on why most world model companies are getting it completely wrong
LLMs may have kicked off this AI boom, but the ceiling is closer than the hype suggests. As models run out of text data to train on, the companies and investors paying attention are already moving on. The next wave isn't better chatbots; it's machines that can understand the physical world. Luma AI, the Bay Area lab that raised over $1.4 billion from a16z, Nvidia, and Amazon, is betting on exactly that.
On episode of TechCrunch's Equity podcast, we’re bringing you a conversation Rebecca Bellan sat down with Amit Jain, co-founder and CEO of Luma AI, at Web Summit Qatar. Together, the pair dug into where the next trillion-dollar AI opportunity actually gets built, and whether the companies chasing it even know what they're building yet.
Listen to the full episode to hear about:
Why video, audio, and images are the real frontier for AI training data, not text
What an "intelligent world model" actually is, and why Jain thinks most companies building them are getting it completely wrong
The case for why AI won't kill creative jobs, and why Jain thinks studio heads are the real problem
How the path from video generation to robotics to AGI is simpler than anyone's making it sound
Subscribe to Equity on YouTube, Apple Podcasts, Overcast, Spotify and all the casts. You also can follow Equity on X and Threads, at @EquityPod.
Chapters:
00:00 Intro
01:13 Why LLMs are hitting a ceiling
02:43 The data problem & what comes after LLMs
04:30 What actually makes a world model a world model
06:05 Why 3D data is a dead end
07:39 What Luma is building next
09:08 How much humans stay in the loop
10:00 Near-term use cases for agentic video
11:22 Will AI kill jobs in film & production?
13:30 Why the entertainment industry is already dying
15:27 Why we actually need more content, not less
17:46 Luma's roadmap: generation, understanding, and robotics
19:54 Outro
Learn more about your ad choices. Visit megaphone.fm/adchoices
Luma Labs' Diffusion Revolution: from Dream Machine to Multimodal Worldsim - Amit Jain, Jiaming Song
In this episode of the Cognitive Revolution podcast, the host Nathan Labenz welcomes Amit Jain, CEO and Jiaming Song, Chief Scientist at Luma Labs, alongside co-host Stephen Parker. The conversation delves into the latest advancements and products from Luma Labs, makers of the Dream Machine, including cutting-edge models and features like camera motion and creative video generation tools. They explore technical aspects like pre-training for diffusion models and the development of concepts to improve AI capabilities. The discussion also covers the philosophical and practical implications of AI interpretability and multimodality, along with a deep dive into the intellectual history and recent innovations in diffusion models.
Upcoming Major AI Events Featuring Nathan Labenz as a Keynote Speaker
https://www.imagineai.live/
https://adapta.org/adapta-summit
https://itrevolution.com/product/enterprise-tech-leadership-summit-las-vegas/
SPONSORS:
ElevenLabs: ElevenLabs gives your app a natural voice. Pick from 5,000+ voices in 31 languages, or clone your own, and launch lifelike agents for support, scheduling, learning, and games. Full server and client SDKs, dynamic tools, and monitoring keep you in control. Start free at https://elevenlabs.io/cognitive-revolution
Oracle Cloud Infrastructure (OCI): Oracle Cloud Infrastructure offers next-generation cloud solutions that cut costs and boost performance. With OCI, you can run AI projects and applications faster and more securely for less. New U.S. customers can save 50% on compute, 70% on storage, and 80% on networking by switching to OCI before May 31, 2024. See if you qualify at https://oracle.com/cognitive
Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive
NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive
PRODUCED BY:
https://aipodcast.ing