Human Data is Key to AI: Alex Wang from Scale AI
What if the key to unlocking AI's full potential lies not just in algorithms or compute, but in data?
In this episode, a16z General Partner David George sits down with Alex Wang, founder and CEO of Scale AI, to discuss the crucial role of "frontier data" in advancing artificial intelligence. From fueling breakthroughs with complex datasets to navigating the challenges of scaling AI models, Alex shares his insights on the current state of the industry and his forecast on the road to AGI.
Resources:
Find Alex on Twitter: https://x.com/alexandr_wang
Find David on Twitter : https://x.com/DavidGeorge83
Stay Updated:
Let us know what you think: https://ratethispodcast.com/a16z
Find a16z on Twitter: https://twitter.com/a16z
Find a16z on LinkedIn: https://www.linkedin.com/company/a16z
Subscribe on your favorite podcast app: https://a16z.simplecast.com/
Follow our host: https://twitter.com/stephsmithio
Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.
Stay Updated:
Find a16z on YouTube: YouTube
Find a16z on X
Find a16z on LinkedIn
Listen to the a16z Show on Spotify
Listen to the a16z Show on Apple Podcasts
Follow our host: https://twitter.com/eriktorenberg
Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.
Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.
20VC: Scale's Alex Wang on Why Data Not Compute is the Bottleneck to Foundation Model Performance, Why AI is the Greatest Military Asset Ever, Is China Really Two Years Behind the US in AI and Why the CCPs Industrial Approach is Better than Anyone Else's
Alex Wang is the Founder and CEO @ Scale.ai, the company that allows you to make the best models with the best data. To date, Alex has raised $1.6BN for the company with a last reported valuation of $14BN earlier this year. Scale tripled their ARR in 2023 and is expected to hit $1.4BN in ARR by the end of 2024. Their investors include Accel, Index, Thrive, Founders Fund, Meta and Nvidia to name a few.
In Today's Show with Alex Wang We Discuss:
1. Foundation Models: Diminishing Returns:
What are the three core pillars that can meaningfully improve foundation models performance?
Why is data the single largest bottleneck to the performance of models today?
What data do we need to capture that we do not currently, that will have the biggest impact on model performance moving forward?
Will we see the largest companies in the world revert back to on-prem with the increasing security challenges of migrating all customer data to foundation models?
2. AI: A Military Asset in Global Conflict: China + Russia
Why does Alex believe that AI has the potential to be an even more powerful military asset than nuclear weapons?
If this is the case, should we have open systems? Do we not have to have closed systems?
Why does Alex believe that the CCP's approach to industrial policy is better than anyone else's?
How does Alex evaluate the rise of Chinese EV car manufacturers in the last few years?
Does Alex really believe that China is two years behind the US in the AI race?
3. "I Get Fairer Treatment in Congress than in the Press":
Why does Alex believe that the best PR is no PR?
Why does Alex believe that he got fairer treatment in congress than he does in the media?
Why does Alex believe that all founders should look to own their own distribution channels today?
4. Alex Wang: AMA:
What are some of Alex's biggest lessons from Patrick Collison on the impact that a hot company brand has on the ability for that company to hire the best?
Does Alex think Trump is going to win? What would be the impact if he were to?
Why does Alex believe that enterprise software will be changed forever in the next few years?
What question is Alex never asked that he thinks he should be asked?
The Implications of AI on the Global Balance of Power with Alex Wang, Andrew Ng, Jack Clark and Cory Booker
Tune in to today's special episode airing a recent panel with the founders of Scale AI, Anthropic, and AI Fund who gathered in Washington DC to discuss China as an adversary. They argue that the papers out of Tsinghua University are just as impressive as those coming out of American universities. China is just as creative, but maybe even more motivated. While discussions of regulations have encompassed certain restraints, Alex Wang, Andrew Ng, and Jack Clark argue that we’re not moving fast enough (moderated by US senator Cory Booker).
This session was recorded live at The Hill & Valley Forum in 2024, a private bipartisan community of lawmakers and innovators committed to harnessing the power of technology to address America's most pressing national security challenges. The Hill & Valley podcast is part of the Turpentine podcast network. Learn more: www.turpentine.co
🔥 Apply to join over 400 founders and Execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj
RECOMMENDED PODCAST - The Riff with Byrne Hobart
Byrne Hobart, the writer of The Diff, is revered in Silicon Valley. You can get an hour with him each week. See for yourself how his thinking can upgrade yours.
Spotify: https://open.spotify.com/show/6rANlV54GCARLgMOtpkzKt
Apple: https://podcasts.apple.com/us/podcast/the-riff-with-byrne-hobart-and-erik-torenberg/id1716646486
SPONSORS:
Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive
The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR
Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/
CHAPTERS:
(00:00) Intro
(03:29) Assembling the founders of Anthropic, Scale AI, and AI Fund
(04:45) Predictions for AGI
(08:21) Navigating AI innovation amidst regulation
(16:15) Global AI competition and the urgency of Innovation
(24:34) Empowering future generations