Performance AI: Insights from Arthur's Adam Wenchel – Ep. 221
In this episode of the NVIDIA AI Podcast, recorded live at the GTC 2024, host Noah Kravitz sits down with Adam Wenchel, co-founder and CEO of Arthur. Arthur enhances the performance of AI systems across various metrics like accuracy, explainability, and fairness. Wenchel shares insights into the challenges and opportunities of deploying generative AI. The discussion spans a range of topics, including AI bias, the observability of AI systems, and the practical implications of AI in business. For more on Arthur, visit arthur.ai.
The Future of AI Security with Adam Wenchel, CEO of Arthur.ai
In this episode, Nathan sits down with Adam Wenchel, CEO of Arthur.ai. Adam founded the AI security company back in 2019, before GPT-2 existed. In this episode, Adam shares his unique perspective on the AI security landscape, drawing from years building commercial AI systems. They discuss the attacks Adam set out to defend against, the changing priorities of executives in the rush to adopt LLMs, and the LLM-specific techniques Adam has developed. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
TIMESTAMPS:
(00:00:00) Episode Preview
(00:03:45) Adam's background in AI and starting Arthur AI in 2019
(00:05:52) The release of ChatGPT as a watershed moment for generative AI
(00:07:09) Differences between traditional cybersecurity and AI security
(00:09:51) Early examples of AI security issues like boundary detection attacks in fraud systems
(00:12:39) - Mitigating risks of AI systems through observability and robust training
(00:14:40) - Financial services governance of AI models and its challenges today
(00:15:12) Sponsors: Netsuite | Omneky
(00:21:18) - Motivations for governance like staying compliant with regulations
(00:21:40) - The mix of incentives shaping earlier AI governance, like explainability
(00:28:14) - Using LMs to evaluate the security of other LMs
(00:30:03) - Dynamics between training and evaluating future LMs
(00:38:10) - The state of reasoning capabilities in large LMs
(00:44:35) - Corporate urgency around adopting generative AI technologies
(00:46:51) - Common enterprise use cases for generative AI and security concerns
(00:50:45) - Techniques for reducing hallucinations in retrieval augmented LMs
(00:53:15) - Benchmarking LMs on specific organizational tasks versus generic benchmarks
(00:56:30) - Metrics beyond accuracy like concision and hedging
(01:01:20) - Automatically detecting anomalies and hallucinations
(01:09:20) - Relationships between Arthur AI and foundation model providers
(01:11:52) - Where Cohere shines: multilingualism and not hedging
(01:13:43) - Anticipating future watershed moments and steady progress
(01:19:03) - Whether we can ever fully solve AI alignment and safety
LINKS:
Arthur.ai: https://www.arthur.ai/
X/Social:
@apwenchel (Adam)
@itsArthurAI (Arthur.ai)
@labenz (Nathan)
@eriktorenberg
@CogRev_Podcast
SPONSORS: Shopify | NetSuite | Omneky
Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive
NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
Music Credit: Stableaudio.com
Data Innovation & AI at Capital One with Adam Wenchel - TWiML Talk #147
In this episode I’m joined by Adam Wenchel, vice president of AI and Data Innovation at Capital One, to discuss how Machine Learning & AI are being integrated into their day-to-day practices, and how those advances benefit the customer. In our conversation, we look into a few of the many applications of AI at the bank, including fraud detection, money laundering, customer service, and automating back office processes. Adam describes some of the challenges of applying ML in financial services and how Capital One maintains consistent portfolio management practices across the organization. We also discuss how the bank has organized to scale their machine learning efforts, and the steps they’ve taken to overcome the talent shortage in the space. The notes for this show can be found at twimlai.com/talk/147.