#385 — AI Utopia
Sam Harris speaks with Nick Bostrom about ongoing progress in artificial intelligence. They discuss the twin concerns about the failure of alignment and the failure to make progress, why smart people don't perceive the risk of superintelligent AI, the governance risk, path dependence and "knotty problems," the idea of a solved world, Keynes's predictions about human productivity, the uncanny valley of utopia, the replacement of human labor and other activities, meaning and purpose, digital isolation and plugging into something like the Matrix, pure hedonism, the asymmetry between pleasure and pain, increasingly subtle distinctions in experience, artificial purpose, altering human values at the level of the brain, ethical changes in the absence of extreme suffering, our cosmic endowment, longtermism, problems with consequentialism, the ethical conundrum of dealing with small probabilities of large outcomes, and other topics.
If the Making Sense podcast logo in your player is BLACK, you can SUBSCRIBE to gain access to all full-length episodes at samharris.org/subscribe.
Learning how to train your mind is the single greatest investment you can make in life. That's why Sam Harris created the Waking Up app. From rational mindfulness practice to lessons on some of life's most important topics, join Sam as he demystifies the practice of meditation and explores the theory behind it.
The Path to Utopia, with Nick Bostrom – from Clearer Thinking with Spencer Greenberg
In this special cross-post episode of The Cognitive Revolution, Nathan shares a fascinating conversation between Spencer Greenberg and philosopher Nick Bostrom from the Clearer Thinking podcast. They explore Bostrom's latest book, "Deep Utopia," and discuss the challenges of envisioning a truly desirable future. Discover how advanced AI could reshape our concept of purpose and meaning, and hear thought-provoking ideas on finding fulfillment in a world where technology solves our pressing problems. Join us for an insightful journey into the potential evolution of human flourishing and the quest for positive visions of the future.
Originally appeared in Clearer Thinking Podcast: https://podcast.clearerthinking.org/episode/224/nick-bostrom-the-path-to-utopia
Check out the Clearer Thinking with Spencer Greenberg Podcast here: https://podcast.clearerthinking.org/
Deep Utopia Book: https://www.amazon.com/Deep-Utopia-Meaning-Solved-World/dp/1646871642/
Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/
SPONSORS:
Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive
Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR
Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/
Weights & Biases Weave: Weights & Biases Weave is a lightweight AI developer toolkit designed to simplify your LLM app development. With Weave, you can trace and debug input, metadata and output with just 2 lines of code. Make real progress on your LLM development and visit the following link to get started with Weave today: https://wandb.me/cr
RECOMMENDED PODCAST:
This Won't Last.
Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics.
Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937
Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz
YouTube: https://www.youtube.com/@ThisWontLastpodcast
CHAPTERS:
(00:00:00) About the Show
(00:00:22) About the Episode
(00:02:58) Introduction to the podcast
(00:03:26) Dystopias vs utopias in fiction
(00:07:29) Material abundance and utopia
(00:14:57) AI and the future of work
(00:20:10) AI companions and human relationships
(00:22:57) Sponsors: Weights & Biases Weave | Oracle
(00:25:01) Sponsor message: Positly research platform
(00:26:04) Surveillance and global coordination
(00:44:38) Sponsors: Omneky | Brave
(00:44:52) Sponsor message: Transparent Replications project
(00:46:07) AI governance challenges
(00:49:36) Deep Utopia book's purpose
(00:53:09) Global coordination strategies
(00:59:13) The vulnerable world hypothesis
(01:05:18) Bostrom's meta-ethical views
(01:08:32) Listener question on meditation
(01:10:17) Outro
AI's Doomsday Philosopher Says Maybe It'll All Be Totally Fine — With Nick Bostrum
Nick Bostrom is a renowned philosopher and bestselling author of "Superintelligence" and "Deep Utopia." He joins Big Technology to discuss the potential outcomes of advanced artificial intelligence, from existential risks to utopian possibilities. Tune in to hear Bostrom's thoughts on how humanity might navigate the transition to a world of superintelligent AI and what life could look like in a technologically "solved" world. We also cover the evolution of AI safety concerns, the concept of effective accelerationism, and the philosophical implications of living in a post-scarcity society. Hit play for a mind-expanding conversation about the future of humanity and the profound challenges and opportunities that lie ahead.
---
Enjoying Big Technology Podcast? Please rate us five stars ⭐⭐⭐⭐⭐ in your podcast app of choice.
For weekly updates on the show, sign up for the pod newsletter on LinkedIn: https://www.linkedin.com/newsletters/6901970121829801984/
Want a discount for Big Technology on Substack? Here’s 40% off for the first year: https://tinyurl.com/bigtechnology
Questions? Feedback? Write to: bigtechnologypodcast@gmail.com
Learn more about your ad choices. Visit megaphone.fm/adchoices
Are We Headed For AI Utopia Or Disaster? - Nick Bostrom - #803
Nick Bostrom is a philosopher, professor at the University of Oxford and an author
For generations, the future of humanity was envisioned as a sleek, vibrant utopia filled with remarkable technological advancements where machines and humans would thrive together. As we stand on the supposed brink of that future, it appears quite different from our expectations. So what does humanity's future actually hold?
Expect to learn what it means to live in a perfectly solved world, whether we are more likely heading toward a utopia or a catastrophe, how humans will find a meaning in a world that no longer needs our contributions, what the future of religion could look like, a breakdown of all the different stages we will move through on route to a final utopia, the current state of AI safety & risk and much more...
Sponsors:
Get a 20% discount on Nomatic’s amazing luggage at https://nomatic.com/modernwisdom (use code MW20)
Get up to 70% off Gymshark's Summer Sale at https://gym.sh/modernwisdom (use code MW10)
Get a 20% discount & free shipping on your Lawnmower 5.0 at https://manscaped.com/modernwisdom (use code MODERNWISDOM)
Timestamps:
(00:00) Is Nick Hopeful About AI?
(03:20) How We Can Get AI Right
(07:07) The Moral Status of Non-Human Intelligences
(17:36) Different Types of Utopia
(19:38) The Human Experience in a Solved World
(31:32) Using AI to Satisfy Human Desires
(43:25) Current Things That Would Stay in Utopia
(49:54) The Value of Daily Struggles
(55:07) Implications of Extreme Human Longevity
(01:00:19) Constraints That We Can’t Get Past
(01:07:27) How Important is This Time for Humanity’s Future?
(01:13:40) Biggest AI Development Surprises
(01:21:24) Current State of AI Safety
(01:28:06) Where to Find Nick
Extra Stuff:
Get my free reading list of 100 books to read before you die: https://chriswillx.com/books
Try my productivity energy drink Neutonic: https://neutonic.com/modernwisdom
Episodes You Might Enjoy:
This Is How To Master Your Life - David Goggins - #577: lnkfi.re/SN-Goggins
How To Destroy Your Negative Beliefs - Dr Jordan Peterson - #712: lnkfi.re/SN-Peterson
The Secret Tools To Hack Your Brain - Dr Andrew Huberman - #700: lnkfi.re/SN-Huberman
-
Get In Touch:
Instagram: https://www.instagram.com/chriswillx
Twitter: https://www.twitter.com/chriswillx
YouTube: https://www.youtube.com/modernwisdompodcast
Email: https://chriswillx.com/contact
-
Learn more about your ad choices. Visit megaphone.fm/adchoices
#181 Nick Bostrom: The Meaning of Life in a World where AI can do Everything for Us
This episode is sponsored by Netsuite by Oracle, the number one cloud financial system, streamlining accounting, financial management, inventory, HR, and more.
NetSuite is offering a one-of-a-kind flexible financing program. Head to https://netsuite.com/EYEONAI to know more.
Venture into the future of AI with Nick Bostrom, a philosopher at the University of Oxford known for his work on existential risk, the anthropic principle, human enhancement ethics, whole brain emulation, superintelligence risks, and the reversal test.
On episode #181 of Eye on AI, Nick Bostrom, explores the existential and societal implications of AI reaching and surpassing human capabilities. As we contemplate a world where all tasks are performed by AI, Nick discusses the potential for a 'technologically solved' society and its impact on human purpose and motivation.
Join us as Nick provides insights into his latest book, "Deep Utopia," where he questions how humans will find meaning when artificial intelligence handles every aspect of labor and creativity. He elaborates on the risks, ethical considerations, and philosophical dilemmas we face as AI continues to evolve at an unprecedented pace.
This episode is an essential exploration of the shifts AI may bring to our societal structures, labour markets, and individual lives.
If you find yourself intrigued by the philosophical journey into AI's potential to redefine humanity, hit the like button and subscribe for more thoughtful discussions on the future landscapes shaped by artificial intelligence.
Stay Updated:
Craig Smith Twitter: https://twitter.com/craigss
Eye on A.I. Twitter: https://twitter.com/EyeOn_AI
(00:00) Introduction and the Concept of a 'Solved World'
(03:05) Nick Bostrom's Background
(06:06) Exploring the Anthropomorphism in Modern AI
(08:02) Predictions and the 'Hockey Stick' Graph
(10:13) AI Safety and Public Perception
(12:58) Deep Utopia and the Search for Meaning
(15:46) Life in a Technologically Mature World
(18:17) Existential Malaise in Modern Society
(20:43) The Potential of Technological Maturity
(23:51) Philosophical Implications of a Solved World
(28:20) Engineering Happiness and Neurological Adjustments
(32:18) Remaining Human Tasks and Cultural Values
(35:45) The Future of Humanity
(47:03) Closing Remarks and Sponsor Message
Fin Moorhouse - Longtermism, Space, & Entrepreneurship
Fin Moorhouse is a Research Scholar and assistant to Toby Ord at Oxford University's Future of Humanity Institute. He co-hosts the Hear This Idea podcast, which showcases new thinking in philosophy, the social sciences, and effective altruism.
We discuss for-profit entrepreneurship for altruism, space governance, morality in the multiverse, podcasting, the long reflection, and the Effective Ideas & EA criticism blog prize.
Watch on YouTube. Listen on Spotify, Apple Podcasts, etc.
Episode website + Transcript here.Follow Fin on Twitter. Follow me on Twitter.
Subscribe to find out about future episodes!
Timestamps
(0:00:10) - Introduction
(0:02:45) - EA Prizes & Criticism
(0:09:47) - Longtermism
(0:12:52) - Improving Mental Models
(0:20:50) - EA & Profit vs Nonprofit Entrepreneurship
(0:30:46) - Backtesting EA
(0:35:54) - EA Billionares
(0:38:32) - EA Decisions & Many Worlds Interpretation
(0:50:46) - EA Talent Search
(0:52:38) - EA & Encouraging Youth
(0:59:17) - Long Reflection
(1:03:56) - Long Term Coordination
(1:21:06) - On Podcasting
(1:23:40) - Audiobooks Imitating Conversation
(1:27:04) - Underappreciated Podcasting Skills
(1:38:08) - Space Governance
(1:42:09) - Space Safety & 1st Principles
(1:46:44) - Von Neuman Probes
(1:50:12) - Space Race & First Strike
(1:51:45) - Space Colonization & AI
(1:56:36) - Building a Startup
(1:59:08) - What is EA Underrating?
(2:10:07) - EA Career Steps
(2:15:16) - Closing Remarks
Please share if you enjoyed this episode! Helps out a ton!
Get full access to Dwarkesh Podcast at www.dwarkesh.com/subscribe
#83 – Nick Bostrom: Simulation and Superintelligence
Nick Bostrom is a philosopher at University of Oxford and the director of the Future of Humanity Institute. He has worked on fascinating and important ideas in existential risks, simulation hypothesis, human enhancement ethics, and the risks of superintelligent AI systems, including in his book Superintelligence. I can see talking to Nick multiple times on this podcast, many hours each time, but we have to start somewhere.
Support this podcast by signing up with these sponsors:
– Cash App – use code “LexPodcast” and download:
– Cash App (App Store): https://apple.co/2sPrUHe
– Cash App (Google Play): https://bit.ly/2MlvP5w
EPISODE LINKS:
Nick’s website: https://nickbostrom.com/
Future of Humanity Institute:
– https://twitter.com/fhioxford
– https://www.fhi.ox.ac.uk/
Books:
– Superintelligence: https://amzn.to/2JckX83
Wikipedia:
– https://en.wikipedia.org/wiki/Simulation_hypothesis
– https://en.wikipedia.org/wiki/Principle_of_indifference
– https://en.wikipedia.org/wiki/Doomsday_argument
– https://en.wikipedia.org/wiki/Global_catastrophic_risk
This conversation is part of the Artificial Intelligence podcast. If you would like to get more information about this podcast go to https://lexfridman.com/ai or connect with @lexfridman on Twitter, LinkedIn, Facebook, Medium, or YouTube where you can watch the video versions of these conversations. If you enjoy the podcast, please rate it 5 stars on Apple Podcasts, follow on Spotify, or support it on Patreon.
Here’s the outline of the episode. On some podcast players you should be able to click the timestamp to jump to that time.
OUTLINE:
00:00 – Introduction
02:48 – Simulation hypothesis and simulation argument
12:17 – Technologically mature civilizations
15:30 – Case 1: if something kills all possible civilizations
19:08 – Case 2: if we lose interest in creating simulations
22:03 – Consciousness
26:27 – Immersive worlds
28:50 – Experience machine
41:10 – Intelligence and consciousness
48:58 – Weighing probabilities of the simulation argument
1:01:43 – Elaborating on Joe Rogan conversation
1:05:53 – Doomsday argument and anthropic reasoning
1:23:02 – Elon Musk
1:25:26 – What’s outside the simulation?
1:29:52 – Superintelligence
1:47:27 – AGI utopia
1:52:41 – Meaning of life
How civilization could destroy itself -- and 4 ways we could prevent it | Nick Bostrom
Humanity is on its way to creating a "black ball": a technological breakthrough that could destroy us all, says philosopher Nick Bostrom. In this incisive, surprisingly light-hearted conversation with Head of TED Chris Anderson, Bostrom outlines the vulnerabilities we could face if (or when) our inventions spiral beyond our control -- and explores how we can prevent our future demise.
Hosted on Acast. See acast.com/privacy for more information.
#151 — Will We Destroy the Future?
Sam Harris speaks with Nick Bostrom about the problem of existential risk. They discuss public goods, moral illusions, the asymmetry between happiness and suffering, utilitarianism, "the vulnerable world hypothesis," the history of nuclear deterrence, the possible need for "turnkey totalitarianism," whether we're living in a computer simulation, the Doomsday Argument, the implications of extraterrestrial life, and other topics.
If the Making Sense podcast logo in your player is BLACK, you can SUBSCRIBE to gain access to all full-length episodes at samharris.org/subscribe.
Anticipating Superintelligence with Nick Bostrom - TWiML Talk #181
In this episode, we’re joined by Nick Bostrom, professor at the University of Oxford and head of the Future of Humanity Institute, a multidisciplinary institute focused on answering big-picture questions for humanity with regards to AI safety and ethics. In our conversation, we discuss the risks associated with Artificial General Intelligence, advanced AI systems Nick refers to as superintelligence, openness in AI development and more! The notes for this episode can be found at https://twimlai.com/talk/18