#534: diskcache: Your secret Python perf weapon
Your cloud SSD is sitting there, bored, and it would like a job. Today we’re putting it to work with DiskCache, a simple, practical cache built on SQLite that can speed things up without spinning up Redis or extra services. Once you start to see what it can do, a universe of possibilities opens up. We're joined by Vincent Warmerdam to dive into DiskCache.
Episode sponsors
Talk Python Courses
Python in Production
Links from the show
diskcache docs: grantjenks.com
LLM Building Blocks for Python course: training.talkpython.fm
JSONDisk: grantjenks.com
Git Code Archaeology Charts: koaning.github.io
Talk Python Cache Admin UI: blobs.talkpython.fm
Litestream SQLite streaming: litestream.io
Plash hosting: pla.sh
Watch this episode on YouTube: youtube.com
Episode #534 deep-dive: talkpython.fm/534
Episode transcripts: talkpython.fm
Theme Song: Developer Rap
🥁 Served in a Flask 🎸: talkpython.fm/flasksong
---== Don't be a stranger ==---
YouTube: youtube.com/@talkpython
Bluesky: @talkpython.fm
Mastodon: @talkpython@fosstodon.org
X.com: @talkpython
Michael on Bluesky: @mkennedy.codes
Michael on Mastodon: @mkennedy@fosstodon.org
Michael on X.com: @mkennedy
659: Open-Source Tools for Natural Language Processing
NLP practitioners: this episode is for you. From the awareness of linguistic elements and annotation to getting the necessary people in the room, Vincent Warmerdam presents to Jon Krohn a recipe for a successful project and the open-source NLP tools to get there.
This episode is brought to you by epic LinkedIn Learning instructor Keith McCormick (linkedin.com/learning/instructors/keith-mccormick). Interested in sponsoring a SuperDataScience Podcast episode? Visit JonKrohn.com/podcast for sponsorship information.
In this episode you will learn:
• How Vincent came to work with De Speld [08:57]
• Vincent’s role at Explosion [18:59]
• How users can apply spaCy [21:46]
• Prodigy: Annotate training data more efficiently with scripts [26:28]
• How to manage “skill anxiety” with Calmcode [32:32]
• How Vincent fixed bad labels [42:47]
• The value of understanding linguistics for NLP [54:42]
• How to constrain artificial stupidity [1:02:38]
Additional materials: www.superdatascience.com/659
Ines & Sofie — Building Industrial-Strength NLP Pipelines
Sofie and Ines walk us through how the new spaCy library helps build end to end SOTA natural language processing workflows.
Ines Montani is the co-founder of Explosion AI, a digital studio specializing in tools for AI technology. She's a core developer of spaCy, one of the leading open-source libraries for Natural Language Processing in Python and Prodigy, a new data annotation tool powered by active learning. Before founding Explosion AI, she was a freelance front-end developer and strategist.
https://twitter.com/_inesmontani
Sofie Van Landeghem is a Natural Language Processing and Machine Learning engineer at Explosion.ai. She is a Software Engineer at heart, with an absurd love for quality assurance and testing, introducing proper levels of abstraction, and ensuring code robustness and modularity.
She has more than 12 years of experience in Natural Language Processing and Machine Learning, including in the pharmaceutical industry and the food industry.
https://twitter.com/oxykodit
https://spacy.io/
https://prodi.gy/
https://thinc.ai/
https://explosion.ai/
Topics covered:
0:00 Sneak peek
0:35 intro
2:29 How spaCy was started
6:11 Business model, open source
9:55 What was spaCy designed to solve?
12:23 advances in NLP and modern practices in industry
17:19 what differentiates spaCy from a more research focused NLP library?
19:28 Multi-lingual/domain specific support
23:52 spaCy V3 configuration
28:16 Thoughts on Python, Syphon, other programming languages for ML
33:45 Making things clear and reproducible
37:30 prodigy and getting good training data
44:09 most underrated aspect of ML
51:00 hardest part of putting models into production
Visit our podcasts homepage for transcripts and more episodes!
www.wandb.com/podcast
Get our podcast on Apple, Spotify, and Google!
Apple Podcasts: bit.ly/2WdrUvI
Spotify: bit.ly/2SqtadF
Google:tiny.cc/GD_Google
We started Weights and Biases to build tools for Machine Learning practitioners because we care a lot about the impact that Machine Learning can have in the world and we love working in the trenches with the people building these models. One of the most fun things about these building tools has been the conversations with these ML practitioners and learning about the interesting things they’re working on. This process has been so fun that we wanted to open it up to the world in the form of our new podcast called Gradient Dissent. We hope you have as much fun listening to it as we had making it!
Join our bi-weekly virtual salon and listen to industry leaders and researchers in machine learning share their research:
tiny.cc/wb-salon
Join our community of ML practitioners where we host AMA's, share interesting projects and meet other people working in Deep Learning:
bit.ly/wb-slack
Our gallery features curated machine learning reports by researchers exploring deep learning techniques, Kagglers showcasing winning models, and industry leaders sharing best practices.
app.wandb.ai/gallery
Modern NLP with spaCy
SpaCy is awesome for NLP! It’s easy to use, has widespread adoption, is open source, and integrates the latest language models. Ines Montani and Matthew Honnibal (core developers of spaCy and co-founders of Explosion) join us to discuss the history of the project, its capabilities, and the latest trends in NLP. We also dig into the practicalities of taking NLP workflows to production. You don’t want to miss this episode!
Featuring:
Ines Montani – GitHub, X
Matthew Honnibal – GitHub, X
Chris Benson – Website, GitHub, LinkedIn, X
Daniel Whitenack – Website, GitHub, X
Show Notes:
SpaCy
Advanced NLP with SpaCy course
Thinc
Explosion AI
Prodigy
Fast.ai
Machine learning yearning
Upcoming Events:
Register for upcoming webinars here!
Practical Natural Language Processing with spaCy and Prodigy w/ Ines Montani - TWiML Talk #262
In this episode of PyDataSci, we’re joined by Ines Montani, Cofounder of Explosion, Co-developer of SpaCy and lead developer of Prodigy.
Ines and I caught up to discuss her various projects, including the aforementioned SpaCy, an open-source NLP library built with a focus on industry and production use cases.
The complete show notes for this episode can be found at twimlai.com/talk/262. Check out the rest of the PyDataSci series at twimlai.com/pydatasci.