The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)·Dec 12, 2019·59m
Single Headed Attention RNN: Stop Thinking With Your Head with Stephen Merity - #325
Show notes
Today we’re joined by Stephen Merity, an independent researcher focused on NLP and Deep Learning. In our conversation, we discuss Stephens latest paper, Single Headed Attention RNN: Stop Thinking With Your Head, detailing his primary motivations behind the paper, the decision to use SHA-RNNs for this research, how he built and trained the model, his approach to benchmarking, and finally his goals for the research in the broader research community.
Guests
Analysis: done · source seed