Go offline with the Player FM app!
Eric Michaud on scaling, grokking and quantum interpretability
Manage episode 371109735 series 2966339
Eric is a PhD student in the Department of Physics at MIT working with Max Tegmark on improving our scientific/theoretical understanding of deep learning -- understanding what deep neural networks do internally and why they work so well. This is part of a broader interest in the nature of intelligent systems, which previously led him to work with SETI astronomers, with Stuart Russell's AI alignment group (CHAI), and with Erik Hoel on a project related to integrated information theory.
Transcript: https://theinsideview.ai/eric
Youtube: https://youtu.be/BtHMIQs_5Nw
The Quantization Model of Neural Scaling: https://arxiv.org/abs/2303.13506
An Effective Theory of Representation Learning https://arxiv.org/abs/2205.10343
Omnigrok: Grokking Beyond Algorithmic Data: https://arxiv.org/abs/2210.01117
54 episodes
Manage episode 371109735 series 2966339
Eric is a PhD student in the Department of Physics at MIT working with Max Tegmark on improving our scientific/theoretical understanding of deep learning -- understanding what deep neural networks do internally and why they work so well. This is part of a broader interest in the nature of intelligent systems, which previously led him to work with SETI astronomers, with Stuart Russell's AI alignment group (CHAI), and with Erik Hoel on a project related to integrated information theory.
Transcript: https://theinsideview.ai/eric
Youtube: https://youtu.be/BtHMIQs_5Nw
The Quantization Model of Neural Scaling: https://arxiv.org/abs/2303.13506
An Effective Theory of Representation Learning https://arxiv.org/abs/2205.10343
Omnigrok: Grokking Beyond Algorithmic Data: https://arxiv.org/abs/2210.01117
54 episodes
All episodes
×Welcome to Player FM!
Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.