Go offline with the Player FM app!
Observational Scaling Laws and the Predictability of Language Model Performance
Manage episode 419141073 series 3524393
Proposing an observational approach to understand language model scaling laws using 80 public models, showing predictability of model performance and emergent phenomena without extensive training across scales.
https://arxiv.org/abs//2405.10938
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
--- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support
1220 episodes
Manage episode 419141073 series 3524393
Proposing an observational approach to understand language model scaling laws using 80 public models, showing predictability of model performance and emergent phenomena without extensive training across scales.
https://arxiv.org/abs//2405.10938
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
--- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support
1220 episodes
All episodes
×Welcome to Player FM!
Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.