Go offline with the Player FM app!
[short] Data Mixing Laws: Optimizing Data Mixtures by Predicting Language Modeling Performance
Manage episode 408878892 series 3524393
Quantitative data mixing laws predict large language model performance based on mixture proportions, guiding optimal data selection and training strategies for improved outcomes.
https://arxiv.org/abs//2403.16952
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
2489 episodes
Manage episode 408878892 series 3524393
Quantitative data mixing laws predict large language model performance based on mixture proportions, guiding optimal data selection and training strategies for improved outcomes.
https://arxiv.org/abs//2403.16952
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
2489 episodes
All episodes
×Welcome to Player FM!
Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.