Go offline with the Player FM app!
[QA] How Far Can Transformers Reason? The Locality Barrier and Inductive Scratchpad
Manage episode 423004436 series 3524393
The paper explores the learnability of new syllogisms by Transformers, introducing the concept of distribution locality to determine efficient learning, showing limitations in composing syllogisms on long chains.
https://arxiv.org/abs//2406.06467
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
--- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support
1338 episodes
Manage episode 423004436 series 3524393
The paper explores the learnability of new syllogisms by Transformers, introducing the concept of distribution locality to determine efficient learning, showing limitations in composing syllogisms on long chains.
https://arxiv.org/abs//2406.06467
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
--- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support
1338 episodes
All episodes
×Welcome to Player FM!
Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.