Go offline with the Player FM app!
Token Erasure as a Footprint of Implicit Vocabulary Items in LLMs
Manage episode 426507868 series 3524393
LLMs process text with tokens, but individual tokens may not relate to word meanings. This study explores how LLMs convert tokens into higher-level representations, revealing an "erasure" effect.
https://arxiv.org/abs//2406.20086
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
--- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support
1398 episodes
Manage episode 426507868 series 3524393
LLMs process text with tokens, but individual tokens may not relate to word meanings. This study explores how LLMs convert tokens into higher-level representations, revealing an "erasure" effect.
https://arxiv.org/abs//2406.20086
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
--- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support
1398 episodes
すべてのエピソード
×Welcome to Player FM!
Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.