Go offline with the Player FM app!
Do LLMs dream of elephants (when told not to)? Latent concept association and associative memory in transformers
Manage episode 425855574 series 3524393
Large Language Models can easily manipulate fact retrieval by changing contexts, behaving like associative memory models. Transformers use self-attention and value matrix for memory tasks.
https://arxiv.org/abs//2406.18400
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
--- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support
1276 episodes
Manage episode 425855574 series 3524393
Large Language Models can easily manipulate fact retrieval by changing contexts, behaving like associative memory models. Transformers use self-attention and value matrix for memory tasks.
https://arxiv.org/abs//2406.18400
YouTube: https://www.youtube.com/@ArxivPapers
TikTok: https://www.tiktok.com/@arxiv_papers
Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016
Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers
--- Support this podcast: https://podcasters.spotify.com/pod/show/arxiv-papers/support
1276 episodes
All episodes
×Welcome to Player FM!
Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.