Go offline with the Player FM app!
Optimizing infrastructure for LLMs - Episode 235
Manage episode 381576243 series 2591275
In this episode, we explore the infrastructure that is needed for LLMs, the key components to building it, and common challenges. We also talk about why LLMs hallucinate and how to reduce the frequency of that from occurring.
Joining us in the discussion this week is Trey Doig, CTO and co-founder of Pathlight, which is a generative AI company.
280 episodes
Manage episode 381576243 series 2591275
In this episode, we explore the infrastructure that is needed for LLMs, the key components to building it, and common challenges. We also talk about why LLMs hallucinate and how to reduce the frequency of that from occurring.
Joining us in the discussion this week is Trey Doig, CTO and co-founder of Pathlight, which is a generative AI company.
280 episodes
All episodes
×Welcome to Player FM!
Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.