Artwork

Content provided by Dave Kimura. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Dave Kimura or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.
Player FM - Podcast App
Go offline with the Player FM app!

Streaming LLM Responses

24:10
 
Share
 

Manage episode 404399598 series 1261019
Content provided by Dave Kimura. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Dave Kimura or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.
In this episode, we look at running a self hosted Large Language Model (LLM) and consuming it with a Rails application. We will use a background to make API requests to the LLM and then stream the responses in real-time to the browser.
  continue reading

31 episodes

Artwork

Streaming LLM Responses

Drifting Ruby Screencasts

35 subscribers

published

iconShare
 
Manage episode 404399598 series 1261019
Content provided by Dave Kimura. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Dave Kimura or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.
In this episode, we look at running a self hosted Large Language Model (LLM) and consuming it with a Rails application. We will use a background to make API requests to the LLM and then stream the responses in real-time to the browser.
  continue reading

31 episodes

All episodes

×
 
Loading …

Welcome to Player FM!

Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.

 

Quick Reference Guide