Artwork

Content provided by Raza Habib. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Raza Habib or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.
Player FM - Podcast App
Go offline with the Player FM app!

Why Your AI Product Needs Evals with Hamel Husain and Swyx

1:09:02
 
Share
 

Manage episode 441766382 series 3586305
Content provided by Raza Habib. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Raza Habib or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.

Hamel Husain is a seasoned AI consultant and engineer with experience at companies like GitHub, DataRobot, and Airbnb. He is a trailblazer in AI development, known for his innovative work in literate programming and AI-assisted development tools. Shawn Wang (aka Swyx) is the host of the Latent Space podcast, the author of the essay 'Rise of the AI Engineer,' and the founder of the AI Engineer World Fair. In this episode, Hamel and Swyx share their unique insights on building effective AI products, the critical importance of evaluations, and their vision for the future of AI engineering.

Chapters
00:00 - Introduction and recent AI advancements

06:14 - The critical role of evals in AI product development

15:33 - Common pitfalls in AI product development

26:33 - Literate programming: A new paradigm for AI development

39:58 - Answer AI and innovative approaches to software development

51:56 - Integrating AI with literate programming environments

58:47 - The importance of understanding AI prompts

01:00:37 - Assessing the current state of AI adoption

01:07:10 - Challenges in evaluating AI models

--------------------------------------------------------------------------------------------------------------------------------------------------
Humanloop is an Integrated Development Environment for Large Language Models. It enables product teams to develop LLM-based applications that are reliable and scalable. To find out more go to humanloop.com

  continue reading

17 episodes

Artwork
iconShare
 
Manage episode 441766382 series 3586305
Content provided by Raza Habib. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Raza Habib or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.

Hamel Husain is a seasoned AI consultant and engineer with experience at companies like GitHub, DataRobot, and Airbnb. He is a trailblazer in AI development, known for his innovative work in literate programming and AI-assisted development tools. Shawn Wang (aka Swyx) is the host of the Latent Space podcast, the author of the essay 'Rise of the AI Engineer,' and the founder of the AI Engineer World Fair. In this episode, Hamel and Swyx share their unique insights on building effective AI products, the critical importance of evaluations, and their vision for the future of AI engineering.

Chapters
00:00 - Introduction and recent AI advancements

06:14 - The critical role of evals in AI product development

15:33 - Common pitfalls in AI product development

26:33 - Literate programming: A new paradigm for AI development

39:58 - Answer AI and innovative approaches to software development

51:56 - Integrating AI with literate programming environments

58:47 - The importance of understanding AI prompts

01:00:37 - Assessing the current state of AI adoption

01:07:10 - Challenges in evaluating AI models

--------------------------------------------------------------------------------------------------------------------------------------------------
Humanloop is an Integrated Development Environment for Large Language Models. It enables product teams to develop LLM-based applications that are reliable and scalable. To find out more go to humanloop.com

  continue reading

17 episodes

All episodes

×
 
Loading …

Welcome to Player FM!

Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.

 

Quick Reference Guide