Artwork

Content provided by Dan Turchin. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Dan Turchin or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.
Player FM - Podcast App
Go offline with the Player FM app!

Adam Wenchel, Arthur founder and CEO, discusses evaluating AI model performance

30:25
 
Share
 

Manage episode 395522411 series 2986762
Content provided by Dan Turchin. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Dan Turchin or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.

Adam Wenchel is the CEO of Arthur, a company with a platform that gives you an immediate comprehensive AI performance solution across LLMs, Computer Vision, Tabular Data, and NLP.

Adam and the team have been making AI observable for almost 5 years with Arthur. Arthur has raised over $60 million from a legendary group of investors including Index Ventures, Greycroft Partners, Work-Bench, and others. An equal list of impressive customers they’ve served includes Humana and Plaid, among others.

Listen and learn

  • How Adam started his career in AI
  • How he helped map out Capital One’s early AI strategy
  • The value of evaluating AI model performance
  • How Arthur launched its first LLM-specific product and what the team learned
  • How to monitor the performance of an LLM model in production and which questions to ask when evaluating it
  • The lessons from growing a startup that nobody talks about

References in this episode…

  continue reading

229 episodes

Artwork
iconShare
 
Manage episode 395522411 series 2986762
Content provided by Dan Turchin. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Dan Turchin or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.

Adam Wenchel is the CEO of Arthur, a company with a platform that gives you an immediate comprehensive AI performance solution across LLMs, Computer Vision, Tabular Data, and NLP.

Adam and the team have been making AI observable for almost 5 years with Arthur. Arthur has raised over $60 million from a legendary group of investors including Index Ventures, Greycroft Partners, Work-Bench, and others. An equal list of impressive customers they’ve served includes Humana and Plaid, among others.

Listen and learn

  • How Adam started his career in AI
  • How he helped map out Capital One’s early AI strategy
  • The value of evaluating AI model performance
  • How Arthur launched its first LLM-specific product and what the team learned
  • How to monitor the performance of an LLM model in production and which questions to ask when evaluating it
  • The lessons from growing a startup that nobody talks about

References in this episode…

  continue reading

229 episodes

All episodes

×
 
Loading …

Welcome to Player FM!

Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.

 

Quick Reference Guide