Artwork

Content provided by Justin Macorin and Bradley Arsenault. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Justin Macorin and Bradley Arsenault or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.
Player FM - Podcast App
Go offline with the Player FM app!

Using Agents to Test Agents

21:41
 
Share
 

Manage episode 424324749 series 3519364
Content provided by Justin Macorin and Bradley Arsenault. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Justin Macorin and Bradley Arsenault or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.

In this cutting-edge episode of The Prompt Desk, your hosts Justin Macorin and Bradley Arsenault explore innovative techniques for testing AI agents using synthetic data and AI-generated test cases. Discover how to create testing agents that validate the performance of your main AI agent, handle edge cases, ensure proper conversation realignment, and improve overall reliability and robustness.

---
Continue listening to The Prompt Desk Podcast for everything LLM & GPT, Prompt Engineering, Generative AI, and LLM Security.
Check out PromptDesk.ai for an open-source prompt management tool.
Check out Brad’s AI Consultancy at bradleyarsenault.me
Add Justin Macorin and Bradley Arsenault on LinkedIn.
Please fill out our listener survey here to help us create a better podcast: https://docs.google.com/forms/d/e/1FAIpQLSfNjWlWyg8zROYmGX745a56AtagX_7cS16jyhjV2u_ebgc-tw/viewform?usp=sf_link


Hosted by Ausha. See ausha.co/privacy-policy for more information.

  continue reading

40 episodes

Artwork
iconShare
 
Manage episode 424324749 series 3519364
Content provided by Justin Macorin and Bradley Arsenault. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Justin Macorin and Bradley Arsenault or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.

In this cutting-edge episode of The Prompt Desk, your hosts Justin Macorin and Bradley Arsenault explore innovative techniques for testing AI agents using synthetic data and AI-generated test cases. Discover how to create testing agents that validate the performance of your main AI agent, handle edge cases, ensure proper conversation realignment, and improve overall reliability and robustness.

---
Continue listening to The Prompt Desk Podcast for everything LLM & GPT, Prompt Engineering, Generative AI, and LLM Security.
Check out PromptDesk.ai for an open-source prompt management tool.
Check out Brad’s AI Consultancy at bradleyarsenault.me
Add Justin Macorin and Bradley Arsenault on LinkedIn.
Please fill out our listener survey here to help us create a better podcast: https://docs.google.com/forms/d/e/1FAIpQLSfNjWlWyg8zROYmGX745a56AtagX_7cS16jyhjV2u_ebgc-tw/viewform?usp=sf_link


Hosted by Ausha. See ausha.co/privacy-policy for more information.

  continue reading

40 episodes

All episodes

×
 
Loading …

Welcome to Player FM!

Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.

 

Quick Reference Guide