Artwork

Content provided by John Koetsier. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by John Koetsier or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.
Player FM - Podcast App
Go offline with the Player FM app!

Solving the GPU shortage: software to 2-4X existing GPU utilization

18:05
 
Share
 

Manage episode 376711847 series 2809813
Content provided by John Koetsier. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by John Koetsier or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.

GPUs are rare and expensive right now. Every company doing AI model training needs more, and NVIDIA can't build enough, especially of the NVIDIA H100 GPU.

Run.ai CEO and co-founder Omri Geller says he has a software solution to this hardware problem.

The key: GPUs are mostly idle, even in high-demand settings. According to Geller, his software 2X to 4Xs your GPU capacity on existing hardware, simply by streamlining workloads and maximizing GPU usage time.

In this TechFirst, we chat about:

- the GPU shortage

- how many GPUs we need

- what Open AI is using right now

- whether OpenAI is getting dumber or not

- and much more

As always, get a full transcript and subscribe to the audio podcast at my website:

https://johnkoetsier.com/category/tech-first/

  continue reading

317 episodes

Artwork
iconShare
 
Manage episode 376711847 series 2809813
Content provided by John Koetsier. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by John Koetsier or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.

GPUs are rare and expensive right now. Every company doing AI model training needs more, and NVIDIA can't build enough, especially of the NVIDIA H100 GPU.

Run.ai CEO and co-founder Omri Geller says he has a software solution to this hardware problem.

The key: GPUs are mostly idle, even in high-demand settings. According to Geller, his software 2X to 4Xs your GPU capacity on existing hardware, simply by streamlining workloads and maximizing GPU usage time.

In this TechFirst, we chat about:

- the GPU shortage

- how many GPUs we need

- what Open AI is using right now

- whether OpenAI is getting dumber or not

- and much more

As always, get a full transcript and subscribe to the audio podcast at my website:

https://johnkoetsier.com/category/tech-first/

  continue reading

317 episodes

All episodes

×
 
Loading …

Welcome to Player FM!

Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.

 

Quick Reference Guide