Gaudi processors & Intel's AI portfolio (Practical AI #281)

Changelog Master Feed

There is an increasing desire for and effort towards GPU alternatives for AI workloads and an ability to run GenAI models on CPUs. Ben and Greg from Intel join us in this episode to help us understand Intel’s strategy as it related to AI along with related projects, hardware, and developer communities. We dig into Intel’s Gaudi processors, open source collaborations with Hugging Face, and AI on CPU/Xeon processors.

Leave us a comment

Changelog++ members save 5 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

• Intel Innovation 2024 – Early bird registration is now open for Intel Innovation 2024 in San Jose, CA! Learn more OR register
• Motific – Accelerate your GenAI adoption journey. Rapidly deliver trustworthy GenAI assistants. Learn more at motific.ai

Featuring:

• Benjamin Consolvo – Twitter, GitHub, LinkedIn
• Greg Serochi – LinkedIn
• Chris Benson – Twitter, GitHub, LinkedIn, Website
• Daniel Whitenack – Twitter, GitHub, Website

Show Notes:

• Intel’s AI & Machine Learning Ecosystem Developer Resources
• Intel® Tiber™ Developer Cloud
• Intel Gaudi AI Processors
• Optimum Habana
• Overview of AI tools from Intel
• OpenVINO
• Case Study: Prediction Guard De-Risks LLM Applications at Scale
• How Prediction Guard Delivers Trustworthy AI on Intel® Gaudi® 2 AI Accelerators

Something missing or broken? PRs welcome!

Chapters

1. Welcome to Practical AI (00:00:00)

2. Sponsor: Intel (00:00:44)

https://intel.com/innovation?regcode=CMCCHL&utm_campaign=Changelog

3. Welcome Intel's Benjamin Consolvo & Greg Serochi (00:02:47)

4. Intel at a high level (00:04:11)

5. Competition (00:07:30)

6. Transitioning from NVIDIA (00:08:59)

7. Intel & open source (00:12:02)

8. What is Gaudi®? (00:16:52)

9. AI dedicated processors vs GPUs (00:20:37)

10. Scale & possibilities (00:23:13)

11. Sponsor: Motific (00:27:56)

https://www.motific.ai/

12. Getting hands on (00:29:56)

13. Tiber developer cloud (00:31:47)

14. Gaudi® at the edge (00:34:22)

15. The future with Intel (00:35:44)

16. Chip diversity (00:39:52)

17. Where is this headed? (00:41:12)

18. Go try it! (00:45:11)

19. Outro (00:45:41)