Udio & the age of multi-modal AI

Practical AI: Machine Learning, Data Science

2024 promises to be the year of multi-modal AI, and we are already seeing some amazing things. In this “fully connected” episode, Chris and Daniel explore the new Udio product/service for generating music. Then they dig into the differences between recent multi-modal efforts and more “traditional” ways of combining data modalities.

Leave us a comment

Changelog++ members save 26 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

• Fly.io – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs.
• Changelog News – A podcast+newsletter combo that’s brief, entertaining & always on-point. Subscribe today.

Featuring:

• Chris Benson – Twitter, GitHub, LinkedIn, Website
• Daniel Whitenack – Twitter, GitHub, Website

Show Notes:

• Udio
• CLIP
• BridgeTower
• LLaVA

Something missing or broken? PRs welcome!

Chapters

1. Welcome to Practical AI (00:00:00)

2. Get fully-connected (00:00:43)

3. 2024 multi-modality (00:02:24)

4. Udio songs (00:03:48)

5. AI music legality (00:11:37)

6. Industry shaking (00:16:12)

7. Growing with these tools (00:17:24)

8. Sponsor: Changelog News (00:19:29)

https://changelog.com/news

9. Evolution of multi-modality (00:21:28)

10. Human information processing (00:24:32)

11. Computer vision progress (00:26:21)

12. Conclusion (00:36:04)

13. Outro (00:38:05)