Microsoft is all-in on AI: Part 2 (Changelog Interviews #594)

Changelog Master Feed

Mark Russinovich, Eric Boyd & Neha Batra join us to discuss the state of AI for Microsoft and OpenAI at Microsoft Build 2024. It’s safe to say that Microsoft is all-in on AI.

Leave us a comment

Changelog++ members save 14 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

• Cronitor – Cronitor helps you understand your cron jobs. Capture the status, metrics, and output from every cron job and background process. Name and organize each job, and ensure the right people are alerted when something goes wrong.
• 1Password – Build securely with 1Password - 1Password simplifies how you securely use, manage, and integrate developer credentials. Manage SSH keys and sign Git commits. Access secrets stored in 1Password. Automate administrative tasks. Integrate with third-party tools. Also, check out our INFRASTRUCTURE.md file for more details on how we do secrets with 1Password.
• Neon – The fully managed serverless Postgres with a generous free tier. Neon separates storage and compute to offer autoscaling, branching, and bottomless storage.
• Fly.io – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs.

Featuring:

• Mark Russinovich – LinkedIn
• Eric Boyd – LinkedIn
• Neha Batra – Twitter, GitHub, LinkedIn
• Adam Stacoviak – Mastodon, Twitter, GitHub, LinkedIn, Website
• Jerod Santo – Mastodon, Twitter, GitHub, LinkedIn

Show Notes:

• Mark Russinovich, Author on Amazon

Something missing or broken? PRs welcome!

Chapters

1. This is The Changelog (00:00:00)

2. Sponsor: Cronitor (00:01:23)

https://cronitor.io

3. Start the show! (00:02:49)

4. Hallucinations are concerning (00:05:22)

5. AI Red Team at Microsoft (00:09:57)

6. The Crescendo attack (00:11:48)

7. Masterkey attack (00:14:00)

8. AI Red Team's toolkit (00:17:09)

9. What skills do you need? (00:19:30)

10. The state of AI security (00:21:51)

11. Were you a Mr. Robot fan (00:25:33)

12. Do you write good books? (00:27:54)

13. Hard science favorite authors (00:28:43)

14. We're not at risk losing our jobs to AI (00:31:02)

15. Image generation wtih DALL-E (00:34:51)

16. Generating better code (00:38:24)

17. Copilots' everywhere (00:45:14)

18. Coding with the Copilot pause (00:48:42)

19. Copilot + PC (00:50:19)

20. Install the Copilot app (00:52:41)

21. Sponsor: 1Password (00:55:38)

https://1password.com/changelogpod

22. Eric Boyd on Azure's AI platform (01:00:29)

23. Building specialized data centers (01:03:11)

24. Announcing GPT-4o is ready (01:05:20)

25. Opperating at scale (01:07:07)

26. Behind Azure's AI Platform team (01:09:23)

27. How SLM can we go? (01:15:39)

28. Practices for benchmarking results (01:16:16)

29. Prompt Shields (01:18:43)

30. AI crafted a sword in Minecraft (01:21:06)

31. Hallucinations are challenging (01:24:16)

32. 12x cheaper, 6x faster (new Moore's Law?) (01:26:34)

33. Are you hopeful about AI? (01:30:31)

34. Working with Copilot + PC (01:36:08)

35. Choosing a model (01:38:44)

36. Moving into the devices (01:42:16)

37. Allocating budget to Ai agents (01:44:28)

38. What's next for your team? (01:46:55)

39. Driving and talking to AI (01:48:55)

40. Major gaps. What's missing? (01:51:01)

41. Sponsor: Neon (01:53:40)

https://neon.tech

42. Neha Batra is here for the adventure (01:59:01)

43. Your journey at GitHub (02:02:38)

44. When Satya calls you on stage (02:06:16)

45. Open in Workspace (02:09:08)

46. How does GitHub Copilot work? (02:11:18)

47. Are summaries the killer feature? (02:16:49)

48. Every app will be reinvented with AI (02:21:02)

49. Anthropomorphization of AI (02:23:02)

50. The ReadMe Podcast (02:25:42)

51. Sitting the VP seat (02:27:58)

52. Daily mantra? (02:32:14)

53. Recent major fires? (02:36:12)

54. Measuring results (02:39:12)

55. Electrifying energy here at Build (02:41:07)

56. Wrapping up (02:42:38)

57. Whew! What's next? (02:44:06)