All about Kafka

Go Time: Golang, Software Engineering

In this episode Matt joins Kris & Jon to discuss Kafka. During their discussion they cover topics like what problems Kafka helps solve, when a company should start considering Kafka, how throwing tech like Kafka at a problem won’t fix everything if there are underlying issues, complexities of using Kafka, managing payload schemas, and more.

Leave us a comment

Changelog++ members save 3 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

• Changelog News – A podcast+newsletter combo that’s brief, entertaining & always on-point. Subscribe today.
• Fly.io – The home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs.

Featuring:

• Matthew Boyle – Twitter, GitHub, Website
• Jon Calhoun – Twitter, GitHub, Website
• Kris Brandow – Twitter, GitHub

Show Notes:

• Matt’s Blog Post About Kafka at Cloudflare
• Sarama library
• Matt’s Golang Insiders Twitter Community
• Kubernetes the Hard Way
• Incident Monolith Blog Post
• Encore
• Memphis
• CRDT
• Designing Data-Intensive Applications
• Buf (mentioned by Matt)
• Prototool
• grpc.io

Something missing or broken? PRs welcome!

Chapters

1. It's Go Time! (00:00:00)

2. Matt's qualifications (00:01:34)

3. What is Kafka? (00:03:01)

4. Sponsor: Changelog News (00:12:24)

https://changelog.com/news

5. Barriers to entry (00:13:57)

6. Incident.io (00:35:41)

7. Chasing the next language (00:36:38)

8. CRDT (00:49:45)

9. Kafka and Go (00:54:49)

10. Protobuffs (01:05:11)

11. Unpopular opinions! (01:08:38)

12. Matt's unpop (01:09:02)

13. Kris' unpop (01:14:34)

14. Outro (01:24:02)