41: Trino Puts On Its Hudi Trino Community Broadcast podcast

1+ y ago 1:43:00

Content provided by Brian Olsen and Trino Community. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Brian Olsen and Trino Community or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.

Trino's initial use case was around replacing the Apache Hive runtime. As data lakes grew into prominence, it became clear that having a faster query engine didn't solve all problems. The Hive model itself was a huge bottleneck and didn't provide features that companies needed akin to data warehouses and databases. Apache Hudi is a new table format created out of Uber that aims to address many of these issues and usher in a new generation of data lake.

Tune in as we speak to the Trino Hudi connector contributor Sagar Sumit and Grace Lu who uses Trino and Hudi at Robinhood to discuss the new Hudi connector and future plans!

- Intro Music: 0:00

- Intro: 0:32

- Releases: 14:43

- Concept of the episode: Intro to Hudi and the Hudi connector: 22:29

- Concept of the episode: Merge on read and copy on write tables: 28:28

- Concept of the episode: Hudi metadata table: 39:24

- Concept of the episode: Hudi data layout: 46:39

- Concept of the episode: Robinhood Trino and Hudi use cases: 51:12

- Concept of the episode: Current state and roadmap for the Hudi connector: 1:03:15

- Pull request of the episode: PR 14445: Fault-tolerant execution for PostgreSQL and MySQL connectors: 1:08:14

- Demo of the episode: Using the Hudi Connector: 1:13:34

Show Notes: https://trino.io/episodes/41.html

Show Page: https://trino.io/broadcast/

55 episodes