Artwork

Content provided by Michael Kennedy and Michael Kennedy (@mkennedy). All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Michael Kennedy and Michael Kennedy (@mkennedy) or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.
Player FM - Podcast App
Go offline with the Player FM app!

#454: Data Pipelines with Dagster

58:25
 
Share
 

Manage episode 408157463 series 83399
Content provided by Michael Kennedy and Michael Kennedy (@mkennedy). All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Michael Kennedy and Michael Kennedy (@mkennedy) or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.
Do you have data that you pull from external sources or is generated and appears at your digital doorstep? I bet that data needs processed, filtered, transformed, distributed, and much more. One of the biggest tools to create these data pipelines with Python is Dagster. And we are fortunate to have Pedram Navid on the show this episode. Pedram is the Head of Data Engineering and DevRel at Dagster Labs. And we're talking data pipelines this week at Talk Python.
Episode sponsors
Talk Python Courses
Posit
Links from the show
Rock Solid Python with Types Course: training.talkpython.fm
Pedram on Twitter: twitter.com
Pedram on LinkedIn: linkedin.com
Ship data pipelines with extraordinary velocity: dagster.io
dagster-open-platform: github.com
The Dagster Master Plan: dagster.io
data load tool (dlt): dlthub.com
DataFrames for the new era: pola.rs
Apache Arrow: arrow.apache.org
DuckDB is a fast in-process analytical database: duckdb.org
Ship trusted data products faster: www.getdbt.com
Watch this episode on YouTube: youtube.com
Episode transcripts: talkpython.fm
--- Stay in touch with us ---
Subscribe to us on YouTube: youtube.com
Follow Talk Python on Mastodon: talkpython
Follow Michael on Mastodon: mkennedy
  continue reading

499 episodes

Artwork

#454: Data Pipelines with Dagster

Talk Python To Me

5,632 subscribers

published

iconShare
 
Manage episode 408157463 series 83399
Content provided by Michael Kennedy and Michael Kennedy (@mkennedy). All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Michael Kennedy and Michael Kennedy (@mkennedy) or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.
Do you have data that you pull from external sources or is generated and appears at your digital doorstep? I bet that data needs processed, filtered, transformed, distributed, and much more. One of the biggest tools to create these data pipelines with Python is Dagster. And we are fortunate to have Pedram Navid on the show this episode. Pedram is the Head of Data Engineering and DevRel at Dagster Labs. And we're talking data pipelines this week at Talk Python.
Episode sponsors
Talk Python Courses
Posit
Links from the show
Rock Solid Python with Types Course: training.talkpython.fm
Pedram on Twitter: twitter.com
Pedram on LinkedIn: linkedin.com
Ship data pipelines with extraordinary velocity: dagster.io
dagster-open-platform: github.com
The Dagster Master Plan: dagster.io
data load tool (dlt): dlthub.com
DataFrames for the new era: pola.rs
Apache Arrow: arrow.apache.org
DuckDB is a fast in-process analytical database: duckdb.org
Ship trusted data products faster: www.getdbt.com
Watch this episode on YouTube: youtube.com
Episode transcripts: talkpython.fm
--- Stay in touch with us ---
Subscribe to us on YouTube: youtube.com
Follow Talk Python on Mastodon: talkpython
Follow Michael on Mastodon: mkennedy
  continue reading

499 episodes

All episodes

×
 
Loading …

Welcome to Player FM!

Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.

 

Quick Reference Guide