Artwork

Content provided by Eric Anderson. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Eric Anderson or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.
Player FM - Podcast App
Go offline with the Player FM app!

Prefect with Jeremiah Lowin

48:59
 
Share
 

Manage episode 274991531 series 2626943
Content provided by Eric Anderson. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Eric Anderson or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.

Eric Anderson (@ericmander) and Jeremiah Lowin (@jlowin) discuss Prefect, a workflow management system and data orchestration tool under development as an open-source project. Jeremiah initially created Prefect to solve a technical challenge specific to his own work, but soon realized that it was appealing to a very wide range of different clients. Listen to today’s episode to learn why Jeremiah believes most attempts to build a unified framework for solving data orchestration fail.

In this episode we discuss:

  • Solving the “negative engineering problem”
  • Learning from the complaints of data engineers at Apache Airflow
  • The difficulty of having a product that serves two masters
  • How COVID changed the direction of Prefect

Links:

People mentioned:

  continue reading

82 episodes

Artwork

Prefect with Jeremiah Lowin

Contributor

19 subscribers

published

iconShare
 
Manage episode 274991531 series 2626943
Content provided by Eric Anderson. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Eric Anderson or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.

Eric Anderson (@ericmander) and Jeremiah Lowin (@jlowin) discuss Prefect, a workflow management system and data orchestration tool under development as an open-source project. Jeremiah initially created Prefect to solve a technical challenge specific to his own work, but soon realized that it was appealing to a very wide range of different clients. Listen to today’s episode to learn why Jeremiah believes most attempts to build a unified framework for solving data orchestration fail.

In this episode we discuss:

  • Solving the “negative engineering problem”
  • Learning from the complaints of data engineers at Apache Airflow
  • The difficulty of having a product that serves two masters
  • How COVID changed the direction of Prefect

Links:

People mentioned:

  continue reading

82 episodes

All episodes

×
 
Loading …

Welcome to Player FM!

Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.

 

Quick Reference Guide