Artwork

Content provided by Chariot Solutions. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Chariot Solutions or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.
Player FM - Podcast App
Go offline with the Player FM app!

D2C242: Data Engineering and its Streams, Rivers, and Lakes

47:38
 
Share
 

Manage episode 418062189 series 1250290
Content provided by Chariot Solutions. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Chariot Solutions or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.

Keith Gregory teaches Day Two Cloud about data engineering in a way DevOps folks (and hydrologists) can understand. He explains that the role of a data engineer is to create pipelines to transport data from metaphorical rivers and make it usable for data analysts. Keith walks us through the testing process; the difference between streaming pipelines and polling pipelines; and the difference between data lakes and data warehouses. Plus, he explains terms that network engineers and developers might bump into when working on big projects, but might not know exactly what they are: ELT, OLTP, columnar storage, and more.

The post D2C242: Data Engineering and its Streams, Rivers, and Lakes appeared first on Chariot Solutions.

  continue reading

46 episodes

Artwork
iconShare
 
Manage episode 418062189 series 1250290
Content provided by Chariot Solutions. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Chariot Solutions or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.

Keith Gregory teaches Day Two Cloud about data engineering in a way DevOps folks (and hydrologists) can understand. He explains that the role of a data engineer is to create pipelines to transport data from metaphorical rivers and make it usable for data analysts. Keith walks us through the testing process; the difference between streaming pipelines and polling pipelines; and the difference between data lakes and data warehouses. Plus, he explains terms that network engineers and developers might bump into when working on big projects, but might not know exactly what they are: ELT, OLTP, columnar storage, and more.

The post D2C242: Data Engineering and its Streams, Rivers, and Lakes appeared first on Chariot Solutions.

  continue reading

46 episodes

All episodes

×
 
Loading …

Welcome to Player FM!

Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.

 

Quick Reference Guide