#036 Why Distributed Processing Is Super Important

Plumbers of Data Science

Content provided by Andreas Kretz. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Andreas Kretz or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.

5+ y ago 22:30

MP3•Episode home

Archived series ("Inactive feed" status)

When? This feed was archived on August 04, 2020 21:15 (3+ y ago). Last successful fetch was on March 10, 2020 15:30 (4y ago)

Why? Inactive feed status. Our servers were unable to retrieve a valid podcast feed for a sustained period.

What now? You might be able to find a more up-to-date version using the search function. This series will no longer be checked for updates. If you believe this to be in error, please check if the publisher's feed link below is valid and contact support to request the feed be restored or if you have any other concerns about this.

You need to become comfortable with distributed processing. Data Science or the Internet of Things, the amount of data that is getting produced and processed grows like crazy. In this podcast I talk about how a platform for distributed processing looks like. I talk about the different layers that need parallelization, as well as the tools you can use for on premise installations or clouds like AWS, Azure or Google Cloud. Big Data tools like Kafka, Spark or server less like Kinesis or Lambda functions.

84 episodes

#Tech #Data Science #Andreas Kretz