show episodes
 
Streaming Audio is a podcast from Confluent, the team that originally built Apache Kafka. Host Tim Berglund (Senior Director of Developer Experience, Confluent) and guests unpack a variety of topics surrounding Apache Kafka, event stream processing, and real-time data. The show covers frequently asked questions and comments about the Confluent and Kafka ecosystems—from Kafka connectors to distributed systems, data integration, Kafka deployment, and managed Apache Kafka as a service—on Twitte ...
 
Welcome to The Craft of Open Source, hosted by Ben Rometsch, Co-Founder and CEO of Flagsmith. This bi-weekly show is focused on the ins and outs of the Open Source Software Community. Join Ben as he speaks with the brightest minds that have brought us some of the most adopted technologies on earth. Each episode is an interview with creators, maintainers, entrepreneurs, and key contributors to the open source community. We will cover critical topics for open source developers, contributors an ...
 
New to networks? Looking into links? Realising the relevance of relationships? Welcome to GraphStuff, your one-stop podcast for all things connected. Join your hosts William Lyon and Lju Lazarevic and guests as they dive into the world of graph databases. They’ll cover everything from how they’re constructed and where they’re used; deep dives to modelling, from first concepts to finished application, from graph-shaped problems, to best-practice graphs. With something new and different each w ...
 
Loading …
show series
 
The best-informed business insights that support better decision-making begin with data collection, ahead of data processing and analytics. Enterprises nowadays are engulfed by data floods, with data sources ranging from cloud services, applications, to thousands of internal servers. The massive volume of data that organizations must process presen…
 
Neo4j Connectors page: neo4j.com/product/connectors Neo4j Connector for Apacha Kafka: neo4j.com/labs/kafka/ Neo4j Connector for Business Intelligence: neo4j.com/bi-connector/ Neo4j Connector for Apache Spark: neo4j.com/product/connectors/apache-spark-connector The Neo4j GraphQL library: neo4j.com/product/graphql-library/ Using Retool with Neo4j Gra…
 
Stream processing has become an important part of the big data landscape as a new programming paradigm to implement real-time data-driven applications. One of the biggest challenges for streaming systems is to provide correctness guarantees for data processing in a distributed environment. Guozhang Wang (Distributed Systems Engineer, Confluent) con…
 
Using large amounts of streaming data increasingly requires interactive, real-time analytics and dashboards—and this applies to any industry, including tech. CTO and Co-Founder of Rockset Dhruba Borthakur shares how his company uses Apache Kafka® to perform complex joins, search, and aggregations on streaming data with low latencies. The Kafka data…
 
MinIO is considered the #1 cloud-native open-source object store for enterprises. Ben Rometsch's guest in this episode is Harshavardhana, the co-founder of MinIO. In this interview, you'll get a glimpse of Harsha's founding principles in building MinIO: simplicity and predictability. Harsha explains that building software anyone can run on their la…
 
Is it possible to have automated adoption of your event-driven architectures and microservices? The answer is yes! Alianna Inzana, product leader for API testing and virtualization at SmartBear, uses this evolutionary model to make event services reusable, functional, and strategic for both in-house needs and clients. SmartBear relies on Apache Kaf…
 
NODES 2021 Keynote video: https://www.youtube.com/watch?v=4ZCs83_iHU8 Neo4j 4.3 blog post: https://neo4j.com/blog/introducing-neo4j-4-3-the-fastest-path-to-graph-productivity/ Neo4j 4.3 release notes: https://neo4j.com/release-notes/neo4j-4-3-0/ Neo4j 4.3 Blog Series: Relationship Indexes: https://neo4j.com/developer-blog/neo4j-4-3-blog-series-rela…
 
The open-source community was changed forever with the Jenkins software project. Providing hundreds of plugins to be used for project building, deployment, and automation, it is the leading open-source automation server today. To explore this even further, Ben Rometsch goes back to the beginning by sitting down with its creator, Kohsuke Kawaguchi. …
 
Coming out of university, Patrick Neff (Data Scientist, BAADER) was used to “perfect” examples of datasets. However, he soon realized that in the real world, data is often either unavailable or unstructured. This compelled him to learn more about collecting data, analyzing it in a smart and automatic way, and exploring Apache Kafka® as a core ecosy…
 
We're joined on this episode of Drill to Detail by Dylan Baker and Josh Temple to talk about developing multi-layer modern data stack projects, Spectacles’ recently released integration with dbt and what's now possible with their new public API Extending Spectacles with API-Triggered Runs Synchronizing Looker and dbt™ with Spectacles Drill to Detai…
 
The most secure clusters aren’t built on the hopes that they’ll never break. They are the clusters that are broken on purpose and with a specific goal. When organizations want to avoid systematic weaknesses, chaos engineering with Apache Kafka® is the route to go. Your system is only as reliable as its highest point of vulnerability. Patrick Brenna…
 
Open source is an ever-evolving field since technological innovation and demands will not stop as human life progresses, finding a useful open-source alternative to existing projects. This way, the work of a developer can be easier depending on the purpose they are after. Ben Rometsch talks with Bjarne Christiansen to discuss the journey of how he …
 
Confluent Cloud isn’t just for public access anymore. As the requirement for security across sectors increases, so does the need for virtual private cloud (VPC) connections. It is becoming more common today to come across Apache Kafka® implementations with the latest private link connectivity option. In the past, most Confluent Cloud users were sat…
 
Based on Apache Kafka® 2.8, Confluent Platform 6.2 introduces Health+, which offers intelligent alerting, cloud-based monitoring tools, and accelerated support so that you can get notified of potential issues before they manifest as critical problems that lead to downtime and business disruption. Health+ provides ongoing, real-time analysis of perf…
 
Collecting internal, operational telemetry from Confluent Cloud services and thousands of clusters is no small feat. Stakeholders need to rely on the same data to make operational decisions. Whether it be metrics from clusters in Confluent Cloud or traces from our internal service, they all provide valuable insights not only to engineering teams bu…
 
Mark Rittman is joined in this episode by Nick Schrock, ex-Facebook Engineer and now Founder of Elementl to talk about GraphQL, data platform engineers and @dagsterio, a data orchestrator for machine learning, analytics, and ETL. Introducing Dagster Dagster homepage Elementl homepage Orchestrating dbt with Dagster Moving past Airflow: Why Dagster i…
 
One of the most important features of an open-source project is its high level of user-friendliness. Even if one has various complexities that allow for better application development or webserver management, something that's confusing and time-consuming will not be used as much by many. This is what Kasra Bigdeli had in mind when he started CapRov…
 
Focused on optimizing Apache Kafka® performance with maximized efficiency, Confluent’s Product Infrastructure team has been actively exploring opportunities for scaling out Kafka clusters. They are able to run Kafka workloads with half the typical memory usage while saving infrastructure costs, which they have tested and now safely rolled out acros…
 
Mark Rittman is joined in this episode by Michale Drogalis, Product Manager at Confluent to talk about the history of Apache Kafka and real-time stream processing, the origins of kSQL and kSQLdb and the rationale and use-cases addressed by these products. ksqldDB product homepage Introducing ksqlDB Blog Post Kafka Streams vs. ksqlDB Blog Post…
 
When compiling database reports using a variety of data from different systems, obtaining the right data when you need it in real time can be difficult. With cloud connectivity and distributed data pipelines, Pat Helland (Principal Architect, Salesforce) explains how to make educated partial answers when you need to use the Apache Kafka® platform. …
 
Jason Gustafson and Colin McCabe, Apache Kafka® developers, discuss the project to remove ZooKeeper—now known as the KRaft (Kafka on Raft) project. A previous episode of Streaming Audio featured both developers on the podcast before the release of Apache Kafka 2.8. Now they’re back to share their progress. The KRraft code has been merged (and conti…
 
What is the internet of things (IoT), and how does it relate to event streaming and Apache Kafka®? The deployment of Kafka outside the datacenter creates many new possibilities for processing data in motion and building new business cases. In this episode, Kai Waehner, field CTO and global technology advisor at Confluent, discusses the intersection…
 
Imagine if you could create a better world for future generations simply by delivering marine ingenuity. Van Oord is a Dutch family-owned company that has served as an international marine contractor for over 150 years, focusing on dredging, land infrastructure in the Netherlands, and offshore wind and oil & gas infrastructure. Real-time insights i…
 
Mark Rittman is joined by Eldad Farkash, Co-Founder and CEO at Firebolt to talk about SiSense and Panorama, the history of cloud data warehouses and how Firebolt's technology delivers query results 4-6000x faster than Snowflake, Redshift and AWS Athena. Snowflake’s Co-Founder Marcin Żukowski Reflects On His Time At CWI Centrum Wiskunde & Informatic…
 
Mitchell Hashimoto's company HashiCorp is the creator of Vagrant, Packer, Serf, Consul, Terraform, Vault, and Nomad. Together, these open source projects have over 100,000 stars on Github and exist to help engineers better with consistent workflows to provision, secure, connect, and run any infrastructure for any application.…
 
At Klarna, Lead Engineer Tommy Brunn is building a runtime platform for developers. But outside of his professional role, he is also one of the authors of the JavaScript client for Apache Kafka® called KafkaJS, which has grown from being a niche open source project to the most downloaded Kafka client for Node.js since 2018. Using Kafka in Node.js h…
 
Apache Kafka 2.8 is out! This release includes early access to the long-anticipated ZooKeeper removal encapsulated in KIP-500, as well as other key updates, including the addition of a Describe Cluster API, support for mutual TLS authentication on SASL_SSL listeners, exposed task configurations in the Kafka Connect REST API, the removal of a proper…
 
Loading …

Quick Reference Guide

Copyright 2021 | Sitemap | Privacy Policy | Terms of Service
Google login Twitter login Classic login