Improving Apache Kafka Scalability and Elasticity with Tiered Storage

Improving Apache Kafka Scalability and Elasticity with Tiered Storage

What happens when you need to store more than a few petabytes of data? Rittika Adhikari (Software Engineer, Confluent) discusses how her team implemented tiered storage, a method for improving the scalability and elasticity of data storage in Apache Kafka®. She also explores the motivating factors for building it in the first place: cost, performance, and manageability. Before Tiered Storage, there was no real way to retain Kafka data indefinitely. Because of the tight coupling between...

Episoder(289)

Designing a Cluster Rollout Management System for Apache Kafka ft. Twesha Modi

Designing a Cluster Rollout Management System for Apache Kafka ft. Twesha Modi

As one of the top coders of her Java coding class in high school, Twesha Modi is continuing to follow her passion for computer science as a senior at Cornell University, where she has proven to be one...

23 Sep 202130min

Apache Kafka 3.0 - Improving KRaft and an Overview of New Features

Apache Kafka 3.0 - Improving KRaft and an Overview of New Features

Apache Kafka® 3.0 is out! To spotlight major enhancements in this release, Tim Berglund (Apache Kafka Developer Advocate) provides a summary of what’s new in the Kafka 3.0 release from Krakow, Poland,...

21 Sep 202115min

How to Build a Strong Developer Community with Global Engagement ft. Robin Moffatt and Ale Murray

How to Build a Strong Developer Community with Global Engagement ft. Robin Moffatt and Ale Murray

A developer community brings people with shared interests and purpose together. The fundamental elements of a community are to gather, learn, support, and create opportunities for collaboration. A dev...

14 Sep 202135min

What Is Data Mesh, and How Does it Work? ft. Zhamak Dehghani

What Is Data Mesh, and How Does it Work? ft. Zhamak Dehghani

The data mesh architectural paradigm shift is all about moving analytical data away from a monolithic data warehouse or data lake into a distributed architecture—allowing data to be shared for analyti...

9 Sep 202134min

Multi-Cluster Apache Kafka with Cluster Linking ft. Nikhil Bhatia

Multi-Cluster Apache Kafka with Cluster Linking ft. Nikhil Bhatia

Note: This episode was recorded when Cluster Linking was in preview mode. It’s now generally available as part of the Confluent Q3 ‘21 release on August 17, 2021. Infrastructure needs to react in rea...

31 Aug 202131min

Using Apache Kafka and ksqlDB for Data Replication at Bolt

Using Apache Kafka and ksqlDB for Data Replication at Bolt

What does a ride-hailing app that offers micromobility and food delivery services have to do with data in motion? In this episode, Ruslan Gibaiev (Data Architect, Bolt) shares about Bolt’s road to ado...

26 Aug 202129min

Placing Apache Kafka at the Heart of a Data Revolution at Saxo Bank

Placing Apache Kafka at the Heart of a Data Revolution at Saxo Bank

Monolithic applications present challenges for organizations like Saxo Bank, including difficulties when it comes to transitioning to cloud, data efficiency, and performing data management in a regula...

19 Aug 202128min

Advanced Stream Processing with ksqlDB ft. Michael Drogalis

Advanced Stream Processing with ksqlDB ft. Michael Drogalis

ksqlDB makes it easy to read, write, process, and transform data on Apache Kafka®, the de facto event streaming platform. With simple SQL syntax, pre-built connectors, and materialized views, ksqlDB’s...

11 Aug 202128min

Populært innen Politikk og nyheter

aftenpodden
giver-og-gjengen-vg
lydartikler-fra-aftenposten
forklart
aftenpodden-usa
i-retten
popradet
stopp-verden
det-store-bildet
dine-penger-pengeradet
fotballpodden-2
rss-gukild-johaug
rss-ness
hanna-de-heldige
nokon-ma-ga
aftenbla-bla
e24-podden
bt-dokumentar-2
rss-dannet-uten-piano
frokostshowet-pa-p5