Improving Apache Kafka Scalability and Elasticity with Tiered Storage

Improving Apache Kafka Scalability and Elasticity with Tiered Storage

What happens when you need to store more than a few petabytes of data? Rittika Adhikari (Software Engineer, Confluent) discusses how her team implemented tiered storage, a method for improving the scalability and elasticity of data storage in Apache Kafka®. She also explores the motivating factors for building it in the first place: cost, performance, and manageability. Before Tiered Storage, there was no real way to retain Kafka data indefinitely. Because of the tight coupling between...

Episoder(289)

Data Mesh Architecture: A Modern Distributed Data Model

Data Mesh Architecture: A Modern Distributed Data Model

Data mesh isn’t software you can download and install, so how do you build a data mesh? In this episode, Adam Bellemare (Staff Technologist, Office of the CTO, Confluent) discusses his data mesh proof...

2 Jun 202248min

Flink vs Kafka Streams/ksqlDB: Comparing Stream Processing Tools

Flink vs Kafka Streams/ksqlDB: Comparing Stream Processing Tools

Stream processing can be hard or easy depending on the approach you take, and the tools you choose. This sentiment is at the heart of the discussion with Matthias J. Sax (Apache Kafka® PMC member; Sof...

26 Mai 202255min

Practical Data Pipeline: Build a Plant Monitoring System with ksqlDB

Practical Data Pipeline: Build a Plant Monitoring System with ksqlDB

Apache Kafka® isn’t just for day jobs according to Danica Fine (Senior Developer Advocate, Confluent). It can be used to make life easier at home, too! Building out a practical Apache Kafka® data pipe...

19 Mai 202233min

Apache Kafka 3.2 - New Features & Improvements

Apache Kafka 3.2 - New Features & Improvements

Apache Kafka® 3.2 delivers new KIPs in three different areas of the Kafka ecosystem: Kafka Core, Kafka Streams, and Kafka Connect. On behalf of the Kafka community, Danica Fine (Senior Developer Advo...

17 Mai 20226min

Scaling Apache Kafka Clusters on Confluent Cloud ft. Ajit Yagaty and Aashish Kohli

Scaling Apache Kafka Clusters on Confluent Cloud ft. Ajit Yagaty and Aashish Kohli

How much can Apache Kafka® scale horizontally, and how can you automatically balance, or rebalance data to ensure optimal performance? You may require the flexibility to scale or shrink your Kafka cl...

11 Mai 202249min

Streaming Analytics on 50M Events Per Day with Confluent Cloud at Picnic

Streaming Analytics on 50M Events Per Day with Confluent Cloud at Picnic

What are useful practices for migrating a system to Apache Kafka® and Confluent Cloud, and why use Confluent to modernize your architecture?Dima Kalashnikov (Technical Lead, Picnic Technologies) is pa...

5 Mai 202234min

Build a Data Streaming App with Apache Kafka and JS - Coding in Motion

Build a Data Streaming App with Apache Kafka and JS - Coding in Motion

Coding is inherently enjoyable and experimental. With the goal of bringing fun into programming, Kris Jenkins (Senior Developer Advocate, Confluent) hosts a new series of hands-on workshops—Coding in ...

3 Mai 20222min

Optimizing Apache Kafka's Internals with Its Co-Creator Jun Rao

Optimizing Apache Kafka's Internals with Its Co-Creator Jun Rao

You already know Apache Kafka® is a distributed event streaming system for setting your data in motion, but how does its internal architecture work? No one can explain Kafka’s internal architecture be...

28 Apr 202248min

Populært innen Politikk og nyheter

giver-og-gjengen-vg
aftenpodden
forklart
lydartikler-fra-aftenposten
aftenpodden-usa
popradet
i-retten
stopp-verden
det-store-bildet
fotballpodden-2
rss-gukild-johaug
dine-penger-pengeradet
rss-ness
hanna-de-heldige
nokon-ma-ga
aftenbla-bla
bt-dokumentar-2
e24-podden
frokostshowet-pa-p5
rss-penger-polser-og-politikk