Improving Apache Kafka Scalability and Elasticity with Tiered Storage

Improving Apache Kafka Scalability and Elasticity with Tiered Storage

What happens when you need to store more than a few petabytes of data? Rittika Adhikari (Software Engineer, Confluent) discusses how her team implemented tiered storage, a method for improving the scalability and elasticity of data storage in Apache Kafka®. She also explores the motivating factors for building it in the first place: cost, performance, and manageability. Before Tiered Storage, there was no real way to retain Kafka data indefinitely. Because of the tight coupling between...

Episoder(284)

Deploying Confluent Platform, from Zero to Hero ft. Mitch Henderson

Deploying Confluent Platform, from Zero to Hero ft. Mitch Henderson

Mitch Henderson (Technical Account Manager, Confluent) explains how to plan and deploy your first application running on Confluent Platform. He covers critical factors to consider, like the tools and ...

18 Jun 201932min

Why Kafka Connect? ft. Robin Moffatt

Why Kafka Connect? ft. Robin Moffatt

In this episode, Tim talks to Robin Moffatt about what Kafka Connect is and why you should almost certainly use it if you're working with Apache Kafka®️. Whether you're building database offload pipel...

12 Jun 201946min

Schema Registry Made Simple by Confluent Cloud ft. Magesh Nandakumar

Schema Registry Made Simple by Confluent Cloud ft. Magesh Nandakumar

Tim Berglund and Magesh Nandakumar (Software Engineer, Confluent) discuss why schemas matter for building systems on Apache Kafka®, and how Confluent Schema Registry helps with the problem. They talk ...

3 Jun 201941min

Why is Stream Processing Hard? ft. Michael Drogalis

Why is Stream Processing Hard? ft. Michael Drogalis

Tim Berglund and Michael Drogalis (Product Lead for Kafka Streams and KSQL, Confluent) talk about all things stream processing: why it’s complex, how it's evolved, and what’s on the horizon to make it...

29 Mai 201945min

Testing Kafka Streams Applications with Viktor Gamov

Testing Kafka Streams Applications with Viktor Gamov

Tim Berglund is joined by Viktor Gamov (Developer Advocate, Confluent) to discuss various approaches to testing Kafka Streams applications. EPISODE LINKS KafkaEmbeddedTopologyTestDriverMocked Streams...

20 Mai 201942min

Chris Riccomini on the History of Apache Kafka and Stream Processing

Chris Riccomini on the History of Apache Kafka and Stream Processing

It’s a problem endemic to the tech world that we are always focused on what’s coming next, that we often forget to look at where we’ve been. Chris Riccomini, who was there at LinkedIn when Apache Kafk...

16 Mai 201950min

Ask Confluent #13: Machine Learning with Kai Waehner

Ask Confluent #13: Machine Learning with Kai Waehner

Gwen and Kai chat about machine learning architectures, and whether software engineers and data scientists can learn to get along. EPISODE LINKS Blogs on deploying machine learning workloads: Machine...

8 Mai 201933min

Diving into Exactly Once Semantics with Guozhang Wang

Diving into Exactly Once Semantics with Guozhang Wang

It has been said that in distributed messaging, there are two hard problems: 2) exactly once delivery, 1) guaranteed order of messages and 2) exactly once delivery. Apache Kafka® has offered exactly o...

22 Apr 201947min

Populært innen Politikk og nyheter

giver-og-gjengen-vg
aftenpodden
aftenpodden-usa
forklart
i-retten
stopp-verden
lydartikler-fra-aftenposten
nokon-ma-ga
popradet
det-store-bildet
rss-gukild-johaug
dine-penger-pengeradet
fotballpodden-2
aftenbla-bla
rss-ness
e24-podden
hanna-de-heldige
rss-dannet-uten-piano
frokostshowet-pa-p5
bt-dokumentar-2