Improving Apache Kafka Scalability and Elasticity with Tiered Storage

Improving Apache Kafka Scalability and Elasticity with Tiered Storage

What happens when you need to store more than a few petabytes of data? Rittika Adhikari (Software Engineer, Confluent) discusses how her team implemented tiered storage, a method for improving the scalability and elasticity of data storage in Apache Kafka®. She also explores the motivating factors for building it in the first place: cost, performance, and manageability. Before Tiered Storage, there was no real way to retain Kafka data indefinitely. Because of the tight coupling between...

Episoder(284)

Announcing ksqlDB ft. Jay Kreps

Announcing ksqlDB ft. Jay Kreps

Jay Kreps (original Co-creator of Apache Kafka and CEO, Confluent) introduces ksqlDB, an event streaming database. As the successor to KSQL, ksqlDB seeks to unify the multiple systems involved in stre...

20 Nov 201926min

Installing Apache Kafka with Ansible ft. Viktor Gamov and Justin Manchester

Installing Apache Kafka with Ansible ft. Viktor Gamov and Justin Manchester

“It’s one thing to get a distributed system up and running. It’s another thing to get a distributed system up and running well.” Ansible keeps your Apache Kafka® deployment, management, and installati...

18 Nov 201946min

Securing the Cloud with VPC Peering ft. Daniel LaMotte

Securing the Cloud with VPC Peering ft. Daniel LaMotte

Everything is moving to the cloud, which makes it increasingly important to secure your cloud infrastructure and minimize the threat of potential attackers. With a virtual private cloud (VPC)—your own...

13 Nov 201931min

ETL and Event Streaming Explained ft. Stewart Bryson

ETL and Event Streaming Explained ft. Stewart Bryson

Migrating from traditional ETL tools to an event streaming platform is a process that Stewart Bryson (CEO and founder, Red Pill Analytics), is no stranger to. In this episode, he dispels misconception...

6 Nov 201949min

The Pro’s Guide to Fully Managed Apache Kafka Services ft. Ricardo Ferreira

The Pro’s Guide to Fully Managed Apache Kafka Services ft. Ricardo Ferreira

Several definitions of a fully managed Apache Kafka® service have floated around, but Ricardo Ferreira (Developer Advocate, Confluent) breaks down what it truly means and why every developer should ca...

4 Nov 201956min

Kafka Screams: The Scariest JIRAs and How To Survive Them ft. Anna McDonald

Kafka Screams: The Scariest JIRAs and How To Survive Them ft. Anna McDonald

In today's spooktacular episode of Streaming Audio, Anna McDonald (Technical Account Manager, Confluent) discusses six of the scariest Apache Kafka® JIRAs. Starting with KAFKA-6431: Lock Contention in...

30 Okt 201946min

Data Integration with Apache Kafka and Attunity

Data Integration with Apache Kafka and Attunity

From change data capture (CDC) to business development, connecting Apache Kafka® environments, and customer success stories, Graham Hainbach discusses the possibilities of data integration with Kafka ...

28 Okt 201943min

Distributed Systems Engineering with Apache Kafka ft. Colin McCabe

Distributed Systems Engineering with Apache Kafka ft. Colin McCabe

Colin McCabe shares about what it’s like being a distributed systems engineer on the Core Kafka team at Confluent, where he has worked previously, and how that led to his interest in Apache Kafka®. As...

23 Okt 201945min

Populært innen Politikk og nyheter

giver-og-gjengen-vg
aftenpodden
aftenpodden-usa
forklart
stopp-verden
i-retten
lydartikler-fra-aftenposten
popradet
nokon-ma-ga
det-store-bildet
dine-penger-pengeradet
rss-ness
aftenbla-bla
hanna-de-heldige
rss-gukild-johaug
e24-podden
fotballpodden-2
frokostshowet-pa-p5
rss-dannet-uten-piano
grasoner-den-nye-kalde-krigen