Improving Apache Kafka Scalability and Elasticity with Tiered Storage

Improving Apache Kafka Scalability and Elasticity with Tiered Storage

What happens when you need to store more than a few petabytes of data? Rittika Adhikari (Software Engineer, Confluent) discusses how her team implemented tiered storage, a method for improving the scalability and elasticity of data storage in Apache Kafka®. She also explores the motivating factors for building it in the first place: cost, performance, and manageability. Before Tiered Storage, there was no real way to retain Kafka data indefinitely. Because of the tight coupling between...

Jaksot(282)

From “This May Never Work” to WarpStream with Richie Artoul | Ep. 17

From “This May Never Work” to WarpStream with Richie Artoul | Ep. 17

Tim Berglund talks to Richie Artoul (WarpStream/Confluent) about his career in data infrastructure. Richie’s first job: working at Howie’s Game Shack, a walk‑in LAN gaming cafe. His challenge: working...

2 Helmi 30min

Inside $3M GPU Racks: Powering Modern AI with Bryan Oliver | Ep. 16

Inside $3M GPU Racks: Powering Modern AI with Bryan Oliver | Ep. 16

Adi Polak talks to Bryan Oliver (Thoughtworks) about his career in platform engineering and large-scale AI infrastructure. Bryan’s first job: building pools and teaching swimming lessons. His challeng...

26 Tammi 30min

Hacking Kafka Streams with Sophie Blee‑Goldman | Ep. 15

Hacking Kafka Streams with Sophie Blee‑Goldman | Ep. 15

Tim Berglund talks to Sophie Blee-Goldman (Responsive) about her career in container orchestration and Kafka Streams. Sophie’s first job: interning at Google. Her challenge: helping a hyper-growth cus...

19 Tammi 34min

Turning Chaos into Push-Button Provisioning with Dhiraj Suri| Ep. 14

Turning Chaos into Push-Button Provisioning with Dhiraj Suri| Ep. 14

Viktor Gamov talks to Dhiraj Suri (Confluent) about his career in systems engineering and stream governance. Dhiraj’s first job: software developer at NetApp. His challenge: working at Splunk to stitc...

12 Tammi 21min

The Late Night Hack That Changed Daniel Hinojosa's Career | Ep. 13

The Late Night Hack That Changed Daniel Hinojosa's Career | Ep. 13

Tim Berglund talks to Daniel Hinojosa (an independent consultant) about his career in software development, data engineering, and event-driven architecture. Daniel’s first job: Sears credit card telem...

5 Tammi 16min

From Early Startups to Product Leadership with Mike Agnich | Ep. 12

From Early Startups to Product Leadership with Mike Agnich | Ep. 12

Tim Berglund talks to Mike Agnich (Confluent) about his career in product leadership and startups. Mike’s first job: refereeing youth basketball. His challenge: leading product across connectors, gove...

15 Joulu 202518min

Adventures in Data Infrastructure with Gwen Shapira | Ep. 11

Adventures in Data Infrastructure with Gwen Shapira | Ep. 11

Adi Polak talks to Gwen Shapira (Nile) about her career in databases and data infrastructure. Gwen’s first job: a side hustle fixing computers. Her challenge: figuring out why a production report at H...

8 Joulu 202521min

Decreasing Java Build Times with Pratik Patel | Ep. 10

Decreasing Java Build Times with Pratik Patel | Ep. 10

Tim Berglund talks to Pratik Patel (Azul Systems) about his career in developer relations and Java. Pratik’s first job: computer lab assistant at UNC Chapel Hill. His challenge: working at a large ent...

1 Joulu 202525min

Suosittua kategoriassa Politiikka ja uutiset

aikalisa
rss-ootsa-kuullut-tasta
tervo-halme
ootsa-kuullut-tasta-2
politiikan-puskaradio
viisupodi
otetaan-yhdet
rss-podme-livebox
rss-asiastudio
et-sa-noin-voi-sanoo-esittaa
rss-vaalirankkurit-podcast
the-ulkopolitist
linda-maria
rss-kaikki-uusiksi
rss-mina-ukkola
rss-pykalien-takaa
rss-merja-mahkan-rahat
rss-kuka-mina-olen
rss-raha-talous-ja-politiikka
rss-kyselytunti