DoK Talks #101- Redpanda: how to build a storage engine for kubernetes // Alexander Gallego

DoK Talks #101- Redpanda: how to build a storage engine for kubernetes // Alexander Gallego

https://go.dok.community/slack
https://dok.community/

ABSTRACT OF THE TALK

How to build a stateful, transactional streaming storage engine on top of kubernetes.

KEY TAKE-AWAYS FROM THE TALK

1. Building storage engines in kubernetes is hard
2. You need tiered storage (S3 or google cloud bucket, Azure Blob) for total disaster recovery
3. You also need sound replication inside the cluster
4. You need a simple architecture so you can scale the pods easily

BIO

Alex Gallego is the founder and CEO of Vectorized, where he & the team hack on Redpanda, a modern streaming platform for mission critical workloads. Prior to Vectorized, he was a principal engineer at Akamai, as well as co-founder and CTO of Concord.io, a high performance stream processing engine built in C++ and acquired by Akamai in 2016.

Jaksot(243)

Operating FoundationDB on Kubernetes (DoK Day EU 2022) // Johannes M. Scheuermann

Operating FoundationDB on Kubernetes (DoK Day EU 2022) // Johannes M. Scheuermann

https://go.dok.community/slack https://dok.community/ From the DoK Day EU 2022 (https://youtu.be/Xi-h4XNd5tE) FoundationDB is an open-source distributed transactional Key-Value store that is used by ...

27 Touko 20228min

One Click to Run Apache Spark as a Service on Kubernetes (DoK Day EU 2022) // Bo Yang

One Click to Run Apache Spark as a Service on Kubernetes (DoK Day EU 2022) // Bo Yang

https://go.dok.community/slack https://dok.community/ From the DoK Day EU 2022 (https://youtu.be/Xi-h4XNd5tE) It is still challenging to run Apache Spark and other big data processing workload on Kub...

27 Touko 20229min

Microservices and Kubernetes for your Full Data Lifecycle (DoK Day EU 2022) // Steve Pousty

Microservices and Kubernetes for your Full Data Lifecycle (DoK Day EU 2022) // Steve Pousty

https://go.dok.community/slack https://dok.community/ From the DoK Day EU 2022 (https://youtu.be/Xi-h4XNd5tE) Data doesn’t magically appear in our data centers. There are usually several phases and s...

27 Touko 202214min

Leveraging Running Stateful Workloads on Kubernetes for the Benefit of Developers (DoK Day EU 2022) // Arsh Sharma, Lapo Elisacci & Ramiro Berrelleza

Leveraging Running Stateful Workloads on Kubernetes for the Benefit of Developers (DoK Day EU 2022) // Arsh Sharma, Lapo Elisacci & Ramiro Berrelleza

https://go.dok.community/slack https://dok.community/ From the DoK Day EU 2022 (https://youtu.be/Xi-h4XNd5tE) Kubernetes comes with a lot of useful features like Volumes and StatefulSets, which make ...

27 Touko 202214min

Kanister & Kopia - An Open-Source Data Protection Match Made in Heaven (DoK Day EU 2022) // Pavan Navarathna

Kanister & Kopia - An Open-Source Data Protection Match Made in Heaven (DoK Day EU 2022) // Pavan Navarathna

https://go.dok.community/slack https://dok.community/ From the DoK Day EU 2022 (https://youtu.be/Xi-h4XNd5tE) Cloud-native applications comprise various components, including data services, storage s...

27 Touko 202213min

Is your database in Kubernetes production ready (DoK Day EU 2022) // Mykola Marzhan

Is your database in Kubernetes production ready (DoK Day EU 2022) // Mykola Marzhan

https://go.dok.community/slack https://dok.community/ From the DoK Day EU 2022 (https://youtu.be/Xi-h4XNd5tE) It only looks simple to run databases in Kubernetes. In fact, it is too many things neede...

27 Touko 202215min

How to protect your data (DoK Day EU 2022) // Sarah Julia Kriesch

How to protect your data (DoK Day EU 2022) // Sarah Julia Kriesch

https://go.dok.community/slack https://dok.community/ From the DoK Day EU 2022 (https://youtu.be/Xi-h4XNd5tE) How can you keep your data secure and how can you transfer them on a secure way? You will...

27 Touko 20226min

 Growing up fast - Kubernetes and Real-Time Analytic Applications (DoK Day EU 2022) // Robert Hodges

Growing up fast - Kubernetes and Real-Time Analytic Applications (DoK Day EU 2022) // Robert Hodges

https://go.dok.community/slack https://dok.community/ From the DoK Day EU 2022 (https://youtu.be/Xi-h4XNd5tE) Kubernetes is turning into a preferred platform for real-time analytic app that crunch bi...

27 Touko 202215min