DoK Talks #101- Redpanda: how to build a storage engine for kubernetes // Alexander Gallego

DoK Talks #101- Redpanda: how to build a storage engine for kubernetes // Alexander Gallego

https://go.dok.community/slack
https://dok.community/

ABSTRACT OF THE TALK

How to build a stateful, transactional streaming storage engine on top of kubernetes.

KEY TAKE-AWAYS FROM THE TALK

1. Building storage engines in kubernetes is hard
2. You need tiered storage (S3 or google cloud bucket, Azure Blob) for total disaster recovery
3. You also need sound replication inside the cluster
4. You need a simple architecture so you can scale the pods easily

BIO

Alex Gallego is the founder and CEO of Vectorized, where he & the team hack on Redpanda, a modern streaming platform for mission critical workloads. Prior to Vectorized, he was a principal engineer at Akamai, as well as co-founder and CTO of Concord.io, a high performance stream processing engine built in C++ and acquired by Akamai in 2016.

Jaksot(243)

DoK Talks #105 - Run Graph Database on K3s with KubeSphere // Feynman Zhou & Wey Gu

DoK Talks #105 - Run Graph Database on K3s with KubeSphere // Feynman Zhou & Wey Gu

https://go.dok.community/slack https://dok.community/ ABSTRACT OF THE TALK Graph databases are fundamentally designed with a focus on the relationship between data sets. Running stateful workloads l...

1 Joulu 20211h 2min

DoK Talks #104- How to enable self-service Infrastructure by shifting your Data left with Kubernetes // Nic Vermande

DoK Talks #104- How to enable self-service Infrastructure by shifting your Data left with Kubernetes // Nic Vermande

https://go.dok.community/slack https://dok.community/ ABSTRACT OF THE TALK On-demand infrastructure services have become a key requirement for developers and DevOps engineers to provision and consum...

24 Marras 20211h 8min

DoK Talks#103 -Performant and Version-Aware Analytics With Spark & lakeFS on K8s // Itai Admi

DoK Talks#103 -Performant and Version-Aware Analytics With Spark & lakeFS on K8s // Itai Admi

https://go.dok.community/slack https://dok.community/ ABSTRACT OF THE TALK Spark and lakeFS are revolutionizing large scale data processing that is version-aware. Is it possible to run this architec...

19 Marras 202139min

DoK Talks #102- From Enemy to Evangelist // Rick Vasquez

DoK Talks #102- From Enemy to Evangelist // Rick Vasquez

https://go.dok.community/slack https://dok.community/ ABSTRACT OF THE TALK A few short years ago I was a huge opponent of putting any data in Kubernetes, now I'm one of the most vocal proponents of ...

17 Marras 20211h 1min

DoK Talks #100- CAPE for data backup/restore on kubernetes // Sanjeev Ganjihal

DoK Talks #100- CAPE for data backup/restore on kubernetes // Sanjeev Ganjihal

https://go.dok.community/slack https://dok.community/ ABSTRACT OF THE TALK CAPE is an open source solution offering advanced kubernetes features for DR, data migration and mobility, multi-cluster ap...

15 Marras 20211h 2min

DoK Talks #99- ETL/ELT on Kubernetes with Airbyte: K8s Development Insights // Abhi Vaidyanatha

DoK Talks #99- ETL/ELT on Kubernetes with Airbyte: K8s Development Insights // Abhi Vaidyanatha

https://go.dok.community/slack https://dok.community/ ABSTRACT OF THE TALK ETL/ELT on Kubernetes is currently an unsolved problem. There are a lot of different approaches vying for a spot as the de ...

5 Marras 20211h

DoK Talks #98- It´s not me, it´s you: Migrating between third party storage solutions at scale // Dinesh Majrekar

DoK Talks #98- It´s not me, it´s you: Migrating between third party storage solutions at scale // Dinesh Majrekar

https://go.dok.community/slack https://dok.community/ ABSTRACT OF THE TALK With the help of 3rd parties, running stateful workloads can be a “trivial” experience but what happens when you need to mi...

3 Marras 202148min