Fork Around And Find Out14 Feb 2025

Predicting Bluesky’s Scale with Jaz

Bluesky has been on a roller coaster of growth for over a year. From the early days of figuring out a new distributed social protocol—AT protocol—to actually building it and inviting 30 million of their closest friends. Not only has the site gone through tremendous growth, the team has been optimizing, re-architecting, and adding features the entire time.

Jaz is a software engineer focused on the infrastructure at Bluesky, and they share how they achieved exponential growth without exponential costs. We cover some of the key components of the protocol and how that affects the architecture.

There’s some amazing advice from the trenches we know you’ll enjoy.

Show Highlights
(0:00) Intro
(5:00) Jaz’s background
(12:30) Bluesky Infrastructure
(17:00) Predicting the future
(20:00) What is a PDS?
(22:30) Relay and firehose
(26:00) Work queues
(30:00) Scaling physical servers
(37:00) How do you handle incidents?
(41:00) Where’s Kubernetes?
(43:30) How video changes
(45:00) Data locality
(46:30) Hardware decisions
(53:00) What bad decisions?
(57:00) Launching video
(1:00:00) What’s next?

About Jaz

Jaz is a software engineer who learned from on-the-job experience. They have a background with hardware which makes them better with software. If they’re not drinking Monster they’re building a single purpose database, or maybe they’re doing both. Jaz went from building with AT protocol to building AT protocol in a matter of months. They also have an impressive collection of plushies and power tools.

Sponsor the FAFO Podcast!

http://fafo.fm/sponsor

Det här avsnittet är hämtat från ett öppet RSS-flöde och publiceras inte av Podme. Det kan innehålla reklam.

Avsnitt(33)

Laughing Through The Pain with David Crawshaw

Some of you might know David as a co-founder of Tailscale. In this episode we're talking about a new kind of cloud he's building at exe.dev. The SSH-only interface is a breath of fresh air compared to...

13 Juli 1h 13min

Suing The Government with Cindy Cohn

If you've ever heard code is an expression of free speech you have Cindy Cohn to thank. Her decades of work in courtrooms and at the Electronic Frontier Foundation has been keeping Open Source, open a...

10 Juni 56min

Taking Down Prod with Eve

If you're a platform engineer you've had to exit vi at least once. Eve is stuck with it for the rest of her social media life. She's a Sr Platform Engineer and obviously knows a ton about Kubernetes a...

14 Maj 59min

Laying the Foundation with Joe Beda

Fork Around and Get EmailSponsor FAFOFM"Everyone is a beginner at one point." Even one of the creators of Kubernetes. If you're listening to this podcast then Joe has had an impact on what you do. He'...

24 Apr 1h 10min

Training The Future with Mark Russinovich

Sponsor FAFOFMDon't FAFO with cloud disaster recovery. Do it right with Arpio.Have a podcast you need help with? Reach out to HumblePod.Mark is the CTO of Azure and has decades of experience exploring...

20 Mars 1h 2min

Developing Measurements with Cat Hicks

SoCal Linux Expo - discount "FAFOF" -https://www.socallinuxexpo.org/Kubecon EU Amsterdam - https://events.linuxfoundation.org/kubecon-cloudnativecon-europe/Linuxfest North West - https://linuxfestnort...

25 Feb 1h 15min

Embracing the Journey with Cassidy Williams

Cassidy Williams was too funny to be a developer so she was banished to the island of misfit devs called DevRel. Along the way she found a passion for memes and dreams and mechanical keyboards. No Oxf...

27 Jan 1h

Objecting to storage

Thank you NoPorts for sponsoringhttps://fafo.fm/noportsIf the Internet is a big computer, Amazon s3 is the hard drive. So what happens when a single typo breaks the Internet's hard drive? On this epis...

15 Dec 202532min