67: Measuring Developer Productivity with Diff Authoring Time

67: Measuring Developer Productivity with Diff Authoring Time

At Meta, engineers are our biggest asset which is why we have an entire org tasked with making them as productive as possible. But how do you know if your projects for improving developer experience are actually successful? For any other product, you would run an A/B test but that requires metrics and how do you measure developer productivity? Sarita and Moritz have been working on exactly that with Diff Authoring Time which measures how long it took to submit a change to our codebase. Host Pascal talks to them about the way this is implemented, the challenges and abilities this unlocks.

Got feedback? Send it to us on Threads (https://threads.net/@metatechpod), Twitter (https://twitter.com/metatechpod), Instagram (https://instagram.com/metatechpod) and don't forget to follow our host @passy (https://twitter.com/passy, https://mastodon.social/@passy, and https://threads.net/@passy_). Fancy working with us? Check out https://www.metacareers.com/.

You can follow our guest Moritz on X (https://x.com/Inventitech) or check out his website on inventitech.com.

Links

Timestamps

  • Episode intro 0:05

  • Sarita Intro 2:33

  • Moritz Intro 3:44

  • DevInfra as an Engineer 4:25

  • DevInfra as a Data Scientist 5:12

  • Why DevEx Metrics? 6:04

  • Average Diff Authoring Time at Meta 9:55

  • Events for calculating DAT 10:55

  • Edge cases 13:15

  • DAT for Performance Evaluation? 20:29

  • Analyses on DAT data 22:29

  • Onboarding to DAT 23:23

  • Stat-sig data 25:06

  • Validating the metric 26:34

  • Versioning metrics 28:09

  • Detecting and handling biases 29:19

  • Diff coverage 30:30

  • Do we need DevX metrics in an AI software engineering world? 31:23

  • Measuring the impact of AI tools 32:23

  • What's next for DAT? 33:40

  • Outtakes 36:22

Det här avsnittet är hämtat från ett öppet RSS-flöde och publiceras inte av Podme. Det kan innehålla reklam.

Avsnitt(91)

85: Reel Friends: Building Social Discovery that Scales to Billions

85: Reel Friends: Building Social Discovery that Scales to Billions

You've probably spotted those little circles of your friends' faces popping up on Facebook Reels. They look simple enough, but building them was a proper engineering challenge. In this episode, Pascal...

8 Maj 38min

84: Trust But Canary: Configuration Safety at Scale

84: Trust But Canary: Configuration Safety at Scale

Have you ever wondered how Meta makes config rollouts safe at scale? In this episode, Pascal sits down with Ishwari and Joe to discuss Meta's approach for propagating changes across services in second...

2 Apr 37min

83: Patch Me If You Can: AI Codemods for Secure-by-Default Android Apps

83: Patch Me If You Can: AI Codemods for Secure-by-Default Android Apps

At Meta, even seemingly simple engineering tasks—like updating an API—become monumental undertakings when you're dealing with millions of lines of code and thousands of engineers, especially if the ch...

27 Feb 47min

82: CSS at Scale with StyleX

82: CSS at Scale with StyleX

It's not just Not Invented Here Syndrome. Some technologies like CSS simply don't scale if you're building some of the largest websites on the planet with thousands of engineers committing to the same...

8 Jan 44min

81: From Zero to Polish: Building Meta Ray-Ban Display

81: From Zero to Polish: Building Meta Ray-Ban Display

You've likely heard of Meta Ray-Ban Display by now — but what's it actually like to work on it? In this episode, Pascal talks to Kenan and Emanuel about the exciting features of Meta's First-Gen Displ...

12 Dec 202547min

80: Lowering emissions with the Open Compute Project

80: Lowering emissions with the Open Compute Project

In this episode, Pascal talks to Dharmesh J. (DJ) and Lisa about the vision for the open, scalable future of networking hardware for AI and to break down Meta's big announcements from the 2025 Open Co...

14 Nov 202538min

79: Building Android apps in Meta's monorepository with Buck2

79: Building Android apps in Meta's monorepository with Buck2

How do you keep Android build times under control when your codebase spans tens of thousands of modules and millions of lines of Kotlin? In this episode, Pascal talks with Iveta, Navid, and Joshua fro...

10 Okt 202537min

78: Generating 3D Worlds with AI

78: Generating 3D Worlds with AI

Creating 3D assets can be daunting, but does it have to be? Mahima and Rakesh are on a quest to democratize 3D content creation with AssetGen, a foundation model for 3D. They discuss the challenges of...

19 Sep 202536min

Populärt inom Teknik

uppgang-och-fall
market-makers
elbilsveckan
rss-laddstationen-med-elbilen-i-sverige
rss-elektrikerpodden
bli-saker-podden
rss-technokratin
natets-morka-sida
developers-mer-an-bara-kod
bilar-med-sladd
skogsforum-podcast
rss-veckans-ai
hej-bruksbil
rss-uppgang-och-fall
rss-it-sakerhetspodden
rss-snacka-om-ai
dom-kallar-oss-krypto
bosse-bildoktorn-och-hasse-p
rss-fabriken-2
rss-powerboat-sverige-podcast