67: Measuring Developer Productivity with Diff Authoring Time
Meta Tech Podcast30 Syys 2024

67: Measuring Developer Productivity with Diff Authoring Time

At Meta, engineers are our biggest asset which is why we have an entire org tasked with making them as productive as possible. But how do you know if your projects for improving developer experience are actually successful? For any other product, you would run an A/B test but that requires metrics and how do you measure developer productivity? Sarita and Moritz have been working on exactly that with Diff Authoring Time which measures how long it took to submit a change to our codebase. Host Pascal talks to them about the way this is implemented, the challenges and abilities this unlocks.

Got feedback? Send it to us on Threads (https://threads.net/@metatechpod), Twitter (https://twitter.com/metatechpod), Instagram (https://instagram.com/metatechpod) and don't forget to follow our host @passy (https://twitter.com/passy, https://mastodon.social/@passy, and https://threads.net/@passy_). Fancy working with us? Check out https://www.metacareers.com/.

You can follow our guest Moritz on X (https://x.com/Inventitech) or check out his website on inventitech.com.

Links

Timestamps

  • Episode intro 0:05

  • Sarita Intro 2:33

  • Moritz Intro 3:44

  • DevInfra as an Engineer 4:25

  • DevInfra as a Data Scientist 5:12

  • Why DevEx Metrics? 6:04

  • Average Diff Authoring Time at Meta 9:55

  • Events for calculating DAT 10:55

  • Edge cases 13:15

  • DAT for Performance Evaluation? 20:29

  • Analyses on DAT data 22:29

  • Onboarding to DAT 23:23

  • Stat-sig data 25:06

  • Validating the metric 26:34

  • Versioning metrics 28:09

  • Detecting and handling biases 29:19

  • Diff coverage 30:30

  • Do we need DevX metrics in an AI software engineering world? 31:23

  • Measuring the impact of AI tools 32:23

  • What's next for DAT? 33:40

  • Outtakes 36:22

Tämä jakso on lisätty Podme-palveluun avoimen RSS-syötteen kautta eikä se ole Podmen omaa tuotantoa. Siksi jakso saattaa sisältää mainontaa.

Jaksot(94)

BONUS: Send Us Your Questions About Engineering at Meta

BONUS: Send Us Your Questions About Engineering at Meta

Pascal is going on Recharge for August so there will be no regular interview episode. However, we want to hear your questions for our mailbag episode. Send them to us on Instagram (https://www.instagr...

29 Heinä 1min

87: Everything is Power: Battery Life Engineering for AI Glasses

87: Everything is Power: Battery Life Engineering for AI Glasses

What changes for you as a developer when the device moves from your pocket to your face? The battery shrinks by an order of magnitude, the thermal budget is whatever won't make your nose uncomfortable...

13 Heinä 41min

86: A Hard Cell: Engineering Ultra-Narrow Batteries for AI Glasses

86: A Hard Cell: Engineering Ultra-Narrow Batteries for AI Glasses

Your smart glasses run all day on a battery narrower than your pinky finger and building it required reinventing how batteries are made. In this episode, Pascal talks to Karthik and Myuran, the engine...

9 Kesä 42min

85: Reel Friends: Building Social Discovery that Scales to Billions

85: Reel Friends: Building Social Discovery that Scales to Billions

You've probably spotted those little circles of your friends' faces popping up on Facebook Reels. They look simple enough, but building them was a proper engineering challenge. In this episode, Pascal...

8 Touko 38min

84: Trust But Canary: Configuration Safety at Scale

84: Trust But Canary: Configuration Safety at Scale

Have you ever wondered how Meta makes config rollouts safe at scale? In this episode, Pascal sits down with Ishwari and Joe to discuss Meta's approach for propagating changes across services in second...

2 Huhti 37min

83: Patch Me If You Can: AI Codemods for Secure-by-Default Android Apps

83: Patch Me If You Can: AI Codemods for Secure-by-Default Android Apps

At Meta, even seemingly simple engineering tasks—like updating an API—become monumental undertakings when you're dealing with millions of lines of code and thousands of engineers, especially if the ch...

27 Helmi 47min

82: CSS at Scale with StyleX

82: CSS at Scale with StyleX

It's not just Not Invented Here Syndrome. Some technologies like CSS simply don't scale if you're building some of the largest websites on the planet with thousands of engineers committing to the same...

8 Tammi 44min

81: From Zero to Polish: Building Meta Ray-Ban Display

81: From Zero to Polish: Building Meta Ray-Ban Display

You've likely heard of Meta Ray-Ban Display by now — but what's it actually like to work on it? In this episode, Pascal talks to Kenan and Emanuel about the exciting features of Meta's First-Gen Displ...

12 Joulu 202547min