Description

Metrics are meant to help.

But sometimes they just perform.

In this episode, we explore the difference between measurement that drives insight and measurement that becomes theatre. From counting test cases and commit history, to DORA metrics and Monte Carlo forecasting, we unpack how numbers can guide teams - or quietly distort behaviour  .

We reflect on how metrics have evolved over the past 25 years, how Agile shifted the way we think about delivery and value, and why modern teams now have more data than ever but not always more clarity.

We also challenge a few uncomfortable truths:

• When a metric becomes a target
• When dashboards replace conversations
• When velocity gets mistaken for predictability
• When comparing teams causes more harm than insight
• When “healthy culture” is reduced to a number

At its best, a metric is an invitation to a conversation.

At its worst, it is theatre.

What we cover

• Early career metrics: counting test cases and “how many did you do?”
• Commit counts, leaderboards and accidental gamification
• From CD releases to cloud shipping and real time telemetry
• DORA and the four key delivery metrics
• SPACE Framework and measuring beyond output
• Monte Carlo method vs story point velocity
• Confidence levels and how to talk about uncertainty with stakeholders
• Goodhart’s law and the danger of turning measures into targets
• Pulse surveys, fatigue and the limits of yearly sentiment snapshots
• The challenge: if you could only pick one metric, what would it be?

Useful links

• Monte Carlo method https://en.wikipedia.org/wiki/Monte_Carlo_method https://medium.com/@benjihuser/an-introduction-and-step-by-step-guide-to-monte-carlo-simulations-4706f675a02f
• Actionable Agile for Jira https://www.55degrees.se/products/actionableagileanalytics
• DORA research https://dora.dev/research/
• SPACE Framework https://www.youtube.com/watch?v=O2rbekHpG4Q
• Goodhart’s law https://en.wikipedia.org/wiki/Goodhart%27s_law
• Moving beyond velocity https://docondev.com/escape-velocity
• PETALS Measuring team health across Productivity, Enjoyment, Teamwork, Learning and Serenity https://petals.team https://app.petals.team

Chapter markers

• 00:00:07 - Intro and over engineering an EV charger box
• 00:02:16 - Why metrics matter and how they can mislead
• 00:03:27 - Counting test cases and early vanity metrics
• 00:05:45 - Commit counts and gamified leaderboards
• 00:09:57 - DORA metrics and delivery performance
• 00:13:07 - SPACE and measuring people, not just output
• 00:16:02 - Time to learn vs time to earn
• 00:20:03 - Monte Carlo forecasting vs velocity
• 00:24:35 - Pulse surveys, fatigue and psychological safety
• 00:30:03 - What averages hide
• 00:35:05 - Goodhart’s Law and when metrics go wrong
• 00:45:07 - If you could only choose one metric
• 00:50:56 - Wrap up and listener challenge

Hosts

Connect with us on LinkedIn…

Neil Younger - https://www.linkedin.com/in/neil-younger/

Simon Jobling - https://www.linkedin.com/in/sijobling/

What do you measure?

What have you stopped measuring?

And what has backfired spectacularly?