A Process for Setting UX Metrics


Dear Reader,

This is a question I hear a lot. Maybe it's rumbling around in your brain.

Q: How do I set UX metrics?

Organisations run on metrics. It's pretty hard to make the case to improve usability if you can't translate that initiative into UX metrics.

I believe that UX can and should be measured, but it isn't easy. Is there some grand, universal UX metric we can all follow?

The reality is that there is no perfect UX or product metric that all designers can use. In reality, there are many ways to measure UX. So how do we find the right metrics?

Last night, Maria Panagiotidi gave a talk for our monthly meetup called Choosing the Right UX Metrics. In it, she shared some practical ways to find UX metrics. I love what how she defined UX metrics:

"UX Metrics are user-centered algorithms that measure performance."︎ -Maria Panagiotidi

That's so good. I want to zoom in on one thing she covered in her talk called the Goals-Signals-Metrics Process developed by Google. If you've never set a UX metric, I think it's a great place to start!

Goals

The goals are the big-picture targets for your product team. Goals should always be based on outcomes, not outputs. An output example would be completing 10 cards in a sprint. An output example would be increasing your efficiency at work.

I'd recommend that you start with one goal. These goals are usually well-defined quarterly goals for mature product teams, like increasing adoption by 15%. Startups might have goals like improving sales to break even. Don't make these goals up. Instead, ask your PM what the goals are or facilitate your team in that process.

UX Example: We want to improve the usability of our app

Signals

Signals tell you whether you're on the right path toward your goal. Based on customer behaviours, a signal is an early sign of success or failure. Signals can tell you when you're reaching the goal: after using the new feature, a user submits a positive app store review. These signals could tell you that you've failed: a user submits a bug report while using the feature.

These won't be outcomes-based like the goals, so it's ok to have outputs like the user finishes 3 tasks a day. Try to pick 2-3 signals at first.

UX Example:

  • Users complete tasks faster after usability updates
  • We get fewer bug reports submitted after we improve the usability
  • Users log into the app more often as usability is improved

As you can see, the signals don't have to contain numbers until the next stage, but it's ok if they already sound a bit like metrics. Finding signals can be a fun activity so bring your team in on the action. PMs will be the decision-maker here, so defer to their judgment as they know your product metrics best.

Metrics

It's finally time to choose the right metrics by translating your signals into measurable criteria. The metrics should reflect a change over time. Avoid selecting "vanity metrics" or counts that always go up, like increasing follower count. Instead, use ratios or percentages over time, like growing followers by 30% every month.

UX Example:

By Q4 2022...

  • We will reduce the time it takes for users to complete their [main task] by 50%
  • We will get fewer bug reports in Q4 2022 than in Q4 2021
  • Our weekly active users goes up by 10% every month of 2022

If you want detailed directions to run this process with your team, check out these detailed playbook directions.

We'll post Maria's full talk on our YouTube channel next week. In it, she talks about pairing this G.S.M. with the H.E.A.R.T. framework. It's very inspiring! Until then, Maria was kind enough to share her slides:

UX Metrics_deck.pptx.zip

If you find them useful, show some love to Maria on Linkedin!

Until next week, look for signals in customer behaviours!

Jeff Humble

Designer & Co-Founder
The Fountain Institute

P.S. We just added a lot of free tools and articles (and even a few memes) to our new Resources Page if you like advanced UX and Product Design stuff!

The Fountain Institute

The Fountain Institute is an independent online school that teaches advanced UX & product skills.

Read more from The Fountain Institute
diverge explore converge diagram

10 Design Diagrams To Study Instead of Staring Into the Void by Jeff Humble Dear Reader, It's that time of the year. Another boring Q3 earnings call, and all you want is to go back to the beach. You look at yourself in Zoom, and all you see is a bottomless void. Hey. Stop that. Instead, check out some of the best Jeffing diagrams on the internet. At least you will look like you are kind of working... 1. Diverging and converging in action by Nicholas Frota Designers talk a lot about diverging...

Six-screen signup: SSO/login, email entry, verify email (pre- & post-entry states), OTP with timer, success.

Level-up your critiques in 3 questions By Hannah Baker Dear Reader, You know the critique that starts with “quick feedback” and ends 45 minutes later with five conflicting opinions and no next step? Or the one where a senior voice speaks first and the room quietly aligns, even when the data points elsewhere. Here’s a simple pattern, adapted from Visual Thinking Strategies (VTS), that pulls critiques out of taste debates and into clearer decisions. What VTS is (in 60 seconds) VTS is a...

What is design strategy?

The Summer Edition(and a Free Masterclass) by Jeff Humble Dear Reader, I'm taking some time off for summer, and I hope you are, too. When I'm off, I end up watching a lot of YouTube, so... A Free Masterclass on YouTube If you've ever wondered about design strategy, this masterclass has you covered. It's called "What is Design Strategy?" The toolbox of the design strategist is incredibly powerful, but it's not well documented. See what it looks like when the designer's sphere of influence...