Usability Is the Last Thing You Should Be Testing


Usability Is the Last Thing You Should Be Testing

by Jeff Humble


Dear Reader,

Here's a common scenario you might find yourself in:

Somebody in leadership has been pushing for an idea for a long time, and your team finally gets a chance to tackle it. You want to do this by the books, so you design three versions and run a usability test with five users.

You catch some problems early and start feeling pretty confident in your approach. The executives love the design, so everyone is happy.

The idea is finally built, but customers completely ignore it.

It never gains traction, but nobody knows why. Eventually, the leader realizes the idea is a dud and blames the team's execution for the result.

πŸ€¦πŸ½β€β™€οΈ What happened here?

You skipped the desirability test.

Usability should have been the last thing you tested.

4 Checks to "Validation"

Rather than validating an idea, you want to put an idea through 4 different validation checks. Here are they are in the most common order:

  1. Viability, a.k.a. "Should we build this?" - Generally not a design area, validated by business stakeholders
  2. Feasibility, a.k.a. "Can we build this?" - Generally not a design area, validated by tech stakeholders
  3. Desirability, a.k.a. "Will people want this?" - Potential for design, validated by users
  4. Usability, a.k.a. "Will people understand this?" - Owned by design, validated by users

Generally, you will go in that order, meaning usability is the final check and not as crucial as desirability. That might come as a shock to you if you're not aware of the whole process.

Desirability and usability are challenging because they are risks related to people, and people change. What was desirable five years ago may not necessarily be desirable today.

That's why testing is a full-time job. There are always risks related to desirability and usability. Very few designers can test for both.

Testing for desirability is a blind spot for many teams, and it's a good growth role for a senior designer.

Learn more in our four-week course on designing product experiments...only 2 essential seats left!

What methods do you have for testing desirability?

β€œwErE a FaMiLy HeRe. BrInG yOuR wHoLe SeLf To WoRk.” πŸ€¦πŸΌβ€β™‚οΈ -@tomfall

​

​Source, shared in the Guild​


COURSE: Defining UX Strategy

Learn to design a winning strategy that aligns design with business.​
​
Next cohort: Oct. 5-Nov. 16, 2026

​

Until next week, y'all! ✌️

Jeff Humble
​Designer & Co-Founder
​
The Fountain Institute

​

The Fountain Institute

The Fountain Institute is an independent online school that teaches advanced UX & product skills.

Read more from The Fountain Institute

Slop Grenades, a Warming UX Job Market, and the New Bar for Designers Dear Reader, It's officially autumn, and the air is crisp with the sound of falling design career norms. Here's what you need to know from the last two weeks... How to turn your AI into a world-class designer Source In this guest post for Lenny's Newsletter, Anshu Chimala really shared the sauce on how to get AI to do the kind of high-end web design that could only previously be done by someone with a septum piercing and...

Recording for Upstream of the Machine, a masterclass by Jeff Humble

5 Ways to Stay Ahead of AI + Recording for "Upstream of the Machine" Dear Reader, Last night we had a fun little event called Upstream of the Machine. In the talk, I shared 5 strategies that designers can use to stay ahead of AI. Each one is inspired by design-adjacent roles where designers can potentially have an edge. You should be able to find at least one strategy that fits you. The Five Strategies Work the infrastructure β€” like a service designer Generate evidence β€” like a scientist...

Written by a human, not by AI Dear Reader, Last week, some of you were gracious enough to give me some feedback on the newsletter. (You can still do it at the bottom). Someone left a review that said, "AI Slop" without any other context. And it got me thinking... You might be assuming that this newsletter is written by AI. Today, I'll let you in on a little secret: I still write by hand. And I plan to keep writing this newsletter by hand. I'm not gonna lie, I tried to get AI to write the...