When Traditional UX Research Doesn't Fit


When Traditional UX Research Doesn't Fit

by Jeff Humble


Dear Reader,

Sometimes, that research phase just doesn't fit.

What can you do when everybody says no to the research phase?

Perhaps they have a reason for saying no. In many tech companies, a traditional research process can slow down the learning speed.

Research doesn't have to be upfront.

Upfront, traditional discovery research isn't the only way to do research. You can evolve beyond this problem-then-solution process.

Process models like Design Thinking and the Double Diamond make designers think that discovery always has to come first. Force-fitting a research phase at the beginning of every project won't earn you a trophy. In fact, it might be showing your managers that you don't understand how your company prefers to learn.

With a mental model of "research first," you may think your only option is to hide time for research in your projects while trying to meet your deadlines. Sure, there are ways to squeeze discovery in (see continuous research), but you can't always find the answer upfront.

Sometimes, users don't know enough about the context to provide useful feedback...especially when the idea is totally new.

"People have told us over and over again, they don't want to rent their music...they don't want subscriptions." -Steve Jobs in 2003

You can conduct research while you deliver. But first, you must let go of the idea that research always starts projects.

Everything can be a test.

Rapid experimentation is another way to research that starts with solutions, and it helps you evolve to better research practices in organizations obsessed with speed and numbers.

Rapid experimentation is an agile approach to the product development process. With this approach, frequent experiments are deployed in an attempt to discover new, innovative ideas. Experiments can range in severity, from simple A/B tests to larger field experiments. -Product Plan

The experiment doesn't have to be coded or release-ready. It can be a scrappy prototype that tests the value behind your product ideas. The important thing is to test the value, according to the customer, before you jump to implementation details.

Here is what might be new in Rapid Experimentation:

  • You need to know how to write a good hypothesis
  • You need to create a lot of rapid prototypes
  • You need a way to measure the prototypes you're testing
  • You need to remember to analyze the results of the test
  • You need to be able to form insights from experiment data

These are the skills we teach in Designing Product Experiments: LIVE, and I've seen dozens of designers turn their design skills into experimentation skills.

Setting up an experiment takes time, but it's much faster than doing 20 rounds of upfront user interviews on an idea nobody understands yet. You can still supplement experiments with more traditional qualitative UX research to understand the "why" behind the experiment numbers.

Some scenarios where rapid experimentation can shine:

  • The idea you're working on is completely new
  • Upfront research is seen as slowing down learning
  • The team prefers to learn from quantitative data

Remember, when an idea is new, sometimes the only way to learn about it is to put it in customers' hands and watch.

Everything is an assumption until it's in the hands of a user. Find ways to test your assumptions early and often. Testing can potentially offer more realistic insights than traditional research can provide.

What do you think? Is rapid experimentation worth a try?


MINI-COURSE: Facilitative Leadership
Learn to lead with clarity, even in uncertainty
AM & PM time slots available, good for anywhere in the world
Buy a seat


COURSE: Defining UX Strategy
Learn to design a winning strategy that aligns design with business
Basic seats available now
Buy a seat


"When you go straight into high fidelity design and it starts poppin’"

Source, shared in the Guild

Until next week, be rapid experimenters! 🔬🏃‍♂️💨

Jeff Humble
Designer & Co-Founder
The Fountain Institute

The Fountain Institute

The Fountain Institute is an independent online school that teaches advanced UX & product skills.

Read more from The Fountain Institute

How to Build Comfort with Ambiguity By Hannah Baker Dear Reader, You're expected to lead even when you have no idea what the hell is going on. (I know, you’ve heard the next part a million times. Bear with me.) The world is moving faster than ever. Technologies shift overnight. Markets pivot on a dime. And somehow, you’re still just trying to get everyone to show up to the team meeting. We all know this, we’re surrounded by it. The speed, the volatility, the endless flood of decisions....

quibi case study strategy

When Hype Comes Before User Insight by Jeff Humble Dear Reader, Have you ever seen a hyped-up product that felt worthless? Today I want to tell you a tale of two companies and how they handled user demand. One took a hype-based approach, trying to create demand, while the other achieved real demand (and hype) through user insights. Hype-First Failure: Quibi (2020) On its surface, Quibi made perfect sense to investors in 2020. The idea was to create Hollywood-quality ten-minute movies and...

designing in reactive mode

Are you stuck in reactive mode? by Jeff Humble Dear Reader, Some designers spend their whole careers reacting to other people's moves. As a design manager, I remember being in this position. I had to brace myself every Monday morning for some radical change in company direction. We never knew what the new agenda would be, but we knew that it would throw our work into chaos. Sometimes, all it took was for the founder to read a single article to change the company agenda. When a competitor...