User Experience

How To Find Out What Users Really Experience

Published December 9, 2015 ⚡ Updated on October 2, 2023 by Stefan Rössler
Muppet Show's Statler and Waldorf looking down from their balcony

Did you ever notice that user experience is a lot like health?

User experience designers are doctors. Developers are surgeons. Users are of course patients, and bad user experiences are like a disease.

I want to dedicate this article to the people who are creating these user experiences. They are the ones who caused the disease in the first place—by designing a bad user experience. They carry the disease. The good news is, they also carry the cure.

The not-so-almighty user experience designer

If you run a website or work at a company and help them run their site or any other software, you are a user experience designer. You may or may not think of yourself this way, but your decisions contribute to what users experience. The same is true for everyone else on your team. The question is, what is your contribution to this experience?

Forget about the idea of an almighty user experience designer because he or she doesn’t exist. And while it’s good to have a person who’s carrying the job title user experience designer and it’s also fine to consult outside experts, it’s even better to have people who really care about their work. No matter if they call it design, development, customer support or anything else. And you could be one of them.

Have you ever seen a real user experience?

We have huge amounts of data and many ways to make sense of it, but most of us have never seen a real user experience. In theory we know everything about UX. We have graphs, numbers, and all sorts of representations to understand what our users experience. Yet, real user experiences are something only few of us have ever seen.

The funny thing is, that it’s not some miracle, that only occurs on a full moon after you’ve sacrificed baby kittens. No! You just have to watch someone using a smartphone, a laptop, a tablet, or whatever crazy device they just came up with. Observing people is the easiest form of usability testing and it’s all it takes to see a real user experience.

Usability tests don’t guarantee great user experiences!

We’ve done hundreds of usability tests for our clients before we started Userbrain. Here’s what we typically do:

We get people to use, for example, our client’s website and observe them to find out what works and what doesn’t. After we’ve analyzed the test videos, we create reports and presentations to communicate our findings to our clients. No matter how good these reports are, there’s one important truth about them. A report can never show you what users really experience.

Executive summary of a usability report
Executive summary we provide our clients with, to inform them about our usability findings.

Please don’t get me wrong, usability reports are useful. You’ll get a list of your website’s most severe usability issues and often times you get suggestions for improvement. Maybe you even get highlight clips to see where users struggle and you get statistics about effectiveness and efficiency, and you may even get satisfaction ratings.

In short, you get plenty of data about your usability problems. And you may even know how to fix them. But you don’t know much about your real user experience.

Data cannot show real user experiences

Whenever someone is doing a usability test for you, they have to communicate their findings. They need to tell you what they’ve found by showing you the data. But data only represents the truth. It’s not the truth itself. If you want to see what users really experience, you have to observe them yourself. Not only where they struggle; you have to observe everything they do.

What are they looking for? What do they want right now? What are they thinking? Do they understand what we’re presenting them with? What kind of atmosphere did we create for them? Did we create an enjoyable/comfortable/efficient experience for them? How does it make them feel? Not on some artificial scale, but in their own words. Not in general, but in every moment.

You need to do your own usability testing!

Experts will always tell you that usability testing is complicated. Their income depends on your perception of these tests as too hard to do by yourself. And it’s true. Usability tests and reports we do for our clients are actually too complicated to be done by anyone. But that’s because we’re trying to translate our understanding into data. We want to explain our findings to our clients. We want to transform feelings into words and statistics, and that’s not a trivial thing to do.

It took us years to come up with a useful blueprint for communicating our usability findings. But there’s an easy way around this complexity—do your own tests! Even if you’re doing it completely wrong, usability testing always works.

Observe what users experience by yourself—don’t leave it to others

You have heard about various usability methods? You know the difference between formative and summative testing? You’ve even learned how to moderate a usability test? Then please forget about it for a second.

There’s only one important thing, if you want to find out what users experience and that’s to observe what they actually experience. Just sit back, relax, and watch them do whatever they do! Take notes if you want, but don’t interrupt their experience.

Fade into the background

We’re sometimes inviting people for in-person usability tests. It’s typical to ask burning research questions during these sessions as well. And it’s fine to combine usability testing with user research, but it’s not the same as observing a real user experience.

You will find insightful answers — there’s no doubt about it, but your questions are not part of what people usually experience.

How do you avoid these disturbing questions? An easy way is to prepare a specific task scenario to engage your users. Give them something to do and observe how they’re doing it. Let them focus on this task and remind them to think out loud and say everything they have on their mind.

Become the silent observer

Experts call themselves moderators whenever they are facilitating a usability test. What a huge mistake if you aim to observe a real user experience. A moderator, however skilled he is, will always influence the user experience. Instead of being a moderator, you can fade into the background and become a silent observer.

Forget about yourself and your own agenda and focus on your user. Try to empathize and see the world through her eyes. What is she experiencing right now? How does this affect her mood? Is there anything you should change to improve her experience? How does this relate to what other users may experience?

Here’s why it works…

Watching videos of someone using your site or app, gives you an unparalleled understanding of what people experience. You begin to understand your users, empathize with them, and learn how they interact with you. You’ll know what they’re feeling and why they do what they are doing — or why they refuse to do it.

And if you keep observing them and build your business (or whatever you’re making) from a place of empathy and a desire to create better experiences for them, those values bubble up into everything you do, and that will eventually be noticed by your user.

“Your website shouldn’t be optimized just to make people click what you want them to click. Your website needs to make people feel like they belong. When they do, they want to return and to become members, customers and advocates.”Bernadette Jiwa

Understanding what people feel and why they feel this ways is far more valuable than we think. Understanding what users really experience is like taking care of your patients. It’s one thing to look at the graphs and numbers, but it’s something different to really know how they’re doing.

You can give Userbrain a try if you want to see how well this works for your site.

Back to homepage