Making the most of your Maze usability tests

Define learning goals

Knowing where to start with testing ideas is always a bit overwhelming, especially when you’re trying to test a whole experience as opposed to a small functionality. Before you jump into Maze, take time to write down the assumptions you used to put together the solution you’re testing and the main learning goals for this test.

  • What behaviour do I expect users to have when completing this test?
  • What knowledge gaps do I have that I could learn more from users completing this test?
  • How in-depth do insights need to be so that I can iterate the solution? (basically, do you need to ask additional questions or not)

Identifying user groups

I always start Maze usability tests by asking users to share their name and job title within our client’s company. From a designer’s perspective, this information is important for two reasons:

  • While Maze users are anonymous, knowing the name of the people who participated can help you reach out to a specific person if you have follow up questions to specific users.

Build up the test and share context

Share enough context with users upfront so that they can successfully complete the task. Users failing a usability test doesn’t necessarily means that your solution isn’t the right one, but it might be that they didn’t understand what they’re being asked to do in the first place.

Conditions feature in Maze

Always ask additional questions

While getting users to go through your glow will tell you how intuitive your solution is, it won’t necessarily tell you much about what worked and what didn’t work with your prototype.

Opinion scale with labels for more guidance
Open questions let users format answers however works best for them
Open question and additional notes to focus user feedback

Eliminate order bias to improve insights quality

When using `single-select` or `multi-select` question formats, switch on the shuffle toggle to make sure the order or your pre-define answers is randomised for every user. You can learn more about order bias here.

Eliminate order bias with the shuffle toggle

Let users share in-depth insights

While pre-defined answers are a good options in specific situations and help users focus on the problem space, always try to give users an opportunity to share their thoughts in a non pre-formatted format.

  • Us the open question format and ask well defined questions
‘Other’ option on for in-depth insights

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store