Moderated usability test

Moderated usability test

Usability testUX/UI

Task

  • The "Price Audit" service had been in development for almost a year, during which the interface requirements and usage scenarios changed several times
  • Despite continuous contact with the client, feedback from end users remained negative
  • Key research goals: determine whether the new version meets user needs, identify problems in completing the scenario, define improvement priorities, and understand what users do after receiving the audit results

What was done

  • Defined the research methodology, formed 3 hypotheses, prepared the prototype and the research guide
  • Conducted moderated UX testing of the prototype with elements of in-depth interviews. Each session included a short interview about the work context and a task to complete the specification audit scenario in the interface
  • Prioritized the problems by severity based on the testing results
  • Aligned the list of improvements with the team and the client
  • Revised the mockups

Methodology and respondents

  • Method: moderated UX testing of the prototype with elements of in-depth interviews
  • Audience: employees of Sber's "Construction" division involved in evaluating specifications and determining procurement costs
  • Test scenario: specification audit

Hypotheses

  • Users find it hard to understand the interface logic without additional instructions
  • Users find it hard to interpret the specification audit results
  • Users lack sufficient data to make decisions within the specification audit scenario

Result

  • 2 of 3 hypotheses confirmed
  • Identified 12 problems of varying severity
  • The new version is perceived positively overall — users noted progress compared to the previous one
  • Aligned the improvements with the team and the client
  • Drew up new mockups
  • Identified additional needs for the research backlog
  • Received positive feedback from the client after the interface was reworked