CT-UT Sample Questions & Answers

The 'Consistency and standards' heuristic states that users should not have to wonder whether different words, situations, or actions mean the same thing. This includes following platform and industry conventions. A non-standard icon for 'next month' and a 'search' action styled as a link instead of a button both violate established web conventions.

The purpose of a pilot session is to check the usability test script and setup. Discovering a show-stopping bug is a valid and important outcome. The correct procedure is to report the bug, get it fixed, and then run another pilot to ensure the script and tasks can be completed before commencing the full test sessions with recruited participants.

For a point-of-sale system in a busy coffee shop, the environmental context is crucial. Realistic background noise and interruptions are key components of that context. Simulating the physical counter setup is also important for ergonomic and workflow evaluation.

For a point-of-sale system in a busy coffee shop, the environmental context is crucial. Realistic background noise and interruptions are key components of that context. Simulating the physical counter setup is also important for ergonomic and workflow evaluation.

A key principle of effective usability reporting is that the report itself must be usable. Reporting too many findings (e.g., all 50 observations) overwhelms stakeholders and reduces the likelihood of action. The moderator's critical task is to prioritize and report only the most important problems, typically limiting the list to around 20-25 findings.

This statement is false. User surveys are used to report subjective evaluations, such as user satisfaction, based on their experience. Observing user behavior and measuring task completion rates are the primary purposes of usability testing, not user surveys.

SUMI is a 50-item questionnaire designed to provide a detailed, multi-faceted evaluation of software usability. It is well-suited for benchmarking and in-depth analysis. SUS is much shorter (10 items) and provides a single global score, making it less ideal for a detailed breakdown. WAMMI is specifically for websites, but SUMI is also applicable and known for its robustness in detailed software evaluation.

Summative evaluation is conducted late in the development cycle to measure the usability of a product and verify it against requirements. Its focus is quantitative, measuring metrics like task completion time and error rates. Formative testing and expert reviews are qualitative methods used earlier in the cycle to find and fix problems.

The Usability Tester is responsible for the overall planning and preparation activities, such as writing the test plan and organizing reviews. The Moderator's role is focused on the execution of the test session itself, including briefing the participant, conducting interviews, and guiding the session.

For skeptical stakeholders, seeing is believing. A moderated usability test provides direct, undeniable evidence of users struggling with the product. Inviting stakeholders to observe these sessions is the most powerful way to 'sell' the findings and overcome the perception that feedback is just subjective opinion. Expert reviews can still be dismissed as opinion, and surveys lack the visceral impact of watching a real user fail.

A key risk with inexperienced reviewers is that they may focus on superficial issues like cosmetic details or minor guideline violations while overlooking more severe, systemic problems related to task effectiveness and efficiency. Experts are better trained to identify these deeper issues.