Scrutinising usability evaluation: Does thinking aloud affect behaviour and mental workload?

Morten Hertzum, Kristin Due Hansen, Hans H. K. Andersen

    Research output: Contribution to journalJournal articleResearchpeer-review

    Abstract

    Thinking aloud is widely used for usability evaluation. The validity of the method is, however, debatable because it is generally used in a relaxed way that conflicts with the prescriptions of the classic model for obtaining valid verbalizations of thought processes. This study investigates whether participants that think aloud in the classic or relaxed way behave differently compared to performing in silence. Results indicate that whereas classic thinking aloud has little or no effect on behaviour apart from prolonging tasks, relaxed thinking aloud affects behaviour in multiple ways. During relaxed thinking aloud participants took longer to solve tasks, spent a larger part of tasks on general distributed visual behaviour, issued more commands to navigate both within and between the pages of the web sites used in the experiment, and experienced higher mental workload. Implications for usability evaluation are discussed.
    Original languageEnglish
    JournalBehavior and Information Technology
    Volume28
    Issue number2
    Pages (from-to)165-181
    Number of pages17
    ISSN0144-929X
    DOIs
    Publication statusPublished - 2009

    Keywords

    • thinking aloud
    • verbalization
    • usability evaluation methods
    • user testing
    • validity

    Projects

    Usability Evaluation of Safety-Critical Systems

    Hertzum, M., Holmegaard, K. D. & Paulsen, J. L.

    <ingen navn>

    01/04/200631/03/2009

    Project: Research

    Cite this