Workload-based assessment of a user interface design

Patrice D. Tremoulet, Patrick L. Craven, Susan Harkness Regli, Saki Wilcox, Joyce Barton, Kathleeen Stibler, Adam Gifford, Marianne Clark

Research output: Chapter in Book/Report/Conference proceedingConference contribution


Lockheed Martin Advanced Technology Laboratories (LM ATL) has designed and developed a tool called Sensor-based Mental Assessment in Real Time (SMART), which uses physiological data to help evaluate human-computer interfaces (HCI). SMART non-intrusively collects and displays objective measures of cognitive workload, visual engagement, distraction and drowsiness while participants interact with HCIs or HCI prototypes. This paper describes a concept validation experiment (CVE) conducted to 1) demonstrate the feasibility of using SMART during user interface evaluations and 2) validate the EEG-based cognitive workload values derived from the SMART system by comparing them to three other measures of cognitive workload (NASA TLX, expert ratings, and expected workload values generated with Design Interactive's Multimodal Information Decision Support tool). Results from the CVE indicate that SMART represents a valuable tool that provides human factors engineers with a non-invasive, non-interrupting, objective method of evaluating cognitive workload.

Original languageEnglish (US)
Title of host publicationDigital Human Modeling - Second International Conference, ICDHM 2009 - Held as Part of HCI International 2009, Proceedings
Number of pages10
StatePublished - 2009
Externally publishedYes
Event2nd International Conference on Digital Human Modeling, ICDHM 2009. Held as Part of HCI International 2009 - San Diego, CA, United States
Duration: Jul 19 2009Jul 24 2009

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume5620 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Other2nd International Conference on Digital Human Modeling, ICDHM 2009. Held as Part of HCI International 2009
Country/TerritoryUnited States
CitySan Diego, CA

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • General Computer Science


Dive into the research topics of 'Workload-based assessment of a user interface design'. Together they form a unique fingerprint.

Cite this