research-article

A Tool for Easing the Cognitive Analysis of Design Prototypes of Aircraft Cockpit Instruments: The Human Efficiency Evaluator

Authors:

Sebastian Feuerstack,

Andreas Lüdtke,

Jan-Patrick OsterlohAuthors Info & Claims

ECCE '15: Proceedings of the European Conference on Cognitive Ergonomics 2015

Article No.: 22, Pages 1 - 8

https://doi.org/10.1145/2788412.2788434

Published: 01 July 2015 Publication History

Abstract

Development and evaluation of dynamic and complex systems require new techniques and tools to evaluate the risks of Human and Systems Error, especially for safety critical systems. Established techniques like the cognitive workload analysis that can be used to assess the individual perceived operator workload for sets of tasks these are not widely used in industrial development. That is, because cognitive analysis of dynamic systems depends on complex architectures and simulations to evaluate workload over time, and is still driven by proprietary notations for cognitive models that require in-depth cognitive modeling skills and is currently only accessible to experts. In this paper we present an extension to CogTool, the Human Efficiency Evaluator (HEE) to ease the analysis of the impact of new instruments and new display designs with respect to human operator workload and task execution times. The tool is designed to make these cognitive analysis techniques available to non-experts, such as system analysts and engineers. We explain the cognitive modeling and analysis process supported by the HEE referring to an aeronautics scenario presented earlier by Hutchins. The cognitive analysis compares the task performance and workload of three generations of cockpit instrument designs to support pilots' with the slats/flaps settings during an aircraft approach with the current support in modern aircrafts and was performed by using the HEE.

References

[1]

Craddock W. Aldrich, T. B. and J. H. McCracken. A computer analysis to predict crew workload during lhx scout-attack missions:. Technical Report (MDA903-81-C-0504/ASI479-054-I-84(B), United States Army Research Institute Field Unit, Fort Rucker, AL, USA:, 1984.

[2]

Theodore B Aldrich, Sandra M Szabo, and Carl R Bierbaum. The development and application of models to predict operator workload during system design. In Applications of human performance models to system design, pages 65--80. Springer, 1989.

[3]

John R. Anderson and Christian J. Lebiere, editors. The Atomic Components of Thought. Lawrence Erlbaum Associates, Mahwah, NJ, 1998.

[4]

Stuart K. Card, Allen Newell, and Thomas P. Moran. The Psychology of Human-Computer Interaction. L. Erlbaum Associates Inc., Hillsdale, NJ, USA, 1983.

Digital Library

[5]

Richard Cooper and John Fox. Cogent: A visual design environment for cognitive modeling. Behavior Research Methods, Instruments, & Computers, 30(4):553--564, 1998.

[6]

Chris Forsythe, Michael L. Bernard, and Timothy E. Goldsmith, editors. Cognitive Systems: Human Cognitive Models in Systems Design. Psychology Press, 2006.

Digital Library

[7]

Andreas Lüdtke; Jan-Patrick Osterloh; Florian Frische. Multi--criteria evaluation of aircraft cockpit systems by model--based simulation of pilot performance. In Proceedings of ERTS - Embedded Real Time Software and Systems 2012, 02 2012.

[8]

F. Frische, J.-P. Osterloh, and A. Lüdtke. Simulating visual attention allocation of pilots in an advanced cockpit environment. In Modelling and Simulation (MODSIM) World Conference & Expo, Hampton, Virginia, USA, 13--15 October 2010.

[9]

Brian F. Gore, Becky L. Hooey, Nancy Haan, Deborah L. Bakowski, and Eric Mahlstedt. A methodical approach for developing valid human performance models of flight deck operations. In Masaaki Kurosu, editor, HCI (16), volume 6776 of Lecture Notes in Computer Science, pages 379--388. Springer, 2011.

Digital Library

[10]

Sandra G Hart and Lowell E Staveland. Development of nasa-tlx (task load index): Results of empirical and theoretical research. Advances in psychology, 52:139--183, 1988.

[11]

Dzaack-J. Wiesner A. & Urbas L. Heinath, M. Simplifying the development and the analysis of cognitive models. In Proceedings of EuroCogSci07, Delphi, Greece., 2007.

[12]

Erik Hollnagel and David D. Woods. Joint cognitive systems : foundations of cognitive systems engineering. Taylor & Francis, Boca Raton, FL, 2005.

[13]

Edwin Hutchins. How a cockpit remembers its speeds. Cognitive Science, 19(3):265--288, 1995.

[14]

Bonnie E. John, Konstantine Prevas, Dario D. Salvucci, and Ken Koedinger. Predictive human performance modeling made easy. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '04, pages 455--462, New York, NY, USA, 2004. ACM.

Digital Library

[15]

RobertA. North and VictorA. Riley. W/index: A predictive model of operator workload. In GrantR. McMillan, David Beevis, Eduardo Salas, MichaelH. Strub, Robert Sutton, and Leo Van Breda, editors, Applications of Human Performance Models to System Design, pages 81--89. Springer US, 1989.

[16]

Thomas C. Ormerod and A. Shepherd. Using task analysis for information requirements specification: The SGT method. Lawrence Erlbaum Associates, 2004.

[17]

A. M. Parks and G. P. Boucek. Workload prediction, diagnosis and continuing challenges. In G. R. McMillan et al., editor, Applications of Human Performance Models to System Design. NY: Plenum Press, 1989.

[18]

Kenneth J. Sarno. Role of multiple resources in predicting time-sharing efficiency: Evaluation of three workload models in a multiple-task setting. The International Journal of Aviation Psychology, 5(1):107--130, 1995. 11541493.

[19]

Angelia Sebok, Christopher Wickens, Nadine Sarter, Stacey Quesada, Connie Socash, and Brian Anthon. The automation design advisor tool (adat): Supporting flight deck design in nextgen. In Proceedings of the Human Factors and Ergonomics Society 54th Annual Meeting, 2010.

[20]

Christopher Wickens, Angelia Sebok, John Keller, Steve Peters, Ronald Small, Shaun Hutchins, Liana Algarín, Brian F. Gore, Becky L. Hooey, and David C. Foyle. Modeling and evaluating pilot performance in nextgen: Review of and recommendations regarding pilot modeling efforts, architectures, and validation studies. Technical report, Human Centered Systems Lab, 2013.

Cited By

Zhang WWu X(2021)A Data Recognition Technology of Aviation Virtual Instrument Screen2021 IEEE 3rd International Conference on Civil Aviation Safety and Information Technology (ICCASIT)10.1109/ICCASIT53235.2021.9633717(22-25)Online publication date: 20-Oct-2021
https://doi.org/10.1109/ICCASIT53235.2021.9633717
Iuskevich IHein AAmokrane-Ferka KDoufene AJankovic M(2020)A DISCRETE-EVENT SIMULATION MODEL FOR DRIVER PERFORMANCE ASSESSMENT: APPLICATION TO AUTONOMOUS VEHICLE COCKPIT DESIGN OPTIMIZATIONProceedings of the Design Society: DESIGN Conference10.1017/dsd.2020.1571(2521-2530)Online publication date: 11-Jun-2020
https://doi.org/10.1017/dsd.2020.157
Wortelen BUnni ARieger JLüdtke AOsterloh J(2018)Monte Carlo Methods for Real-Time Driver Workload Estimation Using a Cognitive ArchitectureCognitive Infocommunications, Theory and Applications10.1007/978-3-319-95996-2_2(25-48)Online publication date: 26-Aug-2018
https://doi.org/10.1007/978-3-319-95996-2_2
Show More Cited By

Index Terms

A Tool for Easing the Cognitive Analysis of Design Prototypes of Aircraft Cockpit Instruments: The Human Efficiency Evaluator
1. Human-centered computing

Recommendations

Unmanned Aircraft Design: A Review of Fundamentals
Designing Aircraft Cockpit Displays: Borrowing from Multimodal User Interfaces
Transactions on Computational Science III

In this paper, we present an approach to design of command tables in aircraft cockpits. To date, there is no common standard for designing this kind of command tables. Command tables impose high load on human visual senses for displaying flight ...
Applied cognitive ergonomics design principles for fighter aircraft
EPCE'11: Proceedings of the 9th international conference on Engineering psychology and cognitive ergonomics

The objective of the reported work was to study the use and applicability of applied cognitive ergonomics design principles for fighter aircraft, with examples from the modern Swedish swing-role aircraft Gripen. Methods used were a literature review of ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

ECCE '15: Proceedings of the European Conference on Cognitive Ergonomics 2015

July 2015

185 pages

ISBN:9781450336123

DOI:10.1145/2788412

General Chairs:
Anke Dittmar
University of Rostock, Germany
,
Marcin Sikorski
PJAIT, Warsaw and Gdansk University of Technology, Gdansk, Poland
,
Program Chairs:
Tjerk de Greef
Delft University of Technology, The Netherlands
,
Krzysztof Marasek
PJAIT, Warsaw, Poland

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

In-Cooperation

EACE: European Association for Cognitive Ergonomics
ACM: Association for Computing Machinery
IDF: The Interaction Design Foundation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

ARTEMIS-JU

Conference

ECCE '15

ECCE '15: European Conference on Cognitive Ergonomics 2015

July 1 - 3, 2015

Warsaw, Poland

Acceptance Rates

Overall Acceptance Rate 56 of 91 submissions, 62%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
143
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)0

Reflects downloads up to 06 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Zhang WWu X(2021)A Data Recognition Technology of Aviation Virtual Instrument Screen2021 IEEE 3rd International Conference on Civil Aviation Safety and Information Technology (ICCASIT)10.1109/ICCASIT53235.2021.9633717(22-25)Online publication date: 20-Oct-2021
https://doi.org/10.1109/ICCASIT53235.2021.9633717
Iuskevich IHein AAmokrane-Ferka KDoufene AJankovic M(2020)A DISCRETE-EVENT SIMULATION MODEL FOR DRIVER PERFORMANCE ASSESSMENT: APPLICATION TO AUTONOMOUS VEHICLE COCKPIT DESIGN OPTIMIZATIONProceedings of the Design Society: DESIGN Conference10.1017/dsd.2020.1571(2521-2530)Online publication date: 11-Jun-2020
https://doi.org/10.1017/dsd.2020.157
Wortelen BUnni ARieger JLüdtke AOsterloh J(2018)Monte Carlo Methods for Real-Time Driver Workload Estimation Using a Cognitive ArchitectureCognitive Infocommunications, Theory and Applications10.1007/978-3-319-95996-2_2(25-48)Online publication date: 26-Aug-2018
https://doi.org/10.1007/978-3-319-95996-2_2
Goodrum PMiller JSweany JAlruwaythi O(2016)Influence of the Format of Engineering Information and Spatial Cognition on Craft-Worker PerformanceJournal of Construction Engineering and Management10.1061/(ASCE)CO.1943-7862.0001157142:9Online publication date: Sep-2016
https://doi.org/10.1061/(ASCE)CO.1943-7862.0001157

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents