Test procedure for evaluating the human–machine interface of vehicles with automated driving systems

Objective: The human–machine interface (HMI) is a crucial part of every automated driving system (ADS). In the near future, it is likely that—depending on the operational design domain (ODD)—different levels of automation will be available within the same vehicle. The capabilities of a given automation level as well as the operator’s responsibilities must be communicated in an appropriate way. To date, however, there are no agreed-upon evaluation methods that can be used by human factors practitioners as well as researchers to test this. Methods: We developed an iterative test procedure that can be applied during the product development cycle of ADS. The test procedure is specifically designed to evaluate whether minimum requirements as proposed in NHTSA’s automated vehicle policy are met. Results: The proposed evaluation protocol includes (a) a method to identify relevant use cases for testing on the basis of all theoretically possible steady states and mode transitions of a given ADS; (b) an expert-based heuristic assessment to evaluate whether the HMI complies with applicable norms, standards, and best practices; and (c) an empirical evaluation of ADS HMIs using a standardized design for user studies and performance metrics. Conclusions: Each can be used as a stand-alone method or in combination to generate objective, reliable, and valid evaluations of HMIs, focusing on whether they meet minimum requirements. However, we also emphasize that other evaluation aspects such as controllability, misuse, and acceptance are not within the scope of the evaluation protocol.

Tags
Data and Resources
To access the resources you must log in

This item has no data

Identity

Description: The Identity category includes attributes that support the identification of the resource.

Field Value
PID https://www.doi.org/10.6084/m9.figshare.9250808
PID https://www.doi.org/10.6084/m9.figshare.9250808.v1
URL https://figshare.com/articles/Test_procedure_for_evaluating_the_human_machine_interface_of_vehicles_with_automated_driving_systems/9250808
URL http://dx.doi.org/10.6084/m9.figshare.9250808.v1
URL https://dx.doi.org/10.6084/m9.figshare.9250808.v1
URL https://dx.doi.org/10.6084/m9.figshare.9250808
URL http://dx.doi.org/10.6084/m9.figshare.9250808
Access Modality

Description: The Access Modality category includes attributes that report the modality of exploitation of the resource.

Field Value
Access Right Open Access
Attribution

Description: Authorships and contributors

Field Value
Author Naujoks, Frederik
Author Hergeth, Sebastian
Author Wiedemann, Katharina
Author Schömig, Nadja
Author Forster, Yannick
Author Keinath, Andreas
Publishing

Description: Attributes about the publishing venue (e.g. journal) and deposit location (e.g. repository)

Field Value
Collected From Datacite; figshare
Hosted By figshare
Publication Date 2019-08-05
Publisher Taylor & Francis
Additional Info
Field Value
Language UNKNOWN
Resource Type Dataset
keyword FOS: Mathematics
keyword human–machine interface
system:type dataset
Management Info
Field Value
Source https://science-innovation-policy.openaire.eu/search/dataset?datasetId=dedup_wf_001::25620f2095822f086a8d182f218e02b0
Author jsonws_user
Version None
Last Updated 4 January 2021, 10:41 (CET)
Created 4 January 2021, 10:41 (CET)