Visual INTeraction and Human Effectiveness in the Cockpit, II. Technical Report: VINTHEC II - WP3 - TR 02

Technical Report: Feasibility Study of IBIB Online Prototype and Visualisation and Exploratory Data Analysis

Hans H. K. Sønderstrup-Andersen, C.H. Pedersen, Steen Weber, Jan Ober, Jakub Ober

Publikation: Bog/antologi/afhandling/rapportRapportForskning

Resumé

In this subtask, we have focused on the feasibility study of the IBIB online (training/design) prototype intended to provide immediate feedback for trainers and designers, to enable them to identify significant behaviours.
The IBIB framework builds upon the hypothesis that different saccadic activities are directly related to certain types of cognitive states. Shared situational awareness develops through conscious attention activities. Conscious attention can be involved in three different modes of mental activity: Exploration,
monitoring, and planning. The exploration mode activities are predominantly based on sensor-motor operations during real-time control. During exploration, the majority of fixations are task relevant.
It is these above ideas we have systematically tested through the feasibility study. We have carried out small-scale experiments in co-ordination with the NLR study carried out in WP2. As NLR in WP2, we have used the NASA MAT (Multi-Attribute Task Battery) test software. In the study, we have used
probes that were intended to provoke the three different mental modes during the subjects tasks.
With respect to data collection, we have used the prototype for measuring eye-saccadic movements. We also measured EPOG using a remote SMI eye-tracker and SMI helmet-based system. During the session we measured performance and x, y saccades using JAZZ. In addition we present a short description of some technical issues as well (JAZZ used together with other EPOG equipment,
reliability, ergonomics, etc.)
The results show that there are indications that the JAZZ could be feasible to use in performance studies were objective measures are needed. We have designed a task with a high workload and the JAZZ data together with MAT data and subjects’ self-ratings seem to confirm this workload. The high workload does not leave the subjects much time to plan ahead or think deeper about what to do. We have not had the intention to prove the feasibility of whether or not there exist a relation between certain cognitive modes and certain saccadic behaviours. Other studies must be devoted to that purpose.
We have carried out a technical feasibility study that indicates that JAZZ is capable of detecting different saccadic behaviours in a systematic way.
Within the scope of the WP3 explorative data analysis task we have focused on developing prototype software that illustrates a number of user requirements for exploratory data analysis software. The “Risø Data Analyser” prototype synchronises EPOG scene videos with marked episodes in experiment
scenarios as they unfold for subsequent review during debriefing sessions. Technion and QinetiQ have further developed many of the ideas implemented in this first prototype into "The Data Visualisation Tool" described in WP3-TR 1.0 In addition, in this part there is a short discussion on visualising shared
situational awareness using lag sequential analysis.
The software can be used for two purposes:
1) Synchronising recording of EPOG data and recording video, and
2) Analyse EPOG data
2a) WITH synchronised EPOG data and video parts can be "cut out" for analysis based on
what is seen in the video
2b) WITHOUT synchronised video EPOG data can be analysed "the usual" away by
specifying the time interval of interest in the analysis program.
OriginalsprogEngelsk
Antal sider34
StatusUdgivet - 2003
Udgivet eksterntJa

Citer dette

@book{8c49b9e547894332bf240722be5ca92f,
title = "Visual INTeraction and Human Effectiveness in the Cockpit, II. Technical Report: VINTHEC II - WP3 - TR 02: Technical Report: Feasibility Study of IBIB Online Prototype and Visualisation and Exploratory Data Analysis",
abstract = "In this subtask, we have focused on the feasibility study of the IBIB online (training/design) prototype intended to provide immediate feedback for trainers and designers, to enable them to identify significant behaviours. The IBIB framework builds upon the hypothesis that different saccadic activities are directly related to certain types of cognitive states. Shared situational awareness develops through conscious attention activities. Conscious attention can be involved in three different modes of mental activity: Exploration, monitoring, and planning. The exploration mode activities are predominantly based on sensor-motor operations during real-time control. During exploration, the majority of fixations are task relevant. It is these above ideas we have systematically tested through the feasibility study. We have carried out small-scale experiments in co-ordination with the NLR study carried out in WP2. As NLR in WP2, we have used the NASA MAT (Multi-Attribute Task Battery) test software. In the study, we have used probes that were intended to provoke the three different mental modes during the subjects tasks. With respect to data collection, we have used the prototype for measuring eye-saccadic movements. We also measured EPOG using a remote SMI eye-tracker and SMI helmet-based system. During the session we measured performance and x, y saccades using JAZZ. In addition we present a short description of some technical issues as well (JAZZ used together with other EPOG equipment, reliability, ergonomics, etc.) The results show that there are indications that the JAZZ could be feasible to use in performance studies were objective measures are needed. We have designed a task with a high workload and the JAZZ data together with MAT data and subjects’ self-ratings seem to confirm this workload. The high workload does not leave the subjects much time to plan ahead or think deeper about what to do. We have not had the intention to prove the feasibility of whether or not there exist a relation between certain cognitive modes and certain saccadic behaviours. Other studies must be devoted to that purpose. We have carried out a technical feasibility study that indicates that JAZZ is capable of detecting different saccadic behaviours in a systematic way. Within the scope of the WP3 explorative data analysis task we have focused on developing prototype software that illustrates a number of user requirements for exploratory data analysis software. The “Ris{\o} Data Analyser” prototype synchronises EPOG scene videos with marked episodes in experiment scenarios as they unfold for subsequent review during debriefing sessions. Technion and QinetiQ have further developed many of the ideas implemented in this first prototype into {"}The Data Visualisation Tool{"} described in WP3-TR 1.0 In addition, in this part there is a short discussion on visualising shared situational awareness using lag sequential analysis. The software can be used for two purposes: 1) Synchronising recording of EPOG data and recording video, and 2) Analyse EPOG data 2a) WITH synchronised EPOG data and video parts can be {"}cut out{"} for analysis based on what is seen in the video 2b) WITHOUT synchronised video EPOG data can be analysed {"}the usual{"} away by specifying the time interval of interest in the analysis program.",
author = "S{\o}nderstrup-Andersen, {Hans H. K.} and C.H. Pedersen and Steen Weber and Jan Ober and Jakub Ober",
year = "2003",
language = "English",

}

TY - RPRT

T1 - Visual INTeraction and Human Effectiveness in the Cockpit, II. Technical Report: VINTHEC II - WP3 - TR 02

T2 - Technical Report: Feasibility Study of IBIB Online Prototype and Visualisation and Exploratory Data Analysis

AU - Sønderstrup-Andersen, Hans H. K.

AU - Pedersen, C.H.

AU - Weber, Steen

AU - Ober, Jan

AU - Ober, Jakub

PY - 2003

Y1 - 2003

N2 - In this subtask, we have focused on the feasibility study of the IBIB online (training/design) prototype intended to provide immediate feedback for trainers and designers, to enable them to identify significant behaviours. The IBIB framework builds upon the hypothesis that different saccadic activities are directly related to certain types of cognitive states. Shared situational awareness develops through conscious attention activities. Conscious attention can be involved in three different modes of mental activity: Exploration, monitoring, and planning. The exploration mode activities are predominantly based on sensor-motor operations during real-time control. During exploration, the majority of fixations are task relevant. It is these above ideas we have systematically tested through the feasibility study. We have carried out small-scale experiments in co-ordination with the NLR study carried out in WP2. As NLR in WP2, we have used the NASA MAT (Multi-Attribute Task Battery) test software. In the study, we have used probes that were intended to provoke the three different mental modes during the subjects tasks. With respect to data collection, we have used the prototype for measuring eye-saccadic movements. We also measured EPOG using a remote SMI eye-tracker and SMI helmet-based system. During the session we measured performance and x, y saccades using JAZZ. In addition we present a short description of some technical issues as well (JAZZ used together with other EPOG equipment, reliability, ergonomics, etc.) The results show that there are indications that the JAZZ could be feasible to use in performance studies were objective measures are needed. We have designed a task with a high workload and the JAZZ data together with MAT data and subjects’ self-ratings seem to confirm this workload. The high workload does not leave the subjects much time to plan ahead or think deeper about what to do. We have not had the intention to prove the feasibility of whether or not there exist a relation between certain cognitive modes and certain saccadic behaviours. Other studies must be devoted to that purpose. We have carried out a technical feasibility study that indicates that JAZZ is capable of detecting different saccadic behaviours in a systematic way. Within the scope of the WP3 explorative data analysis task we have focused on developing prototype software that illustrates a number of user requirements for exploratory data analysis software. The “Risø Data Analyser” prototype synchronises EPOG scene videos with marked episodes in experiment scenarios as they unfold for subsequent review during debriefing sessions. Technion and QinetiQ have further developed many of the ideas implemented in this first prototype into "The Data Visualisation Tool" described in WP3-TR 1.0 In addition, in this part there is a short discussion on visualising shared situational awareness using lag sequential analysis. The software can be used for two purposes: 1) Synchronising recording of EPOG data and recording video, and 2) Analyse EPOG data 2a) WITH synchronised EPOG data and video parts can be "cut out" for analysis based on what is seen in the video 2b) WITHOUT synchronised video EPOG data can be analysed "the usual" away by specifying the time interval of interest in the analysis program.

AB - In this subtask, we have focused on the feasibility study of the IBIB online (training/design) prototype intended to provide immediate feedback for trainers and designers, to enable them to identify significant behaviours. The IBIB framework builds upon the hypothesis that different saccadic activities are directly related to certain types of cognitive states. Shared situational awareness develops through conscious attention activities. Conscious attention can be involved in three different modes of mental activity: Exploration, monitoring, and planning. The exploration mode activities are predominantly based on sensor-motor operations during real-time control. During exploration, the majority of fixations are task relevant. It is these above ideas we have systematically tested through the feasibility study. We have carried out small-scale experiments in co-ordination with the NLR study carried out in WP2. As NLR in WP2, we have used the NASA MAT (Multi-Attribute Task Battery) test software. In the study, we have used probes that were intended to provoke the three different mental modes during the subjects tasks. With respect to data collection, we have used the prototype for measuring eye-saccadic movements. We also measured EPOG using a remote SMI eye-tracker and SMI helmet-based system. During the session we measured performance and x, y saccades using JAZZ. In addition we present a short description of some technical issues as well (JAZZ used together with other EPOG equipment, reliability, ergonomics, etc.) The results show that there are indications that the JAZZ could be feasible to use in performance studies were objective measures are needed. We have designed a task with a high workload and the JAZZ data together with MAT data and subjects’ self-ratings seem to confirm this workload. The high workload does not leave the subjects much time to plan ahead or think deeper about what to do. We have not had the intention to prove the feasibility of whether or not there exist a relation between certain cognitive modes and certain saccadic behaviours. Other studies must be devoted to that purpose. We have carried out a technical feasibility study that indicates that JAZZ is capable of detecting different saccadic behaviours in a systematic way. Within the scope of the WP3 explorative data analysis task we have focused on developing prototype software that illustrates a number of user requirements for exploratory data analysis software. The “Risø Data Analyser” prototype synchronises EPOG scene videos with marked episodes in experiment scenarios as they unfold for subsequent review during debriefing sessions. Technion and QinetiQ have further developed many of the ideas implemented in this first prototype into "The Data Visualisation Tool" described in WP3-TR 1.0 In addition, in this part there is a short discussion on visualising shared situational awareness using lag sequential analysis. The software can be used for two purposes: 1) Synchronising recording of EPOG data and recording video, and 2) Analyse EPOG data 2a) WITH synchronised EPOG data and video parts can be "cut out" for analysis based on what is seen in the video 2b) WITHOUT synchronised video EPOG data can be analysed "the usual" away by specifying the time interval of interest in the analysis program.

M3 - Report

BT - Visual INTeraction and Human Effectiveness in the Cockpit, II. Technical Report: VINTHEC II - WP3 - TR 02

ER -