Coding and inferences from visual and other behavioural data

In this report we focus on developing and testing methods for the analysis of team situation awareness. That is, focus is on methods for analysing team situation awareness relating visual and other behavioural data; development of tools to facilitate usability and efficiency of Eye Point of Gaze (EPOG) data collection; and exploration and documentation of EPOG data measurement techniques.
The objective is to develop methods at a semantic level for analysing shared situational awareness relating visual and other behavioural data and to demonstrate how (a) objective measures (eye tracking) (b) subjective measures (Workload, Situation Awareness (SA), Self-assessment) and (c) elicitation of subjects' awareness of team-mates' current SA correlate. Measures of subjects' awareness of team-mates was developed and tested during small-scale experiments. Specifically focus has been the combination of visual and other behavioural data, of subjective (where raw data are interpretations) and objective data (where raw data are recordings of directly observable behaviour), and of data representing voluntary/intentional behaviour (actions) and EPOG data (that do not directly represent intentions).
A series of small-scale experiments was carried out in the following domains: Flight Simulation, Nuclear Power Plant Operation, Air Traffic Control Simulation and Anaesthesia Simulation.
A device has been developed (JAZZ) that provides operators with real-time as well as historic data on co-operators attention mode. The prototype is based on a model that distinguishes three modes of mental activity (described as planning, monitoring and exploration). According to this model, visual activity increases across the planning, monitoring and explorations modes respectively. It is the thought that this model could be utilised to give feedback to operators in terms of team-mates current mental mode and thereby support maintenance of team situation awareness.