VSAT

The evaluation process, the analysis task list and detailed definitions of all subsystems were developed in conjunction with AFRL Subject Matter Experts (SMEs).  These were combined into questionnaires where subjects were asked to rate: a) The importance of the subsystem to each task, b) The adequacy of a subsystem in training that task, c) The current fidelity of the subsystem for training that task and d) The required fidelity of the subsystem in training that task. 

VSAT automated the questionnaire process to: a) ensure that complete and understandable results were obtained from every subject, b) accelerate the process of incorporating data into the MTAD and c) enhance the capability to use similar questionnaires in the future.  The automated questionnaires were successfully used to collect data from F-16 pilots during the period March through June 2004.  A sample of the questionnaire is shown below. 

Collected data is analyzed in the MTAD.  The MTAD includes a system of rules to compute composite numbers for the importance, adequacy, current fidelity and required fidelity for each task /subsystem combination.  These composite results are used in the simulation analysis. This system allows analysts to review the data collected from all subjects and override the computed result if necessary. 

The mappings allow the simulation analyses to be described in terms that are most useful to an individual user for a specific purpose.  VSAT has developed mapping that relates tasks for the beyond-visual-range air-to-air mission to Mission Essential Competencies (MECs).  This allows results to be presented in terms of MECs rather than tasks. Additional mappings are currently being considered.

The MTAD computes and displays the results of the analysis in a combination of charts, forms and reports based on various queries.  Microsoft Access memo fields or linked Microsoft Office files are also used to explain analysis results. Thus far VSAT has demonstrated the following aspects of the MTAD:

a.       Bar charts, generated in real time by the MTAD, which depict the ability of each simulation system to support training.

 b.       Demographic queries that restrict MTAD results to data obtained from particular groups of subjects (e.g. wingmen).

c.       Other sample queries designed to support various analyses.

A sample MTAD Display is shown below. Results show a high degree of agreement on the questionnaire responses.  Subjects consistently identified simulation subsystem problems. 

For information on VSAT services send mail to info@mail.virtualsimulation.com
Send mail to webmaster@mail.virtualsimulation.com with questions or comments about this web site.
Last modified: September 27, 2006