SITUATION AWARENESS MANAGEMENT WORKSHOP
A Workshop for CRM Developers
Ninth International Symposium on Aviation Psychology
Monday, April 27, 1997, 1:30 PM
Conducted by the
Industry CRM Developers Group
TABLE OF CONTENTS
SITUATION AWARENESS MANAGEMENT COURSE OUTLINE
SITUATION AWARENESS BEHAVIORAL MARKERS
ABOUT THE INDUSTRY CRM DEVELOPERS GROUP
HOW TO USE THE CRM-DEVEL MAILING LIST
INTERNET SITUATION AWARENESS MANAGEMENT RESOURCES
Workshop Summary
Situation Awareness (SA), or the lack of it, is repeatedly identified as a key causal factor in many aircraft accidents and serious incidents. Designing a highly effective training program to enhance crew awareness of the subject and improve their Situation Awareness Management (SAM) skills is a real challenge.
This workshop serves as a launching point from which CRM/Human Factors training developers can create a tailored program that spans the curricula from the classroom through the simulator and out to line operations.
The workshop is composed of four blocks that: (1) provide a comprehensive review of the fundamental concepts that make up SA, and some of the techniques used to effectively manage SA in flight operations; (2) develop a generic list of training outcomes for this subject; (3) review a variety of highly effective instructional techniques for teaching SA management, including methods that have been proven successful for use in classroom, simulator, and line settings; and, (4) address methods of observing and assessing both individual and crew SA in classroom, simulator, and line events.
In the process of working through these topics, participants learn to access a rich array of accident studies, scientific research, literature and other resources that are readily available on this vital topic. Special emphasis is placed on how the Internet can be used to collaborate with an extensive, world wide network of CRM/Human Factors colleagues on this vital issue.
This workshop is conducted by members of the Industry CRM Developers Group.
AGENDA
|
Time |
Activity |
Facilitator |
| Introduction | ||
|
13:30 - 13:35 |
Welcome & Agenda | Mr. Neil Krey, Hughes Training Inc. |
|
13:35 - 13:45 |
Introductions | Capt. Peter Wolfe, Southwest Airlines |
|
13:45 - 14:00 |
About the Industry CRM Developers Group and the SAM Tiger Team | Dr. Vince Mancuso, Delta Air Lines |
| The Basics of Developing SAM Training
(links lead to presentations) |
||
|
14:00 - 14:15 |
What is SA and how do I manage it? | Dr. Sherry Chappell, Transquest Inc. |
|
14:15 - 14:30 |
How do I teach SAM? | Capt. Peter Wolfe |
|
14:30 - 14:45 |
How do I measure SAM performance? | Dr. Carolyn Prince |
|
14:45 - 15:00 |
What resources are available to develop SAM training? | Mr. Neil Krey |
Working Groups
15:00 - 16:20 (includes break)
|
Group A - |
Group B - |
Group C - |
Group D - |
Group E - |
|
Dr. Sherry Chappell |
Dr. Vince Mancuso |
Capt. Peter Wolfe |
Dr. Carolyn Prince |
| Working Group Reports (links lead to reports) | ||
|
16:20 - 16:30 |
Group A | Group A Leader |
|
16:30 - 16:40 |
Group B | Group B Leader |
|
16:40 - 16:50 |
Group C | Group C Leader |
|
16:50 - 17:00 |
Group D | Group D Leader |
|
17:00 - 17:10 |
Group E | Group E Leader |
| Conclusion | ||
|
17:10 - 17:15 |
Summary | Dr. Vince Mancuso |
WORKING GROUPS
General Instructions
Workshop participants will form five working groups to address assigned
objectives as detailed below. Work groups may reconfigure the room to
facilitate their work. Each group will have approximately one hour to
accomplish their objective, following which they will report the results
to the entire workshop.
Goal - The overall goal of all working groups is to identify issues
and generate guidance on generic issues which affect the design, development,
and presentation of training on the management of situation awareness.
Each working group should take advantage of the expertise of the panel
of presenters and participants in addressing the specific issues assigned
to their group. Cross-group interaction is also encouraged if the individual
groups find it beneficial.
Group Leader - Each group will select a leader who is responsible
for keeping the group focused on their primary objective. The areas the
groups will be working on overlap and some discipline will be required
to avoid lengthy discussions on topics being addressed by other groups.
The leader will also be responsible for helping the group manage its time
so it can complete its discussions and develop a report for presentation
to the entire workshop.
Group Reports - Following the working session, each group will present the results of their discussions to the entire workshop. This presentation should last no more than 10 minutes and should state the group's objective, summarize discussions which took place, and present the results. Since these reports will be published as part of the Symposium proceedings and included on the Industry CRM Developers' web site, if individual groups desire to provide more detail than the presentation time allows, they may submit them for publication.
Working Group A - Course Objectives and Outline
Objective - Develop a list of the core expectations which an airline or other operator should place on the performance of its flight crews with respect to managing situation awareness.
Considerations - In order to develop a training program which produces clearly identifiable changes in behavior, the objectives of the training must be clearly stated and documented. This group will identify observable and measurable crew behaviors that are needed to successfully manage team situation awareness during line operations. These behaviors may or may not be related to existing behavioral markers for situation awareness (extracted in this handout). Keep in mind the distinction between recognizing when a crew has good situation awareness, and their ability to manage it.
Working Group B- Classroom Techniques
Objective - Develop a list of training content, procedures, and techniques appropriate to the effective presentation and evaluation of situation awareness management knowledge, skills, and attitudes in a classroom environment.
Considerations - The academic classroom provides unique opportunities and challenges when training crews on situation awareness management. This group will explore the various classroom training methods which are used to effectively train this subject matter. Among the considerations should be required support materials, desired group size, time requirements, etc. Examples of existing successful class exercises and techniques can be included.
Working Group C - Simulator Techniques
Objective - Develop a list of training content, procedures, and techniques appropriate to the effective application of situation awareness management knowledge, skills, and attitudes in the flight simulator environment.
Considerations - The modern flight simulator provides a high fidelity learning environment where crews can apply their situation awareness management skills. This group will explore methods for using the simulator to create situations which challenge the crew's SA Management abilities and allow the instructor to provide them with feedback on their performance. Among the considerations will be the development of effective event sets, the use of cockpit video to enhance crew debriefing, and instructor briefing and debriefing techniques to enhance the opportunity for behavior change. Of particular interest are activities in the Line Oriented Flight Training (LOFT) and Line Oriented Evaluation (LOE) environments.
Working Group D - Line Techniques
Objective - Develop a list of the content, procedures, and techniques appropriate to the effective training and observation of situation awareness management knowledge, skills, and attitudes in the line environment and during line checks.
Considerations - Of all the domains within which situation awareness management is trained and observed, the line provides the greatest fidelity and the least control. This group will deal with observation and feedback techniques, check airman roles, and inflight safety considerations.
Working Group E - SAM Assessment
Objective - Develop a list of the content, procedures, and techniques which are appropriate to the effective evaluation of situation awareness management knowledge, skills, and attitudes in the classroom, simulator, and line environments.
Considerations - The leading edge of development.
SITUATION AWARENESS MANAGEMENT COURSE OUTLINE
The following course outline was produced by the Industry CRM Developers
Situation Awareness Tiger Team
Goal of course: To recognize the factors that contribute to a loss of situation awareness and appropriately direct attention and effort to maintain or regain both individual and crew situation awareness.
50 minutes in duration.
I. Introduction
a. What is SA management?
b. Model from 11 June meeting: Plane, Path, People,
c. Contributors to loss of SA:
1. Time Pressure
Schedule
Curfews
Emergency2. Distractions
External (ATC, Flight Attendants)
Internal (Pilot Crew)3. Workload Extremes
High
Low
Summary: Maintain vigilance for situations that drive you away, or distract you from, thinking about the plane, its path, and the people who are flying it.
II. Fuel Management Scenario
a. Preventing Loss of SA
Positive habits
Expanded team
III. AA 757 Cali Report
a. Traps - Truths and Consequences:
If something doesn't feel right it isn't
Automation keeps secretsb. What you can do to have better SA Management:
Focus attention: (plan, detect, interpret, project, revise)
Manage distractions
Plan for contingencies
Create reminders
IV. High Speed Abort - company incident report
a. Crew SA:
Resolve Confusion
The strong silent type
Habits are hard to break
Alternate interpretations
Allocating attention
Using Resources
V. Wrap Up and Final Questions
SITUATION AWARENESS BEHAVIORAL MARKERS
The following behavioral markers are extracted from
FAA Advisory Circular
102-51B, Crew Resource Management.
3. WORKLOAD MANAGEMENT AND SITUATIONAL AWARENESS CLUSTER.
a. Preparation/Planning/Vigilance. These behaviors relate to crews' anticipating contingencies and the various actions that may be required. Excellent crews are always "ahead of the curve" and generally seem relaxed. They devote appropriate attention to required tasks and respond without undue delay to new developments. (They may engage in casual social conversation during periods of low workload and not necessarily diminish their vigilance.)
Behavioral Markers
Demonstrating and expressing situational awareness; for example, the "model" of what is happening is shared within the crew.
Active monitoring of all instruments and communications and sharing relevant information with the rest of the crew.
Monitoring weather and traffic and sharing relevant information with the rest of the crew.
Avoiding "tunnel vision" caused by stress; for example, stating or asking for the "big picture."
Being aware of factors such as stress that can degrade vigilance and watching for performance degradation in other crewmembers.
Staying "ahead of the curve" in preparing for planned situations or contingencies.
Ensuring that cockpit and cabin crewmembers are aware of plans.
Including all appropriate crewmembers in the planning process.
Allowing enough time before maneuvers for programming of the flight management computer.
Ensuring that all crewmembers are aware of initial entries and changed entries in the flight management system.
b. Workload Distributed/Distractions Avoided. These behaviors relate to time and workload management. They reflect how well the crew manages to prioritize tasks, share the workload, and avoid being distracted from essential activities.
Behavioral Markers
Crewmembers speak up when they recognize work overloads in themselves or in others.
Tasks are distributed in ways that maximize efficiency.
Workload distribution is clearly communicated and acknowledged.
Non-operational factors such as social interaction are not allowed to interfere with duties.
Task priorities are clearly communicated.
Secondary operational tasks (for example, dealing with passenger needs and communications with company) are prioritized so as to allow sufficient resources for primary flight duties.
Potential distractions posed by automated systems are anticipated, and appropriate preventive action is taken, including reducing or disengaging automated features as appropriate.
PANELISTS
| Dr. Sherry Chappell, Transquest Inc. Dept. 800 1001 International Blvd. Atlanta GA, 30354 404-773-8820 404-714-1511 (FAX) Sherry.Chappell@TransQuest.com |
Sheryl L. Chappell just joined Transquest,
the information technology company of Delta Air Lines. She is a senior
human factors engineer in charge of aeronautical human factors consulting
within Delta and with other airlines. Prior to this Sherry spent 17
years at the National Aeronautics and Space Administration's Ames
Research Center, at Moffett Field, California. There she was the Principal
Scientist of the Aviation Safety Reporting System. She was responsible
for the research program, which utilized incident reports voluntarily
submitted by pilots and air traffic controllers. Areas of investigation
included: the proper allocation of automation in the cockpit, the
management of information in cockpit and air traffic control tasks,
and the development of error-tolerant systems and procedures.
Previously at NASA Sherry was the principal investigator for the human factors evaluation of the Traffic Alert and Collision Avoidance System and the Data Link / Information Transfer Programs. She was responsible for insuring that pilots are able to correctly interpret the TCAS and data link information and make the required responses to the information being portrayed. She has also conducted many simulation studies evaluating cockpit traffic displays. In the private sector, Sherry is a founder and co-owner of FOCUS Tutoring Systems, a company which supplies computer based training solutions to domestic and international airlines. Sherry received her Ph.D. from Ohio State University, in Cognitive/Experimental Psychology. Sherry is Certified Human Factors Professional and an instrument-rated commercial pilot and flight instructor. |
| Mr. Neil C. Krey, Hughes Training Inc. P.O. Box 6171 Arlington, Texas 76005-6171 817-619-2313 817-619-2178 (FAX) neilkrey@crm-devel.org |
Neil Krey is an aviation training professional
with special interests in Crew Resource Management (CRM) and crew
training for high technology flight decks. With Hughes Training Inc.
he is currently involved in the development of training and performance
support products for aviation maintenance technicians and ramp service
personnel.
Since 1983, Neil have been deeply involved in the development and implementation of Crew Resource Management (CRM) and human factors training for flight and ground crews. He has 15 years experience in the development of training programs using Instructional Systems Design. These programs incorporate advanced learning theories and a variety of multi-media and simulation. Subject areas include equipment specific training, training in the use of automated systems, and crew resource management and team training. His background includes extensive experience in the application of high and low fidelity simulation technologies within the training environment. Simulation training development has been applied to both full and part task training objectives, including Line Oriented Flight Training (LOFT) and Line Oriented Evaluation (LOE). He is currently pursuing the application of virtual reality technology to low fidelity simulation and part-task training applications. Neil has managed the training and professional development program for FlightSafety International's company-wide staff of flight deck crew, cabin crew, and maintenance technician instructors. Previously, he held a similar responsibilities at SimuFlite Training International. Over the past several years, Neil has developed techniques for training delivery through the application of online computer communications suites such as the Internet. This activity included the conduct of an Aviation Weather course for over 80 trainees using the America Online computer service, and the notional design of an Internet-based Just-In-Time training product. Neil's career includes positions as flight department manager, and flight crew member. He holds FAA Airline Transport Pilot, Flight Instructor, and Ground Instructor certificates. |
| Dr. Vince Mancuso, Delta Air Lines P.O. Box 87029 College Park, GA 30337 770-471-6286 (Phone/Fax) 70232.1005@compuserve.com |
Dr. Vince Mancuso is currently a 737
First Officer with Delta Air Lines who has held management positions
as CRM Program Developer, Coordinator of Line Oriented Simulations,
and Manager of Corporate Human Factors. Vince is a Captain in the
Air Force Reserve and currently serves as a CRM advisor to the Air
Education and Training Command. He is also an Associate Professor
of Aerospace Science with Embry-Riddle. He currently holds an Airline
Transport Pilots license, Commercial Seaplane license, Airframe and
Powerplant Mechanics license, and a 727 Flight Engineer certificate.
Vince was an ROTC distinguished graduate commissioned into the Air Force in 1984. He completed the prestigious Euro-NATO Joint Jet Pilot Training (ENJJPT) finishing with "Top-Stick" and Distinguished Graduate honors. He completed tours in the F-4 Wild Weasel in California and Germany and was part of the initial cadre sent to Desert Shield in September 1990. He flew 37 combat missions during Desert Storm and was awarded two Distinguished Flying Crosses, four Air Medals and several other campaign ribbons. Vince's education includes a B.S. in Training and Development from Southern Illinois University, an M.P.A in Administrative Organization and Management from Golden Gate University and a Ph.D. in Information Systems from Nova Southeastern University. |
| Dr. Carolyn Prince, 409 Balmoral Road Winter Park, Florida 32789 407-644-0895 105015.223@compuserve.com |
Carolyn Prince has worked as a researcher
in the field of aviation for over 10 years. Currently, she is involved
in research on decision making and on situation awareness, both funded
by the FAA. The decision making research is a collaborative project
with NASA-Ames.
Carolyn was instrumental in conducting and directing the research for Aircrew Coordination Training for the U.S. Navy (the Navy's version of CRM). Until this past summer, she was the leader for the aviation team training laboratory at the Naval Air Warfare Center Training Systems Division. Some of her specific research interests have included: defining aviation crew process skills, team performance measurement, and situation awareness. Along with Michael Brannick, Ph.D. and Eduardo Salas, Ph.D., she has edited a book on team performance measurement that is in press. Carolyn Prince received her Ph.D. degree from the University of South Florida in Industrial/ Organizational Psychology. She has a Masters Degree in Industrial Psychology and another in business. Prior to her work in aviation, she was a consultant in management selection and training. |
| Mr. Anthony C. Sasso Northwest Airlines Department N7205 5101 Northwest Drive St. Paul, Minnesota 55111-3034 612-727-6739 612-727-4434 (FAX) anthony.sasso@nwa.com |
Tony Sasso is the Senior Crew Resource
Management Specialist for Northwest Airlines (NWA). At NWA, Tony facilitates
the CRM Awareness class for all new-hire pilots, the CRM Facilitation
and LOFT Administration portions of the Northwest Pilot Instructor
Qualification Course, and the Decision Making module of the Captain
Leadership School. He also oversees the development and manages the
facilitation of all the CRM LOFT scenarios used each year at NWA.
He has recently been published in Aviation Training: Pilot, Instructor,
and Organization, in which he authored a chapter on organizational
issues in CRM LOFT facilitation and administration. In addition, he
writes a bi-monthly article for the NWA Flight Operations magazine,
On Course. He is also a contributing author for the Southeastern Aviation
Alumni Association newsletter. He belongs to the Developers Group,
and was a member of the SA Management Tiger Team that developed the
Situation Awareness Management training module. His presentations
include, "Northwest Airlines Instructor Refresher Training",
at the 6th annual CRM Conference in September 1996, and "Human
Factor Integration at Northwest Airlines", at the Flight Crew
Training Conference in November 1996.
Before joining Northwest in 1994, Tony spent 9 years in the United States Air Force as an Advanced Combat Evaluator/Instructor Navigator on the Lockheed C-130 Hercules. His positions in the Air Force included Special Operations Low-Level Instructor, Chief Scheduler, Mobility and Plans Officer, Replacement Training Unit Officer, and Wing Commander Executive Officer. After leaving the active duty Air Force in 1992, he joined CAE-Link Corporation, where he served as the Chief Navigator Instructor and CRM/LOFT Coordinator at the Minnesota Air National Guard facility. During his 2 years with CAE-Link, he trained the entire instructor staff on CRM/LOFT facilitation, administrating over 60 LOFT sessions himself. He still continues his active flying career as a line navigator with the Minnesota Air National Guard, holding the rank of Major, and to date has accumulated over 3000 flying hours on the C-130. Tony received his Bachelors Degree in Mathematics and Economics in 1984 from Boston College, in Chestnut Hill, Massachusetts. While stationed at Little Rock Air Force Base in Arkansas in 1992, he received his Masters Degree in Operations Management from the University of Arkansas, in Fayetteville. |
| Captain Peter J.
Wolfe, Southwest Airlines Flight Operations Department P.O. Box 36611 Dallas, Texas 75235-1611 214-792-5227 214-792-5219 (FAX) pjwolfe@ix.netcom.com |
Peter Wolfe is a line Captain and involved
with the Human Factors program for Southwest Airlines since 1990.
Before joining Southwest, he spent 10 years with a regional airline
as a line pilot/check airman and in various management positions including
Director of Operations and VP Personnel and Ground Operations. He
holds an ATP and is type rated in the B-737, DC-9, FH-227 and G-159.
His civilian flight expereince includes both domestic and international
operations in scheduled, charter and contract passenger and all-freight
service.
His 30+ year aviation career began in the USAF where he flew a wide variety of aircraft including the F-4, EC-135 and T-39 in combat and peacetime operations around the world. In additon to flying duties, he held posts in flight operations management and training, flying safety and aircraft maintenance technical training. He holds a Master's degree in Public Administration. |
ABOUT THE INDUSTRY CRM DEVELOPERS GROUP
The Industry Crew Resource Management (CRM) Developers Group is a forum to identify needs, coordinate processes, and facilitate development of aviation CRM and Human Factors (HF) resources and products. It accomplishes these goals through meetings and online communications. It maintains a site on the Internet's World Wide Web and an Internet mailing list. For additional information about the Industry CRM Developers Group visit the Group's World Wide Web Site, or contact Vince Mancuso at vince_mancuso@compuserve.com or Neil Krey at neilkrey@crm-devel.org
WORLD WIDE WEB SITE
As a companion to the CRM-DEVEL mailing list, the Group has established a World Wide Web (WWW) site. On this site you will find a wide variety of resources to assist you in the development and use of CRM and Human Factors courses, and training materials for aviation and other applications. The address of the Industry CRM Developers web site is
INTERNET MAILING LIST
The Industry CRM Developers Group has established the CRM-DEVEL Internet mailing list to provide a forum for everyone who develops, presents, and/or manages Crew Resource Management (CRM) and Human Factors (HF) programs. It promotes the sharing of ideas, resources, products, and other information to enhance the quality of CRM and human factors programs. To use this valuable resource you only need email access. Instructions for establishing a free subscription are on the next page.
MAILING LIST ARCHIVES
All messages distributed by the CRM-DEVEL mailing list are archived on the Group's World Wide Web site for future reference.
HOW TO USE THE CRM-DEVEL MAILING LIST
An Internet mailing list is much like a telephone party line. Email sent to the mailing list address is forwarded by the list server to all subscribers. In this way, by sending a single email, everyone on the mailing list receives your message. You, in turn, get to read the email messages sent to the list by all other subscribers.
HOW TO SUBSCRIBE
(Connecting to the Party Line)
To join the Industry CRM Developers mailing list, send an email TO: the following address
Majordomo@db.erau.edu
In the body of your email, put the following text
subscribe crm-devel
The automated mailing list system will send you two email messages confirming that your subscription has been started. From then on, you will receive all email sent to the mailing list address.
HOW TO START OR JOIN A DISCUSSION
(Talking on the Party Line)
To start a new discussion, ask a question, or otherwise communicate with the subscribers on the mailing list, send an email with a descriptive SUBJECT: to the following address:
crm-devel@db.erau.edu
NOTE THAT THIS IS A DIFFERENT ADDRESS THAN THE ONE YOU USED TO SUBSCRIBE!
The mailing list server will then distribute the message to all subscribers on the list. You will also receive a copy of your own message from the list server as verification that it has been successfully processed.
To reply to an on-going discussion, simply press REPLY while viewing the message in your mail reader. Make sure that the TO: address in your mail editor is
crm-devel@db.erau.edu
and do not change the SUBJECT: line. Leaving the SUBJECT: line unchanged aids the automated mail archiving system in keeping mail relating to given subject together. These archived messages are available on the Industry CRM Developers Group World Wide Web (WWW) site.
HOW TO CANCEL YOUR SUBSCRIPTION
(Hanging Up from the Party Line)
To remove yourself from the Industry CRM Developers mailing list, send an email TO: the following address
Majordomo@db.erau.edu
NOTE THAT THIS IS A DIFFERENT ADDRESS THAN THE ONE YOU USED TO PARTICIPATE IN DISCUSSIONS!
In the body of your email, put the following text
unsubscribe crm-devel
The automated mailing list system will return an email message confirming that your subscription has been canceled.
INTERNET SITUATION AWARENESS MANAGEMENT RESOURCES
Industry CRM Developers Group Situation Awareness Management Tiger Team
Managing Situation Awareness on the Flight Deck, or The Next Best Thing to a Crystal Ball, Sheryl L. Chappell, NASA Aviation Safety Reporting System.
Situational Awareness, Key Component of Safe Flight, Constance Bovier. Reprinted with permission from FLYING CAREERS Magazine, January 1997.
http://www.crm-devel.org/resources/article/flyingcareers.html
Air Force Office of Scientific Research (AFOSR) Bibliography Situation Awareness Literature Review
No Longer Available Online
Situation Awareness, U.S. Navy Office of Training Technology (OTT)
http://www.ott.navy.mil/2%5F1/2%5F1%5F6/index.htm
Situation Awareness: Its Role in Flight Crew Decision Making, Judith Orasanu, NASA-Ames Research Center
http://olias.arc.nasa.gov/publications/OSU_Orasanu/AvPs-SA.txt.html
Use Of Testable Responses For Performance-Based Measurement Of Situation Awareness, A. R. Pritchett, R.J. Hansman & E.N. Johnson, Department of Aeronautics & Astronautics, Massachusetts Institute of Technology
Team Situation Awareness In Aviation Maintenance, Mica R. Endsley, Texas Tech University, Michelle M. Robertson, University of Southern California
Copyright © 1996-2005 by Neil C. Krey unless otherwise indicated.
Non-commercial reproduction rights granted if the following notice is included:
"Source: Neil Krey's CRM Developers Forum, http://www.crm-devel.org"