RE: Markers

ROGERS, DAVID G. (david.g.rogers1_at_jsc.nasa.gov)
Wed, 30 Dec 1998 09:08:44 -0600

Mike and CRM's
I am an Instructor within the Guidance & Control/Propulsion group in
the Space Flight Training Division at NASA's Johnson Space Center.
Your questions caught my attention because they echo many of the
issues we are raising as well. The CRM or SFRM (Space Flight Resource
Management) course of instruction here at NASA has been very well received
by the astronauts, flight controllers and instructors. The question of
marking performance is a sensitive one within this culture. We wanted to
stray away from gathering metrics for metrics sake and shift the focus to
being able to identify those CRM skills which were or were not exercised and
which in turn led to positive or negative outcomes. During the classroom
instruction we baseline the concepts and direct the instruction to skill
identification. During the application phase (during training simulations)
the instructors are tasked with skill identification as well. During the
sim and prior to the debrief the training lead is responsible for
facilitating the debrief. Marking positive or negative use of CRM skills is
the training leads role. If issues are not covered by the crew's self
analysis then it becomes the training lead's role to facilitate the crew's
discussion to the "marked" skills. The training lead uses an evaluation
form which serves two purposes. First is serves an a debriefing tool to
ensure critical observations are covered. Secondly it serves to identify
trends the crew's my be developing throughout the training template. These
trends then feed into future training sessions.
In answering many of your questions and concerns we asked ourselves
"What is the end goal?" Our answer was to enhance the crew's debrief and
establish an environment to address CRM issues with open and candid
dialogue.

Just some food for thought

David G. Rogers
DT 34
Space Flight Training Instructor
CRM Specialty Instructor

1-281-244-7354

> ----------
> From: Mike Nendick[SMTP:avmdn_at_cc.newcastle.edu.au]
> Sent: Tuesday, December 29, 1998 5:08 AM
> To: crm-devel_at_db.erau.edu
> Subject: Re: Markers
>
>
> At 09:44 28/12/98 +0800, Julian wrote:
> >
> >Dear All, I am interested to know who is using markers with their LOFT/
> >CRM sim sessions. ...................
> >We see the importance of marking the sim
> >sessions. Is it valuable or is it critical? Does it go against the
> >basics of CRM? Is it productive or counter productive? Is it a
> >re-emergence of the 'check mentality'? Are the bean counters out of
> >control? Is there a reluctance of pilots/managers to admit they are
> >human? Do you know how well you will perform on the third missed
> >approach?(sress!!!!) ........................
> >So, should we mark or not???????
>
>
> Julian
> Hi there. I believe that this should be an interesting and important
> thread
> as CRM goes into "5th generation" and beyond.
> There is no doubt that there are serious pros and cons to the
> assessment
> issue.
> However I think that without comprehensive evaluation of process and
> outcome, including group and individual performance, there can be little
> improvement nor understanding of what is working, what is not, and why.
> Also
> snap shot assessment can be supplemented by studies over time to pick
> trends and so on. At some stage individuals will be made accountable for
> poor human performance on the flightdeck, in the cabin, or on the hangar
> floor beyond the technical focus of current assessment systems.
> The critical factors will be defining appropriate markers, assessing
> objectively to them, and using the results primarily as a training and
> development tool, rather than a heavy handed threat and negative
> reinforcement regime.
> It would be interesting to compile the markers in current use in airlines
> and their application in the assessment process.
> There is a lot of work ahead in this area of human factors evaluation for
> aviation personnel.
> "We" need to educate before "they" regulate....., don't we?
>
> regards, Mike
>
>
>
> Mike Nendick
> Department of Aviation & Technology
> The University of Newcastle
> Callaghan
> NSW 2308
> AUSTRALIA
>
> ph (++61-2) 4921-7396
> fax (++61-2) 4921-8742
> homepage: www.newcastle.edu.au/department/av/index.
>