Re : Markers

Piers Herbert (herbert_at_orchard.keme.co.uk)
Sun, 3 Jan 1999 12:53:13 -0000


Mike Nendick wrote:

>It would be interesting to compile the markers in current use in airlines
>and their application in the assessment process.
>There is a lot of work ahead in this area of human factors evaluation for
>aviation personnel.

If you haven't read it already, you might be interested in UK CAA paper
98005 which addresses this issue.

>"We" need to educate before "they" regulate....., don't we?

JAR OPS already requires assessment of CRM as part of the overall
assessment of operator proficiency checks (base checks), line checks and
command upgrades (but not LOFT). Given that we are required to assess, it
seems to me that the issues of reliability and validity must be addressed,
though the validity issue is particularly problematic; as Rick Heybroek
says:

>it is not really clear how closely specific process variables are related
to
>outcomes.

Regarding reliability, I was talking the other day to a fleet Senior
Training Captain who
expressed the opinion that, since he would personally make the final
judgment regarding a pilot's career ("chopping", demotion etc.) the issue
of inter rater reliability between his other training captains was not
important.

Piers