Transcriber Confidence in Relation to Accuracy of Transcription
Transcriber Confidence in Relation to Accuracy of Transcription

Author: Eugene P. Stichman

Publisher:

Published: 1966

Total Pages: 32

ISBN-13:

DOWNLOAD EBOOK

Measures of two aspects of performance--message intelligibility and expressed confidence in the correctness of transcription--were obtained from 8 Army enlisted men (untrained in communications) transcribing word lists received at 3 signal-to-noise ratios. Confidence was expressed through the use of a five-point rating scale ranging from 'fully confident' to 'not at all confident', and a separate rating was assigned to each word in a list as it was transcribed. A significant relationship was obtained between transcriber confidence and accuracy of transcription. As expected, both mean intelligibility and mean confidence ratings increased as a direct function of signal-to-noise ratio. Signal-to-noise ratio did not similarly affect the relationship between confidence and accuracy. Because of generally unpredictable and unstable listening conditions in the field, the relationship between confidence and accuracy--averaged across signal-to-noise ratios--appears to provide a stable measure which is the best practical basis for estimating transcript accuracy. Conclusion was that a positive relationship exists between transcriber confidence of correct reception and message intelligibility, even when personnel untrained in communications serve as transcribers. While far from perfect, the relationship is sufficient to warrant further research using trained communications transcribers. (Author).

Relationship of Expressed Confidence to Accuracy of Transcription by Operational Communications Personnel
Relationship of Expressed Confidence to Accuracy of Transcription by Operational Communications Personnel

Author: Eugene P. Stichman

Publisher:

Published: 1967

Total Pages: 40

ISBN-13:

DOWNLOAD EBOOK

The study sought to determine whether operational communications personnel can rate their performance in transcribing voice radio messages partially embedded in noise with sufficient precision for the ratings to have potential operational utility. Eight experienced communications operators rated their confidence in the accuracy of their reception and transcription of messages received at three signal-to-noise ratios ( -6 db, 0 db, +6 db), using a five-point rating scale. As a control, subjects also received and transcribed the messages without making ratings. Measures of transcript accuracy and expressed confidence in transcription were compared with results from a prior study in which subjects had no formal training or experience in communications or transcription. Experienced operators were highly successful in judging their own accuracy, the relationship between confidence and accuracy being r sub tet = .78. Some overconfidence at the upper end of the rating scale and underconfidence at the lower end were evident. Intelligibility improved from 20% to 88% as signal-to-noise ratio increased. The communications operators performed better than the non-communications trained subjects in the former study both in accuracy of transcription and in precision of confidence ratings. Judging the transcription did not affect the average accuracy of the transcripts in either study. In both studies, subjects tended to make effective use of less than all five points of the confidence rating scale. (Author).

Abstracts of BESRL Research Publications
Abstracts of BESRL Research Publications

Author: Emma E. Brown

Publisher:

Published: 1967

Total Pages: 62

ISBN-13:

DOWNLOAD EBOOK

BESRL Technical Research Reports are publications describing completed research studies or programs which contribute directly to the solution of Army human factors problems. The Report is generally divided into two parts--a brief general report to management and a technical supplement. BESRL Technical Research Notes are of interest primarily to technically trained research workers in the Department of Defense and in other government research agencies. Notes present technical information concerning research methodology or basic psychological knowledge growing out of the work program. BESRL Research Studies are special reports to military management, generally prepared in response to questions raised by operating agencies when early answers are needed. Research Studies may include presentations to military management, interim bases for changes in personnel operations, and bases for research decisions. Distribution is usually limited to operating agencies with a direct interest in the content. BESRL Research Memorandums are informal reports on technical research problems. Research Memorandums include the following types of content: details concerning construction of experimental instruments, fragmentary or incidental data, and methodological developments relating primarily to in-house technical operations. Limited distribution is made, primarily to personnel engaged in research for the U.S. Army Behavioral Science Research Laboratory.