The LINGUIST List is dedicated to providing information on language and language analysis, and to providing the discipline of linguistics with the infrastructure necessary to function in the digital world. LINGUIST is a free resource, run by linguistics students and faculty, and supported by your donations. Please support LINGUIST List during the 2017 Fund Drive.
Ask-A-Linguist Message Details
|Subject:||How to measure the reliability of transcription?|
|Question:||As I've read some articles mostly in Phonetics saying that they use three transcribers for transcription of their studies, and they claim the reliability for the transcription like 80 to 90% of correctness of transcription. I would like to ask you how they know that it's 80% or 90%. What the method they use to measure this percentage?|
|Reply:||The method is sometimes called ‘independent verification’. The accuracy of each phonetic transcription is verified against the others. The percentages that you mention refer to the matches between each transcription, that is, to where the different transcriptions are identical. When different transcribers are unavailable, for example in transcription of multilingual speech where speakers of all the languages in question cannot be found, one other way of ensuring accuracy is to have the same transcriber repeat the transcriptions after a certain period of time, and then look for matches between those transcriptions in the same way. Madalena|
|Reply From:||Madalena Cruz-Ferreira click here to access email|