Abstract
In many research activities, the data is unordered or qualitative. In such circumstances, inter-rater reliability is usually measured by calculating a percentage of agreement score between judges. The present paper expands on an equation first introduced by Goodman and Kruskal for obtaining a reliability measure of one item. This formula determines inter-rater reliability for a series of items across many subjects. The statistic that results is easily interpreted and in many ways is analogous to the conventional reliability for quantitative data.
| Original language | English |
|---|---|
| Pages (from-to) | 843-846 |
| Number of pages | 4 |
| Journal | Educational and Psychological Measurement |
| Volume | 35 |
| Issue number | 4 |
| DOIs | |
| State | Published - Dec 1975 |
| Externally published | Yes |
Bibliographical note
Funding Information:1 This work was supported, in part, by Contract NIH-72-4207 from the Division of Dental Health, National Institutes of Health, Public Health Service. The authors would like to thank Paula Valluzzo and Paula Atwood for their help in collecting the data.
Funding
1 This work was supported, in part, by Contract NIH-72-4207 from the Division of Dental Health, National Institutes of Health, Public Health Service. The authors would like to thank Paula Valluzzo and Paula Atwood for their help in collecting the data.
| Funders |
|---|
| Division of Dental Health |
| National Institutes of Health |
| U.S. Public Health Service |
Fingerprint
Dive into the research topics of 'A measure of reliability using qualitative data'. Together they form a unique fingerprint.Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver