The design of observer agreement studies with binary assessments

Laurence S. Freedman, Mahesh K.B. Parmar, Stuart G. Baker

Research output: Contribution to journalArticlepeer-review

23 Scopus citations

Abstract

We discuss the design of observer agreement studies with binary assessments, with particular emphasis on the need for adequate sample size and the use of replicate observations. First, we present a method and tables for determining the sample size required for ensuring a desired precision for the estimate of the probability of disagreement between two observers. Second, for studies including replicate observations, we present a statistical model that allows estimation of the magnitude of within‐ and between‐observer variation. We then derive sample sizes guaranteeing a specified precision for these estimates, present tables of these sample sizes and give examples of their use.

Original languageEnglish
Pages (from-to)165-179
Number of pages15
JournalStatistics in Medicine
Volume12
Issue number2
DOIs
StatePublished - 30 Jan 1993
Externally publishedYes

Fingerprint

Dive into the research topics of 'The design of observer agreement studies with binary assessments'. Together they form a unique fingerprint.

Cite this