TY - JOUR
T1 - The design of observer agreement studies with binary assessments
AU - Freedman, Laurence S.
AU - Parmar, Mahesh K.B.
AU - Baker, Stuart G.
PY - 1993/1/30
Y1 - 1993/1/30
N2 - We discuss the design of observer agreement studies with binary assessments, with particular emphasis on the need for adequate sample size and the use of replicate observations. First, we present a method and tables for determining the sample size required for ensuring a desired precision for the estimate of the probability of disagreement between two observers. Second, for studies including replicate observations, we present a statistical model that allows estimation of the magnitude of within‐ and between‐observer variation. We then derive sample sizes guaranteeing a specified precision for these estimates, present tables of these sample sizes and give examples of their use.
AB - We discuss the design of observer agreement studies with binary assessments, with particular emphasis on the need for adequate sample size and the use of replicate observations. First, we present a method and tables for determining the sample size required for ensuring a desired precision for the estimate of the probability of disagreement between two observers. Second, for studies including replicate observations, we present a statistical model that allows estimation of the magnitude of within‐ and between‐observer variation. We then derive sample sizes guaranteeing a specified precision for these estimates, present tables of these sample sizes and give examples of their use.
UR - http://www.scopus.com/inward/record.url?scp=0027401841&partnerID=8YFLogxK
U2 - 10.1002/sim.4780120208
DO - 10.1002/sim.4780120208
M3 - ???researchoutput.researchoutputtypes.contributiontojournal.article???
C2 - 8446811
AN - SCOPUS:0027401841
SN - 0277-6715
VL - 12
SP - 165
EP - 179
JO - Statistics in Medicine
JF - Statistics in Medicine
IS - 2
ER -