Using replicate observations in observer agreement studies with binary assessments

S. G. Baker; L. S. Freedman; M. K.B. Parmar

doi:10.2307/2532389

Using replicate observations in observer agreement studies with binary assessments

S. G. Baker, L. S. Freedman, M. K.B. Parmar

National Institutes of Health

Research output: Contribution to journal › Article › peer-review

29 Scopus citations

Abstract

By introducing replicate observations into observer agreement studies, one can obtain better measures of observer agreement than heretofore possible. New methodology based on the analysis of latent variables allows a separation of within- and between-observer variation for binary measures of assessment among pairs of observers. Maximum likelihood estimation and hypothesis testing are discussed. The methodology is illustrated using data on the assessment of dysplasia by pathologists.

Original language	English
Pages (from-to)	1327-1338
Number of pages	12
Journal	Biometrics
Volume	47
Issue number	4
DOIs	https://doi.org/10.2307/2532389
State	Published - Dec 1991
Externally published	Yes

Bibliographical note

Funding Information:
This work was supported by the AFOSR under the atmospheric science project 2310 and performed as part of ABGL Task 2310G1, and has the ESD clearance # 85-369 dated 6 May 1985.

Funding

This work was supported by the AFOSR under the atmospheric science project 2310 and performed as part of ABGL Task 2310G1, and has the ESD clearance # 85-369 dated 6 May 1985.

Funders	Funder number
Air Force Office of Scientific Research	2310G1, 2310
Empire State Development	85-369

Access to Document

10.2307/2532389

Cite this

@article{bfad2598609d471b88f4be95b94b2547,

title = "Using replicate observations in observer agreement studies with binary assessments",

abstract = "By introducing replicate observations into observer agreement studies, one can obtain better measures of observer agreement than heretofore possible. New methodology based on the analysis of latent variables allows a separation of within- and between-observer variation for binary measures of assessment among pairs of observers. Maximum likelihood estimation and hypothesis testing are discussed. The methodology is illustrated using data on the assessment of dysplasia by pathologists.",

author = "Baker, {S. G.} and Freedman, {L. S.} and Parmar, {M. K.B.}",

note = "Funding Information: This work was supported by the AFOSR under the atmospheric science project 2310 and performed as part of ABGL Task 2310G1, and has the ESD clearance # 85-369 dated 6 May 1985.",

year = "1991",

month = dec,

doi = "10.2307/2532389",

language = "אנגלית",

volume = "47",

pages = "1327--1338",

journal = "Biometrics",

issn = "0006-341X",

publisher = "Oxford University Press",

number = "4",

}

TY - JOUR

T1 - Using replicate observations in observer agreement studies with binary assessments

AU - Baker, S. G.

AU - Freedman, L. S.

AU - Parmar, M. K.B.

N1 - Funding Information: This work was supported by the AFOSR under the atmospheric science project 2310 and performed as part of ABGL Task 2310G1, and has the ESD clearance # 85-369 dated 6 May 1985.

PY - 1991/12

Y1 - 1991/12

N2 - By introducing replicate observations into observer agreement studies, one can obtain better measures of observer agreement than heretofore possible. New methodology based on the analysis of latent variables allows a separation of within- and between-observer variation for binary measures of assessment among pairs of observers. Maximum likelihood estimation and hypothesis testing are discussed. The methodology is illustrated using data on the assessment of dysplasia by pathologists.

AB - By introducing replicate observations into observer agreement studies, one can obtain better measures of observer agreement than heretofore possible. New methodology based on the analysis of latent variables allows a separation of within- and between-observer variation for binary measures of assessment among pairs of observers. Maximum likelihood estimation and hypothesis testing are discussed. The methodology is illustrated using data on the assessment of dysplasia by pathologists.

UR - http://www.scopus.com/inward/record.url?scp=0026340544&partnerID=8YFLogxK

U2 - 10.2307/2532389

DO - 10.2307/2532389

M3 - ???researchoutput.researchoutputtypes.contributiontojournal.article???

C2 - 1786322

AN - SCOPUS:0026340544

SN - 0006-341X

VL - 47

SP - 1327

EP - 1338

JO - Biometrics

JF - Biometrics

IS - 4

ER -

Using replicate observations in observer agreement studies with binary assessments

Abstract

Bibliographical note

Funding

Access to Document

Other files and links

Fingerprint

Cite this