Journalism and Mass Communication Quarterly, volume 73, issue 4, pages 963-973

Sampling Error and Selecting Intercoder Reliability Samples for Nominal Content Categories

Stephen Lacy ¹

Daniel Riffe ²

Show full list: 2 authors

Hide authors affiliations Show authors affiliations: 2 affiliations

Michigan State University School of Journalism |

E. W. Scripps School of Journalism at Ohio University. The authors thank Fred Fico for his comments and suggestions |

Publication type: Journal Article

Publication date: 1996-12-01

SAGE

Journal: Journalism and Mass Communication Quarterly

scimago Q1

SJR: 1.603

CiteScore: 7.2

Impact factor: 3.4

ISSN: 10776990, 2161430X

DOI: 10.1177/107769909607300414

Copy DOI

Communication

Abstract

This study views intercoder reliability as a sampling problem. It develops a formula for generating sample sizes needed to have valid reliability estimates. It also suggests steps for reporting reliability. The resulting sample sizes will permit a known degree of confidence that the agreement in a sample of items is representative of the pattern that would occur if all content items were coded by all coders.

Found 0

Clear filter

By date By citations

Top-30

Journals

	1 2 3 4
Computers in Human Behavior	Computers in Human Behavior, 4, 2.9% Computers in Human Behavior 4 publications, 2.9%
International Communication Gazette	International Communication Gazette, 3, 2.17% International Communication Gazette 3 publications, 2.17%
Policy Studies Journal	Policy Studies Journal, 3, 2.17% Policy Studies Journal 3 publications, 2.17%
Journal of Health Communication	Journal of Health Communication, 3, 2.17% Journal of Health Communication 3 publications, 2.17%
Journal of Medical Internet Research	Journal of Medical Internet Research, 2, 1.45% Journal of Medical Internet Research 2 publications, 1.45%
Gazette (Leiden, Netherlands)	Gazette (Leiden, Netherlands), 2, 1.45% Gazette (Leiden, Netherlands) 2 publications, 1.45%
SAGE Open	SAGE Open, 2, 1.45% SAGE Open 2 publications, 1.45%
Journalism and Mass Communication Quarterly	Journalism and Mass Communication Quarterly, 2, 1.45% Journalism and Mass Communication Quarterly 2 publications, 1.45%
Newspaper Research Journal	Newspaper Research Journal, 2, 1.45% Newspaper Research Journal 2 publications, 1.45%
International Journal of Environmental Research and Public Health	International Journal of Environmental Research and Public Health, 2, 1.45% International Journal of Environmental Research and Public Health 2 publications, 1.45%
Frontiers in Psychology	Frontiers in Psychology, 2, 1.45% Frontiers in Psychology 2 publications, 1.45%
Journal of Current Issues and Research in Advertising	Journal of Current Issues and Research in Advertising, 2, 1.45% Journal of Current Issues and Research in Advertising 2 publications, 1.45%
Asian Journal of Communication	Asian Journal of Communication, 2, 1.45% Asian Journal of Communication 2 publications, 1.45%
Cogent Social Sciences	Cogent Social Sciences, 2, 1.45% Cogent Social Sciences 2 publications, 1.45%
Environmental Communication	Environmental Communication, 2, 1.45% Environmental Communication 2 publications, 1.45%
Mass Communication and Society	Mass Communication and Society, 2, 1.45% Mass Communication and Society 2 publications, 1.45%
Academy of Management Journal	Academy of Management Journal, 1, 0.72% Academy of Management Journal 1 publication, 0.72%
Journal of Communication Management	Journal of Communication Management, 1, 0.72% Journal of Communication Management 1 publication, 0.72%
Internet Research	Internet Research, 1, 0.72% Internet Research 1 publication, 0.72%
Journal of Human Resource Costing & Accounting	Journal of Human Resource Costing & Accounting, 1, 0.72% Journal of Human Resource Costing & Accounting 1 publication, 0.72%
International Journal of Contemporary Hospitality Management	International Journal of Contemporary Hospitality Management, 1, 0.72% International Journal of Contemporary Hospitality Management 1 publication, 0.72%
Journal of Intellectual Capital	Journal of Intellectual Capital, 1, 0.72% Journal of Intellectual Capital 1 publication, 0.72%
Journal of Hospitality and Tourism Insights	Journal of Hospitality and Tourism Insights, 1, 0.72% Journal of Hospitality and Tourism Insights 1 publication, 0.72%
Journal of Documentation	Journal of Documentation, 1, 0.72% Journal of Documentation 1 publication, 0.72%
International Journal of E-Politics	International Journal of E-Politics, 1, 0.72% International Journal of E-Politics 1 publication, 0.72%
International Journal of Virtual and Personal Learning Environments	International Journal of Virtual and Personal Learning Environments, 1, 0.72% International Journal of Virtual and Personal Learning Environments 1 publication, 0.72%
American Journal of Public Health	American Journal of Public Health, 1, 0.72% American Journal of Public Health 1 publication, 0.72%
Journal of Travel Research	Journal of Travel Research, 1, 0.72% Journal of Travel Research 1 publication, 0.72%
Science Communication	Science Communication, 1, 0.72% Science Communication 1 publication, 0.72%
	1 2 3 4

Publishers

	5 10 15 20 25 30 35
Taylor & Francis	Taylor & Francis, 34, 24.64% Taylor & Francis 34 publications, 24.64%
SAGE	SAGE, 26, 18.84% SAGE 26 publications, 18.84%
Elsevier	Elsevier, 17, 12.32% Elsevier 17 publications, 12.32%
Springer Nature	Springer Nature, 10, 7.25% Springer Nature 10 publications, 7.25%
Wiley	Wiley, 10, 7.25% Wiley 10 publications, 7.25%
Emerald	Emerald, 8, 5.8% Emerald 8 publications, 5.8%
Oxford University Press	Oxford University Press, 5, 3.62% Oxford University Press 5 publications, 3.62%
IGI Global	IGI Global, 3, 2.17% IGI Global 3 publications, 2.17%
JMIR Publications	JMIR Publications, 3, 2.17% JMIR Publications 3 publications, 2.17%
MDPI	MDPI, 3, 2.17% MDPI 3 publications, 2.17%
Cambridge University Press	Cambridge University Press, 2, 1.45% Cambridge University Press 2 publications, 1.45%
Frontiers Media S.A.	Frontiers Media S.A., 2, 1.45% Frontiers Media S.A. 2 publications, 1.45%
Institute of Electrical and Electronics Engineers (IEEE)	Institute of Electrical and Electronics Engineers (IEEE), 2, 1.45% Institute of Electrical and Electronics Engineers (IEEE) 2 publications, 1.45%
Association for Computing Machinery (ACM)	Association for Computing Machinery (ACM), 2, 1.45% Association for Computing Machinery (ACM) 2 publications, 1.45%
Academy of Management	Academy of Management, 1, 0.72% Academy of Management 1 publication, 0.72%
American Public Health Association	American Public Health Association, 1, 0.72% American Public Health Association 1 publication, 0.72%
Diabetes Technology Society	Diabetes Technology Society, 1, 0.72% Diabetes Technology Society 1 publication, 0.72%
Walter de Gruyter	Walter de Gruyter, 1, 0.72% Walter de Gruyter 1 publication, 0.72%
American Educational Research Association	American Educational Research Association, 1, 0.72% American Educational Research Association 1 publication, 0.72%
BMJ	BMJ, 1, 0.72% BMJ 1 publication, 0.72%
Cold Spring Harbor Laboratory	Cold Spring Harbor Laboratory, 1, 0.72% Cold Spring Harbor Laboratory 1 publication, 0.72%
Bristol University Press	Bristol University Press, 1, 0.72% Bristol University Press 1 publication, 0.72%
	5 10 15 20 25 30 35

We do not take into account publications without a DOI.
Statistics recalculated only for publications connected to researchers, organizations and labs registered on the platform.
Statistics recalculated weekly.

Are you a researcher?

Create a profile to get free access to personal recommendations for colleagues and new articles.

Metrics

n/a Field Citation Ratio

n/a Relative Citation Ratio

Cite this

GOST |

Cite this

GOST Copy

Lacy S., Riffe D. Sampling Error and Selecting Intercoder Reliability Samples for Nominal Content Categories // Journalism and Mass Communication Quarterly. 1996. Vol. 73. No. 4. pp. 963-973.

GOST all authors (up to 50) Copy

Lacy S., Riffe D. Sampling Error and Selecting Intercoder Reliability Samples for Nominal Content Categories // Journalism and Mass Communication Quarterly. 1996. Vol. 73. No. 4. pp. 963-973.

RIS |

Cite this

RIS Copy

TY - JOUR

DO - 10.1177/107769909607300414

UR - https://doi.org/10.1177/107769909607300414

TI - Sampling Error and Selecting Intercoder Reliability Samples for Nominal Content Categories

T2 - Journalism and Mass Communication Quarterly

AU - Lacy, Stephen

AU - Riffe, Daniel

PY - 1996

DA - 1996/12/01

PB - SAGE

SP - 963-973

IS - 4

VL - 73

SN - 1077-6990

SN - 2161-430X

ER -

BibTex |

Cite this

BibTex (up to 50 authors) Copy

@article{1996_Lacy,

author = {Stephen Lacy and Daniel Riffe},

title = {Sampling Error and Selecting Intercoder Reliability Samples for Nominal Content Categories},

journal = {Journalism and Mass Communication Quarterly},

year = {1996},

volume = {73},

publisher = {SAGE},

month = {dec},

url = {https://doi.org/10.1177/107769909607300414},

number = {4},

pages = {963--973},

doi = {10.1177/107769909607300414}

}

MLA

Cite this

MLA Copy

Lacy, Stephen, and Daniel Riffe. “Sampling Error and Selecting Intercoder Reliability Samples for Nominal Content Categories.” Journalism and Mass Communication Quarterly, vol. 73, no. 4, Dec. 1996, pp. 963-973. https://doi.org/10.1177/107769909607300414.

Found error?

Message

Support chat

Publisher

SAGE

Journal

Journalism and Mass Communication Quarterly

scimago Q1

SJR

1.603

CiteScore

7.2

Impact factor

3.4

ISSN

10776990 (Print)

2161430X (Electronic)