Different thresholds for detecting osteophytes and joint space narrowing exist between the site investigators and the centralized reader in a multicenter knee osteoarthritis study-data from the Osteoarthritis Initiative

Ali Guermazi, David J. Hunter, Ling Li, Olivier Benichou, Felix Eckstein, Chian K Kwoh, Michael Nevitt, Daichi Hayashi

Research output: Contribution to journalArticle

33 Citations (Scopus)

Abstract

Objective: To evaluate how the reading of knee radiographs by site investigators differs from that by an expert musculoskeletal radiologist who trained and validated them in a multicenter knee osteoarthritis (OA) study. Materials and methods: A subset of participants from the Osteoarthritis Initiative progression cohort was studied. Osteophytes and joint space narrowing (JSN) were evaluated using Kellgren-Lawrence (KL) and Osteoarthritis Research Society International (OARSI) grading. Radiographs were read by site investigators, who received training and validation of their competence by an expert musculoskeletal radiologist. Radiographs were re-read by this radiologist, who acted as a central reader. For KL and OARSI grading of osteophytes, discrepancies between two readings were adjudicated by another expert reader. Results: Radiographs from 96 subjects (49 women) and 192 knees (138 KL grade ≥ 2) were included. The site reading showed moderate agreement for KL grading overall (kappa = 0.52) and for KL ≥ 2 (i.e., radiographic diagnosis of "definite OA"; kappa = 0.41). For OARSI grading, the site reading showed substantial agreement for lateral and medial JSN (kappa = 0.65 and 0.71), but only fair agreement for osteophytes (kappa = 0.37). For KL grading, the adjudicator's reading showed substantial agreement with the centralized reading (kappa = 0.62), but only slight agreement with the site reading (kappa = 0.10). Conclusion: Site investigators over-graded osteophytes compared to the central reader and the adjudicator. Different thresholds for scoring of JSN exist even between experts. Our results suggest that research studies using radiographic grading of OA should use a centralized reader for all grading.

Original languageEnglish (US)
Pages (from-to)179-186
Number of pages8
JournalSkeletal Radiology
Volume41
Issue number2
DOIs
StatePublished - Feb 2012
Externally publishedYes

Fingerprint

Osteophyte
Knee Osteoarthritis
Osteoarthritis
Reading
Joints
Research Personnel
Knee
Research
Mental Competency

Keywords

  • Centralized reading
  • Knee
  • Osteoarthritis
  • Radiography
  • X-ray

ASJC Scopus subject areas

  • Radiology Nuclear Medicine and imaging

Cite this

Different thresholds for detecting osteophytes and joint space narrowing exist between the site investigators and the centralized reader in a multicenter knee osteoarthritis study-data from the Osteoarthritis Initiative. / Guermazi, Ali; Hunter, David J.; Li, Ling; Benichou, Olivier; Eckstein, Felix; Kwoh, Chian K; Nevitt, Michael; Hayashi, Daichi.

In: Skeletal Radiology, Vol. 41, No. 2, 02.2012, p. 179-186.

Research output: Contribution to journalArticle

@article{51c0cfd42afd47df8de7cb326999d5c9,
title = "Different thresholds for detecting osteophytes and joint space narrowing exist between the site investigators and the centralized reader in a multicenter knee osteoarthritis study-data from the Osteoarthritis Initiative",
abstract = "Objective: To evaluate how the reading of knee radiographs by site investigators differs from that by an expert musculoskeletal radiologist who trained and validated them in a multicenter knee osteoarthritis (OA) study. Materials and methods: A subset of participants from the Osteoarthritis Initiative progression cohort was studied. Osteophytes and joint space narrowing (JSN) were evaluated using Kellgren-Lawrence (KL) and Osteoarthritis Research Society International (OARSI) grading. Radiographs were read by site investigators, who received training and validation of their competence by an expert musculoskeletal radiologist. Radiographs were re-read by this radiologist, who acted as a central reader. For KL and OARSI grading of osteophytes, discrepancies between two readings were adjudicated by another expert reader. Results: Radiographs from 96 subjects (49 women) and 192 knees (138 KL grade ≥ 2) were included. The site reading showed moderate agreement for KL grading overall (kappa = 0.52) and for KL ≥ 2 (i.e., radiographic diagnosis of {"}definite OA{"}; kappa = 0.41). For OARSI grading, the site reading showed substantial agreement for lateral and medial JSN (kappa = 0.65 and 0.71), but only fair agreement for osteophytes (kappa = 0.37). For KL grading, the adjudicator's reading showed substantial agreement with the centralized reading (kappa = 0.62), but only slight agreement with the site reading (kappa = 0.10). Conclusion: Site investigators over-graded osteophytes compared to the central reader and the adjudicator. Different thresholds for scoring of JSN exist even between experts. Our results suggest that research studies using radiographic grading of OA should use a centralized reader for all grading.",
keywords = "Centralized reading, Knee, Osteoarthritis, Radiography, X-ray",
author = "Ali Guermazi and Hunter, {David J.} and Ling Li and Olivier Benichou and Felix Eckstein and Kwoh, {Chian K} and Michael Nevitt and Daichi Hayashi",
year = "2012",
month = "2",
doi = "10.1007/s00256-011-1142-2",
language = "English (US)",
volume = "41",
pages = "179--186",
journal = "Skeletal Radiology",
issn = "0364-2348",
publisher = "Springer Verlag",
number = "2",

}

TY - JOUR

T1 - Different thresholds for detecting osteophytes and joint space narrowing exist between the site investigators and the centralized reader in a multicenter knee osteoarthritis study-data from the Osteoarthritis Initiative

AU - Guermazi, Ali

AU - Hunter, David J.

AU - Li, Ling

AU - Benichou, Olivier

AU - Eckstein, Felix

AU - Kwoh, Chian K

AU - Nevitt, Michael

AU - Hayashi, Daichi

PY - 2012/2

Y1 - 2012/2

N2 - Objective: To evaluate how the reading of knee radiographs by site investigators differs from that by an expert musculoskeletal radiologist who trained and validated them in a multicenter knee osteoarthritis (OA) study. Materials and methods: A subset of participants from the Osteoarthritis Initiative progression cohort was studied. Osteophytes and joint space narrowing (JSN) were evaluated using Kellgren-Lawrence (KL) and Osteoarthritis Research Society International (OARSI) grading. Radiographs were read by site investigators, who received training and validation of their competence by an expert musculoskeletal radiologist. Radiographs were re-read by this radiologist, who acted as a central reader. For KL and OARSI grading of osteophytes, discrepancies between two readings were adjudicated by another expert reader. Results: Radiographs from 96 subjects (49 women) and 192 knees (138 KL grade ≥ 2) were included. The site reading showed moderate agreement for KL grading overall (kappa = 0.52) and for KL ≥ 2 (i.e., radiographic diagnosis of "definite OA"; kappa = 0.41). For OARSI grading, the site reading showed substantial agreement for lateral and medial JSN (kappa = 0.65 and 0.71), but only fair agreement for osteophytes (kappa = 0.37). For KL grading, the adjudicator's reading showed substantial agreement with the centralized reading (kappa = 0.62), but only slight agreement with the site reading (kappa = 0.10). Conclusion: Site investigators over-graded osteophytes compared to the central reader and the adjudicator. Different thresholds for scoring of JSN exist even between experts. Our results suggest that research studies using radiographic grading of OA should use a centralized reader for all grading.

AB - Objective: To evaluate how the reading of knee radiographs by site investigators differs from that by an expert musculoskeletal radiologist who trained and validated them in a multicenter knee osteoarthritis (OA) study. Materials and methods: A subset of participants from the Osteoarthritis Initiative progression cohort was studied. Osteophytes and joint space narrowing (JSN) were evaluated using Kellgren-Lawrence (KL) and Osteoarthritis Research Society International (OARSI) grading. Radiographs were read by site investigators, who received training and validation of their competence by an expert musculoskeletal radiologist. Radiographs were re-read by this radiologist, who acted as a central reader. For KL and OARSI grading of osteophytes, discrepancies between two readings were adjudicated by another expert reader. Results: Radiographs from 96 subjects (49 women) and 192 knees (138 KL grade ≥ 2) were included. The site reading showed moderate agreement for KL grading overall (kappa = 0.52) and for KL ≥ 2 (i.e., radiographic diagnosis of "definite OA"; kappa = 0.41). For OARSI grading, the site reading showed substantial agreement for lateral and medial JSN (kappa = 0.65 and 0.71), but only fair agreement for osteophytes (kappa = 0.37). For KL grading, the adjudicator's reading showed substantial agreement with the centralized reading (kappa = 0.62), but only slight agreement with the site reading (kappa = 0.10). Conclusion: Site investigators over-graded osteophytes compared to the central reader and the adjudicator. Different thresholds for scoring of JSN exist even between experts. Our results suggest that research studies using radiographic grading of OA should use a centralized reader for all grading.

KW - Centralized reading

KW - Knee

KW - Osteoarthritis

KW - Radiography

KW - X-ray

UR - http://www.scopus.com/inward/record.url?scp=84856960934&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84856960934&partnerID=8YFLogxK

U2 - 10.1007/s00256-011-1142-2

DO - 10.1007/s00256-011-1142-2

M3 - Article

VL - 41

SP - 179

EP - 186

JO - Skeletal Radiology

JF - Skeletal Radiology

SN - 0364-2348

IS - 2

ER -