Validation of PROMIS® physical function computerized adaptive tests for orthopaedic foot and ankle outcome research

Man Hung, Judith F. Baumhauer, Daniel L Latt, Charles L. Saltzman, Nelson F. Soohoo, Kenneth J. Hunt

Research output: Contribution to journalArticle

75 Citations (Scopus)

Abstract

Background: In 2012, the American Orthopaedic Foot & Ankle Society® established a national network for collecting and sharing data on treatment outcomes and improving patient care. One of the network's initiatives is to explore the use of computerized adaptive tests (CATs) for patient-level outcome reporting. Questions/purposes: We determined whether the CAT from the NIH Patient Reported Outcome Measurement Information System® (PROMIS®) Physical Function (PF) item bank provides efficient, reliable, valid, precise, and adequately covered point estimates of patients' physical function. Methods: After informed consent, 288 patients with a mean age of 51 years (range, 18-81 years) undergoing surgery for common foot and ankle problems completed a web-based questionnaire. Efficiency was determined by time for test administration. Reliability was assessed with person and item reliability estimates. Validity evaluation included content validity from expert review and construct validity measured against the PROMIS® Pain CAT and patient responses based on tradeoff perceptions. Precision was assessed by standard error of measurement (SEM) across patients' physical function levels. Instrument coverage was based on a person-item map. Results: Average time of test administration was 47 seconds. Reliability was 0.96 for person and 0.99 for item. Construct validity against the Pain CAT had an r value of -0.657 (p < 0.001). Precision had an SEM of less than 3.3 (equivalent to a Cronbach's alpha of ≥ 0.90) across a broad range of function. Concerning coverage, the ceiling effect was 0.32% and there was no floor effect. Conclusions: The PROMIS® PF CAT appears to be an excellent method for measuring outcomes for patients with foot and ankle surgery. Further validation of the PROMIS® item banks may ultimately provide a valid and reliable tool for measuring patient-reported outcomes after injuries and treatment. Level of Evidence: Level III, diagnostic study. See Instructions for Authors for a complete description of levels of evidence.

Original languageEnglish (US)
Pages (from-to)3466-3474
Number of pages9
JournalClinical Orthopaedics and Related Research
Volume471
Issue number11
DOIs
StatePublished - Nov 2013

Fingerprint

Information Systems
Ankle
Orthopedics
Foot
Outcome Assessment (Health Care)
Pain
Information Dissemination
Informed Consent
Patient Reported Outcome Measures
Patient Care
Wounds and Injuries

ASJC Scopus subject areas

  • Orthopedics and Sports Medicine

Cite this

Validation of PROMIS® physical function computerized adaptive tests for orthopaedic foot and ankle outcome research. / Hung, Man; Baumhauer, Judith F.; Latt, Daniel L; Saltzman, Charles L.; Soohoo, Nelson F.; Hunt, Kenneth J.

In: Clinical Orthopaedics and Related Research, Vol. 471, No. 11, 11.2013, p. 3466-3474.

Research output: Contribution to journalArticle

Hung, Man ; Baumhauer, Judith F. ; Latt, Daniel L ; Saltzman, Charles L. ; Soohoo, Nelson F. ; Hunt, Kenneth J. / Validation of PROMIS® physical function computerized adaptive tests for orthopaedic foot and ankle outcome research. In: Clinical Orthopaedics and Related Research. 2013 ; Vol. 471, No. 11. pp. 3466-3474.
@article{89ed0617c6a84a18801475736539b487,
title = "Validation of PROMIS{\circledR} physical function computerized adaptive tests for orthopaedic foot and ankle outcome research",
abstract = "Background: In 2012, the American Orthopaedic Foot & Ankle Society{\circledR} established a national network for collecting and sharing data on treatment outcomes and improving patient care. One of the network's initiatives is to explore the use of computerized adaptive tests (CATs) for patient-level outcome reporting. Questions/purposes: We determined whether the CAT from the NIH Patient Reported Outcome Measurement Information System{\circledR} (PROMIS{\circledR}) Physical Function (PF) item bank provides efficient, reliable, valid, precise, and adequately covered point estimates of patients' physical function. Methods: After informed consent, 288 patients with a mean age of 51 years (range, 18-81 years) undergoing surgery for common foot and ankle problems completed a web-based questionnaire. Efficiency was determined by time for test administration. Reliability was assessed with person and item reliability estimates. Validity evaluation included content validity from expert review and construct validity measured against the PROMIS{\circledR} Pain CAT and patient responses based on tradeoff perceptions. Precision was assessed by standard error of measurement (SEM) across patients' physical function levels. Instrument coverage was based on a person-item map. Results: Average time of test administration was 47 seconds. Reliability was 0.96 for person and 0.99 for item. Construct validity against the Pain CAT had an r value of -0.657 (p < 0.001). Precision had an SEM of less than 3.3 (equivalent to a Cronbach's alpha of ≥ 0.90) across a broad range of function. Concerning coverage, the ceiling effect was 0.32{\%} and there was no floor effect. Conclusions: The PROMIS{\circledR} PF CAT appears to be an excellent method for measuring outcomes for patients with foot and ankle surgery. Further validation of the PROMIS{\circledR} item banks may ultimately provide a valid and reliable tool for measuring patient-reported outcomes after injuries and treatment. Level of Evidence: Level III, diagnostic study. See Instructions for Authors for a complete description of levels of evidence.",
author = "Man Hung and Baumhauer, {Judith F.} and Latt, {Daniel L} and Saltzman, {Charles L.} and Soohoo, {Nelson F.} and Hunt, {Kenneth J.}",
year = "2013",
month = "11",
doi = "10.1007/s11999-013-3097-1",
language = "English (US)",
volume = "471",
pages = "3466--3474",
journal = "Clinical Orthopaedics and Related Research",
issn = "0009-921X",
publisher = "Springer New York",
number = "11",

}

TY - JOUR

T1 - Validation of PROMIS® physical function computerized adaptive tests for orthopaedic foot and ankle outcome research

AU - Hung, Man

AU - Baumhauer, Judith F.

AU - Latt, Daniel L

AU - Saltzman, Charles L.

AU - Soohoo, Nelson F.

AU - Hunt, Kenneth J.

PY - 2013/11

Y1 - 2013/11

N2 - Background: In 2012, the American Orthopaedic Foot & Ankle Society® established a national network for collecting and sharing data on treatment outcomes and improving patient care. One of the network's initiatives is to explore the use of computerized adaptive tests (CATs) for patient-level outcome reporting. Questions/purposes: We determined whether the CAT from the NIH Patient Reported Outcome Measurement Information System® (PROMIS®) Physical Function (PF) item bank provides efficient, reliable, valid, precise, and adequately covered point estimates of patients' physical function. Methods: After informed consent, 288 patients with a mean age of 51 years (range, 18-81 years) undergoing surgery for common foot and ankle problems completed a web-based questionnaire. Efficiency was determined by time for test administration. Reliability was assessed with person and item reliability estimates. Validity evaluation included content validity from expert review and construct validity measured against the PROMIS® Pain CAT and patient responses based on tradeoff perceptions. Precision was assessed by standard error of measurement (SEM) across patients' physical function levels. Instrument coverage was based on a person-item map. Results: Average time of test administration was 47 seconds. Reliability was 0.96 for person and 0.99 for item. Construct validity against the Pain CAT had an r value of -0.657 (p < 0.001). Precision had an SEM of less than 3.3 (equivalent to a Cronbach's alpha of ≥ 0.90) across a broad range of function. Concerning coverage, the ceiling effect was 0.32% and there was no floor effect. Conclusions: The PROMIS® PF CAT appears to be an excellent method for measuring outcomes for patients with foot and ankle surgery. Further validation of the PROMIS® item banks may ultimately provide a valid and reliable tool for measuring patient-reported outcomes after injuries and treatment. Level of Evidence: Level III, diagnostic study. See Instructions for Authors for a complete description of levels of evidence.

AB - Background: In 2012, the American Orthopaedic Foot & Ankle Society® established a national network for collecting and sharing data on treatment outcomes and improving patient care. One of the network's initiatives is to explore the use of computerized adaptive tests (CATs) for patient-level outcome reporting. Questions/purposes: We determined whether the CAT from the NIH Patient Reported Outcome Measurement Information System® (PROMIS®) Physical Function (PF) item bank provides efficient, reliable, valid, precise, and adequately covered point estimates of patients' physical function. Methods: After informed consent, 288 patients with a mean age of 51 years (range, 18-81 years) undergoing surgery for common foot and ankle problems completed a web-based questionnaire. Efficiency was determined by time for test administration. Reliability was assessed with person and item reliability estimates. Validity evaluation included content validity from expert review and construct validity measured against the PROMIS® Pain CAT and patient responses based on tradeoff perceptions. Precision was assessed by standard error of measurement (SEM) across patients' physical function levels. Instrument coverage was based on a person-item map. Results: Average time of test administration was 47 seconds. Reliability was 0.96 for person and 0.99 for item. Construct validity against the Pain CAT had an r value of -0.657 (p < 0.001). Precision had an SEM of less than 3.3 (equivalent to a Cronbach's alpha of ≥ 0.90) across a broad range of function. Concerning coverage, the ceiling effect was 0.32% and there was no floor effect. Conclusions: The PROMIS® PF CAT appears to be an excellent method for measuring outcomes for patients with foot and ankle surgery. Further validation of the PROMIS® item banks may ultimately provide a valid and reliable tool for measuring patient-reported outcomes after injuries and treatment. Level of Evidence: Level III, diagnostic study. See Instructions for Authors for a complete description of levels of evidence.

UR - http://www.scopus.com/inward/record.url?scp=84886905846&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84886905846&partnerID=8YFLogxK

U2 - 10.1007/s11999-013-3097-1

DO - 10.1007/s11999-013-3097-1

M3 - Article

VL - 471

SP - 3466

EP - 3474

JO - Clinical Orthopaedics and Related Research

JF - Clinical Orthopaedics and Related Research

SN - 0009-921X

IS - 11

ER -