Developing a patient-centered outcome measure for complementary and alternative medicine therapies I: Defining content and format

Cheryl Ritenbaugh, Mimi Nichter, Mark Nichter, Kimberly L Kelly, Colette M. Sims, Iris R. Bell, Heide M. Castañeda, Charles R. Elder, Mary S Koithan, Elizabeth G. Sutherland, Marja J. Verhoef, Sarah L. Warber, Stephen J. Coons

Research output: Contribution to journalArticle

22 Citations (Scopus)

Abstract

Background: Patients receiving complementary and alternative medicine (CAM) therapies often report shifts in well-being that go beyond resolution of the original presenting symptoms. We undertook a research program to develop and evaluate a patient-centered outcome measure to assess the multidimensional impacts of CAM therapies, utilizing a novel mixed methods approach that relied upon techniques from the fields of anthropology and psychometrics. This tool would have broad applicability, both for CAM practitioners to measure shifts in patients' states following treatments, and conventional clinical trial researchers needing validated outcome measures. The US Food and Drug Administration has highlighted the importance of valid and reliable measurement of patient-reported outcomes in the evaluation of conventional medical products. Here we describe Phase I of our research program, the iterative process of content identification, item development and refinement, and response format selection. Cognitive interviews and psychometric evaluation are reported separately.Methods: From a database of patient interviews (n = 177) from six diverse CAM studies, 150 interviews were identified for secondary analysis in which individuals spontaneously discussed unexpected changes associated with CAM. Using ATLAS.ti, we identified common themes and language to inform questionnaire item content and wording. Respondents' language was often richly textured, but item development required a stripping down of language to extract essential meaning and minimize potential comprehension barriers across populations. Through an evocative card sort interview process, we identified those items most widely applicable and covering standard psychometric domains. We developed, pilot-tested, and refined the format, yielding a questionnaire for cognitive interviews and psychometric evaluation.Results: The resulting questionnaire contained 18 items, in visual analog scale format, in which each line was anchored by the positive and negative extremes relevant to the experiential domain. Because of frequent informant allusions to response set shifts from before to after CAM therapies, we chose a retrospective pretest format. Items cover physical, emotional, cognitive, social, spiritual, and whole person domains.Conclusions: This paper reports the success of a novel approach to the development of outcome instruments, in which items are extracted from patients' words instead of being distilled from pre-existing theory. The resulting instrument, focused on measuring shifts in patients' perceptions of health and well-being along pre-specified axes, is undergoing continued testing, and is available for use by cooperating investigators.

Original languageEnglish (US)
Article number135
JournalBMC Complementary and Alternative Medicine
Volume11
DOIs
StatePublished - Dec 29 2011

Fingerprint

Complementary Therapies
Outcome Assessment (Health Care)
Psychometrics
Interviews
Language
Research Personnel
Anthropology
United States Food and Drug Administration
Visual Analog Scale
Research

Keywords

  • Complementary and alternative medicine (CAM)
  • Non-specific outcomes
  • Patient-centered care
  • Patient-reported outcomes (PROs)
  • Questionnaire development
  • Retrospective pre-test
  • Well-being

ASJC Scopus subject areas

  • Complementary and alternative medicine

Cite this

Developing a patient-centered outcome measure for complementary and alternative medicine therapies I : Defining content and format. / Ritenbaugh, Cheryl; Nichter, Mimi; Nichter, Mark; Kelly, Kimberly L; Sims, Colette M.; Bell, Iris R.; Castañeda, Heide M.; Elder, Charles R.; Koithan, Mary S; Sutherland, Elizabeth G.; Verhoef, Marja J.; Warber, Sarah L.; Coons, Stephen J.

In: BMC Complementary and Alternative Medicine, Vol. 11, 135, 29.12.2011.

Research output: Contribution to journalArticle

Ritenbaugh, Cheryl ; Nichter, Mimi ; Nichter, Mark ; Kelly, Kimberly L ; Sims, Colette M. ; Bell, Iris R. ; Castañeda, Heide M. ; Elder, Charles R. ; Koithan, Mary S ; Sutherland, Elizabeth G. ; Verhoef, Marja J. ; Warber, Sarah L. ; Coons, Stephen J. / Developing a patient-centered outcome measure for complementary and alternative medicine therapies I : Defining content and format. In: BMC Complementary and Alternative Medicine. 2011 ; Vol. 11.
@article{bdffdedd7e6d44e18762bdcbc49a58b6,
title = "Developing a patient-centered outcome measure for complementary and alternative medicine therapies I: Defining content and format",
abstract = "Background: Patients receiving complementary and alternative medicine (CAM) therapies often report shifts in well-being that go beyond resolution of the original presenting symptoms. We undertook a research program to develop and evaluate a patient-centered outcome measure to assess the multidimensional impacts of CAM therapies, utilizing a novel mixed methods approach that relied upon techniques from the fields of anthropology and psychometrics. This tool would have broad applicability, both for CAM practitioners to measure shifts in patients' states following treatments, and conventional clinical trial researchers needing validated outcome measures. The US Food and Drug Administration has highlighted the importance of valid and reliable measurement of patient-reported outcomes in the evaluation of conventional medical products. Here we describe Phase I of our research program, the iterative process of content identification, item development and refinement, and response format selection. Cognitive interviews and psychometric evaluation are reported separately.Methods: From a database of patient interviews (n = 177) from six diverse CAM studies, 150 interviews were identified for secondary analysis in which individuals spontaneously discussed unexpected changes associated with CAM. Using ATLAS.ti, we identified common themes and language to inform questionnaire item content and wording. Respondents' language was often richly textured, but item development required a stripping down of language to extract essential meaning and minimize potential comprehension barriers across populations. Through an evocative card sort interview process, we identified those items most widely applicable and covering standard psychometric domains. We developed, pilot-tested, and refined the format, yielding a questionnaire for cognitive interviews and psychometric evaluation.Results: The resulting questionnaire contained 18 items, in visual analog scale format, in which each line was anchored by the positive and negative extremes relevant to the experiential domain. Because of frequent informant allusions to response set shifts from before to after CAM therapies, we chose a retrospective pretest format. Items cover physical, emotional, cognitive, social, spiritual, and whole person domains.Conclusions: This paper reports the success of a novel approach to the development of outcome instruments, in which items are extracted from patients' words instead of being distilled from pre-existing theory. The resulting instrument, focused on measuring shifts in patients' perceptions of health and well-being along pre-specified axes, is undergoing continued testing, and is available for use by cooperating investigators.",
keywords = "Complementary and alternative medicine (CAM), Non-specific outcomes, Patient-centered care, Patient-reported outcomes (PROs), Questionnaire development, Retrospective pre-test, Well-being",
author = "Cheryl Ritenbaugh and Mimi Nichter and Mark Nichter and Kelly, {Kimberly L} and Sims, {Colette M.} and Bell, {Iris R.} and Casta{\~n}eda, {Heide M.} and Elder, {Charles R.} and Koithan, {Mary S} and Sutherland, {Elizabeth G.} and Verhoef, {Marja J.} and Warber, {Sarah L.} and Coons, {Stephen J.}",
year = "2011",
month = "12",
day = "29",
doi = "10.1186/1472-6882-11-135",
language = "English (US)",
volume = "11",
journal = "BMC Complementary and Alternative Medicine",
issn = "1472-6882",
publisher = "BioMed Central",

}

TY - JOUR

T1 - Developing a patient-centered outcome measure for complementary and alternative medicine therapies I

T2 - Defining content and format

AU - Ritenbaugh, Cheryl

AU - Nichter, Mimi

AU - Nichter, Mark

AU - Kelly, Kimberly L

AU - Sims, Colette M.

AU - Bell, Iris R.

AU - Castañeda, Heide M.

AU - Elder, Charles R.

AU - Koithan, Mary S

AU - Sutherland, Elizabeth G.

AU - Verhoef, Marja J.

AU - Warber, Sarah L.

AU - Coons, Stephen J.

PY - 2011/12/29

Y1 - 2011/12/29

N2 - Background: Patients receiving complementary and alternative medicine (CAM) therapies often report shifts in well-being that go beyond resolution of the original presenting symptoms. We undertook a research program to develop and evaluate a patient-centered outcome measure to assess the multidimensional impacts of CAM therapies, utilizing a novel mixed methods approach that relied upon techniques from the fields of anthropology and psychometrics. This tool would have broad applicability, both for CAM practitioners to measure shifts in patients' states following treatments, and conventional clinical trial researchers needing validated outcome measures. The US Food and Drug Administration has highlighted the importance of valid and reliable measurement of patient-reported outcomes in the evaluation of conventional medical products. Here we describe Phase I of our research program, the iterative process of content identification, item development and refinement, and response format selection. Cognitive interviews and psychometric evaluation are reported separately.Methods: From a database of patient interviews (n = 177) from six diverse CAM studies, 150 interviews were identified for secondary analysis in which individuals spontaneously discussed unexpected changes associated with CAM. Using ATLAS.ti, we identified common themes and language to inform questionnaire item content and wording. Respondents' language was often richly textured, but item development required a stripping down of language to extract essential meaning and minimize potential comprehension barriers across populations. Through an evocative card sort interview process, we identified those items most widely applicable and covering standard psychometric domains. We developed, pilot-tested, and refined the format, yielding a questionnaire for cognitive interviews and psychometric evaluation.Results: The resulting questionnaire contained 18 items, in visual analog scale format, in which each line was anchored by the positive and negative extremes relevant to the experiential domain. Because of frequent informant allusions to response set shifts from before to after CAM therapies, we chose a retrospective pretest format. Items cover physical, emotional, cognitive, social, spiritual, and whole person domains.Conclusions: This paper reports the success of a novel approach to the development of outcome instruments, in which items are extracted from patients' words instead of being distilled from pre-existing theory. The resulting instrument, focused on measuring shifts in patients' perceptions of health and well-being along pre-specified axes, is undergoing continued testing, and is available for use by cooperating investigators.

AB - Background: Patients receiving complementary and alternative medicine (CAM) therapies often report shifts in well-being that go beyond resolution of the original presenting symptoms. We undertook a research program to develop and evaluate a patient-centered outcome measure to assess the multidimensional impacts of CAM therapies, utilizing a novel mixed methods approach that relied upon techniques from the fields of anthropology and psychometrics. This tool would have broad applicability, both for CAM practitioners to measure shifts in patients' states following treatments, and conventional clinical trial researchers needing validated outcome measures. The US Food and Drug Administration has highlighted the importance of valid and reliable measurement of patient-reported outcomes in the evaluation of conventional medical products. Here we describe Phase I of our research program, the iterative process of content identification, item development and refinement, and response format selection. Cognitive interviews and psychometric evaluation are reported separately.Methods: From a database of patient interviews (n = 177) from six diverse CAM studies, 150 interviews were identified for secondary analysis in which individuals spontaneously discussed unexpected changes associated with CAM. Using ATLAS.ti, we identified common themes and language to inform questionnaire item content and wording. Respondents' language was often richly textured, but item development required a stripping down of language to extract essential meaning and minimize potential comprehension barriers across populations. Through an evocative card sort interview process, we identified those items most widely applicable and covering standard psychometric domains. We developed, pilot-tested, and refined the format, yielding a questionnaire for cognitive interviews and psychometric evaluation.Results: The resulting questionnaire contained 18 items, in visual analog scale format, in which each line was anchored by the positive and negative extremes relevant to the experiential domain. Because of frequent informant allusions to response set shifts from before to after CAM therapies, we chose a retrospective pretest format. Items cover physical, emotional, cognitive, social, spiritual, and whole person domains.Conclusions: This paper reports the success of a novel approach to the development of outcome instruments, in which items are extracted from patients' words instead of being distilled from pre-existing theory. The resulting instrument, focused on measuring shifts in patients' perceptions of health and well-being along pre-specified axes, is undergoing continued testing, and is available for use by cooperating investigators.

KW - Complementary and alternative medicine (CAM)

KW - Non-specific outcomes

KW - Patient-centered care

KW - Patient-reported outcomes (PROs)

KW - Questionnaire development

KW - Retrospective pre-test

KW - Well-being

UR - http://www.scopus.com/inward/record.url?scp=84855175475&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84855175475&partnerID=8YFLogxK

U2 - 10.1186/1472-6882-11-135

DO - 10.1186/1472-6882-11-135

M3 - Article

C2 - 22206345

AN - SCOPUS:84855175475

VL - 11

JO - BMC Complementary and Alternative Medicine

JF - BMC Complementary and Alternative Medicine

SN - 1472-6882

M1 - 135

ER -