Influence of text and participant characteristics on perceived and actual text difficulty

Obay Mouradi, Gondy Augusta Leroy, David Kauchak, James E. Endicott

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

Because patients customarily receive medical text that is difficult to understand, we are developing a simplification algorithm to support simpler writing by medical professionals. Our algorithm relies on term familiarity and automatically suggests alternative wordings from different sources. Weconducted a user study (N=17) to evaluate its effectiveness on reducing perceived and actual difficulty. Perceived difficulty was measured using sentences and a Likert-scale. Actual difficulty was measured using documents and multiple-choice and Cloze tests. We found a strong significant simplification effect for perceived difficulty (p=.002), but no effect for actual difficulty: only 6.2% improvement on the Cloze test. Evaluating participant characteristics showed that reading more newspapers or magazines correlated with lower multiple-choice (r=-386, p=.016) and Cloze test (r=- .340, p=.025) scores. STOFHLA scores, a health literacy measure, correlated with the Cloze test scores (r=.461, p=.002).

Original languageEnglish (US)
Title of host publicationProceedings of the Annual Hawaii International Conference on System Sciences
Pages2464-2473
Number of pages10
DOIs
StatePublished - 2013
Externally publishedYes
Event46th Annual Hawaii International Conference on System Sciences, HICSS 2013 - Wailea, Maui, HI, United States
Duration: Jan 7 2013Jan 10 2013

Other

Other46th Annual Hawaii International Conference on System Sciences, HICSS 2013
CountryUnited States
CityWailea, Maui, HI
Period1/7/131/10/13

Fingerprint

Health

ASJC Scopus subject areas

  • Engineering(all)

Cite this

Mouradi, O., Leroy, G. A., Kauchak, D., & Endicott, J. E. (2013). Influence of text and participant characteristics on perceived and actual text difficulty. In Proceedings of the Annual Hawaii International Conference on System Sciences (pp. 2464-2473). [6480143] https://doi.org/10.1109/HICSS.2013.266

Influence of text and participant characteristics on perceived and actual text difficulty. / Mouradi, Obay; Leroy, Gondy Augusta; Kauchak, David; Endicott, James E.

Proceedings of the Annual Hawaii International Conference on System Sciences. 2013. p. 2464-2473 6480143.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Mouradi, O, Leroy, GA, Kauchak, D & Endicott, JE 2013, Influence of text and participant characteristics on perceived and actual text difficulty. in Proceedings of the Annual Hawaii International Conference on System Sciences., 6480143, pp. 2464-2473, 46th Annual Hawaii International Conference on System Sciences, HICSS 2013, Wailea, Maui, HI, United States, 1/7/13. https://doi.org/10.1109/HICSS.2013.266
Mouradi O, Leroy GA, Kauchak D, Endicott JE. Influence of text and participant characteristics on perceived and actual text difficulty. In Proceedings of the Annual Hawaii International Conference on System Sciences. 2013. p. 2464-2473. 6480143 https://doi.org/10.1109/HICSS.2013.266
Mouradi, Obay ; Leroy, Gondy Augusta ; Kauchak, David ; Endicott, James E. / Influence of text and participant characteristics on perceived and actual text difficulty. Proceedings of the Annual Hawaii International Conference on System Sciences. 2013. pp. 2464-2473
@inproceedings{2dd6bbe47db14e95b8ea4a9ef573f249,
title = "Influence of text and participant characteristics on perceived and actual text difficulty",
abstract = "Because patients customarily receive medical text that is difficult to understand, we are developing a simplification algorithm to support simpler writing by medical professionals. Our algorithm relies on term familiarity and automatically suggests alternative wordings from different sources. Weconducted a user study (N=17) to evaluate its effectiveness on reducing perceived and actual difficulty. Perceived difficulty was measured using sentences and a Likert-scale. Actual difficulty was measured using documents and multiple-choice and Cloze tests. We found a strong significant simplification effect for perceived difficulty (p=.002), but no effect for actual difficulty: only 6.2{\%} improvement on the Cloze test. Evaluating participant characteristics showed that reading more newspapers or magazines correlated with lower multiple-choice (r=-386, p=.016) and Cloze test (r=- .340, p=.025) scores. STOFHLA scores, a health literacy measure, correlated with the Cloze test scores (r=.461, p=.002).",
author = "Obay Mouradi and Leroy, {Gondy Augusta} and David Kauchak and Endicott, {James E.}",
year = "2013",
doi = "10.1109/HICSS.2013.266",
language = "English (US)",
isbn = "9780769548920",
pages = "2464--2473",
booktitle = "Proceedings of the Annual Hawaii International Conference on System Sciences",

}

TY - GEN

T1 - Influence of text and participant characteristics on perceived and actual text difficulty

AU - Mouradi, Obay

AU - Leroy, Gondy Augusta

AU - Kauchak, David

AU - Endicott, James E.

PY - 2013

Y1 - 2013

N2 - Because patients customarily receive medical text that is difficult to understand, we are developing a simplification algorithm to support simpler writing by medical professionals. Our algorithm relies on term familiarity and automatically suggests alternative wordings from different sources. Weconducted a user study (N=17) to evaluate its effectiveness on reducing perceived and actual difficulty. Perceived difficulty was measured using sentences and a Likert-scale. Actual difficulty was measured using documents and multiple-choice and Cloze tests. We found a strong significant simplification effect for perceived difficulty (p=.002), but no effect for actual difficulty: only 6.2% improvement on the Cloze test. Evaluating participant characteristics showed that reading more newspapers or magazines correlated with lower multiple-choice (r=-386, p=.016) and Cloze test (r=- .340, p=.025) scores. STOFHLA scores, a health literacy measure, correlated with the Cloze test scores (r=.461, p=.002).

AB - Because patients customarily receive medical text that is difficult to understand, we are developing a simplification algorithm to support simpler writing by medical professionals. Our algorithm relies on term familiarity and automatically suggests alternative wordings from different sources. Weconducted a user study (N=17) to evaluate its effectiveness on reducing perceived and actual difficulty. Perceived difficulty was measured using sentences and a Likert-scale. Actual difficulty was measured using documents and multiple-choice and Cloze tests. We found a strong significant simplification effect for perceived difficulty (p=.002), but no effect for actual difficulty: only 6.2% improvement on the Cloze test. Evaluating participant characteristics showed that reading more newspapers or magazines correlated with lower multiple-choice (r=-386, p=.016) and Cloze test (r=- .340, p=.025) scores. STOFHLA scores, a health literacy measure, correlated with the Cloze test scores (r=.461, p=.002).

UR - http://www.scopus.com/inward/record.url?scp=84875516625&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84875516625&partnerID=8YFLogxK

U2 - 10.1109/HICSS.2013.266

DO - 10.1109/HICSS.2013.266

M3 - Conference contribution

AN - SCOPUS:84875516625

SN - 9780769548920

SP - 2464

EP - 2473

BT - Proceedings of the Annual Hawaii International Conference on System Sciences

ER -