The influence of text characteristics on perceived and actual difficulty of health information

Gondy Augusta Leroy, Stephen Helmreich, James R. Cowie

Research output: Contribution to journalArticle

19 Citations (Scopus)

Abstract

Purpose: Willingness and ability to learn from health information in text are crucial for people to be informed and make better medical decisions. These two user characteristics are influenced by the perceived and actual difficulty of text. Our goal is to find text features that are indicative of perceived and actual difficulty so that barriers to reading can be lowered and understanding of information increased. Methods: We systematically manipulated three text characteristics, - overall sentence structure (active, passive, extraposed-subject, or sentential-subject), noun phrases complexity (simple or complex), and function word density (high or low), - which are more fine-grained metrics to evaluate text than the commonly used readability formulas. We measured perceived difficulty with individual sentences by asking consumers to choose the easiest and most difficult version of a sentence. We measured actual difficulty with entire paragraphs by posing multiple-choice questions to measure understanding and retention of information in easy and difficult versions of the paragraphs. Results: Based on a study with 86 participants, we found that low noun phrase complexity and high function words density lead to sentences being perceived as simpler. In the sentences with passive, sentential-subject, or extraposed-subject sentences, both main and interaction effects were significant (all p<. .05). In active sentences, only noun phrase complexity mattered (p<. .001). For the same group of participants, simplification of entire paragraphs based on these three linguistic features had only a small effect on understanding (p= .99) and no effect on retention of information. Conclusions: Using grammatical text features, we could measure and improve the perceived difficulty of text. In contrast to expectations based on readability formulas, these grammatical manipulations had limited effects on actual difficulty and so were insufficient to simplify the text and improve understanding. Future work will include semantic measures and overall text composition and their effects on perceived and actual difficulty. Limitations: These results are limited to grammatical features of text. The studies also used only one task, a question-answering task, to measure understanding of information.

Original languageEnglish (US)
Pages (from-to)438-449
Number of pages12
JournalInternational Journal of Medical Informatics
Volume79
Issue number6
DOIs
StatePublished - Jun 2010
Externally publishedYes

Fingerprint

Aptitude
Health
Linguistics
Semantics
Reading

Keywords

  • Communication barrier
  • Comprehension
  • Consumer health information
  • Linguistics
  • Perceived difficulty
  • Readability
  • Retention
  • Understanding

ASJC Scopus subject areas

  • Health Informatics

Cite this

The influence of text characteristics on perceived and actual difficulty of health information. / Leroy, Gondy Augusta; Helmreich, Stephen; Cowie, James R.

In: International Journal of Medical Informatics, Vol. 79, No. 6, 06.2010, p. 438-449.

Research output: Contribution to journalArticle

@article{9464a7b232b047db8c5a8567b1cbb3ed,
title = "The influence of text characteristics on perceived and actual difficulty of health information",
abstract = "Purpose: Willingness and ability to learn from health information in text are crucial for people to be informed and make better medical decisions. These two user characteristics are influenced by the perceived and actual difficulty of text. Our goal is to find text features that are indicative of perceived and actual difficulty so that barriers to reading can be lowered and understanding of information increased. Methods: We systematically manipulated three text characteristics, - overall sentence structure (active, passive, extraposed-subject, or sentential-subject), noun phrases complexity (simple or complex), and function word density (high or low), - which are more fine-grained metrics to evaluate text than the commonly used readability formulas. We measured perceived difficulty with individual sentences by asking consumers to choose the easiest and most difficult version of a sentence. We measured actual difficulty with entire paragraphs by posing multiple-choice questions to measure understanding and retention of information in easy and difficult versions of the paragraphs. Results: Based on a study with 86 participants, we found that low noun phrase complexity and high function words density lead to sentences being perceived as simpler. In the sentences with passive, sentential-subject, or extraposed-subject sentences, both main and interaction effects were significant (all p<. .05). In active sentences, only noun phrase complexity mattered (p<. .001). For the same group of participants, simplification of entire paragraphs based on these three linguistic features had only a small effect on understanding (p= .99) and no effect on retention of information. Conclusions: Using grammatical text features, we could measure and improve the perceived difficulty of text. In contrast to expectations based on readability formulas, these grammatical manipulations had limited effects on actual difficulty and so were insufficient to simplify the text and improve understanding. Future work will include semantic measures and overall text composition and their effects on perceived and actual difficulty. Limitations: These results are limited to grammatical features of text. The studies also used only one task, a question-answering task, to measure understanding of information.",
keywords = "Communication barrier, Comprehension, Consumer health information, Linguistics, Perceived difficulty, Readability, Retention, Understanding",
author = "Leroy, {Gondy Augusta} and Stephen Helmreich and Cowie, {James R.}",
year = "2010",
month = "6",
doi = "10.1016/j.ijmedinf.2010.02.002",
language = "English (US)",
volume = "79",
pages = "438--449",
journal = "International Journal of Medical Informatics",
issn = "1386-5056",
publisher = "Elsevier Ireland Ltd",
number = "6",

}

TY - JOUR

T1 - The influence of text characteristics on perceived and actual difficulty of health information

AU - Leroy, Gondy Augusta

AU - Helmreich, Stephen

AU - Cowie, James R.

PY - 2010/6

Y1 - 2010/6

N2 - Purpose: Willingness and ability to learn from health information in text are crucial for people to be informed and make better medical decisions. These two user characteristics are influenced by the perceived and actual difficulty of text. Our goal is to find text features that are indicative of perceived and actual difficulty so that barriers to reading can be lowered and understanding of information increased. Methods: We systematically manipulated three text characteristics, - overall sentence structure (active, passive, extraposed-subject, or sentential-subject), noun phrases complexity (simple or complex), and function word density (high or low), - which are more fine-grained metrics to evaluate text than the commonly used readability formulas. We measured perceived difficulty with individual sentences by asking consumers to choose the easiest and most difficult version of a sentence. We measured actual difficulty with entire paragraphs by posing multiple-choice questions to measure understanding and retention of information in easy and difficult versions of the paragraphs. Results: Based on a study with 86 participants, we found that low noun phrase complexity and high function words density lead to sentences being perceived as simpler. In the sentences with passive, sentential-subject, or extraposed-subject sentences, both main and interaction effects were significant (all p<. .05). In active sentences, only noun phrase complexity mattered (p<. .001). For the same group of participants, simplification of entire paragraphs based on these three linguistic features had only a small effect on understanding (p= .99) and no effect on retention of information. Conclusions: Using grammatical text features, we could measure and improve the perceived difficulty of text. In contrast to expectations based on readability formulas, these grammatical manipulations had limited effects on actual difficulty and so were insufficient to simplify the text and improve understanding. Future work will include semantic measures and overall text composition and their effects on perceived and actual difficulty. Limitations: These results are limited to grammatical features of text. The studies also used only one task, a question-answering task, to measure understanding of information.

AB - Purpose: Willingness and ability to learn from health information in text are crucial for people to be informed and make better medical decisions. These two user characteristics are influenced by the perceived and actual difficulty of text. Our goal is to find text features that are indicative of perceived and actual difficulty so that barriers to reading can be lowered and understanding of information increased. Methods: We systematically manipulated three text characteristics, - overall sentence structure (active, passive, extraposed-subject, or sentential-subject), noun phrases complexity (simple or complex), and function word density (high or low), - which are more fine-grained metrics to evaluate text than the commonly used readability formulas. We measured perceived difficulty with individual sentences by asking consumers to choose the easiest and most difficult version of a sentence. We measured actual difficulty with entire paragraphs by posing multiple-choice questions to measure understanding and retention of information in easy and difficult versions of the paragraphs. Results: Based on a study with 86 participants, we found that low noun phrase complexity and high function words density lead to sentences being perceived as simpler. In the sentences with passive, sentential-subject, or extraposed-subject sentences, both main and interaction effects were significant (all p<. .05). In active sentences, only noun phrase complexity mattered (p<. .001). For the same group of participants, simplification of entire paragraphs based on these three linguistic features had only a small effect on understanding (p= .99) and no effect on retention of information. Conclusions: Using grammatical text features, we could measure and improve the perceived difficulty of text. In contrast to expectations based on readability formulas, these grammatical manipulations had limited effects on actual difficulty and so were insufficient to simplify the text and improve understanding. Future work will include semantic measures and overall text composition and their effects on perceived and actual difficulty. Limitations: These results are limited to grammatical features of text. The studies also used only one task, a question-answering task, to measure understanding of information.

KW - Communication barrier

KW - Comprehension

KW - Consumer health information

KW - Linguistics

KW - Perceived difficulty

KW - Readability

KW - Retention

KW - Understanding

UR - http://www.scopus.com/inward/record.url?scp=77955877458&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77955877458&partnerID=8YFLogxK

U2 - 10.1016/j.ijmedinf.2010.02.002

DO - 10.1016/j.ijmedinf.2010.02.002

M3 - Article

VL - 79

SP - 438

EP - 449

JO - International Journal of Medical Informatics

JF - International Journal of Medical Informatics

SN - 1386-5056

IS - 6

ER -