Validity and reliability of a new measure of nursing experience with unintended consequences of electronic health records

Unintended consequences of electronic health records represent undesired effects on individuals or systems, which may contradict initial goals and impact patient care. The purpose of this study was to determine the extent to which a new quantitative measure called the Carrington-Gephart Unintended Consequences of Electronic Health Record Questionnaire (CG-UCE-Q) was valid and reliable. Then, it was used to describe acute care nurses' experience with unintended consequences of electronic health records and relate them to the professional practice environment. Acceptable content validity was achieved for two rounds of surveys with nursing informatics experts (n = 5). Then, acute care nurses (n = 144) were recruited locally and nationally to complete the survey and describe the frequency with which they encounter unintended consequences in daily work. Principal component analysis with oblique rotation was applied to evaluate construct validity. Correlational analysis with measures of the professional practice environment and workarounds was used to evaluate convergent validity. Test-retest reliability was measured in the local sample (N = 68). Explanation for 63% of the variance across six subscales (patient safety, system design, workload issues, workarounds, technology barriers, and sociotechnical impact) supported construct validity. Relationships were significant between subscales for electronic health record-related threats to patientsafety and low autonomy/leadership (P < .01), poor communication about patients (P < .01), and low control over practice (P < .01). The most frequent sources of unintended consequences were increased workload, interruptions that shifted tasks from the computer, altered workflow, and the need to duplicate dataentry.Convergent validity of the CG-UCE-Q was moderately supported with both the context and processes of workarounds with strong relationships identified for when nurses perceived a block and altered process to work around it to subscales in the CG-UCE-Q for electronic health record system design (P < .01) and technological barriers (P < .01).