Interrater and test-retest reliability of the beery visual-motor integration in schoolchildren

Erin M Harvey, Tina K. Leonard-Green, Kathleen M. Mohan, Marjean Taylor Kulp, Amy L. Davis, Joseph M Miller, John D Twelker, Irene Campus, Leslie K Dennis

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

Purpose. To assess interrater and test-retest reliability of the 6th Edition Beery-Buktenica Developmental Test of Visual-Motor Integration (VMI) and test-retest reliability of the VMI Visual Perception Supplemental Test (VMIp) in school-age children. Methods. Subjects were 163 Native American third- to eighth-grade students with no significant refractive error (astigmatism <1.00 D, myopia <0.75 D, hyperopia <2.50 D, anisometropia <1.50 D) or ocular abnormalities. The VMI and VMIp were administered twice, on separate days. All VMI tests were scored by two trained scorers, and a subset of 50 tests was also scored by an experienced scorer. Scorers strictly applied objective scoring criteria. Analyses included interrater and test-retest assessments of bias, 95% limits of agreement, and intraclass correlation analysis. Results. Trained scorers had no significant scoring bias compared with the experienced scorer. One of the two trained scorers tended to provide higher scores than the other (mean difference in standardized scores = 1.54). Interrater correlations were strong (0.75 to 0.88). VMI and VMIp test-retest comparisons indicated no significant bias (subjects did not tend to score better on retest). Test-retest correlations were moderate (0.54 to 0.58). The 95% limits of agreement for the VMI were -24.14 to 24.67 (scorer 1) and -26.06 to 26.58 (scorer 2), and the 95% limits of agreement for the VMIp were -27.11 to 27.34. Conclusions. The 95% limit of agreement for test-retest differences will be useful for determining if the VMI and VMIp have sufficient sensitivity for detecting change with treatment in both clinical and research settings. Further research on test-retest reliability reporting 95% limits of agreement for children across different age ranges is recommended, particularly if the test is to be used to detect changes due to intervention or treatment.

Original languageEnglish (US)
Pages (from-to)598-605
Number of pages8
JournalOptometry and Vision Science
Volume94
Issue number5
DOIs
StatePublished - 2017

Fingerprint

Reproducibility of Results
Eye Abnormalities
Anisometropia
Hyperopia
Visual Perception
Refractive Errors
Astigmatism
North American Indians
Myopia
Research
Students
Therapeutics

Keywords

  • Children
  • Interrater reliability
  • Test-retest reliability
  • Visual motor integration

ASJC Scopus subject areas

  • Ophthalmology
  • Optometry

Cite this

Interrater and test-retest reliability of the beery visual-motor integration in schoolchildren. / Harvey, Erin M; Leonard-Green, Tina K.; Mohan, Kathleen M.; Kulp, Marjean Taylor; Davis, Amy L.; Miller, Joseph M; Twelker, John D; Campus, Irene; Dennis, Leslie K.

In: Optometry and Vision Science, Vol. 94, No. 5, 2017, p. 598-605.

Research output: Contribution to journalArticle

Harvey, Erin M ; Leonard-Green, Tina K. ; Mohan, Kathleen M. ; Kulp, Marjean Taylor ; Davis, Amy L. ; Miller, Joseph M ; Twelker, John D ; Campus, Irene ; Dennis, Leslie K. / Interrater and test-retest reliability of the beery visual-motor integration in schoolchildren. In: Optometry and Vision Science. 2017 ; Vol. 94, No. 5. pp. 598-605.
@article{1c957d1e86194c409778641a97c7dcb8,
title = "Interrater and test-retest reliability of the beery visual-motor integration in schoolchildren",
abstract = "Purpose. To assess interrater and test-retest reliability of the 6th Edition Beery-Buktenica Developmental Test of Visual-Motor Integration (VMI) and test-retest reliability of the VMI Visual Perception Supplemental Test (VMIp) in school-age children. Methods. Subjects were 163 Native American third- to eighth-grade students with no significant refractive error (astigmatism <1.00 D, myopia <0.75 D, hyperopia <2.50 D, anisometropia <1.50 D) or ocular abnormalities. The VMI and VMIp were administered twice, on separate days. All VMI tests were scored by two trained scorers, and a subset of 50 tests was also scored by an experienced scorer. Scorers strictly applied objective scoring criteria. Analyses included interrater and test-retest assessments of bias, 95{\%} limits of agreement, and intraclass correlation analysis. Results. Trained scorers had no significant scoring bias compared with the experienced scorer. One of the two trained scorers tended to provide higher scores than the other (mean difference in standardized scores = 1.54). Interrater correlations were strong (0.75 to 0.88). VMI and VMIp test-retest comparisons indicated no significant bias (subjects did not tend to score better on retest). Test-retest correlations were moderate (0.54 to 0.58). The 95{\%} limits of agreement for the VMI were -24.14 to 24.67 (scorer 1) and -26.06 to 26.58 (scorer 2), and the 95{\%} limits of agreement for the VMIp were -27.11 to 27.34. Conclusions. The 95{\%} limit of agreement for test-retest differences will be useful for determining if the VMI and VMIp have sufficient sensitivity for detecting change with treatment in both clinical and research settings. Further research on test-retest reliability reporting 95{\%} limits of agreement for children across different age ranges is recommended, particularly if the test is to be used to detect changes due to intervention or treatment.",
keywords = "Children, Interrater reliability, Test-retest reliability, Visual motor integration",
author = "Harvey, {Erin M} and Leonard-Green, {Tina K.} and Mohan, {Kathleen M.} and Kulp, {Marjean Taylor} and Davis, {Amy L.} and Miller, {Joseph M} and Twelker, {John D} and Irene Campus and Dennis, {Leslie K}",
year = "2017",
doi = "10.1097/OPX.0000000000001068",
language = "English (US)",
volume = "94",
pages = "598--605",
journal = "Optometry and Vision Science",
issn = "1040-5488",
publisher = "Lippincott Williams and Wilkins",
number = "5",

}

TY - JOUR

T1 - Interrater and test-retest reliability of the beery visual-motor integration in schoolchildren

AU - Harvey, Erin M

AU - Leonard-Green, Tina K.

AU - Mohan, Kathleen M.

AU - Kulp, Marjean Taylor

AU - Davis, Amy L.

AU - Miller, Joseph M

AU - Twelker, John D

AU - Campus, Irene

AU - Dennis, Leslie K

PY - 2017

Y1 - 2017

N2 - Purpose. To assess interrater and test-retest reliability of the 6th Edition Beery-Buktenica Developmental Test of Visual-Motor Integration (VMI) and test-retest reliability of the VMI Visual Perception Supplemental Test (VMIp) in school-age children. Methods. Subjects were 163 Native American third- to eighth-grade students with no significant refractive error (astigmatism <1.00 D, myopia <0.75 D, hyperopia <2.50 D, anisometropia <1.50 D) or ocular abnormalities. The VMI and VMIp were administered twice, on separate days. All VMI tests were scored by two trained scorers, and a subset of 50 tests was also scored by an experienced scorer. Scorers strictly applied objective scoring criteria. Analyses included interrater and test-retest assessments of bias, 95% limits of agreement, and intraclass correlation analysis. Results. Trained scorers had no significant scoring bias compared with the experienced scorer. One of the two trained scorers tended to provide higher scores than the other (mean difference in standardized scores = 1.54). Interrater correlations were strong (0.75 to 0.88). VMI and VMIp test-retest comparisons indicated no significant bias (subjects did not tend to score better on retest). Test-retest correlations were moderate (0.54 to 0.58). The 95% limits of agreement for the VMI were -24.14 to 24.67 (scorer 1) and -26.06 to 26.58 (scorer 2), and the 95% limits of agreement for the VMIp were -27.11 to 27.34. Conclusions. The 95% limit of agreement for test-retest differences will be useful for determining if the VMI and VMIp have sufficient sensitivity for detecting change with treatment in both clinical and research settings. Further research on test-retest reliability reporting 95% limits of agreement for children across different age ranges is recommended, particularly if the test is to be used to detect changes due to intervention or treatment.

AB - Purpose. To assess interrater and test-retest reliability of the 6th Edition Beery-Buktenica Developmental Test of Visual-Motor Integration (VMI) and test-retest reliability of the VMI Visual Perception Supplemental Test (VMIp) in school-age children. Methods. Subjects were 163 Native American third- to eighth-grade students with no significant refractive error (astigmatism <1.00 D, myopia <0.75 D, hyperopia <2.50 D, anisometropia <1.50 D) or ocular abnormalities. The VMI and VMIp were administered twice, on separate days. All VMI tests were scored by two trained scorers, and a subset of 50 tests was also scored by an experienced scorer. Scorers strictly applied objective scoring criteria. Analyses included interrater and test-retest assessments of bias, 95% limits of agreement, and intraclass correlation analysis. Results. Trained scorers had no significant scoring bias compared with the experienced scorer. One of the two trained scorers tended to provide higher scores than the other (mean difference in standardized scores = 1.54). Interrater correlations were strong (0.75 to 0.88). VMI and VMIp test-retest comparisons indicated no significant bias (subjects did not tend to score better on retest). Test-retest correlations were moderate (0.54 to 0.58). The 95% limits of agreement for the VMI were -24.14 to 24.67 (scorer 1) and -26.06 to 26.58 (scorer 2), and the 95% limits of agreement for the VMIp were -27.11 to 27.34. Conclusions. The 95% limit of agreement for test-retest differences will be useful for determining if the VMI and VMIp have sufficient sensitivity for detecting change with treatment in both clinical and research settings. Further research on test-retest reliability reporting 95% limits of agreement for children across different age ranges is recommended, particularly if the test is to be used to detect changes due to intervention or treatment.

KW - Children

KW - Interrater reliability

KW - Test-retest reliability

KW - Visual motor integration

UR - http://www.scopus.com/inward/record.url?scp=85017650160&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85017650160&partnerID=8YFLogxK

U2 - 10.1097/OPX.0000000000001068

DO - 10.1097/OPX.0000000000001068

M3 - Article

C2 - 28422801

AN - SCOPUS:85017650160

VL - 94

SP - 598

EP - 605

JO - Optometry and Vision Science

JF - Optometry and Vision Science

SN - 1040-5488

IS - 5

ER -