Evaluating the Applied Use of a Mental Health Screener: Structural Validity of the Social, Academic, and Emotional Behavior Risk Screener

Nathaniel P. Von der Embse, Laura L. Pendergast, Stephen P. Kilgus, Katie R Eklund

Research output: Contribution to journalArticle

23 Citations (Scopus)

Abstract

Universal screening for mental health has gained prominence in schools with the adoption of multitiered systems of support. However, there is a general lack of brief, psychometrically defensible instruments that assess emotional and behavioral risk. This study employed a multilevel, confirmatory bifactor analysis to evaluate the factor structure of a novel screening instrument-the Social, Academic, and Emotional Behavioral Risk Screener (SAEBRS; Kilgus & von der Embse, 2014)-examining the structure at the student (within) and teacher or rater (between) levels. Item response theory (IRT) analyses were then used to examine the functioning of 2 existing factors, social risk and academic risk, in addition to a newly introduced third factor, emotional risk, within a sample of 834 elementary and middle school students. Results indicated good fit of a bifactor model including the addition of the new Emotional Behavior subscale. IRT analyses suggested strong item-level discriminative properties (a > 1.0) for 17 of the 19 SAEBRS items and indicated that scale precision was greatest within the low to moderate range of each respective dimension (social, academic, and behavioral risk). Overall, the findings provide support for the use of the SAEBRS as a screener for mental health-related concerns. Implications for model interpretation and model use are discussed. (PsycINFO Database Record

Original languageEnglish (US)
JournalPsychological Assessment
DOIs
StateAccepted/In press - Nov 30 2015

Fingerprint

Risk-Taking
Mental Health
Students

Keywords

  • Behavioral and emotional screener
  • Bifactor model
  • Item response theory
  • Mental health
  • Multilevel confirmatory factor analysis

ASJC Scopus subject areas

  • Psychiatry and Mental health
  • Clinical Psychology

Cite this

Evaluating the Applied Use of a Mental Health Screener : Structural Validity of the Social, Academic, and Emotional Behavior Risk Screener. / Von der Embse, Nathaniel P.; Pendergast, Laura L.; Kilgus, Stephen P.; Eklund, Katie R.

In: Psychological Assessment, 30.11.2015.

Research output: Contribution to journalArticle

@article{6f0ee130bf5342b5ba56ddc0ff47ed4d,
title = "Evaluating the Applied Use of a Mental Health Screener: Structural Validity of the Social, Academic, and Emotional Behavior Risk Screener",
abstract = "Universal screening for mental health has gained prominence in schools with the adoption of multitiered systems of support. However, there is a general lack of brief, psychometrically defensible instruments that assess emotional and behavioral risk. This study employed a multilevel, confirmatory bifactor analysis to evaluate the factor structure of a novel screening instrument-the Social, Academic, and Emotional Behavioral Risk Screener (SAEBRS; Kilgus & von der Embse, 2014)-examining the structure at the student (within) and teacher or rater (between) levels. Item response theory (IRT) analyses were then used to examine the functioning of 2 existing factors, social risk and academic risk, in addition to a newly introduced third factor, emotional risk, within a sample of 834 elementary and middle school students. Results indicated good fit of a bifactor model including the addition of the new Emotional Behavior subscale. IRT analyses suggested strong item-level discriminative properties (a > 1.0) for 17 of the 19 SAEBRS items and indicated that scale precision was greatest within the low to moderate range of each respective dimension (social, academic, and behavioral risk). Overall, the findings provide support for the use of the SAEBRS as a screener for mental health-related concerns. Implications for model interpretation and model use are discussed. (PsycINFO Database Record",
keywords = "Behavioral and emotional screener, Bifactor model, Item response theory, Mental health, Multilevel confirmatory factor analysis",
author = "{Von der Embse}, {Nathaniel P.} and Pendergast, {Laura L.} and Kilgus, {Stephen P.} and Eklund, {Katie R}",
year = "2015",
month = "11",
day = "30",
doi = "10.1037/pas0000253",
language = "English (US)",
journal = "Psychological Assessment",
issn = "1040-3590",
publisher = "American Psychological Association Inc.",

}

TY - JOUR

T1 - Evaluating the Applied Use of a Mental Health Screener

T2 - Structural Validity of the Social, Academic, and Emotional Behavior Risk Screener

AU - Von der Embse, Nathaniel P.

AU - Pendergast, Laura L.

AU - Kilgus, Stephen P.

AU - Eklund, Katie R

PY - 2015/11/30

Y1 - 2015/11/30

N2 - Universal screening for mental health has gained prominence in schools with the adoption of multitiered systems of support. However, there is a general lack of brief, psychometrically defensible instruments that assess emotional and behavioral risk. This study employed a multilevel, confirmatory bifactor analysis to evaluate the factor structure of a novel screening instrument-the Social, Academic, and Emotional Behavioral Risk Screener (SAEBRS; Kilgus & von der Embse, 2014)-examining the structure at the student (within) and teacher or rater (between) levels. Item response theory (IRT) analyses were then used to examine the functioning of 2 existing factors, social risk and academic risk, in addition to a newly introduced third factor, emotional risk, within a sample of 834 elementary and middle school students. Results indicated good fit of a bifactor model including the addition of the new Emotional Behavior subscale. IRT analyses suggested strong item-level discriminative properties (a > 1.0) for 17 of the 19 SAEBRS items and indicated that scale precision was greatest within the low to moderate range of each respective dimension (social, academic, and behavioral risk). Overall, the findings provide support for the use of the SAEBRS as a screener for mental health-related concerns. Implications for model interpretation and model use are discussed. (PsycINFO Database Record

AB - Universal screening for mental health has gained prominence in schools with the adoption of multitiered systems of support. However, there is a general lack of brief, psychometrically defensible instruments that assess emotional and behavioral risk. This study employed a multilevel, confirmatory bifactor analysis to evaluate the factor structure of a novel screening instrument-the Social, Academic, and Emotional Behavioral Risk Screener (SAEBRS; Kilgus & von der Embse, 2014)-examining the structure at the student (within) and teacher or rater (between) levels. Item response theory (IRT) analyses were then used to examine the functioning of 2 existing factors, social risk and academic risk, in addition to a newly introduced third factor, emotional risk, within a sample of 834 elementary and middle school students. Results indicated good fit of a bifactor model including the addition of the new Emotional Behavior subscale. IRT analyses suggested strong item-level discriminative properties (a > 1.0) for 17 of the 19 SAEBRS items and indicated that scale precision was greatest within the low to moderate range of each respective dimension (social, academic, and behavioral risk). Overall, the findings provide support for the use of the SAEBRS as a screener for mental health-related concerns. Implications for model interpretation and model use are discussed. (PsycINFO Database Record

KW - Behavioral and emotional screener

KW - Bifactor model

KW - Item response theory

KW - Mental health

KW - Multilevel confirmatory factor analysis

UR - http://www.scopus.com/inward/record.url?scp=84949256064&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84949256064&partnerID=8YFLogxK

U2 - 10.1037/pas0000253

DO - 10.1037/pas0000253

M3 - Article

C2 - 26619092

AN - SCOPUS:84949256064

JO - Psychological Assessment

JF - Psychological Assessment

SN - 1040-3590

ER -