•  

Intervention Summary

Kognito At-Risk for College Students

Kognito At-Risk for College Students is a 30-minute, online, interactive training simulation that prepares college students and student leaders, including resident assistants, to provide support to peers who are exhibiting signs of psychological distress such as depression, anxiety, substance abuse, and suicidal ideation. Through a self-paced, narrative-driven experience, participants build knowledge, skills, and confidence to identify, approach, and refer an at-risk student to counseling, mental health, or crisis support services. By practicing speaking with fully animated and emotionally responsive avatars that act and respond like real humans, participants learn effective communication tactics for managing challenging conversations. The course also works to reduce stigma around mental health issues and increase protective factors by promoting help-seeking behaviors and improving social connectedness. Simulations are authored and delivered using Kognito's proprietary Human Interaction Game Engine, which is based on research in social cognition, neuroscience, and motivational interviewing.

The course begins with participants engaging in a variety of social encounters with four avatar friends and identifying warning signs in each friend. Once they have selected the friend who is most at risk, participants practice using evidence-based techniques to effectively broach the topic of psychological distress and motivate that friend to seek help at a campus counseling center or health center. They learn to avoid common pitfalls of "gatekeeper" behavior, such as attempting to diagnose the problem or giving unwarranted advice. By providing hands-on practice, the training increases participants' confidence and ability to handle similar challenging situations in real life. Participants are also encouraged to seek counseling for themselves if they are experiencing psychological distress. A local resources button in the course links participants to specific information about counseling and mental health services available on campus and in the surrounding community.

Kognito provides At-Risk for College Students under licensing agreements to institutions or statewide agencies. A member of the institution (e.g., counseling center or health center staff) usually serves as an administrator for the course. Program setup requires 1 hour of the administrator's time and is conducted via an online meeting. Depending on the institution's infrastructure, goals, and overall suicide prevention strategy, administrators can expect to spend 2-8 hours per month disseminating and promoting the course to learners.

The course is part of a suite of online role-play training simulations offered by Kognito. Other courses are available for higher education faculty, K-12 educators, military families, and medical professionals (see Adaptations section below).

Descriptive Information

Areas of Interest Mental health promotion
Outcomes
1: Preparedness to recognize fellow students in psychological distress
2: Preparedness to approach fellow students in psychological distress
3: Preparedness to refer fellow students in psychological distress
4: Likelihood of approaching and referring fellow students exhibiting signs of psychological distress
5: Willingness to seek mental health counseling for self
Outcome Categories Mental health
Suicide
Ages 18-25 (Young adult)
Genders Male
Female
Races/Ethnicities Race/ethnicity unspecified
Settings Home
School
Geographic Locations Urban
Suburban
Implementation History Kognito's At-Risk for College Students was introduced. It has been adopted by more than 120 institutions in 21 States, as well as in the United Kingdom and New Zealand. The course was developed to be appropriate for and acceptable to a broad range of racial and ethnic groups.
NIH Funding/CER Studies Partially/fully funded by National Institutes of Health: No
Evaluated in comparative effectiveness research studies: No
Adaptations Kognito At-Risk for College Students is part of a suite of online role-play training simulations that support large-scale, universal mental health promotion and suicide prevention, as well as early intervention of suicidal ideation and mental illness. Each course is developed for a specific group of learners. In addition to At-Risk for College Students, which targets students and student leaders in institutions of higher education, other courses are available for higher education faculty, K-12 educators, military families, and medical professionals. 
Adverse Effects No adverse effects, concerns, or unintended consequences were identified by the developer.
IOM Prevention Categories Universal

Quality of Research

Documents Reviewed

The documents below were reviewed for Quality of Research. The research point of contact can provide information regarding the studies reviewed and the availability of additional materials, including those from more recent studies that may have been conducted.

Study 1

Albright, G., Himmel, J., Goldman, R., & Shockley, K. At-Risk for University Students: On-line interactive gatekeeper training simulation for identification and referral of students exhibiting signs of psychological distress. Unpublished manuscript.

Supplementary Materials

At-Risk University Student Supporting Document [document created for the NREPP review]

Outcomes

Outcome 1: Preparedness to recognize fellow students in psychological distress
Description of Measures A 12-item, online questionnaire was administered to college students at pre- and posttest (immediately before and after completing the training for the intervention group; 1-2 weeks apart for the control group). This outcome was assessed using the following item: "How would you rate your preparedness to recognize when a fellow student's behavior or appearance is an indicator of psychological distress such as depression, anxiety, or thoughts of suicide?" Responses were on a 4-point Likert scale from 1 (low) to 4 (very high).
Key Findings Students from 10 colleges and universities were assigned to the intervention group or a no-treatment control group. The intervention group showed a greater increase in preparedness to recognize fellow students in psychological distress compared with the control group (p < .001).
Studies Measuring Outcome Study 1
Study Designs Quasi-experimental
Quality of Research Rating 2.4 (0.0-4.0 scale)
Outcome 2: Preparedness to approach fellow students in psychological distress
Description of Measures A 12-item, online questionnaire was administered to college students at pre- and posttest (immediately before and after completing the training for the intervention group; 1-2 weeks apart for the control group). This outcome was assessed using the following item: "How would you rate your preparedness to approach fellow students exhibiting signs of psychological distress to discuss your concerns?" Responses were on a 4-point Likert scale from 1 (low) to 4 (very high).
Key Findings Students from 10 colleges and universities were assigned to the intervention group or a no-treatment control group. The intervention group showed a greater increase in student-reported preparedness to approach fellow students in psychological distress compared with the control group (p < .001).
Studies Measuring Outcome Study 1
Study Designs Quasi-experimental
Quality of Research Rating 2.4 (0.0-4.0 scale)
Outcome 3: Preparedness to refer fellow students in psychological distress
Description of Measures A 12-item, online questionnaire was administered to college students at pre- and posttest (immediately before and after completing the training for the intervention group; 1-2 weeks apart for the control group). This outcome was assessed using the following item: "How would you rate your preparedness to refer fellow students exhibiting signs of psychological distress to the counseling center?" Responses were on a 4-point Likert scale from 1 (low) to 4 (very high).
Key Findings Students from 10 colleges and universities were assigned to the intervention group or a no-treatment control group. The intervention group showed a greater increase in preparedness to refer fellow students in psychological distress compared with the control group (p = .029).
Studies Measuring Outcome Study 1
Study Designs Quasi-experimental
Quality of Research Rating 2.4 (0.0-4.0 scale)
Outcome 4: Likelihood of approaching and referring fellow students exhibiting signs of psychological distress
Description of Measures A 12-item, online questionnaire was administered to college students at pre- and posttest (immediately before and after completing the training for the intervention group; 1-2 weeks apart for the control group). This outcome was assessed using the following item: "How likely are you to approach and, if necessary, refer a fellow student exhibiting signs of psychological distress to the counseling center?" Responses were on a 4-point Likert scale from 1 (not likely) to 4 (very likely).
Key Findings Students from 10 colleges and universities were assigned to the intervention group or a no-treatment control group. The intervention group showed a greater increase in likelihood of approaching and referring fellow students exhibiting signs of psychological distress compared with the control group (p < .001).
Studies Measuring Outcome Study 1
Study Designs Quasi-experimental
Quality of Research Rating 2.5 (0.0-4.0 scale)
Outcome 5: Willingness to seek mental health counseling for self
Description of Measures A 12-item, online questionnaire was administered to college students at pre- and posttest (immediately before and after completing the training for the intervention group; 1-2 weeks apart for the control group). This outcome was assessed using the following item: "I may seek help from the counseling center myself when feeling stressed." Responses were on a 4-point Likert scale from 1 (strongly disagree) to 4 (strongly agree).
Key Findings Students from 10 colleges and universities were assigned to the intervention group or a no-treatment control group. The intervention group showed a greater increase in willingness to seek mental health counseling when feeling stressed compared with the control group (p = .047).
Studies Measuring Outcome Study 1
Study Designs Quasi-experimental
Quality of Research Rating 2.4 (0.0-4.0 scale)

Study Populations

The following populations were identified in the studies reviewed for Quality of Research.

Study Age Gender Race/Ethnicity
Study 1 18-25 (Young adult) 51.6% Female
48.4% Male
100% Race/ethnicity unspecified

Quality of Research Ratings by Criteria (0.0-4.0 scale)

External reviewers independently evaluate the Quality of Research for an intervention's reported results using six criteria:

  1. Reliability of measures
  2. Validity of measures
  3. Intervention fidelity
  4. Missing data and attrition
  5. Potential confounding variables
  6. Appropriateness of analysis

For more information about these criteria and the meaning of the ratings, see Quality of Research.

Outcome Reliability
of Measures
Validity
of Measures
Fidelity Missing
Data/Attrition
Confounding
Variables
Data
Analysis
Overall
Rating
1: Preparedness to recognize fellow students in psychological distress 1.0 2.0 2.0 4.0 1.5 4.0 2.4
2: Preparedness to approach fellow students in psychological distress 1.0 2.0 2.0 4.0 1.5 4.0 2.4
3: Preparedness to refer fellow students in psychological distress 1.0 2.0 2.0 4.0 1.5 4.0 2.4
4: Likelihood of approaching and referring fellow students exhibiting signs of psychological distress 1.0 2.5 2.0 4.0 1.5 4.0 2.5
5: Willingness to seek mental health counseling for self 1.0 2.0 2.0 4.0 1.5 4.0 2.4

Study Strengths

There is evidence of face validity for all outcome measures and evidence for criterion-related validity for one outcome. The online delivery of the program provides some assurance of fidelity. Missing data and attrition were reported to be low, such that no adjustments were needed. Appropriate statistical methods were used.

Study Weaknesses

None of the outcome measures had strong test-retest reliability correlations. A standardized fidelity instrument was not used. Some confounding variables were not adequately addressed, including student's self-selection into the intervention group, the collection of data at different times for the intervention and control groups, and the presence of more freshmen in the control group than in the intervention group.

Readiness for Dissemination

Materials Reviewed

The materials below were reviewed for Readiness for Dissemination. The implementation point of contact can provide information regarding implementation of the intervention and the availability of additional, updated, or new materials.

Kognito Interactive. At-Risk for College Students: Implementation manual.

Samples of pre- and posttest survey summaries

Readiness for Dissemination Ratings by Criteria (0.0-4.0 scale)

External reviewers independently evaluate the intervention's Readiness for Dissemination using three criteria:

  1. Availability of implementation materials
  2. Availability of training and support resources
  3. Availability of quality assurance procedures

For more information about these criteria and the meaning of the ratings, see Readiness for Dissemination.

Implementation
Materials
Training and Support
Resources
Quality Assurance
Procedures
Overall
Rating
4.0 4.0 4.0 4.0

Dissemination Strengths

All implementation materials, including the training, are online and accessible 24 hours per day, 7 days per week, to students and administrators. The avatar-based simulation is likely to be engaging to a college audience. A direct link to school-specific referral information is provided in the training through a customized "My Counseling Center" page. Through an administrator account, school staff can access a variety of tools to promote and manage the intervention. An account manager assigned to each implementing site provides an initial orientation by phone as well as ongoing support. Participant surveys are available to assess outcomes, and guidance is provided on how to use the survey data to improve program delivery. Administrators can access user-tracking reports and send automated reminders to participants to increase course completion.

Dissemination Weaknesses

No weaknesses were identified by the reviewers.

Costs

The cost information below was provided by the developer. Although this cost information may have been updated by the developer since the time of review, it may not reflect the current costs or availability of items (including newly developed or discontinued items). The implementation point of contact can provide current information and discuss implementation requirements.

Item Description Cost Required by Developer
Program license (includes student access to training and administrator access to downloadable implementation manual, promotional materials, usage reports, and participant surveys)
  • Institutional licenses for colleges and universities: starting at $2,000 per year, depending on the size of the institution
  • Statewide or systemwide licenses: contact the developer
Yes
Consultation and technical assistance by phone or email Included with license Yes

Additional Information