Intervention Summary
Kognito Family of Heroes
Kognito Family of Heroes is a 1-hour, online role-playing training simulation for military families of servicemembers recently returned from deployment (within the past 4 years). The training is designed to: (1) increase awareness of signs of postdeployment stress, including posttraumatic stress disorder (PTSD), traumatic brain injury (TBI), depression, and suicidal ideation, and (2) motivate family members to access mental health services when they show signs of postdeployment stress. Targeted primarily to family members (e.g., spouses and parents), who often have the most contact with veterans, the training also can be appropriate for friends, caregivers, or colleagues of veterans. Through the training, family members learn: The training engages users in practice conversations with avatars that act and respond like real veterans experiencing postdeployment stress. In one such role-play conversation, users assume the role of the wife of a veteran who is experiencing PTSD and mild TBI and learn skills to de-escalate an argument. In another scenario, users assume the role of a mother whose son is exhibiting signs of depression and thoughts of suicide and learn skills to motivate the son to seek support services. These simulations are authored and delivered using Kognito's proprietary Human Interaction Game Engine, which is based on research in social cognition, neuroscience, and motivational interviewing. Additional features of the course include a local resources button with information on nearby medical centers, VA hospitals, and community clinics; links to other resources for veterans and military families; and a printable summary of key techniques discussed in the training. Kognito provides the course under licensing agreements to military units, veterans service organizations, and State agencies, which typically make the course available to servicemembers and their families at no cost. One member of the institution usually serves as an administrator for the course. Program setup requires 1 hour of the administrator's time and is conducted via an online meeting. Depending on the institution's infrastructure, goals, and overall suicide prevention strategy, administrators can expect to spend 2-8 hours per month disseminating and promoting the course to users. Family of Heroes is part of a suite of online role-play training simulations offered by Kognito. Other courses are available for a variety of other target populations (See Adaptations section below). The program is fully narrated and includes text captions in English to accommodate the hearing and visual impaired and to support Section 508 compliancy. Three variations of the course are available that reflect differences in information about available mental health resources (VA, State, or military). Kognito Family of Heroes is part of a suite of online role-play training simulations that support large-scale, universal mental health promotion and suicide prevention, as well as early intervention of suicidal ideation and mental illness. Each course is developed for a specific group of learners. In addition to Family of Heroes, which targets the unique needs of veterans' families, other courses are available for higher education faculty, K-12 educators, and medical professionals.
The documents below were reviewed for Quality of Research. The research point of
contact can provide information regarding the studies reviewed and the availability
of additional materials, including those from more recent studies that may have been conducted. Albright, G., Goldman, R., Shockley, K. M., McDevitt, F., & Akabas, S. Using an avatar-based simulation to train families to motivate veterans with post-deployment stress to seek help at the VA. Games for Health: Research, Development, and Clinical Applications, 1(1), 9-16.
The following populations were identified in the studies reviewed for Quality of
Research.
External reviewers independently evaluate the Quality of Research for an intervention's
reported results using six criteria:
For more information about these criteria and the meaning of the ratings, see Quality of Research.
Good evidence was presented for some aspects of the validity of the outcome measures. Fidelity was enhanced through the standardized nature of the computer-based intervention. All participants were included in each study analysis. Appropriate analytical techniques were used. Insufficient evidence was provided about the reliability of the outcome measures. No formal measures were implemented to assess intervention fidelity. The study did not adequately control for a number of potential confounding factors, including possible self-selection bias given the fact that participants volunteered for the study in response to a recruitment advertisement.
The materials below were reviewed for Readiness for Dissemination. The implementation
point of contact can provide information regarding implementation of the intervention
and the availability of additional, updated, or new materials. Kognito Interactive. Family of Heroes avatar-based resiliency and PTSD training for military families [PowerPoint slides]. New York, NY: Author. Kognito Interactive. Resiliency training simulation for families of veterans: Implementation manual. New York, NY: Author.
External reviewers independently evaluate the intervention's Readiness for Dissemination
using three criteria: For more information about these criteria and the meaning of the ratings, see Readiness for Dissemination.
The online course and implementation materials are well organized and easily accessible to geographically dispersed learners and course administrators. The developer works closely with implementers and offers multiple options for technical assistance and support. Fidelity is supported by the standardized nature of implementation and training. Slides used for training describe how the optional, anonymous participant surveys can be customized by the implementing agency to track data of interest. The survey data can be used by the implementer as well as by the developer to identify possible program improvements or modifications. No dissemination weaknesses were identified by reviewers.
The cost information below was provided by the developer. Although this cost information
may have been updated by the developer since the time of review, it may not reflect
the current costs or availability of items (including newly developed or discontinued
items). The implementation point of contact can provide current information and
discuss implementation requirements. For implementers with evaluation needs that go beyond the included participant surveys, Kognito provides analysis and reporting services starting at $2,500.
Descriptive Information
Areas of Interest
Mental health promotion
Outcomes
1: Preparedness to recognize signs of postdeployment stress
2: Preparedness to discuss concern with veteran and motivate him or her to seek help at a VA hospital or Vet center
3: Self-efficacy in motivating veteran to seek help at a VA hospital or Vet center
4: Intention to approach veteran to discuss concerns
5: Intention to mention the VA as a helpful resource
Outcome Categories
Mental health
Suicide
Ages
18-25 (Young adult)
26-55 (Adult)
55+ (Older adult)
Genders
Male
Female
Races/Ethnicities
American Indian or Alaska Native
Asian
Black or African American
Hispanic or Latino
White
Settings
Home
Geographic Locations
Urban
Suburban
Rural and/or frontier
Implementation History
Kognito Interactive developed Family of Heroes in collaboration with the Department of Veterans Affairs NY/NJ Veterans Healthcare Network. A number of organizations have purchased a license to make the training freely available to families, caregivers, friends, colleagues, and coworkers of veterans within their geographic areas. Organizations providing the training include the Kentucky National Guard, the Air Force Space Command (serving military families and servicemembers in California, Colorado, Florida, Georgia, Illinois, and Texas), the VA of New York/New Jersey, the Virginia Department of Health, the Arizona Department of Health Services, and the Ohio Suicide Prevention Foundation. More than 62,000 people have accessed the course.
NIH Funding/CER Studies
Partially/fully funded by National Institutes of Health: No
Evaluated in comparative effectiveness research studies: No
Adaptations
Adverse Effects
No adverse effects, concerns, or unintended consequences were identified by the developer.
IOM Prevention Categories
Universal
Documents Reviewed
Study 1
Outcomes
Outcome 1: Preparedness to recognize signs of postdeployment stress
Description of Measures
This outcome was measured using a single survey item that asked participants to rate their preparedness to ''recognize when your veteran's behavior or appearance is a sign of post-deployment stress.'' Responses were on a 4-point Likert scale. Surveys were completed at pretest (intervention and control groups), posttest (intervention group only), and 1-month follow-up (intervention and control groups).
Key Findings
In a randomized trial, family members, partners, or friends of veterans who returned from deployment within the last 4 years were assigned to the intervention group or a no-treatment control group. From pretest to follow-up, the intervention group showed a significantly greater change in preparedness to recognize signs of postdeployment stress compared with the control group (p < .05).
Studies Measuring Outcome
Study 1
Study Designs
Experimental
Quality of Research Rating
2.4
(0.0-4.0 scale)
Outcome 2: Preparedness to discuss concern with veteran and motivate him or her to seek help at a VA hospital or Vet center
Description of Measures
This outcome was measured using three survey items that asked participants to rate their preparedness to (1) ''approach your veteran and discuss your concerns, if he/she is showing signs of post-deployment stress,'' (2) ''motivate your veteran to seek help at a VA hospital or Vet center, if he/she is showing signs of post-deployment stress,'' and (3) ''refer your veteran for help at a VA hospital or Vet center, if he/she is showing signs of post-deployment stress.'' Responses were on a 4-point Likert scale, and items were averaged to produce a single score. Surveys were completed at pretest (intervention and control groups), posttest (intervention group only), and 1-month follow-up (intervention and control groups).
Key Findings
In a randomized trial, family members, partners, or friends of veterans who returned from deployment within the last 4 years were assigned to the intervention group or a no-treatment control group. From pretest to follow-up, the intervention group showed a greater change in preparedness to approach, motivate, and refer a veteran with postdeployment stress compared with the control group (p < .05).
Studies Measuring Outcome
Study 1
Study Designs
Experimental
Quality of Research Rating
2.4
(0.0-4.0 scale)
Outcome 3: Self-efficacy in motivating veteran to seek help at a VA hospital or Vet center
Description of Measures
This outcome was measured using two survey items that asked participants to rate their level of agreement with the following statements: ''I feel confident in my ability to have conversations with my veteran about concerns I have about his/her post-deployment stress'' and ''I feel confident in my ability to assist my veteran in seeking help at a VA hospital or a Vet center.'' Responses were on a 4-point Likert scale, and items were averaged to produce a single score. Surveys were completed at pretest (intervention and control groups), posttest (intervention group only), and 1-month follow-up (intervention and control groups).
Key Findings
In a randomized trial, family members, partners, or friends of veterans who returned from deployment within the last 4 years were assigned to the intervention group or a no-treatment control group. From pretest to follow-up, the intervention group showed a greater increase in self-efficacy, or confidence in their ability to motivate a veteran to seek help at a VA hospital or Vet center, compared with the control group (p < .05).
Studies Measuring Outcome
Study 1
Study Designs
Experimental
Quality of Research Rating
2.5
(0.0-4.0 scale)
Outcome 4: Intention to approach veteran to discuss concerns
Description of Measures
This outcome was measured using the following survey question: ''As a result of this course, how likely are you to approach your veteran and discuss your concern if he/she begins to or is showing signs of post-deployment stress?'' The version of this question asked of the control group omitted the ''as a result of this course'' stem. Responses were on a 4-point Likert scale ranging from not likely to very likely. Surveys were completed at pretest (intervention and control groups), posttest (intervention group only), and 1-month follow-up (intervention and control groups).
Key Findings
In a randomized trial, family members, partners, or friends of veterans who returned from deployment within the last 4 years were assigned to the intervention group or a no-treatment control group. From pretest to follow-up, the intervention group showed a greater change in intention to approach their veteran to discuss concerns compared with the control group (p < .05).
Studies Measuring Outcome
Study 1
Study Designs
Experimental
Quality of Research Rating
2.4
(0.0-4.0 scale)
Outcome 5: Intention to mention the VA as a helpful resource
Description of Measures
This outcome was measured using the following survey question: ''As a result of this course, if you speak to your veteran about your concern regarding their post-deployment stress, how likely are you to mention the VA as a resource that can assist them?'' The version of this question asked of the control group omitted the ''as a result of this course'' stem. Responses were on a 4-point Likert scale ranging from not likely to very likely. Surveys were completed at pretest (intervention and control groups), posttest (intervention group only), and 1-month follow-up (intervention and control groups).
Key Findings
In a randomized trial, family members, partners, or friends of veterans who returned from deployment within the last 4 years were assigned to the intervention group or a no-treatment control group. From pretest to follow-up, the intervention group showed a greater change in intention to mention the VA as a resource to a veteran with postdeployment stress compared with the control group (p < .05).
Studies Measuring Outcome
Study 1
Study Designs
Experimental
Quality of Research Rating
2.4
(0.0-4.0 scale)
Study Populations
Study
Age
Gender
Race/Ethnicity
Study 1
18-25 (Young adult)
26-55 (Adult)
55+ (Older adult)
67% Female
33% Male
66% White
21.3% Black or African American
7.4% Hispanic or Latino
4.3% Asian
1.1% American Indian or Alaska Native
Quality of Research Ratings by Criteria (0.0-4.0 scale)
Outcome
Reliability
of Measures
Validity
of Measures
Fidelity
Missing
Data/Attrition
Confounding
Variables
Data
Analysis
Overall
Rating
1: Preparedness to recognize signs of postdeployment stress
1.5
2.3
2.3
2.5
2.0
3.8
2.4
2: Preparedness to discuss concern with veteran and motivate him or her to seek help at a VA hospital or Vet center
1.5
2.5
2.3
2.5
2.0
3.8
2.4
3: Self-efficacy in motivating veteran to seek help at a VA hospital or Vet center
2.0
3.0
2.3
2.5
1.5
3.8
2.5
4: Intention to approach veteran to discuss concerns
1.3
3.3
2.3
2.5
1.5
3.8
2.4
5: Intention to mention the VA as a helpful resource
1.5
2.3
2.3
2.5
2.0
3.8
2.4
Study Strengths
Study Weaknesses
Materials Reviewed
Readiness for Dissemination Ratings by Criteria (0.0-4.0 scale)
Implementation
Materials
Training and Support
Resources
Quality Assurance
Procedures
Overall
Rating
4.0
4.0
4.0
4.0
Dissemination Strengths
Dissemination Weaknesses
Item Description
Cost
Required by Developer
Program license (includes student access to course and administrator access to downloadable implementation manual, promotional materials, usage reports, and participant surveys)
Starting at $500, depending on the number and size of the learner population. Statewide/systemwide licenses are available.
Yes
Consultation and technical assistance by phone or email (includes two, 1-hour initial consultation sessions by phone and additional consultations, as needed)
Included with license
Yes
Additional Information