R03 – Using Human-Centered Design to Adapt an Artificial Intelligence (AI)-Assisted Performance Feedback Implementation Strategy that Supports the Integration of Motivational Interviewing in Teen Helpline Services

Principal Investigators
Sylvanna M. Vargas, PhD, MPH, Assistant Professor, Department of Psychology, San Diego State University
Cari McCarty, PhD, Professor, Pediatrics, University of Washington
Project Description
Despite a drastic increase in public reliance on peer-delivered helpline services (e.g., hotlines, warmlines) in the United States, very little is known about how evidence-based interventions (EBIs) such as motivational interviewing can be further implemented in this service setting. Innovations in Artificial Intelligence (AI) are rapidly developing, and AI-assisted services such as Lyssn, an evidence-based performance feedback (PF) tool, have demonstrated initial validity to support large-scale implementation of EBIs. This project will adapt performance feedback as an implementation strategy and evaluate its usability, engagement, and appropriateness to increase the use of motivational interviewing on a mental health teen-to-teen helpline. We will utilize human-centered design methods to systematically evaluate the process of adapting Lyssn’s PF interface to support the integration of Motivational Interviewing among teen helpers in Here App, a large helpline that provides teen-to-teen emotional support under the supervision of mental health staff. A Discover, Design/Build, Test model will be used. The discover stage will rely on teen helper and helpline supervisor/ leadership focus groups to assess usability issues and initial redesign solutions to support the uptake of this AI-assisted PF implementation tool. The design/build stage will involve iterative rapid prototyping through sustained engagement with participants completing surveys, cognitive interviews and focus groups to develop an adapted, tailored, teen-friendly PF interface that integrates Lyssn’s existing AI tools. The finalized adapted PF prototype will be used to support a larger grant application (NIMH K23) which will conduct a pilot feasibility implementation-effectiveness trial in teen-delivered helplines.
| Setting | Virtual platform |
| Population | Teen peer helpers in the United States who are volunteers serving teens ages 13-19 through the Teen Talk App |
| Timeline | August 2026 to July 2027 |
Intervention and/or Implementation Strategy Designed or Redesigned
| Intervention | Motivational interviewing |
| Implementation Strategy | Performance feedback facilitated by Lyssn – a service tool that uses a trained AI to provide performance feedback based on Motivational Interviewing adherence metrics. |
Anticipated Impact
This project has the potential to support motivational interviewing adherence and self-efficacy among peer helpers of a text-based helpline by adapting an existing tool (Lyssn). Advancing quality improvements to support the use of motivational interviewing within a helpline can help promote patient-level help-seeking in real life. The finalized prototype from this project will support an NIMH Career Mentored K23 grant application (Vargas) to conduct a feasibility hybrid effectiveness-implementation trial that will rely on a multi-component implementation strategy to promote MI adherence within a teen-delivered mental health helpline
