Project Description

This study partnered with the University of Washington Behavioral Health Integration Program (BHIP).

Several recent studies have found that for evidence-based psychosocial interventions (EBPIs) to be delivered more effectively, sustained quality, ongoing supervision, and guidance is critical. This study developed an electronic support tool to support quality delivery of PST that is based on clinician feedback. We hypothesized that supporting clinician delivery of EBPIs will result in enhanced quality of treatment and better patient outcomes.

SettingUniversity of Washington Behavioral Health Integration Program (BHIP)
PopulationPrimary care clinicians delivering evidence-based psychosocial interventions

Intervention and/or Implementation Strategy Designed or Redesigned

InterventionElectronic support tool to support quality delivery of Problem Solving Therapy (PST) based on clinician feedback
Implementation StrategyThree-phase approach: qualitative interviews with clinicians, development of clinician support tool, and small randomized controlled trial testing

Impact

Enhanced quality of treatment delivery for evidence-based psychosocial interventions and improved patient outcomes through better clinician support and guidance

This project also directly led to the Signature R01 project in the center renewal, Redesigning Digital Clinical Decision Support Tool for Implementation of PST for Depression.

Project Publications

Problem Solving Treatment for Depression: Development and Pilot of an Internet-Based Support Tool Created Through Human Centered Design

Journal of Participatory Medicine

Abstract

Background: While Problem Solving Treatment (PST) for depression is an effective psychotherapy in primary care settings, it is not widely used and clinician fidelity to key elements drops quickly following training. Human-centered design (HCD) methods may help identify and address usability barriers that limit adoption and fidelity of evidence-based psychotherapies. 

Objective: This study aimed to use HCD methods to identify usability barriers in PST delivery, co-design a clinician- and patient-centered solution, and carry out a feasibility pilot study for implementation and clinical outcomes of this prototype. 

Methods: Using the Discover, Design, Build, and Test (DDBT) framework, we conducted observations and interviews with PST-experienced clinicians to identify usability challenges in PST delivery. Findings informed iterative co-design and development of PST Aid, a web-based clinical decision support and workflow support tool for PST. The resulting prototype underwent usability testing and was subsequently evaluated in a small pilot study incorporating clinician-level randomization to PST Aid or PST as usual. Measures include feasibility, usability, acceptability, clinician certification and fidelity measures, and patient depression outcomes. 

Results: The Discover phase identified multiple usability barriers affecting PST delivery, including perceived rigidity of the intervention, difficulties maintaining patient engagement and ownership of the problem-solving process, challenges with patient understanding of PST concepts, and inconsistent support for between-session activities. These findings informed rapid prototyping cycles carried out with co-design clinicians (9 undergoing PST training-as-usual and 10 experienced PST clinicians) and their patients (n = 4), which led to a web-based application that served to support and “scaffold” PST tasks as well as provide decision support for both providers and patients (PST Aid app). PST Aid features included interactive guidance prompts, structured problem tracking, and enhanced action planning tools. In pilot testing, clinicians rated PST Aid as having above-average usability (System Usability Scale score=76), while patients rated usability as acceptable (score=65). Acceptability, feasibility, and appropriateness ratings were high among both clinicians and patients. Clinicians using PST Aid demonstrated faster certification trends and encouraging fidelity maintenance compared with PST as usual, although the study was not powered for statistical comparison of these outcomes. Patients treated with PST Aid showed directionally greater reductions in depressive symptoms and a higher proportion achieved PHQ-9 scores below 10 at follow-up, though these findings should be considered exploratory given the small sample size. 

Conclusions: This study demonstrates the feasibility of applying HCD methods to identify implementation barriers and develop usability-focused supports for PST in primary care settings. The resulting prototype showed favorable usability, acceptability, and preliminary implementation signals in a small pilot study. These findings support further evaluation of HCD-informed implementation supports for evidence-based psychotherapies in larger, fully powered trials. 

Supporting implementation of evidence based psychotherapy through a user centered designed scaffolding technology approach

The Annals of Family Medicine (November 2023) · PDF

Abstract

Background: While Problem Solving Treatment (PST) for depression is an effective psychotherapy, it is not widely used and fidelity drops quickly following training. We sought to identify usability challenges and implementation solutions for clinicians who wished to deliver PST and to pilot such a solution. 

Methods: As part of the University of Washington ALACRITY Center (NIMH-P50MH115837), we applied the Discover, Design, Build, and Test human-centered design framework. Discover, Design, and Build stages included clinician observations and interviews (9 undergoing PST training-as-usual and 10 experienced PST clinicians), identification of themes and support needs for PST. Rapid prototyping cycles with these clinicians and their patients led to a web-based application which served to support and “scaffold” PST tasks as well as provide decision support for both providers and patients (PST Aid App). Randomization to training in PST as usual or PST-Aid of a new set of providers (clinical social workers who were part of the University of Washington Behavioral Health Integration Program and new to PST) was carried out to pilot a Type III hybrid effectiveness/implementation trial of this tool. Fidelity to PST and clinically significant improvement in depression (PHQ-9 scores) were the outcomes of interest. 

Results: 11 clinical social workers were randomized to study conditions (4 PST as usual, 7 PST Aid). No difference was found seen in baseline characteristics of clinicians (p>0.05). Patient age was significantly less in the PST Aid condition than in usual PST (p=0.03) but not for any other demographic characteristic (p>0.05). Baseline depression symptoms scores were not different between study conditions (p=0.43). More clinicians adopted PST in the PST-Aid group than those without the tool (72% vs. 50%; p<0.05). No difference between groups using fisher’s exact test (p = .07) for participants responding to treatment. However, 67% of participants in the treatment arm (PST Aid) responded to treatment, while 0% of participants receiving standard care responded to treatment. 

Discussion: We found that a user centered design approach to technology based “scaffolding” can support the adoption, reach, and sustained fidelity of an evidence based clinical intervention. Involving clinicians and patients in the design process may enhance the use and adoption of support tools. This pilot lays the groundwork for a large hybrid effectiveness/implementation trial.