Measures and Guidance
UWAC-funded teams are required to collect common data on DDBT mechanisms and constructs to determine the impact of modifying intervention and implementation strategy targets. This data is used to support center-wide science, help teams select methods and measures based on project design objectives, and satisfy U.S. National Institute of Mental Health reporting requirements. Click on each mechanism and construct to access their definition, quantitative and qualitative measurement methods and instruments.
DDBT Mechanisms
-
Usability
Assessed through usability evaluation, which includes methods such as heuristic evaluations, usability testing, cognitive walkthroughs, and standardize surveys (e.g., System/Intervention/Implementation Strategy Usability Scale). Read More →
-
Engagement
Assessed through the User Responsiveness Scale, observation, self-report, and telemetry (for digital interventions and implementation strategies). Read More →
-
Appropriateness
Assessed through the Intervention Appropriateness Measure (IAM) survey and goodness-of-fit interview. Read More →
Proximal Implementation Outcomes
-
Adoption and Reach
Outcomes from the Consolidated Framework for Implementation Research (CFIR) and Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) frameworks measured uniquely for each project. Read More →
-
Intervention and Implementation Strategy Fidelity
Measured by comparing the intended, original evidence-based intervention or implementation strategy protocol with the intervention or implementation strategy as delivered (fidelity of practice). This is measured uniquely for each project. Read More →
-
Planned Adaptations (i.e., Redesign Solutions)
Assessed using a UWAC-developed survey based on Framework for Reporting Adaptations and Modifications to Evidence-based practices (FRAME) and Framework for Reporting Adaptations and Modifications to Evidence-based Implementation Strategies (FRAME-IS) to capture adaptations made proactively (e.g., as part of the design process). Read More →
-
Unplanned/ Reactive Modifications
Assessed using a UWAC-developed survey based on Framework for Reporting Adaptations and Modifications to Evidence-based practices (FRAME) and Framework for Reporting Adaptations and Modifications to Evidence-based Implementation Strategies (FRAME-IS) to capture adaptations made reactively (e.g., after intervention deployment). Read More →
Distal Service Recipient Outcomes
PROMIS is a rigorously developed system of patient-reported outcome measures that enables standardized assessment of physical, mental, and social health across diverse patient populations.
The Top Problems Assessment (TPA) is a brief, idiographic tool that asks youth and caregivers to identify and rate the severity of the most important behavioral or emotional problems from their own perspectives, providing a personalized way to monitor change during treatment.
The DSM-5 Level 1 Cross-Cutting Symptom Measure is a 23-item survey that screens for the presence and severity of symptoms spanning 13 psychiatric domains, enabling clinicians to identify trans-diagnostic mental health concerns.
The RCADS-25 is a psychometrically validated tool that screens and monitors anxiety and depression symptoms in 8- to 18-year-old youth through child or parent report using a 4-point Likert scale.
The PHQ-9 is a nine-item, self-report questionnaire that screens for, diagnoses, and tracks the severity of depression by assessing DSM-based depressive symptoms experienced over the past two weeks. The GAD-7 is a seven-item self-report questionnaire designed to screen for and measure the severity of generalized anxiety symptoms over the past two weeks.
WHODAS 2.0 is developed by the WHO to measure disability and functional health status across six domains of daily life, allowing standardized comparisons across multiple health conditions and cultures.
Demographic And Process Measures
-
Demographics
Participant collected demographic data based on project needs and U.S. National Institute of Mental Health requirements. Read More →
-
User Needs & Experience
Needs and experiences of direct/primary users (people who directly interact with the intervention and implementation strategy) and indirect/secondary users (people affected by the intervention and implementation strategy) are assessed differently based on project. Methods frequently used include: interviews, focus groups, observation, comparative testing (e.g., A/B testing), and co-design. Read More →
-
Participant Research Burden, Incentive Appropriateness, and Research Satisfaction
Assessed at the end of a project with a six question survey to study participants to measure their perceived burden of participating in the study, appropriateness of the level of compensation offered, and overall satisfaction with the study experience. Read More →
-
Adherence to DDBT Process (DDBT Fidelity and Cost Measure)
Assessed using a UWAC-developed survey to characterize completion of goals in each DDBT phase, methods used to support each goal, and the total cost of redesign (disaggregated by phase and activity). Read More →
-
Team Collaboration, Trust, and Respect
Assessed using a UWAC-adapted survey of the Transdisciplinary Tobacco Use Research Center’s measure of Team Collaboration and Transdisciplinary Integration. This survey focuses on team member’s satisfaction with collaboration, impact of collaboration, trust, and respect. Read More →
-
Community Participation in Research
Assessed using a UWAC-adapted survey of an existing measure of community participation in research to characterize the extent to which teams engage users across 6 dimensions: identification of design issues, design activities, use of resources, design methods, indicators of success, and sustainability. Read More →
-
Investigator Satisfaction with the Support They Receive from the Center
Assessed using a UWAC-developed survey asking teams their satisfaction with support from UWAC. Read More →