Measures & Guidance > DDBT Process
Assessed using a UWAC-developed survey to characterize completion of goals in each DDBT phase, methods used to support each goal, and the total cost of redesign (disaggregated by phase and activity).
DDBT Fidelity and Cost Measure
The purpose of this survey is to gather details related to how your team has used the DDBT framework to guide redesign of clinical interventions and/or implementation strategies. There are core goals that can be completed in each DDBT phase. We will ask you to report which goals your team completed, and then to detail design activities that contributed to those goals.
You are reporting on the Discover phase. We estimate that it will take teams about one to two hours to complete the survey, depending on how many activities you conducted. We suggest you complete this form as a team or, at minimum, with all Principal Investigators. We have provided a PDF of a complete example so you can see the depth of responses we are looking for and preview the questions before filling out this REDCap measure. REDCap will guide you through the steps, and you can pause and resume at any time using your unique survey link. You can also return to earlier survey pages as needed for clarification or modification.
For naming the design activities that you used, some resources that may be helpful include:
- Dopp, A.R., Parisi, K.E., Munson, S.A. and Lyon, A.R., 2019. A glossary of user-centered design strategies for implementation experts. Translational behavioral medicine, 9(6), pp.1057-1064.
- Hanington, B. and Martin, B., 2019. Universal methods of design expanded and revised: 125 Ways to research complex problems, develop innovative ideas, and design effective solutions. Rockport publishers. Preview here through Google Books.
- Kumar, V., 2012. 101 design methods: A structured approach for driving innovation in your organization. John Wiley & Sons. Preview here through Google Books.
- Creative Reaction Lab., 2018. Equity-centered community design field guide. Available here.
When ready, click here to begin. Brief project name/description:
People who completed this form:
DISCOVER PHASE | |
Goals Completed To begin, please check off all goals completed for your project during the Discover phase. The purpose of the Discover phase is to gather information about (a) the context of implementation and (b) the clinical intervention and/or implementation strategy, to identify needs and priorities for redesign in later phases. By “direct users” (also known as “primary users”), we are referring to people who directly interact with the intervention or strategy. By “indirect users” (also known as “secondary users”), we are referring to people affected by the intervention or strategy. For example, if a clinician uses a system in their interactions with a patient, the clinician would be the direct user and the patient would be the indirect user. | |
☐ | Understand needs and perspectives of direct users |
☐ | Understand needs and perspectives of indirect users |
☐ | Understand the context of the clinical intervention and/or implementation strategy |
☐ | Understand the appropriateness of the original clinical intervention and/or implementation strategy |
☐ | Understand the usability of the original clinical intervention and/or implementation strategy |
☐ | Understand user engagement with the original clinical intervention and/or implementation strategy |
☐ | Understand the original clinical intervention and/or implementation strategy from an equity lens (including how/why/for whom it works and potential sources of disparities) |
☐ | Other goals [describe]: |
When finished, click here to continue.
Design Activities that Contributed to Goals
Think about the full range of design activities that your team used to complete the Discover Phase. For each discrete design activity, please specify all details requested below. These details will help us understand the activities involved in completing the Discover phase.
By “design activity,” we mean activities focused on understanding and maximizing the usability of the clinical intervention and/or implementation strategy of interest. (Hover your cursor HERE for resources that may be helpful in identifying activities.)
By “discrete,” we mean you can clearly describe how many times the activity occurred, who was involved, and what resources and costs were involved. Discrete design activities may have multiple steps or components involved, if you can still provide the requested details for the entire activity; you can present activities in whatever way makes the most sense for your project.
Once you have specified one activity, you can choose to specify another activity; after all design activities are specified, you can continue to the next page.
Name of activity | ||||
Please briefly describe how the activity was completed and its purpose or rationale | ||||
Which goal(s) in the Discover phase did this activity contribute to? Check all that apply. | ||||
☐ Understand needs and perspectives of direct users ☐ Understand needs and perspectives of indirect users ☐ Understand the context of the clinical intervention and/or implementation strategy ☐ Understand the appropriateness of the original clinical intervention and/or implementation strategy ☐ Understand the usability of the original clinical intervention and/or implementation strategy ☐ Understand engagement with the original clinical intervention and/or implementation strategy ☐ Understand the original clinical intervention and/or implementation strategy from an equity lens (including how/why/for whom it works and potential sources of disparities) ☐ Other goals | ||||
Did you make any major modifications to the design activity in response to challenges or barriers that emerged when you tried to conduct the design activity as originally planned? | ||||
☐ Yes | ||||
☐ No | ||||
If yes, what were the modifications and why did they occur? | ||||
How many times total did this activity happen during the Discover phase? (In the total, count every instance the activity was done, including repeat activities with the same participants/users [such as a series of interviews or sessions]) | ||||
In a typical single instance of this activity for the Discover phase, who organized and executed the activity? (If this varied, please list the average, median, or otherwise most typical value) | ||||
Role or personnel type involved in activity (provide details for all roles/personnel, adding extra rows as needed) | # of individuals involved per instance | Estimated # hours spent per person, per instance (include prep and follow-up) | ||
In addition to specific instances of the activity, who spent time during the Discover phase creating and completing the activity? This refers to time spent preparing the activity before it was used, analyzing data collected, etc. | ||||
Role or personnel type involved in activity (provide details for all roles/personnel, adding extra rows as needed) | # of individuals | Estimated total hours spent per person for the activity | ||
In a typical single instance of this activity for the Discover phase, who spent time and effort completing the activity as a participant? (If this varied, please list the average, median, or otherwise most typical value) | ||||
Participant or user type (provide details for all participant and user types, adding extra rows as needed) | # of participants/users who completed activity | Estimated total $ payment received, across all instances of the activity per participant OR Estimated total hours spent per participant/user, across all instances of the activity (If per-person total varied, please list the average, median, or otherwise most typical value) | ||
What other resources or costs were involved in completing the activity during the Discover phase? (This could include materials, software, travel, or any other resources or expenses needed to complete the design activity. Only include direct, measurable project expenses) | ||||
Resource or expense (please provide a description) | Unit of resource/expense | Estimated $ amount for unit of resource/expense OR information about cost, if $ amount not known (If per-instance cost varied, please list the average, median, or otherwise most typical value) | ||
☐ Per-instance: Resource incurred once for each instance of the activity ☐ Overall: resource incurred once for the entire activity (not specific to # of instances) | ||||
☐ Per-instance ☐ Overall | ||||
Please share any other information you think is helpful for understanding this design activity and/or interpreting the information you reported in this form. This can include details of how certain or uncertain you were about the time and cost estimates provided. | ||||
Were there any other design activities you completed during this phase?
- ◻ Yes
- ◻ No
Thank you for completing the DDBT Fidelity and Cost Measure!
NOTE: This is the final page to complete before submitting your responses. The survey will remain active / in progress until you click “Click Here to Submit the Survey” below.
We appreciate your taking the time to provide this information. It will be very useful for understanding how the DDBT framework is being used in your project.
As a reminder, a member of the Methods Core team will arrange a follow-up meeting with you to review and clarify your responses. These are typically scheduled 1-2 weeks in advance. If you wish, you can provide details below to assist in scheduling that meeting; however, you can feel free to leave these questions blank and we will follow up with you directly.
Who from your team should participate in the follow-up meeting? Please limit to 3 people max, and please provide both names and email addresses. | |
Name | Email Address |
Are there any times that work well for these team members to meet in the next 1-2 weeks? If yes, please note dates and times, being as specific as you can. | |
Is there anyone else we should work with for scheduling the meeting? If yes, please provide name(s) and email address(es). | |
If you prefer to follow up directly about this survey for any reason, please contact Alex Dopp (adopp@rand.org), and he will be happy to assist.