[OPHDST] MVPS CaseBridge

[OADC] CDC Usability and Digital Content Testing

Appendix A_CaseBridge

[OPHDST] MVPS CaseBridge

OMB: 0920-1050

Document [docx]
Download: docx | pdf

Form Approved

OMB Control No. 0920-1050

Exp Date: 06/30/2025


  1. Email outreach to STLT beta partners:

Hi [STLT PoC Name], 

Our team would like to invite you to join a group call with our 4 other jurisdictional beta partners on [Date] where we will share learnings and updates from our MMG Onboarding Beta Program.  During this call, we will share an update on our team’s progress in addition to themes from speaking with yourself and other beta program jurisdictions, the CDC MMG Onboarding (edx) Team, CDC Programs, APHL, and the NBS GDIT team. We’re interested in hearing your questions and feedback in addition to any additional context and clarification on our understanding of the jurisdictional MMG Onboarding process and pain points that you would like to provide. Please let us know if this date and time doesn’t work for you, and we can find a time that works better for you and the other beta partners. We are also happy to send you the slide deck and a recording of the call if you prefer. 


As part of our team’s progress update, our designer has created initial designs for a jurisdiction self-service MMG Onboarding tool called “CaseBridge” which will incorporate the Implementation Spreadsheet and Test Case Scenario Worksheet and provide validation for both spreadsheets and uploaded HL7v2 test messages. Following the Beta Program group call, we’ll send you an invitation to schedule a user input session for the CaseBridge designs. We’ll have you click through the designs as though you’re onboarding to a new MMG, completing the Implementation Spreadsheet, and receiving automated, real-time feedback within the tool. Your input will directly inform updates to these designs. Below is a screenshot of one of our CaseBridge designs which we’ll have you click through and provide feedback on during the user input session. 

 

[insert screenshot of tool] 

It is completely optional to participate in both the group call and the user input session. If you are unable to participate at this time, we’re happy to keep you updated on our team’s progress, and you can choose to opt out of these emails at any time. We want to be respectful of your time and are high appreciative of the input you’ve already provided us from our previous conversation. Hearing your MMG Onboarding process and pain points helped inform the creation of the CaseBridge designs, and we hope this tool can reduce  MMG Onboarding time in addition to reducing manual entry and error and back-and-forth communications with APHL and the CDC MMG Onboarding (edx) team.  


Please reach out if you have any comments or questions and feel free to forward this email to anyone else at your health department who would be appropriate for this project! 




  1. Semi-structured user testing guide


Agenda

  1. Intros/warm-up (~2-4 min)

  2. Follow up requirements gathering questions (~10-15 min)

  3. CaseBridge demo (~30-40 min)

  4. Wrap up and next steps (~5 min)

Intros/warm-up (2-4 mins)

[Provide an overview of what to expect without disclosing too many details that could bias the outcome.] Thank you for taking the time to review our initial designs for CaseBridge, a jurisdiction self-service tool for MMG Onboarding.

(if there are individuals on the call we haven’t spoken with yet) I’m Peggy from Skylight, a government contractor working with the CDC to improve the MMG Onboarding process.

With me on the call are a few colleagues (including [members of our product and development team], [Marion] who will be helping out with notetaking and may raise their hand with follow up questions during the call.

(if there are individuals on the call we haven’t spoken with yet) During this session, I’ll first ask you a couple requirements gathering questions about your role within [STLT] and your work as it relates to MMG onboarding: test message validation. Then I’ll send you a link to a clickable design and ask you to share your screen with the design open.

We anticipate this session will take about 1 hour. Is that all right with you?

[Remind them of confidentiality and ethical standards] We take your privacy seriously. We won’t share any personal information about you. We won’t record your identity or sensitive information about you in our requirements gathering findings or share outs. That being said, we would like to record this session so we can transcribe it. We do have a team member on the call taking notes if you are not comfortable with recording. Do we have your permission to record?

[if yes] I’m going to go ahead and start the recording now. [hit record on ZoomGov Webinar]

Do you have any questions before we begin?

Questions

Requirements Gathering Questions (if there are individuals on the call we haven’t spoken with yet)

  1. Can you tell me a bit about your background and current role?

    1. [if not answered above] Are you involved with reporting case notification data (such as MMG HL7v2, NETSS, GenV1, etc.) to NNDSS?

      1. [If not] Who at your agency is responsible for this work?

      2. Are other offices/divisions within your agency involved? Do you have vendors involved?

      3. [If yes] How are you involved with reporting case notification data?

        1. [if yes] Are you involved with onboarding MMGs (message mapping guides)?

          1. [if yes] Are you involved with preparing the implementation spreadsheet, test case scenario worksheet, and/or test messages for implementing MMGs?

  2. Based on our understanding, you are using [surveillance system] and have onboarded to [MMGs] and are currently onboarding to [MMGs]. Is that correct?

    1. Which MMGs have you been involved in onboarding / are you currently working on onboarding?

    2. How do you prioritize which MMG to onboard next?

Follow up questions for existing beta partner STLTs

  1. Which MMG(s) do you plan to onboard next?

    1. How do you prioritize which MMG to onboard next?

  2. How many individuals at [STLT] will directly fill out and edit the IS & TCSW during the MMG pre/onboarding process?

    1. When would the individual editing the spreadsheet change (personnel changes, staff busy with other projects, etc.)?

    2. Do individuals ever fill out the IS & TCSW simultaneously? Please describe.

  3. How do you currently use the filled out IS (e.g., during Gap Analysis, meetings with STLT Disease Program epis, etc.)?

  4. (if multiple people in call) Who will be clicking through the CaseBridge design for today’s demo today?

    1. (if haven’t spoken with this individual previously)

      1. How much experience have you had with onboarding to MMGs?

      2. Do you typically fill out the IS & TCSW? Which additional steps do you do?

Tasks

Great! Now we’ll move to the demo portion. I’ll provide you with various tasks that mimic your current process when filling out the Implementation Spreadsheet during MMG Pre-Onboarding, and I’d like you to click through the CaseBridge design to complete these tasks. Throughout this session, I’d like you to "think aloud”. This means to say what you’re thinking at that moment, like “oh hmm I see this button says “Submit” but given what I’m seeing on the screen, I’m not sure what will actually happen when I click it. I guess I’ll go click it” and so on. Please be as open and honest as possible so we can make changes to ensure this feature meets your needs. Also, please keep in mind I may not answer your questions immediately and instead will ask you to take your best guess if you’re not sure what the next step should be or if you’re confused by something—this is so we can better understand what changes we should make to CaseBridge so it best meets your needs. NOTE: this is a prototype so can’t click everything

Scenario: We’re going to imagine that you’re the onboarding [GenV2 MMG] for [STLT]. At this point, you’ve completed the initial gap analysis steps and mapped your surveillance system [case report form/page] to the MMG specifications and are ready to fill out the Implementation Spreadsheet using the CaseBridge Data Planner.

[Instructions for screen sharing and thinking aloud] I’m going to send you a link to a clickable CaseBridge design. I’ll ask you to open this link and then share your screen. Please minimize any windows you wouldn't want us to see or have recorded.

[Send link in the ZoomGov chat]: Let me know if you have any issues with accessing this link.

CaseBridge: Dashboard First Impressions

  1. Tell us your first impressions of this screen.

    1. [optional follow up questions depending on what participant says organically]

      1. What was the first thing you noticed?

      2. What about this page do you like, if anything?

      3. What about this page do you dislike, if anything?

      4. What, if anything do you find confusing?

      5. [content follow up questions]

        1. Is the messaging on the page clear to you? If not, what isn’t clear? Please describe.

        2. Is there any area of the page where you could use more context / explanatory text?

  2. Do the 3 steps make sense to you based on your experience with the CDC MMG Onboarding process? Why/why not?

    1. What, if anything, is missing?

    2. What, if anything, seems out of order?

  3. What information in the Recent activity table is useful to you? Why/how would you use that information?

    1. What information, if any, is missing?

    2. What information, if any, is confusing?

    3. Looking at the 3 MMGs in the table, at which stage is the...

      1. Hepatitis MMG?

      2. Meningitis MMG?

  4. When would you Delete a Data Planner? Please describe.

    1. When would you want to un-delete a Data Planner? Please describe.

Task 1: Onboard to a new MMG

  1. We know that at this point, you would have most likely onboarded to the GenV2 MMG prior to onboarding to the other MMGs. But for the purposes of this session, we’ll now ignore the MMGs in the Recent activity bucket and imagine you’d like to onboard to the GenV2 MMG. How would you go about doing that?

    1. Click “START A NEW PLAN”

    2. Click “TYPE OR SELECT”

    3. Click “SELECT AND CONTINUE”

  2. How was the process of selecting an MMG?

Task 2: Review Data Planner for GenV2 MMG

Data Planner

  1. Is this what you expected to see? Why/why not?

Feel free to scroll up and down on this page and tell us what you think as you look through it.

  1. Are the instructions on this page helpful or not helpful? Why?

    1. What additional instructions would be helpful to include? Where?

  2. Is the option to print out a blank Data Plan useful? If so, how would you use it? Please describe.

  3. What information on this screen is useful to you when filling out this form? How do you use this information?

  4. Are the data elements grouped and ordered how you would fill them out? Why / why not?

  1. Is the language of Save Progress vs. Review Data Plan vs. Save Data Plan and Download CSV clear?

    1. What do you expect to happen when you click...

      1. Save Progress?

      2. Review Data Plan?

      3. Save Data Plan and Download CSV?

  2. What would you expect to see when clicking on View Help Content? What would be useful to you?

  3. How would you find out more information about the Message profile identifier data element?

    1. Click View Metadata

    2. Is this information useful to you? Why/why not? When would you use this information?

    3. Would you want this more visible?

    4. (add in looking at priority info)

Task 3: Fill out Collected status for an individual data element

  1. How would you go about marking the Message profile identifier as “Not Collected”?

    1. What thoughts do you have on these options?

      1. Do they make sense? Why/why not?

      2. What’s missing or should be changed if at all?

    2. How would you go about adding a “Not collected reason” for the message profile identifier data element?

      1. Click EDIT button under Notes

      2. Is that what you expected to see when clicking the “EDIT” button? Why/why not?

      3. What are your thoughts on the information within the Notes section?

      4. What would you typically fill out in the Notes section?

Task 4: Use Bulk Actions to filter for high priority DEs and bulk select collected status

  1. How would you go about marking all the Priority R, 1, and 2 Subject related data elements as “Collected”?

    1. Click Only High Priority filter

    2. Select all checkbox

    3. Click BULK ACTIONS

    4. Click Change collection status

    5. Click Yes

    6. Would you bulk mark data elements as collected or not collected based on priority level? Why/why not?

  2. What would you do if you wanted to save what you’ve done and switch to another task?

    1. How often does this typically happen?

    2. Click Save Progress

    3. How would you go about finding this GenV2 MMG Data Planner again?



Task 5: Review and fix errors in Data Planner

  1. Imagine you’ve filled out this portion of the Data Planner and now you want to have the tool check for errors. How would you go about doing that?

    1. Click Review Data Plan

    2. Review the errors. Which errors make sense vs. not? How would you go about fixing each of these 4 errors?

  2. How would you share this Data Planner with other individuals such as disease program epidemiologists at [STLT] for review and discussion?

    1. Click Save Data Plan and Download CSV

    2. Is that what you expected to see? Why/why not?

    3. When would you use this spreadsheet?

    4. When would you use the Data Planner vs. the spreadsheet for purposes within [STLT]? Please describe.

Dashboard

  1. Is this what you expected to see? Why/why not?

  2. How would you review GenV2 Data Planner?

    1. Is there a scenario where you would want to edit an MMG Data Plan again or delete a filled out Data Plan? Please describe.

Follow up questions

  1. How was the overall experience using CaseBridge?

    1. What do you like? What do you dislike?

    2. What did you think of the Dashboard?

    3. What did you think of the Data Planner?

      1. How does it compare to your current MMG pre-onboarding process when completing the Implementation Spreadsheet?

    4. If you could wave a magic wand, what would you change about CaseBridge?

  2. We plan to incorporate the Test Case Scenario Worksheet into CaseBridge Data Planner next, and our team has a few questions to so we can hopefully reduce the manual entry burden during this step.

    1. For jurisdiction specific values in the TCSW, are they the same across all MMGs (e.g., reporting jurisdiction)? Or does each MMG have a different jurisdiction specific value?

    2. We currently plan to prefill the Data Planner using CDC provided default values and then let the jurisdiction change the values to jurisdiction specific values where appropriate. What are your thoughts on this approach?

Wrap up & Next Steps

Thank you so much for taking the time to provide your feedback on the initial CaseBridge designs! We’re speaking with other jurisdictions in our beta program to look for areas of improvement in CaseBridge.

  1. Would you be interested in participating in more requirements gathering and demo sessions in the future?

Please feel free to share this design link with other relevant individuals within your jurisdiction, but please be mindful not to share this link with individuals outside of your jurisdiction at this time. We are still making improvements before we’d want to share updated CaseBridge designs to a broader audience. If you think of any additional comments or areas of improvement, please feel free to email myself or [staff].

----------------------------------------------------------------------------------------------------------------------------

Public reporting burden of this collection of information is estimated to average 60 minutes per response, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. An agency may not conduct or sponsor, and a person is not required to respond to a collection of information unless it displays a currently valid OMB Control Number. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden to CDC/ATSDR Reports Clearance Officer, 1600 Clifton Road NE, MS H21-8, Atlanta, Georgia 30333; ATTN: PRA 0920-1050

8

File Typeapplication/vnd.openxmlformats-officedocument.wordprocessingml.document
File Modified0000-00-00
File Created0000-00-00
© 2025 OMB.report | Privacy Policy