Form 0920-1050 CDC Flu Usability Survey

Attachment F

CDC Flu Usability: Activities/Follow up Questions

CDC Flu Usability

The list below illustrates activities and questions used to assess the usability of CDC’s Flu website. Participants will do the following activities and questions which will not exceed 20 minutes.

Form Approved

OMB No: 0920-1050

Expiration Date: June 30, 2025

Background Information

1. Which country are you a citizen of?

2. Are you an employee of the United States federal government? 

3. Have you participated in an Optimal Workshop survey with the Centers for Disease Control and Prevention (CDC) within the past year?

4. Which of the following websites have you visited in the past 6 months? 

• CDC.gov

• WebMD

• Mayo Clinic

• National Institutes of Health

• Healthline

• Johns Hopkins

• PubMed/PubMed Central

• UptoDate

• Cleveland Clinic

• World Health Organization

• New England Journal of Medicine

5. Which of the following best describes the industry you work in?

• Advertising, Marketing or Public Relations

• Airlines, Aerospace and Defense

• Arts and Design

• Automotive

• Broadcast Media and Publishing

• Business Support and Logistics

• Construction, Machinery and Homes

• Education

• Entertainment, Leisure and Travel

• Finance and Financial Services

• Food and Beverages

• Government

• Healthcare and Pharmaceuticals

• Insurance

• Legal

• Manufacturing

• Nonprofit

• Real Estate

• Retail and Consumer Durables

• Telecommunications, Technology, Internet and Electronics

• Utilities, Energy and Extraction

• Other

6. What is the highest level of education that you have completed?

• Did not graduate high school

• High school diploma or GED

• Some college

• Associate degree

• Bachelor’s degree

• Master’s degree

• Doctorate degree

7. What is your employment status?  

• Working full time

• Working part time

• Looking for work

• Retired

• Unemployed

• Student

• Other

8. How often do you provide patient care?

• 3 or more days a week

• 1-2 days a week

• A few times a month or less often

• I don’t provide patient care

9. Which best describes your title?

• Nurse

• Physician, actively seeing patients

• Physician, primarily conducting research

• Nurse practitioner

• Physician assistant

• Pharmacist or pharmaceutical assistant

• Office/clinic manager

• Medical assistant

• Medical tech

• Dentist

• Dietitian

• Occupational therapist/physical therapist

• Respiratory Therapist

• Social worker

• Psychologist/therapist

• Administrator/management

• Veterinarian

• Epidemiologist

• Health educator

• Health communicator

• Public health advocate

• Research scientist

• Policy specialist

Introduction

Task 1: You searched for information on the flu and landed on this page. Take a minute or so to look through the page and scroll.

[Link would open up to: https://www.cdc.gov/flu/]

Task 2: Click where you would go to find more information about the symptoms of the flu. (Do not use the search function for this task or any task today.)

[Link would open up to: https://www.cdc.gov/flu/symptoms/index.html]

Task 3: Thinking back to the previous task, indicate where you went to accomplish the task. [multiple choice]

• The top navigation area of the page

• The bottom area of the page (dark blue)

• The area called Related Pages (light blue)

• None of the above/I did something else

• I couldn’t find the page/I wasn’t sure where to go

Task 4: How easy or difficult was it to find this page?

[Link would open up to: https://www.cdc.gov/flu/symptoms/index.html]

[5 point rating scale: Very difficult to Very easy]

Task 5: Take a minute to look at the page you’re on. What is NOT a symptom of the flu?

[Link would open up to: https://www.cdc.gov/flu/symptoms/index.html]

• Runny or stuffy nose

• Body aches

• Fever

• Chest pain

Task 6: How easy or difficult was it for you to find the information on this page?

[5 point rating scale: Very difficult to Very easy]

Task 7: How would you rate the content on this page?

[5 point rating scale: Very unclear to Very clear]

Task 8: How would you rate the ability to scan for information on this page?

[5 point rating scale: Very difficult to Very easy]

Task 9: You searched for information on preventing the flu and landed on this page. Take a minute or so to look through the page and scroll.

[Link would open up to: https://www.cdc.gov/flu/prevent/index.html]

Task 10: [From pervious page] Click where you would go to find more information about treating the flu.

Task 11: Thinking back to the previous task, indicate where you went to accomplish the previous task. [multiple choice]

• The top navigation area of the page

• The bottom area of the page (dark blue)

• The area called Related Pages (light blue)

• None of the above/I did something else

• I couldn’t find the page/I wasn’t sure where to go

Task 12: How easy or difficult was it to find this page?

[link would open to: https://www.cdc.gov/flu/treatment/treatment.htm]

[5 point rating scale: Very difficult to Very easy]

Task 13: Take a minute or so to look through the Treatment page and scroll.

[Link would open up to: https://www.cdc.gov/flu/treatment/treatment.htm]

Task 14: [From previous page] Looking through the page, find out what to do if you get sick.

Task 15: Thinking back to the previous task, indicate how you accomplished the previous task. [multiple choice]

• I scrolled to find the answer

• I used the “On This Page” function to jump to the right area

• I couldn’t find the answer/I wasn’t sure where to look

Task 16: How easy or difficult was it to find this information?

[5 point rating scale: Very difficult to Very easy]

Task 17: Imagine you wanted to see all the information this site has about the flu. Click where you would go.

[Link would open up to: https://www.cdc.gov/flu/index.htm]

Task 18: Thinking back to the previous task, indicate where you went to accomplish the previous task. [multiple choice]

• The top navigation area of the page

• The bottom area of the page (dark blue)

• The area called Related Pages (light blue)

• None of the above/I did something else

• I couldn’t find the page/I wasn’t sure where to go

Task 19: How easy or difficult was it to find this page?

[link would open to: https://www.cdc.gov/flu/index.htm]

[5 point rating scale: Very difficult to Very easy]

Task 20:

[Link would open up to: https://www.cdc.gov/flu/index.htm]

Imagine after reading about the flu you are now interested in learning more about RSV because you’re interested in the differences between those two diseases. How would you search for information about RSV? When you have found search results related to RSV, move to the next task.

Task 21: [From previous page] Were you able to find and use one of these search functions?

[Link opens to an image showing top navigation with the two Search areas circled/boxed.]

• Yes

• No

Task 22: How satisfied are you with the search function?

[5 point rating scale: Very dissatisfied to Very satisfied]

Task 23: Do you have any comments about the search experience?

[Written response]

Post-Task Questions

Task 24: Please answer these questions about your overall experience today on CDC’s Flu site.

• Overall, how satisfied are you with this site?  [5-point Rating scale: Very dissatisfied to Very satisfied]

• Did you encounter any issues, errors or bugs today? If yes, please describe what you saw. If no, just write No. [Written question]

• How would you rate the visual appeal of this site? [5-point Rating scale: Very unappealing to Very appealing]

• How would you rate the usefulness of images and/or infographics on this site? [5-point Rating scale: Not at all useful to Very useful]

• How would you rate the layout of this site? [5-point Rating scale: Very dissatisfied to Very satisfied]

• How would you rate the content on this site? [5-point Rating scale: Very unclear to Very clear]

• How would you rate the ability to scan the pages for information?  [5-point Rating scale: Very difficult to Very easy]

• Which of the following words describes this site? (choose up to 3) [Multiple choice: Annoying, Attractive, Approachable, Busy, Clean, Cold, Complicated, Confusing, Expected, Fresh, Friendly, Intimidating, Inviting, Outdated, Overwhelming, Professional, Simple, Warm]

• How likely is it that you would recommend this site to a friend or colleague? [11-point Rating scale: Not at all Likely to Extremely Likely]

• What did you like most about this site? [Written response]

• If you could change one thing about this site, what would you change? [Written response]

Task 25: How helpful did you find this page element? [rating scale]

[Link opens to an image showing what a page summary/key points element looks like]

• Not very helpful to Very helpful

Task 26: How helpful did you find this page element? [rating scale]

[Link opens to an image showing what a callout box looks like]

• Not very helpful to Very helpful

11