Download:
pdf |
pdfCreative Forces Community Engagement Grant Program Evaluation
Attachment B – Instruments
Contents
Instrument 1 – Participant Survey ................................................................................. 2
Instrument 2 – Arts Engagement Facilitator Survey .....................................................10
Instrument 3 – Grantee Interview Protocol ..................................................................17
Instrument 4 – Partner Interview Protocol ...................................................................19
Instrument 5 – Participant Interview Protocol..............................................................21
Instrument 6 – Grant Leadership Interview Protocol ....................................................23
Instrument 1 – Participant Survey
INTRODUCTION TO PARTICIPANT SURVEY
Slight modifications may be made for each of the administration modes.
Thank you for participating in this survey for the Creative Forces®: NEA Military Healing Arts Network
Community Arts Engagement Grant Program Evaluation. This study is funded by the National
Endowment for the Arts. We are interested in learning more about the experiences and needs of the
people who participate in Creative Forces community arts programs. The survey takes about 10 minutes
to complete. We ask participants to take the survey two times: at the beginning of the program and
again at the end. You will receive a $30 eGift card in appreciation for your time after each survey in a
follow-up email.
For digital surveys: Your survey access code is unique to this survey. When you use this link, your
responses are entered into a database that does not include your name, but links the responses you
make on the survey at the beginning and end of the program. Your responses on this survey are
confidential and only the program researchers (Shawn Bachtler and Candace Gratama) have access to
the responses. The connection between you and the unique link is kept in a separate, password
protected file that only the researchers can access. Details about identifiers (e.g., unique access code,
use of email address) will be included here.
For paper surveys: Your survey code links the responses you make on the survey at the beginning and
end of the program. Your responses on this survey are confidential and only the program researchers
(Shawn Bachtler and Candace Gratama) have access to the responses. The connection between you and
the unique code is kept in a separate, password protected file that only the researchers can access.
No one associated with this program or Creative Forces will be able to see your survey or know whether
you completed the survey. Your answers will be kept confidential and combined with the answers from
other participants in Creative Forces programs. While the researchers will keep your information
confidential, there are some risks of data breeches when sending information over the internet that are
beyond the control of the researchers.
You should also know that:
● You must be 18 or older to take this survey.
● The survey is completely voluntary. You may skip any questions or quit at any time. If you decide
to withdraw, simply close the survey window.
● All information collected through this study will be kept in locked offices and on password
protected computers.
● Your participation in the Creative Forces program will not be impacted by whether or not you
choose to complete the survey.
● There are no benefits to you for taking this survey. There are no risks expected with
participation in this survey, although it is possible that some people may experience discomfort
when answering questions about making art, how connected they feel to others, and how they
handle challenges.
● The database with access codes will be permanently deleted at the end of the project on DATE.
If you have any questions about this survey, information can be obtained from Shawn Bachtler, Ph.D., of
ProgramWorks (shawnbachtler@gmail.com or 206-595-5878) or the National Endowment for the Arts at
research@arts.gov if you have any questions regarding the estimated time burden or any other aspect
of this data collection. If you have any questions about your rights as a participant in the study, you may
contact IRB Service (the body that oversees our protection of study participants) at (855) 226-4472
or participants@solutionsirb.com.
By completing this survey, you are consenting to participate in this study.
*Please feel free to print or save a copy of this form for your records.*
This version of the survey shows analyses related to the specific participant outcomes outlined in the logic models. The
form presented to grantees will show only the survey items.
PARTICIPANT SURVEY
POST-SURVEY ONLY: Self-report of current attendance and prior participation
1.
Self-report attendance and engagement questions will be tailored to each program according to their model.
A. Please estimate how often you participated in this program. [3 examples]
EX 1: How many sessions did you attend out of the eight sessions offered? _____
EX 2: This program offered two drop-in sessions each week. How many sessions have you attended over the past two months? ____
EX 3: In the past 30 days, approximately how many total hours have you been involved in the program?
o Less than 1 hour total
o 1 to 3 hours total
o 4 to 5 hours total
o 6 to 9 hours total
o 10 or more hours total
B. When I attended the sessions over the past 30 days, I took part in the activities:
o
o
o
o
2.
Very often
Often
Occasionally
Rarely
Have you previously attended this program or a similar program?
o Yes
o No
Please select the answer that fits best. For this survey:
● Art refers to all forms of art, such as visual art, music, theatre, dance, and so on.
● Engaging with art refers to observing art, such as watching a performance, viewing an exhibition, etc.
#
Item [source scale]
Analyses
Outcome
Items 3 – 32 use a 5-point Likert response scale: Strongly Disagree, Disagree, Mixed or Neither Agree nor Disagree, Agree, Strongly Agree
Through arts engagement art, I:
3.
4.
5.
a. Understand myself better. [CFCE 1]
b. Understand the things that matter most to me. [CFCE 1]
c. Feel understood by others. [CFCE 2]
d. Understand others better. [CFCE 3]
e. Feel connected to the military/veteran community. [CFCE 4]
f. Feel connected to the civilian community. [CFCE 5]
g. I am able to take chances in a safe, supportive environment. [CFCE 7]
h. Learn and improve creative skills. [CFCE 8]
Arts engagement improves my physical health. [CFCE 6]
Frequencies, change scores
Frequencies, change scores
Frequencies, change scores
Frequencies, change scores
Frequencies, change scores
Frequencies, change scores
Frequencies, change scores
Frequencies, change scores
Frequencies, change scores
Creative Expression
Creative Expression
Creative Expression
Creative Expression
Creative Expression
Creative Expression
Creative Expression
Creative Expression
Creative Expression
Arts engagement has a positive effect on my relationships with family or
close friends. [CFCE 9]
Frequencies, change scores
Creative Expression
Creative Expression Subscale (3 – 5)
6.
7.
8.
Total items 1 – 3; mean,
median, mode, range;
change scores
I enjoy getting lost in the process of engaging with the arts. [CFF2]
Frequencies, change scores
Creative Expression - Flow
My concentration improves when I’m fully absorbed in the arts. [CFF3]
Frequencies, change scores
Creative Expression - Flow
Being absorbed in the arts enables me to clarify thoughts or ideas I didn’t
fully understand before. [CFF 1]
Frequencies, change scores
Creative Expression - Flow
Creative Expression – Flow Subscale CFF (6 – 8)
Total items 4 – 6; mean,
median, mode, range;
change scores
9.
I am optimistic and hopeful about the future. [ESPS 13]
Frequencies, change scores
10.
I am grateful for people or opportunities in my life. [ESPS 14]
Frequencies, change scores
11.
I am proud of myself. [ESPS 15]
Frequencies, change scores
I am kind and understanding towards myself when I am going through a hard
time. [ESPS 16]
I am open minded to trying new experiences. [ESPS 17]
Frequencies, change scores
14.
I approach life with excitement and energy. [ESPS 18]
Frequencies, change scores
15.
I have purpose in my life. [ESPS 32]
Frequencies, change scores
16.
I have personal goals that I am working on achieving. [ESPS 33]
Frequencies, change scores
17.
I have a sense of direction in my life. [ESPS 34]
Frequencies, change scores
18.
I am working towards a common goal with other people. [ESPS 35]
Frequencies, change scores
19.
I feel part of something bigger than myself. [ESPS 36]
Frequencies, change scores
20.
My role in my family, work, or community is a positive source of self-worth
and connection to others. [ESPS 37]
Frequencies, change scores
12.
13.
Independence and Successful Adaptation to Civilian Life Sense of Purpose
Subscale (9 – 20)
Frequencies, change scores
Total items 7 – 18; mean,
median, mode, range;
change scores
21.
I put time and effort into helping others. [EECS 19]
Frequencies, change scores
22.
I feel a sense of belonging to a larger community. [EECS 20]
Frequencies, change scores
23.
I feel connected to my local community. [EECS 29]
Frequencies, change scores
24.
I participate in leadership activities that increase my sense of purpose. [EECS
38]
I participate in community service activities that increase my sense of
purpose. [EECS 39]
Frequencies, change scores
25.
Frequencies, change scores
Independence and Successful Adaptation to
Civilian Life
Independence and Successful Adaptation to
Civilian Life
Independence and Successful Adaptation to
Civilian Life
Independence and Successful Adaptation to
Civilian Life
Independence and Successful Adaptation to
Civilian Life
Independence and Successful Adaptation to
Civilian Life
Independence and Successful Adaptation to
Civilian Life
Independence and Successful Adaptation to
Civilian Life
Independence and Successful Adaptation to
Civilian Life
Independence and Successful Adaptation to
Civilian Life
Independence and Successful Adaptation to
Civilian Life
Independence and Successful Adaptation to
Civilian Life
Independence and Successful Adaptation to
Civilian Life
Independence and Successful Adaptation to
Civilian Life
Independence and Successful Adaptation to
Civilian Life
Independence and Successful Adaptation to
Civilian Life
Independence and Successful Adaptation to
Civilian Life
26.
I feel like a leader in my community. [EECS 40]
Independence and Successful Adaptation to Civilian Life Engaged
Citizenship Subscale (21 – 26)
Frequencies, change scores
Total items 19 – 24; mean,
median, mode, range,
change scores
Independence and Successful Adaptation to
Civilian Life
I tend to bounce back quickly after hard times. [BRS 1]
Frequencies, change scores
Resilience
28.
I have a hard time making it through stressful events. [BRS 2]
Resilience
29.
It does not take me long to recover from a stressful event. [BRS 3]
Frequencies, change scores
[reverse]
Frequencies, change scores
Frequencies, change scores
[reverse]
Frequencies, change scores
Resilience
Frequencies, change scores
[reverse]
Total items 25 – 30; mean,
median, mode, range,
Resilience Subscale (27 – 32)
change scores
5-point Likert response scale for item 31: Very Poor, Poor, Neither Poor Nor Good, Good, Very good
Resilience
27.
30.
It is hard for me to snap back when something bad happens. [BRS 4]
31.
I usually come through difficult times with little trouble. [BRS 5]
32.
I tend to take a long time to get over set-backs in my life. [BRS 6]
33.
How would you rate your quality of life? [WHOQOL-BREF G1]
Quality of life brief assessment (31)
Frequencies, change scores
Resilience
Resilience
Creative Forces general outcome: Quality of Life
Mean, median, mode,
range, change scores
5-point Likert response scale for item 32: Very Dissatisfied, Dissatisfied, Neither Satisfied Nor Dissatisfied, Satisfied, Very satisfied
34.
How satisfied are you with your health? [WHOQOL-BREF G4]
Well-being brief assessment (34)
Frequencies, change scores
Creative Forces general outcome: Well-being
Mean, median, mode,
range, change scores
7-point Likert response scale for items 35 – 46: Strongly disagree, Disagree, Disagree a little, Neither agree or disagree, Agree a little, Agree, Strongly agree
35.
When I am with other people, I feel included. [GBS 1]
Frequencies, change scores
Social Connectedness
36.
I have close bonds with family and friends. [GBS 2]
Frequencies, change scores
Social Connectedness
37.
I feel like an outsider. [GBS 3]
Frequencies, change scores
Social Connectedness
38.
I feel as if people do not care about me. [GBS 4]
Frequencies, change scores
Social Connectedness
39.
I feel accepted by others. [GBS 5]
Frequencies, change scores
Social Connectedness
40.
Because I do not belong, I feel distant during the holiday season. [GBS 6]
Frequencies, change scores
Social Connectedness
41.
I feel isolated from the rest of the world. [GBS 7]
Frequencies, change scores
Social Connectedness
42.
I have a sense of belonging. [GBS 8]
Frequencies, change scores
Social Connectedness
43.
When I am with other people, I feel like a stranger. [GBS 9]
Frequencies, change scores
Social Connectedness
44.
I have a place at the table with others. [GBS 10]
Frequencies, change scores
Social Connectedness
45.
I feel connected with others. [GBS 11]
Frequencies, change scores
Social Connectedness
46.
Friends and family do not involve me in their plans. [GBS 12]
Frequencies, change scores
Social Connectedness
Total items 35 – 346; mean,
median, mode, range
Subscale GBS
Demographics – used for descriptive statistics and as disaggregation variables
47.
Which best describes you? (check all that apply) [Creative Forces]
o Service Member
o
o
o
Active Duty
National Guard/Reserve
Veteran/Retiree
Spouse/Partner of a Service Member or Veteran
Active Duty Service Member
National Guard/Reserve
Veteran
Other Family Member of a Service Member or Veteran
Active Duty Service Member
National Guard/Reserve
Frequencies for individual and co-endorsements
(categories endorsed by the same individual, such as
“Veteran” plus “Military/veteran caregiver –
clinical”)
Military connection
o
o
o
o
o
48.
49.
50.
Veteran
Caregiver for a
Active Duty Service Member
National Guard/Reserve
Veteran
Health care worker serving military-connected populations
Civilian
Other ________
Prefer not to say
What is your age? [Veterans Administration population data collection]
o
o
o
o
18-24 years
25-44 years
45- 64 years
65 years or older
What is your race and/or ethnicity? Select all that apply.
o
o
o
o
o
o
o
o
American Indian or Alaska Native
Asian
Black or African American
Hispanic or Latino
Middle Eastern or North African
Native Hawaiian or Pacific Islander
White
Prefer not to say
What is your sex?
o
Female
o
Male
o
Prefer not to say
Frequencies; mean, median, mode, range
Age
Frequencies for individual and co-endorsements
(categories endorsed by the same individual, such as
“Asian” plus “Hispanic or Latino”)
Race/ethnicity
Frequencies
Gender
Instrument 2 – Arts Engagement Facilitator Survey
INTRODUCTION TO ARTS ENGAGEMENT FACILITATOR SURVEY
Thank you for participating in this voluntary survey for the Creative Forces®: NEA Military Healing Arts
Network Community Arts Engagement Grant Program Evaluation. The National Endowment for the Arts,
who is funding the program, and its cooperator, Mid-America Arts Alliance, are interested in gathering
the perspectives of the Arts Engagement Facilitators who serve Creative Forces Community Engagement
programs. For the purposes of this survey, an Arts Engagement Facilitator is someone who leads,
facilitates, or teaches arts activities or experiences for programs supported by Creative Forces grants.
This can include a range of experiential and educational backgrounds, such as practicing artists,
individuals who have previously participated in a Creative Forces program who have moved into a
facilitator role, and people with formal experience and/or training as teaching artists.
The survey takes about 15 to 20 minutes to complete. You will receive a $30 eGift card in appreciation
for your time in a follow-up email. At the end of the survey, you'll have the opportunity to enter your
name and email address so we can send you the eGift card. Your name and email will be used solely for
issuing the gift card and will be removed from your survey responses, ensuring that no one will be able
to link your identity to your answers. We are very interested in your perspectives and ideas, and we
hope you will share your real thoughts.
Your responses on this survey are confidential and only the program researchers (Shawn Bachtler and
Candace Gratama) have access to the responses. The survey requests the name of the organization
where you serving as an Arts Engagement Facilitator for Creative Forces. This information allows us to
look at the responses of all facilitators across types of programs (e.g., workshops versus ongoing classes)
and different art forms (e.g., visual, music, theater). However, no one associated with your organization,
Creative Forces, the National Endowment for the Arts, or the Mid-America Arts Alliance will know
whether you completed the survey or be able to see the responses for individual programs. While the
researchers will keep your information confidential, there are some risks of data breeches when sending
information over the internet that are beyond the control of the researchers.
You should also know that:
● You must be 18 or older to take this survey.
● The survey is completely voluntary. You may skip any questions or quit at any time. If you decide
to withdraw, simply close the survey window.
● All information collected through this study will be kept in locked offices and on password
protected computers.
● Your role in the Creative Forces program or in other programs associated with the National
Endowment for the Arts or Mid-America Arts Alliance will not be impacted by whether or not
you choose to complete the survey.
● There are no benefits to you for taking this survey. There are no risks expected with
participation in this survey, although it is possible that some people may experience discomfort
when answering questions about their experiences and perspectives.
Under the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of
information unless such collection displays a valid Office of Management and Budget (OMB) control
number. The OMB control number for this survey is OMB No. XXXX-XXXX (expires XX/XX/XXXX).
Please contact Shawn Bachtler, Ph.D., of ProgramWorks (shawnbachtler@gmail.com or 206-595-5878) if
you have questions about this survey or the National Endowment for the Arts at research@arts.gov if
you have any questions regarding the estimated time burden or any other aspect of this data collection.
If you have any questions about your rights as a participant in the study, you may contact Solutions IRB
(the body that oversees our protection of study participants) at (855) 226-4472 or
participants@solutionsirb.com.
By completing this survey, you are consenting to participate in this study.
*Please feel free to print or save a copy of this form for your records.*
SURVEY
YOUR ROLE AS AN ARTS ENGAGEMENT FACILITATOR FOR CREATIVE FORCES
Please note: In this survey, the term military connected populations include current or former members
in the military (Active Duty Service Member, National Guard/Reserve, Veteran), family members, and
caretakers.
1. What is the name of the lead organization that received the Creative Forces grant?
2. How long have you been working as an Arts Engagement Facilitator with this project, currently
supported by Creative Forces? Include the current year.
o Less than 1 year
o 1-3 years
o 4-7 years
3. Do you have experience as a participant/student in a Creative Forces program?
o No
o Yes, I previously was a participant/student in this Creative Forces program
o Yes, I am currently a participant/student in this Creative Forces program
o Yes, I was previously a participant/student in a different Creative Forces program
4. Which creative discipline(s) are you using for the Creative Forces Community Engagement Grant?
(select all that apply)
o
o
o
o
o
o
o
o
o
o
o
o
Crafts (Clay, Fiber, Glass, Leather, Metal, Mixed Media, Paper, Plastic, Wood)
Dance/movement (Ballet, Ethnic, Jazz, Tribal, Modern)
Design Arts (Architecture, Fashion, Graphic, Industrial, Interior, Urban/Metropolitan)
Folk/Traditional Arts (Crafts, Visual Arts, Dance)
Humanities (Facilitated conversations, Compilation of historical documentation, Preservation of
history)
Literature (Fiction, Memoirs, Non-Fiction, Playwriting, Poetry)
Media Arts (Film Arts, Film Audio, Film Technology/Experiments, Film Video, Podcasts)
Music (Band, Chamber, Ethnic, Jazz, New, Orchestral, Popular, Solo/Recital, Song Writing)
Music Theatre/Opera (Musicals, Opera)
Oral Traditions (Spoken word, Stand-up Comedy, Storytelling)
Theater (Mime, Puppet, Young Audiences, General)
Visual Arts (Collage, Experimental, Graphics, Multimedia, Painting, Photography, Printmaking,
Sculpture)
5. What type(s) of programming are you facilitating for the Creative Forces Community Engagement
grant? (select all that apply)
o Ongoing class/other ongoing engagement: A class group, and/or ensemble that meets regularly
for a distinct time period.
o Ongoing drop-in program: Ongoing, drop-in programs, such as an open-studio, where
participation may or may not be consistent.
o Single event: Single event, such as a workshop, exhibition, or café, where individuals participate
one time.
o Participant cohort performance: Participant exhibition or performance to showcase their work.
o Passive art engagement: Participants attend a performance, exhibition, etc.
6. How often do you lead Creative Forces art classes, workshops, or experiences?
•
•
•
•
Daily
Weekly
Monthly
Less than once a month
PROGRAM STRATEGIES AND OUTCOMES
7. Creative Forces offers program participants an opportunity to develop a better understanding of
themselves and others by creating or engaging with art. As an Arts Engagement Facilitator with
military-connected populations, what practices or strategies have you found the most effective for
supporting this outcome? Please briefly describe up to three.
________________
________________
________________
8. Creative Forces intends for program participants to develop supportive relationships and a sense of
belonging to a community. As an Arts Engagement Facilitator with military-connected populations,
what practices or strategies have you found the most effective for supporting these outcomes?
Please briefly describe up to three.
________________
________________
________________
9. What key strategies or conditions encourage participants to attend consistently and to return for
additional programming? Please briefly describe up to three.
________________
________________
________________
10. What other practices or strategies have been particularly effective in fostering creative expression
for Creative Forces participants?
11. What other practices or strategies have you found effective for supporting the Creative Forces goals
of improving health, well-being, and quality of life for participants?
12. In what other ways is the program impacting participants? Feel free to cite an example (no names).
13. If you experienced any challenges during program implementation, please describe them briefly.
YOUR EXPERIENCE AS AN ARTS ENGAGEMENT FACILITATOR WITH CREATIVE FORCES
Strongly
Disagree
Disagree
Neither
Agree nor
Disagree
Agree
Strongly
Agree
14. I am thriving as an Arts Engagement Facilitator
with Creative Forces.
15. I am interested in continuing my work with
Creative Forces as Arts Engagement Facilitator
16. I am confident in my understanding of military
culture.
17. I am able to engage members of the militaryconnected community in arts activities.
18. If you responded “disagree” or “strongly disagree” to items 13 through 16, what would you need to
thrive or be confident in that area?
19. In what ways does Creative Forces and/or your organization support you as an Arts Engagement
Facilitator?
20. What specific competencies do Arts Engagement Facilitators need to be successful in Creative
Forces Community Engagement Programs?
21. Have you received training through your Creative Forces program or the organization hosting the
program in the following areas? (select all that apply)
o
o
o
o
o
o
o
Military culture and/or working with military-connected populations
The art form I am facilitating
The program model
Trauma-informed approaches
Working with groups
Other_________
No training specific to
22. Is there additional training you wished you had received?
o No
o Yes (please describe)
23. Is there anything you would like us to understand about the program’s impact on you?
YOUR GENERAL BACKGROUND AND EXPERIENCE AS AN ARTS ENGAGEMENT FACILITATOR
24. How many years, in total, have you been an Arts Engagement Facilitator? Include the current year.
o
o
o
o
Less than 1 year
1-3 years
4-7 years
8+ years
25. Please indicate whether you have you obtained formal certification or education related to being an
Arts Engagement Facilitator? (select all that apply)
o
o
o
o
o
o
o
o
Certificate in art
Certificate as a teaching artist
Associate’s, Bachelor’s, or Master’s Degree in art field
Associate’s, Bachelor’s, or Master’s Degree in education
Associate’s, Bachelor’s, or Master’s Degree in social services
Creative Arts Therapy degree or license (Art, Dance/Movement, Drama, Music, Poetry)
Other (please describe)
None
26. If you have additional background or qualifications you rely on as an Arts Engagement Facilitator,
please describe that here. [Open-ended]
A LITTLE MORE ABOUT YOU
27. Are you connected to the military? (select all that apply)
o I am or was in the military
Active Duty Service Member
National Guard/Reserve
Veteran
o I am related to or close to someone in the military
Active Duty Service Member
National Guard/Reserve
Veteran
o I am a caregiver for a someone in the military
Active Duty Service Member
National Guard/Reserve
Veteran
o I work in a military setting or organization (e.g., USO)
o Other ___________
o Prefer not to say
28. What is your age?
o
o
o
o
18-24 years
25-44 years
45- 64 years
65 years or older
29. What is your race and/or ethnicity? Select all that apply.
o
o
o
o
o
o
o
o
American Indian or Alaska Native
Asian
Black or African American
Hispanic or Latino
Middle Eastern or North African
Native Hawaiian or Pacific Islander
White
Prefer not to say
30. Are you:
o
o
o
Female
Male
Prefer not to say
Thank you for completing this survey. Please enter your name and email address
below so we can send you an eGift card Through the Giftly platform. Your name and
email address are confidential and will be removed from your survey. Alternatively, you
may leave these two items blank and direct email Shawn Bachtler
(shawnbachtler@gmail.com) to receive your eGift card.
31. Name
32. Email address
Thanks again!
Instrument 3 – Grantee Interview Protocol
GRANTEE INTERVIEW PROTOCOL
Thank you for participating in this interview for the Creative Forces Community Engagement
Grant Program Evaluation. This study is funded by the National Endowment for the Arts.
We are conducting a study of the program and want to learn more about how the programs are
serving the military-connected through arts and cultural activities. We are studying the grant
program overall. This is not an evaluation of any individual program or of the people providing
or participating in the program. Instead, we are interested in learning what is going well, what
challenges there are, and how these programs can be supported. I will be asking questions
about the program, partnerships, what is going well, what challenges there are, and
recommendations for strengthening programs.
Our conversation is confidential. The information you share with me will be integrated with
interviews across all programs and your name will not be shared outside of our conversation.
Participation in this interview is voluntary, and you can skip any question or quit at any time.
Participation in the study will not impact your current or future awards from the NEA. The
interview will take approximately 30 minutes.
If you have any questions about this interview, information can be obtained from Shawn Bachtler, Ph.D.,
of ProgramWorks (shawnbachtler@gmail.com or 206-595-5878) or the National Endowment for the Arts
at research@arts.gov if you have any questions regarding the estimated time burden or any other
aspect of this data collection. If you have any questions about your rights as a participant in the study,
you may contact IRB Service (the body that oversees our protection of study participants) at (855) 2264472 or participants@solutionsirb.com.
Do you consent to continue with the interview?
GRANTEE INTERVIEW
Interviewee (Title and Name): _______________________________________
Interviewer: _____________________________________________________
Grantee Organization:_____________________________________________
Name of CFCE Program: ___________________________________________
Date: __________________________________________________________
Email for eGift card:______________________________________________
Selection of questions will depend on the nature of the project and the interviewee’s role.
1. Please describe your role in [organization].
2. Briefly describe the Creative Forces Community Engagement project. Prompt for:
a. Population served
b. Implementation strategies and activities
c. Timeline
d. Location/site
3. What prompted your organization to implement this project?
4. What needs does it address, and how were those needs identified?
5. What participant outcomes does your project address and in what ways?
6. Who are your key partners for the project? How were the partnerships developed?
What roles do the partner(s) serve in the project?
7. What are the strengths of your partnerships? What challenges are there?
8. To what extent has the grant program helped your organization build networks and
partnerships? In what ways has that supported your organization and the CFCE project?
In what ways can the grant program continue to assist grantees in building networks
and partnerships?
9. In what ways has the grant program enabled your organization and/or your partners to
build capacity to understand and engage members of the local military-connected
community?
10. In what ways has the grant program helped your organization build capacity to design,
implement, and evaluate your program(s) for miliary-connected individuals?
11. In what ways has the grant program increased an understanding of the value and impact
of the arts in your local networks and community?
12. In what ways are you documenting and collecting data on implementation and impact?
13. What challenges have you encountered with this project? How have you addressed
them?
14. What has gone well? What is one example of success achieved through this grant?
15. To what extent will the practices, tools, partnerships, and/or new understandings be
sustained after the grant period?
16. What conditions or resources are essential for developing a program like this?
17. The grant program provides technical assistance. What technical assistance have you
participated in? In what ways was it beneficial? In what ways can the technical
assistance be further strengthened to meet your organization’s needs?
18. Like many evaluations, this evaluation uses data collected through interviews, surveys,
and reporting forms. In what ways could an evaluation incorporate experiential or artsbased approaches to demonstrate outcomes?
19. To what extent would it be possible to gather participants’ attendance data in future
evaluations? Why? What approaches might make it feasible?
20. What recommendations do you have for other organizations interested in offering arts
or cultural programs to military-connected populations?
21. What recommendations do you have about the grant program, overall, for M-AAA and
the NEA?
22. Is there anything else you would like to add?
Instrument 4 – Partner Interview Protocol
PARTNER INTERVIEW PROTOCOL
Thank you for participating in this interview for the Creative Forces Community Engagement
Grant Program Evaluation. This study is funded by the National Endowment for the Arts.
We are conducting a study of the program and want to learn more about how the programs are
serving the military-connected through arts and cultural activities. We are studying the grant
program overall. This is not an evaluation of any individual program or of the people providing
or participating in the program. Instead, we are interested in learning what is going well, what
challenges there are, and how these programs can be supported. I will be asking questions
about the program, what you like about it, and recommendations for strengthening it. You will
receive a $35 eGift card in appreciation for your time in a follow-up email.
Our conversation is confidential. The information you share with me will be integrated with
interviews across all programs and your name will not be shared outside of our conversation.
Participation in this interview is voluntary, and you can skip any question or quit at any time.
The interview will take approximately 30 minutes.
If you have any questions about this interview, information can be obtained from Shawn
Bachtler, Ph.D., of ProgramWorks (shawnbachtler@gmail.com or 206-595-5878) or the National
Endowment for the Arts at research@arts.gov if you have any questions regarding the
estimated time burden or any other aspect of this data collection. If you have any questions
about your rights as a participant in the study, you may contact IRB Service (the body that
oversees our protection of study participants) at (855) 226-4472
or participants@solutionsirb.com.
Do you consent to continue with the interview?
PARTNER INTERVIEW
Interviewee (Title and Name): _______________________________________
Interviewer: _____________________________________________________
Grantee Organization:_____________________________________________
Date: __________________________________________________________
Email for eGift card:______________________________________________
Selection of questions will depend on the nature of the project and the partnership.
1. Please describe your role in [organization].
2. Briefly describe the Creative Forces Community Engagement project. Prompt for:
a. Population served
b. Implementation strategies and activities
c. Timeline
3. What needs does it address, and how were those needs identified?
4. What participant outcomes does the project address and in what ways?
5. In what ways is your organization engaged in the Community Engagement project?
Prompt for: role, services provided
6. What prompted your organization to become involved in this project? How did the
partnership develop?
7. What are the strengths of your partnership with [grantee organization]? What
challenges are there?
8. What are the benefits of the partnership for your organization?
9. In what ways has the grant program enabled [grantee organization] and you as a
partner build capacity to understand and engage members of the local militaryconnected community?
10. In what ways has the grant program helped [grantee organization] and you as a partner
build capacity to design, implement, and evaluate program(s) for miliary-connected
individuals? To what extent will the new practices and tools developed through the
grant be sustained?
11. In what ways has the grant program increased an understanding of the value and impact
of the arts in your local networks and community?
12. What has gone well with this grant? What is one example of success achieved through
this grant?
13. To what extent will the practices, tools, partnerships, and/or new understandings be
sustained after the grant period?
14. Like many evaluations, this evaluation uses data collected data through interviews,
surveys, and reporting forms. In what ways could an evaluation incorporate experiential
or arts-based approaches to demonstrate outcomes?
15. What recommendations do you have for organizations interested in offering arts or
cultural programs to military-connected populations?
16. What recommendations do you have about the grant program, overall, for M-AAA and
the NEA?
17. Is there anything else you would like to add?
18. What benefits does the partnership provide?
19. Is there anything else you would like to add?
Instrument 5 – Participant Interview Protocol
PARTICIPANT INTERVIEW PROTOCOL
Thank you for participating in this interview for the Creative Forces Community Engagement
Grant Program Evaluation. This study is funded by the National Endowment for the Arts.
We are conducting a study of the program and want to learn more about how the programs are
serving the military-connected through arts and cultural activities. We are studying the grant
program overall. This is not an evaluation of any individual program or of the people providing
or participating in the program. Instead, we are interested in learning what is going well, what
challenges there are, and how these programs can be supported. I will be asking questions
about the program, partnerships, what is going well, what challenges there are, and
recommendations for strengthening programs. You will receive a $35 eGift card in appreciation
for your time in a follow-up email.
Our conversation is confidential. The information you share with me will be integrated with
interviews across all programs and your name will not be shared outside of our conversation.
Participation in this interview is voluntary, and you can skip any question or quit at any time.
The interview will take approximately 30 minutes.
If you have any questions about this interview, information can be obtained from Shawn Bachtler, Ph.D.,
of ProgramWorks (shawnbachtler@gmail.com or 206-595-5878) or the National Endowment for the
Arts at research@arts.gov if you have any questions regarding the estimated time burden or any other
aspect of this data collection. If you have any questions about your rights as a participant in the study,
you may contact IRB Service (the body that oversees our protection of study participants) at (855) 2264472 or participants@solutionsirb.com.
Do you consent to continue with the interview?
PARTICIPANT INTERVIEW
Interviewee (Title and Name): _______________________________________
Interviewer: _____________________________________________________
Grantee Organization: _____________________________________________
Name of CFCE Program: __________________________________________
Date: __________________________________________________________
Email for eGift card: ______________________________________________
1. Please describe the program you are participating in. What led you to participate in the
program?
2. From your perspective, what are the goals of this project?
3. The program is committed to serving military-connected individuals - service members,
veterans, family members, and caregivers. In what ways does it serve this community?
In what ways can this program reach out and better serve the military population?
4. What do you enjoy most about the program?
5. In what ways does it support participants in engaging with [type of art]?
6. In what ways does this project help participants build connections with other people?
7. Are there other benefits to participating in the program that we haven’t discussed?
8. In what ways can the evaluation ensure it includes diverse perspectives?
9. What recommendations would you make to strengthen the program?
10. Is there anything else you would like to add?
Instrument 6 – Grant Leadership Interview Protocol
GRANT LEADERSHIP INTERVIEW PROTOCOL
Thank you for participating in this interview for the Creative Forces Community Engagement
Grant Program Evaluation. This study is funded by the National Endowment for the Arts. We are
interested in your perspectives of the grant program –the extent to which the grant program
has rolled out as intended, what is going well, what challenges there have been, and any
lessons learned or recommendations you have. Your perspectives will contribute to the
evaluation, as well as lessons that can be shared with the communities providing community
arts engagement or programming for military-connected individuals. Our conversation is
confidential. The information you share with me will be integrated with interviews across all
programs and your name will not be shared outside of our conversation. Participation in this
interview is voluntary, and you can skip any question or quit at any time. The interview will take
about 30 minutes.
If you have any questions about this interview, information can be obtained from Shawn Bachtler, Ph.D.,
of ProgramWorks (shawnbachtler@gmail.com or 206-595-5878) or the National Endowment for the
Arts at research@arts.gov if you have any questions regarding the estimated time burden or any other
aspect of this data collection. If you have any questions about your rights as a participant in the study,
you may contact IRB Service (the body that oversees our protection of study participants) at (855) 2264472 or participants@solutionsirb.com.
Do you consent to continue with the interview?
GRANT LEADERSHIP INTERVIEW
Interviewee (Title and Name): _______________________________________
Interviewer: _____________________________________________________
Organization: _____________________________________________
Date: __________________________________________________________
Choice of questions will depend on when the interview occurs within the grant program
timeline.
1. From your perspective, how does the design of the grant program reflect the goals and
values of Creative Forces? How is it helping Creative Forces meet those goals?
2. What is unique about this grant program that differs from other grant programs?
3. What has gone well this year in terms of the administration of the program? What
challenges have been encountered?
4. How is the program impacting grantees? What successes are you seeing in the target
outcomes areas or in other ways?
5. How is the program impacting participants? Please consider the target outcomes areas
or other ways in which participants impacted. How have you learned about this impact?
6. In what ways might an evaluation demonstrate the impacts for grantees and
participants that are not part of the current evaluation? Are there other data sources,
including experiential or arts-based approaches?
7. What have the leaders or grantees learned that would be useful for other grant
programs to know? For other community organizations to know?
8. What recommendations do you have for the future of this program?
File Type | application/pdf |
Author | Shawn Bachtler |
File Modified | 2025-06-09 |
File Created | 2025-06-09 |