Data Collection, Analysis, & Impact

Data Collection

The focus of my data collection will be on using direct sources. Those who are participants in this program, their close family members, as well as those you are involved in running the program. Each of these stakeholder groups would provide a unique insight into the program and seeing how their responses align with one another would be a great way to identify which goals are being met and where improvements can be made. 

I would conduct written surveys and personal interviews for both groups. The written survey would be conducted first and the personal interview would be a way for me to have stakeholders expand on ideas and deepen my understanding of their experiences.

Participants

Written surveys for this group would focus on asking about their experiences within the group. Are they feeling welcome in the group? Who is their favourite friend in the group? How do they feel about their grief/trauma experience after attending the group?


These questions would help highlight their experiences and provide a springboard for conversation during the personal interview. 

Family Members

As many of the participants are quite young, I feel as though it would be beneficial to include family members in the data collection. Their viewpoints and experiences can offer information that participants may not be able to articulate. 

The survey for this group would focus on questions surrounding the change(s) they may be noticing in the behaviour and coping strategies of the participant. 

Program Instructors 

These individuals will be able to offer a different perspective from the other two groups. Their survey would focus on questions concerning the success of the program. Do they see improvements or changes in behaviours of the participants. Do they notice any improved ways of dealing with grief or trauma that the participants are applying in workshops? 

Analysis Strategies 

Looking at the answers that have been provided by the various stakeholders can highlight some key themes. If the responses are all positive and have overlapping observations, the program is doing it's job and working toward reaching it's goals. If the responses are similar but instead portray a negative light, the program has some gaps. However, the upside is that all stakeholders are on the same page. 

I think the biggest danger is when we contradictory responses from the various groups. This indicates that stakeholders are not on the same page and that the connection between participants, family members, and program instructors is lacking.

I will be using an inductive approach, where I will attempt to highlight emergent themes from the surveys and interviews. The diagram (click to enlarge) highlights the questions I will be using to guide the analysis process. What themes am I noticing? Is anything diverging from these themes and why might this occur? What interesting stories am I learning from these themes? Am I left with any wonderings that could spark the need for more data collection? 

Impact

Evaluation doesn't serve a purpose unless it sparks change. In order to ensure that my evaluation has an impact on the program at hand, I would make sure to sit down with stakeholders and discuss the findings. What did the surveys and interviews show? How are the goals being met? What suggestions do I have to make sure that gaps are being bridged? Stakeholders have been involved in the data collection stage, meaning that they will feel as though their voice has been heard. Sitting down together and discussing "next steps" and where we should go from here is a key part to making sure that change actually happens and that the program doesn't remain stagnant. 

The information I have gathered and conclusions I have come to will be shared with program leaders. I will write up a report of my findings, answering the various questions from the data analysis section as well as the questions that have been driving my program evaluation. After this has been shared, a meeting will be held to discuss the information, answer any questions, receive feedback, and figure out practical ways we can work together to implement this new information, making necessary changes to the program. From there, we will figure out how to relay this information to the participants of the program.