Assignment #2

Prenatal Exercise Program for Aboriginal Women à Evaluation Proposal

One of the main difficulties in selecting an evaluation approach is the lack of information provided in the case study. The document does open with a clear explanation of why an exercise program for pregnant Aboriginal women in Saskatoon is an excellent idea. However, the provided description never really states the goals of the program beyond the idea that “initiatives to promote regular physical activity among Aboriginal women during their childbearing years could play a major role in optimizing healthy pregnancies and in reducing rates of type 2 diabetes in future generations”. It also becomes very difficult to evaluate a program without knowing the future intent of the program (summative or formative perspectives).

I think a naturalistic perspective is the logical starting point for this program evaluation. It appears that a major component of the program was the recruitment and retention of the targeted demographic. The program developers began by seeking partnerships with the Aboriginal community and then looked for support from an Aboriginal Project Facilitator and the advice of an Elder. The case study seems to focus a great deal of attention on the participants and not the medical statistics. In fact, the majority of statistical analysis appears to be about the rate of participation and not the rate of type 2 diabetes.

The evaluation should focus on qualitative data (some quantitative would also be useful) collected through conversations and simple surveys with the 61 participants (the quality of feedback would be much stronger through a discussion group but the anonymous distribution of a survey also has some merit). If possible, it would also be very helpful to acquire feedback from the 45 individuals that inquired about the program but chose not participate. A third set of data from the individuals that began the program but dropped out would also be important (possibly the most valuable) to the evaluation. The evaluation would focus on the three data groups and their perceptions of the program and the implementing individuals. A fourth set of data from the implementers would also provide another perspective to include in the evaluation.

The project developers did not simply create a physical exercise regiment, apply this to a test group, and see if the diabetes ratio in Aboriginal women decreased. I get the feeling that the project developers viewed health through a holistic lens (as does traditional Aboriginal thinking). This was evident through the social components and the health education portion of the program. The program evaluation must include more than the rate of diabetes, it must look at the whole person and examine their physical, emotional and spiritual well-being. These areas are very difficult to analyze in a purely statistical method and this lends further weight to the notion of a naturalistic evaluation.

As this program is likely grant-based, Provus’ cost-benefit analysis could be important for some stakeholders. As an evaluator, I would caution against the notion that we are dealing with a measurable output. The program appears to be about more than simple diabetes rates.

As mentioned earlier, the case study does not clearly state goals and therefore I would recommend a Scriven, Goal-free analysis. This would allow for an external, unbiased and naturalistic perspective that simply allows the evaluators safe entry to the thoughts and feelings of the participants and program implementers.

Some key questions:

-          What was the role of the Elder and how did they influence the program and participants?

-          What was the role of the Aboriginal Project Facilitator and how did they influence the program and participants?

-          How did the Aboriginal community feel about the program and participants?

-          What was the role of program implementers and how did they influence the program and participants?

-          Was the level of exercise (duration and intensity) enough to have a medically relevant impact?

-          How did the program function in terms of a means and an end to address health issues?

-          Should the program be implemented again?

-          Can the recruitment plan be improved (only 7% participation)?

-          What impact did the facility have?

-          How can all demographics be reached?

o   Why did specific demographics participate?

-          Were there any other health benefits?

-          Was there an increase in health knowledge/education?

-          Was there an emotional or spiritual impact felt by participants?

-          Would participants return if they became pregnant again?

-          Did the participant get diabetes?

-          What impact did the social area have?

-          Etc.