Module 1 Evaluation of Canadian Citizenship Program

MODULE 1

EVALUATION OF THE CITIZENSHIP AWARENESS PROGRAM – CITIZENSHIP AND IMMIGRATION CANADA

http://www.cic.gc.ca/english/resources/evaluation/cap/index.asp

                The Citizenship Awareness Program (CIP) was evaluated with an outcomes based evaluation.  It was designed to ask whether the Federal Citizenship program was relevant to new and existing Canadians and what the performance of the organization was in reaching this population (effectiveness, efficiency, and economy). 

                This program evaluation was done with a variety of data collection tools including interviews, site visits, ceremony exit surveys, new citizen surveys, administrative data review, and a literature review.  Within this data collection, the questions the evaluators sought to answer were based on relevance and performance goals such as:

·         Is citizenship promoted among all Canadians?

·         Is the value of citizenship promoted in citizenship and Immigration Canada policies?

·         Is the promotion of citizenship shared equally between federal, provincial and local governments?

·         Is citizenship literature distributed equitably and widely among new and existing Canadians with language barriers removed?

·         Are citizenship ceremonies promoted among all Canadians and reaching a wide audience?

·         What is the value placed on citizenship in Canada?

·         Do promotional activities increase a sense of belonging among Canadians?

The outcomes were prioritized in this study based on these questions.

                In determining whether the outcomes of this program were reached, the evaluators turned to a variety of data collection tools.  In their final report, it was determined that there was a need to promote citizenship to maintain the value of becoming a Canadian citizen.  This study also indicated that very little is known about how promotional activities to draw attention to the benefits of citizenship in Canada are viewed in the Canadian public.  The value of ceremonies was highlighted in the conclusion of this report. 

                The flow chart (Figure 2-1) on page 23 of this document effectively highlights the steps of this model.  There were “Activities” such as set direction, a plan, monitoring of the plan and a report. “Output” sources were the priorities of the Citizenship Program, research, strategic policies, performance measurement, and performance data.  “Outcomes” were immediate such as recommendations for citizenship promotion, and staff training and intermediate such as the knowledge that the clients have knowledge of the responsibilities and privileges associated with Canadian citizenship.

                Data was gathered in interview format with five groups including citizenship representatives at NHQ and Regional and Local offices, citizenship judges, partners and stakeholders, and representatives from other government departments.  Documentation was collected either by telephone or in person and was qualitative (value responses) and quantitative (all, most, many, some, few) in nature.  Academic and technical literature was reviewed to determine the actual need for a citizenship program in Canada and the federal government’s role in the program once established.  There were bar graphs to display information like the Citizenship Take-up Rates over a 25 year period in Canada (Figure 3-1; p. 31) as well as Reasons for Becoming Canadian Citizens (Figure 3-2; p. 56).  Clients were all new Canadian citizens.

                The final analysis of the data was divided into four categories: 

·         Participation in CIC promotional activities

·         Knowledge of citizenship rights and responsibilities

·         Impacts related to applying for Canadian citizenship

·         Program Management

·         Resource utilization

The last section briefly describes the recommendations for the Citizenship Awareness Program. 

 

                I think that this was a very effective model for evaluating this program.  There was an indented outcome of this program: Is Canadian citizenship valued, recognized and promoted among federal, provincial, and local governments?  Strengths of this outcomes based model for evaluation were that there was a clear government directive at a federal level to ascertain the effectiveness of a program and a large gathering of data to support the need for such programming.   Potential areas of weakness in using this model could be that a cost measure could be overlooked in the effectiveness of this program as no cost measures were determined.  Also as a process, were there personnel that were hired on the basis of providing citizenship services that were not under scrutiny?

Module 1 Case Study

MODULE 1

CASE STUDY – THE BENEFITS OF EXERCISE TO PREVENT TYPE 2 DIABETES AMONG ABORIGINAL WOMEN

                This case study, described as a “means and an end” was to determine the effectiveness of an exercise program for  pregnant Aboriginal women in a Canadian city that were at risk for type two diabetes after having gestational diabetes (GDM).  I think that the best model to use for a program evaluation for this program would be a Goals Based Evaluation.

                The premise of the Goals Based Evaluation is that it can effectively determine if the program has met predetermined goals or objectives, in this case, whether an exercise program among this population would lower the instances of type two diabetes.  The program goals were established as a result of an increase of type two diabetes among the Aboriginal population in Saskatoon.  Program goals were established through a background and pre-natal history of the participants.  In the time period between 1995 and 1997, there were 114 inquiries about this exercise program with 69 participants.  It was determined through the use of a survey given to Aboriginal women in the city that were not only living with type two diabetes, but also those who were not experiencing the disease as a result of their pregnancy or lifestyle.  One of the strengths of this program was that the parameters around who could participate in this free program were broadened because there were already personnel in place for the originally determined population.

                The goals of this program were achieved according to the timeline suggested because after the year, including pre-natal and post natal care, there was follow up provided at the YMCA for mother and child.  The entire program was NHR funded after a feasibility study was conducted.  The study determined that the Aboriginal population was more susceptible to type two diabetes and gestational diabetes and that exercise was a key factor in reducing this risk.  Another strength of this program was that an Aboriginal Project Facilitator and an Elder were hired to manage the program.  The program itself was conducted by a trained fitness instructor as well as an RN and physiotherapist.  The program was provided free to the participants with child care, bus ticket, nutritious snack, weekly door prizes, and educational material provided.  That was another key strength.

                This program could be effectively evaluated with a Goals Based approach because it was designed to address the needs of a particular population (pregnant Aboriginal women) for a certain time period (second trimester of pregnancy through to post natal) and with an intended outcome (to reduce the number of Aboriginal women with type two diabetes) with a structured activity (exercise).  The program had start-up  and long term costs including salaries for the Program Facilitator, RN, fitness trainer and physiotherapist and probably a cost for the rental of the facility as well as the snacks, childcare, bus tickets, and educational material.  The fact that the program itself was free of charge is a benefit to the participants.

                Some of the questions I have after reading about the program:  was the program educational in nature or lifestyle and health cost based?  Was there adequate time and resources placed on informing younger Aboriginal populations (i.e. school age girls) about the potential health risks of diet, lifestyle, and glucose intolerance among the population?