Canadian Evaluation Society Société canadienne d'évaluation

Canadian Evaluation Society Société canadienne d'évaluation 2008 Student Evaluation Case Competition Concours de simulation d'évaluation pour les étudiant(e)s

Partenaires Permettez-nous de remercier très sincèrement nos partenaires : Catégorie or Gendarmerie royale du Canada Secrétariat du Conseil du Trésor du Canada Catégorie argent Instituts de recherche en santé du Canada Société canadienne d'évaluation Section de la capital nationale Goss Gilroy Inc. Santé Canada Industrie Canada Infrastructure Canada Ressources naturelles Canada Catégorie bronze Cathexis Consulting Inc. Société canadienne d'évaluation, sections régionale: de l'alberta ; de la Colombie Britannique ; de l'ile-du-prince-çdouard ; du Manitoba ; de la Nouvelle-Écosse ; de Terre-Neuve et du Labrador ; et la Société québécoise d'évaluation de programme 1

Supporters A sincere thank you to our supporters: Gold Royal Canadian Mounted Police Treasury Board of Canada Secretariat Silver Canadian Institutes of Health Research Canadian Evaluation Society National Capital Chapter Goss Gilroy Inc. Health Canada Industry Canada Infrastructure Canada Natural Resources Canada Bronze Cathexis Consulting Inc. Canadian Evaluation Society Regional Chapters: British Columbia, Alberta, Saskatchewan, Manitoba,Nova Scotia, Prince Edward Island, Newfoundland and Labrador and la Société québécoise d'évaluation de programme 2

About the Competition À propos du concours Since 1996, the Canadian Evaluation Society has presented an annual bilingual Student Evaluation Case Competition where teams of three to five students from post-secondary institutions compete in the analysis of an evaluation case file. Students from all disciplines and all levels of postsecondary studies in academic institutions across Canada are invited to participate. In a preliminary qualifying round, teams receive an evaluation case file at their home institution and have five hours to prepare an analysis and submit it for review by a bilingual panel of judges. The three top-rated teams are then invited to participate in the final round held at the CES conference, where they must analyze a new case and present their analysis before judges and a live audience. This Year's Competition On Saturday, February 23, 2008, 15 teams (63 student team members and 15 coaches), from 11 Canadian universities/colleges, gathered in six provinces across Canada to compete in the preliminary round of the 2008 CES Student Evaluation Case Competition. Each team was given five hours to design an evaluation plan for the Toronto Waterfront Revitalization Initiative (kindly provided by Environment Canada) and submit it via email for judging by a panel of bilingual experts. Based on this judging, the following three teams were selected to participate in the final round at the 2008 Annual CES Conference in Quebec City: Adrastos - Georgian College, Research Analyst; Compass Consulting - University of Waterloo, Applied Health Sciences; and, LEAD Solutions - University of Ottawa, Education. Depuis 1996, la Société canadienne d'évaluation parraine annuellement et sur une base bilingue, le concours d'analyse de cas. Des équipes composées de trois à cinq étudiants de niveau universitaire s'affrontent au niveau de la réalisation d'une étude de cas qui porte sur l'évaluation d'un programme. Ces étudiants, issus de diverses disciplines, sont rattachés à des universités canadiennes. Dans le cadre de la ronde préliminaire, les équipes reçoivent un dossier d'évaluation à leur institution et elles ont cinq heures pour élaborer une offre de services qui est acheminée à un panel composé de trois juges. Les trois meilleures équipes sont alors invitées à accéder à la finale qui se déroule dans le cadre de la conférence annuelle de la SCÉ. Un nouveau cas leur sera alors soumis et elles devront présenter leur production devant le panel de juges ainsi que les éventuels spectateurs. L'édition 2008 du concours Samedi le 23 février, 15 équipes, composées de 63 étudiants et de 15 entraîneurs, en provenance de 11 universités canadiennes et de six provinces, ont participé à la première ronde de l'édition 2008 du concours. Chaque équipe a bénéficié de 5 heures pour élaborer la planification de l'évaluation de l'initiative de revitalisation du secteur riverain de Toronto, qu'elle devait acheminer aux organisateurs. Nous tenons à souligner que le cas a été rendu disponible grâce à la collaboration d'environnement Canada.. Les trois équipes retenues pour accéder à la ronde finale du concours qui se déroulera à la Conférence annuelle de la SCÉ à Québec sont : Adrastos - Georgian College, Analyse en recherche Compass Consulting - University of Waterloo, Sciences appliquées en santé LEAD Solutions - Université d'ottawa, Éducation. 3

2008 Case Competition Participants / Participants à l'édition 2008 du concours de simulation Carleton University School of Public Policy and Administration The Evengers Rebecca Greenwood Katherine Raspopow Renate Ysseldyk Coach: Robert Shepherd Dalhousie University School of Public Administration Logica Consulting Boafoa Kwamena Krystal Therien Emily Zbieranowski Coach: Dominika Wranik École nationale d'administration publique Administration publique Les papes mobiles Anne-Marie Jobin Paule Lavoie Évariste Kog Somda Danielle Tremblay Coach: Ghislain Arbour Georgian College Research Analyst Adrastos (FINALIST) Jay Callowhill Lynn Dare Asa Klint Jeslyn Thibedeau Cherie Underhill Coaches: Richard Acton-Rinaldo & Christine Frank Kwantlen University College Psychology Performance Evaluation Group Oscar Astete Kyle Mitchell Cindy Parry Jessica Tengco Agata Zasada Coaches: Bob Basil & Wayne Podrouzek Memorial University Applied Social Psychology KASA Consulting Stephanie Avery Allan Johnson Adam Reid Kellee Stamp Coach: Monique Goguen Campbell PPIK Consulting Jennifer Kavanagh Iris Lin Patricia Rice Philip Sampson Coach: Monique Goguen Campbell University of Ottawa Education LEAD Solutions (FINALIST) Anna Lenk Louise McLennan Deniz Paktunc Erin Revill Coach: Bradley Cousins The Incredible Indicators Falaiye Caroline Lisa Stephens Illana Sultan Patrick Wray Coach: Bradley Cousins 4

University of Regina Psychology The Freudian Slips Murray Abrams Nick Carleton Kelsey Collimore Theresa Dever Amy (Jennifer) Janzen Coach: Richard MacLennan Flatlanders Consulting Candice Bovell Heather Eritz Paulette Hunter Melissa Kehler Atif Shujah Coach: Richard MacLennan University of Saskatchewan Psychology TLC Consulting Lisa Jewell Terri Simon Carrie Tanasichuk Coach: Melanie Morrison University of Toronto Ontario Institute for Studies in Education Datahost Saad Chahine Zhimei Gu Monique Herbert Anita Ram Linda Umezawa Coaches: Ruth Childs & Olesya Falenchuk University of Waterloo Applied Health Sciences Compass Consulting (FINALIST) Robin Blanchard Colleen Dwyer Michelle Vibert Sarah Viehbeck Coach: Anita Myers & Mark Seasons In Focus Consulting A. Morgan Akalehiwot Eric Hobin Nicki Lauzon Taryn Sandzik Aileen Trang Coaches: Anita Myers & Mark Seasons Finalists / Les finalistes Compass Consulting University of Waterloo - Applied Health Sciences Robin Blanchard, MSc Robin Blanchard is a PhD Candidate in the Department of Health Studies & Gerontology at the University of Waterloo. Robin has previously participated in the case competition three times, reaching the finals in 2004. Her evaluation training extends from graduate-level courses in program evaluation, multiple teaching assistantships for the undergraduate health evaluation course, and involvement (with her supervisor, Anita Myers) in several evaluation projects. Robin has served on the CES student committee for two years. Colleen Dwyer Colleen Dwyer is a Master's candidate within the University of Waterloo's Health Studies and Gerontology program. Specializing in the mental health of health care clients, she had no previous evaluation experience before enrolling in a program evaluation course in her first year of Master's study. She quickly became well-versed in evaluation language and practice, and went on to conduct evaluations for two immigrantservice programs in the Kitchener-Waterloo area. This is Colleen's first year participating in the CES student competition. Michelle Vibert Michelle Vibert is completing her MSc at the University of Waterloo, with a focus on individuals living with HIV/AIDS and injection drug users. Her experience in evaluation is young but progressive; earlier this year Michelle completed a pilot evaluation of a shelter food 5

distribution program and was an interviewer with the Ontario Harm Reduction Distribution Program Evaluation with the University of Ottawa. Michelle is happy to be one of the finalists of the 2008 Student Case Competition. Sarah Viehbeck Sarah Viehbeck is a PhD candidate in Health Studies and Gerontology at the University of Waterloo. Her dissertation examines knowledge exchange between researchers and policymakers in tobacco control. Sarah has been a Teaching Assistant in a Planning and Evaluation course, taken two graduate level evaluation courses, and been a repeat participant in the CES Student Case Competition. Currently, Sarah is collaborating to evaluate a multi-year grant program aimed at enhancing research capacity in tobacco control. Coaches Anita Myers, PhD Anita Myers is a Full Professor in the Department of Health Studies & Gerontology at the University of Waterloo. Anita regularly teaches courses in health program evaluation, supervises graduate projects in evaluation and has coached teams for the case competition since 1999. She is a member of the CJPE editorial board and the Consortium for University Training in Evaluation. She has received the Contribution to Evaluation in Canada and Fellowship awards from CES. Mark Seasons, PhD Mark Seasons is Associate Dean with the Faculty of Environmental Studies, and Associate Professor with the School of Planning, University of Waterloo. He has extensive planning and policy evaluation experience in Ontario, Alberta and New Zealand and served as President of the Canadian Institute of Planning (2000-2001). Mark currently serves on the CJPE editorial board and has coached (while at Carleton) or co-coached (at University of Waterloo) teams in the case competition since 1996. Adrastos Georgian College ~ Research Analyst Jay Callowhill Jay Callowhill graduated from the University of Guelph in 2003 with a B.Sc Major in Biochemistry. Jay is currently enrolled in the Research Analyst Post-Graduate Program at Georgian College where he has developed the skills to pursue his interest in conducting social research. In the summer of 2008, Jay will get a chance to put his interest in social research into practice by completing an internship with the Public Affairs division of Environics Research group in Ottawa. Lynn Dare Lynn Dare graduated as a Senate Medal winner (Outstanding Academic Achievement) from Carleton University in 2004 with a B.A. Major in Psychology, Minor in Law. The Research Analyst Post-Graduate Program at Georgian College has furthered Lynn's academic career in the field of evaluation and research. Lynn enjoys being actively involved in the community, volunteering at the Royal Victoria Hospital, Barrie and local elementary schools. Asa Klint Asa Klint Piggott graduated cum laude from Laurentian University in 2007 with a B.A. in Sociology and is currently completing post-graduate studies at Georgian College in the Research Analyst Program. Prior to this, Asa spent many years as a marketing manager and enjoyed planning numerous community functions to raise awareness and funds for a variety of different charities. She has also been actively involved in her community serving as trustee on the local library board. Jeslyn Thibedeau Jeslyn Thibedeau graduated from Queen's University in 2007 with a B.A.(Hons) in Sociology. She is currently enrolled in the Research Analyst Program at Georgian College. She is looking forward to utilizing her new research skills as she completes an internship with Phase 5 in Ottawa. Cherie Underhill Cherie Underhill graduated from the Tourism Management program at Georgian College in 2004. Cherie is currently enrolled in the Research Analyst Post- Graduate Program at Georgian College where she has been developing the skills needed in social research. 6

Coach Dr. Christine Frank A faculty member at Georgian College, Christine Frank teaches Qualitative Research Methods and Population/Demography in the postgraduate Research Analyst Program. In her capacity as a professor of research methods and also as an independent consultant, she regularly leads program evaluations and social research projects. She has been coaching the Georgian Case Competition teams since 2004. Chris is an active member of the CES Ontario Professional Development Committee and recently formed CES Credentialing Sub Committee. LEAD Solutions University of Ottawa ~ Faculty of Education Anna Lenk Anna Lenk is a student in the Certificate Program in Program Evaluation at the University of Ottawa. She is manager of community planning at the Homelessness Partnering Secretariat, Human Resources and Social Development Canada (HRSDC). Louise McLennan-Sauve Louise McLennan-Sauve is a bilingual Senior Management Consultant with 23 years' experience in program evaluation, audit and management consulting. Studies included federal-provincial and horizontal initiatives, regulatory reviews, organizational modeling, Official Language programs and developing GoC interoperability protocols. She has expertise in process analysis, activity-based-cost analysis, surveys, focus groups and quality assurance programs. An MBA graduate of Ottawa University, she is completing the Graduate Certificate in Program Evaluation. She completed the Management Consultant Program, National Defence. She is a member of the Executive Team of ASIS Ottawa and former Chair of Six Sigma Conference 2000 and Co-Chair of TBS Interdepartmental Test Committee. Deniz Paktunc Ms. Deniz Paktunc has been a Program Manager for the past 13 years at the Canadian Forces Language School in Ottawa. She has experience in surveys, performance measurement and evaluation of training programs. Her other areas of specialization include adult education, program and business planning, program implementation, and reporting of program evaluations. Currently, she is a full-time graduate student at the University of Ottawa, Faculty of Education. Following the completion of her M.Ed. degree in the summer of 2008, she would like to continue taking courses towards a Graduate Certificate in Program Evaluation. Ms. Paktunc speaks English fluently and has a bilingual profile in French. She holds clearance at the secret level. Erin Revill Erin Revill is currently a part-time student in the Master's Certificate Program in Program Evaluation, at the University of Ottawa. She completed her Master's of Education in the spring of 2007 (University of Ottawa), a BScH in Psychology from Queen's University, and a Post Graduate Diploma in Behavioural Science Technology from St. Lawrence College. Erin is currently employed as a Consultant at Goss Gilroy Inc., gaining significant experience in program evaluations at the federal and provincial level. Coach Brad Cousins J. Bradley Cousins is Professor of Educational Administration at the Faculty of Education, University of Ottawa. Professor Cousins' main academic interests are in program evaluation including participatory and collaborative approaches, utilization issues and capacity building. He is author of several articles, international handbook chapters and books on evaluation related topics. Professor Cousins received his Ph.D. in educational measurement and evaluation from the University of Toronto in 1988. Throughout his career he has received several awards in research and evaluation including the 'Contribution to Evaluation in Canada' award (CES, 1999) and the Karl Boudreau award for 'Leadership in Evaluation' (CES-NCC, 2007). He has been Editor of the Canadian Journal of Program Evaluation since January 2002. 7

The Judges / Les juges Michelle Anderson-Draper Michelle Anderson-Draper is a qualified evaluator who holds two graduate degrees. Using a participatory approach, Michelle has worked with representatives from all levels of government and many not-for-profit organizations. She joined Capital Health in 2007 as a fulltime Population Health Evaluation Consultant. An active member of CES, Michelle is the Vice-President of the Alberta Chapter, a judge in this year's student case competition, an Essential Skills Series facilitator, and the winner of the 2005 student paper contest. Her research interests include understanding how to create and sustain an evaluative culture. Michelle de Cordova Michelle de Cordova moved to BC from Europe in 2007. As an independent environmental and social sustainability and evaluation consultant she has undertaken projects in BC, Europe, Asia and Africa, and earlier worked for WWF International, Oxfam-Novib (Netherlands) and as a UK diplomat. She holds a Master of Science degree in Protected Landscape Management from the University of Wales, Aberystwyth (UK), and a Bachelor of Arts degree from the University of London. She is an active member of the CES BC Chapter. She has just embarked on a new role as Manager, Sustainability Research with Northwest and Ethical Investments LP. Marthe Hurteau Marthe Hurteau has a Ph.D in education from Laval University with a specialization in program evaluation. She has been working as a private consultant in program evaluation for more than twelve years and is now a fulltime professor at the University of Quebec in Montréal, Sciences of Education Faculty. Within her responsibilities, she is in charge of a graduate program in program evaluation, she teaches program evaluation at the graduate level in education, as well at the undergraduate level in career counselling. Her actual research activities are on program evaluation practices. Madame Hurteau détient un Ph.D en éducation de l'université Laval - spécialisation en évaluation de programme. Elle a eu son entreprise de services en évaluation de programme durant une douzaine d'années et elle présentement professeure à l'université du Québec à Montréal Faculté des sciences de l'éducation. Dans le cadre de ses fonctions, elle est responsable d'un programme court de second cycle en évaluation de programme; elle enseigne l'évaluation de programme au niveau de la maîtrise en éducation ainsi qu'au niveau du baccalauréat en carriérologie. Ses intérêts de recherche porte sur les pratiques en évaluation de programme. Martha McGuire Martha McGuire, M.S.W. has been a program evaluator for over twenty years and heads Cathexis Consulting Inc. She has worked across a number of sectors and with a variety of populations including the homeless, First Nations, children, and people with disabilities. Through her work on the CES Core Body of Knowledge with Rochelle Zorzi and Burt Perrin, Martha has contributed to a better understanding of the value of evaluation and what is needed to conduct credible and useful evaluations. The Organizers / Les organisateurs Bea Courtney Bea Courtney is a Partner with Goss Gilroy Inc. and based in their St. John's, NL office. She is also Member Services Chair with the CES National Council. She has previously been active in the case competition as a coach of teams from Memorial University. Lisa Fairweather Lisa Fairweather has been a Case Competition Organizer for many years in 2001-2002 and 2002-2003 as a Student Board Member with the National Capital Chapter, and again in 2007-2008. She is currently working for Environment Canada in Whitehorse, Yukon in intergovernmental affairs and policy. Congratulations and good luck teams! Marthe Hurteau Marthe Hurteau has a Ph.D in education from Laval University with a specialization in program evaluation. She has been working as a private consultant in program evaluation for more than twelve years and is now a fulltime professor at the University of Quebec in Montréal, Sciences of Education Faculty. Within her responsibilities, she is in charge of a graduate program 8

in program evaluation, she teaches program evaluation at the graduate level in education, as well at the undergraduate level in career counselling. Her actual research activities are on program evaluation practices. Madame Hurteau détient un Ph.D en éducation de l'université Laval - spécialisation en évaluation de programme. Elle a eu son entreprise de services en évaluation de programme durant une douzaine d'années et elle présentement professeure à l'université du Québec à Montréal Faculté des sciences de l'éducation. Dans le cadre de ses fonctions, elle est responsable d'un programme court de second cycle en évaluation de programme; elle enseigne l'évaluation de programme au niveau de la maîtrise en éducation ainsi qu'au niveau du baccalauréat en carriérologie. Ses intérêts de recherche porte sur les pratiques en évaluation de programme. Mary Kay Lamarche Mary Kay Lamarche is an Evaluation Manager with Human Resources and Social Development Canada (HRSDC). She has been involved with evaluation and/or strategic planning, in both the private and public sectors, for nearly 8 years. In addition to participating on this year's Case Competition Working Group, she also helped organize the competition in 2003 and 2004. Brian McGowan Brian McGowan, BSc, MBA has worked for 30 years as a management consultant. He offers 20 years experience in public program evaluation including social services, economic development, and forestry. Brian has well developed skills in evaluation frameworks, qualitative and quantitative research and analysis, and preparing practical recommendations. In addition, his consulting expertise extends to market and financial assessment, labour market studies, and organizational review. Brian is an independent consultant in Vancouver and currently serves on the Executive Council of the CESBC. Lisa O'Reilly Lisa O'Reilly is a Vancouver-based independent consultant in evaluation, strategic planning and policy analysis for public sector and not-for-profit organizations. She is Vice President of the BC Chapter of the CES. In 2003, she helped organize the CES Student Case Competition. Lisa is reprising her role with the Case Competition this year. Getting Involved There are many benefits associated with getting involved in this annual event! Partners and supporters get preferential recruiting opportunities with students as well as opportunities for recognition within the evaluation community and with evaluation students. Coaches have a chance to raise the profile of evaluation on their campus through their students. Students obtain first-hand experience in evaluation, while also networking with future colleagues and employers. Organizers get to meet some talented students, network with sponsors and evaluators and develop organizational skills. Get Involved!Visit our web site: http://competition.evaluationcanada.ca or contact one of the organizers. S'impliquer Le concours offre plusieurs avantages pour ceux qui désirent s'impliquer: Les partenaires et commanditaires se situent aux premières loges pour identifier d'éventuels collaborateurs; Cette activité fournit aux entraîneurs l'opportunité de faire la promotion de la formation en évaluation de programme au sein de leur institution,, et cela est encore plus vrai lorsque leur équipe accède à la finale; Les étudiants bénéficient d'une expérience enrichissante ainsi que de l'opportunité d'établir des réseaux avec des étudiants de d'autres universités ainsi que d'éventuels employeurs; Finalement, les organisateurs ont la chance de rencontrer des étudiants talentueux, d'établir des contactes avec les commanditaires et des évaluateurs et de développer ou de consolider leurs habiletés en tant qu'organisateurs d'événement. Impliquez-vous! Visitez notre site web: http://simulation.evaluationcanada.ca et contactez un des organisateurs. 9

Special thanks to the following for their support: CES National Council Michael Goodyer and Francois Dumaine, former Case Competition organizers The CES Travel Scholarship Fund and Social Sciences and Humanities Research Council of Canada Felix Meisels and Ghislain Arbour, of the 2008 Conference Committee Sue Ryan, The Willow Group Eleanor Swanson and Carol Ann Cotter of the Newfoundland and Labrador Department of health and Community Services for providing material for the final round case Shelley Borys and William Blois from Environment Canada for the preliminary round case Competition judges: Michelle Anderson-Draper, Michelle de Cordova, Marthe Hurteau and Martha McGuire Benoît Gauthier of Circum Network Inc., Case Competition Webmaster Des remerciements très particuliers aux personnes suivantes pour leur soutien: Le Conseil national de la SCÉ Micheal Goodyer et François Dumaine, les organisateurs des éditions antérieures du concours Le Fonds de bourses de voyage de la SCÉ et le Conseil de recherches des sciences humaines du Canada Felix Meisels et Ghislain Arbour, membres du comité organisateur de la conférence 2008 Sue Ryan, The Willow Group Eleanor Swanson et Carol Ann Cotter rattachées au Département de santé et des services communautaires de Terre-Neuve-et-Labrador qui ont gracieusement contribué à l'élaboration du cas destiné à la ronde finale du concours Shelley Borys et William Blois de Environnement Canada qui ont aussi gracieusement contribué à la ronde préliminaire du concours Les juges du concours: Michelle Anderson- Draper, Michelle de Cordova, Marthe Hurteau et Martha McGuire Benoît Gauthier de Circum Network Inc., Webmaster du concours d'analyse de cas 10