Fundamentals of Program Evaluation in Public Policy

This five day course is designed for public sector workers and academics who are interested in commissioning, managing or conducting evaluations of public policy or programs.
 
The course is structured to progress participants through the stages of an evaluation. Participants are exposed to key theories and approaches to evaluation and then apply these to real examples of evaluations, from negotiation and planning through to data collection and final reporting and dissemination of findings. Examples from published studies and the facilitator’s applied practice in evaluation will be drawn upon to illustrate and reinforce key concepts.
This five day short course is interactive and participatory. Participants are encouraged to bring their own examples and work through issues throughout the week. A set of handout notes will be provided to participants and case exemplars reviewed in class sessions.
 
Monday: Program Evaluation: What is it? How does it differ from social research? The role of valuing in evaluation. Key Evaluation types and approaches. The roles of internal and external evaluation. Key evaluation design considerations. Fostering the use and influence of evaluations. Using evaluation models to inform practice – social programming, valuing, knowledge construction, use and influence, and practice.
 
Tuesday: Planning Evaluation: Working with Key Stakeholders. The role of program logic and program theory in evaluation: What is program logic and when is it helpful? How to facilitate a program logic mapping session. Program theory for complicated and complex social programs. From initiation to final evaluation brief (or plan).
 
Wednesday: Designing an evaluation plan: Key components of an evaluation plan. The importance of identifying key audience information needs, and evaluation scope. Budgeting for an evaluation. Defining a limited set of key evaluation questions (KEQs). Managing an evaluation: some principles and tips for practice. Designs relevant for evaluation of emergent and/or multifaceted public sector programs (complex and complicated programs). Types of Evaluation: Process and Outcome evaluation approaches. The emerging role of Developmental evaluation. The roles of experimental, quasi experimental, non-experimental and qualitative designs, including case studies.
 
Thursday: Data Collection and Analysis/Major methods of data collection. Topics to be reviewed will include interviews, Most Significant Change technique (MSC), photographs and other visual methods, focus groups, nominal group technique and Delphi technique, Q sort, surveys, and goal attainment scaling. The role of mixed methods in evaluation – Strategies to integrate qual and quant methods.
Analysis principles and approaches will be emphasised in Day 4 and in Day 5 in relation to major methods addressed.
 
Friday: Reporting an evaluation and supporting use and influence. The 1, 5, 25 rule. Considerations in generating valid claims. Issues of rigour and relevance. The role of program evaluation standards and core competencies in evaluation. Disseminating evaluation findings and influencing the use of evaluation. Practical tips to enhance the value of evaluation. Building a culture of evaluative thinking into public sector agencies – the role of monitoring and evaluation frameworks.

 
Level 2 - runs over 5 days
Instructor: 

Dr Delwyn Goodrick is a psychologist who undertakes program evaluation and social research with a wide range of government and private sector clients. She is an experienced trainer having conducted a range of specialist workshops in research and program evaluation in Australia, Singapore, the US, UK, Canada and New Zealand. Most of Delwyn's work relates to health and education contexts. She maintains her own private consultancy practice and is currently working from New Zealand.

Course dates: Monday 14 January 2013 - Friday 18 January 2013
Course status: Course completed (no new applicants)
Week: 
Week 1
Recommended Background: 

Previous completion of the course 'Introduction to Qualitative Research Techniques', another introductory qualitative course or equivalent experience with qualitative research.

Recommended Texts: 

Patton, M.Q. (2008). Utilization-focused evaluation (4th ed). Thousand Oaks, CA: Sage.
Torres, R.T., Preskill, H., and Piontek, M.E. (2005). Evaluation strategies for communicating and reporting: Enhancing learning in organizations (2nd ed). Thousand Oaks, CA: Sage.

Course fees
Member: 
$1,660
Non Member: 
$2,980
Full time student Member: 
$1,660