Policy and Program Evaluation

• A GUIDE TO POLICY EVALUATION by Nonie Malone
  in Policy and Program Evaluation
  31 May 2011  | 0 Comments

  It is a common observation by those working in the area of policy and program evaluation that often the person charged with responsibility for setting up an evaluation is unclear about what the evaluation is for, what it is that they want to evaluate, and the purpose of the evaluation.  Often, all they know is that there is a Cabinet or legislative requirement for an evaluation to be undertaken. 

  Evaluation is such an important component in the policy cycle, yet one that is easily overlooked and omitted.  Indeed, without evaluation, there is no cycle, but rather a line extending to infinity. 

  It is important for policy officers (or policy analysts in the New Zealand nomenclature) to understand the principles behind sound and useful evaluations so they can design and execute effective internal or external reviews that meet the information needs of decision-makers, policy developers and program managers.

  Below is a brief outline of issues from the newly released Magenta Book, the United Kingdom Treasury’s guide for evaluation of policy programs delivered or supported by the UK Government.  The Magenta Book is an excellent source of guidance on evaluation for Australian policy officers and New Zealand policy analysts and can be found at http://www.hm-treasury.gov.uk/d/magenta_book_combined.pdf .

   

  Issues in policy evaluation

  Evaluation is an objective process of understanding how a policy or other intervention was implemented, what effects it had, for whom, how and why.

  Evaluations need to be tailored to the type of policy being considered, and the types of questions it is hoped to answer. The earlier an evaluation is considered in the policy development cycle, the more likely it will be that the most appropriate type of evaluation can be identified and adopted. (My emphasis added.)

  Good-quality evaluations generate reliable results which can be used and quoted with confidence. They enable policies to be improved, or can justify reinvestment or resource savings. They can show whether or not policies are delivering as planned and resources being effectively used.

  Good-quality evaluations can play important roles in setting and delivering on government priorities and objectives, demonstrating accountability, and providing defensible evidence to independent scrutiny processes. They also contribute valuable knowledge to the policy evidence base, feeding into future policy development and occupying a crucial role in the policy cycle.

  Not evaluating, or evaluating poorly, will mean that policy makers will not be able to provide meaningful evidence in support of any claims they might wish to make about a policy’s effectiveness. Any such claims will be effectively unfounded.

  Posted by:  Nonie Malone

  Date:   31 May 2011