Training on Impact Evaluation for Evidence-Based Development

Impact Evaluation for Evidence-Based Development Program

About the Program

Impact evaluation entails the assessment of the changes made as a result of projects, policies, and programs. The program then aims at instilling the necessary skills required by the participants in the ways they should execute evaluations related to their respective projects. The program introduces participants to current quantitative as well as qualitative evaluation techniques for impact evaluation and gives them an insight into the critical understanding of the roles they can play in the design and assessment of public policy and development interventions.

Program Objectives

By the end of this course the participants will be able to:

• Understand problems of evaluation (biases and placement, attribution and selection)
• Learn impact evaluation econometric tools.
• Undertake analysis of impact data using Propensity Matching and Difference-in –Difference.
• Report and share findings from impact evaluation.
• Carry out a project impact evaluation.
• Explain designs of IE.
• Identify impact evaluation theories and practices.

Target Audience

This program targets Project Staff, Researchers, Managers, Development Professionals, Government Policy Makers, NGOs, and Development Organizations who want to acquire an in-depth understanding of different interventions in their line of specialization.

Training Period

• Classroom: 5 Days
• Online: 7 Days

The Expedition
Module 1: Impact Evaluation Introduction
✓ Meaning of impact evaluation.
✓ Attribution impact evaluation
✓ Contribution versus Attribution.
Module 2: Impact Evaluation.
✓ Forms of evaluation.
✓ Theories of Change.
✓ Hypothesis of evaluation.
✓ Indicators of impact evaluation.
Module 3: Impact Evaluation Counterfactuals.
✓ Causal reference.
✓ Comparison groups and Counterfactuals.
✓ Counterfactual estimation in impact evaluation
✓ Impact Evaluation without baseline data and comparison.
Module 4: Impact Evaluation Research Designs.

1. Experimental Design.
   ➢ Randomized Control Trials.
2. Quasi experimental designs.
   ➢ Difference-in-Difference.
   ➢ Regression Discontinuity.
   ➢ Matching.
3. Non-experimental designs
   

Module 5: Impact Evaluation Sampling
✓ Impact Evaluation sampling techniques.
✓ Statistical power.
✓ Development of comparison groups.
✓ Calculation of sample size.
✓ Sampling weight.

Module 6: Impact Evaluation Quantitative Data Analysis.
✓ Measurement of the impact on the target beneficiaries.
✓ Comparison of those receiving the intervention to those not
receiving the intervention.

Module 7: Randomized Impact Evaluation
✓ Developing counterfactual.
✓ Randomization.
✓ Program Placement impacts.
✓ Program Participation impacts.
✓ Integrating Program Placement and Participation.
✓ Spill over Effects Measurements

Module 8: Propensity Score Matching Technique (PSM).
✓ PSM introduction.
✓ PSM in Impact Evaluation.
✓ Developing propensity scores.
✓ Matching Analysis (Nearest-Neighbours, Stratification, Radius,
Kernel).
✓ Doubly Robust Estimation.

Module 9: Difference in Difference Method
✓ Introduction to DID.
✓ DID in Impact Evaluation.
✓ DID estimator: (Single DID, DID with covariates,
Quantile DID).
✓ DID for Cross-Sectional Data.
✓ Balancing Tests.
✓ Diff-in-Diff with Propensity Score Matching.

Module 10: Qualitative Approaches in Impact
Evaluation.
✓ Significant Change.
✓ Outcome Mapping.
✓ Outcome Harvesting.
✓ Appreciative Inquiry.

Module 11: Impact Evaluation findings Development
and Dissemination.
✓ Impact Evaluation Plan.
✓ Impact Evaluation Reports: Baseline report, Impact
Evaluation Reports.
✓ Case studies