Pact's capacity development evaluation

Pact envisioned OPI filling a gap in traditional capacity development measurements, moving beyond measuring outputs toward capturing capacity development outcomes.

Further, the tool creates a clearer linkage between the output change and the impact change, such as the reduction in maternal and neonatal fatality or the increase in household incomes.

Pact tested the reliability of the OPI in 2012 with 40 CSOs and networks across six countries where it implements development projects in health, livelihoods, governance, and natural resource management sectors. Using Cronbach’s Alpha, Pact sought a reliability of 0.70 or higher. As this article explains, Pact found that its Organizational Performance Index exceeded the 0.70 alpha and was found to be a reliable tool for measuring organizational performance. To review the OPI tool and the Rockefeller Foundation funded research, please review Pact’s Capacity Development Evaluation report.

Pact Theory of Change for Capacity Development

Figure 1: Pact Theory of Change for Capacity Development

 

Contents

  • Tool overview
  • Figure 1: Pact Theory of Change for Capacity Development
  • Sampling and methodology
  • Figure 2: Countries and projects sampled
  • Reliability testing results
  • Figure 3: OPI reliability testing by country
  • Figure 4: OPI reliability testing by domain
  • Lessons learned
  • Figure 5: OPI reliability testing by sub-domain
  • Annex 1: Organizational Performance Index

Sources

Pact. Capacity Development Evaluation