Measuring Impact in Pakistan

As implementer of USAID’s Pakistan Monitoring and Evaluation Program, MSI helps the Agency’s mission in the country manage its $4 billion development portfolio.

Our project team and local partners worked as independent monitoring and evaluation (M&E) units within the Pakistan mission to assist in the execution of three kinds of activities: 1) monitoring, verification and validation; 2) performance management; and 3) special studies. All activities required collecting and analyzing data on more than 100 projects supported by USAID throughout the country. With our local partners, we were able to monitor project activities in areas where access was restricted due to security or other concerns.

The project team conducted baseline, midterm and final evaluations; impact studies; and surveys. Key stakeholders participated in the design of tasks and activities; assisted with data collection and analysis; and helped inform our findings and recommendations to determine impact, inform future USAID programming, and enable the broader dissemination of knowledge as outlined in the USAID Evaluation Policy (January 2011).

For example, the team completed the largest-ever early grade reading assessment (EGRA), which involved testing over 31,000 school children in the third and fifth grades. The findings support the long-term measurement and improvement of early literacy in Pakistan.

The project team also gathered data for a stability index, an innovative, mixed-method study to help USAID’s mission in Pakistan understand the drivers of stabilization over time in the Federally Administered Tribal Areas and Khyber Pakhtunkhwa province. MSI’s geographic information systems (GIS/MIS) team also supported the Pakistan mission’s activities through the management of an electronic document library and training on USAID’s PakInfo, a system for collecting and sharing information about USAID projects in the country. The GIS/MIS team produced maps and graphical displays for USAID/Pakistan technical offices and our M&E units in Pakistan. It also developed methods for integrating GIS into the M&E system and created interfaces to improve data collection and error-free recording of data to support the EGRA activity.

The Pakistan M&E Program followed the Mission’s focus on results, sustainability and strengthening of M&E set forth by the USAID Forward reform initiative and the Quadrennial Diplomacy and Development Review.