MERL Tech DC 2019

The session will illustrate ways in which big data and data analytics can strengthen the evaluation of complex programs. Previous MERL Tech sessions on complexity have usually presented a specific analytical technique but without a framework for defining complexity or an overall methodology for evaluating complex programs. The first session will introduce a framework to assess the level of complexity of a development program and a 5 step methodology for evaluating complex programs.

This will be followed by a presentation on the importance of systems analysis for the evaluation of complex programs, and the opportunities and challenges for introducing big data and data analytics into systems analysis. The session will focus on systems mapping, systems dynamics and social network analysis.

The third presentation will discuss how the Independent Evaluation Group of the World Bank is applying complexity concepts in its evaluations and the potential contribution of big data to strengthen complexity-responsive evaluations.

All panelists will illustrate their presentations with examples of widely used big data and data science technologies that are starting to be introduced into program evaluation (e.g. geospatial analysis and remote sensors, social network analysis, mobile apps and social media analysis - among others). Panelists will also draw lessons on the opportunities and challenges of using big data in program evaluation.

Participants will leave with a clearer understanding of: complexity, a user-friendly approach for evaluating complex programs, real-world examples of how big data techniques have been applied in complexity-responsive evaluations – and the accessibility of these approaches to development agencies. It is hoped the framework will stimulate further research and future MERL Tech sessions on the application of big data tools to complexity evaluation.