How effective is the monitoring and evaluation (M&E) of adaptation implementation by the EU and its member states? This report examines the range of M&E efforts being undertaken and finds that some areas, such as the monitoring of policies, are more advanced than others. Furthermore, the majority of adaptation projects are still under development or implementation. This is an evolving area and further focus is needed on issues such as defining appropriate climate change indicators and metrics.
M&E can take place through the use of indicators to simplify and quantify often disparate data and information. Indicators can form the basis of efficiency and effectiveness assessments. The task of measuring the effectiveness of adaptation measures is challenging, and the development of appropriate outcome-based indicators should follow agreed adaptation objectives and targets.
Monitoring and evaluation is undertaken for different adaptation measures at various levels and in and across various sectors. Current progress in the monitoring and evaluation of adaptation measures is varied.
- At the national level, M&E efforts range from fully implemented strategies, as seen in Finland, to partial implementation and plans for developing monitoring systems, as in Spain.
- In comparison with monitoring, the evaluation of adaptation policies is still an emerging area in which little progress has been made. Only Finland, Germany and the UK have put in place formal procedures.
- M&E of adaptation programmes and projects is more advanced. These are more short-term and tend to be implemented in individual sectors or local areas where M&E systems already exist.
- The evaluation of projects, in particular of their overall effectiveness, is limited. For example, only the economic aspects of a capacity building project in the Pacific islands were evaluated.
The monitoring and evaluation of projects, policies and programmes is still developing. Among the lessons learned, gaps identified and issues for further consideration are the following:
- Consideration of M&E systems for adaptation projects, policies and programmes should be included in the design of an adaptation measure.
- Despite the challenges, the benefits of using indicators are considerable. They allow for a comparison of the situation after adaption implementation with initial conditions before implementation.
- Regarding the type of adaptation indicators that planners and practitioners should select, it is suggested that a mix of quantitative, qualitative and narrative tools be used, including surveys and scorecards.
- Many adaptation policies and programmes lack measurable targets or clearly defined outcomes. Without these, indicators cannot be used to evaluate effectiveness.
- The European Environment Agency sees a need for an agreement on the definition of key climate change indicators, including extreme weather events (such as floods and droughts).
