Black Box of Change = a term used to express the complexity of understanding and decomposing the factors that drive sector or programme change
Contribution Analysis = analysis to measure the contribution of programme outputs to sector results
Intervention Logic = a description of the implementation approach to achieve results
New Intervention Logic = a new results oriented description of the implementation approach to achieve sector-based results
OP = Operational Programme = a national strategy to address key priorities and at the same time contribute to EU2020 objectives
Operation = the way in which a programme is implemented
Other Factors = the factors outside the control of the programme that influence the sector results
Outcomes = the change or effects of a programme, the benefits of the programme

Outputs = direct products & services that contribute to results
Programme Outputs = the products and services produced by programme inputs and activities
Programme Results = the measurable change in well-being in a target group defined in the programme objectives
Results = specific dimension of well-being and progress (for target group/sector)
that motivates policy action
Results Chain = a linear view of intervention logic showing links between inputs, outputs and results (usually programme-based)
Results indicators = variables that provide information on specific aspects of results (baselines + targets needed)
Sector Results = the measurable change in well-being in a sector
Theory of Change = A list of the assumptions on which the programme logic is based. (Think of a series of “if-then” statements)

The reading guide contains sources and reading recommendations for this course: articles, directives, regulations, Commission’s guidance documents and more.

1. EC General guidance

Better Regulation: https://ec.europa.eu/info/better-regulation-guidelines-and-toolbox_en

DG Regio Regulations: http://ec.europa.eu/regional_policy/en/information/legislation/regulations/ 

• CPR
• ERDF / ESF Regulation
• Common Indicators

       2. DG Regio Guidance

http://ec.europa.eu/regional_policy/en/information/legislation/guidance/

•     Programming
•     Implementing
•     Evaluation: http://ec.europa.eu/regional_policy/en/policy/evaluations/

Outcome indicators and targets, Barca, McCann, June 2011: http://ec.europa.eu/regional_policy/sources/docgener/evaluation/doc/performance/outcome_indicators_en.pdf

     3. DG Employment Guidance

ESIF Open Data Platform: https://cohesiondata.ec.europa.eu/

ESF Monitoring and Evaluation Guidance, June 2015 edition: https://ec.europa.eu/sfc/en/system/files/ged/ESF%20monitoring%20and%20evaluation%20guidance.pdf

Evaluation: http://ec.europa.eu/regional_policy/en/policy/evaluations/

Strategic reporting 2007-2013: http://ec.europa.eu/regional_policy/index.cfm/en/policy/how/stages-step-by-step/strategic-report/

    4. Eurostat website and publications

Europe 2020 headline indicators: http://ec.europa.eu/eurostat/statistics-explained/index.php/Europe_2020_headline_indicators

Smarter, greener, more inclusive?
Indicators to Support the Europe 2020 Strategy: http://ec.europa.eu/eurostat/documents/3217494/8113874/KS-EZ-17-001-ENN.pdf/c810af1c-
0980-4a3b-bfdd-f6aa4d8a004e

   5. World Bank text book

The Road to Results: https://52.21.52.208/bitstream/handle/10986/2699/52678.pdf?sequence=1&isAllowed=y