Rome, 16-17 May 2012
Access to Monitweb and
use of ESF data
Paola Stocco
ISFOL - Sistemi e servizi formativi
Dictionary of acronyms
IS
ISFOL
MA
MEF
MEUR
MLHSP
(R/N)OPs
NSF
Information System
Institute for the Development of Vocational Training for Workers
Managing Authorities
Ministry of Economy and Finance
Ministry of Education, University and Research
Ministry of Labour, Health and Social Policies
Regional/National Operational Programmes
National Strategic Framework
ISFOL and his main fields of research
ISFOL, institute of research controlled by Ministry of
Labour, promotes activities of study in:
• Vocational training policies
• Market Labour policies
• Social Cohesion policies
• Knowledge Society policies
EUROPEAN SOCIAL FUND 2007-2013 in Italy:
21 ESF ROPs and 3 ESF NOPs
Regional Competitiveness and Employment Objective:
 16 ROPs concern Regions and Autonomous Provinces:
Abruzzi, Aosta Valley, Autonomous Province of Bolzano, Autonomous Province of
Trento, Emilia Romagna, Friuli Venezia Giulia, Latium, Liguria, Lombardy, Marches,
Molise, Piedmont, Sardinia, Tuscany, Umbria, Veneto
 1 NOP held by the MLHS:
Azioni di sistema
Convergence Objective:
 5 ROPs concern Regions:
Apulia, Calabria, Campania, Sicily, and, in addition, Basilicata (phasing out region)
 2 NOPs:
Governance e Azioni di sistema NOP, held by the MLHSP
Competenze per lo sviluppo NOP, held by the MEUR
THE MAP OF ESF ROPs 2007-2013 in Italy
ISFOL and the links with other policy makers (1/2)
ISFOL supports the activity of the Ministry of Labour,
which is the ESF leading authority in Italy
The Ministry of Economy and Finance is the Authority
responsible of the IT Central Information System
(MonitWeb) for the European Structural Funds 20072013
ISFOL cooperates with the Managing Authorities of
ESF OPs and the MEF in order to collect the
information for the ESF monitoring and evaluation
Isfol – Sistemi e Servizi formativi
ISFOL and the links with other policy makers (2/2)
This chart shows the flow of data releted to ESF projects and the role of
ISFOL
Ad hoc data transfer (*)
Communication Net
Systematic data transfer
MLHSP - DG PAPL
ISFOL
MEF-IGRUE:
ESF Ops
National Monitoring
System
(ROPs + NOPs)
Regional
coordination
system
EC
Isfol – Sistemi e Servizi formativi
National
Evaluation System
The coordinating role of ISFOL
All Italian OPs have their own Information System for
collecting data
ISFOL supports the local/regional level to select the correct
information that have to be sent to the Central Monitoring
System (MonitWeb)
National Monitoring Working Group: periodically Isfol meets
the Managing Autorities of ESF OPs in order to discuss
common issues and to improve the implementation of data
into MonitWeb
Isfol – Sistemi e Servizi formativi
Final-user role of ISFOL
As Technical Assistance Agency of the Ministry of Labour,
ISFOL has access to Monitweb
As read-only user, we can surf in the “official area” where we
can query/extract the data “validated” by ESF OPs
We can do that by using a Business Objects Infoview
(Datamart)
The Datamart’s tools allow us to organize the information in
“queries” that we save in our own web site
Isfol – Sistemi e Servizi formativi
Querying Monitweb
The variables set of Monitweb is established in the “Data
Exchange Protocol”, with the agreement of all the actors
involved with ESF
We have stored several queries for all the OPs co-financed
by the ESF using the variables codes in the “Data Exchange
Protocol”
In this way we can use them everytime a data update occurs
in MonitWeb, just renewing them
Isfol – Sistemi e Servizi formativi
ESF data for local usage
micro data level
Data are related both with projects and participants
(about 400.000 projects at the end of 2011)
aggregate data level
we can save the results of the queries in local area so we
can treat them to figure out the progress of the OPs cofinanced by the ESF at national level
Isfol – Sistemi e Servizi formativi
Statistical treatment of data
We generally use STATA software in order to:
- merge all the files obtained from the queries
- create a structured database
- check the reliability and the consistency of the data
- produce statistical analysis
Isfol – Sistemi e Servizi formativi
Monitoring data: a tool for evaluation needs
National/international
literature and document;
case studies;
Quantitative analysis
E
Qualitative analysis
V
Effectiveness indicators
A
L
Ad-hoc Surveys
Context indicators and
target
U
A
T
Monitoring data
Outputs indicators
Outcomes indicators
I
O
N
Isfol – Sistemi e Servizi formativi
Monitoring data and evaluation issues
Isfol coordinates two
National Working Group
strongly linked between them:
we could obtain the population
frame from Monitweb in ordert to
perform sampling surveys for
evaluation aims
National Placement
Working Group
National Monitoring
Working Group
1. Training projects and
beneficiaries database:
application form for
pre-enrolment
• 2. Harmonizing regional’s surveys: the
questionnaire
• 3. Models for the impact evaluation (net
effects)
• 4. Robustness of the surveys (from a
statistical point of view)
• 5 ….