DESIGNING AND IMPLEMENTING E-GOVERNMENT POLICIES:
THE CASE OF THE PALESTINIAN AUTHORITY
TRENTO 28-29 MARCH 2012
social
The social and economic
The
and economicvalue
value
of
public
information
of public information
Carlo Batini
Universita’ degli Studi di Milano Bicocca
[email protected]
1
Remark
• Slides with symbol
will be
deliberately skipped, they are left to
provide further material
2
Public information and
social and economic value
Social value
Community
Economic value
Open
Public
data
service
Back
office
3
Public
Information
Market
Reuse
Private
Public information and
social value
Social value
Community
Economic value
Open
Public
data
service
Back
office
4
Public
Information
Market
Reuse
Private
Good policies for public information:
lessons learned in Italy
5
1. Defining relevant types of data:
Essential and personal data
Essential data are those public data that are
needed by citizens and businesses to exercise their
rights or else to achieve desired functionings
(“beings” and “doings”)
E.g. Which law or laws discipline this aspect of my
relationship with the Government?
Personal data are those public data that are
accessible to a single person or a circumscribed
number of persons that have the right to access
them
E.g. where is my file for passport renewal?
6
Examples of essential data
Mandelkern Report, France, 1995
•
•
•
•
•
•
•
Juridical data (laws, norms, etc.)
Statistical data
Geographical data
Environmental data
Metereological data
Economic and Financial data
Public Registries
7
2. The back/front offices as enabling technologies
for establishing policies
DataServices
& Services
Front office
Central PA
Front office
Local PA1
Front office
Local PA2
Back office
Central PA
Back office
Local PA1
Back office
Local PA2
Common front office
service oriented layer
Front office
Central PA
Front office
Local PA1
Front office
Local PA2
Back office
Central PA
Back office
Local PA1
Back office
Local PA2
Internal information flows
Common back office
cooperative layer
a. Technological architecture
in the traditional interaction
b. Technological architecture
in the new interaction
8
More on back office data
Community
Open
data
Public
Information
Common front office
service oriented layer
Front office
Central PA
Front office
Local PA1
Front office
Local PA2
Back office
Central PA
Back office
Local PA1
Back office
Local PA2
Internal information flows
Back
office
Public
Information
Common back office
cooperative layer
b. Technological architecture
in the new interaction
9
Example of enabling norm in Italy
Law 340/2000 art. 25 comma 2
Public administrations have free access to data
managed in public registries and documents,
except personal data and documents, in which case
they have to justify accessibility on the basis of
the adherence of data to their administration’s
responsibility.
10
3. Data Governance initiatives:
The same business as represented
in three national registries
Agency
Identifier
Name
Type of
activity
Address
City
Social
Security
CNCBTB765SDV
Canned meat
production of John
Ngombo
Retail of
bovine and
ovine
meats
35 Niagara
Street
New
York
Social
Assurance
0111232223
John Ngombo sales
Grocer’s
shop,
beverages
9 Rome
Street
Albany
Chambers of
Commerce
CND8TB76SSDV
Meat production in
New York state of
John Ngombo
Butcher
4, Garibaldi
Square
Long
Island
What shall we do?
Data Governance, Data Governance, Data Governance!
11
47
MF, MT
40
MI, MS
38
39
48
37
36
165
180
110
35
82
174
59
89
98
Taxpayer VAT
Belonging to
office
Tax registry
Land registry
office member
153
163
MI, MT, MD
Assisted
162
Drug addict
520
161
Civil Disability
91
Claiming
civil disabilities
RevenueSocial
life
Health and
Assistance
Unemployed
Student
Foreign
81
Town clerk
Politics
Work
Worker
MI
Candidate
Reported drug addict
101
2
54
80
Reported
Foreign affairs
92
88
171
142
School
Pension
Looking for new job
74
190
601
Justice
160
52
16
With scholarship
Central
Local Administrations
Administrations,
Piedmont,
Italy, 1995
2003
Individual
653
600
With disability
Veteran
Looking for first job
6
Housewife
Volunteer
Taxpayer
Retired
164
MGG, MI,
MIBCA ,
526MT, MTN
650
Self-employed
Employee
104
4
105
663
53
71
603
MAE, MF, 7
87
19
11
108
12 MGG, MI,
10
120
651
21
MIBCA, MLP,
9
20 MT,
65 MLPS,
24 25
97 109
MCE, 93
68MTN,51
96
501
131
MD, MURST45
172 137
64
656
173
55
86
136
516 515
531
506
111
602 170
507
Foreigner
Italian
Convict
MAE,
MURST,
66
MPI
Waiting for sentence
Applicant for
citizenship
Applicant for
Resident
visa
abroad
Condemned
99
72
63
18
27
MAE, MGG,
MI
90
5
132
73
MAE, MI,
MLPS
12
Reference on Data Governance
More on open data
Community
Open
data
Public
Information
Common front office
service oriented layer
Front office
Central PA
Front office
Local PA1
Front office
Local PA2
Back office
Central PA
Back office
Local PA1
Back office
Local PA2
Internal information flows
Back
office
Public
Information
Common back office
cooperative layer
b. Technological architecture
in the new interaction
14
Open essential data must be
free of charge
15
The Italian Official Journal
year 2000
16
Cost of bank transactions
$6,00
$5,00
$ Cost per transaction
$5,00
$4,00
$3,40
$3,00
$2,00
$1,00
$0,30
$0,10
$0,01
Banking by
Phone
Internet
Banking
$0,00
Visit to
Client
Client goes
to Teller
Client goes
to ATM
Source: Belltech - “America Economia”, Nov. 19, 1998, p. 209
17
The paradox of the
Italian Official Journal in 90s
Cost
ininliras
page
Costo
L. per per
pagina
L. 4.000
L. 3.500
1 € = 1880 liras
L. 3.000
L. 2.500
L. 2.000
L. 1.500
L. 1.000
L. 500
L. 0
18
L. 3.200
L. 30
Paper
Edizione edition
su carta
Electronic
edition
Edizione telematica
Source: Il Sole-24 Ore newspaper, nov. 2000
Outcome
• Italian Official Journal for free for the
last 60 days
• Eurpean Official Journal for free fr the
last 45 days
19
Open data must be of
good quality
(accurate, complete, current, etc.)
20
Applying data cleaning……
Agency
Identifier
Name
Type of
activity
Address
City
Social
Security
CNCBTB765SDV
Canned meat
production of John
Ngombo
Retail of
bovine and
ovine
meats
35 Niagara
Street
New
York
Social
Assurance
0111232223
John Ngombo sales
Grocer’s
shop,
beverages
9 Rome
Street
Albany
Chambers of
Commerce
CND8TB76SSDV
Meat production in
New York state of
John Ngombo
Butcher
4, Garibaldi
Square
Long
Island
21
We improve data quality……
Certified copy
Agency
Identifier
Name
Type of
activity
Address
City
Chambers of
Commerce
CND8TB76SSDV
Meat production in
New York state of
John Ngombo
Butcher
4, Garibaldi
Square
Long
Island
Entity
reconciliation
22
Agency
Identifier
Social Security
CNCBTB765SDV
Social Assurance
0111232223
Chambers of Commerce
CND8TB76SSDV
More on data quality……
2006
Open data must be linked:
linked open data
24
May 2007
September 2008
July 2009
Linked Open
Datasets
on the Web
September 2011
25
Initially data are
small disconnected clouds……
26
First level: give addresses (URI) to data
so that ……they are linked
http://www.grgad.dd
http://www.ffrrt.gf
http://www.httyud.dd
http://www.jypt.gf
http://www.ffrrt.gf
http://www.dsfad.dd
http://www.bbbyud.dd
http://www.htread.dd
http://www.ffoot.gf
http://www.fkurrt.gf
http://www.cvbyud.dd
http://www.ffopt.gf
27
First level: give addresses (URI) to data
so that ……they are linked
http://www.grgad.dd
http://www.ffrrt.gf
http://www.httyud.dd
http://www.jypt.gf
http://www.ffrrt.gf
http://www.dsfad.dd
http://www.bbbyud.dd
http://www.htread.dd
http://www.ffoot.gf
http://www.fkurrt.gf
http://www.cvbyud.dd
http://www.ffopt.gf
28
Second level: data have to be provided with
names (URN) in such a way to …
Legislative decree
December 5, 2003, n. 343
Sono prioritariamente inseriti
nel ruolo di cui al comma 1 i
dirigenti già inquadrati nelle
soppresse tabelle allegate alla
law august 23, 1988, n. 400,
i dirigenti vincitori di concorso
presso la Presidenza e i
dirigenti con incarico di prima
fascia. La collocazione dei
dirigenti nella posizione
soprannumeraria non comporta
alcun pregiudizio giuridico,
economico e di carriera.
?
Law august 23,
1988, n. 400
Capo I Gli organi del Governo
Art. 1
Gli Organi del Governo Formula di giuramento
1. Il Governo della Repubblica è
composto del Presidente del
Consiglio dei ministri e dei
ministri, che costituiscono
insieme il Consiglio dei ministri.
2. Il decreto di nomina del
Presidente del Consiglio dei
ministri è da lui controfirmato,
insieme
ai
decreti
di
accettazione delle dimissioni
del precedente Governo.
29
Assigning uniform names to Laws
Uniform Resource Names (URN)
Example Law 127, May 15, 1997
urn:state:law: 1997-05-15;127
Issuing
Authority
Type of
norm
Date and
number
30
Second level: data have to be provided with
names in such a way to make them “linkable”
Legislative
state:law:
decree
December
2003-12-05;343
5, 2003, n. 343
Sono prioritariamente inseriti
nel ruolo di cui al comma 1 i
dirigenti già inquadrati nelle
soppresse tabelle allegate alla
law august 23, 1988, n. 400,
i dirigenti vincitori di concorso
presso la Presidenza e i
dirigenti con incarico di prima
fascia. La collocazione dei
dirigenti nella posizione
soprannumeraria non comporta
alcun pregiudizio giuridico,
economico e di carriera.
Law,
state:law:
august 23,
1988-08-23;400
1988, n. 400
Capo I Gli organi del Governo
Art. 1
Gli Organi del Governo Formula di giuramento
1. Il Governo della Repubblica è
composto del Presidente del
Consiglio dei ministri e dei
ministri, che costituiscono
insieme il Consiglio dei ministri.
2. Il decreto di nomina del
Presidente del Consiglio dei
ministri è da lui controfirmato,
insieme
ai
decreti
di
accettazione delle dimissioni
del precedente Governo.
31
Open data should have
social value
32
Open data on www.il.data.gov (Illinois)
33
Social value – Economist October 2011
34
Who decides and How to decide
the social value of data?
• Government?
• Final users?
• Reciprocal interaction among the two?
Proposal:
1. PAs publish all types of data in its own information system that are potentially open data,
2. A third party certifies the correctness and
completeness of the statement
3. Citizens decide priorities
35
Open data should be
visible and geo-referenced
36
Map of rest areas in Illinois
Table
Map
37
Open data should be reusable,
so they should be changed into open services
38
From
www.data.gov
(March 20, 2012)
Public
Collectivity
39
Example of App for open data
40
Popularity of applications
41
Economic value of information
just the flavour…
42
Concepts to be related
• Information quality, namely accuracy, completeness,etc.
• Information structure, organization of data and
operations on data
• Information diffusion, how information extracted from
data is used in the organization
• Information capacity, how many “different” pieces of
information can be extracted
• Information utility, how much available information is
effective for the organization
• Information value, how much it is economically
convenient to use ICT technologies to increase utility
How to relate all of them together and
with ICT (integration) technologies?
43
A Unified Model
Information
quality
Information
structure
Accuracy, Completeness
Data structure
Set of DB schemas
Query load
Transaction load
Information integration architectures
Data Integration technologies
Application
integration
architectures
Information
diffusion
Information
Capacity
Information
Utility
Information
Value
Publish&Subscribe technologies
Business process
structure
Costs
Set of Processes
44
Thank you!
45
Rests
46
Public information and
social and economic value
Community
Open
Public
data
service
Back
office
47
Public
Information
Market
Reuse
Private
Public
Publicinformation
informationand
and
social social
and economic
value value
Community
Open
data
Back
office
48
Public
Information
Market
Reuse
Private
More on the back office
Community
Open
data
Public
Information
Common front office
service oriented layer
Front office
Central PA
Front office
Local PA1
Front office
Local PA2
Back office
Central PA
Back office
Local PA1
Back office
Local PA2
Internal information flows
Back
office
Public
Information
Common back office
cooperative layer
b. Technological architecture
in the new interaction
49
50
New York City
51
Freedom of Information Act – USA - 1966
• Il Freedom of Information Act (FOIA), "atto
per la libertà di informazione", è una legge sulla
libertà di informazione, emanata negli Stati
Uniti il 4 luglio 1966 dal presidente Lyndon B.
Johnson, che impone alle amministrazioni
pubbliche una serie di regole per permettere a
chiunque di sapere come opera il Governo
federale, comprendendo l'accesso totale o
parziale a documenti classificati.
52
Tipologie di dati essenziali
(Rapporto Mandelkern, Francia, 1995)
•
•
•
•
•
•
•
Dati giuridici (atti normativi, la giurisprudenza)
Dati statistici
Dati geografici
Dati ambientali
Dati meteorologici
Dati economici e finanziari
Registri
53
New technological model - 1
start from principles
technologies are a tool, not an end
Users
Front office
Local PA1
Front office
Local PA2
Back office
Central PA
Back office
Local PA1
Back office
Local PA2
3.Internal information flows
2. Cooperative
Technological
infrastructure
Security and Privacy
Front office
Central PA
Social inclusion
Sustainability, efficiency and cost reduction
Effectiveness of services
4. Central
Data bases
Transaparency
Local
Data bases
Information
and
1. Seamless,
secure
service
flows
interface
Local
Document
bases
4. Global
Document bases
54
Main drivers of legal frameworks
Users
Front office
Local PA1
Front office
Local PA2
Back office
Central PA
Back office
Local PA1
Back office
Local PA2
Internal information flows
Cooperative
Technological
infrastructure
Authentication and anonymity
Front office
Central PA
Accessibility and user diversity
adaptivity
Interoperability of processes, data
and flows
Openness and Reuse
Central
Data bases
Quality and integration of data
and services
Local
Data bases
Seamless, secure
interface
Local
Document
bases
Global
Document
bases
55
Reference model
of the technological infrastructure
Users
Digital authentication
Front office
Central PA
Front office
Local PA1
Front office
Local PA2
Back office
Central PA
Back office
Local PA1
Back office
Local PA2
Internal information flows
Event notification infrastructure
Interoperability and cooperation
infrastructure
Authentication and anonymity
Seamless interfaces
Accessibility and user diversity
adaptivity
Interoperability of processes, data
and flows
Openness and Reuse
Central
Data bases
Quality and integration of data
and services
Local
Data bases
Multichannel access
Local
Document
bases
Global
Document
bases
Connectivity infrastructure
56
Example: the NormeinRete
technological architecture
Main principle
addressed:
transparency
Users
Digital authentication
Main drivers:
- interoperability
- accessibility
Multichannel access
Seamless interface:
Search index + URN resolution
Front office
Central PA
Front office
Local PA1
Front office
Local PA2
Back office
Central PA
Back office
Local PA1
Back office
Local PA2
XML markup + URNs
Local
Document
bases
Internal information flows
Central
Registries
DTDs
Names
Norms
Event notification infrastructure
Interoperability and cooperation
infrastructure
Global
Document
bases
Connectivity infrastructure
57
Life cycle of a legal framework in a single country
1.
2.
3.
4.
5.
6.
When a technology is at its mature stage,
produce a first draft
Experimentation in a small environment with
“safe-conduct”
Updated draft and request for comments
Impact analysis
Enactment of the final document
Adequate period of time for procedures and
infrastructure adjustment
58
Example: the NormeinRete
legal framework
Interoperability:
Accessibility:
W3G standards
adopted
Technical rules
for URNs and
XML formats
Users
Digital authentication
Multichannel access
Seamless interface:
Search index + URN resolution
Front office
Central PA
Front office
Local PA1
Front office
Local PA2
Back office
Central PA
Back office
Local PA1
Back office
Local PA2
XML markup + URNs
Local
Document
bases
Internal information flows
Central
Registries
DTDs
Names
Norms
Event notification infrastructure
Interoperability and cooperation
infrastructure
Connectivity infrastructure
59
Traditional scenario….
Court of Cassation
€
Publishers
Official Journal
€
€
60
…after Internet spreading…
Central PA
Judicial offices
Local PA
Publishers
€
61
….new scenario
Central PA
Judicial offices
Local PA
Normeinrete
62
Cooperative architecture
central registries
administration i domain
norms
administration j domain
names
registry
NIR-node
NIR
gateway
NIR-nodes
directory
norms
catalogue
NIR-node
norms
NIR
gateway
NIR services
indexing
search
index
searching
URN
resolution
front-office channels
63
Data referring to the same object
are non integrated and heterogeneous
Person
Fiscal
code
Registry
office
Driver
licence
reistry
Driver
Licence
code
Fiscal
code
Tax payers
registry
Numerical
code
Payroll
Mnemonic code
Health service
registry
64
Terzo livello: i links devono essere individuabili
in modo che i dati siano “interlinked”
Find SSN of tax payers that
States an income <= 10.000 € and
Own >= 1 Boats
Boat
Tax payer
Owns
States
Income
Tax payer
65