Towards a new model for evaluating the merit of Italian
academic scientists and their institutions
Faculty of
Life Sciences
Mauro Degli Esposti
Ferrara, Jan 2011
A new analysis of Italian universities – the start
From The Times October 9, 2008
Whatever happened to the University of Bologna?
The University of Bologna, which received its charter from Frederick I Barbarossa in
1158, was probably the first university founded in the Western world. It became a
renowned home to scholars of great distinction in both the sciences and the humanities.
The Times Higher Education-QS World University Rankings survey was published this
week. It rates the performance of universities according to the quality of their research,
the employment rates of graduates and their international profile.
The University of Bologna does not feature in the top 100!
Harvard = 1, Cambdrige = 3, Oxford = 4, UCL = 7...
Manchester = 29 – now 26
M Degli Esposti, presented at the first conference of Via-academy, 21 September 2009
http://via-academy.org/Relazione_Prima_Conferenza_della_VIA_a_Manchester.aspx
MERIT – a new approach to evaluation
The members of the Via-academy network who work in UK have been selected
on the basis of merit, but educated in Italy.
The number of academic links of Via-members with Italian institution will be
proportional to the relative teaching capacity of these institutions – i.e. they
will be an output measure of their quality and relative standing.
Diritto di cronaca
12/10/2009
Un ateneo per scappare
di FLAVIA AMABILE
M Degli Esposti, presented at the first conference of Via-academy, 21 September 2009
http://via-academy.org/Relazione_Prima_Conferenza_della_VIA_a_Manchester.aspx
Italian University
Times QS
Leiden 250
VIA members
Bologna
1
3
3
Roma 1 ‘La Sapienza’
2
2
2
Padova
4
4
4
Pisa
5
7
6
Firenze
6
8
8
Napoli ‘Federico II’
7
5
5
Milano
15
1
1
0.31
with Leiden
1
With Leiden
0.79**
with Leiden
Kendall tau correlation
coefficient by Marco Geraci
M Degli Esposti, presented at the first conference of Via-academy, 21 September 2009
VIA25 - cumulative ranking from 10 separate rankings
October 2009
Italian University
VIA25
Gelmini virtuose (27+)
Padova
1
14
Bologna
2
16
Milano
3
11
Roma 1 ‘La Sapienza’
4
(42)
Torino
5
8
Pisa
6
22
Firenze
7
27 (later)
Pavia
8
25
Trento
9
1
Napoli ‘Federico II’
10
(38)
0.63**
with Leiden
0.09
with Leiden
Kendall tau correlation
coefficient by Marco Geraci
http://rpc264.cs.man.ac.uk/VIA/index.php/VIA25
parere sull'iniziativa 'top italian scientists'
80
70
numero
60
50
40
30
20
10
0
positivo
neutro
negativo
ISI negativo
M Degli Esposti, presented at
the second conference of Viaacademy, 18 September 2010
From ‘top Italian scientists’: ranking of Italian institutes
La Stampa 30/8/10
La Repubblica 5/1/2011
400 TIS
1230 TIS
M Degli Esposti, December 31, 2010 – retrieved from:
http://www.topitalianscientists.org/Top_italian_scientist
s_VIA-Academy.aspx
Rank
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
Italian Institution
Bologna
CNR, all
Milano
Padova
Roma
Torino
INAF, all
San Raffaele Milano
Firenze
Ist. Naz. Tumori Milano
Pisa
Ferrara
Napoli
Mario Negri Miano
Genova
Roma 2
Perugia
Pavia
Brescia
Trieste
Modena
Normale Pisa
Milano Bicocca
Parma
IEO Milano
Sanita' Roma
IFOM Milano
Bari
Verona
SISSA Trieste
Siena
Trento
Humanitas Milano
IIT Genova
Roma 3
Udine
Cagliari
Cattolica Roma
Bocconi Milano
Ancona
Gaslini Genova
Palermo
Sum of H-Index
3019
2524
2113
2060
1713
1619
1420
1333
1205
1106
1049
998
959
931
891
880
804
712
610
585
489
478
436
433
427
423
399
388
386
374
374
373
336
326
326
297
250
244
222
217
186
182
N. of TIS
71
63
46
46
41
38
38
28
29
25
23
26
23
20
20
21
19
15
15
13
12
11
8
10
9
10
8
9
9
10
9
9
6
8
8
7
5
6
5
6
3
5
The media resonance of ‘top Italian scientists’
Italian biochemists and their h-index
Note
Correlation h-index for biochemists, 54
names
Valori di h-index sono
stati calcolati cosi’:
X, con Google Scholar
add-standard, con iniziale,
ristretto alle aree ‘chemistry’,
‘biology’ and ‘medicine’
Y, con ISI Web of Science,
In genere ‘all years’
nei settori di bio-medicina
(non clinici) e chimica
(e.g. medicinal chemistry)
h-index ISI WoS
100
90
y = 0.97
80
R = 0.973
2
70
60
50
40
30
mean for full professors = 19
20
10
0
0
Mauro Degli Esposti La Voce.it, 14-9-10
20
40
60
80
h-index Google Scholar add-on
http://www.topitalianscientists.org/downloads/Manualetto_del_Ricercatore_Provetto_ver1.2.pdf
100
Italian scientists: home and abroad
Home - in Italy (50)
Abroad (50)
over 70
under 50
>70
female
>70
prize winners
cell biologists/cancer
physics
chemistry & biochemistry
computer sciences
economics
average h-index computer
scientitsts
average h-index
70
60
TIS Reports 001
50
http://tisreports.com/fullreport/1-Top_100_-_home___abroad.aspx
40
30
20
10
0
abroad
Italy
Top Italian Scientists – towards the saturation of names?
ultimo aggiornamento: 09/11/2010
Top Italian Scientists List
1118 names
all top updated
ID
1
2
3
4
5
6
7
8
Academic
Carlo Croce
Napoleone Ferrara
Alberto Mantovani
Giorgio Trinchieri
Ettore Appella
Giuseppe Remuzzi
Alex Sette
Tomaso Poggio
number of names
9 Lorenzo Moretta
10 Antonio Lanzavecchia
11 Alessandro Moretta
12 Giuseppe Mancia
13 Pietro De Camilli
14 Silvia Franceschi
15 Alberto Alesina
16 PP Pandolfi
17 Piero Anversa
18 1400
Tullio Pozzan
19 A Maseri
20 Carlo La Vecchia
21 G Rizzolatti
22 1200
Paolo Sassone-Corsi
23 PG Pelicci
24 Dario Alessi
25 Ele Ferrannini
26 PM Mannucci
1000
27 R Dalla Favera
28 A Sangiovanni Vincentelli
29 Mario Gerla
30 Roberto Bolli
800Romagnani
31 Sergio
32 A Aguzzi
33 Rino Rappuoli
34 Vincenzo Di Marzo
35 LL600
Cavalli-Sforza
36 Marco Colonna
37 Renato Baserga
38 Elisabetta Dejana
39 Ernesto Carafoli
400
40 Massimo Filippi
41 Vincenzo Balzani
42 Zaverio Ruggeri
43 PM Comoglio
200
44 GL
Gessa
45 M Parrinello
46 Umberto Veronesi
47 Alfonso Caramazza
48 DC Altieri
0
49 Paolo Boffetta
50 Elio Riboli
51 G Bernardi
52 Giorgio Parisi
53 Marco Pierotti
54 Marino Zerial
55 Mario Capecchi
h index
125
119
109
109
102
99
98
98
95
93
92
92
92
92
89
88
87
86
85
85
85
85
85
84
84
84
84
83
81
80
80
79
79
79
78
78
78
77
76
76
76
76
75
73
73
73
72
72
72
71
71
71
71
68
68
Nation
USA
USA
Italy
France/USA
USA
Italy
USA
USA
Area
cancer - medicine
cancer - medicine
immunology - medicine
immunology - medicine
immunology - medicine
nephrology - medicine
immunology - medicine
computer, neurosciences, social sciences
Italian Institution
Italy
Switzerland
Italy
Italy
USA
Italy/France
USA
USA
USA
Italy
Italy
Italy
Italy
USA
Italy
UK
Italy
Italy
USA
USA
USA
USA
Italy
Switzerland
Italy/UK
Italy
USA
USA
USA
Italy
Switzerland/Italy
Italy
Italy
USA
Italy
Italy
Switzerland
Italy
USA/Italy
USA
France
UK
Italy
Italy
Italy
Germany
USA
immunology - medicine
immunology - medicine
immunology - medicine
clinical - medicine
cell biology - neurosciences
epidemiology - medicine
economics
cancer - medicine
cancer - medicine
cell biology
clinical - medicine
cancer - medicine
neurosciences
neurosciences
cell biology - medicine
biochemistry
diabetes - medicine
haematology -medicine
cancer - medicine
computer sciences
computer sciences
cardiology - medicine
immunology - medicine
neurosciences - medicine
pharmacology
pharmacology - neurosciences
population genetics
immunology - medicine
cancer - medicine
cancer - mol cell biology
biochemistry - cell biology
neurology - medicine
chemistry
haematology -medicine
cancer - medicine
neurosciences
chemistry - physics
cancer - medicine
psychology - neurosciences
cancer - medicine
epidemiology - cancer
epidemiology - medicine
neurology -medicine
physics
cancer - medicine
cell biology
genetics - mol cell biology
Gaslini GE
Evolution TIS List
note
Lasker award 2010
Humanitas e Milano
Mario Negri
youngest top
most eclectic
83% of the
top100 work in
Bio-medicine!
Genova
Milano Bicocca
Torino
top female
CNR Pisa e Padova
HSC Onlus
Milano
Parma
$ISI WoS
Grand Prix Sci. 04
IEO Milano
Pisa
Milano
PorP
IEEE Maxwell Award 2009
Firenze
PorP
Chiron
CNR Napoli
retired?
IFOM e Milano
Padova
San Raffaele
Bologna
Torino/IRCC
Cagliari
$ISI WoS
retired
h-index ISI = 85
senatore
M Degli Esposti, December 31,
2010 – retrieved from:
http://www.topitalianscientists.org/T
10-Aug 30-Aug 19-Sep 09-Oct 29-Oct 18-Nov 08-Dec 28-Dec Roma 2
Roma
h-index ISI = 81
op_italian_scientists_VIAIst Naz Tumori MI
PorP
time (date, 2010)
Academy.aspx
Nobel
Milano
Trento
200
Top Italian scientists abroad
(total = 363)
% total Top Italians
150
100
60
100
40
20
0
M Degli Esposti (2010), retrievedJanuary 3, 2011 from:
http://www.topitalianscientists.org/Top_italian_scientists_VIA-Academy.aspx
double
affiliation
50
abroad
0
Italy
number
80
Nel 2006 Italia = 93000 ricercatori
Fonte : OCSE
normalized performance of Italy in different areas
Areas of relative
excellence for Italy
normalized ranking vs. medicine
4
haematology
3.5
3
2.5
2
cancer
research
immunology
biochemistry
1.5
1
0.5
numero di scienziati
500
450
400
350
300
250
200
150
100
50
0
ag
e
in
ca ndo
g
nc cr
er ino
re lo
ne sea gy
ha phr rch
ep olo
at gy
on olo
g
in
te ne col y
rn u og
al ro y
im
m lo
m
ed gy
un
ic
in
ol
e
og
y/
a
l le
ne
rg
ur
y
os
m ci e
icr n
o b ce
io s
lo
gy
ce bi o
bi ll b log
oc io y
he log
m y
ph
ist
ry
ar
ph
m
ys
ac
ics
ol
og
m n ast
y
at u ro
he cle p
h
m ar ys
at p ic
ica hy s
l p sic
hy s
si
m
cs
at
he
m
at
ics
ec
on
om
y
ch
em
ist
ry
ve
te
ri n
ar
y
ha
em
at
ol
og
y
0
SCImago. (2007). SJR — SCImago Journal & Country Rank.
Retrieved November 10, 2010, from http://www.scimagojr.com
top scienziati per discipline
M Degli Esposti, December 31,
2010 – retrieved from:
http://www.topitalianscientists.org/T
op_italian_scientists_VIAAcademy.aspx
TIS
Fonte : ISTAT
Ranking di universita’ statali e non – problems
L’università italiana ha finito
anche la frutta
di Andrea Aparo
IL Fatto Quotidiano, 12 Novembre 2010
Ricercatori italiani uguale fannulloni?
di Pietro Greco
Scienza in Rete (http://www.scienzainrete.it)
04/05/2009
Ranking for Italian universities – various and different
Ranking
From
Times QS - THE
UK
QS Agency and Times
Mix of 6 parameters
ARWU
China
Jiao Tong Shanghai University
Mix of 6 parameters (different)
Leiden top 250
Holland
CSTS Leiden University
Bibliometric (normalized)
Webometrics
Spain
Cybermetrics lab, CISC
Based on data of web visibility
Vision
UK - Italy
Vision think-tank
Mix of 5 parameters (2009)
Campus super
Italy
Campus magazine
Average of 8 rankings
Sole 24 Ore
Italy
Sole 24 Ore newspaper
Mix of national parameters
Repubblica Censis
Italy
Censis Institute
Mix of national parameters
MIUR
Italy
CIRV, VTR2001-2003
Bibliometric (selected)
Kendall corr.
VIA25_1 stampa
VIA25_2
VIA_memb
times_09
iarwu_09
webo_09
leid_orange
campus
campus_super
sole_09
censis_09
censis_10
social_cap_gate
gelmini_09
udu_09
source
nature
coefficient
VIA25_2 VIA_membtimes_09
0.88** (25) 0.53** (16) 0.42* (19)
0.51** (16) 0.46* (19)
0.43 (12)
VIA25-1 s VIA25_2
iarwu_09 webo_09 leid_orangecampus
0.65** (18) 0.68** (19) 0.63** (18) 0.39* (18)
0.7** (18) 0.73** (19) 0.63** (18) 0.42* (18)
0.66** (12) 0.49* (13) 0.79** (13) 0.29 (11)
0.24 (14) 0.49* (16) 0.31 (16) 0.08 (14)
0.56** (15) 0.64** (15) 0.33 (13)
0.49* (14) 0.12 (13)
0.08 (13)
VIA_membtimes_09 iarwu_09 webo_09
leid_orangecampus
campus_super
sole_09
censis_09
0.54** (21) -0.12 (17) -0.19 (14)
0.52** (21) -0.12 (17) -0.25 (14)
0.46* (15) -0.36 (10) -0.03 (9)
0.25 (17) 0.02 (12) -0.02 (11)
0.45* (15)
-6.16 -0.28 (9)
0.31 (15) -0.35 (12) -0.22 (9)
0.42* (16) -0.64** (12)-0.06 (9)
0.54** (14) 0.21 (14) 0 (12)
0.05 (14) 0.03 (13)
0.26 (13)
campus_super
sole_09
censis_10 social_cap_gate
gelmini_09 udu_09
MIUR_09
0.08 (13) 0.65** (22) -0.04 (17) 0.57** (20) 0.59** (20)
-0.1 (13) 0.69** (22) -0.03 (17) 0.59** (20) 0.6** (20)
-0.6 (6)
0.49* (13) -0.02 (10) 0.64** (13) 0.71** (14)
-0.24 (10) 0.46* (18) -0.1 (13) 0.3 (17)
0.35 (16)
-0.57 (8) 0.53** (17) -0.24 (11) 0.57** (17) 0.57** (18)
-0.11 (8) 0.81** (19) -0.4 (13) 0.48** (17) 0.49** (16)
0.07 (8)
0.53** (16) 0.09 (12) 0.67** (16) 0.75** (17)
-0.24 (10) 0.22 (15) 0.28 (15) -0.01 (14) 0.03 (14)
-0.05 (11) 0.35* (18) -0.05 (13) 0.53** (17) 0.41* (17)
0.13 (11) -0.25 (14) 0.01 (15) -0.3 (12) -0.42 (12)
0.73** (10) -0.38 (11) 0.09 (12) -0.24 (10) -0.07 (10)
-0.09 (11) 0.06 (9)
-0.2 (10) -0.06 (9)
-0.16 (14) 0.49** (19) 0.53** (18)
-0.15 (12) -0.12 (12)
0.75** (19)
censis_09 censis_10 social_cap_gate
gelmini_09 udu_09
MIUR_09
Marco Geraci e Mauro Degli Esposti, unpublished results, October 2010
In depth analysis of all ranking – recent advances
GRAND VIA - a new meta-ranking combining 5 international and 4 national ones
From co-variance patterns – principal components analysis, PCA (Pearson, 1901)
Marco Geraci e Mauro Degli Esposti, November 2010, in preparation
Ranking of Italian universities: 2 principal components
Principal component analysis of different rankings of Italian universities
1.0
Rankings map
Campus Super
Campus
Sole
Censis-Repubblica
Gelmini
Times-QS
iARWU
VIA-TopH
Top Italian Scientists
UDU
VIA-Member
MIUR
Webometrics
0.0
Leiden Orange
-0.5
National performance
PC2 (25.9%)
0.5
Grand
VIA
Grand VIA
Vision
-0.5
0.0
International impact and visibility
0.5
PC1 (39.7%)
Marco Geraci e Mauro Degli Esposti, November 2010 in preparation
1.0
Ranking from ‘top Italian scientists’ – better than others!
cumulative correlation with rankings
cumulative correlation
3.5
3
2.5
2
1.5
1
0.5
0
Times QS
ARWU
Grand VIA
Vision
Computed over 4 different international rankings
Marco Geraci e Mauro Degli Esposti, November 2010
Top H
Italians
Evaluation landscape of state Italian universities
Individuals factor map
+
average
Padova
Trento
Bologna
Torino
Firenze
Pavia
Roma 1
average
Pisa
Parma
Milano
Napoli
Perugia
Roma 2
-
National performance (PC2)
Politecnico MI
-
International impact and visibility (PC1) +
Marco Geraci e Mauro Degli Esposti, submitted
Landscape of state Italian universities - all
Ferrara
Marco Geraci e Mauro Degli Esposti 2010, submitted…
Ferrara university – ranking among top institutes in Italy:
before
Rank
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
and after systematic analysis 31-12
15-12
Italian Institution
Bologna
CNR - global
Milano
Padova
Roma
Torino
INAF - global
San Raffaele Milano
Firenze
Ist Naz Tumori Milano
Pisa
Napoli
Mario Negri Milano
Genova
Roma 2
Perugia
Pavia
Brescia
Ferrara
Trieste
Modena
Normale Pisa
Total TIS = 15
Sum of H-Index
3019
2524
2113
2060
1713
1619
1420
1333
1205
1106
1049
959
931
891
880
804
752
610
589
585
489
478
N. of TIS
71
63
46
46
41
38
38
28
29
25
23
23
20
20
21
19
16
15
15
13
12
11
Rank
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
Italian Institution
Bologna
CNR, all
Milano
Padova
Roma
Torino
INAF, all
San Raffaele Milano
Firenze
Istit. Naz. Tumori Milano
Pisa
Ferrara
Napoli
Mario Negri Miano
Genova
Roma 2
Perugia
Pavia
Brescia
Trieste
Modena
Normale Pisa
+ 11 new TIS = 26
Sum of H-Index
3019
2524
2113
2060
1713
1619
1420
1333
1205
1106
1049
998
959
931
891
880
804
712
610
585
489
478
N. of TIS
71
63
46
46
41
38
38
28
29
25
23
26
23
20
20
21
19
15
15
13
12
11
Ferrara university – ranking among state universities:
before
Ranking = 15
Total TIS = 15
M Degli Esposti, December 15, 2010 – retrieved from:
http://www.topitalianscientists.org/Top_italian_scientists_V
IA-Academy.aspx
and after systematic analysis
Ranking = 10
+ 12 new TIS = 27
M Degli Esposti, January 5, 2011 - retrieved from:
http://www.topitalianscientists.org/Top_italian_scientists_V
IA-Academy.aspx
Different Area – different impact
(publications and citations)
•Normalization? By which criteria?
•Which database to use for reference?
NOT ISI WoS!
M Degli Esposti, September, 2010 – retrieved from: Manueletto del Ricercatore Provetto
Scientometrics 73 (2007)
The normalization factor
follows a ‘stretched exponential’;
it becomes bigger by increasing
the number of published articles
For scientists with less than
50 published articles, the fieldspecific differences are small
h-index - discrepancies between different databases
Note
Correlation h-index mathematicians,
24 names
Valori di h-index sono
stati calcolati cosi’:
Y, con ISI Web of Science,
all years, ristretto
ai settori matematici
Matematici con nomi
Compositi (e.g. De Giorgi)
sono esclusi - ISI non li trova!
40
h-index ISI WoS
X, con Google Scholar
add-standard, con iniziale,
ristretto all’area
‘egineering and mathematics’
y = 0.599
2
30
R = 0.83
20
10
0
0
10
20
30
40
50
60
h-index Google Scholar add-on
NOTA: usando Google Scholar si normalizza gia’ le citazioni dei matematici
rispetto a quelle che si computano con ISI WoS.
Questo risulta in una normalizzazione automatica di un fattore = 1.67,
Simile al fattore di nromalizzatione proposto da Iglesias (2007) ca. = 1.83
Mauro Degli Esposti – Via-academy.org, 6-9-2010
Discrepancies between different databases for h-index:
the problem with chemistry
Average h-index
25
20
Add-on
PorP
ISI WoS
ISI
Google Scholar
15
Correlation h-index for chemists
80
10
ISI WoS
5
0
database
70
y = 1.379
60
R = 0.802
n = 38
2
50
40
30
20
10
0
All chemists of Ferrara university
0
40
20
PorP
Mauro Degli Esposti, 21-12-2010
Correlation factor = 1.38
60
Ca
rd
io
lo
An
P a g ia
at
t
om olo
gi
ia
a
Is
U
to
F
m
lo
ar
gi
m ana
a
ed a co
Em log
ia
M
br
ed
io
lo
ic
gi
in
a
a
Sc
ie
M In te
nz
icr
r
e
ob na
F
i
ol
ar
An
og
m
at
a
om
ce ia
u
ia
,I
Em tich
st
e
ol
og ato
lo
ia
, C gia
it o
lo
gi
a
Fi
sic
Bi
a
C
ol
og h im
ia
i
Ev c a
Fi
si
o
Sc olo lu ti
v
g
ie
nz i Um a
e
de ana
lla
M Ter
at
r
em a
at
In
i
fo ca
rm
at
ica
Total citations
70
60
50
40
30
20
Mauro Degli Esposti, 5-1-2011
Add-On (full name)
Average h-index
Number of TIS
top areas in Ferrara
average h-index Ferrara departments
40
35
30
y = 0.9086x
2
R = 0.9325
25
20
15
10
5
0
0
5
10
0
10
15
20
25
PorP (initial)
30
35
40
Fonte : National Science Board
Biomedicine: area variation of publication rate
Publications per year x 10-3
Correlation, R2 = 0.72
Neoplasms
6
%articles that are
patent-associated[
4
2
Relative disease burden (Log %)
at
o
An
at
o
m
ia
C
A
m
n
om
ia
, I atom p
a
st
ol i a r at
Bi
og U a
oc
ia ma
hi
,C n
m
ito a
ica
B
Es io log
Bi Bio er ch ia
im
ol
og log cizi
ica
o
i
ia a
F
A
C
el mb isic
/G i o
B i en ent
a
ol
og etic le
a
ia
Ev Mo
ol l
C
C
u
hi
ru ard tiva
rg io
C i
l
C lin a G ogia
lin ic
e
ica a C ne
D hir rale
er
m urg
C ato ica
lin
l
C ica ogi
lin
c
ica Me a
d
O ic
a
s
Em tetr
En a icia
do tolo
cr gi
Fi
si Fa ino a
ol rm lo
o
a g
Fi gia co ia
si
l
ol e B ogi
og i o a
Fi ia fisi
si G ca
ol en
o
G gia era
en
l
et U m e
Is
i
c
a
to
a
n
lo
M a
gi
e
a
di
ed
ca
I
E m gi
e
M
al bri ne
at ol
M tie og
ed I n i a
i
M cin fetti
ed a
v
M i c I nt e
ed in er
i c a L na
in
a ega
N
M uc le
i
N cro lea
ut
riz bio re
io log
ne ia
c
Pa linic
to a
lo
P e gi a
di
at
ria
An
biomedical and clinical scientists in Ferrara
Ordine alfabetico
5-1-2011
average h-index
total citations x 10-3
30
25
20
15
10
5
0
Fonte : OCSE
MERIT - evaluation
Let’s the discussion begin!
Fondazione CRUI luglio 2010
CAF = Common
Assessment
Framework
H-index, pagina 65 (su 85)
Evaluate university institutions and individuals:
The VIA-Ferrara model
A 3-step new evaluation model
TIME FRAME: end of 2010, beginning of 2011
Mauro Degli Esposti, 6 December 2010
Evaluate university institutions and individuals:
The Manchester model
Total weight
Publications =
40% of RQI
Mauro Degli Esposti, 6 December 2010
Evaluate university institutions and individuals:
The Manchester model
Research Quality Indicator = RQI
Before RAE 2009:
Category
- weight
Esteems
Publications
Environment*
5
75
25
PROBLEMS:
1. Evaluation of Publication quality by
Internal Committee – prone to politics!
2. No consideration of international standing
and individual’s scientific impact, e.g. h-index
*including research income
Mauro Degli Esposti, 6 December 2010
Evaluate university institutions and individuals:
The VIA-Ferrara model
A 3-step new evaluation model
1. Via-academy
•Quantitative evaluation of the
scientific impact of all Ferrara
scientists based on the systematic
analysis of h-index.
•Area-specific analysis of h-index
using average values of top Italian
scientists as reference
2. Ferrara
All scientists to provide by e-mail:
• a list with their top 4 papers in
the last 2 years;
• the number of Ph.D. and Master
students supervised;
• the total grant income obtained
from external sources.
TIME FRAME: end of 2010
3. Combine the analysis 1 with data in 2 to define the basic format (like in
Manchester) and quantify individual profiles - with 1 at least counting for 50%
Mauro Degli Esposti, 6 December 2010
Questions?
Simple model for auto-evaluation in specific disciplines within a university
Set a threshold of intrinsic (local) excellence by applying this formula:
Threshold = average + SD + 1 (in absolute value of h-index)
For example, Ferrara chemists:
Threshold = 15.6 + 7.5 + 1 = 24
Italian scientists: home and away
Media dei valori di h-index per gruppi di scienziati ed accademici italiani
che lavorano in Italia. I valori sono simili a quelli degli Italiani che lavorano all’estero.
70
Nota: la barra
corrisponde
alla
deviazione
standard.
60
h-index medio
50
40
30
20
Valore soglia
per entrare in lista
10
0
rettori e
direttori
biologi
astrofisici
Mauro Degli Esposti – La Voce.it, 14-9-2010
economisti
Su un totale di 1188 scienziati nella TIS al 15-12-2010,
Di cui 834 in Italia – escluso CNR ed INAF
Top Italian scientists per regione
Lombardia
Emilia-Romagna
Lazio
Toscana
Veneto
Piemonte
Friuli
Campania
Liguria
Umbria
Sicilia
Trentino-Alto Adige
Puglia
Marche
Sardegna
Calabria
Abruzzi
M Degli Esposti, December 15, 2010 – retrieved from:
http://www.topitalianscientists.org/Top_italian_scientists_VIA-Academy.aspx