ost          gretha

  

Comparing and Ranking in Science when both Quantity and Quality Matter


    Within a research project involving the Obervatoire des Sciences et Technique and the Gretha (CNRS and Univ Bordeaux), we have recently proposed an extension of the concept of stochastic dominance intensively used in economics for the comparison of composite outcomes both the quality and the quantity of which do matter.

We have applied this theory to the ranking of US research universities, thereby providing a new tool to scientometricians (and the academic communities) who typically aim to compare research institutions taking into account both the volume of publications and the impact of these articles.

Another application is provided for comparing and ranking academic departments when one cares for both the size of the department and some prestige measure of each member.

This web page provides to the community all our results (articles and all ranking tables). 

_____________________________________________________________________

Papers

Lead paper:

N. Carayol, A. Lahatte, 2017, Comparing and Ranking universities when quantity and quality both matter,  [paper], mimeo.  


Applied papers:
N. Carayol, G. Filliatreau, A. Lahatte, 2011, Reference classes: A tool for benchmarking universities research, [paper], Published in Scientometrics 2012.

N. Carayol, G. Filliatreau, A. Lahatte, 2011, Impact, dominance et classements des universites, [paper], forthcoming in Revue Economique.

N. Carayol, G. Filliatreau, A. Lahatte, 2012, Intensite, Qualite, Excellence et classements des universites, [paper], mimeo.



_____________________________________________________________________

A picture: dominance network among the top 112 US universities



weak dominance, best 112 US universities 

(All rights reserved - performed by A. Lahatte)
(weak dominance dyadic relations, transitive dominance relations are omitted, all publications are considered, impact is measured with citations)

______________________________________________________________________

Ranking of top US research universities

Interdisciplinary based rankings (all disciplines are included)

• Ranking when all publications are considered (phi = 1) and when direct citations (3 years window) are used to account for publications impact. All disciplines

• Ranking when all publications are considered (phi = 1) and when the direct impact factor of the journal (3 years window) is used to account for publications impact. All disciplines

• Ranking when all publications are considered (phi = 1) and when the relative impact factor of the journal (3 years window) is used to account for publications impact. All disciplines  

• Ranking when only publications in the top ten percent of their discipline are considered (phi = 0.1) and when the direct citations (3 years window) is used to account for publications impact. All disciplines  

• Ranking when only publications in the top ten percent of their discipline are considered (phi = 0.1) and when the direct impact factor of the journal (3 years window) is used to account for publications impact.  All disciplines  

•   Ranking when only publications in the top ten percent of their discipline are considered (phi = 0.1) and when the relative impact factor of the journal (3 years window) is used to account for publications impact.  All disciplines



Disciplinary based rankings (rankings are produced for each of the 8 large disciplines considered)

• Ranking when all publications are considered (phi = 1) and when direct citations (3 years window) are used to account for publications impact. (Fund. biology, Medicine, App. bio & ecol , Chemistry, Physics, Sc. of the univ., Eng. sciences, Mathematics)

• Ranking when all publications are considered (phi = 1) and when the direct impact factor of the journal (3 years window) is used to account for publications impact. (Fund. biology, Medicine, App. bio & ecol , Chemistry, Physics, Sc. of the univ., Eng. sciences, Mathematics)

• Ranking when all publications are considered (phi = 1) and when the relative impact factor of the journal (3 years window) is used to account for publications impact. (Fund. biology, Medicine, App. bio & ecol , Chemistry, Physics, Sc. of the univ., Eng. sciences, Mathematics)

• Ranking when only publications in the top ten percent of their discipline are considered (phi = 0.1) and when direct citations (3 years window) are used to account for publications impact. (Fund. biology, Medicine, App. bio & ecol , Chemistry, Physics, Sc. of the univ., Eng. sciences, Mathematics)


• Ranking when only publications in the top ten percent of their discipline are considered (phi = 0.1) and when the direct impact factor of the journal (3 years window) is used to account for publications impact. (Fund. biology, Medicine, App. bio & ecol , Chemistry, Physics, Sc. of the univ., Eng. sciences, Mathematics)


• Ranking when only publications in the top ten percent of their discipline are considered (phi = 0.1) and when the relative impact factor of the journal (3 years window) is used to account for publications impact.(Fund. biology, Medicine, App. bio & ecol , Chemistry, Physics, Sc. of the univ., Eng. sciences, Mathematics)

______________________________________________________________________

Ranking of top world wide departments in economics

• Ranking of top economic departments (all registered scholars in the departments are considered). Econ department

• Ranking of top economic departments when only scholars in the top ten percent cited are considered. Econ departments