NDLI: The Pagerank-Index: Going beyond Citation Counts in Quantifying Scientific Impact of Researchers

Content Provider	PubMed Central
Author	Senanayake, Upul Mahendra, Piraveenan Albert, Zomaya
Editor	Besselaar, Peter Van Den
Copyright Year	2015
Abstract	Quantifying and comparing the scientific output of researchers has become critical for governments, funding agencies and universities. Comparison by reputation and direct assessment of contributions to the field is no longer possible, as the number of scientists increases and traditional definitions about scientific fields become blurred. The h-index is often used for comparing scientists, but has several well-documented shortcomings. In this paper, we introduce a new index for measuring and comparing the publication records of scientists: the pagerank-index (symbolised as π). The index uses a version of pagerank algorithm and the citation networks of papers in its computation, and is fundamentally different from the existing variants of h-index because it considers not only the number of citations but also the actual impact of each citation. We adapt two approaches to demonstrate the utility of the new index. Firstly, we use a simulation model of a community of authors, whereby we create various ‘groups’ of authors which are different from each other in inherent publication habits, to show that the pagerank-index is fairer than the existing indices in three distinct scenarios: (i) when authors try to ‘massage’ their index by publishing papers in low-quality outlets primarily to self-cite other papers (ii) when authors collaborate in large groups in order to obtain more authorships (iii) when authors spend most of their time in producing genuine but low quality publications that would massage their index. Secondly, we undertake two real world case studies: (i) the evolving author community of quantum game theory, as defined by Google Scholar (ii) a snapshot of the high energy physics (HEP) theory research community in arXiv. In both case studies, we find that the list of top authors vary very significantly when h-index and pagerank-index are used for comparison. We show that in both cases, authors who have collaborated in large groups and/or published less impactful papers tend to be comparatively favoured by the h-index, whereas the pagerank-index highlights authors who have made a relatively small number of definitive contributions, or written papers which served to highlight the link between diverse disciplines, or typically worked in smaller groups. Thus, we argue that the pagerank-index is an inherently fairer and more nuanced metric to quantify the publication records of scientists compared to existing measures.
Related Links	http://dx.doi.org/10.1371/journal.pone.0134794
Starting Page	134794
File Format	PDF
ISSN	19326203
e-ISSN	19326203
Journal	PLoS ONE
Issue Number	8
Volume Number	10
Language	English
Publisher	Public Library of Science
Publisher Date	2015-08-19
Access Restriction	Open
Rights Holder	Public Library of Science
Subject Keyword	Research in Higher Education
Content Type	Text
Resource Type	Article
Subject	Multidisciplinary

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Measuring Scientific Impact Beyond Citation Counts

Citation analysis of faculty publication: beyond Science Citation Index and Social Science Citation Index.

The Field-Dependent Nature of PageRank Values in Citation Networks

What Affects Citation Counts in MIS Research Articles? An Empirical Investigation

Interdisciplinary Comparison of Scientific Impact of Publications Using the Citation-Ratio

Universality of citation distributions: Toward an objective measure of scientific impact

A citation-based, author- and age-normalized, logarithmic index for evaluation of individual researchers independently of publication counts

Impact of Impact Factor in quantifying the quality of scientific research

Improving the Measurement of Scientific Success by Reporting a Self-Citation Index

The Pagerank-Index: Going beyond Citation Counts in Quantifying Scientific Impact of Researchers

Similar Documents

Measuring Scientific Impact Beyond Citation Counts

Citation analysis of faculty publication: beyond Science Citation Index and Social Science Citation Index.

The Field-Dependent Nature of PageRank Values in Citation Networks

What Affects Citation Counts in MIS Research Articles? An Empirical Investigation

Interdisciplinary Comparison of Scientific Impact of Publications Using the Citation-Ratio

Universality of citation distributions: Toward an objective measure of scientific impact

A citation-based, author- and age-normalized, logarithmic index for evaluation of individual researchers independently of publication counts

Impact of Impact Factor in quantifying the quality of scientific research

Improving the Measurement of Scientific Success by Reporting a Self-Citation Index

The Pagerank-Index: Going beyond Citation Counts in Quantifying Scientific Impact of Researchers