Study Comparing Traditional Versus Alternative Metrics to Measure the Impact of the Critical Care Medicine Literature


Kaul V, Bhan R, Stewart NH, Behrens DM, Gutman A, Dangayach N, et al. Study Comparing Traditional Versus Alternative Metrics to Measure the Impact of the Critical Care Medicine Literature. Critical Care Explorations [Internet]. 2019;


Our objective was to evaluate the association between traditional metrics such as Impact Factor and Eigenfactor with respect to alternative metrics. The Altmetric Attention Score for the top nine pulmonary and critical care journals was compared with Impact Factor, Eigenfactor, and citations over two time periods (2007–2011 and 2012–2016). There was a significant increase in the Altmetric Attention Score (52 from 2007 to 2011 vs 1,061 from 2012 to 2016; p < 0.001) but no significant differences in Total Citations, Impact Factor, or Eigenfactor. There was a strong positive correlation between citations and Altmetric Attention Score, negative correlations between Eigenfactor and Altmetric Attention Score for most journals, and no clear association between Impact Factor and Altmetric Attention Score. Over time, the digital reach of traditional publications has increased significantly, while no significant increase was noted for the traditional metrics. These findings likely reflect discussions of articles online that are not captured by traditional metrics and hence their impact on the community at large.Supplemental digital content is available for this article. Direct URL citations appear in the printed text and are provided in the HTML and PDF versions of this article on the journal’s website ( authors have disclosed that they do not have any potential conflicts of interest.For information regarding this article, E-mail: jishuviren@gmail.comThis is an open-access article distributed under the terms of the Creative Commons Attribution-Non Commercial-No Derivatives License 4.0 (CCBY-NC-ND), where it is permissible to download and share the work provided it is properly cited. The work cannot be changed in any way or used commercially without permission from the journal.Copyright © 2019 The Authors. Published by Wolters Kluwer Health, Inc. on behalf of the Society of Critical Care Medicine

Publisher's Version

Last updated on 08/28/2019