To rank or not to rank

Gives an overview of my research in the field of journal rankings, university rankings and citation rankings

Anne-Wil Harzing - (updated Thu 2 Jun 2022 14:34)

Very shortly after establishing my website in 1999, I posted the first edition of my Journal Quality List, now in its 60th edition. Over the years I have also published a large number of articles dealing in one way or another with rankings. You would thus be forgiven for thinking that I am a big advocate of journal and university rankings. It might surprise you I am not. Just like many of you I would prefer to live in an academic world where rankings and public relations didn't dominate academic substance. However, I recognize that rankings are not going away and that even if we did away with formal rankings, most academics would still create rankings in their own minds.

So my main motivation has been to ensure that if rankings do persist, we at least make sure they are as inclusive as possible and understand that every ranking has its own biases. My first publication in this field thus presented an integrated ranking of the then 16 rankings included in the Journal Quality list. One of its motivations was to help the asessors in the Business & Management panel of the 2008 British Research Assessment Excercise in their assessment of over 10,000 publications by providing a ranking based on a variety of perspectives. Remember, this was before the days of the "one list to rule them all", aka the ABS journal ranking.

  • Mingers, J.; Harzing, A.W. (2007) Ranking journals in Business and Management: A statistical analysis of the Harzing Dataset, European Journal of Information Systems, vol. 16, no. 4, pp. 303-316. Available online... - Publisher's version (read for free)

I then moved on to exploring new data sources that provide a fairer assessment of journal impact in the Social Sciences and Humanities, using Google Scholar as an alternative to Scopus and the Web of Science. For a more general introduction into the coverage of Google Scholar and its drawbacks, see here, here, here, here, here and here.

  • Harzing, A.W.; Wal, R. van der (2008) Google Scholar as a new source for citation analysis?, Ethics in Science and Environmental Politics, vol. 8, no. 1, pp. 61-73. Available online... - Publisher's version (free access!)
  • Harzing, A.W. (2008) On becoming a high impact journal in International Business and Management, European Journal of International Management, 2(2): 115-118. Available online... - Publisher’s version
  • Harzing, A.W.; Wal, R. van der (2009) A Google Scholar h-index for journals: An alternative metric to measure journal impact in Economics & Business?, Journal of the American Society for Information Science and Technology, 60(1, pp 41-46. Available online... - Publisher’s version - White paper.

Subsequently, my attention was drawn towards university rankings. A short commentary on the - in my view - arbitrary decisions in one particular ranking of universities study grew into a more provocative piece, co-authored with the wonderful Nancy Adler. We highlight the problematic nature of academic ranking systems and question if such assessments are drawing scholarship away from its fundamental purpose. Ironically, this paper is now my top-ranked publication in terms of citations per year.

In recent years, I have looked at how problems in citation databases and rankings might reinforce existing academic hierarchies in terms of disciplines and universities. In these articles, I also discuss how these problems might disproportionally disadvantage academics with Asian names, women, and younger academics.

My interest in publishing articles in this field has waned a little. There is only so much time in the day and life is short. However, I continue to blog on this and related topics (see below) and give presentations in a variety of fora.

Related blog posts

Related videos

research focus social sciences research evaluation bibliometric research citation analysis academic publishing research integrity

Copyright © 2022 Anne-Wil Harzing. All rights reserved. Page last modified on Thu 2 Jun 2022 14:34

Anne-Wil Harzing is Emerita Professor of International Management at Middlesex University, London. She is a Fellow of the Academy of International Business, a select group of distinguished AIB members who are recognized for their outstanding contributions to the scholarly development of the field of international business. In addition to her academic duties, she also maintains the Journal Quality List and is the driving force behind the popular Publish or Perish software program.

Anne-Wil Harzing's profile and contact details >>