The mystery of the phantom reference: a detective story

Short summary of white paper that shows how sloppy writing and sloppy quality control lead to a non-existing article being cited nearly 400 times

Anne-Wil Harzing - (updated Thu 2 Jun 2022 14:31)

Picture: Paris Musee Cluny by Pieter Kroonenberg

Through my work with Publish or Perish I get in touch with many academics who are doing bibliometric work, oftentimes as a “research hobby”. In one of these exchanges, Pieter Kroonenberg, a Dutch emeritus professor in Statistics, told me about an interesting puzzle he had come across. When looking at the author guidelines for an Elsevier journal that he intended to submit to he noticed the following reference:

  • Van der Geer, J., Hanraads, J.A.J., Lupton, R.A., 2000. The art of writing a scientific article. J Sci. Commun. 163 (2) 51-59. [The journal name can also be found with its full title Journal of Science Communications]

He was intrigued to see that one of his former colleagues Prof. John van de Geer had a “hidden side”, publishing about the art of academic writing in addition to his work on experimental psychology and multivariate analysis. But, wait a minute…, this reference referred to Van der Geer instead of Van de Geer. Still…, the paper looked interesting so he ventured to look it up. However, despite strenuous efforts he was unable to find it. An (Italian) journal with a similar name did exist, but its full name was Journal of Science Communication rather than Communications and it had only started in 2002. Looking at the original reference again, it did strike him as a little odd for a journal to have published 163 volumes in a discipline that normally equates volumes to years. Moreover, the second author seemed to have only ever published this particular article, which obviously is rather strange for someone writing about the art of writing a scientific article.

To cut a long story short, the article appeared to be completely made up and did not in fact exist. It was a “phantom reference” that had been created merely to illustrate Elsevier's desired reference format. Even so, Pieter found that in the Web of Science there were nearly 400 articles citing this non-existing reference and many more citing articles appeared in the more comprehensive Google Scholar. The fact that academics don’t always take the necessary care in their referencing behaviour is something that is not unfamiliar to me. Early on in my career, I even wrote an article about this: Are referencing errors undermining our scholarship and credibility? But even so, how could authors cite a publication that didn’t in fact exist?

Thus, I was instantly intrigued as this is just the kind of puzzle I like solving. Yes I know I am a bit of a forensic bibliometrics nerd. Maybe it has something to do with me wanting to be a detective when I was young? Although I did have one of Enid Blyton’s girly “Pitty at boarding school” books, my favourite books were her “Famous Five” detective stories. And of course, I always wanted to be Dick, the one who knew all the detective tricks, not one of the two rather meek girls. Well in a way academics are the ultimate detectives aren’t they? They follow both hunches and systematic research to get to the bottom of tricky problems. For the full detective story, refer to the white paper:

Caveat

As I wrote to a journalist from CBC who contacted me with further questions, the pressure on scientists to "publish or perish" might well have contributed to this phenomenon. That said, nearly every academic is under the same pressure, but the vast majority of academics do behave both conscientiously and ethically. As always, it is only a small minority that is giving the profession a bad name.

Press coverage for the white paper

Related blogposts

academia behind the scenes that's interesting academic referencing research metrics citation analysis academic publishing scopus research integrity

Copyright © 2022 Anne-Wil Harzing. All rights reserved. Page last modified on Thu 2 Jun 2022 14:31

Anne-Wil Harzing is Emerita Professor of International Management at Middlesex University, London. She is a Fellow of the Academy of International Business, a select group of distinguished AIB members who are recognized for their outstanding contributions to the scholarly development of the field of international business. In addition to her academic duties, she also maintains the Journal Quality List and is the driving force behind the popular Publish or Perish software program.

Anne-Wil Harzing's profile and contact details >>