Impact factor trends for general medical journals: non-English-language journals are lagging behind
BACKGROUND: The impact factor (IF) is a common citation metric used for evaluating and comparing scientific journals within a certain field. Previous studies have shown that IFs are increasing. However, rates may depend on journal publication language.
The aim of this study was to determine IF values and trends for general medical journals, comparing non-English-language with English-language journals.
METHODS: For all journals categorised as “medicine, general and internal” (n = 150) in the Journal Citation Reports (JCR), publication language, country of origin and IFs for the last 10 years were recorded (2001–2010).
Data were classified, analysed descriptively and compared using non-parametric tests.
RESULTS: From 2001 to 2010, IFs increased for English-language and non-English-language journals (p <0.001). During the 10-year study period, IFs were higher for English-language than for non-English-language journals (p <0.001).
The proportion of non-English-language journals included in the JCR was 12.2% in 2001 and 18.0% in 2010 (p = 0.28).
INTERPRETATION: From 2001 to 2010, IFs increased significantly for English-language and non-English-language journals. When comparing IF values year-by-year (2001–2010), IFs were significantly higher for English-language than for non-English-language journals.
In an international scientific community with English as the universal language of science, non-English-language journals should consider changing publication language, and adopt either a bi- or a monolingual approach. Publishing in English will increase citation counts and thus IFs, but, more importantly, scientific findings will be accessible to a much wider audience.
- Reuters T. Journal Citation Reports. http://wokinfo.com/media/pdf/jcrwebfs.pdf 2010.
- Garfield E. The history and meaning of the journal impact factor. JAMA. 2006;295:90–3.
- Neff BD, Olden JD. Not so fast: inflation in impact factors contributes to apparent improvements in journal quality. Bioscience. 2010;60:455–9.
- Stock WG. The inflation of impact factors of scientific journals. Chemphyschem. 2009;10:2193–6.
- Althouse BM, West JD, Bergstrom CT, Bergstrom T. Differences in impact factor across fields and over time. J Am Soc Inf Sci Technol. 2009;60:27–34.
- Chen M, Zhao MH, Kallenberg CG. The impact factor of rheumatology journals: an analysis of 2008 and the recent 10 years. Rheumatol Int. 2011;31:1611–5.
- Chew M, Villanueva EV, Van Der Weyden MB. Life and times of the impact factor: retrospective analysis of trends for seven medical journals (1994–2005) and their Editors’ views. J R Soc Med. 2007;100:142–50.
- Falagas ME, Kouranos VD, Michalopoulos A, Rodopoulou SP, Batsiou MA, Karageorgopoulos DE. Comparison of the distribution of citations received by articles published in high, moderate, and low impact factor journals in clinical medicine. Intern Med J. 2010;40:587–91.
- Karageorgopoulos DE, Lamnatou V, Sardi TA, Gkegkes ID, Falagas ME. Temporal trends in the impact factor of European versus USA biomedical journals. PLoS One. 2011;6:e16300.
- Lee C-H, Shih C-P, Chang Y-C, Chaou C-H. The evolution of academic performance in emergency medicine journals: Viewpoint from 2000 to 2009 Journal Citation Reports. Acad Emerg Med. 2011;18:898–904.
- van Leeuwen TN, Moed HF, Tijssen RJW, Visser MS, van Raan AFJ. First evidence of serious language-bias in the use of citation analysis for the evaluation of national science systems. Research Evaluation. 2000;9:155–6.
- van Leeuwen TN, Moed HF, Tijssen RJW, Visser MS, van Raan AFJ. Language biases in the coverage of the Science Citation Index and its consequences for international comparisons of national research performance. Scientometrics. 2001;51:335–46.
- Lopez-Abente G, Munoz-Tinoco C. Time trends in the impact factor of public health journals. BMC Public Health. 2005;5:24
- Smith DR. Citation analysis and impact factor trends of 5 core journals in occupational medicine, 1985–2006. Arch of Environmental Occupat Health. 2008;63:114–22.
- Mueller PS, Murali NS, Cha SS, Erwin PJ, Ghosh AK. The association between impact factors and language of general internal medicine journals. Swiss Med Weekly. 2006;136:441–3.
- Poomkottayil D, Bornstein MM, Sendi P. Lost in translation: the impact of publication language on citation frequency in the scientific dental literature. Swiss Med Weekly. 2011;141:w13148
- Currie GM, Wheat JM. Impact factors in nuclear medicine journals. J Nucl Med 2007;48:1397–400.
- Andersen J, Belmont J, Cho CT. Journal impact factor in the era of expanding literature. J Microbiol Immunol Infect. 2006;39:436–43.
- Garfield E. The impact factor and its correct usage. Anaesthesist. 1998;47:439–40.
- Kumar V, Upadhyay S, Medhi B. Impact of the impact factor in biomedical research: its use and misuse. Singapore Med J. 2009;50:752–5.
- Andrade A, Gonzalez-Jonte R, Miguel Campanario J. Journals that increase their impact factor at least fourfold in a few years: The role of journal self-citations. Scientometrics. 2009;80:515–28.
- DeLisa JA. Evaluating journal quality – the role of citation data and the impact factor. J Spinal Cord Med. 2004;27:1.
- Falagas ME, Kouranos VD, Michalopoulos A, Rodopoulou SP, Batsiou MA, Karageorgopoulos DE. Comparison of the distribution of citations received by articles published in high, moderate, and low impact factor journals in clinical medicine. Int Med J. 2010;40:587–91.
- van Leeuwen TN, Moed HF. Characteristics of Journal Impact Factors: The effects of uncitedness and citation distribution on the understanding of journal impact factors. Scientometrics. 2005;63:357–71.
- Falagas ME, Alexiou VG. The top-ten in journal impact factor manipulation. Arch Immunol Ther Exp 2008;56:223–6.
- Ha TC, Tan SB, Soo KC. The journal impact factor: Too much of an impact? Ann Acad Med Singapore. 2006;35:911–6.
- Seglen PO. Why the impact factor of journals should not be used for evaluating research. BMJ 1997;314:498–502.
- Joseph KS. Quality of impact factors of general medical journals. BMJ. 2003;326:283–3.
- Reuters T. The Thomson Reuters journal selection process. http://thomsonreuters.com/products_services/science/free/essays/journal_selection_process/.
- Kaltenborn KF, Kuhn K. The journal impact factor as a parameter for the evaluation of researchers and research. Med Klin (Munich). 2003;15:153–69
- Schaffner A. Journal impact factors depend on more than just publication language. Swiss Med Weekly. 2006;136:411–2.
- Smith DR, Rivett DA. Bibliometrics, impact factors and manual therapy: Balancing the science and the art. Man Ther. 2009;14:456–9.
- Rosenberg J. Danish versus English in Ugeskrift for Laeger. Ugeskr Laeger. 2009;171:1911.