Skip to main content
Springer Nature Link
Log in

Association of scientific and nonscientific factors to citation rates of articles of renowned orthopedic journals

  • Original Article
  • Published:
European Orthopaedics and Traumatology

Abstract

Purpose

The physician often relies on the prestige of a journal to identify the most relevant articles to be read in his field. This investigation studied associations of scientific and nonscientific criteria with the citation frequency of articles in two top-ranked international orthopedic journals.

Methods

The 100 most (mean, 88 citations/5 years for cases) and 100 least (mean, two citations/5 years for controls) cited articles published between 2000 and 2004 in the Journal of Bone and Joint Surgery and the Bone & Joint Journal (formerly known as JBJS (Br)), two of the most distributed general orthopedic journals, were identified. The association of scientific and nonscientific factors on their citation rate was quantified.

Results

Randomized controlled trials, as well as multicenter studies with large sample sizes, were significantly more frequent in the high citation rate group. The unadjusted odds of a highly cited article to be supported by industry were 2.8 (95 % confidence interval 1.5, 5.6; p < 0.05) if compared with a lowly cited article.

Conclusion

Beside scientific factors, nonscientific factors such as industrial support seem associated to the citation rate of published articles. This, together with publication bias, questions whether scientific facts reach the readers in a balanced fashion.

Level of Evidence 3

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
€34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Germany)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  1. Neuberger J, Counsell C (2002) Impact factors: uses and abuses. Eur J Gastroenterol Hepatol 14(3):209–211

    Article  PubMed  Google Scholar 

  2. Rieder S, Bruse CS, Michalski CW, Kleeff J, Friess H The impact factor ranking—a challenge for scientists and publishers. Langenbecks Arch Surg 395 Suppl 1:69–73. doi:10.1007/s00423-010-0623-4

  3. Bhandari M, Busse J, Devereaux PJ, Montori VM, Swiontkowski M, Tornetta Iii P, Einhorn TA, Khera V, Schemitsch EH (2007) Factors associated with citation rates in the orthopedic literature. Can J Surg 50(2):119–123

    PubMed  Google Scholar 

  4. Kurmis AP (2003) Understanding the limitations of the journal impact factor. J Bone Joint Surg Am 85-A(12):2449–2454

    PubMed  Google Scholar 

  5. Garfield E (1999) Journal impact factor: a brief review. CMAJ 161(8):979–980

    PubMed  CAS  Google Scholar 

  6. Garfield E (1996) How can impact factors be improved? BMJ 313(7054):411–413

    Article  PubMed  CAS  Google Scholar 

  7. Walsh EF, Weinstein JN (1998) Spine: scientific citation index and its impact factor. Spine (Phila Pa 1976) 23(10):1087–1090

    Article  CAS  Google Scholar 

  8. Leimu R, Koricheva J (2005) What determines the citation frequency of ecological papers. Trends Ecol Evol 20(1):28–32

    Article  PubMed  Google Scholar 

  9. Saper CB (1999) What's in a citation impact factor? A journal by any other measure. J Comp Neurol 411(1):1–2

    Article  PubMed  CAS  Google Scholar 

  10. Nieminen P, Carpenter J, Rucker G, Schumacher M (2006) The relationship between quality of research and citation frequency. BMC Med Res Methodol 6:42

    Article  PubMed  Google Scholar 

  11. Figg WD, Dunn L, Liewehr DJ, Steinberg SM, Thurman PW, Barrett JC, Birkinshaw J (2006) Scientific collaboration results in higher citation rates of published articles. Pharmacotherapy 26(6):759–767. doi:10.1592/phco.26.6.759

    Article  PubMed  Google Scholar 

  12. Filion KB, Pless IB (2008) Factors related to the frequency of citation of epidemiologic publications. Epidemiol Perspect Innov 5:3

    Article  PubMed  Google Scholar 

  13. Kulkarni AV, Busse JW, Shams I (2007) Characteristics associated with citation rate of the medical literature. PLoS One 2(5):e403. doi:10.1371/journal.pone.0000403

    Article  PubMed  Google Scholar 

  14. MacCallum CJ, Parthasarathy H (2006) Open access increases citation rate. PLoS Biol 4 (5):e176.

    Google Scholar 

  15. Piwowar HA, Day RS, Fridsma DB (2007) Sharing detailed research data is associated with increased citation rate. PLoS One 2(3):e308

    Article  PubMed  Google Scholar 

  16. Habibzadeh F, Yadollahie M Are shorter article titles more attractive for citations? Cross-sectional study of 22 scientific journals. Croat Med J 51 (2):165–170

  17. Callaham M, Wears RL, Weber E (2002) Journal prestige, publication bias, and other characteristics associated with citation of published studies in peer-reviewed journals. JAMA 287(21):2847–2850

    Article  PubMed  Google Scholar 

  18. Patsopoulos NA, Analatos AA, Ioannidis JP (2005) Relative citation impact of various study designs in the health sciences. JAMA 293(19):2362–2366

    Article  PubMed  CAS  Google Scholar 

  19. Elsevier (2013) Scopus. www.scopus.com/home. Accessed 31 Aug 2010

  20. Kulkarni AV, Aziz B, Shams I, Busse JW (2009) Comparisons of citations in web of science, scopus, and google scholar for articles published in general medical journals. JAMA 302(10):1092–1096

    Article  PubMed  CAS  Google Scholar 

  21. Garrett WE Jr, Swiontkowski MF, Weinstein JN, Callaghan J, Rosier RN, Berry DJ, Harrast J, Derosa GP (2006) American board of orthopaedic surgery practice of the orthopaedic surgeon: part-ii, certification examination case mix. J Bone Joint Surg Am 88(3):660–667

    Article  PubMed  Google Scholar 

  22. Angell M (2008) Industry-sponsored clinical research: a broken system. JAMA 300(9):1069–1071

    Article  PubMed  CAS  Google Scholar 

  23. Hopewell S, Clarke M (2003) How important is the size of a reprint order? Int J Technol Assess Health Care 19(4):711–714

    Article  PubMed  Google Scholar 

  24. Lundh A, Barbateskovic M, Hrobjartsson A, Gotzsche PC (2010) Conflicts of interest at medical journals: the influence of industry-supported randomised trials on journal impact factors and revenue—cohort study. PLoS Med 7(10):e1000354

    Article  PubMed  Google Scholar 

  25. Leopold SS, Warme WJ, Fritz Braunlich E, Shott S (2003) Association between funding source and study outcome in orthopaedic research. Clin Orthop Relat Res 415:293–301

    Article  PubMed  Google Scholar 

  26. Okike K, Kocher MS, Mehlman CT, Bhandari M (2008) Industry-sponsored research. Injury 39(6):666–680

    Article  PubMed  Google Scholar 

  27. Sarmiento A (2003) The relationship between orthopaedics and industry must be reformed. Clin Orthop Relat Res 412:38–44

    Article  PubMed  Google Scholar 

  28. Shah RV, Albert TJ, Bruegel-Sanchez V, Vaccaro AR, Hilibrand AS, Grauer JN (2005) Industry support and correlation to study outcome for papers published in spine. Spine (Phila Pa 1976) 30(9):1099–1104, discussion 1105

    Article  Google Scholar 

  29. Als-Nielsen B, Chen W, Gluud C, Kjaergard LL (2003) Association of funding and conclusions in randomized drug trials: a reflection of treatment effect or adverse events? JAMA 290(7):921–928. doi:10.1001/jama.290.7.921

    Article  PubMed  Google Scholar 

Download references

Conflict of interest

The authors declare no conflicts of interest.

Author information

Authors and Affiliations

  1. Balgrist University Hospital, University of Zürich, Zürich, Switzerland

    Mazda Farshad, Claudia Sidler & Christian Gerber

Authors
  1. Mazda Farshad
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Claudia Sidler
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Christian Gerber
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Mazda Farshad.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Farshad, M., Sidler, C. & Gerber, C. Association of scientific and nonscientific factors to citation rates of articles of renowned orthopedic journals. Eur Orthop Traumatol 4, 125–130 (2013). https://doi.org/10.1007/s12570-013-0174-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12570-013-0174-6

Keywords