Skip to main content
Journal of Experimental Orthopaedics
Download PDF

What makes an orthopaedic paper highly citable? A bibliometric analysis of top orthopeadic journals with 10-year follow up

Journal of Experimental Orthopaedics volume 10, Article number: 78 (2023) Cite this article

Abstract

Purpose

To examine a series of papers from top ranked orthopaedic journals with respect to the number of citations over a 10-year observation period to identify factors that lead to high citation rates.

Methods

The Web of Science database was consulted to identify all published papers from the first-year term of 2010 (January-May) from four top orthopaedic journals: AJSM, Arthroscopy, JBJS Am and KSSTA. The database was used to analyze and compare the papers with respect to their characteristics and citations up to 2019. Basic information for each paper was collected including the author, country, study type and average citations per year (ACY). The most (Top20%) and least (Bottom20%) frequently cited papers were identified and differences were extracted.

Results

Five hundred sixteen papers were included with a total of 19,261 citations. Most of the published papers were from the United States (n = 245). On average, a paper received 37.3 citations over the 10-year observation period. The most cited paper was cited 322 times. The most cited study type was randomized controlled trial (RCT) (Ø80.8). The Top20% papers were cited 37 times more often than the Bottom20%. Among the Top20%, the largest group was cohort study (n = 20) followed by case series (n = 19). Among others, the number of authors, the number of keywords and the number of references significantly correlated with the number of citations (p < 0.001).

Conclusions

Factors influencing citation frequency were identified.

Introduction

It is a generally accepted goal of science to publish papers of the highest possible quality [36]. For authors, the impact factor (IF) of a journal is a significant contributing factor when deciding where to submit scientific work, since the perceived renown of a journal scales with its IF [24, 36, 37]. At the same time, journals advertise their IF and encourage authors to submit papers of the highest possible quality [36]. In addition, the current trend shows that researchers strive to publish a large quantity of papers [24]. This development has led to the assumption that the number of publications is the decisive criterion to measure the reputation of a scientist in professional circles [24]. According to findings, a high IF shapes the reward signal of scientists, at the prospect of publication [32]. Even if the high IF of a journal certifies a correspondingly high quality of a manuscript, however, it naturally does not allow any conclusions to be drawn about the quality of every article contained therein.

Currently, bibliometrics is being widely applied as a burgeoning method in numerous medical fields [3, 5, 15, 17, 19, 22, 23, 26, 27, 29,30,31, 40, 41, 44]. In recent years, bibliometric analyses have been used to find out which published paper was cited and how frequently [38,39,40]. Citation analyses can help to evaluate publications in terms of their quality of information to a particular field and to help researchers to better assess the published literature [1, 23, 26, 28]. For this purpose, for example, the Web of Science Core Collection (WOSCC) is recognized as one of the most suitable online databases for bibliometric analyses [33, 44]. Thus, how often a particular paper is cited by other authors is a measure of the scientific relevance of a paper [2, 25].

The aim of this study was to investigate which factors influence the citation frequency of orthopaedic papers and to determine which factors impact the citation rate. A further goal was to identify characteristics that distinguish the "top" orthopaedic papers. We hypothesized that studies with a high level of evidence such as randomized controlled trials or meta-analyses are cited most frequently.

Although there are already numerous studies that list and examine the most frequently papers on a particular medical specialty, to the best of our knowledge, no study exists that elaborates on the differences between well-cited papers and poorly-cited papers over a long period of time. The results could show authors which factors can be optimized to increase the likelihood of citations after publication.

Methods

We examined papers from four major orthopaedic journals with high IF: the American Journal of Sports Medicine (AJSM, IF: 7.010), Arthrosocopy (IF: 5.973), The Journal of Bone and Joint Surgery American edition (JBJS Am, IF: 6.558) and Knee Surgery, Sports Traumatology Arthroscopy (KSSTA, IF: 4.114) (as of 2021). All of these are listed among the best 20 in Web of Science's Journal Citation Report in the category orthopaedics [11,12,13,14]. For comparison, the IFs of the journals in 2010 (time of publication of the studied articles) should also be mentioned here; AJSM (3,821), Arthroscopy (3,317), JBJS (2,969), KSSTA (1,857) [7,8,9,10] .

All consecutive papers published by the aforementioned journals during the first-year term from January 2010 to May 2010 were entered into a database. The JBJS was published twice per month and all others were published once per month. All papers, including case reports, commentaries, letters to the editor and editorials (n = 516), were considered and categorized. These papers were then individually analyzed for their characteristics and their citations were determined for every year using the Web of Science database over a total period of 10 years up to and including 2019 (n = 19,261 citations). Data collection was carried out by one author from December 2021 to January 2022; a sample check was performed by the second author; the last author provided appropriate quality assurance by cross-checking.

The following characteristics for each paper were collected via open access and subscription according to their availability: journal, first author, total number of authors, first author's country of origin, title, length of title in words, presence of a subtitle, wording of title, keywords and their number tables and figures, whether colored graphics were used, number of references, total citations up to and including 2019 and single citations per year from 2010 to 2019.

In order to make a possible statement about a statistical relationship between title and citation count, two sports orthopaedic surgeons (RL, TH) independently ranked the titles of the papers according to their subjective informative value on a scale of 1–10, for which 1 was definted as not appealing and 10 was defined as appealing by all measures.

Papers were then subclassified by authors according to study field, study type, field of research and study aim (Table 1). The categorization is based on a study classification published in the Lancet in 2002 [18]. We used quintiles regarding the total count of citations in the years 2010–2019 to compare the Top20%, Middle60% and Bottom20% papers.

Table 1 Classification of the papers
Full size table

Data analysis and statistical methods

Statistical analyses were performed using the statistical software package R version 4.1.2 and the packages comparegroups and glm [34]. As the first step, all papers (n = 516) were divided into a bottom (n = 108), middle (n = 305) and top range (n = 103) using quintiles according to the respective total citation numbers in the years 2010–2019 (Table 2). Regarding the subjective ranking, an inter-rater correlation calculation was performed. The Spearman R coefficient was adopted as the mathematical measure of correlation strength. We classified repeatability as very good (R > 0.75), good (R > 0.6), or poor to moderate (R < 0.59) [6]. Dependence of main categories of collected paper characteristics with top and bottom citation count was statistically tested by Chi-Square or Fisher’s exact test, applying a significance level of 0.05. Choice of chi-square test or Fishers exact test was according to expected cell counts. Mean and standard deviation were calculated for continuous variables.

Table 2 Part 1: Summary descriptives table by groups of citations. Summary descriptives table by groups of citations. Number of citations and percentages. Means and SD are presented
Full size table

In a second step, associations of collected journal characteristics with total citation count in 10 years was estimated by a multivariable generalized linear model with negative binomial distribution. Estimated coefficients of a predictor variable assess the difference in the logs of expected counts for each category in comparison to the reference, or for a one-unit change in the case of quantitative variables. The reference categories were as follows: in the field of journals: the AJSM; in the field of study type: clinical descriptive: case series; in the field of research: knee; and “Description of new injury patterns, diseases, risk factories, etc.” for the study aim (see Appendix Table A1).

Results

Analysis of the total collective

Overall, 516 papers with a total of 19.261 citations were examined. The average citation per paper was 37.3 (42.3 SD) and the most frequently cited paper was cited 322 times. The overall collective average citations per year (ACY) was 3.7 (5.1 SD) with 2015 being the year with the highest ACY (4.7; 5.5 SD). Otherwise, the average citation count per paper per year was nearly constant over the ten-year period after about two years after publication. The examined papers came from the JBJS Am (n = 174, 33.7%), AJSM (n = 128, 24.8%), KSSTA (n = 112, 21.7%) and Arthroscopy (n = 102, 19.8%). The AJSM had the highest average citation count per paper (50; 48.2 SD). Clinical studies were published most frequently (n = 286) Most publications originated from the USA (n = 245) All detailed results can be found in Tables 2, 3 and 4.

Table 3 Average citation per year per paper of the total collective
Full size table
Table 4 Average citation per Journal
Full size table

Study categories and their influence on citation

Regarding the number of citations according to study fields, reviews displayed the highest average citations per paper (54.6; 56.7 SD) Regarding citation development over ten years, reviews were found to be the leading field of study (Fig. 1).

Fig. 1
figure 1

Average citation per paper per year of the total collective (according to study field)

Full size image

Among the study types, RCTs had the highest citation count (80.8, 75.7 SD) (Fig. 2).

Fig. 2
figure 2

Average citation count per study type of the total collective as a bar plot. The bars symbolize the average citation frequency together with a measure of the standard deviation. As example Clinical Descriptive Case Report: The average citation rate is 9 with a standard deviation of 11

Full size image

The field of research had also an important influence on citation, with papers from basic science having the highest citation count (59.2; 62.4 SD) (Table 5). Concerning the field of research, basic science studies were cited significantly more frequently than studies concerning the knee (1.02, p = 0.018). In the category study aim, “Review, Description of current state of the art, Guidelines” had the highest citation count (51.6; 57.6 SD) (Table 6) However, the study aim was not shown to be a relevant factor in determining citation frequency. In terms of study type, experimental studies generate the most citations per year in the first few years after publication, but are caught up by review articles after about 6.5 years.

Table 5 Average citation per Field of research
Full size table
Table 6 Average citation per study aim
Full size table

Considering the dependence of the variables with the citation frequency, it was found that the study type has an especially strong influence on the citation frequency. Clinical analytical studies, such as RCT (1.49 times, p = 0.047) and non-RCT (1.83 times, p = 0.003), were cited more frequently than the reference case series, whereas biomechanical study (1.33 times, p = 0.032) and editorials/letter/other (2.3 times, p < 0.01) were cited less frequently. With regard to the subjective ranking of the titles by two sports orthopedists, interrater reliability was good with regard to the assessment of the manuscript titles. Therefore, the assessment was considered reliable. With regard to the other parameters surveyed, the number of authors (p < 0.001), the subjective evaluation of the title (p < 0.001), the title length (p = 0.029), the number of tables (p = 0.014) and the number of references (p < 0.001) significantly correlated with citation frequency; for each reference more in the paper, citations were 1.7% higher over ten years.

Analysis of Top20% and Bottom20%

The average overall citation count of the Top20% (more than 60 citations) was 103 (49.6 SD) and the average overall citation count of the Bottom20% (7 or less citations) was 2.8 (2.3 SD), making the Top20% papers 37 times more frequently cited than the Bottom20% papers. The Top20% papers showed a largely constant citation trend after two years (Figs. 3 and 4).

Fig. 3
figure 3

Average citation per year of selected categories (according to study type)

Full size image
Fig. 4
figure 4

Average citation per paper per year for the Top20% and Middle60% in direct comparison

Full size image

The publishing journal had a significant effect on the distribution in the Top20%, Middle60% and Bottom20% papers (p = 0.02). Similarly, the study field was found to be a significant indicator for assessment in the Top20%, Middle60% and Bottom20% (p < 0.01). Reviews were more often among the Top20% (19.4% to 7.4% Bottom20%), whereas editorials/letters/other were found to have 38.9% in the Bottom20% and only 0.97% in the Top20%. In clinical trials, there was a clear tendency towards the Top20% instead of the Bottom20% (68% and 41.7%, respectively). The knee joint was by far the most frequently addressed field of research in both the Top20% and Bottom20% groups (35.9% and 29.6%, respectively) and could not be identified as a characteristic of either group. While most of the studies in the Top20% group focused on the study aim "Evaluation of new technique or treatments" (40.8%), the dominant study aim in the Bottom20% group was "Description of new injury pattern, disease, risk factors, etc." (37%). These showed a disproportionate distribution in favor of the respective categories.

Cohort Studies, RCTs and systematic reviews were disproportionately found in the Middle60% and Top20%, whereas case reports and editorials/letters/other were significantly more likely to be found in the Bottom20%. Biomechanical studies and case series showed no clear tendency regarding their distribution in either group. The most Top20% papers originated in the United States" (n = 51, 49.5%). Despite this fact, a comparison of the distribution in Top20%, Middle60% and Bottom20% showed that no country published a clearly higher proportion of Top20% papers in relation to the total number of papers. Details can be found in Table 2 Part 2 in the appendix. AJSM was most frequently represented in the Top20% (35%). In addition, the AJSM also showed the highest percentage of Top20% papers in terms of total number of papers (28%) and was the only journal to have a higher percentage of Top20% papers than that of the overall collective (35% compared to 24.8%). As a striking difference, the Top20% had significantly more references on average than the Bottom20% (39 and 16.9, respectively, p < 0.001). In addition, the Top20% were significantly characterized on average by a larger authorship (5.7 and 3.2, respectively, p < 0.001) or had a longer title in words on average (15.6 and 10.7, respectively). It was less relevant whether or not illustrations were printed in color. In the subjective ranking of titles by two sports orthopaedic surgeons, the Top20% were three rating points on average ahead of the Bottom20% (p < 0.001). Furthermore, it could be proven that Top20% papers show more tables (2.5 and 0.6, respectively, p < 0.001), more Figs. (4.0 and 2.7, respectively, p < 0.005) and more keywords (6.0 and 3.6, respectively, p < 0.001). Detailed results can be found in Table 2.

Discussion

One main finding of this study is that the number of authors, title length, number of figures and reference quantity were statistically significant positive variables influencing the citation count. We found that larger authorship, longer titles, more numerous keywords, more tables and figures and a higher number of references positively correlated with the Top20% compared to the Bottom20%. Shekhani et al. were also able to show a positive correlation between the number of citations and authorship, the number of tables and figures and the number of references [37] in 2017. One possible reason is that a large author community or larger number of references generally indicates more complex research topics, which increases the value of the published paper. Additionally, a higher proportion of self-citations is likely with a larger authorship.

We also found that the Top20% papers showed a largely constant citation trend after two years that did not decline after ten years. Papers from the Middle60% did not show strong fluctuations with regard to citation frequency over the years, which is surprising because it would seem that in an ever more rapidly growing flood of publications, the importance of and general interest in individual papers declines rapidly over the years.

The most cited study field is reviews and the most cited study type is RCT. This conclusion was also reached by Khatra et al. in his study on the best-cited papers in sports medicine [23]. Considering the individual study types, experimental studies are ahead of reviews but are equaled by them after about 6.5 years. This can be explained by the fact that RCTs have a great impact on the current state of research due to their high level of evidence after a certain time, while reviews have a more general validity. Basic science was the best-cited field of research in the overall collective, with most papers in the Top20% addressing the knee joint. However, since the knee plays a central role in both the Bottom20% and Top20%, we could not statistically determine a preference for Top20% papers, but confirmed that it is the main topic of discussion across all groups. This underlines the importance of the knee joint in research circles of orthopaedics in this decade, a conclusion which was also reached by Khatra et al [23]. The study aim “Evaluation of new techniques or treatment” was the best cited on average, which is plausible, since an evaluated method is already somewhat established in certain circles and is of greater general interest than a completely unknown one. In the Top20% papers “evaluation of new techniques or treatment” makes up the largest part, whereas the primary study aim in the Bottom20% is “Description of new injury pattern, disease, or risk factors”. Evaluations and assessments of new findings are of general interest for the scientific community, whereas new findings are sometimes just of temporary interest.

We could not identify a unique geographic leader among the Top20%. Although almost half of the Top20% papers came from the USA half of all papers examined were of United States origin.Other authors, such as Khatra et al., state that the US has the largest research community with the most available funding available and that American authors are more likely to cite American work and publish in American journals [22, 23, 29]. However, Wu et al. highlighted the fact that China is exerting an ever-increasing influence on science and currently publishes the most research papers [42]. Although the US is one of the countries with the highest self-citation counts, [4, 43] the work of Bardeesi et al. concludes that these self-citations have little impact on the overall picture and therefore does not support the call by many scientists to exclude self-citations.

AJSM had the highest average citation count and the largest proportion of total papers in the Top20%, which is consistent with the fact that AJSM has the highest IF of the journals mentioned (7.010). It can also be said that even after a time interval of ten years, a high IF has a positive effect on the citation numbers.

In addition to the classic method of measuring the scientific influence of a paper by means of documented citations or the classification of a journal by means of an impact factor on databases such as Web of Science, alternative scores such as altmetrics are gaining influence by determining the digital attention of scientific content on the basis of clicks, comments, downloads, or mentions on social media platforms [16, 20, 21, 35]. The Altmetric Score generates the media attention of a publication from many sources, but its main flaw is obvious, as it is unclear whether the attention is positive or negative. Therefore, this is a parameter of the attention an article has received and not of scientific quality, although there can be a correlation between these parameters [16]. Hughes et al. concluded that sports and trauma orthopaedic journals with their own Twitter account have a higher IF than journals without, [20, 21] highlighting the importance of social media for scientific knowledge distribution. Buckarma et al. recognized social media as a suitable tool to disseminate scientific knowledge in a manuscript published in 2017 and already called on scientists to pay more attention to this topic. In a progressively digital and fast-paced world, such types of science analysis are expected to become increasingly influential and at least partially replace traditional established databases such as Web of Science.

Recent bibliometric analyses performed by others usually proceeded as following: the best cited papers at a defined time or period on a specific topic [22, 29, 40] or generally on the sports orthopaedic specialty were noted on one or a few days on large databases such as Scopus, Web of Science and PubMed and then examined in detail. Our approach was different, namely that we systematically compared papers published in early 2010 over a ten-year period, not only including the best cited papers. Including less well cited papers allows a more general statement about the characteristics of good papers and gives conclusions about the detailed citation development of a paper after publication for up to ten years.

This study is not without limitations: 1) self-citations by the authors were not excluded; 2) articles published in January 2010 have a time advantage and therefore a little more time to be quoted as compared to articles published in April 2010 and therefore may have a few more citations in 2010, however, over the ten-year period, this should only have a minimal impact; 3) the categories study field, study type, field of research and study aim are self-designed and extensive and lack universal reference standards; 4) the four journals examined were selected by consensus of the authors, so the statements in this paper do not necessarily reflect the entire field of sports orthopaedics; 5) the authors would like to emphasize once again that a high IF of a journal or a high number of citations of a publication is not the sole criterion for quality. However, in this study, a bibliometric understanding was used that articles with more citations are more likely to be considered top papers than those with few citations.

In summary, from our study results, the following recommendations can be made for highly cited publications:

  1. 1.

    more extensive authorships are advantageous

  2. 2.

    authors should aim for longer and therefore more concrete titles

  3. 3.

    specifying numerous keywords is favorable and suggests that the study can be found more easily

  4. 4.

    tables and figures are important because they are likely to make the study more understandable and descriptive

  5. 5.

    a broad repertoire of references should be considered, which allows the assumption of a sound basic understanding of the topic

  6. 6.

    RCTs and reviews are confirmed to be more frequently cited than other studies

  7. 7.

    basic science has a value in orthopaedics that should not be underestimated

  8. 8.

    studies that include an evaluation of a new technique or treatment are often cited by others

Conclusion

The main results of this study are the statistical correlation between the number of citations with the number of authors, number of keywords and number of references, among others. In addition, we found that the Top20% papers showed a largely constant citation trend after two years for up to at least ten years. RCTs and reviews are cited most frequently.

Availability of data and material

Data will be provided on request.

References

  1. Ali MJ (2021) Questioning the Impact of the Impact Factor. A Brief Review and Future Directions. Semin Ophthalmol 37(1):91–96. https://doi.org/10.1080/08820538.2021.1922713

    Article  PubMed  Google Scholar 

  2. Antoniou GA, Antoniou SA, Georgakarakos EI et al (2015) Bibliometric analysis of factors predicting increased citations in the vascular and endovascular literature. Ann Vasc Surg 29:286–292. https://doi.org/10.1016/j.avsg.2014.09.017

    Article  PubMed  Google Scholar 

  3. Barbera J, Selverian S, Courington R et al (2020) The Top 50 Most Influential Articles in Hip Arthroscopy. Arthroscopy 36:716–722. https://doi.org/10.1016/j.arthro.2019.09.031

    Article  PubMed  Google Scholar 

  4. Bardeesi AM, Jamjoom AAB, Sharab MA et al (2021) Impact of country self citation on the ranking of the top 50 countries in clinical neurology. eNeurologicalSci 23:100333. https://doi.org/10.1016/j.ensci.2021.100333

    Article  PubMed  PubMed Central  Google Scholar 

  5. Chen WMY, Bukhari M, Cockshull F et al (2020) The relationship between citations, downloads and alternative metrics in rheumatology publications: a bibliometric study. Rheumatology (Oxford) 59:277–280. https://doi.org/10.1093/rheumatology/kez163

    Article  PubMed  Google Scholar 

  6. Cicchetti DV (1994) Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol Assess 6:284–290. https://doi.org/10.1037/1040-3590.6.4.284

    Article  Google Scholar 

  7. Clarivate (2010) Journal Citation Reports: American Journal of Sports Medicine. JCR Year 2010. https://jcr.clarivate.com/jcr-jp/journal-profile?journal=AM%20J%20SPORT%20MED&year=2010&fromPage=%2Fjcr%2Fhome. Accessed 03 May 2023

  8. Clarivate (2010) Journal Citation Reports: Arthroscopy- The Journal of Arthroscopic and Related Surgery. https://jcr.clarivate.com/jcr-jp/journal-profile?journal=ARTHROSCOPY&year=2010&fromPage=%2Fjcr%2Fhome. Accessed 03 May 2023

  9. Clarivate (2010) Journal Citation Reports: Knee Surgery Sports Traumatology Arthroscopy. https://jcr.clarivate.com/jcr-jp/journal-profile?journal=KNEE%20SURG%20SPORT%20TR%20A&year=2010&fromPage=%2Fjcr%2Fhome. Accessed 03 May 2023

  10. Clarivate (2010) Journal Citations Reports: Journal of Bone and Joint Surgery American Volume. https://jcr.clarivate.com/jcr-jp/journal-profile?journal=J%20BONE%20JOINT%20SURG%20AM&year=2010&fromPage=%2Fjcr%2Fhome. Accessed 03 May 2023

  11. Clarivate (2021) Journal Citation Reports: American Journal of Sports Medicine. https://jcr.clarivate.com/jcr-jp/journal-profile?journal=AM%20J%20SPORT%20MED&year=2021&fromPage=%2Fjcr%2Fhome. Accessed 02 Jul 2022

  12. Clarivate (2021) Journal Citation Reports: Arthroscopy- The Journal of Arthroscopic and Related Surgery. https://jcr.clarivate.com/jcr-jp/journal-profile?journal=ARTHROSCOPY&year=2021&fromPage=%2Fjcr%2Fhome. Accessed 02 Jul 2022

  13. Clarivate (2021) Journal Citation Reports: Journal of Bone and Joint Surgery American Volume. https://jcr.clarivate.com/jcr-jp/journal-profile?journal=J%20BONE%20JOINT%20SURG%20AM&year=2021&fromPage=%2Fjcr%2Fhome. Accessed 02 Jul 2022

  14. Clarivate (2021) Journal Citation Reports: Knee Surgery Sports Traumatolgy Arthrosocopy. https://jcr.clarivate.com/jcr-jp/journal-profile?journal=KNEE%20SURG%20SPORT%20TR%20A&year=2021&fromPage=%2Fjcr%2Fhome. Accessed 02 Jul 2022

  15. Devos P, Menard J (2019) Bibliometric analysis of research relating to hypertension reported over the period 1997–2016. J Hypertens 37:2116–2122. https://doi.org/10.1097/HJH.0000000000002143

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  16. Elmore SA (2018) The Altmetric Attention Score: What Does It Mean and Why Should I Care? Toxicol Pathol 46:252–255. https://doi.org/10.1177/0192623318758294

    Article  PubMed  PubMed Central  Google Scholar 

  17. Falagas ME, Zarkali A, Karageorgopoulos DE et al (2013) The impact of article length on the number of future citations: a bibliometric analysis of general medicine journals. PLoS One 8:e49476. https://doi.org/10.1371/journal.pone.0049476

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  18. Grimes DA, Schulz KF (2002) An overview of clinical research: the lay of the land. Lancet 359:57–61. https://doi.org/10.1016/S0140-6736(02)07283-5

    Article  PubMed  Google Scholar 

  19. Hafeez DM, Jalal S, Khosa F (2019) Bibliometric analysis of manuscript characteristics that influence citations: a comparison of six major psychiatry journals. J Psychiatr Res 108:90–94. https://doi.org/10.1016/j.jpsychires.2018.07.010

    Article  PubMed  Google Scholar 

  20. Hughes H, Hughes A, Murphy C (2017) The Use of Twitter by the Trauma and Orthopaedic Surgery Journals: Twitter Activity, Impact Factor, and Alternative Metrics. Cureus 9:e1931. https://doi.org/10.7759/cureus.1931

    Article  PubMed  PubMed Central  Google Scholar 

  21. Hughes H, Hughes A, Murphy CG (2018) Correction: The Use of Twitter by Trauma and Orthopaedic Surgery Journals: Twitter Activity, Impact Factor, and Alternative Metrics. Cureus 10:c13. https://doi.org/10.7759/cureus.c13

    Article  PubMed  PubMed Central  Google Scholar 

  22. Karslı B, Tekin SB (2021) The Top 100 Most-Cited Articles on Ankle Arthroscopy: Bibliometric Analysis. J Foot Ankle Surg 60:477–481. https://doi.org/10.1053/j.jfas.2020.08.028

    Article  PubMed  Google Scholar 

  23. Khatra O, Shadgan A, Taunton J et al (2021) A Bibliometric Analysis of the Top Cited Articles in Sports and Exercise Medicine. Orthop J Sports Med 9:2325967120969902. https://doi.org/10.1177/2325967120969902

    Article  PubMed  PubMed Central  Google Scholar 

  24. Kumar V, Upadhyay S, Medhi B (2009) Impact of the impact factor in biomedical research: its use and misuse. Singapore Med J 50:752–755

    CAS  PubMed  Google Scholar 

  25. Lefaivre KA, Shadgan B, O’Brien PJ (2011) 100 most cited articles in orthopaedic surgery. Clin Orthop Relat Res 469:1487–1497. https://doi.org/10.1007/s11999-010-1604-1

    Article  PubMed  Google Scholar 

  26. Liu B, Liu S, Alastra AJ et al (2019) The 100 Most Cited vs. Most Relevant Articles in the Journal of Neurosurgery: A Bibliometric Analysis. Cureus 11:e4498. https://doi.org/10.7759/cureus.4498

    Article  PubMed  PubMed Central  Google Scholar 

  27. Mikhail CM, Schwartz JT, Barbera J et al (2020) The most influential papers in direct anterior approach to total hip arthroplasty. Arthroplast Today 6:190–195. https://doi.org/10.1016/j.artd.2020.01.006

    Article  PubMed  PubMed Central  Google Scholar 

  28. Moed HF (2009) New developments in the use of citation analysis in research evaluation. Arch Immunol Ther Exp (Warsz) 57:13–18. https://doi.org/10.1007/s00005-009-0001-5

    Article  PubMed  Google Scholar 

  29. Moore ML, Pollock JR, McQuivey KS et al (2021) The Top 50 Most-Cited Shoulder Arthroscopy Studies. Arthrosc Sports Med Rehabil 3:e277–e287. https://doi.org/10.1016/j.asmr.2020.09.011

    Article  PubMed  PubMed Central  Google Scholar 

  30. Namdari S, Baldwin K, Kovatch K et al (2012) Fifty most cited articles in orthopedic shoulder surgery. J Shoulder Elbow Surg 21:1796–1802. https://doi.org/10.1016/j.jse.2011.11.040

    Article  PubMed  Google Scholar 

  31. Parrish JM, Jenkins NW, Brundage TS et al (2020) The Top 100 Spine Surgery Articles on Social Media: An Altmetric Study. Spine (Phila Pa 1976) 45:1229–1238. https://doi.org/10.1097/BRS.0000000000003508

    Article  PubMed  Google Scholar 

  32. Paulus FM, Rademacher L, Schäfer TAJ et al (2015) Journal Impact Factor Shapes Scientists’ Reward Signal in the Prospect of Publication. PLoS One 10:e0142537. https://doi.org/10.1371/journal.pone.0142537

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  33. Qin Y-F, Ren S-H, Shao B et al (2022) The intellectual base and research fronts of IL-37: A bibliometric review of the literature from WoSCC. Front Immunol 13:931783. https://doi.org/10.3389/fimmu.2022.931783

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  34. R Foundation for Statistical Computing, Vienna, Austria (2021) R Core Team. R: A language and enviroment for statistical computing. https://www.R-project.org/. Accessed 02 Jun 2022

  35. Ramamurti P, Gu A, Fassihi SC et al (2021) Correlation Between Altmetric Score and Traditional Bibliometrics in Total Joint Arthroplasty Research. Arthroplast Today 7:225–229. https://doi.org/10.1016/j.artd.2020.12.030

    Article  PubMed  PubMed Central  Google Scholar 

  36. Roldan-Valadez E, Salazar-Ruiz SY, Ibarra-Contreras R et al (2019) Current concepts on bibliometrics: a brief review about impact factor, Eigenfactor score, CiteScore, SCImago Journal Rank, Source-Normalised Impact per Paper, H-index, and alternative metrics. Ir J Med Sci 188:939–951. https://doi.org/10.1007/s11845-018-1936-5

    Article  PubMed  Google Scholar 

  37. Shekhani HN, Shariff S, Bhulani N et al (2017) Bibliometric Analysis of Manuscript Characteristics That Influence Citations: A Comparison of Six Major Radiology Journals. AJR Am J Roentgenol 209:1191–1196. https://doi.org/10.2214/AJR.17.18077

    Article  PubMed  Google Scholar 

  38. Shen J, Shen H, Ke L et al (2022) Knowledge Mapping of Immunotherapy for Hepatocellular Carcinoma: A Bibliometric Study. Front Immunol 13:815575. https://doi.org/10.3389/fimmu.2022.815575

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  39. Sun H-L, Bai W, Li X-H et al (2022) Schizophrenia and Inflammation Research: A Bibliometric Analysis. Front Immunol 13:907851. https://doi.org/10.3389/fimmu.2022.907851

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  40. Tang N, Zhang W, George DM et al (2021) The Top 100 Most Cited Articles on Anterior Cruciate Ligament Reconstruction: A Bibliometric Analysis. Orthop J Sports Med 9:2325967120976372. https://doi.org/10.1177/2325967120976372

    Article  PubMed  PubMed Central  Google Scholar 

  41. Tang N, Zhang W, George DM et al (2021) The Top 100 Most-Cited Articles on Arthroscopy: Most Popular Topic Is Rotator Cuff Rather Than Cartilage in the Last 5 Years. Arthroscopy. https://doi.org/10.1016/j.arthro.2021.01.039

    Article  PubMed  Google Scholar 

  42. Wu S (2019) China: How science made a superpower. Nature 574:25–28. https://doi.org/10.1038/d41586-019-02937-2

    Article  CAS  PubMed  Google Scholar 

  43. Yaminfirooz M, Tirgar A (2019) Self-citation in Iran in Comparison with Other Countries. Acta Inform Med 27:259–262. https://doi.org/10.5455/aim.2019.27.259-262

    Article  PubMed  PubMed Central  Google Scholar 

  44. Zhang H, Fan Y, Wang R et al (2020) Research trends and hotspots of high tibial osteotomy in two decades (from 2001 to 2020): a bibliometric analysis. J Orthop Surg Res 15:512. https://doi.org/10.1186/s13018-020-01991-1

    Article  PubMed Central  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

Open Access funding enabled and organized by Projekt DEAL.

Author information

Authors and Affiliations

  1. Department of Orthopaedic Surgery, University Medical Center Rostock, Rostock, Germany

    Mirjam Lutter, Robert Lenz & Thomas Tischer

  2. Institute for Biostatistics and Informatics in Medicine and Ageing Research, University Medical Center Rostock, Rostock, Germany

    Henrik Rudolf

  3. Center for Musculoskeletal Surgery Osnabrück (OZMC), Klinikum Osnabrück, Osnabrück, Germany

    Thilo Hotfiel

  4. Department of Orthopaedic and Trauma Surgery, Waldkrankenhaus, Erlangen, Germany

    Thomas Tischer

Authors
  1. Mirjam Lutter
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Henrik Rudolf
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Robert Lenz
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Thilo Hotfiel
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Thomas Tischer
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors contributed on data acquisition and preparation of the manuscript.

Authors’ information (optional)

Not applicable.

Corresponding author

Correspondence to Mirjam Lutter.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

All authors gave their consent for publication.

Competing interests

None.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This study is part of the thesis from Mirjam Lutter.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lutter, M., Rudolf, H., Lenz, R. et al. What makes an orthopaedic paper highly citable? A bibliometric analysis of top orthopeadic journals with 10-year follow up. J EXP ORTOP 10, 78 (2023). https://doi.org/10.1186/s40634-023-00631-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s40634-023-00631-x

Keywords