bioRxiv Science⌕ Search

bioRxiv · 10.1101/802850

Academic criteria for promotion and tenure in faculties of biomedical sciences: a cross-sectional analysis of 146 universities

Abstract

ObjectivesTo determine the presence of a set of pre-specified traditional and progressive criteria used to assess scientists for promotion and tenure in faculties of biomedical sciences among universities worldwide. DesignCross-sectional study. SettingNot applicable. Participants170 randomly selected universities from the Leiden Ranking of world universities list were considered. Main outcome measuresTwo independent reviewers searched for all guidelines applied when assessing scientists for promotion and tenure for institutions with biomedical faculties. Where faculty-level guidelines were not available, institution-level guidelines were sought. Available documents were reviewed and the presence of 5 traditional (e.g., number of publications) and 7 progressive (e.g., data sharing) criteria was noted in guidelines for assessing assistant professors, associate professors, professors, and the granting of tenure. ResultsA total of 146 institutions had faculties of biomedical sciences with 92 having eligible guidelines available to review. Traditional criteria were more commonly reported than progressive criteria (t(82)= 15.1, p= .001). Traditional criteria mentioned peer-reviewed publications, authorship order, journal impact, grant funding, and national or international reputation in 95%, 37%, 28%, 67%, and 48% of the guidelines, respectively. Conversely, among progressive criteria only citations (any mention in 26%) and accommodations for extenuating circumstances (37%) were relatively commonly mentioned; while there was rare mention of alternative metrics for sharing research (2%) and data sharing (1%), and 3 criteria (publishing in open access mediums, registering research, and adhering to reporting guidelines) were not found in any institution reviewed. We observed notable differences across continents on whether guidelines are accessible or not (Australia 100%, North America 97%, Europe 50%, Asia 58%, South America 17%), and more subtle differences on the use of specific criteria. ConclusionsThis study demonstrates that the current evaluation of scientists emphasizes traditional criteria as opposed to progressive criteria. This may reinforce research practices that are known to be problematic while insufficiently supporting the conduct of better-quality research and open science. Institutions should consider incentivizing progressive criteria. RegistrationOpen Science Framework (https://osf.io/26ucp/) What is already known on this topicO_LIAcademics tailor their research practices based on the evaluation criteria applied within their academic institution. C_LIO_LIEnsuring that biomedical researchers are incentivized by adhering to best practice guidelines for research is essential given the clinical implications of this work. C_LIO_LIWhile changes to the criteria used to assess professors and confer tenure have been recommended, a systematic assessment of promotion and tenure criteria being applied worldwide has not been conducted. C_LI What this study addsO_LIAcross countries, university guidelines focus on rewarding traditional research criteria (peer-reviewed publications, authorship order, journal impact, grant funding, and national or international reputation). C_LIO_LIThe minimum requirements for promotion and tenure criteria are predominantly objective in nature, although several of them are inadequate measures to assess the impact of researchers. C_LIO_LIDeveloping and evaluating more appropriate, progressive indicators of research may facilitate changes in the evaluation practices for rewarding researchers. C_LI

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Rice, D. B., Raffoul, H., Ioannidis, J. P., Moher, D.. 2019-10-21. Academic criteria for promotion and tenure in faculties of biomedical sciences: a cross-sectional analysis of 146 universities. https://doi.org/10.1101/802850

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

Auditing Biomedical Literature with Blinded AI Peer Review: Where Peer Review Works, Where It Fails, and How to Strengthen It

Biomedical publishing has grown more than elevenfold since 1991, outstripping human peer review. Unblinded language models cannot audit this literature objectively because they recognize famous authors and journals from training memory. We built BARS (Blinded AI Review System), an automated referee that strips titles, author names, institutions, journal headers, and dates before grading full-text manuscripts on a 10-point scale covering methods, evidence, biology, and reproducibility. We used BARS to generate 1,874 blind reviews across 1,714 unique papers. BARS passed 100% of verified sound controls, caught 77% to 91% of internally flawed papers, eliminated a +0.35-point prestige boost, and more than doubled human referee consistency. Across 320 recent open-access articles (2020-2025) from eight fields, 54% failed on core scientific rigor (<5.0/10; 41% excluding megajournals). Revision at selective journals improved preprints more than twice as much as revision at commercial megajournals (+0.62 vs. +0.30 points; baseline-adjusted p = 0.033), and BARS recalled 98% of unresolved human referee critiques across 100 open-review papers. Across 915 date-blinded papers from 1991 to 2025, average scores fell from 7.6/10 to 5.8/10 as megajournals and template database studies expanded. Blinded self-audits of 238 papers by two senior authors -- and of this manuscript itself -- caught real statistical, control, and table errors in our own work. At four cents per paper, BARS offers a practical quality check for authors, journals, and readers (https://veg.github.io/BARS/).

scientific communication and education↗

From Problems to Solutions: How Self-Questions Drive Strong Scientific Reasoning

Metacognition, or awareness and control of thinking, is essential for problem solving because it helps solvers select strategies for learning and decide when to enact them (planning), check their understanding in the moment (monitoring), and assess effectiveness of solutions and learning strategies (evaluating). Most studies that examine metacognition do so retrospectively, leaving a critical gap in how metacognition is used in-the-moment for problem solving. In this study, we utilized a think-aloud interview approach to capture and characterize the metacognitive skills that senior undergraduate life science students at three institution types in the United States used spontaneously while solving challenging biology problems. We found that the students (n = 39) displayed a wide variety and quantity of monitoring, some evaluating, and nearly no planning skills while creating a solution backed with high-quality reasoning. Students frequently used self-questions to monitor and evaluate their thinking. We found that self-questioning is a critical skill for generating solutions, but it only moves problem solving forward if the student asks and correctly answers the self-question out loud. This study illustrates how self-questioning and other metacognitive regulation skills provide links to bridge the gap between a student's prior knowledge and specific features of a challenging problem. Based on our student data, we conceptualized a model of metacognitive phases during problem solving with high-quality reasoning. Finally, we present a self-question scaffold to facilitate the proposed phases (planning, monitoring, reasoning, and evaluating) so educators can equip students with metacognitive and scientific reasoning tools for effective problem solving.

scientific communication and education↗

Preprint solicitation as a natural experiment in scholarly publishing

Preprinting is a growing and increasingly recognized mechanism for scientific communication and productivity and a way to facilitate global access to science. The interplay of preprinting practices with formal peer-reviewed publication is an open question that is now tractable to targeted analysis. Here, we take advantage of nearly a decade of preprint solicitation at Proceedings B to address this question, which offers a quasi-experimental setting for comparing outcomes for solicited preprints and traditionally submitted manuscripts. We used submission records from 15,368 manuscripts from 2018-2024 to assess whether preprint solicitation affects acceptance rates, journal scope, author geographic diversity, and post-publication uptake. Solicited manuscripts were accepted at nearly twice the rate of traditional submissions and received more downloads and citations after publication. Submission topics were broadly similar between the two routes, though solicited manuscripts showed marginally greater subject diversity. Geographic disparities favoring the Global North persisted, but acceptance rates for solicited manuscripts converged across regions, narrowing the gap seen in traditional submissions. These findings extend earlier work on this initiative and indicate that editor-driven solicitation can identify high-quality preprints, broaden geographic representation, and increase research visibility, offering a replicable model for journals seeking to diversify authorship while maintaining editorial standards.

scientific communication and education↗