bioRxiv ScienceSearch

bioRxiv · 10.1101/802850

Academic criteria for promotion and tenure in faculties of biomedical sciences: a cross-sectional analysis of 146 universities

Abstract

ObjectivesTo determine the presence of a set of pre-specified traditional and progressive criteria used to assess scientists for promotion and tenure in faculties of biomedical sciences among universities worldwide. DesignCross-sectional study. SettingNot applicable. Participants170 randomly selected universities from the Leiden Ranking of world universities list were considered. Main outcome measuresTwo independent reviewers searched for all guidelines applied when assessing scientists for promotion and tenure for institutions with biomedical faculties. Where faculty-level guidelines were not available, institution-level guidelines were sought. Available documents were reviewed and the presence of 5 traditional (e.g., number of publications) and 7 progressive (e.g., data sharing) criteria was noted in guidelines for assessing assistant professors, associate professors, professors, and the granting of tenure. ResultsA total of 146 institutions had faculties of biomedical sciences with 92 having eligible guidelines available to review. Traditional criteria were more commonly reported than progressive criteria (t(82)= 15.1, p= .001). Traditional criteria mentioned peer-reviewed publications, authorship order, journal impact, grant funding, and national or international reputation in 95%, 37%, 28%, 67%, and 48% of the guidelines, respectively. Conversely, among progressive criteria only citations (any mention in 26%) and accommodations for extenuating circumstances (37%) were relatively commonly mentioned; while there was rare mention of alternative metrics for sharing research (2%) and data sharing (1%), and 3 criteria (publishing in open access mediums, registering research, and adhering to reporting guidelines) were not found in any institution reviewed. We observed notable differences across continents on whether guidelines are accessible or not (Australia 100%, North America 97%, Europe 50%, Asia 58%, South America 17%), and more subtle differences on the use of specific criteria. ConclusionsThis study demonstrates that the current evaluation of scientists emphasizes traditional criteria as opposed to progressive criteria. This may reinforce research practices that are known to be problematic while insufficiently supporting the conduct of better-quality research and open science. Institutions should consider incentivizing progressive criteria. RegistrationOpen Science Framework (https://osf.io/26ucp/) What is already known on this topicO_LIAcademics tailor their research practices based on the evaluation criteria applied within their academic institution. C_LIO_LIEnsuring that biomedical researchers are incentivized by adhering to best practice guidelines for research is essential given the clinical implications of this work. C_LIO_LIWhile changes to the criteria used to assess professors and confer tenure have been recommended, a systematic assessment of promotion and tenure criteria being applied worldwide has not been conducted. C_LI What this study addsO_LIAcross countries, university guidelines focus on rewarding traditional research criteria (peer-reviewed publications, authorship order, journal impact, grant funding, and national or international reputation). C_LIO_LIThe minimum requirements for promotion and tenure criteria are predominantly objective in nature, although several of them are inadequate measures to assess the impact of researchers. C_LIO_LIDeveloping and evaluating more appropriate, progressive indicators of research may facilitate changes in the evaluation practices for rewarding researchers. C_LI

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Rice, D. B., Raffoul, H., Ioannidis, J. P., Moher, D.. 2019-10-21. Academic criteria for promotion and tenure in faculties of biomedical sciences: a cross-sectional analysis of 146 universities. https://doi.org/10.1101/802850

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

Evaluating Large Language Models as Tools to Navigate Researchers in Rapidly Evolving Research Landscapes: A Case Study in Cancer Drug Response Prediction

Large Language Models (LLMs) have emerged as promising tools for assisting researchers in automating and accelerating the synthesis of literature reviews. However, their reliability is a significant concern due to issues like factual inaccuracies and hallucinations. The key question is whether LLMs can reliably provide comprehensive, up-to-date overviews and analyses. This study evaluates the performance of three leading LLMs (OpenAI's ChatGPT, Google's Gemini, and DeepSeek) on the complex task of generating a comprehensive survey paper on deep learning for cancer Drug Response Prediction (DRP). By testing both standard and Deep Research (DR) / Deep Think (DT) modes of LLMs with prompts of varying detail, this paper assesses key academic dimensions, including reference management, content quality, and analytical depth. Key findings reveal that while DR modes of LLMs significantly improve reliability by eliminating hallucinations, performance variations exist across models and prompts. A trade-off between reference quantity and integration quality was observed, and even the best-performing models lacked the analytical depth of human experts, often requiring extensive human supervision. The study concludes that LLMs currently serve as powerful assistive tools but still cannot replace the critical validation and synthesis provided by human researchers. Choosing the best LLM to use depends on the task in hand, while several strategies can be implemented to improve the produced output.

scientific communication and education

Plagiarism in Brazil: A perspective of 25,000 PhD holders across the sciences

When it comes to ownership of ideas in science, Robert K. Merton (1957) observed in Priorities in Scientific Discovery: A Chapter in the Sociology of Science that "what is true of physics, chemistry, astronomy, medicine and mathematics is true also of all the other scientific disciplines, not excluding the social and psychological sciences". However, consensus over related issues, such as what constitutes plagiarism in these fields cannot be taken for granted. We conducted a comprehensive study on plagiarism views among PhD holders registered in the database of the Brazilian National Council for Scientific and Technological Development (CNPq). We collected 25,157 valid responses encompassing views and attitudes toward plagiarism from a probability sample of PhD holders across the fields, including biologists, physicists, mathematicians, and engineers as well as linguists, philosophers and anthropologists. The results suggest that core principles about plagiarism are shared among this multidisciplinary community and that they corroborate Mertons observations. Before this study, we could only speculate that this is the case. With these data from a probability sample of Brazilian academia (PhD holders), this study offers insight into the way plagiarism is perceived across the sciences, including the literature and arts, and sheds light on the problem in the context of international collaborative research networks. The data focus on a young research system in Latin America, but, given the cultural similarities that bind most Latin-American nations, these results may be relevant to other PhD populations in the region and should provide a comparison with studies from other emerging, non-Anglophone regions.

scientific communication and education

Turn of Events: Academic events as a platform for preregistration

Prereg posters are conference posters that present planned scientific projects. We provide preliminary evidence for their value in receiving constructive feedback, promoting open science, and supporting early career researchers.View Full Text

scientific communication and education