bioRxiv Science⌕ Search

bioRxiv · 10.1101/2020.04.27.063578

A systematic examination of preprint platforms for use in the medical and biomedical sciences setting

Abstract

ABSTRACTObjectives The objective of this review is to identify all preprint platforms with biomedical and medical scope and to compare and contrast the key characteristics and policies of these platforms. We also aim to provide a searchable database to enable relevant stakeholders to compare between platforms.Study Design and Setting Preprint platforms that were launched up to 25th June 2019 and have a biomedical and medical scope according to MEDLINE’s journal selection criteria were identified using existing lists, web-based searches and the expertise of both academic and non-academic publication scientists. A data extraction form was developed, pilot-tested and used to collect data from each preprint platform’s webpage(s). Data collected were in relation to scope and ownership; content-specific characteristics and information relating to submission, journal transfer options, and external discoverability; screening, moderation, and permanence of content; usage metrics and metadata. Where possible, all online data were verified by the platform owner or representative by correspondence.Results A total of 44 preprint platforms were identified as having biomedical and medical scope, 17 (39%) were hosted by the Open Science Framework preprint infrastructure, six (14%) were provided by F1000 Research Ltd (the Open Research Central infrastructure) and 21 (48%) were other independent preprint platforms. Preprint platforms were either owned by non-profit academic groups, scientific societies or funding organisations (n=28; 64%), owned/partly owned by for-profit publishers or companies (n=14; 32%) or owned by individuals/small communities (n=2; 5%). Twenty-four (55%) preprint platforms accepted content from all scientific fields although some of these had restrictions relating to funding source, geographical region or an affiliated journal’s remit. Thirty-three (75%) preprint platforms provided details about article screening (basic checks) and 14 (32%) of these actively involved researchers with context expertise in the screening process. The three most common screening checks related to the scope of the article, plagiarism and legal/ethical/societal issues and compliance. Almost all preprint platforms allow submission to any peer-reviewed journal following publication, have a preservation plan for read-access, and most have a policy regarding reasons for retraction and the sustainability of the service. Forty-one (93%) platforms currently have usage metrics, with the most common metric being the number of downloads presented on the abstract page.Conclusion A large number of preprint platforms exist for use in biomedical and medical sciences, all of which offer researchers an opportunity to rapidly disseminate their research findings onto an open-access public server, subject to scope and eligibility. However, the process by which content is screened before online posting and withdrawn or removed after posting varies between platforms, which may be associated with platform operation, ownership, governance and financing.In concurrence with an increase in the number of preprint servers and platforms supporting biomedical and medical sciences research since 2013, there has been substantial growth in the number of preprints posted in this research area.The significant benefits of accelerated dissemination of research that preprints offer has attracted the support of many major funders.The raised profile of preprints has led to their wider acceptance in institutional and individual level assessment.This is the first full examination of the characteristics and policies of 44 preprint platforms with biomedical and medical scope. We use a robust methodological approach to extract relevant information from web-based material with input from preprint platform owners.Despite concerns regarding the permanence and quality of preprints, most preprint platforms have long-term preservation strategies and many have screening checks (for example, a basic check for the relevance of content) in place. For some platforms, these checks are performed by researchers with content expertise.We provide a searchable database as a valuable resource for researchers, funders and policymakers in the biomedical and medical science field to determine which preprint platforms are relevant to their research scope and which have the functionality and policies that they value most.Competing Interest StatementJessica Polka is Executive Director of ASAPbio.View Full Text

Source connections

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Kirkham, J. J., Penfold, N., Murphy, F., Boutron, I., Ioannidis, J. P., Polka, J. K., Moher, D.. 2020-04-28. A systematic examination of preprint platforms for use in the medical and biomedical sciences setting. https://doi.org/10.1101/2020.04.27.063578

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

Auditing Biomedical Literature with Blinded AI Peer Review: Where Peer Review Works, Where It Fails, and How to Strengthen It

Biomedical publishing has grown more than elevenfold since 1991, outstripping human peer review. Unblinded language models cannot audit this literature objectively because they recognize famous authors and journals from training memory. We built BARS (Blinded AI Review System), an automated referee that strips titles, author names, institutions, journal headers, and dates before grading full-text manuscripts on a 10-point scale covering methods, evidence, biology, and reproducibility. We used BARS to generate 1,874 blind reviews across 1,714 unique papers. BARS passed 100% of verified sound controls, caught 77% to 91% of internally flawed papers, eliminated a +0.35-point prestige boost, and more than doubled human referee consistency. Across 320 recent open-access articles (2020-2025) from eight fields, 54% failed on core scientific rigor (<5.0/10; 41% excluding megajournals). Revision at selective journals improved preprints more than twice as much as revision at commercial megajournals (+0.62 vs. +0.30 points; baseline-adjusted p = 0.033), and BARS recalled 98% of unresolved human referee critiques across 100 open-review papers. Across 915 date-blinded papers from 1991 to 2025, average scores fell from 7.6/10 to 5.8/10 as megajournals and template database studies expanded. Blinded self-audits of 238 papers by two senior authors -- and of this manuscript itself -- caught real statistical, control, and table errors in our own work. At four cents per paper, BARS offers a practical quality check for authors, journals, and readers (https://veg.github.io/BARS/).

scientific communication and education↗

From Problems to Solutions: How Self-Questions Drive Strong Scientific Reasoning

Metacognition, or awareness and control of thinking, is essential for problem solving because it helps solvers select strategies for learning and decide when to enact them (planning), check their understanding in the moment (monitoring), and assess effectiveness of solutions and learning strategies (evaluating). Most studies that examine metacognition do so retrospectively, leaving a critical gap in how metacognition is used in-the-moment for problem solving. In this study, we utilized a think-aloud interview approach to capture and characterize the metacognitive skills that senior undergraduate life science students at three institution types in the United States used spontaneously while solving challenging biology problems. We found that the students (n = 39) displayed a wide variety and quantity of monitoring, some evaluating, and nearly no planning skills while creating a solution backed with high-quality reasoning. Students frequently used self-questions to monitor and evaluate their thinking. We found that self-questioning is a critical skill for generating solutions, but it only moves problem solving forward if the student asks and correctly answers the self-question out loud. This study illustrates how self-questioning and other metacognitive regulation skills provide links to bridge the gap between a student's prior knowledge and specific features of a challenging problem. Based on our student data, we conceptualized a model of metacognitive phases during problem solving with high-quality reasoning. Finally, we present a self-question scaffold to facilitate the proposed phases (planning, monitoring, reasoning, and evaluating) so educators can equip students with metacognitive and scientific reasoning tools for effective problem solving.

scientific communication and education↗

Preprint solicitation as a natural experiment in scholarly publishing

Preprinting is a growing and increasingly recognized mechanism for scientific communication and productivity and a way to facilitate global access to science. The interplay of preprinting practices with formal peer-reviewed publication is an open question that is now tractable to targeted analysis. Here, we take advantage of nearly a decade of preprint solicitation at Proceedings B to address this question, which offers a quasi-experimental setting for comparing outcomes for solicited preprints and traditionally submitted manuscripts. We used submission records from 15,368 manuscripts from 2018-2024 to assess whether preprint solicitation affects acceptance rates, journal scope, author geographic diversity, and post-publication uptake. Solicited manuscripts were accepted at nearly twice the rate of traditional submissions and received more downloads and citations after publication. Submission topics were broadly similar between the two routes, though solicited manuscripts showed marginally greater subject diversity. Geographic disparities favoring the Global North persisted, but acceptance rates for solicited manuscripts converged across regions, narrowing the gap seen in traditional submissions. These findings extend earlier work on this initiative and indicate that editor-driven solicitation can identify high-quality preprints, broaden geographic representation, and increase research visibility, offering a replicable model for journals seeking to diversify authorship while maintaining editorial standards.

scientific communication and education↗