bioRxiv ScienceSearch

bioRxiv · 10.1101/2020.04.27.063578

A systematic examination of preprint platforms for use in the medical and biomedical sciences setting

Abstract

ABSTRACTObjectives The objective of this review is to identify all preprint platforms with biomedical and medical scope and to compare and contrast the key characteristics and policies of these platforms. We also aim to provide a searchable database to enable relevant stakeholders to compare between platforms.Study Design and Setting Preprint platforms that were launched up to 25th June 2019 and have a biomedical and medical scope according to MEDLINE’s journal selection criteria were identified using existing lists, web-based searches and the expertise of both academic and non-academic publication scientists. A data extraction form was developed, pilot-tested and used to collect data from each preprint platform’s webpage(s). Data collected were in relation to scope and ownership; content-specific characteristics and information relating to submission, journal transfer options, and external discoverability; screening, moderation, and permanence of content; usage metrics and metadata. Where possible, all online data were verified by the platform owner or representative by correspondence.Results A total of 44 preprint platforms were identified as having biomedical and medical scope, 17 (39%) were hosted by the Open Science Framework preprint infrastructure, six (14%) were provided by F1000 Research Ltd (the Open Research Central infrastructure) and 21 (48%) were other independent preprint platforms. Preprint platforms were either owned by non-profit academic groups, scientific societies or funding organisations (n=28; 64%), owned/partly owned by for-profit publishers or companies (n=14; 32%) or owned by individuals/small communities (n=2; 5%). Twenty-four (55%) preprint platforms accepted content from all scientific fields although some of these had restrictions relating to funding source, geographical region or an affiliated journal’s remit. Thirty-three (75%) preprint platforms provided details about article screening (basic checks) and 14 (32%) of these actively involved researchers with context expertise in the screening process. The three most common screening checks related to the scope of the article, plagiarism and legal/ethical/societal issues and compliance. Almost all preprint platforms allow submission to any peer-reviewed journal following publication, have a preservation plan for read-access, and most have a policy regarding reasons for retraction and the sustainability of the service. Forty-one (93%) platforms currently have usage metrics, with the most common metric being the number of downloads presented on the abstract page.Conclusion A large number of preprint platforms exist for use in biomedical and medical sciences, all of which offer researchers an opportunity to rapidly disseminate their research findings onto an open-access public server, subject to scope and eligibility. However, the process by which content is screened before online posting and withdrawn or removed after posting varies between platforms, which may be associated with platform operation, ownership, governance and financing.In concurrence with an increase in the number of preprint servers and platforms supporting biomedical and medical sciences research since 2013, there has been substantial growth in the number of preprints posted in this research area.The significant benefits of accelerated dissemination of research that preprints offer has attracted the support of many major funders.The raised profile of preprints has led to their wider acceptance in institutional and individual level assessment.This is the first full examination of the characteristics and policies of 44 preprint platforms with biomedical and medical scope. We use a robust methodological approach to extract relevant information from web-based material with input from preprint platform owners.Despite concerns regarding the permanence and quality of preprints, most preprint platforms have long-term preservation strategies and many have screening checks (for example, a basic check for the relevance of content) in place. For some platforms, these checks are performed by researchers with content expertise.We provide a searchable database as a valuable resource for researchers, funders and policymakers in the biomedical and medical science field to determine which preprint platforms are relevant to their research scope and which have the functionality and policies that they value most.Competing Interest StatementJessica Polka is Executive Director of ASAPbio.View Full Text

Source connections

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Kirkham, J. J., Penfold, N., Murphy, F., Boutron, I., Ioannidis, J. P., Polka, J. K., Moher, D.. 2020-04-28. A systematic examination of preprint platforms for use in the medical and biomedical sciences setting. https://doi.org/10.1101/2020.04.27.063578

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

Evaluating Large Language Models as Tools to Navigate Researchers in Rapidly Evolving Research Landscapes: A Case Study in Cancer Drug Response Prediction

Large Language Models (LLMs) have emerged as promising tools for assisting researchers in automating and accelerating the synthesis of literature reviews. However, their reliability is a significant concern due to issues like factual inaccuracies and hallucinations. The key question is whether LLMs can reliably provide comprehensive, up-to-date overviews and analyses. This study evaluates the performance of three leading LLMs (OpenAI's ChatGPT, Google's Gemini, and DeepSeek) on the complex task of generating a comprehensive survey paper on deep learning for cancer Drug Response Prediction (DRP). By testing both standard and Deep Research (DR) / Deep Think (DT) modes of LLMs with prompts of varying detail, this paper assesses key academic dimensions, including reference management, content quality, and analytical depth. Key findings reveal that while DR modes of LLMs significantly improve reliability by eliminating hallucinations, performance variations exist across models and prompts. A trade-off between reference quantity and integration quality was observed, and even the best-performing models lacked the analytical depth of human experts, often requiring extensive human supervision. The study concludes that LLMs currently serve as powerful assistive tools but still cannot replace the critical validation and synthesis provided by human researchers. Choosing the best LLM to use depends on the task in hand, while several strategies can be implemented to improve the produced output.

scientific communication and education

Cooperative efforts on developing vaccines and therapies for COVID-19

Health organizations have always sought partnership to join competencies in innovation, even with fierce competition in this sector. In this pandemic moment it is relevant to observe how organizations behave to seek quick and safe answers. The present research analyzes how the cooperation networks were set off considering the clinical trials on therapies and vaccines that were developed specifically to treat or prevent COVID-19. Social Network Analysis technique was used to build cooperation networks and apply metrics that characterize these connections. There was an evaluation of statistics of Strength of cooperation and Unilateral dependence of cooperation that identify the cooperation strength between two organizations, and the dependence of this relations. A total of 415 clinical trial were identified, of which 42% are in cooperation. From organizations that have partnership, firms are the first, followed by universities. We extracted the main categories that concentrate 74% of partnerships in the trials of antibody, and vaccine. Several organizations cooperate in multiple categories of trials, evidencing the efforts to focus on different strategies to treat the disease. We found high strength of cooperation and an assimetryc dependency between partners, which can be assigned to specialized models of partnership and it occurs in competitive enviroments like this pandemic moment. Cooperation were not limited to geographical proximity and the advent of Chinese players can represent a new change in the biotechnological development axis. Finally, the challenge of finding therapeutic or immunological solutions for COVID-19 demonstrates a clear composition of cooperation groups that complement their skills to manage organizational strategies to beat the pandemic. In this new paradigm, there can be partnerships not only in clinical trial but also in pre-competitive technologies development. This experience is expected to change the way of organizations define their R&D strategies and start to adopt more a collaborative innovation model.

scientific communication and education

A Mental Health Paradox: Mental health was both a motivator and barrier to physical activity during the COVID-19 pandemic

The COVID-19 pandemic has impacted the mental health, physical activity, and sedentary behavior of citizens worldwide. Using an online survey with 1669 respondents, we sought to understand why and how by querying about perceived barriers and motivators to physical activity that changed because of the pandemic, and how those changes impacted mental health. Consistent with prior reports, our respondents were less physically active (aerobic activity, -11%, p <0.05; strength-based activity, -30%, p<0.01) and more sedentary (+11%, p<0.01) during the pandemic as compared to 6-months before. The pandemic also increased psychological stress (+22%, p <0.01) and brought on moderate symptoms of anxiety and depression. Respondents whose mental health deteriorated the most were also the ones who were least active (depression r = -.21, p<0.01; anxiety r = -.12, p<0.01). The majority of respondents were unmotivated to exercise because they were too anxious (+8%, p <0.01), lacked social support (+6%, p =<0.01), or had limited access to equipment (+23%, p <0.01) or space (+41%, p <0.01). The respondents who were able to stay active reported feeling less motivated by physical health outcomes such as weight loss (-7%, p<0.01) or strength (-14%, p<0.01) and instead more motivated by mental health outcomes such as anxiety relief (+14%, p <0.01). Coupled with previous work demonstrating a direct relationship between mental health and physical activity, these results highlight the potential protective effect of physical activity on mental health and point to the need for psychological support to overcome perceived barriers so that people can continue to be physically active during stressful times like the pandemic.

scientific communication and education