bioRxiv Science⌕ Search

bioRxiv · 10.1101/2021.12.03.471055

Characteristics and data reporting of rare disease clinical trials: Getting better but still room for improvement

Abstract

BackgroundIt is estimated that there are more than 7,000 rare diseases (RDs) worldwide, impacting the lives of approximately 400 million people and only 5% have an approved therapy. Facing special challenges, including patient scarceness, incomplete knowledge of the natural history and only few specialized clinical sites, clinical trials (CT) are limited, making the data from trials critical for research and clinical care. Despite the introduction of the U.S. Food and Drug Administration Amendment Act (FDAAA) in 2007 requiring certain CTs to post results on the registry ClinicalTrials.gov within 12 months following completion, compliance has been reportedly poor. Here, we describe general characteristics of RD CTs, identify trends, and evaluate result reporting practices under the FDAAA aiming to draw awareness to the problem of non-compliance. MethodsCTs conducted between 2008 and 2015 were extracted from the public U.S. trial registry ClinicalTrials.gov using the text mining software I2E (Linguamatics). Disease names were matched with rare disease names from the Orphanet Rare Disease Ontology (ORDO, v2.5, Orphanet). Statistical analyses and data visualization were performed using GraphPad Prism 7 and R (v3.5). The Students t-test was employed to calculate significance using p-value cut-offs of <0.05 or <0.001. ResultsWe analyzed 1,056 RD CTs of which 55.7% were phase 2, 7.7% phase 2/3 and 36.7% phase 3 trials. The studies were mostly one- and two-armed experimental CTs with the majority (60.2%) being funded by industry. Cystic fibrosis and sickle cell disease represented the most frequently investigated diseases (25.0% and 16.5%). Industry-led phase 2 RD CTs were significantly (p<0.0001) shorter than their equivalent led by academia/non-profit (22 vs. 33 months). Screening CTs completed before the end of 2015, we found that of the 725 analyzed studies, 55.2% predominantly phase 2 CTs, did not report results. Taking their potential applicability to the FDAAA into account, 25.2% industry-funded and 28.0% academia/non-profit-funded trials failed to disclose results on ClinicalTrial.gov. ConclusionRD CTs tend to be comparatively small, industry-funded studies focusing on genetic and neurologic conditions. Sponsor-related differences in study design, duration, and enrollment were observed. There are still substantial shortcomings when it comes to result publication.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Mair, N. K., Gottowik, J., Rodriguez-Esteban, R., Seabrook, T. J.. 2021-12-07. Characteristics and data reporting of rare disease clinical trials: Getting better but still room for improvement. https://doi.org/10.1101/2021.12.03.471055

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

Evaluating Large Language Models as Tools to Navigate Researchers in Rapidly Evolving Research Landscapes: A Case Study in Cancer Drug Response Prediction

Large Language Models (LLMs) have emerged as promising tools for assisting researchers in automating and accelerating the synthesis of literature reviews. However, their reliability is a significant concern due to issues like factual inaccuracies and hallucinations. The key question is whether LLMs can reliably provide comprehensive, up-to-date overviews and analyses. This study evaluates the performance of three leading LLMs (OpenAI's ChatGPT, Google's Gemini, and DeepSeek) on the complex task of generating a comprehensive survey paper on deep learning for cancer Drug Response Prediction (DRP). By testing both standard and Deep Research (DR) / Deep Think (DT) modes of LLMs with prompts of varying detail, this paper assesses key academic dimensions, including reference management, content quality, and analytical depth. Key findings reveal that while DR modes of LLMs significantly improve reliability by eliminating hallucinations, performance variations exist across models and prompts. A trade-off between reference quantity and integration quality was observed, and even the best-performing models lacked the analytical depth of human experts, often requiring extensive human supervision. The study concludes that LLMs currently serve as powerful assistive tools but still cannot replace the critical validation and synthesis provided by human researchers. Choosing the best LLM to use depends on the task in hand, while several strategies can be implemented to improve the produced output.

scientific communication and education↗

Insights from a survey of mentorship experiences by graduate and postdoctoral researchers

Mentorship is vital for early career researchers in training positions, allowing them to navigate the challenges of work and life in research environments. However, the quality of mentorship received by trainees can vary by investigator and by institution. One challenge faced by those hoping to improve trainee mentorship is that the extent to which mentorship is offered to and experienced by research trainees is not well characterized. To address this knowledge gap, we conducted a survey to examine the quality of mentorship received by trainees in research environments, to identify characteristics of positive and negative mentorship, and to highlight best practices to improve trainee mentorship. We received 2,114 responses from researchers at graduate and postdoctoral career stages worldwide. Quantitative analysis showed that at least [~]25-45% of respondents were dissatisfied with some aspects of their mentorship. Qualitative responses revealed that common issues in mentorship include unclear expectations in research and mentoring interactions, lack of guidance, and inadequate support of trainee independence and career goals. Our findings also identified key mentorship elements desired by trainee mentees. Based on trainee suggestions, we describe strategies for individual mentors, departments, and institutions to improve the training experience for graduate and postdoctoral researchers.

scientific communication and education↗

Supporting diamond open access journals. Interest and feasibility of direct funding mechanisms

More and more academics and governements consider that the open access model based on Article Processing Charges (APC) is problematic, not only due to the inequalities it generates and reinforces, but also because it has become unsustainable and even opposed to open access values. They consider that scientific publishing based on a model where both authors and readers do not pay - the so-called Diamond, or non-APC model - should be developed and supported. However, beyond the display of such a support on an international scale, the landscape of Diamond journals is rather in the form of loosely connected archipelagos, and not systematically funded. This article explores the practical conditions to implement a direct funding mechanism to such journals, that is reccurent money provided by a funder to support the publication process. Following several recommendations from institutional actors in the open access world, we consider the hypothesis that such a funding would be fostered by research funding organizations (RFOs), which have been essential to the expansion of the APC model, and now show interest in supporting other models. Based on a questionnaire survey sent to more thant 1000 Diamond Open Access journals, this article analyzes their financial needs, as well as their capacity to interact with funders. It is structured around four issues regarding the implementation of a direct funding model : Do Diamond journals really make use of money, and to what end ? Do they need additional money? Are they able to engage monetary transactions? Are they able to meet RFOs visibility requirements? We show that a majority of OA Diamond journals could make use of a direct funding mechanism with certain adjustments. We conclude on the challenges that such a financial stream would spur.

scientific communication and education↗