bioRxiv ScienceSearch

bioRxiv · 10.1101/729129

Analysis of Practices to Promote Reproducibility and Transparency in Anaesthesiology Research: Are Important Aspects Hidden Behind the Drapes?

Abstract

IntroductionReliable, high-quality research is essential to the field of anaesthesiology. Reproducibility and transparency has been investigated in the biomedical domain and in the social sciences, with both lacking to provide necessary information to reproduce the study findings. In this study, we investigated 14 indicators of reproducibility in anaesthesiology research.\n\nMethodsWe used the National Library of Medicine (NLM) catalogue to search for all anaesthesiology journals that are MEDLINE indexed and provided English texts. PubMed was searched with the list of journals to identify all publications from January 1, 2014 to December 31, 2018. We randomly sampled 300 publications that fit the inclusion criteria for our analysis. Data extraction was then conducted in a blinded, duplicate fashion using a pilot-tested Google form.\n\nResultsThe PubMed search of these journals identified 171,441 publications, with 28,310 being within the time frame. From the 300 publications sampled, 296 full-text publications were accessible. Most of the studies did not include materials or protocol availability statements. The majority of publications did not provide a data analysis script statement (121/122, 99% [98% to 100%]) or a preregistration statement (94/122, 77% [72% to 81%]).\n\nConclusionAnaesthesiology research needs to drastically improve indicators of reproducibility and transparency. By making research publically available and improving accessibility to detailed study components, primary research can be reproduced in subsequent studies and help contribute to the development of new practice guidelines.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Okonya, O., Rorah, D., Tritz, D., Umberham, B., Wiley, M., Vassar, M.. 2019-08-12. Analysis of Practices to Promote Reproducibility and Transparency in Anaesthesiology Research: Are Important Aspects Hidden Behind the Drapes?. https://doi.org/10.1101/729129

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

Evaluating Large Language Models as Tools to Navigate Researchers in Rapidly Evolving Research Landscapes: A Case Study in Cancer Drug Response Prediction

Large Language Models (LLMs) have emerged as promising tools for assisting researchers in automating and accelerating the synthesis of literature reviews. However, their reliability is a significant concern due to issues like factual inaccuracies and hallucinations. The key question is whether LLMs can reliably provide comprehensive, up-to-date overviews and analyses. This study evaluates the performance of three leading LLMs (OpenAI's ChatGPT, Google's Gemini, and DeepSeek) on the complex task of generating a comprehensive survey paper on deep learning for cancer Drug Response Prediction (DRP). By testing both standard and Deep Research (DR) / Deep Think (DT) modes of LLMs with prompts of varying detail, this paper assesses key academic dimensions, including reference management, content quality, and analytical depth. Key findings reveal that while DR modes of LLMs significantly improve reliability by eliminating hallucinations, performance variations exist across models and prompts. A trade-off between reference quantity and integration quality was observed, and even the best-performing models lacked the analytical depth of human experts, often requiring extensive human supervision. The study concludes that LLMs currently serve as powerful assistive tools but still cannot replace the critical validation and synthesis provided by human researchers. Choosing the best LLM to use depends on the task in hand, while several strategies can be implemented to improve the produced output.

scientific communication and education

PlotTwist - a web app for plotting and annotating time-series data

The results from time-dependent experiments are often used to generate plots that visualize how the data evolves over time. To simplify state-of-the-art data visualization and annotation of data from such experiments, an open source tool was created with R/shiny that does not require coding skills to operate. The freely available web app accepts wide (spreadsheet) and tidy data and offers a range of options to normalize the data. The data from individual objects can be shown in three different ways: (i) lines with unique colors, (ii) small multiples and (iii) heatmap-style display. Next to this, the mean can be displayed with a 95% confidence interval for the visual comparison of different conditions. Several color blind friendly palettes are available to label the data and/or statistics. The plots can be annotated with graphical features and/or text to indicate any perturbations that were applied during the time-lapse experiments. All user-defined settings can be stored for reproducibility of the data visualization. The app is dubbed PlotTwist and is available online: https://huygens.science.uva.nl/PlotTwist\n\n\n\nO_FIG O_LINKSMALLFIG WIDTH=200 HEIGHT=166 SRC=\"FIGDIR/small/745612v2_ufig1.gif\" ALT=\"Figure 1\">\nView larger version (34K):\norg.highwire.dtl.DTLVardef@1bad5e6org.highwire.dtl.DTLVardef@1312023org.highwire.dtl.DTLVardef@350cb5org.highwire.dtl.DTLVardef@d556c6_HPS_FORMAT_FIGEXP M_FIG C_FIG

scientific communication and education

The Five-Primer Challenge: An inquiry-based laboratory module for synthetic biology

New technologies in DNA synthesis and assembly give genetic engineers complete freedom in genetic design, where virtually any plasmid DNA sequence can be created efficiently and economically. Learning how to design, construct, and test new DNA sequences is a critical skill for researchers in molecular biology and biotechnology. Here we present a student-centered, inquiry-based module in which students learn how to control bacterial gene expression by appplying various DNA assembly techniques. The central activity in this learning module is termed the Five-Primer Challenge. Each student is allowed to order up to five 60-mer oligonucleotide primers to then modify a GFP expression plasmid with the goal of increasing GFP expression as much as possible. This module was developed and implemented at the 2016 Cold Spring Harbor Laboratory Synthetic Biology Course, and was effective at engaging students in critical thinking and in promoting student learning.

scientific communication and education