Knowledge and attitudes among life scientists towards reproducibility within journal articles.

Kaimaklioti Samota, E.; P. Davey, R.

doi:10.1101/581033

Home/Archive/bioRxiv

bioRxiv · 10.1101/581033

Knowledge and attitudes among life scientists towards reproducibility within journal articles.

Kaimaklioti Samota, E.·P. Davey, R.

View original source ↗Export metadata ↓

Abstract

We constructed a survey to understand how authors and scientists view the issues around reproducibility, focusing on interactive elements such as interactive figures embedded within online publications, as a solution for enabling the reproducibility of experiments. We report the views of 251 researchers, comprising authors who have published in eLIFE Sciences, and those who work at the Norwich Biosciences Institutes (NBI). The survey also outlines to what extent researchers are occupied with reproducing experiments themselves. Currently, there is an increasing range of tools that attempt to address the production of reproducible research by making code, data, and analyses available to the community for reuse. We wanted to collect information about attitudes around the consumer end of the spectrum, where life scientists interact with research outputs to interpret scientific results. Static plots and figures within articles are a central part of this interpretation, and therefore we asked respondents to consider various features for an interactive figure within a research article that would allow them to better understand and reproduce a published analysis. The majority (91%) of respondents reported that when authors describe their research methodology (methods and analyses) in detail, published research can become more reproducible. The respondents believe that having interactive figures in published papers is a beneficial element to themselves, the papers they read as well as to their readers. Whilst interactive figures are one potential solution for consuming the results of research more effectively to enable reproducibility, we also review the equally pressing technical and cultural demands on researchers that need to be addressed to achieve greater success in reproducibility in the life sciences.

Explore related subjects

scientific communication and education Preprint

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

Kaimaklioti Samota, E., P. Davey, R.. 2019-03-20. Knowledge and attitudes among life scientists towards reproducibility within journal articles.. https://doi.org/10.1101/581033

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

bioRxiv2026

Evaluating Large Language Models as Tools to Navigate Researchers in Rapidly Evolving Research Landscapes: A Case Study in Cancer Drug Response Prediction

Large Language Models (LLMs) have emerged as promising tools for assisting researchers in automating and accelerating the synthesis of literature reviews. However, their reliability is a significant concern due to issues like factual inaccuracies and hallucinations. The key question is whether LLMs can reliably provide comprehensive, up-to-date overviews and analyses. This study evaluates the performance of three leading LLMs (OpenAI's ChatGPT, Google's Gemini, and DeepSeek) on the complex task of generating a comprehensive survey paper on deep learning for cancer Drug Response Prediction (DRP). By testing both standard and Deep Research (DR) / Deep Think (DT) modes of LLMs with prompts of varying detail, this paper assesses key academic dimensions, including reference management, content quality, and analytical depth. Key findings reveal that while DR modes of LLMs significantly improve reliability by eliminating hallucinations, performance variations exist across models and prompts. A trade-off between reference quantity and integration quality was observed, and even the best-performing models lacked the analytical depth of human experts, often requiring extensive human supervision. The study concludes that LLMs currently serve as powerful assistive tools but still cannot replace the critical validation and synthesis provided by human researchers. Choosing the best LLM to use depends on the task in hand, while several strategies can be implemented to improve the produced output.

scientific communication and education↗

bioRxiv2019

The Mastery Rubric for Bioinformatics: supporting design and evaluation of career-spanning education and training

As the life sciences have become more data intensive, the pressure to incorporate the requisite training into life-science education and training programs has increased. To facilitate curriculum development, various sets of (bio)informatics competencies have been articulated; however, these have proved difficult to implement in practice. Addressing this issue, we have created a curriculum-design and -evaluation tool to support the development of specific Knowledge, Skills and Abilities (KSAs) that reflect the scientific method and promote both bioinformatics practice and the achievement of competencies. Twelve KSAs were extracted via formal analysis, and stages along a developmental trajectory, from uninitiated student to independent practitioner, were identified. Demonstration of each KSA by a performer at each stage was initially described (Performance Level Descriptors, PLDs), evaluated, and revised at an international workshop. This work was subsequently extended and further refined to yield the Mastery Rubric for Bioinformatics (MR-Bi). The MR-Bi was validated by demonstrating alignment between the KSAs and competencies, and its consistency with principles of adult learning. The MR-Bi tool provides a formal framework to support curriculum building, training, and self-directed learning. It prioritizes the development of independence and scientific reasoning, and is structured to allow individuals (regardless of career stage, disciplinary background, or skill level) to locate themselves within the framework. The KSAs and their PLDs promote scientific problem formulation and problem solving, lending the MR-Bi durability and flexibility. With its explicit developmental trajectory, the tool can be used by developing or practicing scientists to direct their (and their teams) acquisition of new, or to deepen existing, bioinformatics KSAs. The MR-Bi can thereby contribute to the cultivation of a next generation of bioinformaticians who are able to design reproducible and rigorous research, and to critically analyze results from their own, and others, work.

scientific communication and education↗

bioRxiv2019

Perceived Barriers in Accessing Sexual and Reproductive Health Services for Youth in Lao People’s Democratic Republic

BackgroundSexual activity during youth is common in Lao PDR. However, young people seldom utilize sexual and reproductive health services and subsequently suffer from poor sexual and reproductive health. The aim of this qualitative study was to explore the barriers perceived by youth that prevent their access to sexual and reproductive health services.\n\nMethodsTwenty-nine semi-structured interviews were conducted with 22 participants aged 15-25 years, from urban and rural areas. A vignette was used during interviews with those who had no experience with sexual and reproductive health services. Additionally, seven semi-structured interviews were conducted with health providers from youth-friendly health clinics and from public sexual and reproductive health services. Data were analyzed using a thematic approach.\n\nResultsThe main barriers preventing young people from accessing sexual and reproductive health services were related to cognitive accessibility and psychosocial accessibility. The cognitive accessibility barriers were a lack of sexual knowledge and a lack of awareness of services. Perceived barriers in psychosocial accessibility were the feelings of shyness and shame caused by negative cultural attitudes to premarital sex, and the fear of parents finding out about visits to public sexual and reproductive health services, due to lack of confidentiality in the services and among health providers. In addition, the barriers of geographical accessibility, mainly insufficient availability of youth-friendly health clinics.\n\nConclusionTo improve access to services, a multi-component strategy is needed: promotion of youth-friendly health clinics; sexual education in schools; a formal referral system between schools and youth-friendly health clinics; and community support interventions. Prior to implementation, more research should be done on the applicability of these methods in the Laos context. Future research should try to determine the cost-effectiveness of youth-friendly health clinics integrated in a district hospital and stand-alone clinics, to provide insight into which form should be further developed.

scientific communication and education↗