bioRxiv ScienceSearch

bioRxiv · 10.1101/773473

Evaluation of Reproducible and Transparent Research Practices in Sports Medicine Research: A Cross-sectional study

Abstract

BackgroundIn recent years, urgency has been placed on the \"reproducibility crisis\" facing biomedical research. Despite efforts toward improvement, certain elements needed to reproduce a study are often lacking from publications. The current state of reproducibility within the sports medicine research community remains unknown.\n\nPurposeOur study sought to evaluate the presence of eight indicators of reproducibility and transparency to determine the current state of research reporting in sports medicine research.\n\nStudy DesignCross-sectional review\n\nMethodsUsing the National Library of Medicine catalog, we identified 41 MEDLINE-indexed, English language sports medicine journals. From the 41 journals, we randomly sampled 300 publications that were recorded on PubMed as being published between January 1, 2014, and December 31, 2018. Two investigators extracted data in duplicate and blinded fashion.\n\nResultsOf the 300 publications sampled, 280 were accessible and were screened for empirical data. Studies that lack empirical data were excluded from our analysis. Of the remaining 195 with empirical data, 10 (5.13%) publications provided data availability statements, 1 (0.51%) provided a protocol, 0 (0.0%) provided an analysis script, and 9 (4.62%) were pre registered.\n\nConclusionReproducibility and transparency indicators are lacking in sports medicine publications. The majority of publications lack the necessary resources for reproducibility such as material, data, analysis scripts, or protocol availability. While the current state of reproducibility cannot be fixed overnight, we feel combined efforts of data sharing, open access, and verifying disclosure statements can help to improve overall reporting.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Evans, S., Fladie, I., Anderson, M., Tritz, D., Vassar, M.. 2019-09-25. Evaluation of Reproducible and Transparent Research Practices in Sports Medicine Research: A Cross-sectional study. https://doi.org/10.1101/773473

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

Evaluating Large Language Models as Tools to Navigate Researchers in Rapidly Evolving Research Landscapes: A Case Study in Cancer Drug Response Prediction

Large Language Models (LLMs) have emerged as promising tools for assisting researchers in automating and accelerating the synthesis of literature reviews. However, their reliability is a significant concern due to issues like factual inaccuracies and hallucinations. The key question is whether LLMs can reliably provide comprehensive, up-to-date overviews and analyses. This study evaluates the performance of three leading LLMs (OpenAI's ChatGPT, Google's Gemini, and DeepSeek) on the complex task of generating a comprehensive survey paper on deep learning for cancer Drug Response Prediction (DRP). By testing both standard and Deep Research (DR) / Deep Think (DT) modes of LLMs with prompts of varying detail, this paper assesses key academic dimensions, including reference management, content quality, and analytical depth. Key findings reveal that while DR modes of LLMs significantly improve reliability by eliminating hallucinations, performance variations exist across models and prompts. A trade-off between reference quantity and integration quality was observed, and even the best-performing models lacked the analytical depth of human experts, often requiring extensive human supervision. The study concludes that LLMs currently serve as powerful assistive tools but still cannot replace the critical validation and synthesis provided by human researchers. Choosing the best LLM to use depends on the task in hand, while several strategies can be implemented to improve the produced output.

scientific communication and education

Plagiarism in Brazil: A perspective of 25,000 PhD holders across the sciences

When it comes to ownership of ideas in science, Robert K. Merton (1957) observed in Priorities in Scientific Discovery: A Chapter in the Sociology of Science that "what is true of physics, chemistry, astronomy, medicine and mathematics is true also of all the other scientific disciplines, not excluding the social and psychological sciences". However, consensus over related issues, such as what constitutes plagiarism in these fields cannot be taken for granted. We conducted a comprehensive study on plagiarism views among PhD holders registered in the database of the Brazilian National Council for Scientific and Technological Development (CNPq). We collected 25,157 valid responses encompassing views and attitudes toward plagiarism from a probability sample of PhD holders across the fields, including biologists, physicists, mathematicians, and engineers as well as linguists, philosophers and anthropologists. The results suggest that core principles about plagiarism are shared among this multidisciplinary community and that they corroborate Mertons observations. Before this study, we could only speculate that this is the case. With these data from a probability sample of Brazilian academia (PhD holders), this study offers insight into the way plagiarism is perceived across the sciences, including the literature and arts, and sheds light on the problem in the context of international collaborative research networks. The data focus on a young research system in Latin America, but, given the cultural similarities that bind most Latin-American nations, these results may be relevant to other PhD populations in the region and should provide a comparison with studies from other emerging, non-Anglophone regions.

scientific communication and education

Turn of Events: Academic events as a platform for preregistration

Prereg posters are conference posters that present planned scientific projects. We provide preliminary evidence for their value in receiving constructive feedback, promoting open science, and supporting early career researchers.View Full Text

scientific communication and education