bioRxiv Science⌕ Search
Home/Archive/bioRxiv

bioRxiv · 10.1101/2024.12.23.630160

Framework for assessing the risk to a field from fraudulent research

Ni, C.·Hutchins, B. I.
View original source ↗Export metadata ↓

Abstract

Concerns over research integrity are rising, with increasing attention to potential threats from untrustworthy authors. We established a framework to gauge the potential negative influence of researchers potentially engaged in misconduct. The field of Alzheimers Disease (AD) research has been a focal point of these worries. This study aims to assess the risk posed by questionable studies or individuals potentially engaging in fraudulent science in research by examining citation relationships among papers, taking AD research as an illustrative example. Analysis of citation network structure can elucidate the potential propagation of misinformation arising at the author level. Our analysis revealed that there arent any single authors or papers whose citation connections jeopardize a major portion of the fields literature. This indicates a low probability of single entities undermining the majority of works in this area. However, our findings suggest that attention to research integrity of the most influential scientists is warranted. Some scientists can reach a sizable minority of the literature through citations to their work. Emphasizing oversight of the integrity of these authors is crucial, given their influence on the field. Our study introduces an analytical framework adaptable across various fields and disciplines to evaluate potential risks from fraudulence.

Explore related subjects

scientific communication and educationPreprint

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Ni, C., Hutchins, B. I.. 2024-12-26. Framework for assessing the risk to a field from fraudulent research. https://doi.org/10.1101/2024.12.23.630160

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

bioRxiv2026

Evaluating Large Language Models as Tools to Navigate Researchers in Rapidly Evolving Research Landscapes: A Case Study in Cancer Drug Response Prediction

Large Language Models (LLMs) have emerged as promising tools for assisting researchers in automating and accelerating the synthesis of literature reviews. However, their reliability is a significant concern due to issues like factual inaccuracies and hallucinations. The key question is whether LLMs can reliably provide comprehensive, up-to-date overviews and analyses. This study evaluates the performance of three leading LLMs (OpenAI's ChatGPT, Google's Gemini, and DeepSeek) on the complex task of generating a comprehensive survey paper on deep learning for cancer Drug Response Prediction (DRP). By testing both standard and Deep Research (DR) / Deep Think (DT) modes of LLMs with prompts of varying detail, this paper assesses key academic dimensions, including reference management, content quality, and analytical depth. Key findings reveal that while DR modes of LLMs significantly improve reliability by eliminating hallucinations, performance variations exist across models and prompts. A trade-off between reference quantity and integration quality was observed, and even the best-performing models lacked the analytical depth of human experts, often requiring extensive human supervision. The study concludes that LLMs currently serve as powerful assistive tools but still cannot replace the critical validation and synthesis provided by human researchers. Choosing the best LLM to use depends on the task in hand, while several strategies can be implemented to improve the produced output.

scientific communication and education↗
bioRxiv2026

A strong start for sustained success: inclusivity through a national group mentorship program for first-year graduate students

In the United States, STEM graduate programs and workforce do not represent the demographics of the population. Obstacles, including a lack of transparency, community, and accessible information in navigating academia, disproportionately affect students from underserved backgrounds. Peer mentoring networks can address these disparities. Here, we describe Cientifico Latino, Inc.s Graduate Student Engagement and Community (CL-GSEC) program, a nationwide, group-based peer mentorship program that has served first-year graduate students across the U.S., especially those from underserved backgrounds. Surveys indicate CL-GSEC positively impacts the first-year graduate experience. We highlight key program features, challenges, and insights, such as financial strains faced by first-year graduate students. We offer suggestions for how faculty and departments can better support students during this critical early stage of graduate training. We hope that reporting on CL-GSECs program structure, evaluations, and findings will guide educational leaders in expanding programming for junior graduate students.

scientific communication and education↗
bioRxiv2026

Biodesign Buddy: Integrating Generative Artificial Intelligence in Academic Biodesign

Biodesign is an interdisciplinary research domain that incorporates principles from design and the life sciences to develop new systems, processes, and objects. Collegiate biodesign educators face unique pedagogical challenges, including an absence of relevant scholarship on curriculum design and instructional best practices for cultivating student scientific literacy. These difficulties may be overcome with newly available technologies, like generative AI systems, that enable personalized learning through domain-specific semantic spaces. This article examines the instructional value of one such domain-specific LLM, Biodesign Buddy, through a mixed-methods analysis of an eight-week study involving 64 students participating in an international biodesign competition. Results indicate strong support for integrating AI into biodesign coursework. Surveys captured attitudes toward AI, scientific literature, and learning experiences to assess AIs impact on learning outcomes. Findings suggest that integrating AI into biodesign pedagogy can meaningfully redress conceptual issues in biodesign while informing broader debates on AIs role in higher education. Impact StatementThis article introduces Biodesign Buddy, a domain-specific generative AI system for collegiate biodesign education, and reports on its exploratory deployment, offering design principles and preliminary findings to inform the development of AI-supported pedagogies for interdisciplinary biodesign instruction.

scientific communication and education↗