bioRxiv Science⌕ Search

bioRxiv · 10.1101/2022.02.03.479041

Science in motion: A qualitative analysis of journalists' use and perception of preprints

Abstract

This qualitative study explores how and why journalists use preprints -- unreviewed research papers -- in their reporting. Through thematic analysis of interviews conducted with 19 health and science journalists in the second year of the COVID-19 pandemic, it applies a theoretical framework that conceptualizes COVID-19 preprint research as a form of post-normal science, characterized by high scientific uncertainty and societal relevance, urgent need for political decision-making, and value-related policy considerations. Findings suggest that journalists approach the decision to cover preprints as a careful calculation, in which the potential public benefits and the ease of access preprints provided were weighed against risks of spreading misinformation. Journalists described viewing unreviewed studies with extra skepticism and relied on diverse strategies to find, vet, and report on them. Some of these strategies represent standard science journalism, while others, such as labeling unreviewed studies as preprints, mark a departure from the norm. However, journalists also reported barriers to covering preprints, as many felt they lacked the expertise or the time required to fully understand or vet the research. The findings suggest that coverage of preprints is likely to continue post-pandemic, with important implications for scientists, journalists, and the publics who read their work.

Source connections

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Fleerackers, A., Moorhead, L., Maggio, L. A., Fagan, K., Alperin, J. P.. 2022-02-04. Science in motion: A qualitative analysis of journalists' use and perception of preprints. https://doi.org/10.1101/2022.02.03.479041

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

Evaluating Large Language Models as Tools to Navigate Researchers in Rapidly Evolving Research Landscapes: A Case Study in Cancer Drug Response Prediction

Large Language Models (LLMs) have emerged as promising tools for assisting researchers in automating and accelerating the synthesis of literature reviews. However, their reliability is a significant concern due to issues like factual inaccuracies and hallucinations. The key question is whether LLMs can reliably provide comprehensive, up-to-date overviews and analyses. This study evaluates the performance of three leading LLMs (OpenAI's ChatGPT, Google's Gemini, and DeepSeek) on the complex task of generating a comprehensive survey paper on deep learning for cancer Drug Response Prediction (DRP). By testing both standard and Deep Research (DR) / Deep Think (DT) modes of LLMs with prompts of varying detail, this paper assesses key academic dimensions, including reference management, content quality, and analytical depth. Key findings reveal that while DR modes of LLMs significantly improve reliability by eliminating hallucinations, performance variations exist across models and prompts. A trade-off between reference quantity and integration quality was observed, and even the best-performing models lacked the analytical depth of human experts, often requiring extensive human supervision. The study concludes that LLMs currently serve as powerful assistive tools but still cannot replace the critical validation and synthesis provided by human researchers. Choosing the best LLM to use depends on the task in hand, while several strategies can be implemented to improve the produced output.

scientific communication and education↗

Hybrid conferences: opportunities, challenges and ways forward

Hybrid conferences are in-person events that are also accessible online. This type of meeting format was rare pre-COVID-19 but started to become more common recently given the asynchronous global progression of the pandemic and the uneven access and distribution of vaccines that led to a large proportion of participants being unable to attend international conferences in person. Here we report the organization of a middle-sized (581 participants: 159 onsite, 422 online) international hybrid conference that took place in France in September 2021. We highlight particular organizational challenges inherent to this relatively new type of meeting format. Furthermore, we surveyed both in-person and online participants to better understand their conference experience and to propose improvements based on the feedback received. Finally, we compare the advantages and disadvantages of three types of conferences (onsite-only, online-only and hybrid) and suggest that hybrid events should be favored in the future because they offer the most flexibility to participants. We conclude by proposing suggestions and ways forward to maximize accessibility and inclusivity of hybrid conferences.

scientific communication and education↗

If this title is funny, will you cite me? Citation impacts of humour and other features of article titles in ecology and evolution

Titles of scientific papers pay a key role in their discovery, and "good" titles engage and recruit readers. A particularly interesting aspect of title construction is the use of humour, but little is known about whether funny titles boost or limit readership and citation of papers. We used a panel of volunteer scorers to assess title humour for 2,439 papers in ecology and evolution, and measured associations between humour scores and subsequent citation (both self-citation and citation by others). Papers with funnier titles were cited less often, but this appears to result from a confound with paper importance. Self-citation data suggest that authors give funnier titles to papers they consider less important. After correction for this confound, papers with funny titles have significantly higher citation rates, suggesting that humour recruits readers. We also examined associations between citation rates and several other features of titles. Inclusion of acronyms and taxonomic names was associated with lower citation rates, while assertive-statement phrasing and presence of colons, question marks, and political regions were associated with somewhat higher citation rates. Title length had no effect on citation. Our results suggest that scientists can use creativity with titles without having their work condemned to obscurity.

scientific communication and education↗