bioRxiv Science⌕ Search

bioRxiv · 10.1101/2021.03.24.436697

Sysrev: A FAIR Platform For Data Curation And Systematic Evidence Review

Abstract

AbstractWell-curated datasets are essential to evidence based decision making and to the integration of artificial intelligence with human reasoning across disciplines. However, many sources of data remain siloed, unstructured, and/or unavailable for complementary and secondary research. Sysrev was developed to address these issues. First, Sysrev was built to aid in systematic evidence reviews (SER), where digital documents are evaluated according to a well defined process, and where Sysrev provides an easy to access, publicly available and free platform for collaborating in SER projects. Secondly, Sysrev addresses the issue of unstructured, siloed, and inaccessible data in the context of generalized data extraction, where human and machine learning algorithms are combined to extract insights and evidence for better decision making across disciplines. Sysrev uses FAIR - Findability, Accessibility, Interoperability, and Reuse of digital assets - as primary principles in design. Sysrev was developed primarily because of an observed need to reduce redundancy, reduce inefficient use of human time and increase the impact of evidence based decision making. This publication is an introduction to Sysrev as a novel technology, with an overview of the features, motivations and use cases of the tool. MethodsSysrev.com is a FAIR motivated web platform for data curation and SER. Sysrev allows users to create data curation projects called "sysrevs" wherein users upload documents, define review tasks, recruit reviewers, perform review tasks, and automate review tasks. ConclusionSysrev is a web application designed to facilitate data curation and SERs. Thousands of publicly accessible Sysrev projects have been created, accommodating research in a wide variety of disciplines. Described use cases include data curation, managed reviews, and SERs.

Source connections

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Bozada, T., Borden, J., Del Cid, M., Malinowski, J., Luechtefeld, T.. 2021-03-26. Sysrev: A FAIR Platform For Data Curation And Systematic Evidence Review. https://doi.org/10.1101/2021.03.24.436697

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

Evaluating Large Language Models as Tools to Navigate Researchers in Rapidly Evolving Research Landscapes: A Case Study in Cancer Drug Response Prediction

Large Language Models (LLMs) have emerged as promising tools for assisting researchers in automating and accelerating the synthesis of literature reviews. However, their reliability is a significant concern due to issues like factual inaccuracies and hallucinations. The key question is whether LLMs can reliably provide comprehensive, up-to-date overviews and analyses. This study evaluates the performance of three leading LLMs (OpenAI's ChatGPT, Google's Gemini, and DeepSeek) on the complex task of generating a comprehensive survey paper on deep learning for cancer Drug Response Prediction (DRP). By testing both standard and Deep Research (DR) / Deep Think (DT) modes of LLMs with prompts of varying detail, this paper assesses key academic dimensions, including reference management, content quality, and analytical depth. Key findings reveal that while DR modes of LLMs significantly improve reliability by eliminating hallucinations, performance variations exist across models and prompts. A trade-off between reference quantity and integration quality was observed, and even the best-performing models lacked the analytical depth of human experts, often requiring extensive human supervision. The study concludes that LLMs currently serve as powerful assistive tools but still cannot replace the critical validation and synthesis provided by human researchers. Choosing the best LLM to use depends on the task in hand, while several strategies can be implemented to improve the produced output.

scientific communication and education↗

Welfare concerns for mounted load carrying by working donkeys in Pakistan

Working donkeys (Equus asinus) are vital to peoples livelihoods. They are essential for carrying goods, however globally, overloading is one of the primary welfare concerns of working donkeys. We studied mounted load carrying by donkeys and associated factors in Pakistan. A cross-sectional study of donkey owners (n = 332) was conducted, and interviews were undertaken based on a questionnaire. Owners estimated that the median weight of their donkeys was 110kg (interquartile range (IQR) 100-120kg), and that they carried a median mounted load of 81.5kg (IQR 63-99kg). We found that 87.4% of donkeys carried a load above 50% of their bodyweight ratio (BWR), the median BWR carried was 77.1% (IQR 54.5-90.7%), and 25.3% of donkeys carried above 90% BWR. Donkeys that were loaded at more than 50% BWR were more likely to sit, compared to donkeys loaded with less weight (p=0.01). Donkeys working in peri-urban and urban areas were more likely to carry a greater BWR than donkeys working in rural areas (P<0.001), as were those carrying construction materials or bricks, compared to agricultural materials (p=0.004). Age (p=0.03) and breed (p=0.01) were also associated with carrying a higher weight. Overloading based on current recommendations (50% BWR) was common, with the majority (87.4%) of donkeys reported to carry more than the recommended 50% limit. This survey provides evidence of on-the-ground working practices and factors associated with mounted load carrying, which is critical for developing evidence-based recommendations for loading, in order to improve the welfare of working donkeys.

scientific communication and education↗