bioRxiv Science⌕ Search
Home/Archive/bioRxiv

bioRxiv · 10.1101/2022.01.21.477291

Becoming metrics literate: An analysis of brief videos that teach about the h-index

Maggio, L. A.·Jeffrey, A.·Haustein, S.·Samuel, A.
View original source ↗Export metadata ↓

Abstract

IntroductionAcademia uses scholarly metrics, such as the h-index, to make hiring, promotion, and funding decisions. These high-stakes decisions require that those using scholarly metrics be able to recognize, interpret, critically assess and effectively and ethically use them. This study aimed to characterize educational videos about the h-index to understand available resources and provide recommendations for future educational initiatives. MethodsThe authors analyzed videos on the h-index posted to YouTube. Videos were identified by searching YouTube and were screened by two authors. To code the videos the authors created a coding sheet, which assessed content and presentation style with a focus on the videos educational quality based on Cognitive Load Theory. Two authors coded each video independently with discrepancies resolved by group consensus. ResultsThirty-one videos met inclusion criteria. Twenty-one videos (68%) were screencasts and seven used a "talking head" approach. Twenty-six videos defined the h-index (83%) and provided examples of how to calculate and find it. The importance of the h-index in high-stakes decisions was raised in 14 (45%) videos. Sixteen videos (52%) described caveats about using the h-index, with potential disadvantages to early researchers the most prevalent (n=7; 23%). All videos incorporated various educational approaches with potential impact on viewer cognitive load. Most videos (n=21; 68%) displayed amateurish production quality. DiscussionThe videos featured content with potential to enhance viewers metrics literacies such that many defined the h-index and described its calculation, providing viewers with skills to recognize and interpret the metric. However, less than half described the h-index as an author quality indicator, which has been contested, and caveats about h-index use were inconsistently presented, suggesting room for improvement. While most videos integrated practices to facilitate balancing viewers cognitive load, few (32%) were of professional production quality. Some videos missed opportunities to adopt particular practices that could benefit learning.

Source connections

Explore related subjects

scientific communication and educationPreprint

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Maggio, L. A., Jeffrey, A., Haustein, S., Samuel, A.. 2022-01-24. Becoming metrics literate: An analysis of brief videos that teach about the h-index. https://doi.org/10.1101/2022.01.21.477291

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

bioRxiv2026

Evaluating Large Language Models as Tools to Navigate Researchers in Rapidly Evolving Research Landscapes: A Case Study in Cancer Drug Response Prediction

Large Language Models (LLMs) have emerged as promising tools for assisting researchers in automating and accelerating the synthesis of literature reviews. However, their reliability is a significant concern due to issues like factual inaccuracies and hallucinations. The key question is whether LLMs can reliably provide comprehensive, up-to-date overviews and analyses. This study evaluates the performance of three leading LLMs (OpenAI's ChatGPT, Google's Gemini, and DeepSeek) on the complex task of generating a comprehensive survey paper on deep learning for cancer Drug Response Prediction (DRP). By testing both standard and Deep Research (DR) / Deep Think (DT) modes of LLMs with prompts of varying detail, this paper assesses key academic dimensions, including reference management, content quality, and analytical depth. Key findings reveal that while DR modes of LLMs significantly improve reliability by eliminating hallucinations, performance variations exist across models and prompts. A trade-off between reference quantity and integration quality was observed, and even the best-performing models lacked the analytical depth of human experts, often requiring extensive human supervision. The study concludes that LLMs currently serve as powerful assistive tools but still cannot replace the critical validation and synthesis provided by human researchers. Choosing the best LLM to use depends on the task in hand, while several strategies can be implemented to improve the produced output.

scientific communication and education↗
bioRxiv2022

Preparing future STEM faculty nationwide through flexible teaching professional development

We report on a five-year initiative that has prepared thousands of future STEM faculty around the world to adopt evidence-based instructional practices by participating in two massive open online courses (MOOCs) and facilitated in-person learning communities. This novel combination of asynchronous online and coordinated, structured face-to-face learning community experiences provides flexible options for STEM graduate students and postdoctoral fellows to pursue teaching professional development, while leveraging the affordances of educational technologies and the geographically clustered nature of this target learner demographic. A total of 14,977 participants enrolled in seven offerings of the introductory course held 2014-2018, with 1,725 participants from approximately 60 countries completing at an average course completion rate of 13%. The preparation of future STEM faculty makes an important difference in establishing high-quality instruction that meets the diverse needs of all undergraduate students, and the initiative described here can serve as a model for increasing access to such preparation.

scientific communication and education↗
bioRxiv2022

Sexual health knowledge acquisition processes among very young adolescent girls in rural Malawi: Implications for sexual and reproductive health programs

Early adolescence is a period characterized by enormous biological, cognitive, sexual, emotional, and social changes. Sexual curiosity and the desire to acquire sexual health (SH) information are part of these developments. Understanding the SH knowledge acquisition process is critical for designing interventions that can best support very young adolescents (VYAs). This study explored the SH knowledge acquisition processes among VYA girls aged 10 to 14 years who attended the DREAMs Girl Only Clubs (GOCs) and those who did not. The GOCs were a part of a larger comprehensive HIV prevention project called DREAMS (Determined, Resilient, Empowered, AIDS-free, Mentored, and Safe) which provided an evidence-based core package of interventions to VYAs to prevent HIV. In-depth interviews were conducted with 43 VYA girls aged 10-14 years in two rural southern districts of Zomba and Machinga in Malawi. Twenty-three VYA girls were GOC participants and 20 VYAs were not. Guided by the Social Ecological Model, a thematic analysis approach was used to analyze the data with the assistance of Nvivo 12 software. The SH knowledge acquisition processes were the interaction of various factors at the microsystem (biological factors, attitudes), mesosystem (parents, older relatives, friends), and exosystem levels (schools and GOCs). Factors influencing this interaction included the beginning of menstruation, supportive parents/adults on SH issues, trust and confidentiality in SH information sources, and preference for well-informed sources of information. Compared to Non-GOC participants, GOC participants demonstrated an in-depth knowledge of SH issues, and positive sexual behaviors such as HIV testing. Limitations to SH knowledge acquisition were adult messages focus on sexual relationship avoidance and on girls who have started menstruation; perception of adults not being knowledgeable about SH and school teachers hiding some SH information. VYA SH interventions that provide VYA with accurate SH information such as the GOCs have the potential to address the limitations that other sources have in reaching VYAs. Integrating such interventions with empowering parents, other adults, and teachers with comprehensive SH information and with skills on how to deliver SH information to VYAs can enhance their SH knowledge acquisition and influence positive behavior change.

scientific communication and education↗