Beyond Metrics: Catalyzing Responsible Assessment for Open Science

Research assessment systems have traditionally relied on journal-based metrics, such as the Journal Impact Factor, which inadequately capture the diverse contributions of research and researchers, which hinder the recognition of the full spectrum of academic work, including open science practices. Traditional assessment practices are not contributing to the progress of open scholarship.
The San Francisco Declaration on Research Assessment (DORA) originated from the scientific community's concern about the misuse of journal-based metrics like the Journal Impact Factor to evaluate research quality. The resulting declaration offered 18 recommendations for a transparent assessment of research quality and impact, not quantity or publication venue. DORA has become a global movement with over 26,000 signatories across 166+ countries. This international initiative now actively supports institutional change in research assessment.
In this presentation, we would like to share how responsible research assessment and open scholarship connect and how people can advance it wherever they are in the knowledge system. It will showcase DORA's resources and initiatives, such as practical guidance, narrative CV formats, the Reformscape database of institutional policies, and community engagement efforts through workshops and discussion groups. These tools and collaborative approaches help research performing organizations and funders evaluate diverse outputs like data, code, and protocols, aligning with the open science values of transparency and broader societal impact. The aim is to stimulate discussion and promote practical steps towards a more equitable, transparent, and effective research landscape, resonating with the conference's goal to facilitate idea exchange and promote collaborations for advancing Open Science.