Peer review, bibliometrics and altmetrics - Do we need them all?

Judit Bar-Ilan, Stefanie Haustein, Staša Milojević, Isabella Peters, Dietmar Wolfram

Research output: Contribution to journalReview articlepeer-review

10 Scopus citations

Abstract

This panel will present views and critical reflections on peer review, bibliometrics and altmetrics against the background of the latest developments and critique of the scientific system (e.g., replication crisis, DORA, open science, data manipulation). Peer review is the oldest form of monitoring the scientific process and research outcomes and is sometimes considered as the gold standard for evaluating quality. However, it also has its drawbacks; therefore, new forms of peer review are being explored. Bibliometrics, comparative statistics based on publication and citation counts, was introduced as a more objective evaluation method, which is applicable on meso and macro levels of research producing units but is not without problems either. Citation counts as a proxy of quality; the impact factor and the h-index are some of the most controversial subjects of research evaluation today. The newest addition to the evaluation toolbox are altmetrics, impact measures based mainly on social media activity. Altmetrics have pros and cons as well. None of the measuring devices is perfect, and rather than replacing they complement each other. By drawing on indicators from all three aspects of research evaluation, negative and adverse effects are limited.

Original languageEnglish
Pages (from-to)653-656
Number of pages4
JournalProceedings of the Association for Information Science and Technology
Volume55
Issue number1
DOIs
StatePublished - Jan 2018

Bibliographical note

Publisher Copyright:
Copyright © 2018 by Association for Information Science and Technology

Funding

This panel is sponsored by ASIS&T SIG/MET. Work presented by Judit Bar-Ilan is supported by EU COST Action TD1306 “New Frontiers of Peer Review” PEERE.

FundersFunder number
EU COSTTD1306

    Keywords

    • Peer review
    • altmetrics
    • bibliometrics
    • research evaluation

    Fingerprint

    Dive into the research topics of 'Peer review, bibliometrics and altmetrics - Do we need them all?'. Together they form a unique fingerprint.

    Cite this