Dr. Rodolfo Barrere, III Congreso Internacional de Epistemología y Metodología

Value of the Information & Strength of the Argument

The presentation offers valuable insights into the construction and misuse of rankings, drawing on the speaker’s professional expertise. The argumentation is coherent and well-structured, systematically deconstructing the assumptions behind rankings. Barrere effectively demonstrates that rankings are not objective but are shaped by subjective choices in indicator selection and weighting. He provides concrete examples, such as the Shanghai ranking’s criteria, to illustrate his points. The talk is persuasive in arguing for a more critical and context-aware approach to quantitative indicators. However, the argumentation is primarily based on the speaker’s authority and experience rather than on empirical evidence or formal citations, which slightly weakens its scientific rigor.

Scientific Rigor, Source Quality, Title Accuracy

The presentation demonstrates scientific rigor in its logical reasoning and use of examples, but it lacks explicit citations to academic literature or detailed methodological references. The speaker mentions specific rankings (e.g., Shanghai, Global Innovation Index) and a newspaper article (Clarín), but does not provide formal references. The title accurately reflects the content, as it is a talk delivered at an epistemology and methodology congress. The talk is well-structured and stays on topic, fulfilling the expectations set by the title.

The title accurately reflects the content: a presentation by Dr. Rodolfo Barrere at an epistemology and methodology congress.

7/10

The speaker is an expert in science and technology indicators, providing a well-structured critique of rankings. The talk is based on professional experience and references specific rankings, but lacks formal citations or peer-reviewed sources.

Markers derived by PSI from the transcript: the creator did not define chapters.

• 00:00Introduction: speaker introduces his work on science and technology indicators.
• 03:00Definition of rankings and their growing popularity.
• 06:00Explanation of the value model behind rankings, using Shanghai ranking as example.
• 09:00Discussion of the problems with rankings: loss of information, false simplicity, and media amplification.
• 12:00Analysis of the Pareto principle and its impact on ranking differences.
• 15:00Critique of the quantification of quality and the imposition of a single value model.
• 18:00Conclusion: call for contextual and careful use of quantitative indicators.

• Shanghai Ranking (ARWU) — Mentioned as an example of a university ranking with specific criteria.
• Global Innovation Index — Cited as an example of a ranking with many indicators.

• The Leiden Manifesto for research metrics — Aligns with the talk's critique of simplistic metrics and calls for contextual evaluation.

• Rankings as a tool for quality assurance — Some argue that rankings provide useful comparative information for students and policymakers, a perspective not fully addressed in the talk.