Losing objectivity: The questionable use of surveys in the Global Ranking of Academic Subjects Herrera-Viedma, Enrique Arroyo-Machado, Wenceslao Torres-Salinas, Daniel Academic Ranking of World Universities Global Ranking of Academic Subjects journals The Academic Ranking of World Universities (ARWU) is one of the most well-known university rankings, recognized for its objective and reproducible methodology. In contrast, the Global Ranking of Academic Subjects (GRAS), which ranks institutions by scientific subjects and is also elaborated by Shanghai Ranking Consultancy (SRC), introduces methodological differences that deviate from the ARWU’s objectivity. This is due to the use of SRC’s Academic Excellence Survey to define two of the GRAS’s five indicators. Specifically, the Top indicator counts publications in journals determined by respondents as top tier in their field, and the Award indicator does the same for prizes. An examination of this survey suggests the presence of potential biases, especially in participant selection and journal identification, among which an Anglo-Saxon bias is prominently evident. Likewise, there is a potential risk that the selection of journals in some cases may be influenced, potentially masking conflicts of interest, such as involvement in editorial committees that could sway this selection. As a result, relying on surveys instead of adhering to established bibliometric standards can lead to inconsistencies and subjectivity, especially if not rigorously conducted. Such methodologies pose a risk to the trustworthiness of tools crucial for university policymaking. 2024-07-31T07:41:06Z 2024-07-31T07:41:06Z 2024-05-01 journal article Herrera Viedma, E. & Arroyo Machado, W. & Torres Salinas, D. Quantitative Science Studies (2024) 5 (2): 484–486. [https://doi.org/10.1162/qss_c_00289] https://hdl.handle.net/10481/93667 10.1162/qss_c_00289 eng http://creativecommons.org/licenses/by/4.0/ open access Atribución 4.0 Internacional MIT Press Direct