SRCS: Statistical Ranking Color Scheme for Visualizing Parameterized Multiple Pairwise Comparisons with R
Metadata
Show full item recordEditorial
The R Foundation
Materia
Statistical hypothesis testing Machine Learning
Date
2015-06-29Referencia bibliográfica
Villacorta, P. J. and Sáez, J.A. (2015) SRCS: Statistical Ranking Color Scheme for Visualizing Parameterized Multiple Pairwise Comparisons with R. The R Journal 7(2), 89-104
Sponsorship
Department of Computer Science and Artificial Intelligence, Universidad de GranadaAbstract
The problem of comparing a new solution method against existing ones to find statistically
significant differences arises very often in sciences and engineering. When the problem instance being
solved is defined by several parameters, assessing a number of methods with respect to many problem
configurations simultaneously becomes a hard task. Some visualization technique is required for
presenting a large number of statistical significance results in an easily interpretable way. Here we
review an existing color-based approach called Statistical Ranking Color Scheme (SRCS) for displaying
the results of multiple pairwise statistical comparisons between several methods assessed separately on
a number of problem configurations. We introduce an R package implementing SRCS, which performs
all the pairwise statistical tests from user data and generates customizable plots. We demonstrate
its applicability on two examples from the areas of dynamic optimization and machine learning, in
which several algorithms are compared on many problem instances, each defined by a combination of
parameters