Beyond Single Rankings: A Systematic Approach to Compare Multi-Criteria Decision Methods

Abstract

Scikit-Criteria is a library that has evolved into a powerful toolkit for discrete multi-criteria methods. In this paper, we present the RanksComparator tool, designed to compare and evaluate different rankings of alternatives generated by various methods applied to the same decision problem. This infrastructure provides statistical metrics and visualizations that allow users to assess the robustness of results, identify discrepancies between rankings, and effectively communicate similarities and differences between methods, thereby improving the transparency of the decision-making process.