Ranking methods based on the dominance degree. An investigation of rank reversal

[en] Multi-criteria decision making methods have been used in many applications to derive a ranking of objects evaluated on several criteria. In case these evaluations are imprecise, integrating imprecision in the overall assessment is a further issue. In this paper, we deal with imprecise evaluations in the form of intervals. Therefore, the problem is to rank multi-dimensional interval data. In recent years, a scoring method using the dominance degree has been proposed in order to rank interval data. This index is ordinal in the sense that it takes only into account the ordering of the endpoints of the evaluation intervals. It is computed by considering the evaluations of all the other objects to be ranked. This implies that the dominance degree, hence the ranking, may change when the set of objects to be ranked is altered. This phenomenon is known as rank reversal in the literature. We analyze the occurrence of rank reversal when we remove an object from (or add one to) the set of objects to be ranked. We introduce variants of the dominance degree rule and analyze them similarly. This is done both analytically and by simulation. We then compare the dominance degree approach with an adaptation of the Borda rule. We also examine how the presence of a set of reference points can reduce the rank reversal phenomenon and enhance the discrimination power of the method.

Research center :

CRTI - Centre de Recherche en Technologie de l'Information

Disciplines :

Computer science
Mathematics

Author, co-author :

Kerboui, Roumeissa ; USTHB, Faculty of Mathematics, AMCD & RO, Algiers, Algeria

Abbas, Moncef; USTHB, Faculty of Mathematics, AMCD & RO, Algiers, Algeria

PIRLOT, Marc ; Université de Mons - UMONS > Faculté Polytechnique > Service de Mathématique et Recherche opérationnelle

Language :

English

Title :

Ranking methods based on the dominance degree. An investigation of rank reversal

Publication date :

November 2025

Journal title :

Computers and Operations Research

ISSN :

0305-0548

Publisher :

Elsevier BV

Volume :

183

Pages :

107196

Peer reviewed :

Peer reviewed

Additional URL :

https://api.elsevier.com/content/article/PII:S0305054825002242?httpAccept=text/xml

Research unit :

Mathematics and Operational Research

Research institute :

Infortech

Available on ORBi UMONS :

since 24 August 2025

Statistics

Number of views

89 (3 by UMONS)

Number of downloads

0 (0 by UMONS)

More statistics

Scopus citations^®

Scopus citations^®
without self-citations

OpenCitations

OpenAlex citations

Bibliography

Abbas, M., Chergui, Z., The impact of using new significant reference point with TOPSIS methods: study and application. Int. J. Inf. Decis. Sci. 11:2 (2019), 95–115.
Aiche, F., Abbas, M., Dubois, D., Chance-constrained programming with fuzzy stochastic coefficients. Fuzzy Optim. Decis. Mak. 12:2 (2013), 125–152.
Arrow, K.J., Social Choice and Individual Values. second ed., 1963, Wiley, New York.
Belahcène, K., Mousseau, V., Ouerdane, W., Pirlot, M., Sobrie, O., Ranking with multiple reference points: Efficient SAT-based learning procedures. Comput. Oper. Res., 150, 2023, 106054.
Belton, V., Gear, T., On a short-coming of Saaty's method of analytic hierarchies. Omega 11:3 (1983), 228–230.
Belton, V., Stewart, T., Multiple Criteria Decision Analysis: An Integrated Approach. 2001, Kluwer, Dordrecht.
Bouyssou, D., Ranking methods based on valued preference relations: A characterization of the net flow method. European J. Oper. Res. 60:1 (1992), 61–67.
Bouyssou, D., Dubois, D., Prade, H., Pirlot, M., Decision Making Process: Concepts and Methods ISTE, 2009, Wiley.
Bouyssou, D., Marchant, Th., An axiomatic approach to noncompensatory sorting methods in MCDM, I: The case of two categories. European J. Oper. Res. 178:1 (2007), 217–245.
Bouyssou, D., Marchant, Th., An axiomatic approach to noncompensatory sorting methods in MCDM, II: More than two categories. European J. Oper. Res. 178:1 (2007), 246–276.
Bouyssou, D., Marchant, T., Multiattribute preference models with reference points. European J. Oper. Res. 229:2 (2013), 470–481.
Bouyssou, D., Marchant, T., Pirlot, M., A theoretical look at ElectreTri-nB and related sorting models. 4OR 21:1 (2023), 1–31.
Bouyssou, D., Marchant, T., Pirlot, M., Tsoukiàs, A., Vincke, Ph., Evaluation and decision models with multiple criteria: Stepping stones for the analyst. 2006, Springer-Verlag, New York.
Bouyssou, D., Pirlot, M., A consolidated approach to the axiomatization of outranking relations: a survey and new results. Ann. Oper. Res. 229:1 (2015), 159–212.
Brans, J.-P., De Smet, Y., PROMETHEE methods. Greco, S., Ehrgott, M., Figueira, J.R., (eds.) Multiple Criteria Decision Analysis: State of the Art Surveys, 2016, Springer New York, New York, NY, 187–219.
Brans, J.-P., Vincke, Ph., A preference ranking organisation method. (The PROMETHEE method for multiple criteria decision-making). Manag. Sci. 31:6 (1985), 647–656.
Chen, P.-Y., Hong, Y., Liu, Y., The value of multidimensional rating systems: Evidence from a natural experiment and randomized experiments. Manag. Sci. 64:10 (2018), 4629–4647.
Condorcet, M.J.A.N., Essai sur l'application de l'analyse à la probabilité des décisions rendues à la pluralité des voix. 1785, Imprimerie Royale, Paris.
de Borda, J.-Ch., Mémoire sur les élections au scrutin, 44, 1781, Comptes Rendus de l'Académie des Sciences, Paris, 42–51 Translated by Alfred de Grazia as “Mathematical derivation of an election system”,Isis.
Dyer, J.S., Remarks on the Analytic Hierarchy Process. Manag. Sci. 36:3 (1990), 249–258.
Eppe, S., De Smet, Y., 2017. On the Influence of Altering the Action Set on PROMETHEE II's Relative Ranks. In: Evolutionary Multi-Criterion Optimization - 9th International Conference, EMO 2017, MÜnster, Germany, March 19-22, 2017, Proceedings. pp. 206–220.
Figueira, J.R., Mousseau, V., Roy, B., ELECTRE methods. Greco, S., Ehrgott, M., Figueira, J.R., (eds.) Multiple Criteria Decision Analysis: State of the Art Surveys, second ed., 2016, Springer, NY, 155–185.
Fishburn, P.C., The Theory of Social Choice. 1973, Princeton University Press, Princeton.
Fishburn, P.C., Interval representations for interval orders and semiorders. J. Math. Psych. 10 (1973), 91–105.
Fishburn, P.C., Interval Orders and Interval Graphs. 1985, J. Wiley, New York.
Garcìa-Cascales, M.S., Lamata, M.T., On rank reversal and TOPSIS method. Math. Comput. Modelling 56:5–6 (2012), 123–132.
Gehrlein, W.V., Condorcet's paradox. Theory and Decision 15:2 (1983), 161–197.
Giakoumakis, V., Monjardet, B., Coefficients d'accord entre deux préordres totaux. Stat. Anal. Des Données 12:1–2 (1987), 46–99.
Greco, S., Matarazzo, B., Słowinski, R., Rough sets theory for multicriteria decision analysis. European J. Oper. Res. 129:1 (2001), 1–47.
Hwang, C.L., Yoon, K., Multiple Attribute Decision Making: Methods and Applications. 1981, Springer-Verlag.
Insua, D.R., French, S., A framework for sensitivity analysis in discrete multi-objective decision-making. European J. Oper. Res. 54:2 (1991), 176–190.
Jahan, A., Edwards, K.L., A state-of-the-art survey on the influence of normalization techniques in ranking: Improving the materials selection process in engineering design. Mater. Des. 65 (2015), 335–342.
Keeney, R.L., Raiffa, H., Decisions with multiple objectives: Preferences and value tradeoffs. 1976, Wiley, New York.
Khannoussi, A., Olteanu, A-L., Labreuche, C., Meyer, P., Simple ranking method using reference profiles: incremental elicitation of the preference parameters. 4OR 20:3 (2022), 499–530.
Khannoussi, A., Olteanu, A-L., Meyer, P., Pasdeloup, B., A metaheuristic for inferring a ranking model based on multiple reference profiles. Ann. Math. Artif. Intell. 92:6 (2024), 1467–1488.
Kizielewicz, B., Shekhovtsov, A., Wieckowski, J., Watróbski, J., Sałabun, W., The compromise-COMET method for identifying an adaptive multi-criteria decision model. IEEE Access 12 (2024), 157083–157106.
Klir, G.J., Folger, T.A., Fuzzy Sets, Uncertainty and Information. 1988, Prentice Hall, Englewood Cliffs, NJ.
Krantz, D.H., Luce, R.D., Suppes, P., Tversky, A., Foundations of measurement. 1: Additive and Polynomial Representations. 1971, Academic Press, New York.
Maleki, H., Zahir, S., A comprehensive literature review of the rank reversal phenomenon in the Analytic Hierarchy Process. J. Multi Criteria Decis. Anal., 2012.
Olteanu, A-L., Belahcène, K., Mousseau, V., Ouerdane, W., Rolland, A., Zheng, J., Preference elicitation for a ranking method based on multiple reference profiles. 4OR 20:1 (2022), 63–84.
Qian, Y., Liang, J., Dang, C., Interval ordered information systems. Comput. Math. Appl. 56:8 (2008), 1994–2009.
Rolland, A., Reference-based preferences aggregation procedures in multi-criteria decision making. European J. Oper. Res. 225:3 (2013), 479–486.
Roy, B., Classement et choix en présence de points de vue multiples (la méthode ELECTRE). RIRO 2:8 (1968), 57–75.
Roy, B., 1996. Multicriteria Methodology for Decision Aiding. Dordrecht, Kluwer, Original version in French: Méthodologie multicritère d'aide la décision, Economica, Paris, 1985.
Roy, B., Bouyssou, D., Aide multicritère à la décision: méthodes et cas. 1993, Economica, Paris.
Saari, D.G., Selecting a voting method: the case for the Borda count. Const. Politi. Econ. 34:3 (2022), 357–366.
Saaty, T.L., The Analytic Hierarchy Process, Planning, Priority Setting, Resource Allocation. 1980, McGraw-Hill, New york.
Sałabun, W., The characteristic objects method: A new distance-based approach to multicriteria decision-making problems. J. Multi Criteria Decis. Anal. 22:1–2 (2015), 37–50.
Sałabun, W., Karczmarczyk, A., Watróbski, J., Jankowski, J., Handling data uncertainty in decision making with COMET. IEEE Symposium Series on Computational Intelligence, SSCI 2018, Bangalore, India, November 18-21, 2018, 2018, IEEE, 1478–1484.
Song, P., Liang, J., Qian, Y., A two-grade approach to ranking interval data. Knowl.-Based Syst. 27 (2012), 234–244.
Stewart, T.J., Durbach, I., Dealing with uncertainties in MCDA. Greco, S., Ehrgott, M., Figueira, J.R., (eds.) Multiple Criteria Decision Analysis: State of the Art Surveys, 2016, Springer New York, New York, NY, 467–496.
Triantaphyllou, E., Two new cases of rank reversals when the AHP and some of its additive variants are used that do not occur with the multiplicative AHP. J. Multi Criteria Decis. Anal. 10:1 (2001), 11–25.
Verly, C., De Smet, Y., Some results about rank reversal instances in the PROMETHEE methods. Int. J. Multicrit. Decis. Mak. 3:4 (2013), 325–345.
Vincke, Ph., 1992. Multi-criteria Decision Aid. Wiley, New York, Original version in French: “L'aide multicritère à la décision”, Éditions de l'Université libre de Bruxelles Éditions Ellipses, Brussels, 1989.
von Winterfeldt, D., Edwards, W., Decision Analysis and Behavioral Research. 1986, Cambridge University Press, Cambridge.
Wang, X., Triantaphyllou, E., Ranking irregularities when evaluating alternatives by using some ELECTRE methods. Omega 36:1 (2008), 45–63.
Xu, Z., Uncertain Multi-Attribute Decision Making: Methods and Applications. 2015, Springer.