<abstract xmlns="http://www.w3.org/1999/xhtml"><p>In this note, we propose a game-theoretic approach for benchmarking computational problems and their solvers. The approach takes an assessment matrix as a payoff matrix for some zero-sum matrix game in which the first player chooses a problem and the second player chooses a solver. The solution in mixed strategies of this game is used to construct a notionally objective ranking of the problems and solvers under consideration. The proposed approach is illustrated in terms of an example to demonstrate its viability and its suitability for applications.</p></abstract>

In this note, we propose a game-theoretic approach for benchmarking computational problems and their solvers. The approach takes an assessment matrix as a payoff matrix for some zero-sum matrix game in which the first player chooses a problem and the second player chooses a solver. The solution in mixed strategies of this game is used to construct a notionally objective ranking of the problems and solvers under consideration. The proposed approach is illustrated in terms of an example to demonstrate its viability and its suitability for applications.

Benchmarking of Problems and Solvers: a Game-Theoretic Approach

Foundations of Computing and Decision Sciences

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.

{"article-title":"Benchmarking of Problems and Solvers: a Game-Theoretic Approach"}

In this note, we propose a game-theoretic approach for benchmarking computational problems and their solvers. The approach takes an assessment matrix as a...

Benchmarking of Problems and Solvers: a Game-Theoretic Approach

Published Online: Jun 06, 2019

Page range: 137 - 150

Received: Jul 18, 2018

Accepted: Jan 14, 2019

DOI: https://doi.org/10.2478/fcds-2019-0008

Keywords
benchmarking, software, solvers, problems, testing, multi objective decision-making problem

© 2019 Joseph Gogodze, published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.

Benchmarking of Problems and Solvers: a Game-Theoretic Approach

Published Online: Jun 06, 2019

Page range: 137 - 150

Received: Jul 18, 2018

Accepted: Jan 14, 2019

DOI: https://doi.org/10.2478/fcds-2019-0008

Keywordsbenchmarking, software, solvers, problems, testing, multi objective decision-making problem

© 2019 Joseph Gogodze, published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.

Keywords
benchmarking, software, solvers, problems, testing, multi objective decision-making problem