EQBENCH: A Dataset of Equivalent and Non-equivalent Program Pairs

Sahar Badihi, Yi Li, and Julia Rubin

In Proceedings of the 18th Mining Software Repositories Conference (MSR), 2021

Abstract: Equivalence checking techniques help establish whether two versions of a program exhibit the same behavior. The majority of popular techniques for formally proving/refuting equivalence are evaluated on small and simplistic benchmarks, omitting “difficult” programming constructs, such as non-lineararithmetic, loops, floating-point arithmetic, and string and array manipulation. This hinders efficient evaluation of these techniques and the ability to establish their practical applicability in real scenarios. This paper addresses this gap by contributing EQBENCH – the largest and most comprehensive benchmark for equivalence checking analysis, which contains 135 equivalent and 113 non-equivalent cases, in both C and Java languages. We envision that EQBENCH can facilitate a more realistic evaluation of equivalence checking techniques, assessing their individual strength and weaknesses. Moreover, this benchmark can be used to facilitate the evaluation of other software-maintenance-related techniques, such as clone and refactoring detection, change impact analysis, and automated test generation.

Cite:

@inproceedings{Badihi2021EAD,
  author = {Badihi, Sahar and Li, Yi and Rubin, Julia},
  booktitle = {Proceedings of the 18th Mining Software Repositories Conference (MSR)},
  month = may,
  pages = {610--614},
  title = {{EQBENCH}: A Dataset of Equivalent and Non-equivalent Program Pairs},
  year = {2021}
}