A Coverage Analysis of Java Benchmark Suites

S. Brown, Á. Mitchell, and J.F. Power (Ireland)


Benchmarking, software testing, dynamic analysis.


In this paper we study the relationship between results ob tainable from static and dynamic analysis of Java programs, and in particular the difficulties of correlating static and dy namic results. As a foundation for this study, we focus on various criteria related to run-time code coverage, as com monly used in test suite analysis. We have implemented a dynamic coverage analysis tool for Java programs, and we use it to evaluate several standard Java benchmark suites using line, instruction and branch coverage criteria. We present data indicating a con siderable variance in static and dynamic analysis results between these suites, and even between programs in these suites.

Important Links:

Go Back