Is it any good wrt to Rank Difference?

[vivekaxl]

How to read

y-axis: Rank Difference
x-axis: Software System (randomly assigned)

Lower the better

[vivekaxl]

SQLite is a major outlier. In the figure shown below, the SQLite (SS11) is removed.

[timm]

I wish these y-axis were expressed in terms of percent of total configurations.

[timm]

why no "al" for e.g. ss22?

assuming that the reason is that it finds best config then:

• 15 examples where it does fine
• 5 examples otherwise

and even in the examples where it fucks up, it does not fuck up by much. even ss11 (which has 3.9 million options) you are within 140 of the best (and 140/3.9000,000= a small number)