diff options
| author | Aleksandr Nogikh <nogikh@google.com> | 2023-07-12 20:32:59 +0200 |
|---|---|---|
| committer | Aleksandr Nogikh <nogikh@google.com> | 2023-07-14 12:36:52 +0000 |
| commit | 35d9ecc508aef508b67ee7986a7abb0864e74f8e (patch) | |
| tree | 5b044a39374c6e3b7c91d14974b7abe1268d62b0 /executor | |
| parent | d624500f3877323fae8eb084872c5ef9a8ce3ef9 (diff) | |
pkg/bisect: estimate confidence in the result
Estimate reproducer's flakiness more carefully, as it can help us get
better results.
During config minimization, do not let reproducibility drop too low.
For each test() run, estimate our confidence in the result. For now,
only consider the false negative case: if we got no crashes, it's likely
that the bug is there, but the reproducer was not lucky enough. Given an
estimate of reproduction likelihood, we can easily calculate the chance
of an invalid result: (1-probability)^runs.
Combine all individual test() confidences into Result.Confidence. If the
resulting Confidence is too low, ignore the bisection result.
Diffstat (limited to 'executor')
0 files changed, 0 insertions, 0 deletions
