Comment on Jepsen: TigerBeetle 0.16.11parentComments−nickpsecurity1yThe correctness bug was due to combinations of features. I'm curious if you've looked into combinatorial testing which NIST claimed knocks out almost all bugs when 6-way testing was used.https://csrc.nist.gov/projects/automated-combinatorial-testi...My intro to other categories of test generation was usually this paper:https://cs.stanford.edu/people/saswat/research/ASTJSS.pdfMaybe see of your team can build combinatorial- or path-based testing in Zig next.−nickpsecurity1yEdit to add 2019, NIST, intro slides on combinatorial testing since it's a better overview:https://csrc.nist.gov/CSRC/media/Projects/Automated-Combinat...−jorangreef1yThanks!
Comments
The correctness bug was due to combinations of features. I'm curious if you've looked into combinatorial testing which NIST claimed knocks out almost all bugs when 6-way testing was used.
https://csrc.nist.gov/projects/automated-combinatorial-testi...
My intro to other categories of test generation was usually this paper:
https://cs.stanford.edu/people/saswat/research/ASTJSS.pdf
Maybe see of your team can build combinatorial- or path-based testing in Zig next.
Edit to add 2019, NIST, intro slides on combinatorial testing since it's a better overview:
https://csrc.nist.gov/CSRC/media/Projects/Automated-Combinat...
Thanks!