hachikuji opened a new pull request #10422:
URL: https://github.com/apache/kafka/pull/10422


   When a `@Property` tests fail, jqwik helpfully reports the initial seed that 
resulted in the failure. For example, if we are executing a test scenario 100 
times and it fails on the 51st run, then we will get the initial seed that 
generated . But if you specify the seed in the `@Property` annotation as the 
previous comment suggested, then the test still needs to run 50 times before we 
get to the 51st case, which makes debugging very difficult given the complex 
nature of the simulation tests. Jqwik also gives us the specific argument list 
that failed, but that is not very helpful at the moment since `Random` does not 
have a useful `toString` which indicates the initial seed. 
   
   To address these problems, I've changed the `@Property` methods to take the 
random seed as an argument directly so that it is displayed clearly in the 
output of a failure. I've also updated the documentation to clarify how to 
reproduce failures.
   
   ### Committer Checklist (excluded from commit message)
   - [ ] Verify design and implementation 
   - [ ] Verify test coverage and CI build status
   - [ ] Verify documentation (including upgrade notes)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Reply via email to