Re: Ci stability

2022-12-05 Thread Dan S
Thanks Colin, I have a draft PR open which I occasionally check on and disable the failing tests, I'll update it and see if it passes. Thanks, Daniel Scanteianu On Mon, Dec 5, 2022, 18:02 Colin McCabe wrote: > FYI, there was a memory leak that affected some of the tests which was > fixed recen

Re: Ci stability

2022-12-05 Thread Colin McCabe
FYI, there was a memory leak that affected some of the tests which was fixed recently, so hopefully stability will improve a bit. See KAFKA-14433 for details. best, Colin On Thu, Nov 24, 2022, at 12:48, John Roesler wrote: > Hi Dan, > > I’m not sure if there’s a consistently used tag, but I’ve

Re: Ci stability

2022-11-24 Thread John Roesler
Hi Dan, I’m not sure if there’s a consistently used tag, but I’ve gotten good mileage out of just searching for “flaky” or “flaky test” in Jira. If you’re thinking about filing a ticket for a specific test failure you’ve seen, I’ve also usually been able to find out whether there’s already a t

Re: Ci stability

2022-11-24 Thread Dan S
Thanks for the reply John! Is there a jira tag or view or something that can be used to find all the failing tests and maybe even try to fix them (even if fix just means extending a timeout)? On Thu, Nov 24, 2022, 16:03 John Roesler wrote: > Hi Dan, > > Thanks for pointing this out. Flaky test

Re: Ci stability

2022-11-24 Thread John Roesler
Hi Dan, Thanks for pointing this out. Flaky tests are a perennial problem. We knock them out every now and then, but eventually more spring up. I’ve had some luck in the past filing Jira tickets for the failing tests as they pop up in my PRs. Another thing that seems to motivate people is to op

Ci stability

2022-11-24 Thread Dan S
Hello all, I've had a pr that has been open for a little over a month (several feedback cycles happened), and I've never seen a fully passing build (tests in completely different parts of the codebase seemed to fail, often timeouts). A cursory look at open PRs seems to indicate that mine is not th