Re: [DISCUSS] Test monitoring process and rotation

2016-10-04 Thread Li Li
The current test status is actually a very important factor to explain why the monitoring process and rotation is necessary, and help to decide how the monitoring process should be. Also does it include both the master and feature branch (e.g. sentry-ha-redesign)? On Tue, Oct 4, 2016 at 1:55 PM,

Re: [DISCUSS] Test monitoring process and rotation

2016-10-04 Thread Sravya Tirukkovalur
That is exactly why I think a process might be useful. I dont believe we have a clear way to answer that question of "What is the current test status? What are current known issues? And how are we making progress towards no flakyness?" At least not that I know of. One of us can spend some time loo

Re: [DISCUSS] Test monitoring process and rotation

2016-10-04 Thread Li Li
It is better if we can get some idea about the current test status, like how many known or unknown flaky tests, which tests are disabled and with what reason, any existing jiras tracking these failure tests. Also does it include both the master and feature branch? On Tue, Oct 4, 2016 at 1:28 PM,

[DISCUSS] Test monitoring process and rotation

2016-10-04 Thread Sravya Tirukkovalur
Hi all, As the project grows, I think it might be useful to have a process and rotation of responsibility on how we maintain the health of test runs which is a crucial piece in project health. I documented a draft of the process, please provide your inputs if you think it would be useful also ple