roywei edited a comment on issue #15525: Nightly tests / integration tests in PRs are not tested before merging URL: https://github.com/apache/incubator-mxnet/issues/15525#issuecomment-510993342 - Nightly tests are supposed to fail and we can revert whichever PR caused it, other wise it's too costly to run even selected jobs only for PR validation, imagine each commit will trigger a big job. - Most of the time, when contributors are changing nightly test configurations and adding nightly tests, they test it anyway, it's not likely to fail. - Test tuorials is a special case as many people are contributing to tutorials. But most of them don't know they have to add any dependency package used in tutorial in CI docker file and warnings generated are considered as failure. That's most of the reasons for CI failure. To start with, without any new features been added to CI, maybe some way to enforce contributors to test locally before merging PR. (Having label bot to leave a message if nightly test change detected?)
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services