[ https://issues.apache.org/jira/browse/IGNITE-5800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dmitriy Pavlov updated IGNITE-5800: ----------------------------------- Description: *Discussions* http://apache-ignite-developers.2346864.n4.nabble.com/Test-failures-td14353.html http://apache-ignite-developers.2346864.n4.nabble.com/Make-Teamcity-Green-Again-td19873.html *Goal* To allow community to grow more quickly and from the CI perspective, failing tests should be the main concern For Run All dependencies at Ignite 20 Tests http://ci.ignite.apache.org/project.html?projectId=Ignite20Tests&branch_Ignite20Tests=%3Cdefault%3E there should be no stable red suites. timed out suites and stable red tests. *Priorities* Following priorities are suggested for issues - Test suite timeout - it hides real test failures from us and wastes agent time - Stable failing test - 50-100% of failures - issue is to be created as blocked to the next release, test should be muted. - Flaky tests 1%-50% of failures, which are considered by teamcity as flaky may be not muted for now because TC interface helps us to identify these tests. *Scope* TBD by JIRA queries was: *Discussions* http://apache-ignite-developers.2346864.n4.nabble.com/Test-failures-td14353.html http://apache-ignite-developers.2346864.n4.nabble.com/Make-Teamcity-Green-Again-td19873.html *Goal* To allow community grow more quickly and from the CI perspective, failing tests should be the main concern For Run All dependencies at Ignite 20 Tests http://ci.ignite.apache.org/project.html?projectId=Ignite20Tests&branch_Ignite20Tests=%3Cdefault%3E there should be no stable red suites. timed out suites and stable red tests. *Priorities* Following priorities are suggested for issues - Test suite timeout - it hides real test failures from us and wastes agent time - Stable failing test - 50-100% of failures - issue is to be created as blocked to the next release, test should be muted. - Flaky tests 1%-50% of failures, which are considered by teamcity as flaky may be not muted for now because TC interface helps us to identify these tests. *Scope* TBD by JIRA queries > Umbrella ticket for making Teamcity Green Again > ----------------------------------------------- > > Key: IGNITE-5800 > URL: https://issues.apache.org/jira/browse/IGNITE-5800 > Project: Ignite > Issue Type: Wish > Reporter: Dmitriy Pavlov > Assignee: Dmitriy Pavlov > > *Discussions* > http://apache-ignite-developers.2346864.n4.nabble.com/Test-failures-td14353.html > http://apache-ignite-developers.2346864.n4.nabble.com/Make-Teamcity-Green-Again-td19873.html > *Goal* > To allow community to grow more quickly and from the CI perspective, failing > tests should be the main concern > For Run All dependencies at Ignite 20 Tests > http://ci.ignite.apache.org/project.html?projectId=Ignite20Tests&branch_Ignite20Tests=%3Cdefault%3E > there should be no stable red suites. timed out suites and stable red tests. > *Priorities* > Following priorities are suggested for issues > - Test suite timeout - it hides real test failures from us and wastes agent > time > - Stable failing test - 50-100% of failures - issue is to be created as > blocked to the next release, test should be muted. > - Flaky tests 1%-50% of failures, which are considered by teamcity as flaky > may be not muted for now because TC interface helps us to identify these > tests. > *Scope* > TBD by JIRA queries -- This message was sent by Atlassian JIRA (v6.4.14#64029)