[ https://issues.apache.org/jira/browse/GEODE-5417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16540542#comment-16540542 ]
Dan Smith commented on GEODE-5417: ---------------------------------- Here is the most recent list of failures from concourse: org.apache.geode.tools.pulse.tests.ui.PulseAutomatedTest.clickServGrpGridButtonShowsGridTest: 1 failures (98.9795918367347% success rate) Failed build 144 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/144 org.apache.geode.tools.pulse.tests.ui.PulseAutomatedTest.testClusterAverageReadsWidget: 1 failures (98.9795918367347% success rate) Failed build 141 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/141 org.apache.geode.tools.pulse.tests.ui.PulseNoAuthTest.testClusterNumSubscriptions: 1 failures (98.9795918367347% success rate) Failed build 141 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/141 org.apache.geode.tools.pulse.tests.ui.PulseAutomatedTest.testDataBrowserColocatedRegions: 1 failures (98.9795918367347% success rate) Failed build 136 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/136 org.apache.geode.tools.pulse.ui.PulseAcceptanceAuthTest.testDropDownList: 2 failures (97.95918367346938% success rate) Failed build 133 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/133 Failed build 67 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/67 org.apache.geode.tools.pulse.tests.ui.PulseAutomatedTest.clickRZGridMembersNavigationTest: 2 failures (97.95918367346938% success rate) Failed build 131 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/131 Failed build 63 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/63 org.apache.geode.tools.pulse.tests.ui.PulseAuthTest.testClusterGridViewCPUUsage: 2 failures (97.95918367346938% success rate) Failed build 127 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/127 Failed build 51 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/51 org.apache.geode.tools.pulse.tests.ui.PulseNoAuthTest.testRegionViewTreeMapPopUpData: 1 failures (98.9795918367347% success rate) Failed build 125 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/125 org.apache.geode.tools.pulse.tests.ui.PulseAuthTest.testClusterGridViewMemberName: 2 failures (97.95918367346938% success rate) Failed build 124 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/124 Failed build 123 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/123 org.apache.geode.tools.pulse.tests.ui.PulseAutomatedTest.testSortingUsingHeapUsageOnRedundancyView: 1 failures (98.9795918367347% success rate) Failed build 123 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/123 org.apache.geode.tools.pulse.tests.ui.PulseAutomatedTest.testClusterNumSubscriptions: 1 failures (98.9795918367347% success rate) Failed build 123 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/123 org.apache.geode.tools.pulse.tests.ui.PulseAutomatedTest.clickRZGridShowingGridTest: 2 failures (97.95918367346938% success rate) Failed build 120 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/120 Failed build 78 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/78 org.apache.geode.tools.pulse.tests.ui.PulseAutomatedTest.clickTreeMapViewShowingTreeMapTest: 1 failures (98.9795918367347% success rate) Failed build 105 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/105 org.apache.geode.tools.pulse.ui.PulseAcceptanceAuthTest.testClusterDetailsAndWidgets: 1 failures (98.9795918367347% success rate) Failed build 98 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/98 org.apache.geode.tools.pulse.tests.ui.PulseAuthTest.testClusterMemberCount: 1 failures (98.9795918367347% success rate) Failed build 98 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/98 org.apache.geode.tools.pulse.ui.PulseAcceptanceNoAuthTest.testClusterDetailsAndWidgets: 1 failures (98.9795918367347% success rate) Failed build 91 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/91 org.apache.geode.tools.pulse.tests.ui.PulseAutomatedTest.regionType: 1 failures (98.9795918367347% success rate) Failed build 86 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/86 org.apache.geode.tools.pulse.tests.ui.PulseAutomatedTest.testClusterGridViewMemberID: 1 failures (98.9795918367347% success rate) Failed build 86 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/86 org.apache.geode.tools.pulse.tests.ui.PulseAuthTest.testClusterNumRunningFunction: 2 failures (97.95918367346938% success rate) Failed build 81 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/81 Failed build 53 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/53 org.apache.geode.tools.pulse.ui.PulseAcceptanceNoAuthTest.testRegionViewTreeMapPopUpData: 1 failures (98.9795918367347% success rate) Failed build 69 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/69 org.apache.geode.tools.pulse.tests.ui.PulseNoAuthTest.testClusterRegionCount: 1 failures (98.9795918367347% success rate) Failed build 69 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/69 org.apache.geode.tools.pulse.tests.ui.PulseAuthTest.testClusterGridViewMemberID: 1 failures (98.9795918367347% success rate) Failed build 67 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/67 org.apache.geode.tools.pulse.tests.ui.PulseAutomatedTest.clickOnGridMemNameNavigatingToCorrespondingRegionTest: 1 failures (98.9795918367347% success rate) Failed build 63 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/63 org.apache.geode.tools.pulse.tests.ui.PulseAutomatedTest.testDataViewTreeMapPopUpData: 1 failures (98.9795918367347% success rate) Failed build 63 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/63 org.apache.geode.tools.pulse.ui.PulseAcceptanceAuthTest.testDataViewTreeMapPopUpData: 1 failures (98.9795918367347% success rate) Failed build 58 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/58 org.apache.geode.tools.pulse.ui.PulseAcceptanceNoAuthTest.testDropDownList: 1 failures (98.9795918367347% success rate) Failed build 58 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/58 org.apache.geode.tools.pulse.tests.ui.PulseAutomatedTest.verifySortingOptionsTest: 1 failures (98.9795918367347% success rate) Failed build 58 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/58 org.apache.geode.tools.pulse.tests.ui.PulseNoAuthTest.testClusterGridViewMemberHost: 1 failures (98.9795918367347% success rate) Failed build 58 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/58 org.apache.geode.tools.pulse.tests.ui.PulseAutomatedTest.regionEmptyNodes: 1 failures (98.9795918367347% success rate) Failed build 52 at https://concourse.apachegeode-ci.info/teams/main/pipelines/develop/jobs/UITests/builds/52 > All UITest tests are flaky and failing in CI > -------------------------------------------- > > Key: GEODE-5417 > URL: https://issues.apache.org/jira/browse/GEODE-5417 > Project: Geode > Issue Type: Bug > Components: pulse, tests > Reporter: Dan Smith > Priority: Major > Labels: swat > > All of these tests with the UITest category seem to be flaky, with the > exception of those that extend BaseServiceTest. I've attached the results of > the metrics job against the current concourse pipeline with 144 runs. > We should fix the systematic failures in these tests, or replace/remove them > if we have coverage elsewhere. -- This message was sent by Atlassian JIRA (v7.6.3#76005)