Thanks Erick. I'm working on fixing TestWithCollection so please do not BadApple it this week.
On Tue, Aug 28, 2018 at 1:04 AM Erick Erickson <[email protected]> wrote: > On the plus side, the CDCR tests (except BiDir) seem to be fixed. > > Also on the plus side, there are quite a number of tests that have > _not_ failed in the last 4 weeks and I'll un-annotate. > > On the minus side, TestPolicy has 39 tests that have failed at least > once in the last 4 weeks. I'll beast this to try to produce some data > as I hope that there's a single underlying cause. > > **Annotated tests/suites that didn't fail in the last 4 weeks. > > **Annotations will be removed from the following tests because they > haven't failed in the last 4 rollups. > > **Methods: 30 > CollectionsAPIAsyncDistributedZkTest.testAsyncIdRaceCondition > DistributedMLTComponentTest.test > GraphExpressionTest.testShortestPathStream > LargeVolumeJettyTest > LeaderElectionIntegrationTest.testSimpleSliceLeaderElection > MathExpressionTest.testDistributions > MoveReplicaHDFSTest.testNormalFailedMove > SchemaApiFailureTest.testAddTheSameFieldTwice > SearchRateTriggerTest.testTrigger > TestDelegationWithHadoopAuth.testDelegationTokenRenew > TestDistribIDF.testMultiCollectionQuery > TestDocTermOrdsUninvertLimit.testTriggerUnInvertLimit > TestManagedResourceStorage > TestSimExecutePlanAction.testExecute > TestSimGenericDistributedQueue > TestSimGenericDistributedQueue.testDistributedQueue > TestSimLargeCluster.testAddNode > TestSimLargeCluster.testBasic > TestSimLargeCluster.testNodeLost > TestSimTriggerIntegration.testCooldown > TestSimTriggerIntegration.testEventFromRestoredState > TestSimTriggerIntegration.testEventQueue > TestSimTriggerIntegration.testListeners > TestSimTriggerIntegration.testNodeAddedTrigger > TestSimTriggerIntegration.testNodeAddedTriggerRestoreState > TestSimTriggerIntegration.testNodeLostTrigger > TestSimTriggerIntegration.testNodeLostTriggerRestoreState > TestSimTriggerIntegration.testNodeMarkersRegistration > TestSimTriggerIntegration.testTriggerThrottling > TestStressCloudBlindAtomicUpdates.test_dv_idx > > **Suites: 0 > > > ********Failures in Hoss' reports for the last 4 rollups. > > There were 571 unannotated tests that failed in Hoss' rollups. Ordered > by the date I downloaded the rollup file, newest->oldest. See above > for the dates the files were collected > These tests were NOT BadApple'd or AwaitsFix'd > All tests that failed 4 weeks running will be BadApple'd unless there > are objections > > Failures in the last 4 reports.. > Report Pct runs fails test > 0123 0.7 1749 8 > CdcrBootstrapTest.testBootstrapWithContinousIndexingOnSourceCluster > 0123 1.6 1751 18 CustomHighlightComponentTest.test > 0123 0.5 1582 8 > DeleteReplicaTest.deleteReplicaFromClusterState > 0123 42.9 101 14 HdfsBasicDistributedZk2Test.test > 0123 1.4 1741 21 JdbcTest(suite) > 0123 10.3 96 6 > LIROnShardRestartTest.testAllReplicasInLIR > 0123 1.8 1801 29 LeaderVoteWaitTimeoutTest.basicTest > 0123 1.8 1602 32 > LeaderVoteWaitTimeoutTest.testMostInSyncReplicasCanWinElection > 0123 4.8 849 46 MoveReplicaHDFSTest.testFailedMove > 0123 4.5 1515 40 SchemaApiFailureTest(suite) > 0123 0.7 1741 14 StreamingTest(suite) > 0123 0.2 1764 11 StreamingTest.testParallelMergeStream > 0123 0.2 1764 4 > StreamingTest.testZeroParallelReducerStream > 0123 0.5 1729 14 SystemLogListenerTest.test > 0123 0.2 1537 4 > TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader > 0123 0.2 1770 21 > TestCollectionStateWatchers.testCanWaitForNonexistantCollection > 0123 0.2 1770 21 > TestCollectionStateWatchers.testDeletionsTriggerWatches > 0123 0.2 1770 11 > TestCollectionStateWatchers.testWaitForStateChecksCurrentState > 0123 5.8 286 9 TestLargeCluster.testBasic > 0123 2.3 286 35 TestLargeCluster.testNodeLost > 0123 4.9 1674 40 TestLargeCluster.testSearchRate > 0123 1.4 1803 35 > TestPolicy.testComputePlanAfterNodeAdded > 0123 1.4 1802 34 TestPolicy.testConditionsSort > 0123 1.4 1803 35 TestPolicy.testCoresSuggestions > 0123 1.4 1800 32 TestPolicy.testDiskSpaceHint > 0123 2.5 1808 40 TestPolicy.testDiskSpaceReqd > 0123 1.4 1806 38 TestPolicy.testEmptyClusterState > 0123 2.5 1809 41 TestPolicy.testEqualFunction > 0123 1.8 1805 37 TestPolicy.testFreeDiskSuggestions > 0123 2.5 1805 37 TestPolicy.testFreediskPercentage > 0123 1.8 1805 37 TestPolicy.testGreedyConditions > 0123 1.4 1804 36 TestPolicy.testMerge > 0123 1.4 1805 37 TestPolicy.testMoveReplica > 0123 2.5 1811 43 TestPolicy.testMoveReplicaSuggester > 0123 1.8 1803 35 > TestPolicy.testMoveReplicasInMultipleCollections > 0123 1.4 1803 35 TestPolicy.testMultiReplicaPlacement > 0123 1.4 1804 36 TestPolicy.testMultipleCollections > 0123 1.4 1802 34 TestPolicy.testNegativeConditions > 0123 1.8 1801 33 TestPolicy.testNodeLost > 0123 1.4 1804 36 TestPolicy.testNodeLostMultipleReplica > 0123 1.4 1805 37 TestPolicy.testOperands > 0123 1.4 1803 35 TestPolicy.testOtherTag > 0123 1.4 1804 36 TestPolicy.testPolicyWithReplicaType > 0123 1.8 1800 32 TestPolicy.testPortSuggestions > 0123 1.8 1805 37 TestPolicy.testReplicaCountSuggestions > 0123 1.4 1805 37 TestPolicy.testReplicaPercentage > 0123 1.4 1801 33 TestPolicy.testReplicaZonesPercentage > 0123 1.4 1801 33 TestPolicy.testRow > 0123 1.4 1802 34 TestPolicy.testRules > 0123 1.4 1804 36 TestPolicy.testScheduledTriggerFailure > 0123 1.4 1803 35 TestPolicy.testSessionCaching > 0123 1.4 1806 38 TestPolicy.testSortError > 0123 1.4 1802 34 TestPolicy.testSyspropSuggestions > 0123 1.4 1804 36 TestPolicy.testUtilizeNodeFailure > 0123 1.4 1807 39 TestPolicy.testUtilizeNodeFailure2 > 0123 1.8 1802 34 TestPolicy.testValidate > 0123 1.4 1799 31 TestPolicy.testViolationOutput > 0123 1.8 1809 41 TestPolicy.testWithCollection > 0123 1.8 1806 38 > TestPolicy.testWithCollectionMoveReplica > 0123 1.8 1803 35 > TestPolicy.testWithCollectionMoveVsAddSuggestions > 0123 2.5 1811 43 > TestPolicy.testWithCollectionSuggestions > 0123 0.5 1742 6 TestPullReplica.testAddDocs > 0123 0.2 1660 10 TestStressRecovery(suite) > 0123 0.2 1663 10 TestStressRecovery.testStressRecovery > 0123 0.2 1725 4 TestTlogReplica(suite) > 0123 3.2 442 13 TestTriggerIntegration.testEventQueue > 0123 3.2 442 34 > TestTriggerIntegration.testNodeMarkersRegistration > 0123 1.6 1069 36 TestTriggerIntegration.testSearchRate > 0123 0.5 2025 7 > TestWithCollection.testAddReplicaSimple > 0123 0.2 2025 6 > TestWithCollection.testAddReplicaWithPolicy > 0123 0.2 2025 6 > TestWithCollection.testCreateCollection > 0123 0.2 2025 6 > TestWithCollection.testMultipleWithCollections > 0123 0.5 2025 7 TestWithCollection.testNodeAdded > 0123 3.6 1738 40 UsingSolrJRefGuideExamplesTest(suite) > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] -- Regards, Shalin Shekhar Mangar.
