********Failures in Hoss' reports for the last 4 rollups. There were 242 unannotated tests that failed in Hoss' rollups. Ordered by the date I downloaded the rollup file, newest->oldest. See above for the dates the files were collected These tests were NOT BadApple'd or AwaitsFix'd
Failures in the last 4 reports.. Report Pct runs fails test 0123 6.4 1757 94 CloudExitableDirectoryReaderTest.test 0123 5.3 8740 325 CloudExitableDirectoryReaderTest.testCreepThenBite 0123 2.6 1734 42 CloudExitableDirectoryReaderTest.testWhitebox 0123 9.5 1688 107 HttpPartitionOnCommitTest.test 0123 2.7 1604 18 HttpPartitionTest.test 0123 1.8 1580 14 HttpPartitionWithTlogReplicasTest.test 0123 0.3 1567 10 LeaderFailoverAfterPartitionTest.test 0123 3.6 1639 57 MultiThreadedOCPTest.test 0123 0.3 1564 5 ReplaceNodeTest.test 0123 0.3 1584 4 ShardSplitTest.testSplitShardWithRule 0123 93.3 46 43 SharedFSAutoReplicaFailoverTest.test 0123 2.3 837 18 TestCircuitBreaker.testBuildingMemoryPressure 0123 0.9 837 12 TestCircuitBreaker.testResponseWithCBTiming 0123 3.6 1853 101 TestContainerPlugin.testApiFromPackage 0123 2.8 1683 37 TestDistributedGrouping.test 0123 4.2 1629 89 TestExportWriter.testExpr 0123 11.7 1326 87 TestHdfsCloudBackupRestore.test 0123 9.3 1672 121 TestLocalFSCloudBackupRestore.test 0123 1.2 1623 25 TestPackages.testPluginLoading 0123 0.3 1586 9 TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast 0123 8.3 1629 82 TestReRankQParserPlugin.testMinExactCount 0123 0.3 1556 4 TestReplicaProperties.test 0123 0.3 1557 5 TestSolrCloudWithDelegationTokens.testDelegationTokenRenew 0123 1.5 1564 10 TestSolrConfigHandlerCloud.test ******************************************** Full report attached:
DO NOT ENABLE LIST: MoveReplicaHDFSTest.testFailedMove MoveReplicaHDFSTest.testNormalFailedMove TestControlledRealTimeReopenThread.testCRTReopen TestICUNormalizer2CharFilter.testRandomStrings TestICUTokenizerCJK TestImpersonationWithHadoopAuth.testForwarding TestLTRReRankingPipeline.testDifferentTopN TestRandomChains DO NOT ANNOTATE LIST CdcrBidirectionalTest.testBiDir IndexSizeTriggerTest.testMergeIntegration IndexSizeTriggerTest.testMixedBounds IndexSizeTriggerTest.testSplitIntegration IndexSizeTriggerTest.testTrigger InfixSuggestersTest.testShutdownDuringBuild ShardSplitTest.test ShardSplitTest.testSplitMixedReplicaTypes ShardSplitTest.testSplitWithChaosMonkey Test2BPostings.test TestLatLonShapeQueries.testRandomBig TestPackedInts.testPackedLongValues TestRandomChains.testRandomChainsWithLargeStrings TestTriggerIntegration.testSearchRate SuppressWarnings count: last week: 4,819, this week: 4,818, delta -1 *************** Files with increased @SuppressWarnings annotations: Suppress count increase in: solr/solrj/src/java/org/apache/solr/common/LazySolrCluster.java. Was: null, now: 1 *************** Files with decreased @SuppressWarnings annotations: Suppress count decrease in: solr/core/src/test/org/apache/solr/search/facet/TestCloudJSONFacetJoinDomain.java. Was: 7, now: 6 Processing file (History bit 3): HOSS-2020-08-17.csv Processing file (History bit 2): HOSS-2020-08-10.csv Processing file (History bit 1): HOSS-2020-08-03.csv Processing file (History bit 0): HOSS-2020-07-27.csv Number of AwaitsFix: 33 Number of BadApples: 4 **Annotated tests that didn't fail in the last 4 weeks. **Tests removed from the next two lists because they were specified in 'doNotEnable' in the properties file MoveReplicaHDFSTest.testNormalFailedMove **Annotations can be removed from the following tests because they haven't failed in the last 4 rollups. **Methods: 0 Raw fail count by week totals, most recent week first (corresponds to bits): Week: 0 had 113 failures Week: 1 had 100 failures Week: 2 had 82 failures Week: 3 had 94 failures ********Failures in Hoss' reports for the last 4 rollups. There were 242 unannotated tests that failed in Hoss' rollups. Ordered by the date I downloaded the rollup file, newest->oldest. See above for the dates the files were collected These tests were NOT BadApple'd or AwaitsFix'd Failures in the last 4 reports.. Report Pct runs fails test 0123 6.4 1757 94 CloudExitableDirectoryReaderTest.test 0123 5.3 8740 325 CloudExitableDirectoryReaderTest.testCreepThenBite 0123 2.6 1734 42 CloudExitableDirectoryReaderTest.testWhitebox 0123 9.5 1688 107 HttpPartitionOnCommitTest.test 0123 2.7 1604 18 HttpPartitionTest.test 0123 1.8 1580 14 HttpPartitionWithTlogReplicasTest.test 0123 0.3 1567 10 LeaderFailoverAfterPartitionTest.test 0123 3.6 1639 57 MultiThreadedOCPTest.test 0123 0.3 1564 5 ReplaceNodeTest.test 0123 0.3 1584 4 ShardSplitTest.testSplitShardWithRule 0123 93.3 46 43 SharedFSAutoReplicaFailoverTest.test 0123 2.3 837 18 TestCircuitBreaker.testBuildingMemoryPressure 0123 0.9 837 12 TestCircuitBreaker.testResponseWithCBTiming 0123 3.6 1853 101 TestContainerPlugin.testApiFromPackage 0123 2.8 1683 37 TestDistributedGrouping.test 0123 4.2 1629 89 TestExportWriter.testExpr 0123 11.7 1326 87 TestHdfsCloudBackupRestore.test 0123 9.3 1672 121 TestLocalFSCloudBackupRestore.test 0123 1.2 1623 25 TestPackages.testPluginLoading 0123 0.3 1586 9 TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast 0123 8.3 1629 82 TestReRankQParserPlugin.testMinExactCount 0123 0.3 1556 4 TestReplicaProperties.test 0123 0.3 1557 5 TestSolrCloudWithDelegationTokens.testDelegationTokenRenew 0123 1.5 1564 10 TestSolrConfigHandlerCloud.test ******************************************** Failures over the last 4 weeks, but not every week. Ordered most-recent first: Report Pct runs fails test 012 1.0 627 4 SearchRateTriggerTest.testWaitForElapsed 01 3 0.3 1169 3 MoveReplicaTest.testFailedMove 01 3 0.3 1165 15 TestInPlaceUpdatesDistrib.test 01 3 0.3 1117 4 TestPackages.testSchemaPlugins 01 0.5 792 3 ChaosMonkeyNothingIsSafeTest.test 01 0.3 804 2 ConnectionManagerTest.testLikelyExpired 01 5.3 34 3 HdfsBasicDistributedZkTest.test 01 0.3 788 2 MetricsHistoryWithAuthIntegrationTest.testValuesAreCollected 01 0.8 1455 7 TestBulkSchemaConcurrent.test 01 0.3 783 3 TestLockTree.testLocks 01 21.0 917 300 TestRequestRateLimiter.testConcurrentQueries 01 24.2 917 343 TestRequestRateLimiter.testSlotBorrowing 0 23 0.3 1041 3 LBSolrClientTest.testServerIteratorTimeAllowed 0 23 0.3 1159 4 RollingRestartTest.test 0 23 1.2 1192 10 TestIndexWriterDelete.testDeleteAllNoDeadLock 0 2 0.5 422 2 ComputePlanActionTest.testNodeAdded 0 2 0.5 422 3 ComputePlanActionTest.testSelectedCollectionsByPolicy 0 2 0.3 781 2 TestRebalanceLeaders.testRebalanceLeaders 0 3 1.5 769 7 CustomHighlightComponentTest.test 0 3 0.5 790 3 DocValuesNotIndexedTest.testGroupingDVOnlySortFirst 0 3 1.0 414 3 ExecutePlanActionTest.testTaskTimeout 0 3 0.0 4716 2 TestJsonFacets.testStatsDistrib 0 3 0.3 771 2 TestRecovery.stressLogReplay 0 0.3 390 1 ChaosMonkeyNothingIsSafeWithPullReplicasTest.test 0 0.3 395 1 ChaosMonkeySafeLeaderTest.test 0 0.3 383 1 CloudHttp2SolrClientTest.testRetryUpdatesWhenClusterStateIsStale 0 0.3 389 1 CollectionsAPIDistributedZkTest.addReplicaTest 0 0.3 390 1 DeleteShardTest.test 0 0.2 403 1 Geo3dTest.testPolygonWithCoplanarPoints 0 0.3 390 1 HealthCheckHandlerTest.testHealthCheckV2Api 0 0.3 390 1 LeaderElectionIntegrationTest.testSimpleSliceLeaderElection 0 0.3 388 1 MetricsHandlerTest.test 0 0.3 388 1 MetricsHandlerTest.testCompact 0 0.4 242 1 OverseerTest.testShardLeaderChange 0 0.3 390 1 RecoveryAfterSoftCommitTest.test 0 0.3 394 1 ShardSplitTest.testSplitStaticIndexReplicationLink 0 0.3 325 1 SoftAutoCommitTest.testSoftCommitWithinAndHardCommitMaxTimeMixedAdds 0 0.3 389 1 SolrCloudReportersTest.testDefaultPlugins 0 0.3 383 1 SolrExampleStreamingTest.testCommitWithinOnDelete 0 0.3 390 1 StatsReloadRaceTest.testParallelReloadAndStats 0 0.3 384 1 SyncSliceTest.test 0 0.3 390 1 TestAuthorizationFramework.authorizationFrameworkTest 0 0.3 390 1 TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeaderAfterRestart 0 0.3 389 1 TestCustomStream.testDynamicLoadingCustomStream 0 0.5 395 2 TestDistributedSearch.test 0 0.7 410 3 TestIndexWriterDelete.testNRTIsCurrentAfterDelete 0 0.5 410 2 TestIndexWriterDelete.testOnlyDeletesTriggersMergeOnGetReader 0 0.0 2382 1 TestJsonFacets.testBigger 0 0.2 430 1 TestLocalFSCloudBackupRestore.testRestoreFailure 0 0.2 409 1 TestPackages.testAPI 0 0.5 395 2 TestRandomRequestDistribution.test 0 0.3 390 1 TestSkipOverseerOperations.testSkipDownOperations 0 0.3 390 1 TestSystemCollAutoCreate.testAutoCreate 0 0.3 383 1 TestV2Request.testCloudSolrClient 0 0.3 390 1 ZkShardTermsTest.testParticipationOfReplicas 123 4.4 1188 33 BasicDistributedZkTest.test 123 0.5 1188 7 DocValuesNotIndexedTest.testGroupingDVOnlySortLast 123 5.6 72 4 ShardSplitTest.testSplitWithChaosMonkey 123 0.4 1058 3 TestDynamicLoading.testDynamicLoading 12 0.7 807 5 ConnectionManagerTest.testReconnectWhenZkDisappeared 12 0.5 427 2 MetricTriggerIntegrationTest.testMetricTrigger 12 0.3 786 2 SolrCloudReportersTest.testExplicitConfiguration 12 0.3 793 3 SystemCollectionCompatTest.testBackCompat 12 0.5 789 3 TestCollectionAPI.test 1 3 0.3 780 3 ReplicationFactorTest.test 1 3 0.9 421 3 ScheduledTriggerIntegrationTest.testScheduledTrigger 1 3 0.3 658 2 SoftAutoCommitTest.testSoftAndHardCommitMaxTimeMixedAdds 1 3 0.3 776 2 TestPullReplicaErrorHandling.testPullReplicaDisconnectsFromZooKeeper 1 0.3 398 1 ActionThrottleTest.testBasics 1 2.7 406 11 BJQParserTest.testToParentFilters 1 0.3 398 1 CdcrVersionReplicationTest.testCdcrDocVersions 1 0.3 398 1 CollectionsAPISolrJTest.testColStatus 1 0.3 399 1 PeerSyncReplicationTest.test 1 0.5 398 2 PeerSyncTest.test 1 0.3 398 1 SignatureUpdateProcessorFactoryTest.testMultiThreaded 1 0.5 404 2 SolrCloudExampleTest.testLoadDocsIntoGettingStartedCollection 1 0.3 397 1 SolrGraphiteReporterTest.testReporter 1 0.3 390 1 StreamDecoratorTest.testInnerJoinStream 1 0.3 391 1 StreamingTest.testMergeStream 1 0.3 399 1 TestBlobHandler.doBlobHandlerTest 1 0.3 399 1 TestCloudManagedSchema.test 1 0.5 403 2 TestCloudSearcherWarming.testPeersyncFailureReplicationSuccess 1 1.2 402 5 TestCollectionAPI.testRecreateCollectionAfterFailure 1 21.0 486 102 TestConfig.testDefaults 1 17.6 17 3 TestIndexingSequenceNumbers.testStressConcurrentAddAndDeleteAndCommit 1 0.0 2412 1 TestJsonFacets.testTolerant 1 0.3 389 1 TestLBHttp2SolrClient.testReliability 1 0.3 397 1 TestOnReconnectListenerSupport.test 1 1.5 399 6 TestPointFields.testFloatPointStats 1 0.3 398 1 TestPrepRecovery.testLeaderNotResponding 1 0.3 398 1 TestShortCircuitedRequests.test 1 0.2 3970 6 TestSolr4Spatial2.testLLPDecodeIsStableAndPrecise 1 0.3 398 1 TestStressInPlaceUpdates.stressTest 1 5.6 18 1 TestStressNRTReplication.test 1 0.9 221 2 TestWithCollection.testNodeAdded 23 4.0 56 9 CdcrReplicationHandlerTest.testReplicationWithBufferedUpdates 23 16.0 47 5 StressHdfsTest.test 23 0.5 417 2 TriggerSetPropertiesIntegrationTest.testSetProperties 23 0.3 769 2 UnloadDistributedZkTest.test 2 0.3 392 1 ChaosMonkeySafeLeaderWithPullReplicasTest.test 2 0.3 310 1 CheckHdfsIndexTest.testChecksumsOnly 2 0.5 398 2 DocValuesNotIndexedTest.testGroupingDocAbsent 2 0.3 386 1 MathExpressionTest.testZipFDistribution 2 0.3 391 1 OverseerRolesTest.testOverseerRole 2 0.3 388 1 RandomGeoPolygonTest.testCompareSmallPolygons 2 0.3 392 1 ReindexCollectionTest.testFailure 2 0.2 403 1 ShardSplitTest.testSplitMixedReplicaTypes 2 0.3 337 1 SoftAutoCommitTest.testHardCommitWithinAndSoftCommitMaxTimeRapidAdds 2 2.7 401 11 TestBlockJoin.testMultiChildQueriesOfDiffParentLevels 2 1.0 390 4 TestCloudPivotFacet.test 2 0.5 396 2 TestCloudRecovery2.test 2 0.3 390 1 TestCloudSchemaless.test 2 0.3 394 1 TestIndexWriterDelete.testDeleteAllRollback 2 0.3 394 1 TestIndexWriterDelete.testMergingAfterDeleteAll 2 0.0 2376 1 TestJsonFacets.testOverrequest 2 1.3 390 5 TestPointFields.testDoublePointStats 2 0.3 387 1 TestPullReplicaErrorHandling.testCantConnectToLeader 2 0.3 393 1 TestRAFDirectory.testRandomShort 2 0.3 388 1 TestTolerantSearch.testGetTopIdsPhaseError 3 3.2 31 1 CdcrReplicationHandlerTest.testPartialReplicationWithTruncatedTlog 3 0.3 381 1 CustomCollectionTest.testRouteFieldForImplicitRouter 3 0.3 381 1 DaemonStreamApiTest.testAPIs 3 0.3 383 1 DistribDocExpirationUpdateProcessorTest.testNoAuth 3 0.5 207 1 ExecutePlanActionTest.testTaskFail 3 0.5 208 1 IndexSizeTriggerTest.testMergeIntegration 3 0.3 381 1 LeaderFailureAfterFreshStartTest.test 3 0.5 386 2 ShardRoutingTest.test 3 0.3 386 1 ShardSplitTest.testSplitShardWithRuleLink 3 0.3 325 1 SoftAutoCommitTest.testHardCommitWithinAndSoftCommitMaxTimeMixedAdds 3 19.0 126 24 SolrQueryParserBaseTest.testGetField 3 19.0 126 24 SolrQueryParserBaseTest.testGetMagicFieldQuery 3 19.0 126 24 SolrQueryParserBaseTest.testInitHappyCases 3 0.5 195 1 StreamDecoratorTest.testParallelTerminatingDaemonUpdateStream 3 0.3 386 1 TestCachePurging.testBackgroundPurges 3 0.3 381 1 TestDistribPackageStore.testPackageStoreManagement 3 0.3 380 1 TestDynamicFieldNamesIndexCorrectly.test 3 0.3 385 1 TestDynamicLoadingUrl.testDynamicLoadingUrl 3 0.3 384 1 TestIndexWriter.testThreadInterruptDeadlock 3 0.3 388 1 TestIndexWriterDelete.testBothDeletes 3 0.5 388 2 TestIndexWriterDelete.testNonRAMDelete 3 0.3 373 1 TestLBHttp2SolrClient.testTwoServers 3 0.3 312 1 TestRecoveryHdfs.testExistOldBufferLog 3 0.3 382 1 TestReplicationHandler.doTestStressReplication 3 0.9 212 2 TestSimScenario.testSplitShard 3 0.5 212 1 TestSimScenario.testSuggestions 3 0.3 305 1 TestSolrCloudWithSecureImpersonation.testForwarding 3 0.2 404 1 TestSolrConfigHandlerConcurrent.test 3 0.5 207 1 TestWithCollection.testMultipleWithCollections ***********************Annotations report *****************AwaitsFix Annotations: ************Lucene AwaitsFix TestAllFilesDetectBitFlips.TestAllFilesDetectBitFlips suite @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-9356") TestAllFilesDetectTruncation.TestAllFilesDetectTruncation suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-9409") TestControlledRealTimeReopenThread.testCRTReopen @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5737") TestICUNormalizer2CharFilter.testRandomStrings @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5595") TestICUTokenizerCJK.TestICUTokenizerCJK suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8222") TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-7161") ************Solr AwaitsFix CdcrBidirectionalTest.testBiDir @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12524") CdcrBootstrapTest.testBootstrapWithContinousIndexingOnSourceCluster @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12028") CollectionsAPISolrJTest.testCreateAndDeleteShard @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13021") ConcurrentCreateRoutedAliasTest.ConcurrentCreateRoutedAliasTest suite @LuceneTestCase.AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12386") // "Can't find resource" LeaderTragicEventTest.LeaderTragicEventTest suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13237") MoveReplicaHDFSTest.MoveReplicaHDFSTest suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13924") MoveReplicaHDFSTest.testFailedMove @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12080") // added 03-Oct-2018 RoutedAliasUpdateProcessorTest.alias, @org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13696") SSLMigrationTest.SSLMigrationTest suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") // 17-Mar-2018 SaslZkACLProviderTest.testSaslZkACLProvider @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13075") SolrExporterIntegrationTest.SolrExporterIntegrationTest suite @org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13786") Tagger2Test.testStopWords @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-8344") TestHierarchicalDocBuilder.testThreeLevelHierarchy @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12801") // this test fails easily under beasting TestImpersonationWithHadoopAuth.testForwarding @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/HADOOP-9893") TestJsonFacetRefinement.testIndexAscRefineConsistency @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-14595") TestJsonFacetRefinement.testProcessEmptyRefinement @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556") TestJsonFacetRefinement.testSortedSubFacetRefinementWhenParentOnlyReturnedByOneShardProcessEmpty @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556") TestLTRReRankingPipeline.testDifferentTopN @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-11134") TestMinMaxOnMultiValuedField.testDoubleFieldCache @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709") TestMinMaxOnMultiValuedField.testFloatFieldCache @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709") TestMinMaxOnMultiValuedField.testIntFieldCache @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709") TestMinMaxOnMultiValuedField.testLongFieldCache @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709") TestPullReplica.TestPullReplica suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") TestStressRecovery.TestStressRecovery suite @LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") // 6-Sep-2018 TestTlogReplayVsRecovery.TestTlogReplayVsRecovery suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13486;https://issues.apache.org/jira/browse/SOLR-14183") TimeRoutedAliasUpdateProcessorTest.testDateMathInStart @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13943") TriLevelCompositeIdRoutingTest.test @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13369") *****************BadApple Annotations: ************Lucene BadApple ************Solr BadApple MoveReplicaHDFSTest.testNormalFailedMove @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") // 14-Oct-2018 SharedFSAutoReplicaFailoverTest.SharedFSAutoReplicaFailoverTest suite @LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") // added 20-Jul-2018 TimeRoutedAliasUpdateProcessorTest.TimeRoutedAliasUpdateProcessorTest suite @LuceneTestCase.BadApple(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13059")
--------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org