I’m not actively annotating anything at this point, the number of failed tests over each of the last 4 weeks is short enough that I’ll just echo those in these e-mails, the full report is attached for anyone who wants to track history. I’ll revise the wording to not make it look like I’ll annotate things.
So things like Test2BPostings.test that are a problem with particular Java compilers will appear in the list but will not be annotated, never fear. Failures in the last 4 reports.. Report Pct runs fails test 0123 1.7 1248 12 HttpPartitionWithTlogReplicasTest.test 0123 1.4 1260 9 LeaderFailoverAfterPartitionTest.test 0123 0.3 1257 30 LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud 0123 0.6 1266 17 RollingRestartTest.test 0123 0.3 1249 7 SyncSliceTest.test 0123 1.4 1298 25 SystemCollectionCompatTest.testBackCompat 0123 26.9 130 28 Test2BPostings.test 0123 4.3 781 57 TestFuzzyQuery.testErrorMessage 0123 0.5 1302 5 TestLucene80DocValuesFormat.testSparseDocValuesVsStoredFields 0123 0.3 1251 8 TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast 0123 2.1 1316 31 TestStressLiveNodes.testStress
DO NOT ENABLE LIST: MoveReplicaHDFSTest.testFailedMove MoveReplicaHDFSTest.testNormalFailedMove TestControlledRealTimeReopenThread.testCRTReopen TestICUNormalizer2CharFilter.testRandomStrings TestICUTokenizerCJK TestImpersonationWithHadoopAuth.testForwarding TestLTRReRankingPipeline.testDifferentTopN TestRandomChains DO NOT ANNOTATE LIST CdcrBidirectionalTest.testBiDir IndexSizeTriggerTest.testMergeIntegration IndexSizeTriggerTest.testMixedBounds IndexSizeTriggerTest.testSplitIntegration IndexSizeTriggerTest.testTrigger InfixSuggestersTest.testShutdownDuringBuild ShardSplitTest.test ShardSplitTest.testSplitMixedReplicaTypes ShardSplitTest.testSplitWithChaosMonkey Test2BPostings.test TestLatLonShapeQueries.testRandomBig TestPackedInts.testPackedLongValues TestRandomChains.testRandomChainsWithLargeStrings TestTriggerIntegration.testSearchRate Processing file (History bit 3): HOSS-2020-13.csv Processing file (History bit 2): HOSS-2020-01-06.csv Processing file (History bit 1): HOSS-2019-12-30.csv Processing file (History bit 0): HOSS-2019-12-23.csv Number of AwaitsFix: 41 Number of BadApples: 6 Raw fail count by week totals, most recent week first (corresponds to bits): Week: 0 had 118 failures Week: 1 had 298 failures Week: 2 had 84 failures Week: 3 had 108 failures **Annotated tests that didn't fail in the last 4 weeks. **Tests removed from the next two lists because they were specified in 'doNotEnable' in the properties file MoveReplicaHDFSTest.testNormalFailedMove **Annotations will be removed from the following tests because they haven't failed in the last 4 rollups. **Methods: 2 MultiThreadedOCPTest.test SolrZkClientTest.testSimpleUpdateACLs ********Failures in Hoss' reports for the last 4 rollups. There were 461 unannotated tests that failed in Hoss' rollups. Ordered by the date I downloaded the rollup file, newest->oldest. See above for the dates the files were collected These tests were NOT BadApple'd or AwaitsFix'd All tests that failed 4 weeks running will be BadApple'd unless there are objections Failures in the last 4 reports.. Report Pct runs fails test 0123 1.7 1248 12 HttpPartitionWithTlogReplicasTest.test 0123 1.4 1260 9 LeaderFailoverAfterPartitionTest.test 0123 0.3 1257 30 LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud 0123 0.6 1266 17 RollingRestartTest.test 0123 0.3 1249 7 SyncSliceTest.test 0123 1.4 1298 25 SystemCollectionCompatTest.testBackCompat 0123 26.9 130 28 Test2BPostings.test 0123 4.3 781 57 TestFuzzyQuery.testErrorMessage 0123 0.5 1302 5 TestLucene80DocValuesFormat.testSparseDocValuesVsStoredFields 0123 0.3 1251 8 TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast 0123 2.1 1316 31 TestStressLiveNodes.testStress ************ Will BadApple all tests above this line except ones listed at the top************** 012 0.8 990 10 AutoScalingHandlerTest.testReadApi 012 0.6 990 5 AutoScalingHandlerTest.testSuggestionsWithPayload 012 0.6 991 5 CollectionsAPISolrJTest.testCreateCollWithDefaultClusterPropertiesNewFormat 012 0.8 1006 7 HttpPartitionTest.test 012 0.6 997 6 LeaderElectionIntegrationTest.testSimpleSliceLeaderElection 012 0.3 999 6 LeaderVoteWaitTimeoutTest.basicTest 012 0.3 1031 4 TestBagOfPositions.test 012 1.1 1038 8 TestBagOfPostings.test 012 0.6 989 4 TestRestoreCore.testFailedRestore 012 0.3 1042 4 TestSearcherManager.testConcurrentIndexCloseSearchAndRefresh 01 3 32.4 91 13 HdfsBasicDistributedZk2Test.test 01 3 7.4 89 11 StressHdfsTest.test 01 4.4 698 30 BasicDistributedZkTest.test 01 0.3 677 2 ChaosMonkeyNothingIsSafeTest.test 01 0.3 671 2 CreateRoutedAliasTest.testV2 01 11.5 52 6 HdfsTlogReplayBufferedWhileIndexingTest.test 01 0.3 603 2 OverseerTest.testShardLeaderChange 01 0.3 672 2 PingRequestHandlerTest.testPingInClusterWithNoHealthCheck 01 0.3 671 2 SchemaApiFailureTest.testAddTheSameFieldTwice 01 0.3 675 3 ShardSplitTest.testSplitMixedReplicaTypesLink 01 0.3 595 2 TestDelegationWithHadoopAuth.testDelegationTokenRenew 01 0.3 669 2 TestDynamicFieldNamesIndexCorrectly.test 01 0.3 702 2 TestLucene80DocValuesFormat.testSortedNumericBlocksOfVariousBitsPerValue 0 23 5.3 150 9 DimensionalRoutedAliasUpdateProcessorTest.testCatTime 0 23 5.3 150 11 DimensionalRoutedAliasUpdateProcessorTest.testTimeCat 0 23 13.3 91 8 HdfsBasicDistributedZkTest.test 0 23 0.3 912 3 TestCloudSchemaless.test 0 23 0.3 969 4 TestLucene80DocValuesFormat.testNumericFieldJumpTables 0 2 0.9 664 7 TestJaegerConfigurator.testInjected 0 3 0.3 610 2 ShardSplitTest.testSplitMixedReplicaTypes 0 3 3.0 616 13 TestPhraseWildcardQuery.testExplain 0 0.3 351 1 CloudMLTQParserTest.testMLTQParser 0 0.3 355 1 CollectionsAPISolrJTest.testCreateCollWithDefaultClusterPropertiesOldFormat 0 0.3 352 1 ComputePlanActionTest.testNodeLostTriggerWithDeleteNodePreferredOp 0 0.3 351 1 CreateRoutedAliasTest.testCollectionNamesMustBeAbsent 0 0.3 351 1 CreateRoutedAliasTest.testTimeStampWithMsFails 0 0.3 351 1 CreateRoutedAliasTest.testTimezoneAbsoluteDate 0 0.3 351 1 CustomCollectionTest.testCustomCollectionsAPI 0 0.3 351 1 CustomCollectionTest.testRouteFieldForHashRouter 0 0.3 351 1 CustomCollectionTest.testRouteFieldForImplicitRouter 0 0.3 352 1 DeleteShardTest.test 0 1.1 351 4 DocValuesTest.testFloatAndDoubleRangeQueryRandom 0 15.0 419 63 EmbeddedSolrNoSerializeTest.testAssertTagStreamingWithSolrTaggerRequest 0 15.0 419 63 EmbeddedSolrNoSerializeTest.testSearch 0 15.0 419 63 EmbeddedSolrNoSerializeTest.testTag 0 0.3 335 1 FullSolrCloudDistribCmdsTest.testBasicUpdates 0 0.3 335 1 FullSolrCloudDistribCmdsTest.testConcurrentIndexing 0 0.3 335 1 FullSolrCloudDistribCmdsTest.testIndexQueryDeleteHierarchical 0 0.3 335 1 FullSolrCloudDistribCmdsTest.testIndexingBatchPerRequestWithHttpSolrClient 0 0.3 335 1 FullSolrCloudDistribCmdsTest.testIndexingOneDocPerRequestWithHttpSolrClient 0 17.2 29 5 HdfsSyncSliceTest.test 0 0.3 352 1 IndexSizeTriggerMixedBoundsTest.testMixedBounds 0 0.3 356 1 MetricsHistoryWithAuthIntegrationTest.testValuesAreCollected 0 15.4 4173 643 RandomizedTaggerTest.test 0 0.3 356 1 ReindexCollectionTest.testFailure 0 0.3 356 1 ReindexCollectionTest.testSameTargetReindexing 0 0.3 350 1 SearchHandlerTest.testRequireZkConnected 0 0.3 350 1 ShardRoutingTest.test 0 0.3 350 1 ShardSplitTest.testSplitShardWithRule 0 0.3 350 1 ShardSplitTest.testSplitStaticIndexReplicationLink 0 0.9 352 3 SolrCloudExampleTest.testLoadDocsIntoGettingStartedCollection 0 16.1 416 67 Tagger2Test.testLongestDominantRight 0 15.9 415 66 Tagger2Test.testMultibyteChar 0 16.1 416 67 Tagger2Test.testWDF 0 16.4 420 69 TaggerTest.testFormat 0 16.4 420 69 TaggerTest.testFormatMatchText 0 16.4 420 69 TaggerTest.testMultipleFilterQueries 0 16.4 420 69 TaggerTest.testSubTags 0 16.4 420 69 TaggerTest.testWholeMatching 0 14.9 410 61 TaggingAttributeTest.testTaggingAttribute 0 0.3 352 1 TestConfigReload.test 0 0.3 352 1 TestCryptoKeys.test 0 3.0 363 11 TestDistributedStatsComponentCardinality.test 0 4.2 24 1 TestDuelingCodecsAtNight.testEquals 0 0.4 231 1 TestExactStatsCacheCloud.testBasicStats 0 0.3 347 1 TestLBHttpSolrClient.testSimple 0 0.3 370 1 TestLucene50TermVectorsFormat.testRamBytesUsed 0 0.3 367 1 TestLucene80DocValuesFormat.testSparseBinaryFixedLengthVsStoredFields 0 0.3 365 1 TestLucene80DocValuesFormat.testSparseSortedNumericBlocksOfVariousBitsPerValue 0 0.3 339 1 TestMiniSolrCloudClusterSSL.testSslAndClientAuth 0 0.3 353 1 TestPullReplicaErrorHandling.testPullReplicaDisconnectsFromZooKeeper 0 0.3 351 1 TestRandomDVFaceting.testRandomFaceting 0 0.3 353 1 TestRecovery.stressLogReplay 0 0.3 353 1 TestRequestForwarding.testMultiCollectionQuery 0 0.3 359 1 TestSimpleTextTermVectorsFormat.testRamBytesUsed 0 1.7 360 6 TestXYMultiPolygonShapeQueries.testRandomMedium 0 15.8 419 66 XmlInterpolationTest.test 0 7.9 419 33 XmlInterpolationTest.testInvalidXml 123 3.6 906 38 BasicAuthIntegrationTest.testBasicAuth 123 0.3 904 22 TestCloudSearcherWarming.testRepFactor1LeaderStartup 123 0.3 935 6 TestIndexingSequenceNumbers.testStressConcurrentCommit 123 1.3 888 32 TestModelManagerPersistence.testFilePersistence 123 1.6 887 31 TestModelManagerPersistence.testWrapperModelPersistence 123 0.6 877 5 TestPackages.testPluginLoading 123 0.3 932 3 TestPackedInts.testPackedLongValues 123 0.3 888 5 TestSkipOverseerOperations.testSkipLeaderOperations 123 52.3 135 49 TestXYMultiPolygonShapeQueries.testRandomBig 12 3.6 56 2 HdfsRestartWhileUpdatingTest.test 12 0.6 642 3 OverseerRolesTest.testOverseerRole 12 0.6 184 2 TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader 12 0.3 633 2 TestCloudRecovery.corruptedLogTest 12 0.3 633 2 TestDynamicLoading.testDynamicLoading 12 0.6 673 3 TestIndexWriterReader.testDuringAddDelete 1 3 3.7 58 4 TestDuelingCodecsAtNight.testBigEquals 1 3 0.3 564 2 TestNamedUpdateProcessors.test 1 0.3 320 1 AddReplicaTest.testAddMultipleReplicas 1 0.6 327 2 AnalysisImplTest.testGetPresetAnalyzerTypes 1 0.3 323 1 AssignBackwardCompatibilityTest.test 1 0.3 321 1 AutoscalingHistoryHandlerTest.testHistory 1 0.3 321 1 BasicDistributedZk2Test.test 1 0.3 318 1 CollectionsAPIDistributedZkTest.testCreateNodeSet 1 0.3 322 1 CollectionsAPISolrJTest.testColStatus 1 0.3 298 1 CommitsImplTest.testGetCommit 1 0.3 298 1 CommitsImplTest.testGetCommit_generation_notfound 1 0.3 298 1 CommitsImplTest.testGetFiles 1 0.3 298 1 CommitsImplTest.testGetFiles_generation_notfound 1 0.3 298 1 CommitsImplTest.testGetSegmentAttributes 1 0.3 298 1 CommitsImplTest.testGetSegmentAttributes_generation_notfound 1 0.3 298 1 CommitsImplTest.testGetSegmentAttributes_invalid_name 1 0.3 298 1 CommitsImplTest.testGetSegmentDiagnostics 1 0.3 298 1 CommitsImplTest.testGetSegmentDiagnostics_generation_notfound 1 0.3 298 1 CommitsImplTest.testGetSegmentDiagnostics_invalid_name 1 0.3 298 1 CommitsImplTest.testGetSegments 1 0.3 298 1 CommitsImplTest.testGetSegments_generation_notfound 1 0.3 298 1 CommitsImplTest.testListCommits 1 0.3 298 1 CommitsImplTest.testSegmentCodec 1 0.3 298 1 CommitsImplTest.testSegmentCodec_generation_notfound 1 0.3 298 1 CommitsImplTest.testSegmentCodec_invalid_name 1 0.3 334 1 ConfusionMatrixGeneratorTest.testGetConfusionMatrixWithCNB 1 0.3 334 1 ConfusionMatrixGeneratorTest.testGetConfusionMatrixWithSNB 1 0.3 318 1 CustomHighlightComponentTest.test 1 0.3 321 1 DistributedIntervalFacetingTest.test 1 0.3 318 1 DistributedSpellCheckComponentTest.test 1 0.6 327 2 DocValuesAdapterTest.testGetDocValues_binary 1 0.6 327 2 DocValuesAdapterTest.testGetDocValues_notAvailable 1 0.6 327 2 DocValuesAdapterTest.testGetDocValues_numeric 1 0.6 327 2 DocValuesAdapterTest.testGetDocValues_sorted 1 0.6 327 2 DocValuesAdapterTest.testGetDocValues_sorted_numeric 1 0.6 327 2 DocValuesAdapterTest.testGetDocValues_sorted_set 1 0.7 303 2 DocumentsImplTest.testClose 1 0.7 303 2 DocumentsImplTest.testFirstTerm 1 0.7 303 2 DocumentsImplTest.testFirstTermDoc 1 0.7 303 2 DocumentsImplTest.testFirstTermDoc_unPositioned 1 0.7 303 2 DocumentsImplTest.testFirstTerm_notAvailable 1 0.7 303 2 DocumentsImplTest.testGetDocumentFields 1 0.7 303 2 DocumentsImplTest.testGetMaxDoc 1 0.7 303 2 DocumentsImplTest.testIsLive 1 0.7 303 2 DocumentsImplTest.testNextTerm 1 0.7 303 2 DocumentsImplTest.testNextTermDoc 1 0.7 303 2 DocumentsImplTest.testNextTermDoc_unPositioned 1 0.7 303 2 DocumentsImplTest.testNextTerm_unPositioned 1 0.7 303 2 DocumentsImplTest.testSeekTerm 1 0.7 303 2 DocumentsImplTest.testSeekTerm_unPositioned 1 0.7 303 2 DocumentsImplTest.testTermPositions 1 0.7 303 2 DocumentsImplTest.testTermPositions_noPositions 1 0.7 303 2 DocumentsImplTest.testTermPositions_unPositioned 1 0.3 320 1 HttpPartitionOnCommitTest.test 1 0.3 322 1 IndexSizeTriggerTest.testMergeIntegration 1 0.3 326 1 LeaderVoteWaitTimeoutTest.testMostInSyncReplicasCanWinElection 1 0.3 313 1 MergeIndexesEmbeddedTest.testMergeIndexesByCoreName 1 0.3 313 1 MergeIndexesEmbeddedTest.testMergeIndexesByDirName 1 0.3 313 1 MergeIndexesEmbeddedTest.testMergeMultipleRequest 1 0.6 327 2 OverviewImplTest.testClose 1 0.6 327 2 OverviewImplTest.testGetCommitDescription 1 0.6 327 2 OverviewImplTest.testGetCommitUserData 1 0.6 327 2 OverviewImplTest.testGetDirImpl 1 0.6 327 2 OverviewImplTest.testGetFieldNames 1 0.6 327 2 OverviewImplTest.testGetIndexFormat 1 0.6 327 2 OverviewImplTest.testGetIndexPath 1 0.6 327 2 OverviewImplTest.testGetIndexVersion 1 0.6 327 2 OverviewImplTest.testGetNumDeletedDocs 1 0.6 327 2 OverviewImplTest.testGetNumDocuments 1 0.6 327 2 OverviewImplTest.testGetNumFields 1 0.6 327 2 OverviewImplTest.testGetNumTerms 1 0.6 327 2 OverviewImplTest.testGetSortedTermCounts 1 0.6 327 2 OverviewImplTest.testGetTopTerms 1 0.6 327 2 OverviewImplTest.testGetTopTerms_illegal_numterms 1 0.6 327 2 OverviewImplTest.testHasDeletions 1 0.6 327 2 OverviewImplTest.testIsOptimized 1 0.3 323 1 PeerSyncTest.test 1 0.3 313 1 SchemaTest.addDynamicFieldShouldntBeCalledTwiceWithTheSameName 1 0.3 313 1 SchemaTest.addFieldShouldntBeCalledTwiceWithTheSameName 1 0.3 313 1 SchemaTest.addFieldTypeShouldntBeCalledTwiceWithTheSameName 1 0.3 313 1 SchemaTest.addFieldTypeWithAnalyzerClassAccuracy 1 0.3 313 1 SchemaTest.addFieldTypeWithSimilarityAccuracy 1 0.3 313 1 SchemaTest.copyFieldsShouldFailWhenOneOfTheFieldsDoesntExistInTheSchema 1 0.3 313 1 SchemaTest.deleteCopyFieldShouldFailWhenOneOfTheFieldsDoesntExistInTheSchema 1 0.3 313 1 SchemaTest.deletingADynamicFieldThatDoesntExistInTheSchemaShouldFail 1 0.3 313 1 SchemaTest.deletingAFieldThatDoesntExistInTheSchemaShouldFail 1 0.3 313 1 SchemaTest.deletingAFieldTypeThatDoesntExistInTheSchemaShouldFail 1 0.3 313 1 SchemaTest.testAddDynamicFieldAccuracy 1 0.3 313 1 SchemaTest.testAddFieldAccuracy 1 0.3 313 1 SchemaTest.testAddFieldTypeAccuracy 1 0.3 313 1 SchemaTest.testCopyFieldAccuracy 1 0.3 313 1 SchemaTest.testCopyFieldWithMaxCharsAccuracy 1 0.3 313 1 SchemaTest.testDeleteCopyFieldAccuracy 1 0.3 313 1 SchemaTest.testDeleteDynamicFieldAccuracy 1 0.3 313 1 SchemaTest.testDeleteFieldAccuracy 1 0.3 313 1 SchemaTest.testDeleteFieldTypeAccuracy 1 0.3 313 1 SchemaTest.testGetCopyFieldsAccuracy 1 0.3 313 1 SchemaTest.testGetDynamicFieldAccuracy 1 0.3 313 1 SchemaTest.testGetDynamicFieldsAccuracy 1 0.3 313 1 SchemaTest.testGetFieldAccuracy 1 0.3 313 1 SchemaTest.testGetFieldTypeAccuracy 1 0.3 313 1 SchemaTest.testGetFieldTypesAccuracy 1 0.3 313 1 SchemaTest.testGetFieldsAccuracy 1 0.3 313 1 SchemaTest.testGetGlobalSimilarityAccuracy 1 0.3 313 1 SchemaTest.testGetUniqueKeyAccuracy 1 0.3 313 1 SchemaTest.testMultipleUpdateRequestAccuracy 1 0.3 313 1 SchemaTest.testReplaceDynamicFieldAccuracy 1 0.3 313 1 SchemaTest.testReplaceFieldAccuracy 1 0.3 313 1 SchemaTest.testReplaceFieldTypeAccuracy 1 0.3 313 1 SchemaTest.testSchemaNameRequestAccuracy 1 0.3 313 1 SchemaTest.testSchemaRequestAccuracy 1 0.3 313 1 SchemaTest.testSchemaVersionRequestAccuracy 1 0.6 327 2 SearchImplTest.testGetRangeSearchableFieldNames 1 0.6 327 2 SearchImplTest.testGetSearchableFieldNames 1 0.6 327 2 SearchImplTest.testGetSortType 1 0.6 327 2 SearchImplTest.testGetSortTypeNoSuchField 1 0.6 327 2 SearchImplTest.testGetSortableFieldNames 1 0.6 327 2 SearchImplTest.testGuessSortTypes 1 0.6 327 2 SearchImplTest.testGuessSortTypesNoSuchField 1 0.6 327 2 SearchImplTest.testNextPage 1 0.6 327 2 SearchImplTest.testNextPageNoMoreResults 1 0.6 327 2 SearchImplTest.testNextPageSearchNotStarted 1 0.6 327 2 SearchImplTest.testParseClassic 1 0.6 327 2 SearchImplTest.testParsePointRange 1 0.6 327 2 SearchImplTest.testPrevPage 1 0.6 327 2 SearchImplTest.testPrevPageNoMoreResults 1 0.6 327 2 SearchImplTest.testPrevPageSearchNotStarted 1 0.6 327 2 SearchImplTest.testSearch 1 0.6 327 2 SearchImplTest.testSearchWithSort 1 0.6 327 2 TermCountsTest.testNumTerms 1 0.6 327 2 TermCountsTest.testSortedTermCounts_count_asc 1 0.6 327 2 TermCountsTest.testSortedTermCounts_count_desc 1 0.6 327 2 TermCountsTest.testSortedTermCounts_name_asc 1 0.6 327 2 TermCountsTest.testSortedTermCounts_name_desc 1 0.6 327 2 TermVectorsAdapterTest.testGetTermVector 1 0.6 327 2 TermVectorsAdapterTest.testGetTermVector_with_positions 1 0.6 327 2 TermVectorsAdapterTest.testGetTermVector_with_positions_offsets 1 0.6 327 2 TermVectorsAdapterTest.testGetTermVectors_notAvailable 1 0.3 313 1 TermsFacetMapTest.testRejectInvalidMinCount 1 0.3 313 1 TermsFacetMapTest.testRejectInvalidOverRefineBuckets 1 0.3 313 1 TermsFacetMapTest.testRejectInvalidOverRequestBuckets 1 0.3 313 1 TermsFacetMapTest.testRejectInvalidTermPrefix 1 0.3 313 1 TermsFacetMapTest.testRejectsInvalidMethod 1 0.3 313 1 TermsFacetMapTest.testRejectsInvalidSortString 1 0.3 313 1 TermsFacetMapTest.testRejectsNegativeBucketOffset 1 0.3 313 1 TermsFacetMapTest.testSetsFacetTypeToTerm 1 0.3 313 1 TermsFacetMapTest.testStoresAllBucketsFlagWithCorrectKey 1 0.3 313 1 TermsFacetMapTest.testStoresBucketLimitWithCorrectKey 1 0.3 313 1 TermsFacetMapTest.testStoresBucketOffsetWithCorrectKey 1 0.3 313 1 TermsFacetMapTest.testStoresFieldWithCorrectKey 1 0.3 313 1 TermsFacetMapTest.testStoresMethodWithCorrectKey 1 0.3 313 1 TermsFacetMapTest.testStoresMinCountWithCorrectKey 1 0.3 313 1 TermsFacetMapTest.testStoresNumBucketsFlagWithCorrectKey 1 0.3 313 1 TermsFacetMapTest.testStoresOverRefineBucketsWithCorrectKey 1 0.3 313 1 TermsFacetMapTest.testStoresOverRequestBucketsWithCorrectKey 1 0.3 313 1 TermsFacetMapTest.testStoresRefinementFlagWithCorrectKey 1 0.3 313 1 TermsFacetMapTest.testStoresSortWithCorrectKey 1 0.3 313 1 TermsFacetMapTest.testStoresTermPrefixWithCorrectKey 1 0.3 331 1 TestCachePurging.testBackgroundPurges 1 0.3 313 1 TestConfigSetAdminRequest.testCreate 1 0.3 313 1 TestConfigSetAdminRequest.testDelete 1 0.3 313 1 TestConfigSetAdminRequest.testNoAction 1 0.3 317 1 TestDistribIDF.testSimpleQuery 1 0.3 320 1 TestDistributedMissingSort.test 1 0.3 320 1 TestDistributedSearch.test 1 0.3 323 1 TestHighlightDedupGrouping.test 1 6.7 30 2 TestInetAddressRangeQueries.testRandomBig 1 0.3 320 1 TestLockTree.testLocks 1 0.3 335 1 TestLucene80DocValuesFormat.testTermsEnumLongSharedPrefixes 1 7.7 26 2 TestLucene80DocValuesFormat.testTermsEnumRandomMany 1 0.3 320 1 TestMiniSolrCloudClusterSSL.testNoSsl 1 0.3 320 1 TestMiniSolrCloudClusterSSL.testSslWithCheckPeerName 1 3.2 342 11 TestRandomChains.testRandomChainsWithLargeStrings 1 0.3 318 1 TestRandomFlRTGCloud.testRandomizedUpdatesAndRTGs 1 0.3 319 1 TestRecovery.testExistOldBufferLog 1 0.3 320 1 TestReplicaProperties.test 1 0.3 319 1 TestSegmentSorting.testAtomicUpdateOfSegmentSortField 1 0.3 319 1 TestSegmentSorting.testSegmentTerminateEarly 1 0.3 319 1 TestSolrCLIRunExample.testSchemalessExample 1 0.5 209 1 TestSolrCachePerf.testGetPutCompute 1 0.6 326 2 TestSolrCloudWithDelegationTokens.testDelegationTokenRenew 1 0.6 314 2 TestSolrJsonWriter.test 1 0.3 313 1 TestSolrProperties.testProperties 1 0.3 319 1 TestTlogReplica.testAddDocs 1 0.3 319 1 TestTlogReplica.testBasicLeaderElection 1 0.3 638 2 TestTlogReplica.testCreateDelete 1 0.3 319 1 TestTlogReplica.testKillLeader 1 0.3 319 1 TestTlogReplica.testOutOfOrderDBQWithInPlaceUpdates 1 0.3 319 1 TestTlogReplica.testRealTimeGet 1 0.3 319 1 TestTlogReplica.testRecovery 1 0.3 313 1 TestZkConfigManager.testConstants 1 0.3 313 1 TestZkConfigManager.testUploadConfig 1 0.3 313 1 TestZkConfigManager.testUploadWithACL 1 0.3 322 1 ZkCLITest.testPutFile 23 2.6 73 4 HdfsChaosMonkeyNothingIsSafeTest.test 23 8.3 56 8 HdfsWriteToMultipleCollectionsTest.test 23 1.2 576 6 MissingSegmentRecoveryTest.testLeaderRecovery 23 0.3 584 3 ShardSplitTest.testSplitShardWithRuleLink 23 2.9 69 2 ShardSplitTest.testSplitWithChaosMonkey 23 3.1 572 14 TestDistribIDF.testMultiCollectionQuery 23 46.4 109 43 TestXYPolygonShapeQueries.testRandomBig 2 0.3 314 1 ChaosMonkeySafeLeaderWithPullReplicasTest.test 2 0.3 310 1 CloudHttp2SolrClientTest.stateVersionParamTest 2 0.3 315 1 CollectionsAPIAsyncDistributedZkTest.testAsyncRequests 2 0.3 322 1 ConfusionMatrixGeneratorTest.testGetConfusionMatrixWithFLTKNN 2 3.4 328 11 DistribCursorPagingTest.test 2 0.3 311 1 DistributedFacetPivotLongTailTest.test 2 4.3 23 1 HdfsUnloadDistributedZkTest.test 2 0.6 315 2 IndexSizeTriggerTest.testSplitIntegration 2 0.3 313 1 PeerSyncReplicationTest.test 2 3.7 81 3 SearchRateTriggerIntegrationTest.testAboveSearchRate 2 0.3 324 1 ShardSplitTest.testSplitAfterFailedSplit 2 3.4 319 11 SolrCmdDistributorTest.test 2 0.3 316 1 SplitShardTest.testSplitFuzz 2 0.3 331 1 TestIndexWriterDelete.testDeletesOnDiskFull 2 0.3 332 1 TestLucene80DocValuesFormat.testBinaryVariableLengthVsStoredFields 2 0.3 332 1 TestLucene80DocValuesFormat.testRandomAdvanceNumeric 2 0.3 329 1 TestLucene80DocValuesFormat.testSortedVariableLengthBigVsStoredFields 2 0.3 331 1 TestLucene80DocValuesFormat.testSparseNumericBlocksOfVariousBitsPerValue 2 0.3 313 1 TestPackages.testAPI 2 0.3 324 1 TestReplicationHandler.doTestIndexAndConfigReplication 3 0.4 246 1 BasicAuthOnSingleNodeTest.basicTest 3 3.2 31 1 CdcrReplicationHandlerTest.testReplicationWithBufferedUpdates 3 4.1 271 11 DocumentAnalysisRequestHandlerTest.testCharsetOutsideDocument 3 0.4 249 1 ExitableDirectoryReaderTest.testPrefixQuery 3 13.8 94 13 FuzzySearchTest.testTooComplex 3 0.4 260 1 LoggingHandlerTest.testLogLevelHandlerOutput 3 0.8 248 2 MBeansHandlerTest.testXMLDiffWithExternalEntity 3 0.4 249 1 OverseerTaskQueueTest.testDistributedQueue 3 13.9 287 40 ParseContextConfigTest.testAll 3 0.4 265 1 TestBinaryDocValuesUpdates.testMultipleDocValuesTypes 3 12.5 32 4 TestBinaryDocValuesUpdates.testTonsOfUpdates 3 0.4 243 1 TestCloudJSONFacetSKG.testRandom 3 0.4 261 1 TestDemoParallelLeafReader.testRandom 3 0.8 262 2 TestDemoParallelLeafReader.testRandomMultipleSchemaGens 3 6.7 30 2 TestDoubleRangeFieldQueries.testRandomBig 3 0.4 244 1 TestInPlaceUpdatesDistrib.test 3 3.7 27 1 TestIndexWriterOnVMError.testCheckpoint 3 0.4 269 1 TestLucene80DocValuesFormat.testBooleanNumericsVsStoredFields 3 0.4 268 1 TestLucene80DocValuesFormat.testSortedSetAroundBlockSize 3 0.4 269 1 TestLucene80DocValuesFormat.testTermsEnumVariableWidth 3 0.4 261 1 TestPagedBytes.testDataInputOutput 3 3.4 261 9 TestSolrCloudWithKerberosAlt.testBasics 3 5.3 266 14 TestXPathEntityProcessor.testMultiValued 3 5.6 266 15 TestXPathRecordReader.testError 3 0.8 250 2 XmlUpdateRequestHandlerTest.testExternalEntities 3 0.8 250 2 XmlUpdateRequestHandlerTest.testNamedEntity ***********************Annotations report Number of AwaitsFix: 41 Number of BadApples: 6 *****************AwaitsFix Annotations: ************Lucene AwaitsFix TestControlledRealTimeReopenThread.testCRTReopen @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5737") TestICUNormalizer2CharFilter.testRandomStrings @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5595") TestICUTokenizerCJK.TestICUTokenizerCJK suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8222") TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-7161") ************Solr AwaitsFix AutoAddReplicasIntegrationTest.testRapidStopStartStopWithPropChange @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13811") CdcrBidirectionalTest.testBiDir @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12524") CdcrBootstrapTest.testBootstrapWithContinousIndexingOnSourceCluster @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12028") CollectionsAPISolrJTest.testCreateAndDeleteShard @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13021") ComputePlanActionTest.testNodeLost @LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") ConcurrentCreateRoutedAliasTest.ConcurrentCreateRoutedAliasTest suite @LuceneTestCase.AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12386") // "Can't find resource" LeaderTragicEventTest.LeaderTragicEventTest suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13237") MoveReplicaHDFSTest.MoveReplicaHDFSTest suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13924") MoveReplicaHDFSTest.testFailedMove @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12080") // added 03-Oct-2018 ReplaceNodeNoTargetTest.ReplaceNodeNoTargetTest suite @LuceneTestCase.AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-11067") ReplaceNodeNoTargetTest.test @LuceneTestCase.AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-11067") RoutedAliasUpdateProcessorTest.alias, @org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13696") SSLMigrationTest.SSLMigrationTest suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") // 17-Mar-2018 SaslZkACLProviderTest.testSaslZkACLProvider @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13075") ScheduledMaintenanceTriggerTest.testInactiveShardCleanup @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") // 17-Mar-2018 ScheduledTriggerTest.testTrigger @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") // added 20-Sep-2018 SearchRateTriggerIntegrationTest.testDeleteNode @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13163") SearchRateTriggerTest.testTrigger @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") SolrExporterIntegrationTest.SolrExporterIntegrationTest suite @org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13786") Tagger2Test.testStopWords @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-8344") TestHierarchicalDocBuilder.testThreeLevelHierarchy @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12801") // this test fails easily under beasting TestImpersonationWithHadoopAuth.testForwarding @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/HADOOP-9893") TestJsonFacetRefinement.testProcessEmptyRefinement @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556") TestJsonFacetRefinement.testSortedSubFacetRefinementWhenParentOnlyReturnedByOneShardProcessEmpty @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556") TestLTRReRankingPipeline.testDifferentTopN @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-11134") TestMinMaxOnMultiValuedField.testDoubleFieldCache @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709") TestMinMaxOnMultiValuedField.testFloatFieldCache @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709") TestMinMaxOnMultiValuedField.testIntFieldCache @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709") TestMinMaxOnMultiValuedField.testLongFieldCache @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709") TestPullReplica.TestPullReplica suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") TestSimComputePlanAction.testNodeLost @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12028") // if you beast this, eventually you will see TestSimExtremeIndexing.TestSimExtremeIndexing suite @org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12923") TestSimLargeCluster.testBasic @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") // this test hits a timeout easily TestStressRecovery.TestStressRecovery suite @LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") // 6-Sep-2018 TestTlogReplayVsRecovery.TestTlogReplayVsRecovery suite @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13486;https://issues.apache.org/jira/browse/SOLR-14183") TimeRoutedAliasUpdateProcessorTest.testDateMathInStart @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13943") TriLevelCompositeIdRoutingTest.test @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13369") *****************BadApple Annotations: ************Lucene BadApple ************Solr BadApple MoveReplicaHDFSTest.testNormalFailedMove @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") // 14-Oct-2018 MultiThreadedOCPTest.test @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") // annotated on: 24-Dec-2018 SharedFSAutoReplicaFailoverTest.SharedFSAutoReplicaFailoverTest suite @LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") // added 20-Jul-2018 SolrZkClientTest.testSimpleUpdateACLs @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") // annotated on: 24-Dec-2018 TimeRoutedAliasUpdateProcessorTest.TimeRoutedAliasUpdateProcessorTest suite @LuceneTestCase.BadApple(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13059")
--------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org