I’m not actively annotating anything at this point, the number of failed tests 
over each of the last 4 weeks is short enough that I’ll just echo those in 
these e-mails, the full report is attached for anyone who wants to track 
history. I’ll revise the wording to not make it look like I’ll annotate things.

So things like Test2BPostings.test that are a problem with particular Java 
compilers will appear in the list but will not be annotated, never fear.


Failures in the last 4 reports..
   Report   Pct     runs    fails           test
     0123   1.7     1248     12      HttpPartitionWithTlogReplicasTest.test
     0123   1.4     1260      9      LeaderFailoverAfterPartitionTest.test
     0123   0.3     1257     30      
LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud
     0123   0.6     1266     17      RollingRestartTest.test
     0123   0.3     1249      7      SyncSliceTest.test
     0123   1.4     1298     25      SystemCollectionCompatTest.testBackCompat
     0123  26.9      130     28      Test2BPostings.test
     0123   4.3      781     57      TestFuzzyQuery.testErrorMessage
     0123   0.5     1302      5      
TestLucene80DocValuesFormat.testSparseDocValuesVsStoredFields
     0123   0.3     1251      8      
TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast
     0123   2.1     1316     31      TestStressLiveNodes.testStress


DO NOT ENABLE LIST:
    MoveReplicaHDFSTest.testFailedMove
    MoveReplicaHDFSTest.testNormalFailedMove
    TestControlledRealTimeReopenThread.testCRTReopen
    TestICUNormalizer2CharFilter.testRandomStrings
    TestICUTokenizerCJK
    TestImpersonationWithHadoopAuth.testForwarding
    TestLTRReRankingPipeline.testDifferentTopN
    TestRandomChains


DO NOT ANNOTATE LIST
    CdcrBidirectionalTest.testBiDir
    IndexSizeTriggerTest.testMergeIntegration
    IndexSizeTriggerTest.testMixedBounds
    IndexSizeTriggerTest.testSplitIntegration
    IndexSizeTriggerTest.testTrigger
    InfixSuggestersTest.testShutdownDuringBuild
    ShardSplitTest.test
    ShardSplitTest.testSplitMixedReplicaTypes
    ShardSplitTest.testSplitWithChaosMonkey
    Test2BPostings.test
    TestLatLonShapeQueries.testRandomBig
    TestPackedInts.testPackedLongValues
    TestRandomChains.testRandomChainsWithLargeStrings
    TestTriggerIntegration.testSearchRate

Processing file (History bit 3): HOSS-2020-13.csv
Processing file (History bit 2): HOSS-2020-01-06.csv
Processing file (History bit 1): HOSS-2019-12-30.csv
Processing file (History bit 0): HOSS-2019-12-23.csv


Number of AwaitsFix: 41 Number of BadApples: 6


Raw fail count by week totals, most recent week first (corresponds to bits):
Week: 0  had  118 failures
Week: 1  had  298 failures
Week: 2  had  84 failures
Week: 3  had  108 failures


**Annotated tests that didn't fail in the last 4 weeks.

  **Tests removed from the next two lists because they were specified in 
'doNotEnable' in the properties file
     MoveReplicaHDFSTest.testNormalFailedMove

  **Annotations will be removed from the following tests because they haven't 
failed in the last 4 rollups.

  **Methods: 2
   MultiThreadedOCPTest.test
   SolrZkClientTest.testSimpleUpdateACLs


********Failures in Hoss' reports for the last 4 rollups.

There were 461 unannotated tests that failed in Hoss' rollups. Ordered by the 
date I downloaded the rollup file, newest->oldest. See above for the dates the 
files were collected 
These tests were NOT BadApple'd or AwaitsFix'd
All tests that failed 4 weeks running will be BadApple'd unless there are 
objections

Failures in the last 4 reports..
   Report   Pct     runs    fails           test
     0123   1.7     1248     12      HttpPartitionWithTlogReplicasTest.test
     0123   1.4     1260      9      LeaderFailoverAfterPartitionTest.test
     0123   0.3     1257     30      
LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud
     0123   0.6     1266     17      RollingRestartTest.test
     0123   0.3     1249      7      SyncSliceTest.test
     0123   1.4     1298     25      SystemCollectionCompatTest.testBackCompat
     0123  26.9      130     28      Test2BPostings.test
     0123   4.3      781     57      TestFuzzyQuery.testErrorMessage
     0123   0.5     1302      5      
TestLucene80DocValuesFormat.testSparseDocValuesVsStoredFields
     0123   0.3     1251      8      
TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast
     0123   2.1     1316     31      TestStressLiveNodes.testStress
************ Will BadApple all tests above this line except ones listed at the 
top**************



     012    0.8      990     10      AutoScalingHandlerTest.testReadApi
     012    0.6      990      5      
AutoScalingHandlerTest.testSuggestionsWithPayload
     012    0.6      991      5      
CollectionsAPISolrJTest.testCreateCollWithDefaultClusterPropertiesNewFormat
     012    0.8     1006      7      HttpPartitionTest.test
     012    0.6      997      6      
LeaderElectionIntegrationTest.testSimpleSliceLeaderElection
     012    0.3      999      6      LeaderVoteWaitTimeoutTest.basicTest
     012    0.3     1031      4      TestBagOfPositions.test
     012    1.1     1038      8      TestBagOfPostings.test
     012    0.6      989      4      TestRestoreCore.testFailedRestore
     012    0.3     1042      4      
TestSearcherManager.testConcurrentIndexCloseSearchAndRefresh
     01 3  32.4       91     13      HdfsBasicDistributedZk2Test.test
     01 3   7.4       89     11      StressHdfsTest.test
     01     4.4      698     30      BasicDistributedZkTest.test
     01     0.3      677      2      ChaosMonkeyNothingIsSafeTest.test
     01     0.3      671      2      CreateRoutedAliasTest.testV2
     01    11.5       52      6      
HdfsTlogReplayBufferedWhileIndexingTest.test
     01     0.3      603      2      OverseerTest.testShardLeaderChange
     01     0.3      672      2      
PingRequestHandlerTest.testPingInClusterWithNoHealthCheck
     01     0.3      671      2      
SchemaApiFailureTest.testAddTheSameFieldTwice
     01     0.3      675      3      
ShardSplitTest.testSplitMixedReplicaTypesLink
     01     0.3      595      2      
TestDelegationWithHadoopAuth.testDelegationTokenRenew
     01     0.3      669      2      TestDynamicFieldNamesIndexCorrectly.test
     01     0.3      702      2      
TestLucene80DocValuesFormat.testSortedNumericBlocksOfVariousBitsPerValue
     0 23   5.3      150      9      
DimensionalRoutedAliasUpdateProcessorTest.testCatTime
     0 23   5.3      150     11      
DimensionalRoutedAliasUpdateProcessorTest.testTimeCat
     0 23  13.3       91      8      HdfsBasicDistributedZkTest.test
     0 23   0.3      912      3      TestCloudSchemaless.test
     0 23   0.3      969      4      
TestLucene80DocValuesFormat.testNumericFieldJumpTables
     0 2    0.9      664      7      TestJaegerConfigurator.testInjected
     0  3   0.3      610      2      ShardSplitTest.testSplitMixedReplicaTypes
     0  3   3.0      616     13      TestPhraseWildcardQuery.testExplain
     0      0.3      351      1      CloudMLTQParserTest.testMLTQParser
     0      0.3      355      1      
CollectionsAPISolrJTest.testCreateCollWithDefaultClusterPropertiesOldFormat
     0      0.3      352      1      
ComputePlanActionTest.testNodeLostTriggerWithDeleteNodePreferredOp
     0      0.3      351      1      
CreateRoutedAliasTest.testCollectionNamesMustBeAbsent
     0      0.3      351      1      
CreateRoutedAliasTest.testTimeStampWithMsFails
     0      0.3      351      1      
CreateRoutedAliasTest.testTimezoneAbsoluteDate
     0      0.3      351      1      
CustomCollectionTest.testCustomCollectionsAPI
     0      0.3      351      1      
CustomCollectionTest.testRouteFieldForHashRouter
     0      0.3      351      1      
CustomCollectionTest.testRouteFieldForImplicitRouter
     0      0.3      352      1      DeleteShardTest.test
     0      1.1      351      4      
DocValuesTest.testFloatAndDoubleRangeQueryRandom
     0     15.0      419     63      
EmbeddedSolrNoSerializeTest.testAssertTagStreamingWithSolrTaggerRequest
     0     15.0      419     63      EmbeddedSolrNoSerializeTest.testSearch
     0     15.0      419     63      EmbeddedSolrNoSerializeTest.testTag
     0      0.3      335      1      
FullSolrCloudDistribCmdsTest.testBasicUpdates
     0      0.3      335      1      
FullSolrCloudDistribCmdsTest.testConcurrentIndexing
     0      0.3      335      1      
FullSolrCloudDistribCmdsTest.testIndexQueryDeleteHierarchical
     0      0.3      335      1      
FullSolrCloudDistribCmdsTest.testIndexingBatchPerRequestWithHttpSolrClient
     0      0.3      335      1      
FullSolrCloudDistribCmdsTest.testIndexingOneDocPerRequestWithHttpSolrClient
     0     17.2       29      5      HdfsSyncSliceTest.test
     0      0.3      352      1      
IndexSizeTriggerMixedBoundsTest.testMixedBounds
     0      0.3      356      1      
MetricsHistoryWithAuthIntegrationTest.testValuesAreCollected
     0     15.4     4173    643      RandomizedTaggerTest.test
     0      0.3      356      1      ReindexCollectionTest.testFailure
     0      0.3      356      1      
ReindexCollectionTest.testSameTargetReindexing
     0      0.3      350      1      SearchHandlerTest.testRequireZkConnected
     0      0.3      350      1      ShardRoutingTest.test
     0      0.3      350      1      ShardSplitTest.testSplitShardWithRule
     0      0.3      350      1      
ShardSplitTest.testSplitStaticIndexReplicationLink
     0      0.9      352      3      
SolrCloudExampleTest.testLoadDocsIntoGettingStartedCollection
     0     16.1      416     67      Tagger2Test.testLongestDominantRight
     0     15.9      415     66      Tagger2Test.testMultibyteChar
     0     16.1      416     67      Tagger2Test.testWDF
     0     16.4      420     69      TaggerTest.testFormat
     0     16.4      420     69      TaggerTest.testFormatMatchText
     0     16.4      420     69      TaggerTest.testMultipleFilterQueries
     0     16.4      420     69      TaggerTest.testSubTags
     0     16.4      420     69      TaggerTest.testWholeMatching
     0     14.9      410     61      TaggingAttributeTest.testTaggingAttribute
     0      0.3      352      1      TestConfigReload.test
     0      0.3      352      1      TestCryptoKeys.test
     0      3.0      363     11      
TestDistributedStatsComponentCardinality.test
     0      4.2       24      1      TestDuelingCodecsAtNight.testEquals
     0      0.4      231      1      TestExactStatsCacheCloud.testBasicStats
     0      0.3      347      1      TestLBHttpSolrClient.testSimple
     0      0.3      370      1      
TestLucene50TermVectorsFormat.testRamBytesUsed
     0      0.3      367      1      
TestLucene80DocValuesFormat.testSparseBinaryFixedLengthVsStoredFields
     0      0.3      365      1      
TestLucene80DocValuesFormat.testSparseSortedNumericBlocksOfVariousBitsPerValue
     0      0.3      339      1      
TestMiniSolrCloudClusterSSL.testSslAndClientAuth
     0      0.3      353      1      
TestPullReplicaErrorHandling.testPullReplicaDisconnectsFromZooKeeper
     0      0.3      351      1      TestRandomDVFaceting.testRandomFaceting
     0      0.3      353      1      TestRecovery.stressLogReplay
     0      0.3      353      1      
TestRequestForwarding.testMultiCollectionQuery
     0      0.3      359      1      
TestSimpleTextTermVectorsFormat.testRamBytesUsed
     0      1.7      360      6      
TestXYMultiPolygonShapeQueries.testRandomMedium
     0     15.8      419     66      XmlInterpolationTest.test
     0      7.9      419     33      XmlInterpolationTest.testInvalidXml
      123   3.6      906     38      BasicAuthIntegrationTest.testBasicAuth
      123   0.3      904     22      
TestCloudSearcherWarming.testRepFactor1LeaderStartup
      123   0.3      935      6      
TestIndexingSequenceNumbers.testStressConcurrentCommit
      123   1.3      888     32      
TestModelManagerPersistence.testFilePersistence
      123   1.6      887     31      
TestModelManagerPersistence.testWrapperModelPersistence
      123   0.6      877      5      TestPackages.testPluginLoading
      123   0.3      932      3      TestPackedInts.testPackedLongValues
      123   0.3      888      5      
TestSkipOverseerOperations.testSkipLeaderOperations
      123  52.3      135     49      
TestXYMultiPolygonShapeQueries.testRandomBig
      12    3.6       56      2      HdfsRestartWhileUpdatingTest.test
      12    0.6      642      3      OverseerRolesTest.testOverseerRole
      12    0.6      184      2      
TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader
      12    0.3      633      2      TestCloudRecovery.corruptedLogTest
      12    0.3      633      2      TestDynamicLoading.testDynamicLoading
      12    0.6      673      3      TestIndexWriterReader.testDuringAddDelete
      1 3   3.7       58      4      TestDuelingCodecsAtNight.testBigEquals
      1 3   0.3      564      2      TestNamedUpdateProcessors.test
      1     0.3      320      1      AddReplicaTest.testAddMultipleReplicas
      1     0.6      327      2      AnalysisImplTest.testGetPresetAnalyzerTypes
      1     0.3      323      1      AssignBackwardCompatibilityTest.test
      1     0.3      321      1      AutoscalingHistoryHandlerTest.testHistory
      1     0.3      321      1      BasicDistributedZk2Test.test
      1     0.3      318      1      
CollectionsAPIDistributedZkTest.testCreateNodeSet
      1     0.3      322      1      CollectionsAPISolrJTest.testColStatus
      1     0.3      298      1      CommitsImplTest.testGetCommit
      1     0.3      298      1      
CommitsImplTest.testGetCommit_generation_notfound
      1     0.3      298      1      CommitsImplTest.testGetFiles
      1     0.3      298      1      
CommitsImplTest.testGetFiles_generation_notfound
      1     0.3      298      1      CommitsImplTest.testGetSegmentAttributes
      1     0.3      298      1      
CommitsImplTest.testGetSegmentAttributes_generation_notfound
      1     0.3      298      1      
CommitsImplTest.testGetSegmentAttributes_invalid_name
      1     0.3      298      1      CommitsImplTest.testGetSegmentDiagnostics
      1     0.3      298      1      
CommitsImplTest.testGetSegmentDiagnostics_generation_notfound
      1     0.3      298      1      
CommitsImplTest.testGetSegmentDiagnostics_invalid_name
      1     0.3      298      1      CommitsImplTest.testGetSegments
      1     0.3      298      1      
CommitsImplTest.testGetSegments_generation_notfound
      1     0.3      298      1      CommitsImplTest.testListCommits
      1     0.3      298      1      CommitsImplTest.testSegmentCodec
      1     0.3      298      1      
CommitsImplTest.testSegmentCodec_generation_notfound
      1     0.3      298      1      
CommitsImplTest.testSegmentCodec_invalid_name
      1     0.3      334      1      
ConfusionMatrixGeneratorTest.testGetConfusionMatrixWithCNB
      1     0.3      334      1      
ConfusionMatrixGeneratorTest.testGetConfusionMatrixWithSNB
      1     0.3      318      1      CustomHighlightComponentTest.test
      1     0.3      321      1      DistributedIntervalFacetingTest.test
      1     0.3      318      1      DistributedSpellCheckComponentTest.test
      1     0.6      327      2      
DocValuesAdapterTest.testGetDocValues_binary
      1     0.6      327      2      
DocValuesAdapterTest.testGetDocValues_notAvailable
      1     0.6      327      2      
DocValuesAdapterTest.testGetDocValues_numeric
      1     0.6      327      2      
DocValuesAdapterTest.testGetDocValues_sorted
      1     0.6      327      2      
DocValuesAdapterTest.testGetDocValues_sorted_numeric
      1     0.6      327      2      
DocValuesAdapterTest.testGetDocValues_sorted_set
      1     0.7      303      2      DocumentsImplTest.testClose
      1     0.7      303      2      DocumentsImplTest.testFirstTerm
      1     0.7      303      2      DocumentsImplTest.testFirstTermDoc
      1     0.7      303      2      
DocumentsImplTest.testFirstTermDoc_unPositioned
      1     0.7      303      2      
DocumentsImplTest.testFirstTerm_notAvailable
      1     0.7      303      2      DocumentsImplTest.testGetDocumentFields
      1     0.7      303      2      DocumentsImplTest.testGetMaxDoc
      1     0.7      303      2      DocumentsImplTest.testIsLive
      1     0.7      303      2      DocumentsImplTest.testNextTerm
      1     0.7      303      2      DocumentsImplTest.testNextTermDoc
      1     0.7      303      2      
DocumentsImplTest.testNextTermDoc_unPositioned
      1     0.7      303      2      DocumentsImplTest.testNextTerm_unPositioned
      1     0.7      303      2      DocumentsImplTest.testSeekTerm
      1     0.7      303      2      DocumentsImplTest.testSeekTerm_unPositioned
      1     0.7      303      2      DocumentsImplTest.testTermPositions
      1     0.7      303      2      
DocumentsImplTest.testTermPositions_noPositions
      1     0.7      303      2      
DocumentsImplTest.testTermPositions_unPositioned
      1     0.3      320      1      HttpPartitionOnCommitTest.test
      1     0.3      322      1      IndexSizeTriggerTest.testMergeIntegration
      1     0.3      326      1      
LeaderVoteWaitTimeoutTest.testMostInSyncReplicasCanWinElection
      1     0.3      313      1      
MergeIndexesEmbeddedTest.testMergeIndexesByCoreName
      1     0.3      313      1      
MergeIndexesEmbeddedTest.testMergeIndexesByDirName
      1     0.3      313      1      
MergeIndexesEmbeddedTest.testMergeMultipleRequest
      1     0.6      327      2      OverviewImplTest.testClose
      1     0.6      327      2      OverviewImplTest.testGetCommitDescription
      1     0.6      327      2      OverviewImplTest.testGetCommitUserData
      1     0.6      327      2      OverviewImplTest.testGetDirImpl
      1     0.6      327      2      OverviewImplTest.testGetFieldNames
      1     0.6      327      2      OverviewImplTest.testGetIndexFormat
      1     0.6      327      2      OverviewImplTest.testGetIndexPath
      1     0.6      327      2      OverviewImplTest.testGetIndexVersion
      1     0.6      327      2      OverviewImplTest.testGetNumDeletedDocs
      1     0.6      327      2      OverviewImplTest.testGetNumDocuments
      1     0.6      327      2      OverviewImplTest.testGetNumFields
      1     0.6      327      2      OverviewImplTest.testGetNumTerms
      1     0.6      327      2      OverviewImplTest.testGetSortedTermCounts
      1     0.6      327      2      OverviewImplTest.testGetTopTerms
      1     0.6      327      2      
OverviewImplTest.testGetTopTerms_illegal_numterms
      1     0.6      327      2      OverviewImplTest.testHasDeletions
      1     0.6      327      2      OverviewImplTest.testIsOptimized
      1     0.3      323      1      PeerSyncTest.test
      1     0.3      313      1      
SchemaTest.addDynamicFieldShouldntBeCalledTwiceWithTheSameName
      1     0.3      313      1      
SchemaTest.addFieldShouldntBeCalledTwiceWithTheSameName
      1     0.3      313      1      
SchemaTest.addFieldTypeShouldntBeCalledTwiceWithTheSameName
      1     0.3      313      1      
SchemaTest.addFieldTypeWithAnalyzerClassAccuracy
      1     0.3      313      1      
SchemaTest.addFieldTypeWithSimilarityAccuracy
      1     0.3      313      1      
SchemaTest.copyFieldsShouldFailWhenOneOfTheFieldsDoesntExistInTheSchema
      1     0.3      313      1      
SchemaTest.deleteCopyFieldShouldFailWhenOneOfTheFieldsDoesntExistInTheSchema
      1     0.3      313      1      
SchemaTest.deletingADynamicFieldThatDoesntExistInTheSchemaShouldFail
      1     0.3      313      1      
SchemaTest.deletingAFieldThatDoesntExistInTheSchemaShouldFail
      1     0.3      313      1      
SchemaTest.deletingAFieldTypeThatDoesntExistInTheSchemaShouldFail
      1     0.3      313      1      SchemaTest.testAddDynamicFieldAccuracy
      1     0.3      313      1      SchemaTest.testAddFieldAccuracy
      1     0.3      313      1      SchemaTest.testAddFieldTypeAccuracy
      1     0.3      313      1      SchemaTest.testCopyFieldAccuracy
      1     0.3      313      1      
SchemaTest.testCopyFieldWithMaxCharsAccuracy
      1     0.3      313      1      SchemaTest.testDeleteCopyFieldAccuracy
      1     0.3      313      1      SchemaTest.testDeleteDynamicFieldAccuracy
      1     0.3      313      1      SchemaTest.testDeleteFieldAccuracy
      1     0.3      313      1      SchemaTest.testDeleteFieldTypeAccuracy
      1     0.3      313      1      SchemaTest.testGetCopyFieldsAccuracy
      1     0.3      313      1      SchemaTest.testGetDynamicFieldAccuracy
      1     0.3      313      1      SchemaTest.testGetDynamicFieldsAccuracy
      1     0.3      313      1      SchemaTest.testGetFieldAccuracy
      1     0.3      313      1      SchemaTest.testGetFieldTypeAccuracy
      1     0.3      313      1      SchemaTest.testGetFieldTypesAccuracy
      1     0.3      313      1      SchemaTest.testGetFieldsAccuracy
      1     0.3      313      1      SchemaTest.testGetGlobalSimilarityAccuracy
      1     0.3      313      1      SchemaTest.testGetUniqueKeyAccuracy
      1     0.3      313      1      
SchemaTest.testMultipleUpdateRequestAccuracy
      1     0.3      313      1      SchemaTest.testReplaceDynamicFieldAccuracy
      1     0.3      313      1      SchemaTest.testReplaceFieldAccuracy
      1     0.3      313      1      SchemaTest.testReplaceFieldTypeAccuracy
      1     0.3      313      1      SchemaTest.testSchemaNameRequestAccuracy
      1     0.3      313      1      SchemaTest.testSchemaRequestAccuracy
      1     0.3      313      1      SchemaTest.testSchemaVersionRequestAccuracy
      1     0.6      327      2      
SearchImplTest.testGetRangeSearchableFieldNames
      1     0.6      327      2      SearchImplTest.testGetSearchableFieldNames
      1     0.6      327      2      SearchImplTest.testGetSortType
      1     0.6      327      2      SearchImplTest.testGetSortTypeNoSuchField
      1     0.6      327      2      SearchImplTest.testGetSortableFieldNames
      1     0.6      327      2      SearchImplTest.testGuessSortTypes
      1     0.6      327      2      
SearchImplTest.testGuessSortTypesNoSuchField
      1     0.6      327      2      SearchImplTest.testNextPage
      1     0.6      327      2      SearchImplTest.testNextPageNoMoreResults
      1     0.6      327      2      SearchImplTest.testNextPageSearchNotStarted
      1     0.6      327      2      SearchImplTest.testParseClassic
      1     0.6      327      2      SearchImplTest.testParsePointRange
      1     0.6      327      2      SearchImplTest.testPrevPage
      1     0.6      327      2      SearchImplTest.testPrevPageNoMoreResults
      1     0.6      327      2      SearchImplTest.testPrevPageSearchNotStarted
      1     0.6      327      2      SearchImplTest.testSearch
      1     0.6      327      2      SearchImplTest.testSearchWithSort
      1     0.6      327      2      TermCountsTest.testNumTerms
      1     0.6      327      2      
TermCountsTest.testSortedTermCounts_count_asc
      1     0.6      327      2      
TermCountsTest.testSortedTermCounts_count_desc
      1     0.6      327      2      
TermCountsTest.testSortedTermCounts_name_asc
      1     0.6      327      2      
TermCountsTest.testSortedTermCounts_name_desc
      1     0.6      327      2      TermVectorsAdapterTest.testGetTermVector
      1     0.6      327      2      
TermVectorsAdapterTest.testGetTermVector_with_positions
      1     0.6      327      2      
TermVectorsAdapterTest.testGetTermVector_with_positions_offsets
      1     0.6      327      2      
TermVectorsAdapterTest.testGetTermVectors_notAvailable
      1     0.3      313      1      TermsFacetMapTest.testRejectInvalidMinCount
      1     0.3      313      1      
TermsFacetMapTest.testRejectInvalidOverRefineBuckets
      1     0.3      313      1      
TermsFacetMapTest.testRejectInvalidOverRequestBuckets
      1     0.3      313      1      
TermsFacetMapTest.testRejectInvalidTermPrefix
      1     0.3      313      1      TermsFacetMapTest.testRejectsInvalidMethod
      1     0.3      313      1      
TermsFacetMapTest.testRejectsInvalidSortString
      1     0.3      313      1      
TermsFacetMapTest.testRejectsNegativeBucketOffset
      1     0.3      313      1      TermsFacetMapTest.testSetsFacetTypeToTerm
      1     0.3      313      1      
TermsFacetMapTest.testStoresAllBucketsFlagWithCorrectKey
      1     0.3      313      1      
TermsFacetMapTest.testStoresBucketLimitWithCorrectKey
      1     0.3      313      1      
TermsFacetMapTest.testStoresBucketOffsetWithCorrectKey
      1     0.3      313      1      
TermsFacetMapTest.testStoresFieldWithCorrectKey
      1     0.3      313      1      
TermsFacetMapTest.testStoresMethodWithCorrectKey
      1     0.3      313      1      
TermsFacetMapTest.testStoresMinCountWithCorrectKey
      1     0.3      313      1      
TermsFacetMapTest.testStoresNumBucketsFlagWithCorrectKey
      1     0.3      313      1      
TermsFacetMapTest.testStoresOverRefineBucketsWithCorrectKey
      1     0.3      313      1      
TermsFacetMapTest.testStoresOverRequestBucketsWithCorrectKey
      1     0.3      313      1      
TermsFacetMapTest.testStoresRefinementFlagWithCorrectKey
      1     0.3      313      1      
TermsFacetMapTest.testStoresSortWithCorrectKey
      1     0.3      313      1      
TermsFacetMapTest.testStoresTermPrefixWithCorrectKey
      1     0.3      331      1      TestCachePurging.testBackgroundPurges
      1     0.3      313      1      TestConfigSetAdminRequest.testCreate
      1     0.3      313      1      TestConfigSetAdminRequest.testDelete
      1     0.3      313      1      TestConfigSetAdminRequest.testNoAction
      1     0.3      317      1      TestDistribIDF.testSimpleQuery
      1     0.3      320      1      TestDistributedMissingSort.test
      1     0.3      320      1      TestDistributedSearch.test
      1     0.3      323      1      TestHighlightDedupGrouping.test
      1     6.7       30      2      TestInetAddressRangeQueries.testRandomBig
      1     0.3      320      1      TestLockTree.testLocks
      1     0.3      335      1      
TestLucene80DocValuesFormat.testTermsEnumLongSharedPrefixes
      1     7.7       26      2      
TestLucene80DocValuesFormat.testTermsEnumRandomMany
      1     0.3      320      1      TestMiniSolrCloudClusterSSL.testNoSsl
      1     0.3      320      1      
TestMiniSolrCloudClusterSSL.testSslWithCheckPeerName
      1     3.2      342     11      
TestRandomChains.testRandomChainsWithLargeStrings
      1     0.3      318      1      
TestRandomFlRTGCloud.testRandomizedUpdatesAndRTGs
      1     0.3      319      1      TestRecovery.testExistOldBufferLog
      1     0.3      320      1      TestReplicaProperties.test
      1     0.3      319      1      
TestSegmentSorting.testAtomicUpdateOfSegmentSortField
      1     0.3      319      1      
TestSegmentSorting.testSegmentTerminateEarly
      1     0.3      319      1      TestSolrCLIRunExample.testSchemalessExample
      1     0.5      209      1      TestSolrCachePerf.testGetPutCompute
      1     0.6      326      2      
TestSolrCloudWithDelegationTokens.testDelegationTokenRenew
      1     0.6      314      2      TestSolrJsonWriter.test
      1     0.3      313      1      TestSolrProperties.testProperties
      1     0.3      319      1      TestTlogReplica.testAddDocs
      1     0.3      319      1      TestTlogReplica.testBasicLeaderElection
      1     0.3      638      2      TestTlogReplica.testCreateDelete
      1     0.3      319      1      TestTlogReplica.testKillLeader
      1     0.3      319      1      
TestTlogReplica.testOutOfOrderDBQWithInPlaceUpdates
      1     0.3      319      1      TestTlogReplica.testRealTimeGet
      1     0.3      319      1      TestTlogReplica.testRecovery
      1     0.3      313      1      TestZkConfigManager.testConstants
      1     0.3      313      1      TestZkConfigManager.testUploadConfig
      1     0.3      313      1      TestZkConfigManager.testUploadWithACL
      1     0.3      322      1      ZkCLITest.testPutFile
       23   2.6       73      4      HdfsChaosMonkeyNothingIsSafeTest.test
       23   8.3       56      8      HdfsWriteToMultipleCollectionsTest.test
       23   1.2      576      6      
MissingSegmentRecoveryTest.testLeaderRecovery
       23   0.3      584      3      ShardSplitTest.testSplitShardWithRuleLink
       23   2.9       69      2      ShardSplitTest.testSplitWithChaosMonkey
       23   3.1      572     14      TestDistribIDF.testMultiCollectionQuery
       23  46.4      109     43      TestXYPolygonShapeQueries.testRandomBig
       2    0.3      314      1      
ChaosMonkeySafeLeaderWithPullReplicasTest.test
       2    0.3      310      1      
CloudHttp2SolrClientTest.stateVersionParamTest
       2    0.3      315      1      
CollectionsAPIAsyncDistributedZkTest.testAsyncRequests
       2    0.3      322      1      
ConfusionMatrixGeneratorTest.testGetConfusionMatrixWithFLTKNN
       2    3.4      328     11      DistribCursorPagingTest.test
       2    0.3      311      1      DistributedFacetPivotLongTailTest.test
       2    4.3       23      1      HdfsUnloadDistributedZkTest.test
       2    0.6      315      2      IndexSizeTriggerTest.testSplitIntegration
       2    0.3      313      1      PeerSyncReplicationTest.test
       2    3.7       81      3      
SearchRateTriggerIntegrationTest.testAboveSearchRate
       2    0.3      324      1      ShardSplitTest.testSplitAfterFailedSplit
       2    3.4      319     11      SolrCmdDistributorTest.test
       2    0.3      316      1      SplitShardTest.testSplitFuzz
       2    0.3      331      1      TestIndexWriterDelete.testDeletesOnDiskFull
       2    0.3      332      1      
TestLucene80DocValuesFormat.testBinaryVariableLengthVsStoredFields
       2    0.3      332      1      
TestLucene80DocValuesFormat.testRandomAdvanceNumeric
       2    0.3      329      1      
TestLucene80DocValuesFormat.testSortedVariableLengthBigVsStoredFields
       2    0.3      331      1      
TestLucene80DocValuesFormat.testSparseNumericBlocksOfVariousBitsPerValue
       2    0.3      313      1      TestPackages.testAPI
       2    0.3      324      1      
TestReplicationHandler.doTestIndexAndConfigReplication
        3   0.4      246      1      BasicAuthOnSingleNodeTest.basicTest
        3   3.2       31      1      
CdcrReplicationHandlerTest.testReplicationWithBufferedUpdates
        3   4.1      271     11      
DocumentAnalysisRequestHandlerTest.testCharsetOutsideDocument
        3   0.4      249      1      ExitableDirectoryReaderTest.testPrefixQuery
        3  13.8       94     13      FuzzySearchTest.testTooComplex
        3   0.4      260      1      
LoggingHandlerTest.testLogLevelHandlerOutput
        3   0.8      248      2      
MBeansHandlerTest.testXMLDiffWithExternalEntity
        3   0.4      249      1      OverseerTaskQueueTest.testDistributedQueue
        3  13.9      287     40      ParseContextConfigTest.testAll
        3   0.4      265      1      
TestBinaryDocValuesUpdates.testMultipleDocValuesTypes
        3  12.5       32      4      
TestBinaryDocValuesUpdates.testTonsOfUpdates
        3   0.4      243      1      TestCloudJSONFacetSKG.testRandom
        3   0.4      261      1      TestDemoParallelLeafReader.testRandom
        3   0.8      262      2      
TestDemoParallelLeafReader.testRandomMultipleSchemaGens
        3   6.7       30      2      TestDoubleRangeFieldQueries.testRandomBig
        3   0.4      244      1      TestInPlaceUpdatesDistrib.test
        3   3.7       27      1      TestIndexWriterOnVMError.testCheckpoint
        3   0.4      269      1      
TestLucene80DocValuesFormat.testBooleanNumericsVsStoredFields
        3   0.4      268      1      
TestLucene80DocValuesFormat.testSortedSetAroundBlockSize
        3   0.4      269      1      
TestLucene80DocValuesFormat.testTermsEnumVariableWidth
        3   0.4      261      1      TestPagedBytes.testDataInputOutput
        3   3.4      261      9      TestSolrCloudWithKerberosAlt.testBasics
        3   5.3      266     14      TestXPathEntityProcessor.testMultiValued
        3   5.6      266     15      TestXPathRecordReader.testError
        3   0.8      250      2      
XmlUpdateRequestHandlerTest.testExternalEntities
        3   0.8      250      2      XmlUpdateRequestHandlerTest.testNamedEntity



***********************Annotations report
   Number of AwaitsFix: 41 Number of BadApples: 6

*****************AwaitsFix Annotations:


************Lucene AwaitsFix
TestControlledRealTimeReopenThread.testCRTReopen
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5737";)

TestICUNormalizer2CharFilter.testRandomStrings
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5595";)

TestICUTokenizerCJK.TestICUTokenizerCJK suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8222";)

TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-7161";)


    ************Solr AwaitsFix
AutoAddReplicasIntegrationTest.testRapidStopStartStopWithPropChange
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13811";)

CdcrBidirectionalTest.testBiDir
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12524";)

CdcrBootstrapTest.testBootstrapWithContinousIndexingOnSourceCluster
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12028";)

CollectionsAPISolrJTest.testCreateAndDeleteShard
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13021";)

ComputePlanActionTest.testNodeLost
   
@LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

ConcurrentCreateRoutedAliasTest.ConcurrentCreateRoutedAliasTest suite
   @LuceneTestCase.AwaitsFix(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-12386";) // "Can't find resource"

LeaderTragicEventTest.LeaderTragicEventTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13237";)

MoveReplicaHDFSTest.MoveReplicaHDFSTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13924";)

MoveReplicaHDFSTest.testFailedMove
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12080";) // 
added 03-Oct-2018

ReplaceNodeNoTargetTest.ReplaceNodeNoTargetTest suite
   @LuceneTestCase.AwaitsFix(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-11067";)

ReplaceNodeNoTargetTest.test
   @LuceneTestCase.AwaitsFix(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-11067";)

RoutedAliasUpdateProcessorTest.alias,
   
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13696";)

SSLMigrationTest.SSLMigrationTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
17-Mar-2018

SaslZkACLProviderTest.testSaslZkACLProvider
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13075";)

ScheduledMaintenanceTriggerTest.testInactiveShardCleanup
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
17-Mar-2018

ScheduledTriggerTest.testTrigger
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
added 20-Sep-2018

SearchRateTriggerIntegrationTest.testDeleteNode
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13163";)

SearchRateTriggerTest.testTrigger
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

SolrExporterIntegrationTest.SolrExporterIntegrationTest suite
   
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13786";)

Tagger2Test.testStopWords
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-8344";)

TestHierarchicalDocBuilder.testThreeLevelHierarchy
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12801";) // 
this test fails easily under beasting

TestImpersonationWithHadoopAuth.testForwarding
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/HADOOP-9893";)

TestJsonFacetRefinement.testProcessEmptyRefinement
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556";)

TestJsonFacetRefinement.testSortedSubFacetRefinementWhenParentOnlyReturnedByOneShardProcessEmpty
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556";)

TestLTRReRankingPipeline.testDifferentTopN
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-11134";)

TestMinMaxOnMultiValuedField.testDoubleFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestMinMaxOnMultiValuedField.testFloatFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestMinMaxOnMultiValuedField.testIntFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestMinMaxOnMultiValuedField.testLongFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestPullReplica.TestPullReplica suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

TestSimComputePlanAction.testNodeLost
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12028";) // 
if you beast this, eventually you will see

TestSimExtremeIndexing.TestSimExtremeIndexing suite
   
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12923";)

TestSimLargeCluster.testBasic
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
this test hits a timeout easily

TestStressRecovery.TestStressRecovery suite
   
@LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 6-Sep-2018

TestTlogReplayVsRecovery.TestTlogReplayVsRecovery suite
   
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13486;https://issues.apache.org/jira/browse/SOLR-14183";)

TimeRoutedAliasUpdateProcessorTest.testDateMathInStart
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13943";)

TriLevelCompositeIdRoutingTest.test
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13369";)



*****************BadApple Annotations:

************Lucene BadApple

************Solr BadApple
MoveReplicaHDFSTest.testNormalFailedMove
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
14-Oct-2018

MultiThreadedOCPTest.test
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
annotated on: 24-Dec-2018

SharedFSAutoReplicaFailoverTest.SharedFSAutoReplicaFailoverTest suite
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // added 20-Jul-2018

SolrZkClientTest.testSimpleUpdateACLs
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
annotated on: 24-Dec-2018

TimeRoutedAliasUpdateProcessorTest.TimeRoutedAliasUpdateProcessorTest suite
   @LuceneTestCase.BadApple(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-13059";)





---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to