Still working through the failures on the reference impl, so AFAIK, the tests 
failing large percentages of the time are on that branch.

Processing file (History bit 3): HOSS-2020-10-26.csv
Processing file (History bit 2): HOSS-2020-10-19.csv
Processing file (History bit 1): HOSS-2020-10-12.csv
Processing file (History bit 0): HOSS-2020-10-05.csv


Number of AwaitsFix: 31 Number of BadApples: 3


**Annotated tests that didn't fail in the last 4 weeks.

  **Tests removed from the next two lists because they were specified in 
'doNotEnable' in the properties file
     MoveReplicaHDFSTest.testNormalFailedMove

  **Annotations can be removed from the following tests because they haven't 
failed in the last 4 rollups.

  **Methods: 0


Raw fail count by week totals, most recent week first (corresponds to bits):
Week: 0  had  150 failures
Week: 1  had  174 failures
Week: 2  had  142 failures
Week: 3  had  153 failures


********Failures in Hoss' reports in every one of the last 4 rollups.

There were 397 unannotated tests that failed in Hoss' rollups. Ordered by the 
date I downloaded the rollup file, newest->oldest. See above for the dates the 
files were collected 
These tests were NOT BadApple'd or AwaitsFix'd

Failures in the last 4 reports..
   Report   Pct     runs    fails           test
     0123 100.0       35     35      AssignTest.classMethod
     0123 100.0      255    255      
AsyncCallRequestStatusResponseTest.classMethod
     0123   0.8     1916     13      CachingDirectoryFactoryTest.stressTest
     0123 100.0      155    155      CollectionsAPIDistributedZkTest.classMethod
     0123   3.8     1960     51      
CollectionsAPIDistributedZkTest.testBadActionNames
     0123   3.8     1960     51      
CollectionsAPIDistributedZkTest.testMissingNumShards
     0123   3.8     1960     51      
CollectionsAPIDistributedZkTest.testMissingRequiredParameters
     0123   3.8     1960     51      
CollectionsAPIDistributedZkTest.testNoConfigSetExist
     0123   3.8     1960     51      
CollectionsAPIDistributedZkTest.testZeroNumShards
     0123 100.0      205    205      CollectionsAPISolrJTest.classMethod
     0123 100.0      250    250      
ConcurrentUpdateSolrClientMultiCollectionTest.classMethod
     0123 100.0      205    205      DeleteNodeTest.classMethod
     0123   1.8     1565     56      HttpPartitionOnCommitTest.test
     0123   1.1     1546     33      HttpPartitionTest.test
     0123 100.0      250    250      
JsonRequestApiHeatmapFacetingTest.classMethod
     0123 100.0      250    250      JsonRequestApiTest.classMethod
     0123   2.2     1576     53      MultiThreadedOCPTest.test
     0123 100.0      205    205      OverseerModifyCollectionTest.classMethod
     0123   1.7      988     11      TestCircuitBreaker.testResponseWithCBTiming
     0123   0.7     1521      6      
TestCustomStream.testDynamicLoadingCustomStream
     0123   1.3     1256     25      TestHdfsCloudBackupRestore.test
     0123   1.1     1509     26      TestLocalFSCloudBackupRestore.test
     0123   1.4     1513     25      TestPackages.testPluginLoading
     0123  13.7     1982    233      
TestSTUniformSplitPostingFormat.testCheckIntegrityReadsAllBytes
     0123  26.0     1981    451      TestSynonymFilterFactory.testFormat
     0123  26.0     1981    451      TestSynonymFilterFactory.testSynonyms
     0123  26.1     1983    452      TestSysoutsLimits.OverHardLimit
     0123  26.1     1983    452      TestSysoutsLimits.testOverSoftLimit
     0123   0.4     1519      6      TestSystemCollAutoCreate.testAutoCreate
     0123  13.7     1982    233      
TestUniformSplitPostingFormat.testCheckIntegrityReadsAllBytes
     0123 100.0      250    250      UsingSolrJRefGuideExamplesTest.classMethod
     0123 100.0      250    250      ZkConfigFilesTest.classMethod
********************************************

DO NOT ENABLE LIST:
    MoveReplicaHDFSTest.testFailedMove
    MoveReplicaHDFSTest.testNormalFailedMove
    TestControlledRealTimeReopenThread.testCRTReopen
    TestICUNormalizer2CharFilter.testRandomStrings
    TestICUTokenizerCJK
    TestImpersonationWithHadoopAuth.testForwarding
    TestLTRReRankingPipeline.testDifferentTopN
    TestRandomChains


DO NOT ANNOTATE LIST
    CdcrBidirectionalTest.testBiDir
    IndexSizeTriggerTest.testMergeIntegration
    IndexSizeTriggerTest.testMixedBounds
    IndexSizeTriggerTest.testSplitIntegration
    IndexSizeTriggerTest.testTrigger
    InfixSuggestersTest.testShutdownDuringBuild
    ShardSplitTest.test
    ShardSplitTest.testSplitMixedReplicaTypes
    ShardSplitTest.testSplitWithChaosMonkey
    Test2BPostings.test
    TestLatLonShapeQueries.testRandomBig
    TestPackedInts.testPackedLongValues
    TestRandomChains.testRandomChainsWithLargeStrings
    TestTriggerIntegration.testSearchRate

SuppressWarnings count: last week: 4,484, this week: 4,484, delta 0


*************** Files with increased @SuppressWarnings annotations:

Suppress count increase in: 
solr/core/src/test/org/apache/solr/cloud/TestConfigSetsAPIShareSchema.java. 
Was: null, now: 1

*************** Files with decreased @SuppressWarnings annotations:


Processing file (History bit 3): HOSS-2020-10-26.csv
Processing file (History bit 2): HOSS-2020-10-19.csv
Processing file (History bit 1): HOSS-2020-10-12.csv
Processing file (History bit 0): HOSS-2020-10-05.csv


Number of AwaitsFix: 31 Number of BadApples: 3


**Annotated tests that didn't fail in the last 4 weeks.

  **Tests removed from the next two lists because they were specified in 
'doNotEnable' in the properties file
     MoveReplicaHDFSTest.testNormalFailedMove

  **Annotations can be removed from the following tests because they haven't 
failed in the last 4 rollups.

  **Methods: 0


Raw fail count by week totals, most recent week first (corresponds to bits):
Week: 0  had  150 failures
Week: 1  had  174 failures
Week: 2  had  142 failures
Week: 3  had  153 failures


********Failures in Hoss' reports in every one of the last 4 rollups.

There were 397 unannotated tests that failed in Hoss' rollups. Ordered by the 
date I downloaded the rollup file, newest->oldest. See above for the dates the 
files were collected 
These tests were NOT BadApple'd or AwaitsFix'd

Failures in the last 4 reports..
   Report   Pct     runs    fails           test
     0123 100.0       35     35      AssignTest.classMethod
     0123 100.0      255    255      
AsyncCallRequestStatusResponseTest.classMethod
     0123   0.8     1916     13      CachingDirectoryFactoryTest.stressTest
     0123 100.0      155    155      CollectionsAPIDistributedZkTest.classMethod
     0123   3.8     1960     51      
CollectionsAPIDistributedZkTest.testBadActionNames
     0123   3.8     1960     51      
CollectionsAPIDistributedZkTest.testMissingNumShards
     0123   3.8     1960     51      
CollectionsAPIDistributedZkTest.testMissingRequiredParameters
     0123   3.8     1960     51      
CollectionsAPIDistributedZkTest.testNoConfigSetExist
     0123   3.8     1960     51      
CollectionsAPIDistributedZkTest.testZeroNumShards
     0123 100.0      205    205      CollectionsAPISolrJTest.classMethod
     0123 100.0      250    250      
ConcurrentUpdateSolrClientMultiCollectionTest.classMethod
     0123 100.0      205    205      DeleteNodeTest.classMethod
     0123   1.8     1565     56      HttpPartitionOnCommitTest.test
     0123   1.1     1546     33      HttpPartitionTest.test
     0123 100.0      250    250      
JsonRequestApiHeatmapFacetingTest.classMethod
     0123 100.0      250    250      JsonRequestApiTest.classMethod
     0123   2.2     1576     53      MultiThreadedOCPTest.test
     0123 100.0      205    205      OverseerModifyCollectionTest.classMethod
     0123   1.7      988     11      TestCircuitBreaker.testResponseWithCBTiming
     0123   0.7     1521      6      
TestCustomStream.testDynamicLoadingCustomStream
     0123   1.3     1256     25      TestHdfsCloudBackupRestore.test
     0123   1.1     1509     26      TestLocalFSCloudBackupRestore.test
     0123   1.4     1513     25      TestPackages.testPluginLoading
     0123  13.7     1982    233      
TestSTUniformSplitPostingFormat.testCheckIntegrityReadsAllBytes
     0123  26.0     1981    451      TestSynonymFilterFactory.testFormat
     0123  26.0     1981    451      TestSynonymFilterFactory.testSynonyms
     0123  26.1     1983    452      TestSysoutsLimits.OverHardLimit
     0123  26.1     1983    452      TestSysoutsLimits.testOverSoftLimit
     0123   0.4     1519      6      TestSystemCollAutoCreate.testAutoCreate
     0123  13.7     1982    233      
TestUniformSplitPostingFormat.testCheckIntegrityReadsAllBytes
     0123 100.0      250    250      UsingSolrJRefGuideExamplesTest.classMethod
     0123 100.0      250    250      ZkConfigFilesTest.classMethod
********************************************

Failures over the last 4 weeks, but not every week. Ordered most-recent first:



   Report   Pct     runs    fails           test
     012    0.3     1425      4      CloudHttp2SolrClientTest.testRouting
     012    0.6      551      4      ExecutePlanActionTest.testTaskTimeout
     012    0.4     1058     19      
ShardSplitTest.testSplitMixedReplicaTypesLink
     012  100.0        8      8      TestJsonFacets.classMethod
     012    0.7     1031      8      
TestPullReplicaErrorHandling.testCantConnectToLeader
     012    1.1     1031      9      
TestPullReplicaErrorHandling.testPullReplicaDisconnectsFromZooKeeper
     01 3   0.4     1120     13      AssignBackwardCompatibilityTest.test
     01 3   0.4     1116      3      MoveReplicaTest.testFailedMove
     01 3   1.4     1122      6      
SolrCloudExampleTest.testLoadDocsIntoGettingStartedCollection
     01 3 100.0        3      3      TestCloudConsistency.classMethod
     01 3   1.3      587      4      TestDynamicLoading.testDynamicLoading
     01 3   0.4     1107      7      TestPointFields.testFloatPointStats
     01 3   1.2     1189      8      
TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast
     01   100.0        2      2      AnalysisErrorHandlingTest.classMethod
     01     0.6      342      2      
AutoAddReplicasIntegrationTest.testClusterPropOverridesCollecitonProp
     01     0.3      856      2      
CloudHttp2SolrClientTest.testNonRetryableRequests
     01     0.4      630      2      
CollectionsAPIDistributedZkTest.addReplicaTest
     01     0.4      632     18      LeaderFailoverAfterPartitionTest.test
     01     0.3      696      2      
ManagedSchemaRoundRobinCloudTest.testAddFieldsRoundRobin
     01     0.3      696     16      MoveReplicaTest.test
     01     0.6      339      2      
NodeLostTriggerIntegrationTest.testNodeLostTriggerRestoreState
     01     0.6      340      2      
NodeMarkersRegistrationTest.testNodeMarkersRegistration
     01   100.0        2      2      PeerSyncReplicationTest.classMethod
     01     0.3      692     18      RecoveryZkTest.test
     01     0.4      643     18      ShardSplitTest.testSplitLocking
     01     0.4      643     18      
ShardSplitTest.testSplitStaticIndexReplication
     01     0.4      643     18      
ShardSplitTest.testSplitStaticIndexReplicationLink
     01     4.5       39      3      ShardSplitTest.testSplitWithChaosMonkey
     01     0.4      630      2      SolrShardReporterTest.test
     01     0.3      691      2      TestBlobHandler.doBlobHandlerTest
     01     0.9      530      3      
TestDelegationWithHadoopAuth.testDelegationTokenRenew
     01   100.0        2      2      TestLocalFSCloudBackupRestore.classMethod
     01     5.7      429     30      
TestSpanExplanations.testExplainWithoutScoring
     01     5.7      427     30      
TestSpanExplanationsOfNonMatches.testExplainWithoutScoring
     01     0.4      636     18      TestTlogReplica.testDeleteById
     01     0.8      147      2      TestVectorValues.testAddIndexesDirectory01
     0 23   0.4     1185      8      BasicDistributedZkTest.test
     0 23   0.4     1157      3      PeerSyncReplicationTest.test
     0 23   0.4     1164      3      
TestCollectionAPI.testRecreateCollectionAfterFailure
     0 23   0.7     1157      8      TestInPlaceUpdatesDistrib.test
     0 2    1.4      931      6      
CloudHttp2SolrClientTest.testRetryUpdatesWhenClusterStateIsStale
     0 2    0.3      931      2      
CloudHttp2SolrClientTest.testVersionsAreReturned
     0 2  100.0        2      2      DeleteStatusTest.classMethod
     0 2    0.4      675      2      TestCloudSchemaless.test
     0 2    1.0      694      4      TestDistributedSearch.test
     0 2    0.3      742      2      TestPrepRecovery.testLeaderUnloaded
     0  3   0.6      401      3      
ComputePlanActionTest.testSelectedCollectionsByPolicy
     0  3   0.3      814      2      DeleteShardTest.test
     0  3   0.3      812      2      
DocValuesNotIndexedTest.testGroupingDVOnlySortFirst
     0  3   0.4      761      4      TestRandomRequestDistribution.test
     0  3   0.3      813      2      
TestSegmentSorting.testSegmentTerminateEarly
     0  3 100.0        2      2      TestSizeLimitedDistributedMap.classMethod
     0    100.0       50     50      AddReplicaTest.classMethod
     0      0.3      363      1      AnalyticsMergeStrategyTest.test
     0      1.6       61      1      
CloudHttp2SolrClientWireMockTest.testConcurrentParallelUpdates
     0    100.0       30     30      
CollectionsAPIAsyncDistributedZkTest.classMethod
     0      2.9      344     10      
CollectionsAPIAsyncDistributedZkTest.testAsyncIdRaceCondition
     0      3.3       61      2      
CollectionsAPIDistClusterPerZkTest.testCollectionReload
     0      0.4      273      1      
CollectionsAPIDistributedZkTest.testCoresAreDistributedAcrossNodes
     0      3.2      344     11      
CollectionsAPIDistributedZkTest.testDeleteNonExistentCollection
     0      0.6      159      1      ComputePlanActionTest.testNodeAdded
     0    100.0       50     50      ConfigSetsAPITest.classMethod
     0      0.4      278      1      ConnectionManagerTest.testLikelyExpired
     0      0.3      334      1      
CustomCollectionTest.testCreateShardRepFactor
     0      0.6      334      2      
CustomCollectionTest.testCustomCollectionsAPI
     0    100.0       30     30      DeleteReplicaTest.classMethod
     0      0.3      335      1      DeleteReplicaTest.deleteReplicaByCount
     0      0.4      278      1      
HealthCheckHandlerTest.testHealthCheckHandler
     0    100.0        2      2      HttpSolrCallGetCoreTest.classMethod
     0      0.3      354      1      HttpSolrCallGetCoreTest.test
     0    100.0        8      8      MissingSegmentRecoveryTest.classMethod
     0      0.3      359      1      OverseerModifyCollectionTest.testModifyColl
     0    100.0        1      1      RollingRestartTest.classMethod
     0      0.6      154      1      SearchRateTriggerTest.testWaitForElapsed
     0     14.1       71     10      SimpleCollectionCreateDeleteTest.test
     0      0.4      244      1      
SoftAutoCommitTest.testSoftCommitWithinAndHardCommitMaxTimeMixedAdds
     0      0.4      278      1      
SolrCloudReportersTest.testExplicitConfiguration
     0      0.3      371      1      
SolrExampleStreamingBinaryTest.testCommitWithinOnAdd
     0      0.3      363      1      
StatsReloadRaceTest.testParallelReloadAndStats
     0      0.6      358      2      TestChildDocTransformer.testAllParams
     0      0.6      358      2      TestChildDocTransformer.testParentFilter
     0      0.3      338      1      
TestCloudCollectionsListeners.testCollectionDeletion
     0      0.9      338      3      
TestCloudCollectionsListeners.testSimpleCloudCollectionsListener
     0      0.4      279      1      TestCloudPivotFacet.test
     0      4.8       21      1      
TestCompressingStoredFieldsFormat.testBigDocuments
     0      4.4      273     12      TestContainerPlugin.testApi
     0      0.5      380      2      TestDemoParallelLeafReader.testBasic
     0      1.3      383      5      
TestDemoParallelLeafReader.testRandomMultipleSchemaGens
     0      2.2      279      6      
TestDistributedStatsComponentCardinality.test
     0    100.0        1      1      
TestExclusionRuleCollectionAccess.classMethod
     0      0.4      251      1      TestFileListEntityProcessor.testNTOT
     0    100.0        1      1      TestHdfsCloudBackupRestore.classMethod
     0      0.3      379      1      TestNRTThreads.testNRTThreads
     0      0.6      154      1      TestNamedUpdateProcessors.test
     0      0.4      283      1      TestPackages.testSchemaPlugins
     0      2.1      384      8      
TestRandomChains.testRandomChainsWithLargeStrings
     0      3.5      284     10      TestReRankQParserPlugin.testMinExactCount
     0    100.0        2      2      TestSegmentSorting.classMethod
     0      0.4      279      1      TestShortCircuitedRequests.test
     0    100.0        1      1      
TestWaitForStateWithJettyShutdowns.classMethod
     0    100.0        1      1      TestWithCJKBigramFilter.classMethod
     0      0.3      377      1      TestWithCJKBigramFilter.testMix2
     0      0.3      335      1      
ZkShardTermsTest.testParticipationOfReplicas
      123   0.3     1247      4      
ConnectionManagerTest.testReconnectWhenZkDisappeared
      123   0.3     1243      3      
DeleteReplicaTest.deleteReplicaAndVerifyDirectoryCleanup
      123   4.8     1252     24      HttpPartitionWithTlogReplicasTest.test
      123   0.3     1242      3      
LBSolrClientTest.testServerIteratorTimeAllowed
      123  50.0        6      3      SharedFSAutoReplicaFailoverTest.test
      123   0.0     7512      3      TestJsonFacets.testTolerant
      123 100.0        4      4      TestReplicationHandler.classMethod
      123   0.6     1244      9      TestSolrConfigHandlerCloud.test
      12    4.8      764     18      BasicDistributedZk2Test.test
      12    4.2      764     16      
ChaosMonkeySafeLeaderWithPullReplicasTest.test
      12    0.4      516      4      OverseerTest.testShardLeaderChange
      12    2.8      764     13      ReplaceNodeTest.test
      12    5.1      768     20      ReplicationFactorTest.test
      12    5.0      776     20      ShardSplitTest.testSplitMixedReplicaTypes
      12  100.0        2      2      TestBM25SimilarityFactory.classMethod
      12    7.1       28      2      
TestIndexingSequenceNumbers.testStressConcurrentCommit
      12    7.1       28      2      TestInetAddressRangeQueries.testRandomBig
      12  100.0        2      2      TestLegacyBM25SimilarityFactory.classMethod
      12    0.6      757      3      TestPointFields.testDoublePointStats
      1 3   1.1      840      7      ChaosMonkeyNothingIsSafeTest.test
      1 3   4.8      833     19      
CollectionsAPIAsyncDistributedZkTest.testAsyncRequests
      1 3   0.3      845      2      MathExpressionTest.testZipFDistribution
      1 3   0.5      427      2      
MetricTriggerIntegrationTest.testMetricTrigger
      1 3   0.3      839      3      RollingRestartTest.test
      1 3   5.3      839     20      
TestCloudSearcherWarming.testPeersyncFailureReplicationSuccess
      1 3   0.3      843      2      
TestConfigSetsAPIExclusivity.testAPIExclusivity
      1 3   0.6      418      2      
TestRequestRateLimiter.testConcurrentQueries
      1 3   5.0      838     19      TestTlogReplica.testRebalanceLeaders
      1 3   4.7      838     18      TestTlogReplica.testRemoveLeader
      1     0.2      494      1      BJQParserTest.testToParentFilters
      1     4.2      357     15      
ChaosMonkeyNothingIsSafeWithPullReplicasTest.test
      1     1.4      355      5      ChaosMonkeySafeLeaderTest.test
      1   100.0        4      4      CloudHttp2SolrClientTest.classMethod
      1     0.4      494      2      
CloudHttp2SolrClientTest.preferReplicaTypesTest
      1     0.2      494      1      
CloudHttp2SolrClientTest.singleShardedPreferenceRules
      1     0.2      494      1      
CloudHttp2SolrClientTest.testParallelUpdateQTime
      1     0.3      357      1      
CollectionsAPIDistributedZkTest.testCreateNodeSet
      1     0.3      357      1      
CustomCollectionTest.testRouteFieldForImplicitRouter
      1     5.0      359     18      
DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplica
      1     7.1       14      1      ForceLeaderTest.testReplicasInLowerTerms
      1     7.7       13      1      
ForceLeaderWithTlogReplicasTest.testReplicasInLowerTerms
      1     0.3      357      1      InfixSuggestersTest.testReloadDuringBuild
      1   100.0        4      4      
JsonQueryRequestHeatmapFacetingTest.classMethod
      1     4.8      357     17      LeaderFailureAfterFreshStartTest.test
      1     4.8      356     17      
LeaderVoteWaitTimeoutTest.testMostInSyncReplicasCanWinElection
      1     4.8      357     17      
MigrateRouteKeyTest.multipleShardMigrateTest
      1     4.8      357     17      
MissingSegmentRecoveryTest.testLeaderRecovery
      1     4.8      357     17      RecoveryAfterSoftCommitTest.test
      1     0.3      358      1      ReindexCollectionTest.testReshapeReindexing
      1     0.3      357      1      ShardRoutingTest.test
      1   100.0        2      2      ShardSplitTest.classMethod
      1     5.9       17      1      ShardSplitTest.test
      1     0.2      495      1      
SolrExampleBinaryHttp2Test.testCommitWithinOnAdd
      1   100.0        1      1      SolrXmlInZkTest.classMethod
      1     4.8      356     17      SyncSliceTest.test
      1   100.0        1      1      TestAtomicUpdateErrorCases.classMethod
      1     4.8      357     17      TestCloudRecovery.corruptedLogTest
      1     5.0      357     18      TestCloudRecovery2.test
      1   100.0        1      1      TestCloudSearcherWarming.classMethod
      1     0.1     1050      1      TestJsonFacets.testFacetValueTypesDistrib
      1     0.0     2166      1      TestJsonFacets.testStatsDistrib
      1     4.7      358     17      TestLeaderElectionWithEmptyReplica.test
      1   100.0        1      1      TestMiniSolrCloudClusterSSL.classMethod
      1   100.0        1      1      TestPHPSerializedResponseWriter.classMethod
      1   100.0        3      3      TestPackages.classMethod
      1     0.3      358      1      
TestRandomFlRTGCloud.testRandomizedUpdatesAndRTGs
      1     4.7      358     17      TestReplicationHandler.doTestDetails
      1     4.7      358     17      
TestReplicationHandler.doTestIndexAndConfigAliasReplication
      1     4.7      358     17      
TestReplicationHandler.doTestIndexAndConfigReplication
      1     4.7      358     17      
TestReplicationHandler.doTestIndexFetchOnLeaderRestart
      1     4.7      358     17      
TestReplicationHandler.doTestIndexFetchWithLeaderUrl
      1     4.7      358     17      
TestReplicationHandler.doTestReplicateAfterCoreReload
      1     4.7      358     17      
TestReplicationHandler.doTestReplicateAfterStartup
      1     4.7      358     17      
TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity
      1     4.7      358     17      TestReplicationHandler.doTestStopPoll
      1     4.7      358     17      
TestReplicationHandler.doTestStressReplication
      1     4.7      358     17      
TestReplicationHandler.testRateLimitedReplication
      1     0.1     4970      6      
TestSolr4Spatial2.testLLPDecodeIsStableAndPrecise
      1     4.5      355     16      TestSolrCloudSnapshots.testSnapshots
      1     0.6      357      2      TestStressCloudBlindAtomicUpdates.test_dv
      1     0.6      357      2      
TestStressCloudBlindAtomicUpdates.test_dv_idx
      1     0.6      357      2      
TestStressCloudBlindAtomicUpdates.test_dv_stored
      1     0.6      357      2      
TestStressCloudBlindAtomicUpdates.test_dv_stored_idx
      1     0.6      357      2      
TestStressCloudBlindAtomicUpdates.test_stored_idx
      1     3.9      358     14      TestTlogReplica.testAddDocs
      1     4.7      358     17      TestTlogReplica.testBasicLeaderElection
      1     4.7      358     17      TestTlogReplica.testKillLeader
      1     4.7      358     17      TestTlogReplica.testOnlyLeaderIndexes
      1     4.7      358     17      
TestTlogReplica.testOutOfOrderDBQWithInPlaceUpdates
      1     4.7      358     17      TestTlogReplica.testRecovery
      1     7.1       14      1      TlogReplayBufferedWhileIndexingTest.test
      1     0.2      494      1      
UninvertDocValuesMergePolicyTest.testIndexAndAddDocValues
      1     5.0      357     18      UnloadDistributedZkTest.test
       23   0.2     1078     19      
ConcurrentUpdateSolrClientMultiCollectionTest.testEnsureDocumentsSentToCorrectCollection
       23   0.3      549      2      
StreamDecoratorTest.testParallelTerminatingDaemonUpdateStream
       23   0.3      537      2      
StreamExpressionTest.testFeaturesSelectionStream
       23   0.2      879      2      
TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader
       23 100.0        2      2      TestCloudSchemaless.classMethod
       23   0.2      885      2      TestCollectionAPI.test
       23   1.5      919     41      TestExportWriter.testExpr
       23   0.2      887      2      
TestSolrCloudWithDelegationTokens.testDelegationTokenRenew
       23   0.2     4474    150      
TestUnifiedHighlighterStrictPhrases.testBasics
       2    0.2      566      1      
AsyncCallRequestStatusResponseTest.testAsyncCallStatusResponse
       2  100.0        1      1      BinaryUpdateRequestHandlerTest.classMethod
       2    0.2      569      1      
CloudHttp2SolrClientTest.testInitializationWithSolrUrls
       2  100.0        1      1      CloudSolrClientRetryTest.classMethod
       2  100.0        1      1      CloudSolrClientTest.classMethod
       2  100.0        1      1      CrossCollectionJoinQueryTest.classMethod
       2    0.5      401      2      CustomHighlightComponentTest.test
       2  100.0        1      1      DefaultValueUpdateProcessorTest.classMethod
       2    0.2      402      1      
DistributedQueueTest.testDistributedQueueBlocking
       2    0.4      284      1      
DistributedUpdateProcessorTest.testVersionDelete
       2    8.3       12      1      HdfsBasicDistributedZkTest.test
       2  100.0        1      1      IndexSchemaTest.classMethod
       2  100.0        1      1      JdbcTest.classMethod
       2    0.5      405      2      
MetricsHistoryWithAuthIntegrationTest.testValuesAreCollected
       2  100.0        1      1      NotRequiredUniqueKeyTest.classMethod
       2    0.4      283      1      OverseerTest.testReplay
       2  100.0        1      1      
PreAnalyzedFieldManagedSchemaCloudTest.classMethod
       2    0.5      209      1      
ScheduledMaintenanceTriggerTest.testInactiveMarkersCleanup
       2  100.0        1      1      ShardRoutingCustomTest.classMethod
       2    0.3      366      1      
SoftAutoCommitTest.testSoftAndHardCommitMaxTimeMixedAdds
       2    0.2      409      1      
SolrExampleJettyTest.testCommitWithinOnDelete
       2  100.0        1      1      SortSpecParsingTest.classMethod
       2    0.2      404      1      
StreamDecoratorTest.testParallelDaemonUpdateStream
       2  100.0        1      1      TestBadConfig.classMethod
       2    0.3      590      2      TestBoolean2.testRandomQueries
       2    0.2      572      1      TestCloudJSONFacetJoinDomain.testRandom
       2  100.0        1      1      TestCollectionAPI.classMethod
       2    0.2      405      1      
TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete
       2  100.0        1      1      TestConfigSetsAPIExclusivity.classMethod
       2  100.0        1      1      TestDFISimilarityFactory.classMethod
       2    0.2      590      1      TestDemoParallelLeafReader.testRandom
       2    0.2      590      1      
TestDemoParallelLeafReader.testRandomMultipleSchemaGensSameField
       2  100.0        1      1      TestDistributedMap.classMethod
       2    0.5      207      1      TestDynamicLoadingUrl.testDynamicLoadingUrl
       2    0.5      407      2      
TestFieldSortOptimizationSkipping.testDocSort
       2    0.8      265      2      
TestFieldSortOptimizationSkipping.testDocSortOptimizationWithAfter
       2    0.5      407      2      
TestFieldSortOptimizationSkipping.testFloatSortOptimization
       2    0.2      407      1      
TestFieldSortOptimizationSkipping.testLongSortOptimization
       2    0.5      407      2      
TestFieldSortOptimizationSkipping.testSortOptimizationEqualValues
       2    0.2      407      1      
TestFieldSortOptimizationSkipping.testSortOptimizationWithMissingValues
       2    0.2      590      1      TestIndexFileDeleter.testExcInDecRef
       2    0.2      406      1      TestPrepRecovery.testLeaderNotResponding
       2  100.0        1      1      TestQuerySenderListener.classMethod
       2  100.0        1      1      TestSearchPerf.classMethod
       2    0.2      567      1      
TestSegmentSorting.testAtomicUpdateOfSegmentSortField
       2    0.5      204      1      TestSimTriggerIntegration.testEventQueue
       2    3.0      607     18      
TestSimpleSearchEquivalence.testBooleanReqExclVersusTerm
       2  100.0        1      1      TestSimpleTextNormsFormat.classMethod
       2    0.2      590      1      TestSimpleTextNormsFormat.testShortRange
       2  100.0        1      1      TestSkipOverseerOperations.classMethod
       2    0.5      207      1      
TestSnapshotCloudManager.testComplexSnapshot
       2    0.5      207      1      
TestSnapshotCloudManager.testSimulatorFromSnapshot
       2    0.3      590      2      
TestTopFieldCollector.testSortWithoutTotalHitTracking
       2  100.0        1      1      TestWordDelimiterFilterFactory.classMethod
       2    0.2      582      1      
TestWordDelimiterFilterFactory.testRetainPositionIncrement
       2    1.0      209      2      
TriggerSetPropertiesIntegrationTest.testSetProperties
        3   0.4      236      1      
CdcrVersionReplicationTest.testCdcrDocVersions
        3   0.2      499      1      
CloudSolrClientTest.testRetryUpdatesWhenClusterStateIsStale
        3   0.4      242      1      
ComputePlanActionTest.testNodeAddedTriggerWithAddReplicaPreferredOpReplicaType_1Shard
        3   0.4      242      1      
ComputePlanActionTest.testSelectedCollectionsByName
        3   3.5      509     18      
ConcurrentUpdateHttp2SolrClientMultiCollectionTest.testEnsureDocumentsSentToCorrectCollection
        3   0.8      484      4      DistribJoinFromCollectionTest.testNoScore
        3   0.2      484      1      DistribJoinFromCollectionTest.testScore
        3 100.0        1      1      DistributedDebugComponentTest.classMethod
        3   0.2      481      1      DistributedIntervalFacetingTest.test
        3 100.0        1      1      DistributedVersionInfoTest.classMethod
        3   0.4      240      1      ExecutePlanActionTest.testTaskFail
        3 100.0        1      1      HdfsNNFailoverTest.classMethod
        3   0.4      242      1      IndexSizeTriggerTest.testSplitIntegration
        3   4.7      511     24      
JsonLoaderTest.testAddBigIntegerValueToTrieField
        3   0.2      482      1      
OverseerTaskQueueTest.testDistributedQueueBlocking
        3   0.2      482      1      OverseerTaskQueueTest.testPeekElements
        3   0.2      476      1      ReindexCollectionTest.testLossySchema
        3   0.4      239      1      
ScheduledTriggerIntegrationTest.testScheduledTrigger
        3   0.2      482      1      ShardSplitTest.testSplitShardWithRuleLink
        3   0.2      478      1      
SimpleCollectionCreateDeleteTest.testCreateAndDeleteThenCreateAgain
        3   0.2      430      1      
SoftAutoCommitTest.testHardCommitWithinAndSoftCommitMaxTimeMixedAdds
        3   0.2      493      1      
SolrExampleEmbeddedTest.testCommitWithinOnAdd
        3 100.0        1      1      StreamDecoratorTest.classMethod
        3   0.2      479      1      StreamDecoratorTest.testExecutorStream
        3   0.2      494      1      StreamDecoratorTest.testParallelFetchStream
        3   0.4      486      2      SystemCollectionCompatTest.testBackCompat
        3   3.7      492     18      
TestBulkSchemaAPI.testAddFieldMatchingExistingDynamicField
        3   3.7      492     18      
TestBulkSchemaAPI.testAddFieldWithExistingCatchallDynamicField
        3   3.7      492     18      TestBulkSchemaAPI.testAddNewFieldAndQuery
        3   3.7      492     18      TestBulkSchemaAPI.testAnalyzerClass
        3   3.7      492     18      TestBulkSchemaAPI.testCopyFieldRules
        3   3.7      492     18      TestBulkSchemaAPI.testDeleteAndReplace
        3   3.7      492     18      TestBulkSchemaAPI.testMultipleCommands
        3   3.7      492     18      TestBulkSchemaAPI.testSimilarityParser
        3   3.7      492     18      
TestBulkSchemaAPI.testSortableTextFieldWithAnalyzer
        3   0.2      476      1      TestCloudManagedSchema.test
        3 100.0        1      1      TestCloudPivotFacet.classMethod
        3 100.0        1      1      TestConfigSetsAPI.classMethod
        3   0.4      240      1      TestCryptoKeys.test
        3 100.0        1      1      TestDownShardTolerantSearch.classMethod
        3   0.2      483      1      
TestIndexWriterMergePolicy.testStressUpdateSameDocumentWithMergeOnCommit
        3   0.2      484      1      TestLBHttp2SolrClient.testSimple
        3   0.2      484      1      TestLBHttp2SolrClient.testTwoServers
        3   0.2      496      1      TestLockTree.testLocks
        3   3.5      508     18      
TestManagedStopFilterFactory.testManagedStopwords
        3   3.5      508     18      
TestManagedSynonymFilterFactory.testManagedSynonyms
        3   3.6      507     18      
TestManagedSynonymGraphFilterFactory.testManagedSynonyms
        3 100.0        1      1      TestOnReconnectListenerSupport.classMethod
        3 100.0        1      1      TestRandomFlRTGCloud.classMethod
        3   0.3      397      1      TestRecoveryHdfs.testExistOldBufferLog
        3   0.3      397      1      TestRecoveryHdfs.testRecoveryMultipleLogs
        3   0.2      483      1      TestReplicaProperties.test
        3 100.0        1      1      
TestStressCloudBlindAtomicUpdates.classMethod
        3   3.5      509     18      TestUseDocValuesAsStored2.testSchemaAPI
        3   0.2      499      1      ZkConfigFilesTest.testCanUploadConfigToZk
        3   0.2      480      1      ZookeeperStatusHandlerTest.monitorZookeeper



***********************Annotations report

*****************AwaitsFix Annotations:


************Lucene AwaitsFix
TestAllFilesDetectBitFlips.TestAllFilesDetectBitFlips suite
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-9356";)

TestAllFilesDetectTruncation.TestAllFilesDetectTruncation suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-9409";)

TestControlledRealTimeReopenThread.testCRTReopen
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5737";)

TestICUNormalizer2CharFilter.testRandomStrings
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5595";)

TestICUTokenizerCJK.TestICUTokenizerCJK suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8222";)

TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-7161";)


    ************Solr AwaitsFix
CollectionsAPISolrJTest.testCreateAndDeleteShard
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13021";)

ConcurrentCreateRoutedAliasTest.ConcurrentCreateRoutedAliasTest suite
   @LuceneTestCase.AwaitsFix(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-12386";) // "Can't find resource"

LeaderTragicEventTest.LeaderTragicEventTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13237";)

MoveReplicaHDFSTest.MoveReplicaHDFSTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13924";)

MoveReplicaHDFSTest.testFailedMove
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12080";) // 
added 03-Oct-2018

RoutedAliasUpdateProcessorTest.alias,
   
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13696";)

SSLMigrationTest.SSLMigrationTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
17-Mar-2018

SaslZkACLProviderTest.testSaslZkACLProvider
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13075";)

SecurityHeadersTest.SecurityHeadersTest suite
   
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-14903";)

SolrExporterIntegrationTest.SolrExporterIntegrationTest suite
   
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13786";)

Tagger2Test.testStopWords
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-8344";)

TestImpersonationWithHadoopAuth.testForwarding
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/HADOOP-9893";)

TestJsonFacetRefinement.testIndexAscRefineConsistency
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-14595";)

TestJsonFacetRefinement.testProcessEmptyRefinement
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556";)

TestJsonFacetRefinement.testSortedSubFacetRefinementWhenParentOnlyReturnedByOneShardProcessEmpty
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556";)

TestLTRReRankingPipeline.testDifferentTopN
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-11134";)

TestMinMaxOnMultiValuedField.testDoubleFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestMinMaxOnMultiValuedField.testFloatFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestMinMaxOnMultiValuedField.testIntFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestMinMaxOnMultiValuedField.testLongFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestPullReplica.TestPullReplica suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

TestStressRecovery.TestStressRecovery suite
   
@LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 6-Sep-2018

TestTlogReplayVsRecovery.TestTlogReplayVsRecovery suite
   
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13486;https://issues.apache.org/jira/browse/SOLR-14183";)

TimeRoutedAliasUpdateProcessorTest.testDateMathInStart
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13943";)

TriLevelCompositeIdRoutingTest.test
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13369";)



*****************BadApple Annotations:

************Lucene BadApple

************Solr BadApple
MoveReplicaHDFSTest.testNormalFailedMove
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
14-Oct-2018

SharedFSAutoReplicaFailoverTest.SharedFSAutoReplicaFailoverTest suite
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // added 20-Jul-2018

TimeRoutedAliasUpdateProcessorTest.TimeRoutedAliasUpdateProcessorTest suite
   @LuceneTestCase.BadApple(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-13059";)



---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to