Largely ignore the fact that weeks 0 and 1 had so many failures, that was due 
to Jenkins running out of space, which bled over into the week0 report.

This is the first one that reports the number of SuppressWarnings annotations 
that we can use as a baseline. If I start adding SuppressWarnings through the 
code as per my other e-mail, this number will increase drastically over the 
next while, but ignore it for now.

**********

SuppressWarnings count: last week: 973, this week: 973, delta 0


Processing file (History bit 3): HOSS-2020-05-11.csv
Processing file (History bit 2): HOSS-2020-05-04.csv
Processing file (History bit 1): HOSS-2020-04-27.csv
Processing file (History bit 0): HOSS-2020-04-20.csv


Number of AwaitsFix: 42 Number of BadApples: 4



Raw fail count by week totals, most recent week first (corresponds to bits):
Week: 0  had  102 failures
Week: 1  had  343 failures
Week: 2  had  86 failures
Week: 3  had  78 failures


********Failures in Hoss' reports for the last 4 rollups.

There were 484 unannotated tests that failed in Hoss' rollups. Ordered by the 
date I downloaded the rollup file, newest->oldest. See above for the dates the 
files were collected 
These tests were NOT BadApple'd or AwaitsFix'd

Failures in the last 4 reports..
   Report   Pct     runs    fails           test
     0123   0.5     1566     10      
ConnectionManagerTest.testReconnectWhenZkDisappeared
     0123   0.3     1556     10      ExecutePlanActionTest.testTaskTimeout
     0123   0.8     1360     20      MultiThreadedOCPTest.test
     0123   0.8     1566     10      RollingRestartTest.test
     0123   0.3     1567     11      SearchRateTriggerTest.testWaitForElapsed
     0123   0.5     1557     10      TestCryptoKeys.test
     0123   0.8     1474      8      TestInPlaceUpdatesDistrib.test
     0123   0.3     1582     13      
TestIndexWriterDelete.testDeleteAllNoDeadLock
     0123   0.5     1500     18      TestPackages.testPluginLoading
********************************************

DO NOT ENABLE LIST:
    MoveReplicaHDFSTest.testFailedMove
    MoveReplicaHDFSTest.testNormalFailedMove
    TestControlledRealTimeReopenThread.testCRTReopen
    TestICUNormalizer2CharFilter.testRandomStrings
    TestICUTokenizerCJK
    TestImpersonationWithHadoopAuth.testForwarding
    TestLTRReRankingPipeline.testDifferentTopN
    TestRandomChains


DO NOT ANNOTATE LIST
    CdcrBidirectionalTest.testBiDir
    IndexSizeTriggerTest.testMergeIntegration
    IndexSizeTriggerTest.testMixedBounds
    IndexSizeTriggerTest.testSplitIntegration
    IndexSizeTriggerTest.testTrigger
    InfixSuggestersTest.testShutdownDuringBuild
    ShardSplitTest.test
    ShardSplitTest.testSplitMixedReplicaTypes
    ShardSplitTest.testSplitWithChaosMonkey
    Test2BPostings.test
    TestLatLonShapeQueries.testRandomBig
    TestPackedInts.testPackedLongValues
    TestRandomChains.testRandomChainsWithLargeStrings
    TestTriggerIntegration.testSearchRate

SuppressWarnings count: last week: 973, this week: 973, delta 0


Processing file (History bit 3): HOSS-2020-05-11.csv
Processing file (History bit 2): HOSS-2020-05-04.csv
Processing file (History bit 1): HOSS-2020-04-27.csv
Processing file (History bit 0): HOSS-2020-04-20.csv


Number of AwaitsFix: 42 Number of BadApples: 4


**Annotated tests that didn't fail in the last 4 weeks.

  **Tests removed from the next two lists because they were specified in 
'doNotEnable' in the properties file
     MoveReplicaHDFSTest.testNormalFailedMove

  **Annotations can be removed from the following tests because they haven't 
failed in the last 4 rollups.

  **Methods: 0


Raw fail count by week totals, most recent week first (corresponds to bits):
Week: 0  had  102 failures
Week: 1  had  343 failures
Week: 2  had  86 failures
Week: 3  had  78 failures


********Failures in Hoss' reports for the last 4 rollups.

There were 484 unannotated tests that failed in Hoss' rollups. Ordered by the 
date I downloaded the rollup file, newest->oldest. See above for the dates the 
files were collected 
These tests were NOT BadApple'd or AwaitsFix'd

Failures in the last 4 reports..
   Report   Pct     runs    fails           test
     0123   0.5     1566     10      
ConnectionManagerTest.testReconnectWhenZkDisappeared
     0123   0.3     1556     10      ExecutePlanActionTest.testTaskTimeout
     0123   0.8     1360     20      MultiThreadedOCPTest.test
     0123   0.8     1566     10      RollingRestartTest.test
     0123   0.3     1567     11      SearchRateTriggerTest.testWaitForElapsed
     0123   0.5     1557     10      TestCryptoKeys.test
     0123   0.8     1474      8      TestInPlaceUpdatesDistrib.test
     0123   0.3     1582     13      
TestIndexWriterDelete.testDeleteAllNoDeadLock
     0123   0.5     1500     18      TestPackages.testPluginLoading
********************************************

Failures over the last 4 weeks, but not every week. Ordered most-recent first:



     012    0.3     1094      3      
ScheduledTriggerIntegrationTest.testScheduledTrigger
     012    0.5     1161      6      TestPointFields.testFloatPointStats
     012    0.3     1160      3      TestWithCollection.testAddReplicaSimple
     01 3   0.8     1201      9      HttpPartitionTest.test
     01 3   1.5     1173     12      HttpPartitionWithTlogReplicasTest.test
     01 3   0.5     1204      5      ShardSplitTest.testSplitShardWithRuleLink
     01 3   0.3     1185      3      
TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast
     01 3   0.3     1186      6      TestSolrConfigHandlerCloud.test
     01     3.8      777     26      BasicDistributedZkTest.test
     01     0.3      748      3      ComputePlanActionTest.testNodeAdded
     01     0.3      794      3      DeleteReplicaTest.deleteReplicaByCount
     01     0.3      794      6      
DeleteReplicaTest.deleteReplicaFromClusterState
     01     0.3      794      8      DeleteReplicaTest.deleteReplicaOnIndexing
     01     0.3      749      3      
DistribDocExpirationUpdateProcessorTest.testNoAuth
     01     0.3      789      2      
LeaderElectionIntegrationTest.testSimpleSliceLeaderElection
     01     0.3      753      2      MoveReplicaTest.testFailedMove
     01     0.3      783      2      ReplaceNodeTest.test
     01     0.3      776      2      
SolrCloudReportersTest.testExplicitConfiguration
     01     0.3      778      2      
TestCloudSearcherWarming.testPeersyncFailureReplicationSuccess
     01     0.5      786      3      
TestPullReplicaErrorHandling.testCantConnectToLeader
     01     0.5      769      4      TestSimScenario.testAutoAddReplicas
     01     0.3      755      3      TestWithCollection.testAddReplicaWithPolicy
     01     0.3      755      2      TestWithCollection.testNodeAdded
     0 23   1.3     1145     18      SystemCollectionCompatTest.testBackCompat
     0 2    0.3      607      2      
TestDelegationWithHadoopAuth.testDelegationTokenRenew
     0  3   0.5      645      3      
HealthCheckHandlerTest.testHealthCheckHandler
     0  3   0.3      793      2      ShardSplitTest.testSplitShardWithRule
     0  3   0.3      776      2      TestCloudJSONFacetSKG.testRandom
     0  3   0.3      782      2      TestCloudRecovery2.test
     0      2.8      400     11      BasicDistributedZk2Test.test
     0      0.3      382      1      
CollectionsAPIAsyncDistributedZkTest.testAsyncRequests
     0      0.5      386      2      
DocValuesNotIndexedTest.testGroupingDVOnlySortFirst
     0      0.5      392      2      
FullSolrCloudDistribCmdsTest.testBasicUpdates
     0      0.3      392      1      
FullSolrCloudDistribCmdsTest.testConcurrentIndexing
     0      0.3      392      1      
FullSolrCloudDistribCmdsTest.testIndexQueryDeleteHierarchical
     0      0.3      392      1      
FullSolrCloudDistribCmdsTest.testThatCantForwardToLeaderFails
     0     26.9      349     94      FuzzySearchTest.testTooComplex
     0      0.3      391      1      HttpPartitionOnCommitTest.test
     0      0.3      383      1      MathExpressionTest.testZipFDistribution
     0      0.3      383      1      MetricsHandlerTest.test
     0      0.3      383      1      MetricsHandlerTest.testCompact
     0      0.3      390      1      
MetricsHistoryWithAuthIntegrationTest.testValuesAreCollected
     0      0.3      384      1      
MigrateRouteKeyTest.multipleShardMigrateTest
     0      5.3       19      1      
MoveReplicaHDFSFailoverTest.testDataDirAndUlogAreMaintained
     0      5.3       19      1      
MoveReplicaHDFSFailoverTest.testOldReplicaIsDeleted
     0      5.3       19      1      
MoveReplicaHDFSFailoverTest.testOldReplicaIsDeletedInRaceCondition
     0      0.3      386      1      MoveReplicaTest.test
     0      0.3      384      1      ReindexCollectionTest.testFailure
     0      0.3      386      1      ShardRoutingCustomTest.test
     0      0.3      333      1      
SoftAutoCommitTest.testHardCommitWithinAndSoftCommitMaxTimeMixedAdds
     0      0.3      333      1      
SoftAutoCommitTest.testSoftCommitWithinAndHardCommitMaxTimeMixedAdds
     0      0.3      387      1      
TestAssertingStoredFieldsFormat.testNumericField
     0      0.3      383      1      
TestBuiltInEvaluators.testDateFormatEvaluator
     0      0.3      386      1      
TestCollectionsAPIViaSolrCloudCluster.testStopAllStartAll
     0      0.3      385      1      
TestCustomStream.testDynamicLoadingCustomStream
     0     33.3       30     10      
TestNRTReplication.testIndexingWhileReplicaIsDown
     0      2.5      394     10      
TestPointFields.testLongPointFieldMultiValuedRangeFacet
     0      0.3      397      1      
TestReplicationHandler.doTestIndexAndConfigAliasReplication
     0      0.3      383      1      
TestSkipOverseerOperations.testSkipDownOperations
     0      2.8      395     11      
TestXYMultiPolygonShapeQueries.testRandomMedium
     0      0.3      385      1      TriggerCooldownIntegrationTest.testCooldown
      123   0.5     1165      4      CustomHighlightComponentTest.test
      123   1.0     1168      6      
NodeMarkersRegistrationTest.testNodeMarkersRegistration
      123   3.8       86      5      ShardSplitTest.testSplitWithChaosMonkey
      123   0.3     1158      3      UnloadDistributedZkTest.test
      12    0.7      793      4      LeaderFailoverAfterPartitionTest.test
      12    0.2      768      2      ShardRoutingTest.test
      12   63.2       76     37      StressHdfsTest.test
      12    2.6      807     22      TestAllFilesHaveChecksumFooter.test
      12    2.6      808     22      TestAllFilesHaveCodecHeader.test
      12    0.2      769      2      TestCloudSchemaless.test
      12    0.2      769      2      TestDynamicLoading.testDynamicLoading
      12    0.3      707      2      TestDynamicLoadingUrl.testDynamicLoadingUrl
      12   27.1       83     19      TestSQLHandler.doTest
      12    0.2      794     12      TestSameScoresWithThreads.test
      12    2.6      806     22      TestShardSearching.testSimple
      12    0.5      726      4      TestSimScenario.testSplitShard
      12    1.1      726      7      TestSimScenario.testSuggestions
      1 3   0.3      795      2      
CdcrVersionReplicationTest.testCdcrDocVersions
      1 3   0.8      747      4      
CloudHttp2SolrClientTest.testRetryUpdatesWhenClusterStateIsStale
      1 3   1.4      770      7      CollectionsAPISolrJTest.testColStatus
      1 3   0.3      767      2      
DocValuesNotIndexedTest.testGroupingDVOnlySortLast
      1 3   0.3      750      2      TestLBHttp2SolrClient.testTwoServers
      1 3   0.3      794      2      TestSolrCloudSnapshots.testSnapshots
      1 3  40.7       51     12      
TestXYMultiPolygonShapeQueries.testRandomBig
      1     0.3      361      1      
AutoAddReplicasIntegrationTest.testClusterPropOverridesCollecitonProp
      1     0.2      404      1      BasicZkTest.testBasic
      1     0.2      414      1      
ChaosMonkeySafeLeaderWithPullReplicasTest.test
      1    62.8      853    536      CheckHdfsIndexTest.doTest
      1     0.8      355      3      
CloudHttp2SolrClientTest.checkCollectionParameters
      1     0.8      355      3      
CloudHttp2SolrClientTest.customHttpClientTest
      1     1.1      355      4      
CloudHttp2SolrClientTest.preferLocalShardsTest
      1     0.8      355      3      
CloudHttp2SolrClientTest.preferReplicaTypesTest
      1     0.8      355      3      
CloudHttp2SolrClientTest.singleShardedPreferenceRules
      1     0.8      355      3      
CloudHttp2SolrClientTest.stateVersionParamTest
      1     1.1      355      4      CloudHttp2SolrClientTest.testAliasHandling
      1     0.8      355      3      
CloudHttp2SolrClientTest.testCollectionDoesntExist
      1     0.8      355      3      
CloudHttp2SolrClientTest.testInitializationWithSolrUrls
      1     0.8      355      3      
CloudHttp2SolrClientTest.testNonRetryableRequests
      1     1.1      355      4      
CloudHttp2SolrClientTest.testOverwriteOption
      1     0.8      355      3      
CloudHttp2SolrClientTest.testParallelUpdateQTime
      1     0.6      355      2      CloudHttp2SolrClientTest.testRouting
      1     0.8      355      3      CloudHttp2SolrClientTest.testShutdown
      1     0.6      355      2      
CloudHttp2SolrClientTest.testVersionsAreReturned
      1     0.8      355      3      
CloudHttp2SolrClientTest.testWrongZkChrootTest
      1     0.5      392      2      
CloudSolrClientTest.checkCollectionParameters
      1     0.3      392      1      CloudSolrClientTest.preferLocalShardsTest
      1     0.3      392      1      CloudSolrClientTest.preferReplicaTypesTest
      1     0.3      357      1      
CloudSolrClientTest.singleShardedPreferenceRules
      1     0.5      392      2      CloudSolrClientTest.stateVersionParamTest
      1     0.5      392      2      CloudSolrClientTest.testAliasHandling
      1     0.3      392      1      
CloudSolrClientTest.testInitializationWithSolrUrls
      1     0.3      392      1      
CloudSolrClientTest.testNonRetryableRequests
      1     0.3      392      1      CloudSolrClientTest.testOverwriteOption
      1     0.3      392      1      CloudSolrClientTest.testParallelUpdateQTime
      1     0.3      357      1      CloudSolrClientTest.testPing
      1     0.5      392      2      
CloudSolrClientTest.testRetryUpdatesWhenClusterStateIsStale
      1     0.3      392      1      CloudSolrClientTest.testShutdown
      1     0.5      392      2      CloudSolrClientTest.testVersionsAreReturned
      1     0.3      392      1      CloudSolrClientTest.testWrongZkChrootTest
      1     0.3      399      1      
CollectionsAPIAsyncDistributedZkTest.testSolrJAPICalls
      1     1.3      397      5      
CollectionsAPIDistributedZkTest.addReplicaTest
      1     0.8      397      3      
CollectionsAPIDistributedZkTest.deleteCollectionOnlyInZk
      1     1.0      397      4      
CollectionsAPIDistributedZkTest.deleteCollectionRemovesStaleZkCollectionsNode
      1     0.8      397      3      
CollectionsAPIDistributedZkTest.deletePartiallyCreatedCollection
      1     0.3      397      1      
CollectionsAPIDistributedZkTest.testBadActionNames
      1     0.8      397      3      
CollectionsAPIDistributedZkTest.testCollectionReload
      1     1.0      397      4      
CollectionsAPIDistributedZkTest.testCollectionsAPI
      1     1.3      397      5      
CollectionsAPIDistributedZkTest.testCoresAreDistributedAcrossNodes
      1     1.0      397      4      
CollectionsAPIDistributedZkTest.testCreateNodeSet
      1     1.3      397      5      
CollectionsAPIDistributedZkTest.testCreateShouldFailOnExistingCore
      1     0.3      397      1      
CollectionsAPIDistributedZkTest.testCreationAndDeletion
      1     0.5      397      2      
CollectionsAPIDistributedZkTest.testDeleteNonExistentCollection
      1     0.8      397      3      
CollectionsAPIDistributedZkTest.testMaxNodesPerShard
      1     0.8      397      3      
CollectionsAPIDistributedZkTest.testMissingNumShards
      1     0.5      397      2      
CollectionsAPIDistributedZkTest.testMissingRequiredParameters
      1     0.8      397      3      
CollectionsAPIDistributedZkTest.testNoConfigSetExist
      1     0.8      397      3      
CollectionsAPIDistributedZkTest.testSpecificConfigsets
      1     0.8      397      3      
CollectionsAPIDistributedZkTest.testTooManyReplicas
      1     1.0      397      4      
CollectionsAPIDistributedZkTest.testZeroNumShards
      1     0.7      405      3      
CollectionsAPISolrJTest.testAddAndDeleteReplica
      1     0.2      405      1      
CollectionsAPISolrJTest.testAddAndDeleteReplicaProp
      1     0.7      405      3      
CollectionsAPISolrJTest.testBalanceShardUnique
      1     0.5      405      2      
CollectionsAPISolrJTest.testCloudInfoInCoreStatus
      1     1.5      405      6      CollectionsAPISolrJTest.testClusterProp
      1     0.5      405      2      CollectionsAPISolrJTest.testCollectionProp
      1     0.5      405      2      
CollectionsAPISolrJTest.testCreateAndDeleteAlias
      1     0.5      405      2      
CollectionsAPISolrJTest.testCreateAndDeleteCollection
      1     0.7      405      3      
CollectionsAPISolrJTest.testCreateCollWithDefaultClusterPropertiesNewFormat
      1     1.7      405      7      
CollectionsAPISolrJTest.testCreateCollWithDefaultClusterPropertiesOldFormat
      1     0.7      405      3      
CollectionsAPISolrJTest.testCreateCollectionWithPropertyParam
      1     1.5      405      6      
CollectionsAPISolrJTest.testCreateWithDefaultConfigSet
      1     1.9      370      7      
CollectionsAPISolrJTest.testDeleteAliasedCollection
      1     1.2      405      5      CollectionsAPISolrJTest.testList
      1     1.0      405      4      
CollectionsAPISolrJTest.testModifyCollectionAttribute
      1     1.2      405      5      CollectionsAPISolrJTest.testOverseerStatus
      1     0.8      370      3      
CollectionsAPISolrJTest.testReadOnlyCollection
      1     1.6      370      6      
CollectionsAPISolrJTest.testRenameCollection
      1     0.7      405      3      CollectionsAPISolrJTest.testSplitShard
      1     0.2      406      1      ConnectionManagerTest.testLikelyExpired
      1     1.1      376      4      DeleteReplicaTest.deleteLiveReplicaTest
      1     1.5      411      6      
DeleteReplicaTest.deleteReplicaAndVerifyDirectoryCleanup
      1     0.5      376      2      
DeleteReplicaTest.deleteReplicaByCountForAllShards
      1     1.5      411      6      
DeleteReplicaTest.deleteReplicaFromClusterStateLegacy
      1     0.8      376      3      
DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplica
      1     1.3      376      5      
DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplicaLegacy
      1     0.7      405      3      DeleteShardTest.test
      1     0.2      405      1      
DeleteShardTest.testDirectoryCleanupAfterDeleteShard
      1     0.5      366      2      
DistribDocExpirationUpdateProcessorTest.testBasicAuth
      1     0.2      402      1      DistributedQueueTest.testDistributedQueue
      1     0.7      402      3      
DistributedQueueTest.testDistributedQueueBlocking
      1     0.7      402      3      
DistributedQueueTest.testDistributedQueueCache
      1     0.2      402      1      DistributedQueueTest.testLeakChildWatcher
      1     0.5      402      2      DistributedQueueTest.testLocallyOffer
      1     0.7      402      3      DistributedQueueTest.testPeekElements
      1     0.2      403      1      ExecutePlanActionTest.testExecute
      1     0.5      403      2      ExecutePlanActionTest.testIntegration
      1     0.7      403      3      ExecutePlanActionTest.testTaskFail
      1     0.3      370      1      
IndexSizeTriggerSizeEstimationTest.testEstimatedIndexSize
      1     0.3      366      1      IndexSizeTriggerTest.testInvalidSplitConfig
      1     0.3      366      1      IndexSizeTriggerTest.testMergeIntegration
      1     0.3      366      1      IndexSizeTriggerTest.testSplitConfig
      1     0.3      366      1      IndexSizeTriggerTest.testSplitIntegration
      1     0.3      366      1      IndexSizeTriggerTest.testTrigger
      1     0.3      366      1      IndexSizeTriggerTest.testValidProperties
      1     0.3      360      1      
JWTAuthPluginIntegrationTest.infoRequestWithoutToken
      1     0.3      360      1      JWTAuthPluginIntegrationTest.testMetrics
      1     0.2      403      1      LeaderElectionTest.testBasic
      1     0.5      403      2      LeaderElectionTest.testCancelElection
      1     0.5      403      2      LeaderElectionTest.testElection
      1     0.5      403      2      LeaderElectionTest.testParallelElection
      1     0.5      403      2      LeaderElectionTest.testStressElection
      1     0.2      404      1      LeaderFailureAfterFreshStartTest.test
      1     0.3      362      1      NestedShardedAtomicUpdateTest.test
      1     0.5      400      2      
NodeAddedTriggerIntegrationTest.testNodeAddedTriggerRestoreState
      1     0.3      398      1      NodeAddedTriggerTest.testListenerAcceptance
      1     0.3      398      1      NodeAddedTriggerTest.testRestoreState
      1     0.3      398      1      NodeAddedTriggerTest.testTrigger
      1     0.3      397      1      
NodeLostTriggerIntegrationTest.testNodeLostTriggerRestoreState
      1     0.3      398      1      
OutOfBoxZkACLAndCredentialsProvidersTest.testOpenACLUnsafeAllover
      1     0.3      398      1      
OutOfBoxZkACLAndCredentialsProvidersTest.testOutOfBoxSolrZkClient
      1     0.3      400      1      
OverriddenZkACLAndCredentialsProvidersTest.testAllCredentialsSolrZkClientFactoryUsingCompletelyNewProviders
      1     0.3      400      1      
OverriddenZkACLAndCredentialsProvidersTest.testAllCredentialsSolrZkClientFactoryUsingVMParamsProvidersButWithDifferentVMParamsNames
      1     0.3      400      1      
OverriddenZkACLAndCredentialsProvidersTest.testNoCredentialsSolrZkClientFactoryUsingCompletelyNewProviders
      1     0.3      400      1      
OverriddenZkACLAndCredentialsProvidersTest.testReadonlyCredentialsSolrZkClientFactoryUsingCompletelyNewProviders
      1     0.3      400      1      
OverriddenZkACLAndCredentialsProvidersTest.testReadonlyCredentialsSolrZkClientFactoryUsingVMParamsProvidersButWithDifferentVMParamsNames
      1     0.3      400      1      
OverriddenZkACLAndCredentialsProvidersTest.testWrongCredentialsSolrZkClientFactoryUsingCompletelyNewProviders
      1     0.3      400      1      
OverriddenZkACLAndCredentialsProvidersTest.testWrongCredentialsSolrZkClientFactoryUsingVMParamsProvidersButWithDifferentVMParamsNames
      1     0.3      400      1      
OverseerTaskQueueTest.testDistributedQueueCache
      1     0.3      400      1      OverseerTaskQueueTest.testLocallyOffer
      1     0.3      400      1      
PingRequestHandlerTest.testPingInClusterWithNoHealthCheck
      1     0.5      398      2      RecoveryAfterSoftCommitTest.test
      1     0.5      396      2      ReplicationFactorTest.test
      1     0.7      412      3      ShardSplitTest.testSplitLocking
      1     0.8      377      3      ShardSplitTest.testSplitMixedReplicaTypes
      1     0.5      411      2      
ShardSplitTest.testSplitStaticIndexReplication
      1     0.3      353      1      SolrZkClientTest.getConfig
      1     0.3      353      1      SolrZkClientTest.testWrappingWatches
      1     0.3      398      1      SpatialHeatmapFacetsTest.testClassicFacets
      1     0.3      398      1      SpatialHeatmapFacetsTest.testJsonFacets
      1     0.3     1194      3      SpatialHeatmapFacetsTest.testPng
      1     1.0      209      2      
StreamDecoratorTest.testParallelTerminatingDaemonUpdateStream
      1     0.3      397      1      SystemLogListenerTest.test
      1     0.5      388      2      
TestCloudCollectionsListeners.testCollectionDeletion
      1     0.3      388      1      
TestCloudCollectionsListeners.testSimpleCloudCollectionsListener
      1     0.3      397      1      
TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeaderAfterRestart
      1     0.8      354      3      
TestCollectionStateWatchers.testCanWaitForNonexistantCollection
      1     0.8      354      3      
TestCollectionStateWatchers.testCollectionWatchWithShutdownOfActiveNode
      1     0.8      354      3      
TestCollectionStateWatchers.testCollectionWatchWithShutdownOfUnusedNode
      1     0.8      389      3      
TestCollectionStateWatchers.testDeletionsTriggerWatches
      1     0.6      354      2      
TestCollectionStateWatchers.testLiveNodeChangesTriggerWatches
      1     0.8      389      3      
TestCollectionStateWatchers.testPredicateFailureTimesOut
      1     0.8      389      3      
TestCollectionStateWatchers.testStateWatcherChecksCurrentStateOnRegister
      1     0.8      389      3      
TestCollectionStateWatchers.testWaitForStateChecksCurrentState
      1     0.8      389      3      
TestCollectionStateWatchers.testWaitForStateWatcherIsRetainedOnPredicateFailure
      1     0.5      389      2      
TestCollectionStateWatchers.testWatcherIsRemovedAfterTimeout
      1     0.5      389      2      
TestCollectionStateWatchers.testWatchesWorkForStateFormat1
      1     0.3      400      1      
TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete
      1     0.3      399      1      TestConfigSetsAPI.testCreate
      1     0.3      399      1      TestConfigSetsAPI.testList
      1     0.3      399      1      TestConfigSetsAPI.testUpload
      1     0.3      399      1      TestConfigSetsAPI.testUploadDisabled
      1     0.3      399      1      TestConfigSetsAPI.testUploadErrors
      1     0.3      399      1      
TestConfigSetsAPI.testUploadWithScriptUpdateProcessor
      1     0.3      399      1      
TestConfigSetsAPI.testUserAndTestDefaultConfigsetsAreSame
      1     0.3      400      1      TestDistribDocBasedVersion.test
      1     0.3      354      1      
TestDocCollectionWatcher.testCanWaitForNonexistantCollection
      1     0.6      354      2      
TestDocCollectionWatcher.testDeletionsTriggerWatches
      1     0.6      354      2      
TestDocCollectionWatcher.testPredicateFailureTimesOut
      1     0.6      354      2      
TestDocCollectionWatcher.testStateWatcherChecksCurrentStateOnRegister
      1     0.6      354      2      
TestDocCollectionWatcher.testWaitForStateChecksCurrentState
      1     0.6      354      2      
TestDocCollectionWatcher.testWaitForStateWatcherIsRetainedOnPredicateFailure
      1     0.6      354      2      
TestDocCollectionWatcher.testWatcherIsRemovedAfterTimeout
      1     0.6      354      2      
TestDocCollectionWatcher.testWatchesWorkForStateFormat1
      1    14.3       21      3      
TestDocTermOrdsUninvertLimit.testTriggerUnInvertLimit
      1     0.2      414      1      TestDuelingCodecs.testCrazyReaderEquals
      1     4.5       22      1      
TestDuelingCodecsAtNight.testCrazyReaderEquals
      1     0.2      419      1      
TestIndexWriterWithThreads.testIOExceptionDuringWriteSegmentWithThreads
      1     0.3      352      1      TestJaegerConfigurator.testInjected
      1     0.3      387      1      TestLTROnSolrCloud.testSimpleQuery
      1     1.2      402      5      TestPointFields.testDoublePointStats
      1     0.2      402      1      
TestPointFields.testIntPointFieldMultiValuedRangeFacet
      1     2.4      425     10      TestRandomChains.testRandomChains
      1     1.0      406      4      TestRandomDVFaceting.testRandomFaceting
      1     0.3      397      1      TestSimTriggerIntegration.testCooldown
      1     0.2      419      1      
TestSimpleExplanationsWithFillerDocs.testMultiFieldBQofPQ5
      1     0.2      402      1      TestSolrConfigHandlerConcurrent.test
      1     0.3      400      1      TestWithCollection.testCreateCollection
      1     0.3      400      1      
TestWithCollection.testCreateCollectionNoWithCollection
      1     0.3      400      1      TestWithCollection.testDeleteWithCollection
      1     0.5      400      2      
TestWithCollection.testMoveReplicaMainCollection
      1     0.3      400      1      
TestWithCollection.testMoveReplicaWithCollection
      1     0.2      401      1      ZkCLITest.testInvalidZKAddress
      1     0.2      401      1      ZkCLITest.testPutFile
      1     0.3      394      1      ZkSolrClientTest.testMakeRootNode
      1     0.3      394      1      ZkSolrClientTest.testReconnect
      1     0.3      394      1      ZkSolrClientTest.testWatchChildren
       23   4.0       50      2      
CdcrReplicationHandlerTest.testReplicationWithBufferedUpdates
       23   0.3      766      4      
ComputePlanActionTest.testSelectedCollections
       23   0.3      765      2      DaemonStreamApiTest.testAPIs
       23   3.8       58      7      HdfsUnloadDistributedZkTest.test
       23   0.3      736      3      
LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud
       23  80.0       11      7      SharedFSAutoReplicaFailoverTest.test
       2    0.3      366      1      ActionThrottleTest.testBasics
       2    0.3      368      1      AutoScalingHandlerTest.testReadApi
       2    0.3      340      1      
AutoScalingHandlerTest.testSuggestionsWithPayload
       2    2.9      377     11      BJQParserTest.testToParentFilters
       2    0.3      366      1      ChaosMonkeyNothingIsSafeTest.test
       2    0.3      365      1      PeerSyncWithLeaderTest.test
       2    0.3      366      1      RulesTest.doIntegrationTest
       2    0.3      335      1      
StreamDecoratorTest.testParallelExecutorStream
       2    0.5      185      1      
StreamExpressionTest.testFeaturesSelectionStream
       2    1.9      371      7      TestBloomPostingsFormat.testInvertedWrite
       2    2.7      377     10      TestCheckIndex.testChecksumsOnly
       2    2.2      372      8      TestDirectPostingsFormat.testInvertedWrite
       2    1.6      370      6      TestFSTPostingsFormat.testInvertedWrite
       2    1.6      370      6      
TestFixedGapPostingsFormat.testInvertedWrite
       2    2.9      379     11      TestIndexWriterOutOfFileDescriptors.test
       2    0.3      367      1      TestOfflineSorter.testThreadSafety
       2    1.6      370      6      TestOrdsBlockTree.testInvertedWrite
       2   16.5      468     77      
TestPolicyCloud.testCreateCollectionAddShardUsingPolicy
       2    5.3      468     25      
TestPolicyCloud.testCreateCollectionSplitShard
       2    5.6      392     22      TestSearcherManager.testSearcherManager
       2    0.3      367      1      
TestSegmentSorting.testSegmentTerminateEarly
       2    0.3      336      1      
TestSimLargeCluster.testCreateLargeSimCollections
       2    0.3      336      1      TestSimLargeCluster.testFreediskTracking
       2    0.3      336      1      TestSimLargeCluster.testNodeLost
       2    0.3      364      1      TestSimLargeCluster.testSearchRate
       2   21.4       28      6      
TestSimpleTextPostingsFormat.testInvertedWrite
       2    0.3      365      1      
TestStressCloudBlindAtomicUpdates.test_dv_stored
       2    0.3      365      1      
TestStressCloudBlindAtomicUpdates.test_stored_idx
       2    1.9      371      7      
TestVarGapDocFreqIntervalPostingsFormat.testInvertedWrite
       2    0.3      366      1      
UninvertDocValuesMergePolicyTest.testIndexAndAddDocValues
        3   0.3      400      1      
DocValuesNotIndexedTest.testGroupingDocAbsent
        3   3.4      295     10      
Geo3dShapeWGS84ModelRectRelationTest.testGeoCircleRect
        3  23.8       42     10      HdfsSyncSliceTest.test
        3   6.9       29      2      
HdfsTlogReplayBufferedWhileIndexingTest.test
        3   0.5      400      2      
MetricTriggerIntegrationTest.testMetricTrigger
        3   0.3      398      1      NodeLostTriggerTest.testTrigger
        3   0.3      397      1      OverseerRolesTest.testOverseerRole
        3   3.8       26      1      RestartWhileUpdatingTest.test
        3   0.3      400      1      SyncSliceTest.test
        3   0.3      400      1      TestAddIndexes.testAddIndexesWithRollback
        3   0.5      401      2      TestCloudPivotFacet.test
        3   1.0      405      4      
TestControlledRealTimeReopenThread.testControlledRealTimeReopenThread
        3   0.0     2396      1      TestJsonFacets.testPrelimSortingSingleNode
        3   0.3      395      1      TestLBHttp2SolrClient.testReliability
        3   0.3      395      1      TestLBHttp2SolrClient.testSimple
        3   0.3      392      1      TestLBHttpSolrClient.testReliability
        3   0.5      397      2      TestNamedUpdateProcessors.test
        3   0.2      402      1      
TestReplicationHandler.doTestIndexAndConfigReplication
        3   0.0     3960      1      
TestSolr4Spatial2.testLLPDecodeIsStableAndPrecise
        3   0.1      798      1      TestTlogReplica.testCreateDelete
        3   0.3      399      1      TestTlogReplica.testRemoveLeader



***********************Annotations report

*****************AwaitsFix Annotations:


************Lucene AwaitsFix
TestControlledRealTimeReopenThread.testCRTReopen
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5737";)

TestICUNormalizer2CharFilter.testRandomStrings
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5595";)

TestICUTokenizerCJK.TestICUTokenizerCJK suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8222";)

TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-7161";)


    ************Solr AwaitsFix
AutoAddReplicasIntegrationTest.testRapidStopStartStopWithPropChange
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13811";)

CdcrBidirectionalTest.testBiDir
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12524";)

CdcrBootstrapTest.testBootstrapWithContinousIndexingOnSourceCluster
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12028";)

CollectionsAPISolrJTest.testCreateAndDeleteShard
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13021";)

ComputePlanActionTest.testNodeLost
   
@LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

ConcurrentCreateRoutedAliasTest.ConcurrentCreateRoutedAliasTest suite
   @LuceneTestCase.AwaitsFix(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-12386";) // "Can't find resource"

LeaderTragicEventTest.LeaderTragicEventTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13237";)

MoveReplicaHDFSTest.MoveReplicaHDFSTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13924";)

MoveReplicaHDFSTest.testFailedMove
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12080";) // 
added 03-Oct-2018

ReplaceNodeNoTargetTest.ReplaceNodeNoTargetTest suite
   @LuceneTestCase.AwaitsFix(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-11067";)

ReplaceNodeNoTargetTest.test
   @LuceneTestCase.AwaitsFix(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-11067";)

RoutedAliasUpdateProcessorTest.alias,
   
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13696";)

SSLMigrationTest.SSLMigrationTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
17-Mar-2018

SaslZkACLProviderTest.testSaslZkACLProvider
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13075";)

ScheduledMaintenanceTriggerTest.testInactiveShardCleanup
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
17-Mar-2018

ScheduledTriggerTest.testTrigger
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
added 20-Sep-2018

SearchRateTriggerIntegrationTest.testDeleteNode
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13163";)

SearchRateTriggerTest.testTrigger
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

SolrExporterIntegrationTest.SolrExporterIntegrationTest suite
   
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13786";)

Tagger2Test.testStopWords
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-8344";)

TestHierarchicalDocBuilder.testThreeLevelHierarchy
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12801";) // 
this test fails easily under beasting

TestImpersonationWithHadoopAuth.testForwarding
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/HADOOP-9893";)

TestJsonFacetRefinement.testProcessEmptyRefinement
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556";)

TestJsonFacetRefinement.testSortedSubFacetRefinementWhenParentOnlyReturnedByOneShardProcessEmpty
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556";)

TestLTRReRankingPipeline.testDifferentTopN
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-11134";)

TestMinMaxOnMultiValuedField.testDoubleFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestMinMaxOnMultiValuedField.testFloatFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestMinMaxOnMultiValuedField.testIntFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestMinMaxOnMultiValuedField.testLongFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestPullReplica.TestPullReplica suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

TestSimComputePlanAction.testNodeLost
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12028";) // 
if you beast this, eventually you will see

TestSimExtremeIndexing.TestSimExtremeIndexing suite
   
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12923";)

TestSimLargeCluster.testAddNode
   @AwaitsFix( bugUrl = "https://issues.apache.org/jira/browse/SOLR-14275";)

TestSimLargeCluster.testBasic
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
this test hits a timeout easily

TestStressRecovery.TestStressRecovery suite
   
@LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 6-Sep-2018

TestTlogReplayVsRecovery.TestTlogReplayVsRecovery suite
   
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13486;https://issues.apache.org/jira/browse/SOLR-14183";)

TimeRoutedAliasUpdateProcessorTest.testDateMathInStart
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13943";)

TriLevelCompositeIdRoutingTest.test
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13369";)



*****************BadApple Annotations:

************Lucene BadApple

************Solr BadApple
MoveReplicaHDFSTest.testNormalFailedMove
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
14-Oct-2018

SharedFSAutoReplicaFailoverTest.SharedFSAutoReplicaFailoverTest suite
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // added 20-Jul-2018

TimeRoutedAliasUpdateProcessorTest.TimeRoutedAliasUpdateProcessorTest suite
   @LuceneTestCase.BadApple(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-13059";)


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to