Well, that’s one way to reduce the number of SuppressWarnings… cut out massive 
amounts of code ;)….

SuppressWarnings count: last week: 5,353, this week: 4,835, delta -518

We had quite a spike in the raw number of tests that have failed at least once 
in the last week:

Raw fail count by week totals, most recent week first (corresponds to bits):
Week: 0  had  502 failures
Week: 1  had  19 failures
Week: 2  had  24 failures
Week: 3  had  26 failures

IDK whether this reflects a temporary glitch or whether we’re now scanning more 
builds. At any rate we’ll see what next week brings.

This bit is encouraging, very few tests have failed every week for the last 4.

********Failures in Hoss' reports for the last 4 rollups.

There were 536 unannotated tests that failed in Hoss' rollups. Ordered by the 
date I downloaded the rollup file, newest->oldest. See above for the dates the 
files were collected 
These tests were NOT BadApple'd or AwaitsFix'd

Failures in the last 4 reports..
   Report   Pct     runs    fails           test
     0123  57.1       25     21      SharedFSAutoReplicaFailoverTest.test
     0123   4.4      741     33      TestContainerPlugin.testApiFromPackage
     0123   2.3      732     13      TestInPlaceUpdatesDistrib.test
********************************************

DO NOT ENABLE LIST:
    MoveReplicaHDFSTest.testFailedMove
    MoveReplicaHDFSTest.testNormalFailedMove
    TestControlledRealTimeReopenThread.testCRTReopen
    TestICUNormalizer2CharFilter.testRandomStrings
    TestICUTokenizerCJK
    TestImpersonationWithHadoopAuth.testForwarding
    TestLTRReRankingPipeline.testDifferentTopN
    TestRandomChains


DO NOT ANNOTATE LIST
    CdcrBidirectionalTest.testBiDir
    IndexSizeTriggerTest.testMergeIntegration
    IndexSizeTriggerTest.testMixedBounds
    IndexSizeTriggerTest.testSplitIntegration
    IndexSizeTriggerTest.testTrigger
    InfixSuggestersTest.testShutdownDuringBuild
    ShardSplitTest.test
    ShardSplitTest.testSplitMixedReplicaTypes
    ShardSplitTest.testSplitWithChaosMonkey
    Test2BPostings.test
    TestLatLonShapeQueries.testRandomBig
    TestPackedInts.testPackedLongValues
    TestRandomChains.testRandomChainsWithLargeStrings
    TestTriggerIntegration.testSearchRate

SuppressWarnings count: last week: 5,353, this week: 4,835, delta -518


*************** Files with increased @SuppressWarnings annotations:

Suppress count increase in: 
solr/core/src/java/org/apache/solr/core/SolrClassLoader.java. Was: null, now: 1
Suppress count increase in: 
solr/core/src/java/org/apache/solr/handler/SchemaHandler.java. Was: 6, now: 7
Suppress count increase in: 
solr/core/src/java/org/apache/solr/pkg/PackageListeningClassLoader.java. Was: 
null, now: 1
Suppress count increase in: 
solr/core/src/test/org/apache/solr/pkg/TestPackages.java. Was: 5, now: 7
Suppress count increase in: 
solr/solrj/src/java/org/apache/solr/client/solrj/cloud/DelegatingCloudManager.java.
 Was: null, now: 1
Suppress count increase in: 
solr/solrj/src/java/org/apache/solr/client/solrj/impl/SolrClientNodeStateProvider.java.
 Was: 4, now: 6
Suppress count increase in: 
solr/solrj/src/java/org/apache/solr/common/cloud/Replica.java. Was: 0, now: 1

*************** Files with decreased @SuppressWarnings annotations:

Suppress count decrease in: 
solr/core/src/java/org/apache/solr/cloud/api/collections/Assign.java. Was: 6, 
now: 5
Suppress count decrease in: 
solr/core/src/test/org/apache/solr/cloud/rule/RulesTest.java. Was: 7, now: 5
Suppress count decrease in: 
solr/core/src/test/org/apache/solr/util/TestSolrCLIRunExample.java. Was: 1, 
now: 0
Suppress count decrease in: 
solr/solrj/src/java/org/apache/solr/client/solrj/impl/ZkDistribStateManager.java.
 Was: 1, now: 0
Suppress count decrease in: 
solr/solrj/src/java/org/apache/solr/common/cloud/ZkStateReader.java. Was: 7, 
now: 6

Processing file (History bit 3): HOSS-2020-07-20.csv
Processing file (History bit 2): HOSS-2020-07-13.csv
Processing file (History bit 1): HOSS-2020-07-06.csv
Processing file (History bit 0): HOSS-2020-06-29.csv


Number of AwaitsFix: 33 Number of BadApples: 4


**Annotated tests that didn't fail in the last 4 weeks.

  **Tests removed from the next two lists because they were specified in 
'doNotEnable' in the properties file
     MoveReplicaHDFSTest.testNormalFailedMove

  **Annotations can be removed from the following tests because they haven't 
failed in the last 4 rollups.

  **Methods: 0


Raw fail count by week totals, most recent week first (corresponds to bits):
Week: 0  had  502 failures
Week: 1  had  19 failures
Week: 2  had  24 failures
Week: 3  had  26 failures


********Failures in Hoss' reports for the last 4 rollups.

There were 536 unannotated tests that failed in Hoss' rollups. Ordered by the 
date I downloaded the rollup file, newest->oldest. See above for the dates the 
files were collected 
These tests were NOT BadApple'd or AwaitsFix'd

Failures in the last 4 reports..
   Report   Pct     runs    fails           test
     0123  57.1       25     21      SharedFSAutoReplicaFailoverTest.test
     0123   4.4      741     33      TestContainerPlugin.testApiFromPackage
     0123   2.3      732     13      TestInPlaceUpdatesDistrib.test
********************************************

Failures over the last 4 weeks, but not every week. Ordered most-recent first:



   Report   Pct     runs    fails           test
     01 3   1.0      628     11      RollingRestartTest.test
     01 3   1.5      249      5      TestCircuitBreaker.testResponseWithCBTiming
     01    13.2      546     63      
CollectionTooManyReplicasTest.testAddTooManyReplicas
     01     0.8      501      4      ShardRoutingTest.test
     01     3.0      241      8      
TestCircuitBreaker.testBuildingMemoryPressure
     01     2.0      519      9      TestDistributedGrouping.test
     0 23   0.3      634      3      
DocValuesNotIndexedTest.testGroupingDVOnlySortFirst
     0 23   3.0      628     42      TestReRankQParserPlugin.testMinExactCount
     0 2    0.8      529      4      ShardSplitTest.testSplitShardWithRule
     0 2    1.8      519      8      
TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast
     0 2    0.5      517      3      TestSimScenario.testSuggestions
     0 2    0.3      508      2      TestTlogReplica.testRemoveLeader
     0  3   0.5      507      3      AutoScalingHandlerTest.testReadApi
     0  3   0.5      507      3      
AutoScalingHandlerTest.testSuggestionsWithPayload
     0  3   0.5      532      4      
TestIndexWriterDelete.testDeleteAllNoDeadLock
     0      1.0      392      4      AddReplicaTest.test
     0      1.0      392      4      AddReplicaTest.testAddMultipleReplicas
     0      1.0      392      4      AliasIntegrationTest.test
     0      1.0      392      4      
AliasIntegrationTest.testClusterStateProviderAPI
     0      1.0      392      4      
AliasIntegrationTest.testDeleteAliasWithExistingCollectionName
     0      1.0      392      4      
AliasIntegrationTest.testDeleteOneOfTwoCollectionsAliased
     0      1.0      392      4      AliasIntegrationTest.testErrorChecks
     0      1.0      392      4      
AliasIntegrationTest.testModifyPropertiesCAR
     0      1.0      392      4      AliasIntegrationTest.testModifyPropertiesV1
     0      1.0      392      4      AliasIntegrationTest.testModifyPropertiesV2
     0      1.0      392      4      AliasIntegrationTest.testProperties
     0      1.0      388      4      
AsyncCallRequestStatusResponseTest.testAsyncCallStatusResponse
     0      0.5      390      2      AuditLoggerIntegrationTest.authValid
     0      0.5      390      2      
AuditLoggerIntegrationTest.searchWithException
     0      0.3      388      1      AutoAddReplicasPlanActionTest.testSimple
     0      0.3      394      1      AutoScalingHandlerTest.testDeleteUsedPolicy
     0      0.3      394      1      
AutoScalingHandlerTest.testDiagnosticsWithPayload
     0      0.5      388      2      BasicAuthIntegrationTest.testBasicAuth
     0      0.5      387      2      BasicAuthOnSingleNodeTest.basicTest
     0      0.5      387      2      
BasicAuthOnSingleNodeTest.testDeleteSecurityJsonZnode
     0      0.8      390      3      BasicDistributedZk2Test.test
     0      1.0      395      4      BasicDistributedZkTest.test
     0      0.4      224      1      BasicZkTest.testBasic
     0      0.5      386      2      
CdcrBootstrapTest.testBootstrapWithMultipleReplicas
     0      0.5      386      2      
CdcrBootstrapTest.testBootstrapWithSourceCluster
     0      0.5      386      2      
CdcrBootstrapTest.testConvertClusterToCdcrAndBootstrap
     0      0.5      387      2      
CdcrVersionReplicationTest.testCdcrDocVersions
     0      0.8      388      3      ChaosMonkeyNothingIsSafeTest.test
     0      0.3      386      1      
ChaosMonkeyNothingIsSafeWithPullReplicasTest.test
     0      0.3      388      1      ChaosMonkeySafeLeaderTest.test
     0      0.3      392      1      
ChaosMonkeySafeLeaderWithPullReplicasTest.test
     0      0.3      333      1      CheckHdfsIndexTest.testChecksumsOnly
     0      0.5      388      2      CleanupOldIndexTest.test
     0      2.7      409     11      CloudExitableDirectoryReaderTest.test
     0      1.9     2043     38      
CloudExitableDirectoryReaderTest.testCreepThenBite
     0      1.2      407      5      
CloudExitableDirectoryReaderTest.testWhitebox
     0      1.8      392      7      CloudHttp2SolrClientRetryTest.testRetry
     0      0.5      387      2      
CloudHttp2SolrClientTest.checkCollectionParameters
     0      0.5      387      2      
CloudHttp2SolrClientTest.preferLocalShardsTest
     0      0.5      387      2      
CloudHttp2SolrClientTest.preferReplicaTypesTest
     0      0.5      387      2      
CloudHttp2SolrClientTest.singleShardedPreferenceRules
     0      0.5      387      2      
CloudHttp2SolrClientTest.stateVersionParamTest
     0      0.5      387      2      CloudHttp2SolrClientTest.testAliasHandling
     0      0.5      387      2      
CloudHttp2SolrClientTest.testInitializationWithSolrUrls
     0      0.5      387      2      
CloudHttp2SolrClientTest.testNonRetryableRequests
     0      0.5      387      2      
CloudHttp2SolrClientTest.testOverwriteOption
     0      0.5      387      2      
CloudHttp2SolrClientTest.testParallelUpdateQTime
     0      0.5      387      2      
CloudHttp2SolrClientTest.testRetryUpdatesWhenClusterStateIsStale
     0      0.5      387      2      CloudHttp2SolrClientTest.testRouting
     0      0.5      387      2      
CloudHttp2SolrClientTest.testVersionsAreReturned
     0      0.3      385      1      CloudMLTQParserTest.testBoost
     0      0.3      385      1      CloudMLTQParserTest.testHighDFValue
     0      0.3      385      1      CloudMLTQParserTest.testHighWLValue
     0      0.3      385      1      
CloudMLTQParserTest.testInvalidSourceDocument
     0      0.3      385      1      CloudMLTQParserTest.testLowMinWLValue
     0      0.3      385      1      CloudMLTQParserTest.testMLTQParser
     0      0.3      385      1      CloudMLTQParserTest.testMinDF
     0      0.3      385      1      CloudMLTQParserTest.testMultipleFields
     0      0.3      385      1      
CloudMLTQParserTest.testUnstoredAndUnanalyzedFieldsAreIgnored
     0      0.5      387      2      CloudSolrClientRetryTest.testRetry
     0      0.5      387      2      
CloudSolrClientTest.checkCollectionParameters
     0      0.5      387      2      CloudSolrClientTest.preferLocalShardsTest
     0      0.5      387      2      CloudSolrClientTest.preferReplicaTypesTest
     0      0.5      387      2      
CloudSolrClientTest.singleShardedPreferenceRules
     0      0.5      387      2      CloudSolrClientTest.stateVersionParamTest
     0      0.5      387      2      CloudSolrClientTest.testAliasHandling
     0      0.5      387      2      
CloudSolrClientTest.testInitializationWithSolrUrls
     0      0.5      387      2      
CloudSolrClientTest.testNonRetryableRequests
     0      0.5      387      2      CloudSolrClientTest.testOverwriteOption
     0      0.5      387      2      CloudSolrClientTest.testParallelUpdateQTime
     0      0.5      387      2      CloudSolrClientTest.testPing
     0      0.5      387      2      
CloudSolrClientTest.testRetryUpdatesWhenClusterStateIsStale
     0      0.5      387      2      CloudSolrClientTest.testRouting
     0      0.5      387      2      CloudSolrClientTest.testVersionsAreReturned
     0      0.5      389      2      ClusterStateUpdateTest.testCoreRegistration
     0      0.5      388      2      CollectionPropsTest.testMultipleWatchers
     0      0.5      388      2      CollectionPropsTest.testReadWriteCached
     0      0.5      388      2      CollectionPropsTest.testReadWriteNoCache
     0      0.5      388      2      CollectionPropsTest.testWatcher
     0      0.5      387      2      
CollectionReloadTest.testReloadedLeaderStateAfterZkSessionLoss
     0      0.4      226      1      
CollectionStateFormat2Test.testZkNodeLocation
     0      0.6      164      1      CollectionStateZnodeTest.testZkNodeLocation
     0      1.6      433      7      CollectionTooManyReplicasTest.testAddShard
     0      1.6      433      7      
CollectionTooManyReplicasTest.testDownedShards
     0      1.3      390      5      
CollectionsAPIAsyncDistributedZkTest.testAsyncRequests
     0      1.3      390      5      
CollectionsAPIAsyncDistributedZkTest.testSolrJAPICalls
     0      0.5      389      2      
CollectionsAPIDistributedZkTest.addReplicaTest
     0      0.5      389      2      
CollectionsAPIDistributedZkTest.deleteCollectionOnlyInZk
     0      0.5      389      2      
CollectionsAPIDistributedZkTest.deletePartiallyCreatedCollection
     0      0.5      389      2      
CollectionsAPIDistributedZkTest.testCollectionReload
     0      0.5      389      2      
CollectionsAPIDistributedZkTest.testCollectionsAPI
     0      0.5      389      2      
CollectionsAPIDistributedZkTest.testCoresAreDistributedAcrossNodes
     0      0.5      389      2      
CollectionsAPIDistributedZkTest.testCreationAndDeletion
     0      0.5      389      2      
CollectionsAPIDistributedZkTest.testDeleteNonExistentCollection
     0      0.5      389      2      
CollectionsAPIDistributedZkTest.testSpecificConfigsets
     0      0.5      394      2      
CollectionsAPISolrJTest.testAddAndDeleteReplica
     0      0.5      394      2      
CollectionsAPISolrJTest.testAddAndDeleteReplicaProp
     0      0.5      394      2      
CollectionsAPISolrJTest.testBalanceShardUnique
     0      0.5      394      2      
CollectionsAPISolrJTest.testCloudInfoInCoreStatus
     0      0.5      394      2      CollectionsAPISolrJTest.testColStatus
     0      0.5      394      2      CollectionsAPISolrJTest.testCollectionProp
     0      0.5      394      2      
CollectionsAPISolrJTest.testCreateAndDeleteAlias
     0      0.5      394      2      
CollectionsAPISolrJTest.testCreateAndDeleteCollection
     0      0.5      394      2      
CollectionsAPISolrJTest.testCreateCollWithDefaultClusterPropertiesNewFormat
     0      0.5      394      2      
CollectionsAPISolrJTest.testCreateCollWithDefaultClusterPropertiesOldFormat
     0      0.5      394      2      
CollectionsAPISolrJTest.testCreateCollectionWithPropertyParam
     0      0.5      394      2      
CollectionsAPISolrJTest.testCreateWithDefaultConfigSet
     0      0.5      394      2      
CollectionsAPISolrJTest.testDeleteAliasedCollection
     0      0.5      394      2      
CollectionsAPISolrJTest.testModifyCollectionAttribute
     0      0.5      394      2      
CollectionsAPISolrJTest.testReadOnlyCollection
     0      0.5      394      2      
CollectionsAPISolrJTest.testRenameCollection
     0      0.5      394      2      CollectionsAPISolrJTest.testSplitShard
     0      1.0      391      4      ComputePlanActionTest.testNodeAdded
     0      0.5      391      2      
ComputePlanActionTest.testNodeAddedTriggerWithAddReplicaPreferredOpReplicaType_1Shard
     0      0.5      391      2      
ComputePlanActionTest.testNodeAddedTriggerWithAddReplicaPreferredOp_1Shard
     0      0.5      391      2      
ComputePlanActionTest.testNodeAddedTriggerWithAddReplicaPreferredOp_2Shard
     0      0.5      391      2      
ComputePlanActionTest.testNodeLostTriggerWithDeleteNodePreferredOp
     0      0.5      391      2      
ComputePlanActionTest.testNodeWithMultipleReplicasLost
     0      0.5      391      2      
ComputePlanActionTest.testSelectedCollectionsByName
     0      0.5      391      2      
ComputePlanActionTest.testSelectedCollectionsByPolicy
     0      0.5      389      2      
ConcurrentCreateCollectionTest.testConcurrentCreatePlacement
     0      0.5      387      2      
ConcurrentUpdateHttp2SolrClientMultiCollectionTest.testEnsureDocumentsSentToCorrectCollection
     0      0.5      387      2      
ConcurrentUpdateSolrClientMultiCollectionTest.testEnsureDocumentsSentToCorrectCollection
     0      0.5      390      2      ConfigSetsAPITest.testSharedSchema
     0      0.8      396      3      
ConnectionManagerTest.testReconnectWhenZkDisappeared
     0      0.5      389      2      
CreateRoutedAliasTest.testCollectionNamesMustBeAbsent
     0      0.5      389      2      
CreateRoutedAliasTest.testTimezoneAbsoluteDate
     0      0.5      389      2      CreateRoutedAliasTest.testV1
     0      0.5      389      2      CreateRoutedAliasTest.testV2
     0      0.8      388      3      
CustomCollectionTest.testCreateShardRepFactor
     0      0.8      388      3      
CustomCollectionTest.testCustomCollectionsAPI
     0      0.8      388      3      
CustomCollectionTest.testRouteFieldForHashRouter
     0      0.8      388      3      
CustomCollectionTest.testRouteFieldForImplicitRouter
     0      0.3      389      1      CustomHighlightComponentTest.test
     0      0.5      387      2      DaemonStreamApiTest.testAPIs
     0      0.5      386      2      
DeleteInactiveReplicaTest.deleteInactiveReplicaTest
     0      0.3      387      1      DeleteLastCustomShardedReplicaTest.test
     0      0.3      387      1      DeleteNodeTest.test
     0      0.3      393      1      DeleteReplicaTest.deleteLiveReplicaTest
     0      0.8      393      3      
DeleteReplicaTest.deleteReplicaAndVerifyDirectoryCleanup
     0      0.3      393      1      DeleteReplicaTest.deleteReplicaByCount
     0      0.3      393      1      
DeleteReplicaTest.deleteReplicaByCountForAllShards
     0      0.3      393      1      
DeleteReplicaTest.deleteReplicaFromClusterState
     0      0.4      231      1      
DeleteReplicaTest.deleteReplicaFromClusterStateLegacy
     0      0.3      393      1      DeleteReplicaTest.deleteReplicaOnIndexing
     0      0.3      393      1      
DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplica
     0      0.4      231      1      
DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplicaLegacy
     0      0.8      388      3      DeleteShardTest.test
     0      0.8      388      3      
DeleteShardTest.testDirectoryCleanupAfterDeleteShard
     0      0.5      389      2      DistribCursorPagingTest.test
     0      0.8      395      3      
DistribDocExpirationUpdateProcessorTest.testBasicAuth
     0      0.5      395      2      
DistribDocExpirationUpdateProcessorTest.testNoAuth
     0      0.8      396      3      
DistributedVersionInfoTest.testReplicaVersionHandling
     0      1.0      399      4      
DocValuesNotIndexedTest.testGroupingDVOnlySortLast
     0      0.3      385      1      ExecutePlanActionTest.testExecute
     0      0.3      385      1      ExecutePlanActionTest.testIntegration
     0      0.3      385      1      ExecutePlanActionTest.testTaskFail
     0      0.3      385      1      ExecutePlanActionTest.testTaskTimeout
     0      0.3      388      1      
FullSolrCloudDistribCmdsTest.testBasicUpdates
     0      0.3      388      1      
FullSolrCloudDistribCmdsTest.testConcurrentIndexing
     0      0.3      388      1      
FullSolrCloudDistribCmdsTest.testIndexQueryDeleteHierarchical
     0      0.3      388      1      
FullSolrCloudDistribCmdsTest.testIndexingBatchPerRequestWithHttpSolrClient
     0      0.3      388      1      
FullSolrCloudDistribCmdsTest.testIndexingOneDocPerRequestWithHttpSolrClient
     0      0.3      388      1      
FullSolrCloudDistribCmdsTest.testThatCantForwardToLeaderFails
     0      0.8      391      3      FuzzySearchTest.testTooComplex
     0      0.5      387      2      
HealthCheckHandlerTest.testHealthCheckHandler
     0      0.3      390      1      Http2SolrClientTest.testUpdate
     0      3.8      421     16      HttpPartitionOnCommitTest.test
     0      2.2      402      9      HttpPartitionTest.test
     0      0.5      393      2      HttpPartitionWithTlogReplicasTest.test
     0      0.5      386      2      
IndexSizeTriggerMixedBoundsTest.testMixedBounds
     0      0.5      387      2      
JWTAuthPluginIntegrationTest.createCollectionUpdateAndQueryDistributed
     0      0.5      387      2      JWTAuthPluginIntegrationTest.testMetrics
     0      0.8      390      3      
LeaderElectionIntegrationTest.testSimpleSliceLeaderElection
     0      0.3      387      1      LeaderElectionTest.testParallelElection
     0      1.0      392      4      LeaderFailoverAfterPartitionTest.test
     0      0.8      387      3      LeaderFailureAfterFreshStartTest.test
     0      0.8      390      3      LeaderVoteWaitTimeoutTest.basicTest
     0      0.8      390      3      
LeaderVoteWaitTimeoutTest.testMostInSyncReplicasCanWinElection
     0      0.8      388      3      
MetricTriggerIntegrationTest.testMetricTrigger
     0      0.8      389      3      
MigrateRouteKeyTest.multipleShardMigrateTest
     0      0.8      389      3      MigrateRouteKeyTest.testMissingSplitKey
     0      0.8      390      3      
MissingSegmentRecoveryTest.testLeaderRecovery
     0      0.5      387      2      MoveReplicaTest.test
     0      0.5      387      2      MoveReplicaTest.testFailedMove
     0      4.1      418     17      MultiThreadedOCPTest.test
     0      1.8      394      7      NestedShardedAtomicUpdateTest.test
     0      0.3      389      1      
NodeMarkersRegistrationTest.testNodeMarkersRegistration
     0      0.5      388      2      OverseerModifyCollectionTest.testModifyColl
     0      0.5      389      2      OverseerStatusTest.test
     0      0.4      266      1      OverseerTest.testBadQueueItem
     0      0.4      266      1      OverseerTest.testDoubleAssignment
     0      0.4      266      1      OverseerTest.testDownNodeFailover
     0      0.4      266      1      OverseerTest.testOverseerFailure
     0      0.4      266      1      OverseerTest.testOverseerStatsReset
     0      0.4      266      1      OverseerTest.testShardAssignment
     0      1.1      266      3      OverseerTest.testShardLeaderChange
     0      0.3      388      1      PackageManagerCLITest.testPackageManager
     0      0.5      392      2      PeerSyncReplicationTest.test
     0      0.3      390      1      PeerSyncTest.test
     0      0.5      387      2      
PingRequestHandlerTest.testPingInClusterWithNoHealthCheck
     0      0.3      388      1      RecoveryAfterSoftCommitTest.test
     0      1.0      391      4      RecoveryZkTest.test
     0      1.0      395      4      ReindexCollectionTest.testAbort
     0      1.0      395      4      ReindexCollectionTest.testBasicReindexing
     0      1.0      395      4      ReindexCollectionTest.testFailure
     0      1.0      395      4      ReindexCollectionTest.testLossySchema
     0      1.0      395      4      ReindexCollectionTest.testReshapeReindexing
     0      1.3      395      5      
ReindexCollectionTest.testSameTargetReindexing
     0      1.0      390      4      RemoteQueryErrorTest.test
     0      1.0      393      4      ReplaceNodeTest.test
     0      0.5      387      2      ReplicationFactorTest.test
     0      1.8      392      7      RoutingToNodesWithPropertiesTest.test
     0      0.3      385      1      RulesTest.doIntegrationTest
     0      0.3      385      1      RulesTest.testHostFragmentRule
     0      0.3      385      1      RulesTest.testModifyColl
     0      0.3      385      1      RulesTest.testPortRule
     0      0.3      385      1      
RulesTest.testPortRuleInPresenceOfClusterPolicy
     0      0.8      389      3      
ScheduledTriggerIntegrationTest.testScheduledTrigger
     0      0.8      387      3      SearchRateTriggerTest.testWaitForElapsed
     0      0.5      390      2      ShardRoutingCustomTest.test
     0      0.5      398      2      ShardSplitTest.testSplitAfterFailedSplit
     0      0.5      398      2      ShardSplitTest.testSplitLocking
     0      0.8      398      3      ShardSplitTest.testSplitMixedReplicaTypes
     0      0.5      398      2      
ShardSplitTest.testSplitMixedReplicaTypesLink
     0      0.8      398      3      ShardSplitTest.testSplitShardWithRuleLink
     0      0.5      398      2      
ShardSplitTest.testSplitStaticIndexReplication
     0      0.8      398      3      
ShardSplitTest.testSplitStaticIndexReplicationLink
     0      0.5      387      2      SimpleCollectionCreateDeleteTest.test
     0      1.3      390      5      
SolrCloudExampleTest.testLoadDocsIntoGettingStartedCollection
     0      0.5      386      2      SolrCloudReportersTest.testDefaultPlugins
     0      0.5      386      2      
SolrCloudReportersTest.testExplicitConfiguration
     0      0.5      387      2      SolrShardReporterTest.test
     0      0.5      387      2      SolrZkClientTest.testWrappingWatches
     0      1.8      392      7      SplitByPrefixTest.doTest
     0      0.5      389      2      SplitShardTest.doTest
     0      0.5      389      2      SplitShardTest.testLiveSplit
     0      0.5      389      2      SplitShardTest.testSplitFuzz
     0      0.5      390      2      SyncSliceTest.test
     0      0.8      391      3      SystemCollectionCompatTest.testBackCompat
     0      0.8      388      3      SystemLogListenerTest.test
     0      0.8      388      3      TemplateUpdateProcessorTest.testSimple
     0      0.5      389      2      TestAuthenticationFramework.testBasics
     0      0.5      387      2      
TestAuthorizationFramework.authorizationFrameworkTest
     0      0.5      388      2      TestBlobHandler.doBlobHandlerTest
     0      0.4      472      2      TestBulkSchemaConcurrent.test
     0      1.8      392      7      
TestCloudCollectionsListeners.testCollectionDeletion
     0      1.8      392      7      
TestCloudCollectionsListeners.testSimpleCloudCollectionsListener
     0      0.8      390      3      
TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader
     0      0.8      390      3      
TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeaderAfterRestart
     0      0.3      385      1      TestCloudManagedSchema.test
     0      0.5      388      2      TestCloudPivotFacet.test
     0      0.5      387      2      TestCloudRecovery.corruptedLogTest
     0      0.5      387      2      
TestCloudRecovery.leaderRecoverFromLogOnStartupTest
     0      0.5      387      2      TestCloudSchemaless.test
     0      0.8      389      3      
TestCloudSearcherWarming.testPeersyncFailureReplicationSuccess
     0      0.5      389      2      
TestCloudSearcherWarming.testRepFactor1LeaderStartup
     0      0.5      392      2      TestCollectionAPI.test
     0      0.8      392      3      
TestCollectionAPI.testRecreateCollectionAfterFailure
     0      0.5      387      2      
TestCollectionStateWatchers.testCanWaitForNonexistantCollection
     0      0.5      387      2      
TestCollectionStateWatchers.testCollectionWatchWithShutdownOfActiveNode
     0      0.5      387      2      
TestCollectionStateWatchers.testCollectionWatchWithShutdownOfUnusedNode
     0      0.5      387      2      
TestCollectionStateWatchers.testDeletionsTriggerWatches
     0      0.5      387      2      
TestCollectionStateWatchers.testLiveNodeChangesTriggerWatches
     0      0.5      387      2      
TestCollectionStateWatchers.testWaitForStateChecksCurrentState
     0      0.5      387      2      
TestCollectionStateWatchers.testWaitForStateWatcherIsRetainedOnPredicateFailure
     0      0.3      388      1      
TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete
     0      0.3      388      1      
TestCollectionsAPIViaSolrCloudCluster.testStopAllStartAll
     0      0.5      387      2      TestConfigReload.test
     0      0.5      387      2      TestConfigSetsAPI.testUpload
     0      0.3      361      1      
TestConfigSetsAPI.testUploadWithScriptUpdateProcessor
     0      1.3      396      5      TestCryptoKeys.test
     0      0.8      395      3      
TestCustomStream.testDynamicLoadingCustomStream
     0      0.8      388      3      
TestDeleteCollectionOnDownNodes.deleteCollectionWithDownNodes
     0      0.8      388      3      TestDistribDocBasedVersion.test
     0      0.3      385      1      TestDistribIDF.testMultiCollectionQuery
     0      0.3      385      1      TestDistribIDF.testSimpleQuery
     0      0.3      391      1      
TestDistribPackageStore.testPackageStoreManagement
     0      0.5      387      2      
TestDocCollectionWatcher.testDeletionsTriggerWatches
     0      0.5      387      2      
TestDocCollectionWatcher.testWaitForStateChecksCurrentState
     0      0.5      387      2      
TestDocCollectionWatcher.testWaitForStateWatcherIsRetainedOnPredicateFailure
     0      0.5      387      2      
TestDownShardTolerantSearch.searchingShouldFailWithoutTolerantSearchSetToTrue
     0      0.3      385      1      TestDynamicFieldNamesIndexCorrectly.test
     0      0.8      390      3      TestDynamicLoading.testDynamicLoading
     0      0.3      386      1      TestDynamicLoadingUrl.testDynamicLoadingUrl
     0      2.4      166      4      
TestExactSharedStatsCacheCloud.testBasicStats
     0      1.2      165      2      TestExactStatsCacheCloud.testBasicStats
     0      2.3      395      9      TestExclusionRuleCollectionAccess.doTest
     0      1.3      391      5      TestExportTool.testBasic
     0      0.5      388      2      TestExportWriter.testExpr
     0      0.5      396      2      TestFlushByRamOrCountsPolicy.testRandom
     0      6.0      364     22      TestHdfsCloudBackupRestore.test
     0      0.2      407      1      TestIndexWriterDelete.testBothDeletes
     0      0.8      388      3      TestJaegerConfigurator.testInjected
     0      0.0     2364      1      TestJsonFacets.testTolerant
     0      0.6      164      1      TestLRUStatsCacheCloud.testBasicStats
     0      0.8      388      3      TestLTROnSolrCloud.testSimpleQuery
     0     12.1      455     55      TestLocalFSCloudBackupRestore.test
     0      0.2      455      1      
TestLocalFSCloudBackupRestore.testRestoreFailure
     0      2.3      392      9      TestManagedSchemaAPI.test
     0      0.8      388      3      TestMiniSolrCloudClusterSSL.testNoSsl
     0      0.8      388      3      
TestMiniSolrCloudClusterSSL.testNoSslButSillyClientAuth
     0      0.9      321      3      
TestMiniSolrCloudClusterSSL.testSslAndClientAuth
     0      0.8      388      3      
TestMiniSolrCloudClusterSSL.testSslAndNoClientAuth
     0      0.8      388      3      
TestMiniSolrCloudClusterSSL.testSslWithCheckPeerName
     0      0.8      388      3      
TestMiniSolrCloudClusterSSL.testSslWithInvalidPeerName
     0      0.8      385      3      TestNamedUpdateProcessors.test
     0      0.5      388      2      TestOnReconnectListenerSupport.test
     0      0.3      393      1      TestPackages.testAPI
     0      1.5      393      6      TestPackages.testPluginLoading
     0      0.5      388      2      TestPolicyCloud.testCreateCollection
     0      0.5      388      2      
TestPolicyCloud.testCreateCollectionAddReplica
     0      0.5      388      2      
TestPolicyCloud.testCreateCollectionAddShardUsingPolicy
     0      0.5      388      2      
TestPolicyCloud.testCreateCollectionAddShardWithReplicaTypeUsingPolicy
     0      0.5      388      2      
TestPolicyCloud.testCreateCollectionSplitShard
     0      0.5      388      2      TestPolicyCloud.testDataProvider
     0      0.5      388      2      
TestPolicyCloud.testDataProviderPerReplicaDetails
     0      0.5      388      2      TestPolicyCloud.testMetricsTag
     0      0.3      388      1      TestPrepRecovery.testLeaderNotResponding
     0      0.3      388      1      TestPrepRecovery.testLeaderUnloaded
     0      0.8      389      3      
TestPullReplicaErrorHandling.testCantConnectToLeader
     0      0.8      389      3      
TestPullReplicaErrorHandling.testCantConnectToPullReplica
     0      0.8      389      3      
TestPullReplicaErrorHandling.testPullReplicaDisconnectsFromZooKeeper
     0      0.8      390      3      TestRandomRequestDistribution.test
     0      0.3      386      1      TestReplicaProperties.test
     0      0.8      390      3      
TestRequestForwarding.testMultiCollectionQuery
     0      0.8      387      3      
TestSSLRandomization.testRandomizedSslAndClientAuth
     0      0.8      388      3      
TestSegmentSorting.testAtomicUpdateOfSegmentSortField
     0      0.8      388      3      
TestSegmentSorting.testSegmentTerminateEarly
     0      0.8      393      3      TestShortCircuitedRequests.test
     0      0.3      397      1      TestSimScenario.testIndexing
     0      0.8      397      3      TestSimScenario.testSplitShard
     0      0.3      386      1      
TestSkipOverseerOperations.testSkipDownOperations
     0      0.3      386      1      
TestSkipOverseerOperations.testSkipLeaderOperations
     0      0.3      390      1      TestSmileRequest.testDistribJsonRequest
     0      0.3      391      1      
TestSolrCLIRunExample.testInteractiveSolrCloudExample
     0      0.5      388      2      TestSolrCloudSnapshots.testSnapshots
     0      0.3      389      1      
TestSolrCloudWithDelegationTokens.testDelegationTokenRenew
     0      0.5      389      2      
TestSolrCloudWithDelegationTokens.testDelegationTokenSolrClientWithUpdateRequests
     0      0.5      386      2      TestSolrCloudWithKerberosAlt.testBasics
     0      0.3      333      1      
TestSolrCloudWithSecureImpersonation.testForwarding
     0      1.3      394      5      TestSolrConfigHandlerCloud.test
     0      1.4      418      6      TestSolrConfigHandlerConcurrent.test
     0      0.5      386      2      TestSolrCoreSnapshots.testBackupRestore
     0      0.5      386      2      TestSolrCoreSnapshots.testIndexOptimization
     0      0.3      389      1      
TestSolrDeletionPolicy1.testNumCommitsConfigured
     0      1.0      394      4      TestStressInPlaceUpdates.stressTest
     0      1.0      392      4      TestSystemCollAutoCreate.testAutoCreate
     0      0.3      391      1      TestTlogReplica.testAddDocs
     0      0.3      391      1      TestTlogReplica.testAddRemoveTlogReplica
     0      0.3      391      1      TestTlogReplica.testBasicLeaderElection
     0      0.3      782      2      TestTlogReplica.testCreateDelete
     0      0.3      391      1      TestTlogReplica.testDeleteById
     0      0.3      391      1      TestTlogReplica.testKillLeader
     0      0.3      391      1      TestTlogReplica.testOnlyLeaderIndexes
     0      0.5      391      2      
TestTlogReplica.testOutOfOrderDBQWithInPlaceUpdates
     0      0.3      391      1      TestTlogReplica.testRealTimeGet
     0      0.3      391      1      TestTlogReplica.testRecovery
     0      0.3      386      1      
TestTrackingShardHandlerFactory.testRequestTracking
     0      0.7      403      3      TestUtilizeNode.test
     0      0.5      387      2      TestV2Request.testCloudSolrClient
     0      0.5      387      2      TestV2Request.testHttpSolrClient
     0      0.5      387      2      TestV2Request.testV2Forwarding
     0      0.8      391      3      
TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown
     0      0.8      391      3      
TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown
     0      1.8      399      7      TestWithCollection.testAddReplicaSimple
     0      2.0      399      8      TestWithCollection.testAddReplicaWithPolicy
     0      1.8      399      7      TestWithCollection.testCreateCollection
     0      1.8      399      7      
TestWithCollection.testCreateCollectionNoWithCollection
     0      1.8      399      7      TestWithCollection.testDeleteWithCollection
     0      1.8      399      7      
TestWithCollection.testMoveReplicaMainCollection
     0      1.8      399      7      
TestWithCollection.testMoveReplicaWithCollection
     0      1.8      399      7      
TestWithCollection.testMultipleWithCollections
     0      2.0      399      8      TestWithCollection.testNodeAdded
     0      0.5      387      2      
TestZKPropertiesWriter.testZKPropertiesWriter
     0      1.0      387      4      UnloadDistributedZkTest.test
     0      0.5      388      2      
ZkCollectionPropsCachingTest.testReadWriteCached
     0      1.0      390      4      ZkFailoverTest.testRestartZkWhenClusterDown
     0      1.8      393      7      
ZkShardTermsTest.testParticipationOfReplicas
      123   4.5       77      6      ShardSplitTest.testSplitWithChaosMonkey
      1     9.5       21      2      HdfsWriteToMultipleCollectionsTest.test
      1     5.0       20      1      StressHdfsTest.test
      1    16.7       24      4      
TestIndexingSequenceNumbers.testStressConcurrentCommit
      1     4.7      129      6      
TestSimpleTextTermVectorsFormat.testPostingsEnumOffsets
      1    32.4       34     11      
TestSimpleTextTermVectorsFormat.testRamBytesUsed
      1    18.2       11      2      ThreadDumpHandlerTest.testMonitor
      1    27.3       11      3      ThreadDumpHandlerTest.testOwnableSync
       23   7.6      420    194      DebugComponentTest.testBasicInterface
       23   7.6      420    194      DebugComponentTest.testPerItemInterface
       2    1.6      122      2      PeerSyncWithLeaderTest.test
       2    0.8      126      1      
TestBlockJoin.testMultiChildQueriesOfDiffParentLevels
       2    1.6      127      2      TestDemoParallelLeafReader.testBasic
       2    1.6      127      2      
TestDemoParallelLeafReader.testBasicMultipleSchemaGens
       2    1.6      127      2      TestDemoParallelLeafReader.testRandom
       2    1.6      127      2      
TestDemoParallelLeafReader.testRandomMultipleSchemaGens
       2    0.8      126      1      
TestDemoParallelLeafReader.testRandomMultipleSchemaGensSameField
       2   52.6       38     20      TestStressThreadBackup.testCoreAdminHandler
       2   52.6       38     20      
TestStressThreadBackup.testReplicationHandler
        3  17.1      140     24      
CurrencyRangeFacetCloudTest.testJsonRangeFacetWithSubFacet
        3  17.2       29      5      HdfsSyncSliceTest.test
        3  30.6       36     11      
TestBinaryDocValuesUpdates.testTonsOfUpdates
        3   3.1      131      4      
TestBinaryDocValuesUpdates.testUpdateSegmentWithPostingButNoDocValues
        3   0.8      125      1      
TestIndexWriterDelete.testErrorInDocsWriterAdd
        3   0.8      125      1      TestIndexWriterDelete.testSimpleCase
        3   8.7      126     11      TestMultiWordSynonyms.testPf
        3   5.5      127      7      
TestRandomChains.testRandomChainsWithLargeStrings
        3   1.7      121      2      
TestSearcherManager.testConcurrentIndexCloseSearchAndRefresh
        3   0.9      116      1      TestSimDistributedQueue.testPeekElements
        3   8.4      131     11      
TestXYMultiPointShapeQueries.testLowCardinalityShapeManyTimes



***********************Annotations report

*****************AwaitsFix Annotations:


************Lucene AwaitsFix
TestAllFilesDetectBitFlips.TestAllFilesDetectBitFlips suite
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-9356";)

TestAllFilesDetectTruncation.TestAllFilesDetectTruncation suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-9409";)

TestControlledRealTimeReopenThread.testCRTReopen
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5737";)

TestICUNormalizer2CharFilter.testRandomStrings
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5595";)

TestICUTokenizerCJK.TestICUTokenizerCJK suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8222";)

TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-7161";)


    ************Solr AwaitsFix
CdcrBidirectionalTest.testBiDir
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12524";)

CdcrBootstrapTest.testBootstrapWithContinousIndexingOnSourceCluster
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12028";)

CollectionsAPISolrJTest.testCreateAndDeleteShard
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13021";)

ConcurrentCreateRoutedAliasTest.ConcurrentCreateRoutedAliasTest suite
   @LuceneTestCase.AwaitsFix(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-12386";) // "Can't find resource"

LeaderTragicEventTest.LeaderTragicEventTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13237";)

MoveReplicaHDFSTest.MoveReplicaHDFSTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13924";)

MoveReplicaHDFSTest.testFailedMove
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12080";) // 
added 03-Oct-2018

RoutedAliasUpdateProcessorTest.alias,
   
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13696";)

SSLMigrationTest.SSLMigrationTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
17-Mar-2018

SaslZkACLProviderTest.testSaslZkACLProvider
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13075";)

SolrExporterIntegrationTest.SolrExporterIntegrationTest suite
   
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13786";)

Tagger2Test.testStopWords
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-8344";)

TestHierarchicalDocBuilder.testThreeLevelHierarchy
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12801";) // 
this test fails easily under beasting

TestImpersonationWithHadoopAuth.testForwarding
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/HADOOP-9893";)

TestJsonFacetRefinement.testIndexAscRefineConsistency
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-14595";)

TestJsonFacetRefinement.testProcessEmptyRefinement
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556";)

TestJsonFacetRefinement.testSortedSubFacetRefinementWhenParentOnlyReturnedByOneShardProcessEmpty
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556";)

TestLTRReRankingPipeline.testDifferentTopN
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-11134";)

TestMinMaxOnMultiValuedField.testDoubleFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestMinMaxOnMultiValuedField.testFloatFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestMinMaxOnMultiValuedField.testIntFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestMinMaxOnMultiValuedField.testLongFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestPullReplica.TestPullReplica suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

TestStressRecovery.TestStressRecovery suite
   
@LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 6-Sep-2018

TestTlogReplayVsRecovery.TestTlogReplayVsRecovery suite
   
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13486;https://issues.apache.org/jira/browse/SOLR-14183";)

TimeRoutedAliasUpdateProcessorTest.testDateMathInStart
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13943";)

TriLevelCompositeIdRoutingTest.test
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13369";)



*****************BadApple Annotations:

************Lucene BadApple

************Solr BadApple
MoveReplicaHDFSTest.testNormalFailedMove
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
14-Oct-2018

SharedFSAutoReplicaFailoverTest.SharedFSAutoReplicaFailoverTest suite
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // added 20-Jul-2018

TimeRoutedAliasUpdateProcessorTest.TimeRoutedAliasUpdateProcessorTest suite
   @LuceneTestCase.BadApple(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-13059";)




---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to