The BadApple report remains skewed as the results include the reference impl so 
this is mostly in case people are curious….

I expect next week to see an uptick in the number of tests that have failed 
each of the last 4 weeks, that’ll be when the reference-impl parts of the 
report kick in. We’ll see how things progress after that.

There were 354 unannotated tests that failed in Hoss' rollups. Ordered by the 
date I downloaded the rollup file, newest->oldest. See above for the dates the 
files were collected 
These tests were NOT BadApple'd or AwaitsFix'd

Failures in the last 4 reports..
   Report   Pct     runs    fails           test
     0123   1.4     1662     54      HttpPartitionOnCommitTest.test
     0123   4.8     1624     25      HttpPartitionWithTlogReplicasTest.test
     0123   0.3     1608      4      
LBSolrClientTest.testServerIteratorTimeAllowed
     0123   2.7     1684     53      MultiThreadedOCPTest.test
     0123  50.0        8      4      SharedFSAutoReplicaFailoverTest.test
     0123   5.0     1350     27      TestHdfsCloudBackupRestore.test
     0123   4.8     1604     29      TestLocalFSCloudBackupRestore.test
     0123   0.6     1610     10      TestSolrConfigHandlerCloud.test
********************************************


Full results:

DO NOT ENABLE LIST:
    MoveReplicaHDFSTest.testFailedMove
    MoveReplicaHDFSTest.testNormalFailedMove
    TestControlledRealTimeReopenThread.testCRTReopen
    TestICUNormalizer2CharFilter.testRandomStrings
    TestICUTokenizerCJK
    TestImpersonationWithHadoopAuth.testForwarding
    TestLTRReRankingPipeline.testDifferentTopN
    TestRandomChains


DO NOT ANNOTATE LIST
    CdcrBidirectionalTest.testBiDir
    IndexSizeTriggerTest.testMergeIntegration
    IndexSizeTriggerTest.testMixedBounds
    IndexSizeTriggerTest.testSplitIntegration
    IndexSizeTriggerTest.testTrigger
    InfixSuggestersTest.testShutdownDuringBuild
    ShardSplitTest.test
    ShardSplitTest.testSplitMixedReplicaTypes
    ShardSplitTest.testSplitWithChaosMonkey
    Test2BPostings.test
    TestLatLonShapeQueries.testRandomBig
    TestPackedInts.testPackedLongValues
    TestRandomChains.testRandomChainsWithLargeStrings
    TestTriggerIntegration.testSearchRate

SuppressWarnings count: last week: 4,520, this week: 4,484, delta -36


*************** Files with increased @SuppressWarnings annotations:

Suppress count increase in: 
solr/core/src/java/org/apache/solr/metrics/MetricSuppliers.java. Was: 5, now: 6
Suppress count increase in: 
solr/core/src/test/org/apache/solr/cloud/ReplaceNodeTest.java. Was: 0, now: 1
Suppress count increase in: 
solr/core/src/test/org/apache/solr/cloud/TestConfigSetsAPI.java. Was: 13, now: 
15

*************** Files with decreased @SuppressWarnings annotations:

Suppress count decrease in: 
solr/core/src/java/org/apache/solr/cloud/api/collections/Assign.java. Was: 5, 
now: 1
Suppress count decrease in: 
solr/core/src/java/org/apache/solr/handler/ReplicationHandler.java. Was: 15, 
now: 14
Suppress count decrease in: 
solr/core/src/java/org/apache/solr/handler/admin/CollectionsHandler.java. Was: 
11, now: 8

Processing file (History bit 3): HOSS-2020-10-19.csv
Processing file (History bit 2): HOSS-2020-10-12.csv
Processing file (History bit 1): HOSS-2020-10-05.csv
Processing file (History bit 0): HOSS-2020-09-28.csv


Number of AwaitsFix: 31 Number of BadApples: 3


**Annotated tests that didn't fail in the last 4 weeks.

  **Tests removed from the next two lists because they were specified in 
'doNotEnable' in the properties file
     MoveReplicaHDFSTest.testNormalFailedMove

  **Annotations can be removed from the following tests because they haven't 
failed in the last 4 rollups.

  **Methods: 0


Raw fail count by week totals, most recent week first (corresponds to bits):
Week: 0  had  174 failures
Week: 1  had  142 failures
Week: 2  had  153 failures
Week: 3  had  51 failures


********Failures in Hoss' reports in every one of the last 4 rollups.

There were 354 unannotated tests that failed in Hoss' rollups. Ordered by the 
date I downloaded the rollup file, newest->oldest. See above for the dates the 
files were collected 
These tests were NOT BadApple'd or AwaitsFix'd

Failures in the last 4 reports..
   Report   Pct     runs    fails           test
     0123   1.4     1662     54      HttpPartitionOnCommitTest.test
     0123   4.8     1624     25      HttpPartitionWithTlogReplicasTest.test
     0123   0.3     1608      4      
LBSolrClientTest.testServerIteratorTimeAllowed
     0123   2.7     1684     53      MultiThreadedOCPTest.test
     0123  50.0        8      4      SharedFSAutoReplicaFailoverTest.test
     0123   5.0     1350     27      TestHdfsCloudBackupRestore.test
     0123   4.8     1604     29      TestLocalFSCloudBackupRestore.test
     0123   0.6     1610     10      TestSolrConfigHandlerCloud.test
********************************************

Failures over the last 4 weeks, but not every week. Ordered most-recent first:



   Report   Pct     runs    fails           test
     012  100.0       32     32      AssignTest.classMethod
     012  100.0      185    185      
AsyncCallRequestStatusResponseTest.classMethod
     012    0.6     1557     10      CachingDirectoryFactoryTest.stressTest
     012  100.0      113    113      CollectionsAPIDistributedZkTest.classMethod
     012    3.3     1588     37      
CollectionsAPIDistributedZkTest.testBadActionNames
     012    3.3     1588     37      
CollectionsAPIDistributedZkTest.testMissingNumShards
     012    3.3     1588     37      
CollectionsAPIDistributedZkTest.testMissingRequiredParameters
     012    3.3     1588     37      
CollectionsAPIDistributedZkTest.testNoConfigSetExist
     012    3.3     1588     37      
CollectionsAPIDistributedZkTest.testZeroNumShards
     012  100.0      185    185      CollectionsAPISolrJTest.classMethod
     012  100.0      185    185      
ConcurrentUpdateSolrClientMultiCollectionTest.classMethod
     012    0.3     1247      4      
ConnectionManagerTest.testReconnectWhenZkDisappeared
     012  100.0      185    185      DeleteNodeTest.classMethod
     012    0.3     1243      3      
DeleteReplicaTest.deleteReplicaAndVerifyDirectoryCleanup
     012    6.1     1267     30      HttpPartitionTest.test
     012  100.0      185    185      
JsonRequestApiHeatmapFacetingTest.classMethod
     012  100.0      185    185      JsonRequestApiTest.classMethod
     012  100.0      185    185      OverseerModifyCollectionTest.classMethod
     012    1.6      690      6      TestCircuitBreaker.testResponseWithCBTiming
     012    0.3     1242      4      
TestCustomStream.testDynamicLoadingCustomStream
     012    0.0     7512      3      TestJsonFacets.testTolerant
     012    5.2     1230     21      TestPackages.testPluginLoading
     012  100.0        4      4      TestReplicationHandler.classMethod
     012   15.6     1603    181      
TestSTUniformSplitPostingFormat.testCheckIntegrityReadsAllBytes
     012   29.8     1604    353      TestSynonymFilterFactory.testFormat
     012   29.8     1604    353      TestSynonymFilterFactory.testSynonyms
     012   29.8     1604    353      TestSysoutsLimits.OverHardLimit
     012   29.8     1604    353      TestSysoutsLimits.testOverSoftLimit
     012    0.6     1240      5      TestSystemCollAutoCreate.testAutoCreate
     012   15.6     1603    181      
TestUniformSplitPostingFormat.testCheckIntegrityReadsAllBytes
     012  100.0      185    185      UsingSolrJRefGuideExamplesTest.classMethod
     012  100.0      185    185      ZkConfigFilesTest.classMethod
     01 3   0.4      789      6      OverseerTest.testShardLeaderChange
     01 3   5.1     1140     22      ReplicationFactorTest.test
     01 3   4.7     1152     22      
ShardSplitTest.testSplitMixedReplicaTypesLink
     01 3 100.0       11     11      TestJsonFacets.classMethod
     01 3   0.6     1124      4      TestPointFields.testDoublePointStats
     01 3   0.6     1127      9      
TestPullReplicaErrorHandling.testPullReplicaDisconnectsFromZooKeeper
     01     4.8      764     18      BasicDistributedZk2Test.test
     01     4.2      764     16      
ChaosMonkeySafeLeaderWithPullReplicasTest.test
     01     0.2     1063      3      CloudHttp2SolrClientTest.testRouting
     01     0.5      396      3      ExecutePlanActionTest.testTaskTimeout
     01     2.8      764     13      ReplaceNodeTest.test
     01     5.0      776     20      ShardSplitTest.testSplitMixedReplicaTypes
     01   100.0        2      2      TestBM25SimilarityFactory.classMethod
     01     7.1       28      2      
TestIndexingSequenceNumbers.testStressConcurrentCommit
     01     7.1       28      2      TestInetAddressRangeQueries.testRandomBig
     01   100.0        2      2      TestLegacyBM25SimilarityFactory.classMethod
     01     1.4      758      6      
TestPullReplicaErrorHandling.testCantConnectToLeader
     0 23   1.1     1212      8      ChaosMonkeyNothingIsSafeTest.test
     0 23   0.3     1211      3      MathExpressionTest.testZipFDistribution
     0 23   0.3     1213      5      RollingRestartTest.test
     0 23   0.5      615      8      TestDynamicLoading.testDynamicLoading
     0 2    3.0      846     12      AssignBackwardCompatibilityTest.test
     0 2    4.8      833     19      
CollectionsAPIAsyncDistributedZkTest.testAsyncRequests
     0 2    0.5      427      2      
MetricTriggerIntegrationTest.testMetricTrigger
     0 2    0.3      837      2      MoveReplicaTest.testFailedMove
     0 2    0.3      838      2      
SolrCloudExampleTest.testLoadDocsIntoGettingStartedCollection
     0 2  100.0        2      2      TestCloudConsistency.classMethod
     0 2    5.3      839     20      
TestCloudSearcherWarming.testPeersyncFailureReplicationSuccess
     0 2    0.3      843      2      
TestConfigSetsAPIExclusivity.testAPIExclusivity
     0 2    0.8      834      6      TestPointFields.testFloatPointStats
     0 2    0.3      850      4      
TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast
     0 2    0.6      418      2      
TestRequestRateLimiter.testConcurrentQueries
     0 2    5.0      838     19      TestTlogReplica.testRebalanceLeaders
     0 2    4.7      838     18      TestTlogReplica.testRemoveLeader
     0  3   4.7      735     18      LeaderFailoverAfterPartitionTest.test
     0  3   0.3      723      2      
ManagedSchemaRoundRobinCloudTest.testAddFieldsRoundRobin
     0  3   4.7      737     18      ShardSplitTest.testSplitLocking
     0    100.0        1      1      AnalysisErrorHandlingTest.classMethod
     0      0.5      187      1      
AutoAddReplicasIntegrationTest.testClusterPropOverridesCollecitonProp
     0      0.2      494      1      BJQParserTest.testToParentFilters
     0      4.2      357     15      
ChaosMonkeyNothingIsSafeWithPullReplicasTest.test
     0      1.4      355      5      ChaosMonkeySafeLeaderTest.test
     0    100.0        4      4      CloudHttp2SolrClientTest.classMethod
     0      0.4      494      2      
CloudHttp2SolrClientTest.preferReplicaTypesTest
     0      0.2      494      1      
CloudHttp2SolrClientTest.singleShardedPreferenceRules
     0      0.2      494      1      
CloudHttp2SolrClientTest.testNonRetryableRequests
     0      0.2      494      1      
CloudHttp2SolrClientTest.testParallelUpdateQTime
     0      0.3      357      1      
CollectionsAPIDistributedZkTest.addReplicaTest
     0      0.3      357      1      
CollectionsAPIDistributedZkTest.testCreateNodeSet
     0      0.3      357      1      
CustomCollectionTest.testRouteFieldForImplicitRouter
     0      5.0      359     18      
DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplica
     0      7.1       14      1      ForceLeaderTest.testReplicasInLowerTerms
     0      7.7       13      1      
ForceLeaderWithTlogReplicasTest.testReplicasInLowerTerms
     0      0.3      357      1      InfixSuggestersTest.testReloadDuringBuild
     0    100.0        4      4      
JsonQueryRequestHeatmapFacetingTest.classMethod
     0      4.8      357     17      LeaderFailureAfterFreshStartTest.test
     0      4.8      356     17      
LeaderVoteWaitTimeoutTest.testMostInSyncReplicasCanWinElection
     0      4.8      357     17      
MigrateRouteKeyTest.multipleShardMigrateTest
     0      4.8      357     17      
MissingSegmentRecoveryTest.testLeaderRecovery
     0      4.2      356     15      MoveReplicaTest.test
     0      0.5      185      1      
NodeLostTriggerIntegrationTest.testNodeLostTriggerRestoreState
     0      0.5      186      1      
NodeMarkersRegistrationTest.testNodeMarkersRegistration
     0    100.0        1      1      PeerSyncReplicationTest.classMethod
     0      4.8      357     17      RecoveryAfterSoftCommitTest.test
     0      4.8      357     17      RecoveryZkTest.test
     0      0.3      358      1      ReindexCollectionTest.testReshapeReindexing
     0      0.3      357      1      ShardRoutingTest.test
     0    100.0        2      2      ShardSplitTest.classMethod
     0      5.9       17      1      ShardSplitTest.test
     0      4.7      361     17      
ShardSplitTest.testSplitStaticIndexReplication
     0      4.7      361     17      
ShardSplitTest.testSplitStaticIndexReplicationLink
     0     11.8       17      2      ShardSplitTest.testSplitWithChaosMonkey
     0      0.2      495      1      
SolrExampleBinaryHttp2Test.testCommitWithinOnAdd
     0      0.3      356      1      SolrShardReporterTest.test
     0    100.0        1      1      SolrXmlInZkTest.classMethod
     0      4.8      356     17      SyncSliceTest.test
     0    100.0        1      1      TestAtomicUpdateErrorCases.classMethod
     0      0.3      357      1      TestBlobHandler.doBlobHandlerTest
     0      4.8      357     17      TestCloudRecovery.corruptedLogTest
     0      5.0      357     18      TestCloudRecovery2.test
     0    100.0        1      1      TestCloudSearcherWarming.classMethod
     0      0.3      299      1      
TestDelegationWithHadoopAuth.testDelegationTokenRenew
     0      0.1     1050      1      TestJsonFacets.testFacetValueTypesDistrib
     0      0.0     2166      1      TestJsonFacets.testStatsDistrib
     0      4.7      358     17      TestLeaderElectionWithEmptyReplica.test
     0    100.0        1      1      TestLocalFSCloudBackupRestore.classMethod
     0    100.0        1      1      TestMiniSolrCloudClusterSSL.classMethod
     0    100.0        1      1      TestPHPSerializedResponseWriter.classMethod
     0    100.0        3      3      TestPackages.classMethod
     0      0.3      358      1      
TestRandomFlRTGCloud.testRandomizedUpdatesAndRTGs
     0      4.7      358     17      TestReplicationHandler.doTestDetails
     0      4.7      358     17      
TestReplicationHandler.doTestIndexAndConfigAliasReplication
     0      4.7      358     17      
TestReplicationHandler.doTestIndexAndConfigReplication
     0      4.7      358     17      
TestReplicationHandler.doTestIndexFetchOnLeaderRestart
     0      4.7      358     17      
TestReplicationHandler.doTestIndexFetchWithLeaderUrl
     0      4.7      358     17      
TestReplicationHandler.doTestReplicateAfterCoreReload
     0      4.7      358     17      
TestReplicationHandler.doTestReplicateAfterStartup
     0      4.7      358     17      
TestReplicationHandler.doTestReplicateAfterStartupWithNoActivity
     0      4.7      358     17      TestReplicationHandler.doTestStopPoll
     0      4.7      358     17      
TestReplicationHandler.doTestStressReplication
     0      4.7      358     17      
TestReplicationHandler.testRateLimitedReplication
     0      0.1     4970      6      
TestSolr4Spatial2.testLLPDecodeIsStableAndPrecise
     0      4.5      355     16      TestSolrCloudSnapshots.testSnapshots
     0     10.1      129     13      
TestSpanExplanations.testExplainWithoutScoring
     0     10.2      128     13      
TestSpanExplanationsOfNonMatches.testExplainWithoutScoring
     0      0.6      357      2      TestStressCloudBlindAtomicUpdates.test_dv
     0      0.6      357      2      
TestStressCloudBlindAtomicUpdates.test_dv_idx
     0      0.6      357      2      
TestStressCloudBlindAtomicUpdates.test_dv_stored
     0      0.6      357      2      
TestStressCloudBlindAtomicUpdates.test_dv_stored_idx
     0      0.6      357      2      
TestStressCloudBlindAtomicUpdates.test_stored_idx
     0      3.9      358     14      TestTlogReplica.testAddDocs
     0      4.7      358     17      TestTlogReplica.testBasicLeaderElection
     0      4.7      358     17      TestTlogReplica.testDeleteById
     0      4.7      358     17      TestTlogReplica.testKillLeader
     0      4.7      358     17      TestTlogReplica.testOnlyLeaderIndexes
     0      4.7      358     17      
TestTlogReplica.testOutOfOrderDBQWithInPlaceUpdates
     0      4.7      358     17      TestTlogReplica.testRecovery
     0      5.9       17      1      TestVectorValues.testAddIndexesDirectory01
     0      7.1       14      1      TlogReplayBufferedWhileIndexingTest.test
     0      0.2      494      1      
UninvertDocValuesMergePolicyTest.testIndexAndAddDocValues
     0      5.0      357     18      UnloadDistributedZkTest.test
      123   0.7     1290     19      BasicDistributedZkTest.test
      123   0.2     1245      3      PeerSyncReplicationTest.test
      123   1.5     1286     42      TestExportWriter.testExpr
      123   1.0     1251      7      TestInPlaceUpdatesDistrib.test
      123   0.2     5994    190      
TestUnifiedHighlighterStrictPhrases.testBasics
      12    0.2     1078     19      
ConcurrentUpdateSolrClientMultiCollectionTest.testEnsureDocumentsSentToCorrectCollection
      12    0.3      549      2      
StreamDecoratorTest.testParallelTerminatingDaemonUpdateStream
      12    0.3      537      2      
StreamExpressionTest.testFeaturesSelectionStream
      12    0.2      879      2      
TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader
      12  100.0        2      2      TestCloudSchemaless.classMethod
      12    0.2      885      2      TestCollectionAPI.test
      12    0.2      885      2      
TestCollectionAPI.testRecreateCollectionAfterFailure
      12    0.2      887      2      
TestSolrCloudWithDelegationTokens.testDelegationTokenRenew
      1 3   0.5      766      4      CustomHighlightComponentTest.test
      1 3   0.5      775      8      
MetricsHistoryWithAuthIntegrationTest.testValuesAreCollected
      1     0.2      566      1      
AsyncCallRequestStatusResponseTest.testAsyncCallStatusResponse
      1   100.0        1      1      BinaryUpdateRequestHandlerTest.classMethod
      1     0.2      569      1      
CloudHttp2SolrClientTest.testInitializationWithSolrUrls
      1     0.2      569      1      
CloudHttp2SolrClientTest.testRetryUpdatesWhenClusterStateIsStale
      1     0.2      569      1      
CloudHttp2SolrClientTest.testVersionsAreReturned
      1   100.0        1      1      CloudSolrClientRetryTest.classMethod
      1   100.0        1      1      CloudSolrClientTest.classMethod
      1   100.0        1      1      CrossCollectionJoinQueryTest.classMethod
      1   100.0        1      1      DefaultValueUpdateProcessorTest.classMethod
      1   100.0        1      1      DeleteStatusTest.classMethod
      1     0.2      402      1      
DistributedQueueTest.testDistributedQueueBlocking
      1     0.4      284      1      
DistributedUpdateProcessorTest.testVersionDelete
      1     8.3       12      1      HdfsBasicDistributedZkTest.test
      1   100.0        1      1      IndexSchemaTest.classMethod
      1   100.0        1      1      JdbcTest.classMethod
      1   100.0        1      1      NotRequiredUniqueKeyTest.classMethod
      1     0.4      283      1      OverseerTest.testReplay
      1   100.0        1      1      
PreAnalyzedFieldManagedSchemaCloudTest.classMethod
      1     0.5      209      1      
ScheduledMaintenanceTriggerTest.testInactiveMarkersCleanup
      1   100.0        1      1      ShardRoutingCustomTest.classMethod
      1     0.3      366      1      
SoftAutoCommitTest.testSoftAndHardCommitMaxTimeMixedAdds
      1     0.2      409      1      
SolrExampleJettyTest.testCommitWithinOnDelete
      1   100.0        1      1      SortSpecParsingTest.classMethod
      1     0.2      404      1      
StreamDecoratorTest.testParallelDaemonUpdateStream
      1   100.0        1      1      TestBadConfig.classMethod
      1     0.3      590      2      TestBoolean2.testRandomQueries
      1     0.2      572      1      TestCloudJSONFacetJoinDomain.testRandom
      1     0.2      402      1      TestCloudSchemaless.test
      1   100.0        1      1      TestCollectionAPI.classMethod
      1     0.2      405      1      
TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete
      1   100.0        1      1      TestConfigSetsAPIExclusivity.classMethod
      1   100.0        1      1      TestDFISimilarityFactory.classMethod
      1     0.2      590      1      TestDemoParallelLeafReader.testRandom
      1     0.2      590      1      
TestDemoParallelLeafReader.testRandomMultipleSchemaGensSameField
      1   100.0        1      1      TestDistributedMap.classMethod
      1     0.2      405      1      TestDistributedSearch.test
      1     0.5      207      1      TestDynamicLoadingUrl.testDynamicLoadingUrl
      1     0.5      407      2      
TestFieldSortOptimizationSkipping.testDocSort
      1     0.8      265      2      
TestFieldSortOptimizationSkipping.testDocSortOptimizationWithAfter
      1     0.5      407      2      
TestFieldSortOptimizationSkipping.testFloatSortOptimization
      1     0.2      407      1      
TestFieldSortOptimizationSkipping.testLongSortOptimization
      1     0.5      407      2      
TestFieldSortOptimizationSkipping.testSortOptimizationEqualValues
      1     0.2      407      1      
TestFieldSortOptimizationSkipping.testSortOptimizationWithMissingValues
      1     0.2      590      1      TestIndexFileDeleter.testExcInDecRef
      1     0.2      406      1      TestPrepRecovery.testLeaderNotResponding
      1     0.2      406      1      TestPrepRecovery.testLeaderUnloaded
      1   100.0        1      1      TestQuerySenderListener.classMethod
      1   100.0        1      1      TestSearchPerf.classMethod
      1     0.2      567      1      
TestSegmentSorting.testAtomicUpdateOfSegmentSortField
      1     0.5      204      1      TestSimTriggerIntegration.testEventQueue
      1     3.0      607     18      
TestSimpleSearchEquivalence.testBooleanReqExclVersusTerm
      1   100.0        1      1      TestSimpleTextNormsFormat.classMethod
      1     0.2      590      1      TestSimpleTextNormsFormat.testShortRange
      1   100.0        1      1      TestSkipOverseerOperations.classMethod
      1     0.5      207      1      
TestSnapshotCloudManager.testComplexSnapshot
      1     0.5      207      1      
TestSnapshotCloudManager.testSimulatorFromSnapshot
      1     0.3      590      2      
TestTopFieldCollector.testSortWithoutTotalHitTracking
      1   100.0        1      1      TestWordDelimiterFilterFactory.classMethod
      1     0.2      582      1      
TestWordDelimiterFilterFactory.testRetainPositionIncrement
      1     1.0      209      2      
TriggerSetPropertiesIntegrationTest.testSetProperties
       23   0.4      433      3      
ComputePlanActionTest.testSelectedCollectionsByName
       23   0.8      433      3      
ComputePlanActionTest.testSelectedCollectionsByPolicy
       23   0.2      842      2      TestCloudManagedSchema.test
       23   0.4      433      3      TestCryptoKeys.test
       23 100.0        2      2      
TestStressCloudBlindAtomicUpdates.classMethod
       2    0.4      236      1      
CdcrVersionReplicationTest.testCdcrDocVersions
       2    0.2      499      1      
CloudSolrClientTest.testRetryUpdatesWhenClusterStateIsStale
       2    0.4      242      1      
ComputePlanActionTest.testNodeAddedTriggerWithAddReplicaPreferredOpReplicaType_1Shard
       2    3.5      509     18      
ConcurrentUpdateHttp2SolrClientMultiCollectionTest.testEnsureDocumentsSentToCorrectCollection
       2    0.2      479      1      DeleteShardTest.test
       2    0.8      484      4      DistribJoinFromCollectionTest.testNoScore
       2    0.2      484      1      DistribJoinFromCollectionTest.testScore
       2  100.0        1      1      DistributedDebugComponentTest.classMethod
       2    0.2      481      1      DistributedIntervalFacetingTest.test
       2  100.0        1      1      DistributedVersionInfoTest.classMethod
       2    0.2      477      1      
DocValuesNotIndexedTest.testGroupingDVOnlySortFirst
       2    0.4      240      1      ExecutePlanActionTest.testTaskFail
       2  100.0        1      1      HdfsNNFailoverTest.classMethod
       2    0.4      242      1      IndexSizeTriggerTest.testSplitIntegration
       2    4.7      511     24      
JsonLoaderTest.testAddBigIntegerValueToTrieField
       2    0.2      482      1      
OverseerTaskQueueTest.testDistributedQueueBlocking
       2    0.2      482      1      OverseerTaskQueueTest.testPeekElements
       2    0.2      476      1      ReindexCollectionTest.testLossySchema
       2    0.4      239      1      
ScheduledTriggerIntegrationTest.testScheduledTrigger
       2    0.2      482      1      ShardSplitTest.testSplitShardWithRuleLink
       2    0.2      478      1      
SimpleCollectionCreateDeleteTest.testCreateAndDeleteThenCreateAgain
       2    0.2      430      1      
SoftAutoCommitTest.testHardCommitWithinAndSoftCommitMaxTimeMixedAdds
       2    0.2      493      1      
SolrExampleEmbeddedTest.testCommitWithinOnAdd
       2  100.0        1      1      StreamDecoratorTest.classMethod
       2    0.2      479      1      StreamDecoratorTest.testExecutorStream
       2    0.2      494      1      StreamDecoratorTest.testParallelFetchStream
       2    0.4      486      2      SystemCollectionCompatTest.testBackCompat
       2    3.7      492     18      
TestBulkSchemaAPI.testAddFieldMatchingExistingDynamicField
       2    3.7      492     18      
TestBulkSchemaAPI.testAddFieldWithExistingCatchallDynamicField
       2    3.7      492     18      TestBulkSchemaAPI.testAddNewFieldAndQuery
       2    3.7      492     18      TestBulkSchemaAPI.testAnalyzerClass
       2    3.7      492     18      TestBulkSchemaAPI.testCopyFieldRules
       2    3.7      492     18      TestBulkSchemaAPI.testDeleteAndReplace
       2    3.7      492     18      TestBulkSchemaAPI.testMultipleCommands
       2    3.7      492     18      TestBulkSchemaAPI.testSimilarityParser
       2    3.7      492     18      
TestBulkSchemaAPI.testSortableTextFieldWithAnalyzer
       2  100.0        1      1      TestCloudPivotFacet.classMethod
       2  100.0        1      1      TestConfigSetsAPI.classMethod
       2  100.0        1      1      TestDownShardTolerantSearch.classMethod
       2    0.2      483      1      
TestIndexWriterMergePolicy.testStressUpdateSameDocumentWithMergeOnCommit
       2    0.2      484      1      TestLBHttp2SolrClient.testSimple
       2    0.2      484      1      TestLBHttp2SolrClient.testTwoServers
       2    0.2      496      1      TestLockTree.testLocks
       2    3.5      508     18      
TestManagedStopFilterFactory.testManagedStopwords
       2    3.5      508     18      
TestManagedSynonymFilterFactory.testManagedSynonyms
       2    3.6      507     18      
TestManagedSynonymGraphFilterFactory.testManagedSynonyms
       2  100.0        1      1      TestOnReconnectListenerSupport.classMethod
       2  100.0        1      1      TestRandomFlRTGCloud.classMethod
       2    0.6      483      3      TestRandomRequestDistribution.test
       2    0.3      397      1      TestRecoveryHdfs.testExistOldBufferLog
       2    0.3      397      1      TestRecoveryHdfs.testRecoveryMultipleLogs
       2    0.2      483      1      TestReplicaProperties.test
       2    0.2      476      1      
TestSegmentSorting.testSegmentTerminateEarly
       2  100.0        1      1      TestSizeLimitedDistributedMap.classMethod
       2    3.5      509     18      TestUseDocValuesAsStored2.testSchemaAPI
       2    0.2      499      1      ZkConfigFilesTest.testCanUploadConfigToZk
       2    0.2      480      1      ZookeeperStatusHandlerTest.monitorZookeeper
        3   0.5      184      1      AutoScalingHandlerTest.testReadApi
        3   0.5      184      1      
AutoScalingHandlerTest.testSuggestionsWithPayload
        3   0.5      191      1      ComputePlanActionTest.testNodeAdded
        3   0.3      367      1      CreateRoutedAliasTest.testV2
        3 100.0        1      1      
MetricsHistoryWithAuthIntegrationTest.classMethod
        3 100.0        1      1      RouteFieldTest.classMethod
        3   0.8      366      3      TestContainerPlugin.testApiFromPackage
        3 100.0        1      1      TestHdfsCloudBackupRestore.classMethod
        3 100.0        1      1      TestQueryingOnDownCollection.classMethod
        3   0.5      186      1      
TestSimLargeCluster.testCreateLargeSimCollections
        3   1.1      371      4      TestSolrConfigHandlerConcurrent.test
        3   0.5      185      1      TestWithCollection.testNodeAdded
        3 100.0        1      1      
VMParamsZkACLAndCredentialsProvidersTest.classMethod



***********************Annotations report

*****************AwaitsFix Annotations:


************Lucene AwaitsFix
TestAllFilesDetectBitFlips.TestAllFilesDetectBitFlips suite
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-9356";)

TestAllFilesDetectTruncation.TestAllFilesDetectTruncation suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-9409";)

TestControlledRealTimeReopenThread.testCRTReopen
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5737";)

TestICUNormalizer2CharFilter.testRandomStrings
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5595";)

TestICUTokenizerCJK.TestICUTokenizerCJK suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8222";)

TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-7161";)


    ************Solr AwaitsFix
CollectionsAPISolrJTest.testCreateAndDeleteShard
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13021";)

ConcurrentCreateRoutedAliasTest.ConcurrentCreateRoutedAliasTest suite
   @LuceneTestCase.AwaitsFix(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-12386";) // "Can't find resource"

LeaderTragicEventTest.LeaderTragicEventTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13237";)

MoveReplicaHDFSTest.MoveReplicaHDFSTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13924";)

MoveReplicaHDFSTest.testFailedMove
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12080";) // 
added 03-Oct-2018

RoutedAliasUpdateProcessorTest.alias,
   
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13696";)

SSLMigrationTest.SSLMigrationTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
17-Mar-2018

SaslZkACLProviderTest.testSaslZkACLProvider
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13075";)

SecurityHeadersTest.SecurityHeadersTest suite
   
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-14903";)

SolrExporterIntegrationTest.SolrExporterIntegrationTest suite
   
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13786";)

Tagger2Test.testStopWords
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-8344";)

TestImpersonationWithHadoopAuth.testForwarding
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/HADOOP-9893";)

TestJsonFacetRefinement.testIndexAscRefineConsistency
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-14595";)

TestJsonFacetRefinement.testProcessEmptyRefinement
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556";)

TestJsonFacetRefinement.testSortedSubFacetRefinementWhenParentOnlyReturnedByOneShardProcessEmpty
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556";)

TestLTRReRankingPipeline.testDifferentTopN
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-11134";)

TestMinMaxOnMultiValuedField.testDoubleFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestMinMaxOnMultiValuedField.testFloatFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestMinMaxOnMultiValuedField.testIntFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestMinMaxOnMultiValuedField.testLongFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestPullReplica.TestPullReplica suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

TestStressRecovery.TestStressRecovery suite
   
@LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 6-Sep-2018

TestTlogReplayVsRecovery.TestTlogReplayVsRecovery suite
   
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13486;https://issues.apache.org/jira/browse/SOLR-14183";)

TimeRoutedAliasUpdateProcessorTest.testDateMathInStart
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13943";)

TriLevelCompositeIdRoutingTest.test
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13369";)



*****************BadApple Annotations:

************Lucene BadApple

************Solr BadApple
MoveReplicaHDFSTest.testNormalFailedMove
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
14-Oct-2018

SharedFSAutoReplicaFailoverTest.SharedFSAutoReplicaFailoverTest suite
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // added 20-Jul-2018

TimeRoutedAliasUpdateProcessorTest.TimeRoutedAliasUpdateProcessorTest suite
   @LuceneTestCase.BadApple(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-13059";)


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to