Still noisy, waiting for the reference impl to untangle.

Short form:

Raw fail count by week totals, most recent week first (corresponds to bits):
Week: 0  had  136 failures
Week: 1  had  185 failures
Week: 2  had  210 failures
Week: 3  had  112 failures


********Failures in Hoss' reports in every one of the last 4 rollups.

There were 380 unannotated tests that failed in Hoss' rollups. Ordered by the 
date I downloaded the rollup file, newest->oldest. See above for the dates the 
files were collected 
These tests were NOT BadApple'd or AwaitsFix'd

Failures in the last 4 reports..
   Report   Pct     runs    fails           test
     0123   0.7     2080     10      CachingDirectoryFactoryTest.stressTest
     0123  18.3      666    134      ClusterEventProducerTest.testEvents
     0123   0.3     1471      5      DistributedFacetPivotLongTailTest.test
     0123   2.5     2056     17      
DistributedQueryComponentCustomSortTest.test
     0123 100.0       57     57      DocValuesNotIndexedTest.classMethod
     0123   0.8     1467      7      HttpPartitionOnCommitTest.test
     0123   0.5     1896     10      
ManagedSchemaRoundRobinCloudTest.testAddFieldsRoundRobin
     0123   4.5     1516     29      MultiThreadedOCPTest.test
     0123   0.3     1478      7      RollingRestartTest.test
     0123  50.0        7      4      SharedFSAutoReplicaFailoverTest.test
     0123   1.0     1526     20      TestCircuitBreaker.testResponseWithCBTiming
     0123  11.3     1467    129      TestContainerPlugin.testApi
     0123   2.6     1584     41      
TestDistributedStatsComponentCardinality.test
     0123   0.9     1264     11      TestHdfsCloudBackupRestore.test
     0123   1.3     1477     14      TestLocalFSCloudBackupRestore.test
     0123   1.5     1526     32      TestPackages.testPluginLoading
     0123   1.5     1801     33      
TestPullReplicaErrorHandling.testCantConnectToLeader
     0123   2.3     1801     40      
TestPullReplicaErrorHandling.testPullReplicaDisconnectsFromZooKeeper
********************************************


Full report:

DO NOT ENABLE LIST:
    MoveReplicaHDFSTest.testFailedMove
    MoveReplicaHDFSTest.testNormalFailedMove
    TestControlledRealTimeReopenThread.testCRTReopen
    TestICUNormalizer2CharFilter.testRandomStrings
    TestICUTokenizerCJK
    TestImpersonationWithHadoopAuth.testForwarding
    TestLTRReRankingPipeline.testDifferentTopN
    TestRandomChains


DO NOT ANNOTATE LIST
    CdcrBidirectionalTest.testBiDir
    IndexSizeTriggerTest.testMergeIntegration
    IndexSizeTriggerTest.testMixedBounds
    IndexSizeTriggerTest.testSplitIntegration
    IndexSizeTriggerTest.testTrigger
    InfixSuggestersTest.testShutdownDuringBuild
    ShardSplitTest.test
    ShardSplitTest.testSplitMixedReplicaTypes
    ShardSplitTest.testSplitWithChaosMonkey
    Test2BPostings.test
    TestLatLonShapeQueries.testRandomBig
    TestPackedInts.testPackedLongValues
    TestRandomChains.testRandomChainsWithLargeStrings
    TestTriggerIntegration.testSearchRate

SuppressWarnings count: last week: 4,491, this week: 4,491, delta 0


*************** Files with increased @SuppressWarnings annotations:

Suppress count increase in: 
solr/core/src/java/org/apache/solr/schema/IndexSchemaFactory.java. Was: 0, now: 
1

*************** Files with decreased @SuppressWarnings annotations:

Suppress count decrease in: 
lucene/core/src/test/org/apache/lucene/util/hnsw/TestHnsw.java. Was: 1, now: 0

Processing file (History bit 3): HOSS-2020-12-21.csv
Processing file (History bit 2): HOSS-2020-12-07.csv
Processing file (History bit 1): HOSS-2020-11-23.csv
Processing file (History bit 0): HOSS-2020-11-09.csv


Number of AwaitsFix: 31 Number of BadApples: 3


**Annotated tests that didn't fail in the last 4 weeks.

  **Tests removed from the next two lists because they were specified in 
'doNotEnable' in the properties file
     MoveReplicaHDFSTest.testNormalFailedMove

  **Annotations can be removed from the following tests because they haven't 
failed in the last 4 rollups.

  **Methods: 0


Raw fail count by week totals, most recent week first (corresponds to bits):
Week: 0  had  136 failures
Week: 1  had  185 failures
Week: 2  had  210 failures
Week: 3  had  112 failures


********Failures in Hoss' reports in every one of the last 4 rollups.

There were 380 unannotated tests that failed in Hoss' rollups. Ordered by the 
date I downloaded the rollup file, newest->oldest. See above for the dates the 
files were collected 
These tests were NOT BadApple'd or AwaitsFix'd

Failures in the last 4 reports..
   Report   Pct     runs    fails           test
     0123   0.7     2080     10      CachingDirectoryFactoryTest.stressTest
     0123  18.3      666    134      ClusterEventProducerTest.testEvents
     0123   0.3     1471      5      DistributedFacetPivotLongTailTest.test
     0123   2.5     2056     17      
DistributedQueryComponentCustomSortTest.test
     0123 100.0       57     57      DocValuesNotIndexedTest.classMethod
     0123   0.8     1467      7      HttpPartitionOnCommitTest.test
     0123   0.5     1896     10      
ManagedSchemaRoundRobinCloudTest.testAddFieldsRoundRobin
     0123   4.5     1516     29      MultiThreadedOCPTest.test
     0123   0.3     1478      7      RollingRestartTest.test
     0123  50.0        7      4      SharedFSAutoReplicaFailoverTest.test
     0123   1.0     1526     20      TestCircuitBreaker.testResponseWithCBTiming
     0123  11.3     1467    129      TestContainerPlugin.testApi
     0123   2.6     1584     41      
TestDistributedStatsComponentCardinality.test
     0123   0.9     1264     11      TestHdfsCloudBackupRestore.test
     0123   1.3     1477     14      TestLocalFSCloudBackupRestore.test
     0123   1.5     1526     32      TestPackages.testPluginLoading
     0123   1.5     1801     33      
TestPullReplicaErrorHandling.testCantConnectToLeader
     0123   2.3     1801     40      
TestPullReplicaErrorHandling.testPullReplicaDisconnectsFromZooKeeper
********************************************

Failures over the last 4 weeks, but not every week. Ordered most-recent first:



   Report   Pct     runs    fails           test
     012    2.3     1610     16      AnalyticsMergeStrategyTest.test
     012    4.1      621     25      AutoscalingHistoryHandlerTest.testHistory
     012    2.4     1088     16      
DistributedUpdateProcessorTest.testVersionAdd
     012    0.3     1088      6      
DistributedUpdateProcessorTest.testVersionDelete
     012  100.0       51     51      HttpSolrCallGetCoreTest.classMethod
     012    0.5     1153      4      LeaderVoteWaitTimeoutTest.basicTest
     012    0.2     1610     26      
MissingSegmentRecoveryTest.testLeaderRecovery
     012    0.2     1138      5      
OverseerRolesTest.testDesignatedOverseerRestarts
     012    0.7     1618     29      RecoveryZkTest.test
     012   25.7      360     34      ShardRoutingTest.doTestNumRequests
     012   13.6       58      6      ShardSplitTest.testSplitWithChaosMonkey
     012    0.8     1453     12      SolrJmxReporterTest.testClosedCore
     012    2.0     1619     36      SplitShardTest.doTest
     012    6.6     1617     62      TestCloudSchemaless.test
     012  100.0       20     20      TestDeleteCollectionOnDownNodes.classMethod
     012    0.2     1597     13      
TestDeleteCollectionOnDownNodes.deleteCollectionWithDownNodes
     012    1.9      616     19      TestWithCollection.testNodeAdded
     012  100.0       55     55      V2ApiIntegrationTest.classMethod
     01 3   1.5     1069      9      TestInPlaceUpdatesDistrib.test
     01 3   0.2     1068      3      TestStressLiveNodes.testStress
     01     1.0      728      5      DistributedFacetPivotLargeTest.test
     01     0.2      738      3      DistributedFacetPivotSmallTest.test
     01     2.5     1036     15      DistributedSpellCheckComponentTest.test
     01     2.5     1038     15      DistributedSuggestComponentTest.test
     01     0.5      365      2      IndexSizeTriggerTest.testMaxOps
     01     0.5      363      2      
NodeMarkersRegistrationTest.testNodeMarkersRegistration
     01     0.3      741     13      TestReplicationHandler.doTestDetails
     0 23   0.3     1136      3      
ChaosMonkeySafeLeaderWithPullReplicasTest.test
     0 23   2.5     1585     17      DistributedExpandComponentTest.test
     0 23   0.3     1146      3      
MetricsHistoryWithAuthIntegrationTest.testValuesAreCollected
     0 23   0.5     1137      4      TestSolrConfigHandlerCloud.test
     0 2    1.5      805      7      BasicDistributedZkTest.test
     0 2    0.3      800      3      
ChaosMonkeyNothingIsSafeWithPullReplicasTest.test
     0 2    0.7      804      4      
DistributedFacetSimpleRefinementLongTailTest.test
     0 2    2.5     1141     16      DistributedMLTComponentTest.test
     0 2  100.0       15     15      
DistributedQueryComponentOptimizationTest.classMethod
     0 2    2.3     1112     14      TermVectorComponentDistributedTest.test
     0 2    0.2      809      2      TestCloudRecovery2.test
     0 2    0.2     1114      2      TestOnReconnectListenerSupport.test
     0  3   0.5      741      5      
CollectionsAPIAsyncDistributedZkTest.testAsyncRequests
     0  3 100.0       31     31      ShardSplitTest.classMethod
     0  3   0.5      860      5      
TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast
     0  3   0.2      742      2      UnloadDistributedZkTest.test
     0    100.0        1      1      BadComponentTest.classMethod
     0      0.6      162      1      
CloudHttp2SolrClientWireMockTest.testConcurrentParallelUpdates
     0    100.0        6      6      CloudSolrClientBuilderTest.classMethod
     0    100.0        2      2      
CloudSolrClientMultiConstructorTest.classMethod
     0      1.0      202      2      
ClusterEventProducerTest.testListenerPlugins
     0      0.3      398      1      CollectionPropsTest.testWatcher
     0      0.3      396      1      
CollectionsAPIDistributedZkTest.addReplicaTest
     0      0.2      560      1      CollectionsAPISolrJTest.testSplitShard
     0     35.8      787    282      
ConfigureRecoveryStrategyTest.testAlmostAllMethodsAreFinal
     0      0.3      398      1      
ConnectionManagerTest.testReconnectWhenZkDisappeared
     0      0.2      558      1      DaemonStreamApiTest.testAPIs
     0    100.0       36     36      DeleteReplicaTest.classMethod
     0      0.5      564      3      
DeleteReplicaTest.deleteReplicaAndVerifyDirectoryCleanup
     0      2.3      556     13      DistributedFacetPivotSmallAdvancedTest.test
     0      0.2      403      1      DistributedIntervalFacetingTest.test
     0      2.3      562     13      DistributedQueryElevationComponentTest.test
     0      0.3      397      1      HttpPartitionWithTlogReplicasTest.test
     0      0.3      396      1      LeaderFailoverAfterPartitionTest.test
     0      7.6      368     28      LeaderTragicEventTest.testLeaderFailsOver
     0      2.3      558     13      MergeStrategyTest.test
     0      0.5      202      1      
PlacementPluginIntegrationTest.testDynamicReconfiguration
     0    100.0        1      1      
PreAnalyzedFieldManagedSchemaCloudTest.classMethod
     0      0.2      559      1      
QueryElevationComponentTest.testQuerySubsetMatching
     0      0.2      405      1      
ShardSplitTest.testSplitStaticIndexReplicationLink
     0      9.7      559     54      ShardsWhitelistTest.test
     0    100.0        1      1      SolrCoreTest.classMethod
     0    100.0        4      4      SolrJmxReporterCloudTest.classMethod
     0      0.2      401      1      SpatialHeatmapFacetsTest.testJsonFacets
     0      0.6      181      1      
StreamDecoratorTest.testParallelTerminatingDaemonUpdateStream
     0    100.0      127    127      TestBinaryDocValuesUpdates.classMethod
     0    100.0        1      1      TestBinaryResponseWriter.classMethod
     0    100.0        1      1      TestCodecSupport.classMethod
     0    100.0       66     66      
TestControlledRealTimeReopenThread.classMethod
     0      0.3      342      1      
TestDelegationWithHadoopAuth.testDelegationTokenRenew
     0      1.1      567      6      TestDeterminism.testRegexps
     0    100.0      162    162      TestDiversifiedTopDocsCollector.classMethod
     0      0.5      198      1      TestDynamicLoadingUrl.testDynamicLoadingUrl
     0    100.0        5      5      TestFieldCacheWithThreads.classMethod
     0    100.0      162    162      TestFunctionMatchQuery.classMethod
     0    100.0      162    162      TestFunctionScoreQuery.classMethod
     0    100.0      162    162      TestIntervals.classMethod
     0      0.3      399      1      TestJmxIntegration.testJmxOnCoreReload
     0      6.7       15      1      
TestLatLonMultiPolygonShapeQueries.testRandomBig
     0    100.0      127    127      TestLucene50CompoundFormat.classMethod
     0     22.6      562    127      TestNRTCachingDirectory.testDetectClose
     0    100.0      127    127      TestNumericDocValuesUpdates.classMethod
     0    100.0      162    162      TestOpenNLPTokenizerFactory.classMethod
     0      0.3      397      1      TestPointFields.testFloatPointStats
     0      0.3      398      1      TestRandomRequestDistribution.test
     0      0.3      396      1      TestRebalanceLeaders.testRebalanceLeaders
     0      0.3      397      1      TestRecovery.testExistOldBufferLog
     0      0.3      396      1      
TestReplicationHandler.doTestStressReplication
     0      0.5      197      1      TestSimScenario.testSuggestions
     0    100.0      127    127      TestSimpleTextCompoundFormat.classMethod
     0      0.2      568      1      TestSizeLimitedDistributedMap.testCleanup
     0      0.2      562      1      
TestStressLockFactories.testNativeFSLockFactory
     0    100.0        1      1      TestStressUserVersions.classMethod
     0    100.0      162    162      TestTaxonomyFacetAssociations.classMethod
     0    100.0      162    162      TestTaxonomyFacetCounts2.classMethod
     0      0.3      397      1      TestTlogReplica.testRemoveLeader
     0      0.2      559      1      
TestTrackingShardHandlerFactory.testRequestTracking
     0      8.9      559     50      
TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown
     0      0.5      200      1      TriggerCooldownIntegrationTest.testCooldown
     0    100.0        1      1      XmlUpdateRequestHandlerTest.classMethod
     0    100.0        8      8      ZkCollectionPropsCachingTest.classMethod
      123   1.7     1532     35      ClusterStateUpdateTest.testCoreRegistration
      123 100.0      114    114      
CollectionsAPIAsyncDistributedZkTest.classMethod
      123   1.7     1535     35      
CollectionsAPIAsyncDistributedZkTest.testAsyncIdRaceCondition
      123   1.7     1535     35      
CollectionsAPIAsyncDistributedZkTest.testSolrJAPICalls
      123   1.7     1517     35      
CollectionsAPIDistributedZkTest.testDeleteNonExistentCollection
      123   1.7     1517     35      
CollectionsAPIDistributedZkTest.testNoConfigSetExist
      123 100.0       59     59      CustomHighlightComponentTest.classMethod
      123   0.2     1494      3      CustomHighlightComponentTest.test
      123 100.0      100    100      
JsonRequestApiHeatmapFacetingTest.classMethod
      123 100.0      100    100      JsonRequestApiTest.classMethod
      123   1.7     1528     37      MoveReplicaTest.test
      123   0.4      719      3      OverseerTest.testShardLeaderChange
      123   1.6     1544     36      ShardSplitTest.testSplitShardWithRule
      123   1.7     1520     26      SplitShardTest.testSplitFuzz
      123  16.1     1404    276      
TestPullReplicaErrorHandling.testCantConnectToPullReplica
      123   0.5     1381      6      
TestPullReplicaErrorHandling.testCloseHooksDeletedOnReconnect
      123   0.3     1072      4      TestReplicaProperties.test
      123   2.1     1518     47      TestSchemalessBufferedUpdates.test
      123 100.0      100    100      UsingSolrJRefGuideExamplesTest.classMethod
      123 100.0       75     75      ZkConfigFilesTest.classMethod
      12    0.9      746      4      AssignBackwardCompatibilityTest.test
      12  100.0       50     50      AtomicUpdateRemovalJavabinTest.classMethod
      12    1.7     1061     25      BasicAuthOnSingleNodeTest.basicTest
      12  100.0       25     25      
CloudHttp2SolrClientBadInputTest.classMethod
      12    1.6     1075     25      
CloudHttp2SolrClientTest.testInitializationWithSolrUrls
      12    1.6     1075     25      
CloudHttp2SolrClientTest.testNonRetryableRequests
      12    1.6     1075     25      
CloudHttp2SolrClientTest.testParallelUpdateQTime
      12    1.6     1075     25      
CloudHttp2SolrClientTest.testVersionsAreReturned
      12  100.0       25     25      CloudSolrClientBadInputTest.classMethod
      12    2.5      702     25      CollectionStateZnodeTest.testZkNodeLocation
      12    5.5      326     25      
CollectionsAPIDistClusterPerZkTest.addReplicaTest
      12    5.5      326     25      
CollectionsAPIDistClusterPerZkTest.testCollectionReload
      12    5.5      326     25      
CollectionsAPIDistClusterPerZkTest.testCreateNodeSet
      12    5.5      326     25      
CollectionsAPIDistClusterPerZkTest.testSpecificConfigsets
      12    1.7     1068     25      
CollectionsAPISolrJTest.testAddAndDeleteReplica
      12    1.7     1068     25      
CollectionsAPISolrJTest.testCloudInfoInCoreStatus
      12    1.9     1068     26      CollectionsAPISolrJTest.testCollectionProp
      12    1.7     1068     25      
CollectionsAPISolrJTest.testCreateAndDeleteCollection
      12    1.7     1068     25      
CollectionsAPISolrJTest.testCreateWithDefaultConfigSet
      12    1.7     1071     25      
ConcurrentUpdateSolrClientMultiCollectionTest.testEnsureDocumentsSentToCorrectCollection
      12    5.5      326     25      
ConfigSetsAPITest.testConfigSetDeleteWhenInUse
      12    2.1     1050     29      
DeleteInactiveReplicaTest.deleteInactiveReplicaTest
      12    1.7     1063     25      DeleteLastCustomShardedReplicaTest.test
      12    1.9     1058     26      DeleteReplicaTest.deleteLiveReplicaTest
      12    1.7     1058     25      DeleteReplicaTest.deleteReplicaByCount
      12    1.7     1058     25      DeleteReplicaTest.deleteReplicaOnIndexing
      12    1.7     1052     25      DeleteStatusTest.testAsyncIdsMayBeDeleted
      12    1.7     1052     25      DeleteStatusTest.testDeleteStatusFlush
      12    1.7     1052     25      
DeleteStatusTest.testProcessAndWaitDeletesAsyncIds
      12  100.0       50     50      
DirectJsonQueryRequestFacetingIntegrationTest.classMethod
      12  100.0       25     25      DirectSolrConnectionTest.classMethod
      12  100.0       24     24      DirectUpdateHandlerTest.classMethod
      12  100.0       75     75      DirectoryFactoryTest.classMethod
      12    1.7     1061     25      
DirectoryFactoryTest.testGetDataHomeByteBuffersDirectory
      12    1.7     1061     25      
DirectoryFactoryTest.testGetDataHomeRAMDirectory
      12  100.0       25     25      DistributedSuggestComponentTest.classMethod
      12    1.7     1063     25      FuzzySearchTest.testTooComplex
      12  100.0       52     52      HelloWorldSolrCloudTestCase.classMethod
      12  100.0       50     50      JDBCStreamTest.classMethod
      12  100.0       50     50      
JsonQueryRequestFacetingIntegrationTest.classMethod
      12  100.0       50     50      
JsonQueryRequestHeatmapFacetingTest.classMethod
      12  100.0       50     50      JsonQueryRequestIntegrationTest.classMethod
      12  100.0       25     25      LargeFieldTest.classMethod
      12  100.0       25     25      MergeIndexesEmbeddedTest.classMethod
      12  100.0       36     36      NestedShardedAtomicUpdateTest.classMethod
      12    2.3     1062     39      NestedShardedAtomicUpdateTest.test
      12    1.7     1060     25      OverseerModifyCollectionTest.testModifyColl
      12  100.0       25     25      
PeerSyncWithIndexFingerprintCachingTest.classMethod
      12  100.0       25     25      
PeerSyncWithLeaderAndIndexFingerprintCachingTest.classMethod
      12  100.0       25     25      
PhrasesIdentificationComponentTest.classMethod
      12  100.0       18     18      RecoveryZkTest.classMethod
      12  100.0       25     25      SampleTest.classMethod
      12    1.7     1056     25      
SearchHandlerTest.testRequireZkConnectedDistrib
      12  100.0       50     50      SelectWithEvaluatorsTest.classMethod
      12    1.7     1058     25      ShardRoutingCustomTest.test
      12    6.2      325     29      ShardRoutingTest.doAtomicUpdate
      12    6.2      325     27      ShardRoutingTest.doHashingTest
      12  100.0       14     14      SolrSchemalessExampleTest.classMethod
      12  100.0       25     25      SuggesterFSTTest.classMethod
      12  100.0       25     25      SuggesterTest.classMethod
      12  100.0       50     50      TestCloudDeleteByQuery.classMethod
      12  100.0       50     50      TestCloudJSONFacetJoinDomain.classMethod
      12  100.0       49     49      TestCloudJSONFacetSKG.classMethod
      12    1.7     1059     25      TestCloudPivotFacet.test
      12  100.0       25     25      TestClusterProperties.classMethod
      12    1.7     1049     25      
TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateWithoutCoresThenDelete
      12    5.6      314     25      
TestCollectionsAPIViaSolrCloudCluster.testDeleteUnknownCollection
      12  100.0       75     75      TestConfigSetsAPI.classMethod
      12    1.7     1063     25      TestConfigSetsAPI.testCreateErrors
      12    1.7     1063     25      TestConfigSetsAPI.testUpload
      12  100.0       24     24      TestDistribPackageStore.classMethod
      12    1.7     1059     25      
TestDownShardTolerantSearch.searchingShouldFailWithoutTolerantSearchSetToTrue
      12    1.7     1061     25      TestDynamicFieldNamesIndexCorrectly.test
      12  100.0        8      8      
TestExclusionRuleCollectionAccess.classMethod
      12  100.0       25     25      
TestHighFrequencyDictionaryFactory.classMethod
      12  100.0       75     75      TestLBHttpSolrClient.classMethod
      12    1.7     1071     25      TestLBHttpSolrClient.testReliability
      12    1.7     1071     25      TestLBHttpSolrClient.testSimple
      12    2.5      701     26      TestLocalStatsCacheCloud.testBasicStats
      12    1.7     1056     25      TestManagedSchemaAPI.test
      12  100.0       25     25      TestManagedStopFilterFactory.classMethod
      12  100.0       25     25      TestReplicationHandlerBackup.classMethod
      12    1.7     1059     25      
TestRequestForwarding.testMultiCollectionQuery
      12  100.0       25     25      TestSchemalessBufferedUpdates.classMethod
      12  100.0        6      6      TestShortCircuitedRequests.classMethod
      12    1.9     1061     27      TestShortCircuitedRequests.test
      12    1.7     1051     25      TestSolrConfigHandlerConcurrent.test
      12    1.7     1059     25      TestSystemCollAutoCreate.testAutoCreate
      12  100.0       55     55      
TestTolerantUpdateProcessorRandomCloud.classMethod
      12  100.0       25     25      TestUseDocValuesAsStored.classMethod
      12  100.0       25     25      TestUseDocValuesAsStored2.classMethod
      12  100.0       25     25      TestZkConfigManager.classMethod
      12    2.1     1062     27      
ZkShardTermsTest.testParticipationOfReplicas
      1 3   0.2      930      2      
DistributedDebugComponentTest.testTolerantSearch
      1 3   0.6      674      5      DistributedTermsComponentTest.test
      1 3   0.2      934      3      
StatsReloadRaceTest.testParallelReloadAndStats
      1 3   0.3      668      2      TestPointFields.testDoublePointStats
      1     0.6      163      1      AutoScalingHandlerTest.testReadApi
      1     0.6      163      1      
AutoScalingHandlerTest.testSuggestionsWithPayload
      1    53.8       13      7      
CdcrReplicationHandlerTest.testReplicationWithBufferedUpdates
      1   100.0        4      4      CloudHttp2SolrClientTest.classMethod
      1     0.3      341      1      
CloudHttp2SolrClientTest.testRetryUpdatesWhenClusterStateIsStale
      1   100.0        4      4      
CollectionsAPIDistClusterPerZkTest.classMethod
      1     0.3      335      1      
CollectionsAPISolrJTest.testCreateCollWithDefaultClusterPropertiesOldFormat
      1     0.2      471      1      
DocValuesNotIndexedTest.testGroupingDVOnlySortLast
      1     0.2      471      1      
DocValuesNotIndexedTest.testGroupingDocAbsent
      1     0.9      117      1      
MiniSolrCloudClusterTest.testSolrHomeAndResourceLoaders
      1     0.3      343      1      ShardSplitTest.testSplitShardWithRuleLink
      1     0.3      339      1      SystemCollectionCompatTest.testBackCompat
      1     0.3      333      1      TestDistribIDF.testMultiCollectionQuery
      1     0.2      501      1      TestLatLonPointQueries.testLowCardinality
      1   100.0        3      3      TestPackages.classMethod
      1     0.6      164      1      
TestSimLargeCluster.testCreateLargeSimCollections
      1   100.0        1      1      TestStressLockFactories.classMethod
      1     0.2      501      1      
TestStressLockFactories.testSimpleFSLockFactory
      1     1.1      179      2      
TestVectorValues.testIndexMultipleVectorFields
      1   100.0        2      2      ZkFailoverTest.classMethod
      1     0.3      334      1      ZkFailoverTest.testRestartZkWhenClusterDown
       23   0.2      737      2      
TestCloudSearcherWarming.testPeersyncFailureReplicationSuccess
       23   0.2      776     44      TestRandomFaceting.testRandomFaceting
       23 100.0        9      9      TestSolrConfigHandlerConcurrent.classMethod
       2  100.0        1      1      AliasIntegrationTest.classMethod
       2    0.2      407      1      BasicDistributedZk2Test.test
       2    0.2      413      1      
CloudSolrClientTest.testRetryUpdatesWhenClusterStateIsStale
       2    0.2      406      1      
CollectionsAPISolrJTest.testCreateCollWithDefaultClusterPropertiesNewFormat
       2    0.5      206      1      ComputePlanActionTest.testNodeAdded
       2  100.0        1      1      ExtractingRequestHandlerTest.classMethod
       2    0.2      588      1      ExtractingRequestHandlerTest.testArabicPDF
       2    7.1       14      1      HdfsBasicDistributedZk2Test.test
       2    0.2      408      1      
HealthCheckHandlerTest.testHealthCheckHandler
       2    0.5      402      2      HttpPartitionTest.test
       2    0.2      402      1      
LeaderElectionIntegrationTest.testSimpleSliceLeaderElection
       2    0.5      408      2      MathExpressionTest.testZipFDistribution
       2    0.2      411      1      MoveReplicaTest.testFailedMove
       2    0.2      402      1      ReplicationFactorTest.test
       2    0.5      206      1      SearchRateTriggerTest.testWaitForElapsed
       2  100.0       12     12      ShardRoutingTest.classMethod
       2    0.3      370      1      
SoftAutoCommitTest.testHardCommitWithinAndSoftCommitMaxTimeMixedAdds
       2    0.2      407      1      SpatialHeatmapFacetsTest.testClassicFacets
       2    6.7       15      1      
TestBestCompressionLucene80DocValuesFormat.testTermsEnumFixedWidth
       2    6.7       15      1      
TestBestCompressionLucene80DocValuesFormat.testTermsEnumLongSharedPrefixes
       2    6.7       15      1      
TestBestCompressionLucene80DocValuesFormat.testTermsEnumRandomMany
       2    6.7       15      1      
TestBestCompressionLucene80DocValuesFormat.testTermsEnumVariableWidth
       2    6.7       15      1      
TestBestSpeedLucene80DocValuesFormat.testTermsEnumFixedWidth
       2    6.7       15      1      
TestBestSpeedLucene80DocValuesFormat.testTermsEnumLongSharedPrefixes
       2    6.7       15      1      
TestBestSpeedLucene80DocValuesFormat.testTermsEnumRandomMany
       2    6.7       15      1      
TestBestSpeedLucene80DocValuesFormat.testTermsEnumVariableWidth
       2    0.2      565      1      
TestCloudDeleteByQuery.testMalformedDBQViaCloudClient
       2    0.2      402      1      TestExactStatsCache.testShardsTolerant
       2  100.0        1      1      TestHdfsCloudBackupRestore.classMethod
       2    1.0      594      6      TestLatLonPointQueries.testAllLatEqual
       2  100.0        3      3      TestOnReconnectListenerSupport.classMethod
       2    0.2      592      1      
TestRandomChains.testRandomChainsWithLargeStrings
       2    0.2      402      1      
TestRandomCollapseQParserPlugin.testRandomCollpaseWithSort
       2  100.0        1      1      TestRandomFaceting.classMethod
       2  100.0        4      4      TestRandomFlRTGCloud.classMethod
       2    1.5      407      6      TestReRankQParserPlugin.testMinExactCount
       2    0.2      403      1      TestRecovery.stressLogReplay
       2    0.5      201      1      
TestRequestRateLimiter.testConcurrentQueries
       2    0.5      204      1      
TestSolrCLIRunExample.testInteractiveSolrCloudExampleWithAutoScalingPolicy
       2    0.2      402      1      
TestSolrCloudWithDelegationTokens.testDelegationTokenRenew
       2    0.2      565      1      
TestTolerantUpdateProcessorRandomCloud.testRandomUpdates
       2    0.4      228      1      TestWithCollection.testAddReplicaWithPolicy
       2    0.2      556      1      
V2ApiIntegrationTest.testSetPropertyValidationOfCluster
        3 100.0       50     50      AddReplicaTest.classMethod
        3   0.2      459      1      CleanupOldIndexTest.test
        3 100.0       30     30      ClusterStateUpdateTest.classMethod
        3 100.0       30     30      CollectionsAPIDistributedZkTest.classMethod
        3   2.1      468     10      
CollectionsAPIDistributedZkTest.testBadActionNames
        3   2.1      468     10      
CollectionsAPIDistributedZkTest.testMissingNumShards
        3   2.1      468     10      
CollectionsAPIDistributedZkTest.testMissingRequiredParameters
        3   2.1      468     10      
CollectionsAPIDistributedZkTest.testZeroNumShards
        3 100.0       50     50      
ConcurrentUpdateSolrClientMultiCollectionTest.classMethod
        3   0.2      458      1      DeleteNodeTest.test
        3 100.0        9      9      DeleteStatusTest.classMethod
        3   0.2      461      1      
DocValuesNotIndexedTest.testGroupingDVOnlySortFirst
        3   0.2      461      1      DocValuesNotIndexedTest.testGroupingSorting
        3   5.3       19      1      
HdfsTlogReplayBufferedWhileIndexingTest.test
        3   0.3      293      1      
LBSolrClientTest.testServerIteratorTimeAllowed
        3 100.0        1      1      
MetricsHistoryWithAuthIntegrationTest.classMethod
        3   7.5      133     10      SimpleCollectionCreateDeleteTest.test
        3   1.3      477      6      
TestAssertingDocValuesFormat.testSortedSetFixedLengthSingleValuedVsStoredFields
        3 100.0        4      4      TestAuthenticationFramework.classMethod
        3   0.4      460      2      TestAuthenticationFramework.testBasics
        3   0.3      340      1      TestBulkSchemaConcurrent.test
        3   0.2      472      1      TestCachePurging.testBackgroundPurges
        3   0.4      460      2      TestChildDocTransformer.testAllParams
        3   0.4      460      2      TestChildDocTransformer.testParentFilter
        3   3.3      183      6      
TestDirectDocValuesFormat.testSortedFixedLengthVsStoredFields
        3   0.3      340      1      TestDistributedMissingSort.test
        3 100.0        1      1      TestHighlightDedupGrouping.classMethod
        3   0.3      340      1      TestLBHttp2SolrClient.testSimple
        3   0.2      487      1      TestLatLonDocValuesQueries.testAllLonEqual
        3   2.3      487     11      TestLatLonDocValuesQueries.testRandomMedium
        3   2.3      485     11      TestLatLonPointQueries.testRandomMedium
        3   0.2      458      1      TestLockTree.testLocks
        3   3.3      183      6      
TestLucene70DocValuesFormat.testSortedSetVariableLengthSingleValuedVsStoredFields
        3   0.2      472      1      
TestLucene80DocValuesFormat.testSortedSetVariableLengthSingleValuedVsStoredFields
        3   1.9      314      6      TestOrdinalMap.testOneSegmentWithAllValues
        3   0.2      472      1      
TestPerFieldDocValuesFormat.testSortedSetFixedLengthSingleValuedVsStoredFields
        3   0.2      472      1      
TestPerFieldDocValuesFormat.testSortedSetVariableLengthSingleValuedVsStoredFields
        3 100.0        1      1      TestPrepRecovery.classMethod
        3   0.4      473      2      TestRandomChains.testRandomChains
        3  67.7     1059    717      TestRandomDVFaceting.testRandomFaceting
        3 100.0        1      1      TestReplicaProperties.classMethod
        3 100.0        1      1      TestReplicationHandler.classMethod
        3  13.1      472     62      
TestSTUniformSplitPostingFormat.testCheckIntegrityReadsAllBytes
        3   0.6      179      1      
TestSimTriggerIntegration.testTriggerThrottling
        3   2.3      485     11      
TestSimpleTextDocValuesFormat.testSortedSetFixedLengthSingleValuedVsStoredFields
        3   0.6      333      2      
TestSkipOverseerOperations.testSkipDownOperations
        3  28.7      471    135      TestSynonymFilterFactory.testFormat
        3  28.7      471    135      TestSynonymFilterFactory.testSynonyms
        3  28.6      472    135      TestSysoutsLimits.OverHardLimit
        3  28.6      472    135      TestSysoutsLimits.testOverSoftLimit
        3  13.1      472     62      
TestUniformSplitPostingFormat.testCheckIntegrityReadsAllBytes
        3   0.2      457      1      
TestUseDocValuesAsStored.testRandomSingleAndMultiValued
        3   0.2      464      1      
UninvertDocValuesMergePolicyTest.testIndexAndAddDocValues



***********************Annotations report

*****************AwaitsFix Annotations:


************Lucene AwaitsFix
TestAllFilesDetectBitFlips.TestAllFilesDetectBitFlips suite
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-9356";)

TestAllFilesDetectTruncation.TestAllFilesDetectTruncation suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-9409";)

TestControlledRealTimeReopenThread.testCRTReopen
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5737";)

TestICUNormalizer2CharFilter.testRandomStrings
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5595";)

TestICUTokenizerCJK.TestICUTokenizerCJK suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8222";)

TestMatchRegionRetriever.testDegenerateIntervalsWithOffsets
   @AwaitsFix(

TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-7161";)


    ************Solr AwaitsFix
CollectionsAPISolrJTest.testCreateAndDeleteShard
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13021";)

ConcurrentCreateRoutedAliasTest.ConcurrentCreateRoutedAliasTest suite
   @LuceneTestCase.AwaitsFix(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-12386";) // "Can't find resource"

MoveReplicaHDFSTest.MoveReplicaHDFSTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13924";)

MoveReplicaHDFSTest.testFailedMove
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12080";) // 
added 03-Oct-2018

RoutedAliasUpdateProcessorTest.alias,
   
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13696";)

SSLMigrationTest.SSLMigrationTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
17-Mar-2018

SaslZkACLProviderTest.testSaslZkACLProvider
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13075";)

SecurityHeadersTest.SecurityHeadersTest suite
   
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-14903";)

SolrExporterIntegrationTest.SolrExporterIntegrationTest suite
   
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13786";)

Tagger2Test.testStopWords
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-8344";)

TestImpersonationWithHadoopAuth.testForwarding
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/HADOOP-9893";)

TestJsonFacetRefinement.testIndexAscRefineConsistency
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-14595";)

TestJsonFacetRefinement.testProcessEmptyRefinement
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556";)

TestJsonFacetRefinement.testSortedSubFacetRefinementWhenParentOnlyReturnedByOneShardProcessEmpty
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556";)

TestLTRReRankingPipeline.testDifferentTopN
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-11134";)

TestMinMaxOnMultiValuedField.testDoubleFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestMinMaxOnMultiValuedField.testFloatFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestMinMaxOnMultiValuedField.testIntFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestMinMaxOnMultiValuedField.testLongFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestPullReplica.TestPullReplica suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

TestStressRecovery.TestStressRecovery suite
   
@LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 6-Sep-2018

TestTlogReplayVsRecovery.TestTlogReplayVsRecovery suite
   
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13486;https://issues.apache.org/jira/browse/SOLR-14183";)

TimeRoutedAliasUpdateProcessorTest.testDateMathInStart
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13943";)

TriLevelCompositeIdRoutingTest.test
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13369";)



*****************BadApple Annotations:

************Lucene BadApple

************Solr BadApple
MoveReplicaHDFSTest.testNormalFailedMove
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
14-Oct-2018

SharedFSAutoReplicaFailoverTest.SharedFSAutoReplicaFailoverTest suite
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // added 20-Jul-2018

TimeRoutedAliasUpdateProcessorTest.TimeRoutedAliasUpdateProcessorTest suite
   @LuceneTestCase.BadApple(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-13059";)


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to