Holding fairly steady, but IDK whether Hoss’ scraping is getting data from 
Uwe’s machines, thought I saw an e-mail go by about that.

this is the first report where the suppresswarnings stats mean anything.

Full report attached:

DO NOT ENABLE LIST:
    MoveReplicaHDFSTest.testFailedMove
    MoveReplicaHDFSTest.testNormalFailedMove
    TestControlledRealTimeReopenThread.testCRTReopen
    TestICUNormalizer2CharFilter.testRandomStrings
    TestICUTokenizerCJK
    TestImpersonationWithHadoopAuth.testForwarding
    TestLTRReRankingPipeline.testDifferentTopN
    TestRandomChains


DO NOT ANNOTATE LIST
    CdcrBidirectionalTest.testBiDir
    IndexSizeTriggerTest.testMergeIntegration
    IndexSizeTriggerTest.testMixedBounds
    IndexSizeTriggerTest.testSplitIntegration
    IndexSizeTriggerTest.testTrigger
    InfixSuggestersTest.testShutdownDuringBuild
    ShardSplitTest.test
    ShardSplitTest.testSplitMixedReplicaTypes
    ShardSplitTest.testSplitWithChaosMonkey
    Test2BPostings.test
    TestLatLonShapeQueries.testRandomBig
    TestPackedInts.testPackedLongValues
    TestRandomChains.testRandomChainsWithLargeStrings
    TestTriggerIntegration.testSearchRate

SuppressWarnings count: last week: 5,373, this week: 5,372, delta -1


*************** Files with increased @SuppressWarnings annotations:

Suppress count increase in: 
solr/core/src/java/org/apache/solr/api/AnnotatedApi.java. Was: 4, now: 5
Suppress count increase in: 
solr/core/src/java/org/apache/solr/packagemanager/PackageManager.java. Was: 4, 
now: 6
Suppress count increase in: 
solr/solrj/src/java/org/apache/solr/common/util/Utils.java. Was: 28, now: 30

*************** Files with decreased @SuppressWarnings annotations:

Suppress count decrease in: 
solr/core/src/java/org/apache/solr/handler/export/ExportWriter.java. Was: 1, 
now: 0
Suppress count decrease in: 
solr/core/src/test/org/apache/solr/handler/export/TestExportWriter.java. Was: 
6, now: 2

Processing file (History bit 3): HOSS-2020-07-06.csv
Processing file (History bit 2): HOSS-2020-06-29.csv
Processing file (History bit 1): HOSS-2020-06-22.csv
Processing file (History bit 0): HOSS-2020-06-15.csv


Number of AwaitsFix: 45 Number of BadApples: 4


**Annotated tests that didn't fail in the last 4 weeks.

  **Tests removed from the next two lists because they were specified in 
'doNotEnable' in the properties file
     MoveReplicaHDFSTest.testNormalFailedMove

  **Annotations can be removed from the following tests because they haven't 
failed in the last 4 rollups.

  **Methods: 0


Raw fail count by week totals, most recent week first (corresponds to bits):
Week: 0  had  24 failures
Week: 1  had  26 failures
Week: 2  had  26 failures
Week: 3  had  34 failures


********Failures in Hoss' reports for the last 4 rollups.

There were 84 unannotated tests that failed in Hoss' rollups. Ordered by the 
date I downloaded the rollup file, newest->oldest. See above for the dates the 
files were collected 
These tests were NOT BadApple'd or AwaitsFix'd

Failures in the last 4 reports..
   Report   Pct     runs    fails           test
     012    0.9      340      4      TestInPlaceUpdatesDistrib.test
     012   15.8      305     32      TestReRankQParserPlugin.testMinExactCount
     01 3   0.8      345      3      
DocValuesNotIndexedTest.testGroupingDVOnlySortFirst
     01 3 100.0       16     14      SharedFSAutoReplicaFailoverTest.test
     01     7.6      420    194      DebugComponentTest.testBasicInterface
     01     7.6      420    194      DebugComponentTest.testPerItemInterface
     01    10.3       55      5      ShardSplitTest.testSplitWithChaosMonkey
     01     5.8      186      9      TestContainerPlugin.testApiFromPackage
     0 2    0.8      230      2      
TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast
     0  3   0.8      230      2      TestSimScenario.testSuggestions
     0      1.6      122      2      PeerSyncWithLeaderTest.test
     0      0.8      131      1      ShardSplitTest.testSplitShardWithRule
     0      0.8      126      1      
TestBlockJoin.testMultiChildQueriesOfDiffParentLevels
     0      1.6      127      2      TestDemoParallelLeafReader.testBasic
     0      1.6      127      2      
TestDemoParallelLeafReader.testBasicMultipleSchemaGens
     0      1.6      127      2      TestDemoParallelLeafReader.testRandom
     0      1.6      127      2      
TestDemoParallelLeafReader.testRandomMultipleSchemaGens
     0      0.8      126      1      
TestDemoParallelLeafReader.testRandomMultipleSchemaGensSameField
     0     52.6       38     20      TestStressThreadBackup.testCoreAdminHandler
     0     52.6       38     20      
TestStressThreadBackup.testReplicationHandler
     0      0.9      117      1      TestTlogReplica.testRemoveLeader
      123  17.2       81     15      HdfsSyncSliceTest.test
      123   4.7      355     11      RollingRestartTest.test
      12    0.9      221      2      AutoScalingHandlerTest.testReadApi
      12   17.1      301     68      
CurrencyRangeFacetCloudTest.testJsonRangeFacetWithSubFacet
      12    0.9      224      2      TestSimDistributedQueue.testPeekElements
      1 3   1.7      233      3      
TestSearcherManager.testConcurrentIndexCloseSearchAndRefresh
      1     0.9      113      1      
AutoScalingHandlerTest.testSuggestionsWithPayload
      1    30.6       36     11      
TestBinaryDocValuesUpdates.testTonsOfUpdates
      1     3.1      131      4      
TestBinaryDocValuesUpdates.testUpdateSegmentWithPostingButNoDocValues
      1    12.5        8      1      TestCircuitBreaker.testResponseWithCBTiming
      1     1.6      125      2      
TestIndexWriterDelete.testDeleteAllNoDeadLock
      1     0.8      125      1      
TestIndexWriterDelete.testErrorInDocsWriterAdd
      1     0.8      125      1      TestIndexWriterDelete.testSimpleCase
      1     8.7      126     11      TestMultiWordSynonyms.testPf
      1     5.5      127      7      
TestRandomChains.testRandomChainsWithLargeStrings
      1     8.4      131     11      
TestXYMultiPointShapeQueries.testLowCardinalityShapeManyTimes
       23   1.8      224      3      SystemCollectionCompatTest.testBackCompat
       23   9.2      233     12      TestIndexWriterOnVMError.testOOM
       2    0.9      108      1      AutoscalingHistoryHandlerTest.testHistory
       2    4.0       25      1      ForceLeaderTest.testReplicasInLowerTerms
       2    0.9      111      1      HttpPartitionWithTlogReplicasTest.test
       2    1.4       74      1      
LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud
       2   15.2      112     17      TestAllFilesDetectTruncation.test
       2   12.1       91     11      TestCloudJSONFacetSKGEquiv.testRandom
       2    0.9      110      1      TestNRTReaderWithThreads.testIndexing
       2    1.8      111      2      TestOfflineSorter.testThreadSafety
       2    0.9      108      1      
TestPullReplicaErrorHandling.testCantConnectToLeader
       2    0.9      111      1      TestStressNRT.test
       2    4.5       22      1      
TestXYMultiPolygonShapeQueries.testRandomBig
        3   3.4       88      3      
BasicAuthOnSingleNodeTest.testDeleteSecurityJsonZnode
        3   8.9      123     11      BasicDistributedZkTest.test
        3   4.3       23      1      
CdcrReplicationHandlerTest.testReplicationWithBufferedUpdates
        3  11.6      112     13      
CloudHttp2SolrClientTest.testWrongZkChrootTest
        3  11.6      112     13      CloudSolrClientTest.testWrongZkChrootTest
        3   0.9      113      1      CollectionPropsTest.testWatcher
        3   7.6      118      9      DistribCursorPagingTest.test
        3   3.7       27      1      
ForceLeaderWithTlogReplicasTest.testReplicasInLowerTerms
        3   3.7       27      1      HdfsBasicDistributedZk2Test.test
        3   7.4       27      2      HdfsWriteToMultipleCollectionsTest.test
        3   0.9      113      1      OverseerTest.testShardLeaderChange
        3   7.6      118      9      SyncSliceTest.test
        3   7.7       13      1      TestAllFilesDetectBitFlips.test
        3  15.4       13      2      TestAllFilesDetectBitFlips.testCFS
        3  11.6      112     13      
TestCloudSolrClientConnections.testCloudClientCanConnectAfterClusterComesUp
        3  11.6      112     13      
TestCloudSolrClientConnections.testCloudClientUploads
        3   0.9      110      1      
TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete
        3   4.3       23      1      TestIndexWriterDelete.testDeletesOnDiskFull
        3   2.3       43      1      TestLRUStatsCacheCloud.testBasicStats
        3   0.9      110      1      
TestRequestForwarding.testMultiCollectionQuery
        3   8.3       84      7      
TestZKPropertiesWriter.testZKPropertiesWriter



***********************Annotations report

*****************AwaitsFix Annotations:


************Lucene AwaitsFix
TestAllFilesDetectBitFlips.TestAllFilesDetectBitFlips suite
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-9356";)

TestAllFilesDetectTruncation.TestAllFilesDetectTruncation suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-9409";)

TestControlledRealTimeReopenThread.testCRTReopen
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5737";)

TestICUNormalizer2CharFilter.testRandomStrings
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5595";)

TestICUTokenizerCJK.TestICUTokenizerCJK suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8222";)

TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-7161";)


    ************Solr AwaitsFix
AutoAddReplicasIntegrationTest.testRapidStopStartStopWithPropChange
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13811";)

CdcrBidirectionalTest.testBiDir
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12524";)

CdcrBootstrapTest.testBootstrapWithContinousIndexingOnSourceCluster
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12028";)

CollectionsAPISolrJTest.testCreateAndDeleteShard
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13021";)

ComputePlanActionTest.testNodeLost
   
@LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

ConcurrentCreateRoutedAliasTest.ConcurrentCreateRoutedAliasTest suite
   @LuceneTestCase.AwaitsFix(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-12386";) // "Can't find resource"

LeaderTragicEventTest.LeaderTragicEventTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13237";)

MoveReplicaHDFSTest.MoveReplicaHDFSTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13924";)

MoveReplicaHDFSTest.testFailedMove
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12080";) // 
added 03-Oct-2018

ReplaceNodeNoTargetTest.ReplaceNodeNoTargetTest suite
   @LuceneTestCase.AwaitsFix(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-11067";)

ReplaceNodeNoTargetTest.test
   @LuceneTestCase.AwaitsFix(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-11067";)

RoutedAliasUpdateProcessorTest.alias,
   
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13696";)

SSLMigrationTest.SSLMigrationTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
17-Mar-2018

SaslZkACLProviderTest.testSaslZkACLProvider
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13075";)

ScheduledMaintenanceTriggerTest.testInactiveShardCleanup
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
17-Mar-2018

ScheduledTriggerTest.testTrigger
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
added 20-Sep-2018

SearchRateTriggerIntegrationTest.testDeleteNode
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13163";)

SearchRateTriggerTest.testTrigger
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

SolrExporterIntegrationTest.SolrExporterIntegrationTest suite
   
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13786";)

Tagger2Test.testStopWords
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-8344";)

TestHierarchicalDocBuilder.testThreeLevelHierarchy
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12801";) // 
this test fails easily under beasting

TestImpersonationWithHadoopAuth.testForwarding
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/HADOOP-9893";)

TestJsonFacetRefinement.testIndexAscRefineConsistency
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-14595";)

TestJsonFacetRefinement.testProcessEmptyRefinement
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556";)

TestJsonFacetRefinement.testSortedSubFacetRefinementWhenParentOnlyReturnedByOneShardProcessEmpty
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556";)

TestLTRReRankingPipeline.testDifferentTopN
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-11134";)

TestMinMaxOnMultiValuedField.testDoubleFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestMinMaxOnMultiValuedField.testFloatFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestMinMaxOnMultiValuedField.testIntFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestMinMaxOnMultiValuedField.testLongFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestPullReplica.TestPullReplica suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

TestSimComputePlanAction.testNodeLost
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12028";) // 
if you beast this, eventually you will see

TestSimExtremeIndexing.TestSimExtremeIndexing suite
   
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12923";)

TestSimLargeCluster.testAddNode
   @AwaitsFix( bugUrl = "https://issues.apache.org/jira/browse/SOLR-14275";)

TestSimLargeCluster.testBasic
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
this test hits a timeout easily

TestStressRecovery.TestStressRecovery suite
   
@LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 6-Sep-2018

TestTlogReplayVsRecovery.TestTlogReplayVsRecovery suite
   
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13486;https://issues.apache.org/jira/browse/SOLR-14183";)

TimeRoutedAliasUpdateProcessorTest.testDateMathInStart
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13943";)

TriLevelCompositeIdRoutingTest.test
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13369";)



*****************BadApple Annotations:

************Lucene BadApple

************Solr BadApple
MoveReplicaHDFSTest.testNormalFailedMove
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
14-Oct-2018

SharedFSAutoReplicaFailoverTest.SharedFSAutoReplicaFailoverTest suite
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // added 20-Jul-2018

TimeRoutedAliasUpdateProcessorTest.TimeRoutedAliasUpdateProcessorTest suite
   @LuceneTestCase.BadApple(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-13059";)


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to