No annotation changes will happen this week.
Summary:
Processing file (History bit 3): HOSS-2019-088-05.csv
Processing file (History bit 2): HOSS-2019-08-19.csv
Processing file (History bit 1): HOSS-2019-08-12.csv
Processing file (History bit 0): HOSS-2019-07-29.csv
Number of AwaitsFix: 38 Number of BadApples: 11
Raw fail count by week totals, most recent week first (corresponds to bits):
Week: 0 had 28 failures
Week: 1 had 18 failures
Week: 2 had 21 failures
Week: 3 had 47 failures
**Annotated tests that didn't fail in the last 4 weeks.
**Tests removed from the next two lists because they were specified in
'doNotEnable' in the properties file
MoveReplicaHDFSTest.testNormalFailedMove
**Annotations will be removed from the following tests because they haven't
failed in the last 4 rollups.
**Methods: 3
FullSolrCloudDistribCmdsTest.test
SolrZkClientTest.testSimpleUpdateACLs
TestDistributedStatsComponentCardinality.test
********Failures in Hoss' reports for the last 4 rollups.
There were 80 unannotated tests that failed in Hoss' rollups. Ordered by the
date I downloaded the rollup file, newest->oldest. See above for the dates the
files were collected
These tests were NOT BadApple'd or AwaitsFix'd
All tests that failed 4 weeks running will be BadApple'd unless there are
objections
Failures in the last 4 reports..
Report Pct runs fails test
0123 1.3 365 8
AliasIntegrationTest.testClusterStateProviderAPI
0123 26.7 44 15
HdfsAutoAddReplicasIntegrationTest.testSimple
************ Will BadApple all tests above this line except ones listed at the
top**************
DO NOT ENABLE LIST:
MoveReplicaHDFSTest.testFailedMove
MoveReplicaHDFSTest.testNormalFailedMove
TestControlledRealTimeReopenThread.testCRTReopen
TestICUNormalizer2CharFilter.testRandomStrings
TestICUTokenizerCJK
TestImpersonationWithHadoopAuth.testForwarding
TestLTRReRankingPipeline.testDifferentTopN
TestRandomChains
DO NOT ANNOTATE LIST
CdcrBidirectionalTest.testBiDir
IndexSizeTriggerTest.testMergeIntegration
IndexSizeTriggerTest.testMixedBounds
IndexSizeTriggerTest.testSplitIntegration
IndexSizeTriggerTest.testTrigger
InfixSuggestersTest.testShutdownDuringBuild
ShardSplitTest.test
ShardSplitTest.testSplitMixedReplicaTypes
ShardSplitTest.testSplitWithChaosMonkey
TestLatLonShapeQueries.testRandomBig
TestRandomChains.testRandomChainsWithLargeStrings
TestTriggerIntegration.testSearchRate
Processing file (History bit 3): HOSS-2019-088-05.csv
Processing file (History bit 2): HOSS-2019-08-19.csv
Processing file (History bit 1): HOSS-2019-08-12.csv
Processing file (History bit 0): HOSS-2019-07-29.csv
Number of AwaitsFix: 38 Number of BadApples: 11
Raw fail count by week totals, most recent week first (corresponds to bits):
Week: 0 had 28 failures
Week: 1 had 18 failures
Week: 2 had 21 failures
Week: 3 had 47 failures
**Annotated tests that didn't fail in the last 4 weeks.
**Tests removed from the next two lists because they were specified in
'doNotEnable' in the properties file
MoveReplicaHDFSTest.testNormalFailedMove
**Annotations will be removed from the following tests because they haven't
failed in the last 4 rollups.
**Methods: 3
FullSolrCloudDistribCmdsTest.test
SolrZkClientTest.testSimpleUpdateACLs
TestDistributedStatsComponentCardinality.test
********Failures in Hoss' reports for the last 4 rollups.
There were 80 unannotated tests that failed in Hoss' rollups. Ordered by the
date I downloaded the rollup file, newest->oldest. See above for the dates the
files were collected
These tests were NOT BadApple'd or AwaitsFix'd
All tests that failed 4 weeks running will be BadApple'd unless there are
objections
Failures in the last 4 reports..
Report Pct runs fails test
0123 1.3 365 8
AliasIntegrationTest.testClusterStateProviderAPI
0123 26.7 44 15
HdfsAutoAddReplicasIntegrationTest.testSimple
************ Will BadApple all tests above this line except ones listed at the
top**************
01 3 6.2 428 150 BasicAuthIntegrationTest.testBasicAuth
01 3 1.4 268 3 RollingRestartTest.test
0 23 1.0 351 6 HttpPartitionWithTlogReplicasTest.test
0 23 1.4 276 3 TestCloudJSONFacetJoinDomain.testRandom
0 3 16.7 19 3
CdcrReplicationHandlerTest.testReplicationWithBufferedUpdates
0 3 4.0 252 7 TestRandomChains.testRandomChains
0 3 3.0 252 7
TestRandomChains.testRandomChainsWithLargeStrings
0 3 1.5 201 3 TestStressLiveNodes.testStress
0 3 1.4 202 2
TestUseDocValuesAsStored.testDuplicateMultiValued
0 8.3 12 1
CdcrReplicationHandlerTest.testPartialReplicationAfterPeerSync
0 2.0 101 2 CollectionPropsTest.testWatcher
0 1.5 67 1
DimensionalRoutedAliasUpdateProcessorTest.testTimeCat
0 12.5 8 1 HdfsWriteToMultipleCollectionsTest.test
0 1.0 97 1 HttpPartitionTest.test
0 1.4 72 1 LeaderVoteWaitTimeoutTest.basicTest
0 1.3 75 1 OverseerTest.testShardLeaderChange
0 2.7 73 2 RulesTest.doIntegrationTest
0 1.3 79 1
StatsReloadRaceTest.testParallelReloadAndStats
0 16.7 6 1 StressHdfsTest.test
0 1.0 98 1
TestLucene80DocValuesFormat.testTermsEnumVariableWidth
0 1.0 96 1
TestRunWithRestrictedPermissions.testCompletelyForbidden1
0 1.0 96 1
TestRunWithRestrictedPermissions.testCompletelyForbidden2
0 1.0 96 1
TestRunWithRestrictedPermissions.testNormallyAllowedStuff
123 22.2 43 7 ShardSplitTest.testSplitWithChaosMonkey
123 1.4 284 5 SystemCollectionCompatTest.testBackCompat
123 7.1 300 15 TestCloudJSONFacetSKG.testRandom
1 3 1.9 255 4 LeaderFailoverAfterPartitionTest.test
1 3 1.0 275 53 TestContainerReqHandler.testRuntimeLib
1 1.2 81 1
CdcrBootstrapTest.testBootstrapWithMultipleReplicas
1 1.0 103 1 CreateRoutedAliasTest.testV2
1 2.6 78 2
DimensionalRoutedAliasUpdateProcessorTest.testCatTime
1 1.5 65 1 IndexSizeEstimatorTest.testEstimator
1 1.2 84 1 TestCloudJSONFacetSKG.testBespoke
1 1.8 109 2
TestConcurrentFacetedIndexing.testConcurrency
1 0.9 111 1 TestIndexFileDeleter.testExcInDecRef
2 1.0 100 1
AuditLoggerIntegrationTest.testQueuedTimeMetric
2 1.5 68 1
CollectionsAPIDistributedZkTest.testCollectionsAPI
2 53.3 15 8 ShardSplitTest.test
2 1.4 71 1
TestCollectionStateWatchers.testLiveNodeChangesTriggerWatches
2 1.0 97 1 TestDemoParallelLeafReader.testBasic
2 1.0 97 1
TestDemoParallelLeafReader.testRandomMultipleSchemaGens
2 1.3 79 1 TestExportWriter.testIndexOrder
2 1.3 76 1 TestLBHttp2SolrClient.testTwoServers
2 1.3 76 1 TestLBHttpSolrClient.testReliability
2 11.1 9 1 TestXYPolygonShapeQueries.testRandomBig
2 1.4 73 1
TestZKPropertiesWriter.testZKPropertiesWriter
3 1.6 128 2 AutoScalingHandlerTest.testReadApi
3 0.7 149 1 CollectionPropsTest.testReadWriteCached
3 0.8 122 1 LeaderElectionTest.testStressElection
3 0.8 128 1
LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud
3 1.6 129 2
MetricsHistoryWithAuthIntegrationTest.testValuesAreCollected
3 2.3 87 2 SplitByPrefixTest.doTest
3 9.1 11 1 Test2BPostings.test
3 0.7 151 1 TestCachePurging.testBackgroundPurges
3 0.7 147 1 TestCloudSchemaless.test
3 7.6 172 13
TestContainerReqHandler.testPluginGlobalLoader
3 30.2 172 52
TestContainerReqHandler.testRuntimeLibWithSig2048
3 31.4 172 54
TestContainerReqHandler.testRuntimeLibWithSig512
3 0.8 125 1
TestDelegationWithHadoopAuth.testDelegationTokenRenew
3 2.0 151 3 TestDynamicLoadingUrl.testDynamicLoadingUrl
3 0.9 117 1 TestInPlaceUpdatesDistrib.test
3 0.7 150 1
TestIndexingSequenceNumbers.testStressConcurrentCommit
3 0.8 125 1 TestJaegerConfigurator.testInjected
3 9.1 11 1
TestLucene80DocValuesFormat.testSortedVariableLengthManyVsStoredFields
3 0.7 153 1 TestSearcherManager.testSearcherManager
3 0.8 129 1
TestSimLargeCluster.testCreateLargeSimCollections
3 0.8 123 1
TestSolrCloudWithDelegationTokens.testDelegationTokenRenew
***********************Annotations report
Number of AwaitsFix: 38 Number of BadApples: 11
*****************AwaitsFix Annotations:
************Lucene AwaitsFix
TestControlledRealTimeReopenThread.testCRTReopen
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5737";)
TestICUNormalizer2CharFilter.testRandomStrings
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5595";)
TestICUTokenizerCJK.TestICUTokenizerCJK suite
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8222";)
TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-7161";)
************Solr AwaitsFix
CdcrBidirectionalTest.testBiDir
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12524";)
CdcrBootstrapTest.testBootstrapWithContinousIndexingOnSourceCluster
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12028";)
CollectionsAPISolrJTest.testCreateAndDeleteShard
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13021";)
ComputePlanActionTest.testNodeLost
@LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
ConcurrentCreateRoutedAliasTest.ConcurrentCreateRoutedAliasTest suite
@LuceneTestCase.AwaitsFix(bugUrl =
"https://issues.apache.org/jira/browse/SOLR-12386";) // "Can't find resource"
LeaderTragicEventTest.LeaderTragicEventTest suite
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13237";)
MoveReplicaHDFSTest.testFailedMove
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12080";) //
added 03-Oct-2018
NodeMarkersRegistrationTest.testNodeMarkersRegistration
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13376";)
ReplaceNodeNoTargetTest.ReplaceNodeNoTargetTest suite
@LuceneTestCase.AwaitsFix(bugUrl =
"https://issues.apache.org/jira/browse/SOLR-11067";)
ReplaceNodeNoTargetTest.test
@LuceneTestCase.AwaitsFix(bugUrl =
"https://issues.apache.org/jira/browse/SOLR-11067";)
SSLMigrationTest.SSLMigrationTest suite
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
17-Mar-2018
SaslZkACLProviderTest.testSaslZkACLProvider
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13075";)
ScheduledMaintenanceTriggerTest.testInactiveShardCleanup
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
17-Mar-2018
ScheduledTriggerTest.testTrigger
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
added 20-Sep-2018
SearchRateTriggerIntegrationTest.testDeleteNode
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13163";)
SearchRateTriggerTest.testTrigger
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
Tagger2Test.testStopWords
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-8344";)
TestCollapseQParserPlugin.testStringCollapse
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-11974";)
TestHierarchicalDocBuilder.testThreeLevelHierarchy
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12801";) //
this test fails easily under beasting
TestImpersonationWithHadoopAuth.testForwarding
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/HADOOP-9893";)
TestJsonFacetRefinement.testProcessEmptyRefinement
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556";)
TestJsonFacetRefinement.testSortedSubFacetRefinementWhenParentOnlyReturnedByOneShardProcessEmpty
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556";)
TestLTRReRankingPipeline.testDifferentTopN
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-11134";)
TestMinMaxOnMultiValuedField.testDoubleFieldCache
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)
TestMinMaxOnMultiValuedField.testFloatFieldCache
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)
TestMinMaxOnMultiValuedField.testIntFieldCache
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)
TestMinMaxOnMultiValuedField.testLongFieldCache
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)
TestPullReplica.TestPullReplica suite
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
TestSimComputePlanAction.testNodeLost
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12028";) //
if you beast this, eventually you will see
TestSimExtremeIndexing.TestSimExtremeIndexing suite
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12923";)
TestSimLargeCluster.testBasic
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
this test hits a timeout easily
TestStressRecovery.TestStressRecovery suite
@LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
// 6-Sep-2018
TestTlogReplica.TestTlogReplica suite
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12313";)
TriLevelCompositeIdRoutingTest.test
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13369";)
*****************BadApple Annotations:
************Lucene BadApple
************Solr BadApple
FullSolrCloudDistribCmdsTest.test
@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
annotated on: 24-Dec-2018
HdfsNNFailoverTest.HdfsNNFailoverTest suite
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
// 12-Jun-2018
HdfsRecoveryZkTest.HdfsRecoveryZkTest suite
@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
MoveReplicaHDFSTest.testNormalFailedMove
@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
14-Oct-2018
MultiThreadedOCPTest.test
@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
annotated on: 24-Dec-2018
SharedFSAutoReplicaFailoverTest.SharedFSAutoReplicaFailoverTest suite
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
// added 20-Jul-2018
SolrZkClientTest.testSimpleUpdateACLs
@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
annotated on: 24-Dec-2018
TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader
@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
6-Sep-2018
TestDistributedStatsComponentCardinality.test
@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
14-Oct-2018
TimeRoutedAliasUpdateProcessorTest.TimeRoutedAliasUpdateProcessorTest suite
@LuceneTestCase.BadApple(bugUrl =
"https://issues.apache.org/jira/browse/SOLR-13059";)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
