This is not a good week at all:
Raw fail count by week totals, most recent week first (corresponds to bits):
Week: 0 had 253 failures Most recent 7 days
Week: 1 had 56 failures 7 days before that
Week: 2 had 66 failures
Week: 3 had 83 failures
Going from 56 failures to 253 is A Very Bad Outcome. IDK whether this is an
actual horrible regression or we’re reporting on more runs or what.
This makes me fear the changes I made in SOLR-13952 since many of the failures
are in the last day. I’ve decided to roll that back anyway, that effort has
gone well past the point of diminishing returns so we’ll see if that magically
fixes the failure rate.
I’m still going to cull the gradle_8 changes for substantive changes and the
suppress warnings zombie threads and push those in the next few days.
Full report attached
Erick
DO NOT ENABLE LIST:
MoveReplicaHDFSTest.testFailedMove
MoveReplicaHDFSTest.testNormalFailedMove
TestControlledRealTimeReopenThread.testCRTReopen
TestICUNormalizer2CharFilter.testRandomStrings
TestICUTokenizerCJK
TestImpersonationWithHadoopAuth.testForwarding
TestLTRReRankingPipeline.testDifferentTopN
TestRandomChains
DO NOT ANNOTATE LIST
CdcrBidirectionalTest.testBiDir
IndexSizeTriggerTest.testMergeIntegration
IndexSizeTriggerTest.testMixedBounds
IndexSizeTriggerTest.testSplitIntegration
IndexSizeTriggerTest.testTrigger
InfixSuggestersTest.testShutdownDuringBuild
ShardSplitTest.test
ShardSplitTest.testSplitMixedReplicaTypes
ShardSplitTest.testSplitWithChaosMonkey
TestLatLonShapeQueries.testRandomBig
TestRandomChains.testRandomChainsWithLargeStrings
TestTriggerIntegration.testSearchRate
Processing file (History bit 3): HOSS-2019-11-25.csv
Processing file (History bit 2): HOSS-2019-11-18.csv
Processing file (History bit 1): HOSS-2019-11-11.csv
Processing file (History bit 0): HOSS-2019-11-04.csv
Number of AwaitsFix: 40 Number of BadApples: 8
Raw fail count by week totals, most recent week first (corresponds to bits):
Week: 0 had 253 failures
Week: 1 had 56 failures
Week: 2 had 66 failures
Week: 3 had 83 failures
**Annotated tests that didn't fail in the last 4 weeks.
**Tests removed from the next two lists because they were specified in
'doNotEnable' in the properties file
no tests removed
**Annotations will be removed from the following tests because they haven't
failed in the last 4 rollups.
**Methods: 3
FullSolrCloudDistribCmdsTest.test
SolrZkClientTest.testSimpleUpdateACLs
TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader
********Failures in Hoss' reports for the last 4 rollups.
There were 345 unannotated tests that failed in Hoss' rollups. Ordered by the
date I downloaded the rollup file, newest->oldest. See above for the dates the
files were collected
These tests were NOT BadApple'd or AwaitsFix'd
All tests that failed 4 weeks running will be BadApple'd unless there are
objections
Failures in the last 4 reports..
Report Pct runs fails test
0123 8.7 910 52 BasicAuthIntegrationTest.testBasicAuth
0123 2.0 927 10
DimensionalRoutedAliasUpdateProcessorTest.testCatTime
0123 3.0 927 19
DimensionalRoutedAliasUpdateProcessorTest.testTimeCat
0123 4.0 95 4 HdfsBasicDistributedZkTest.test
0123 3.7 922 57
LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud
0123 37.5 180 78 MoveReplicaHDFSTest.test
0123 0.5 893 5
ReindexCollectionTest.testSameTargetReindexing
0123 7.1 105 6 ShardSplitTest.testSplitWithChaosMonkey
0123 1.6 901 9 SystemCollectionCompatTest.testBackCompat
0123 5.2 929 54
TestCloudSearcherWarming.testRepFactor1LeaderStartup
0123 9.6 931 73
TestModelManagerPersistence.testFilePersistence
0123 10.5 926 67
TestModelManagerPersistence.testWrapperModelPersistence
0123 1.6 912 18
TestSkipOverseerOperations.testSkipLeaderOperations
0123 1.1 895 12 TestStressLiveNodes.testStress
************ Will BadApple all tests above this line except ones listed at the
top**************
012 0.5 573 3
TestPullReplicaErrorHandling.testPullReplicaDisconnectsFromZooKeeper
01 3 0.5 684 6 HttpPartitionWithTlogReplicasTest.test
01 0.5 366 2
ChaosMonkeyNothingIsSafeWithPullReplicasTest.test
01 0.5 371 2
TestSimpleTextTermVectorsFormat.testRamBytesUsed
01 1.2 296 7 TestSolrCachePerf.testGetPutCompute
01 0.6 345 2 TestTlogReplica.testKillLeader
0 23 1.6 725 13 RollingRestartTest.test
0 23 3.5 733 16 SyncSliceTest.test
0 23 0.6 635 4
TestDelegationWithHadoopAuth.testDelegationTokenRenew
0 23 7.5 713 23 TestInPlaceUpdatesDistrib.test
0 23 0.5 708 4
TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast
0 2 1.1 388 3 LeaderVoteWaitTimeoutTest.basicTest
0 2 14.3 58 11 StressHdfsTest.test
0 2 0.5 394 4
TestSearcherManager.testConcurrentIndexCloseSearchAndRefresh
0 2 0.5 388 2 TestV2Request.testHttpSolrClient
0 2 28.9 67 12 TestXYPolygonShapeQueries.testRandomBig
0 3 1.1 506 7 LeaderFailoverAfterPartitionTest.test
0 3 0.5 496 2 PeerSyncReplicationTest.test
0 3 1.0 509 3 ShardSplitTest.testSplitShardWithRuleLink
0 3 8.0 54 3 Test2BPostings.test
0 3 0.5 498 2
TestLucene80DocValuesFormat.testTermsEnumLongSharedPrefixes
0 3 0.5 498 2 TestPrepRecovery.testLeaderNotResponding
0 3 0.5 498 2 TestPrepRecovery.testLeaderUnloaded
0 3 0.5 490 2
TestPullReplicaErrorHandling.testCantConnectToLeader
0 0.5 183 1 AliasIntegrationTest.test
0 0.5 183 1
AliasIntegrationTest.testClusterStateProviderAPI
0 0.5 183 1
AliasIntegrationTest.testDeleteAliasWithExistingCollectionName
0 0.5 183 1
AliasIntegrationTest.testDeleteOneOfTwoCollectionsAliased
0 0.5 183 1 AliasIntegrationTest.testErrorChecks
0 0.5 183 1
AliasIntegrationTest.testModifyPropertiesCAR
0 0.5 183 1 AliasIntegrationTest.testModifyPropertiesV1
0 0.5 183 1 AliasIntegrationTest.testModifyPropertiesV2
0 0.5 183 1 AliasIntegrationTest.testProperties
0 0.5 182 1
AsyncCallRequestStatusResponseTest.testAsyncCallStatusResponse
0 0.6 170 1 AuditLoggerIntegrationTest.authValid
0 0.5 185 1
AuditLoggerIntegrationTest.searchWithException
0 0.5 185 1
CdcrBootstrapTest.testBootstrapWithMultipleReplicas
0 1.1 185 2 ChaosMonkeySafeLeaderTest.test
0 0.5 184 1 CloudHttp2SolrClientRetryTest.testRetry
0 0.5 184 1
CloudHttp2SolrClientTest.checkCollectionParameters
0 0.5 184 1
CloudHttp2SolrClientTest.preferLocalShardsTest
0 0.5 184 1
CloudHttp2SolrClientTest.preferReplicaTypesTest
0 0.5 184 1
CloudHttp2SolrClientTest.stateVersionParamTest
0 0.5 184 1 CloudHttp2SolrClientTest.testAliasHandling
0 0.5 184 1
CloudHttp2SolrClientTest.testInitializationWithSolrUrls
0 0.5 184 1
CloudHttp2SolrClientTest.testNonRetryableRequests
0 0.5 184 1
CloudHttp2SolrClientTest.testOverwriteOption
0 0.5 184 1
CloudHttp2SolrClientTest.testParallelUpdateQTime
0 0.5 184 1
CloudHttp2SolrClientTest.testRetryUpdatesWhenClusterStateIsStale
0 0.5 184 1 CloudHttp2SolrClientTest.testRouting
0 0.5 184 1
CloudHttp2SolrClientTest.testVersionsAreReturned
0 0.5 184 1 CloudSolrClientRetryTest.testRetry
0 0.5 184 1
CloudSolrClientTest.checkCollectionParameters
0 0.5 184 1 CloudSolrClientTest.preferLocalShardsTest
0 0.5 184 1 CloudSolrClientTest.preferReplicaTypesTest
0 0.5 184 1 CloudSolrClientTest.stateVersionParamTest
0 0.5 184 1 CloudSolrClientTest.testAliasHandling
0 0.5 184 1
CloudSolrClientTest.testInitializationWithSolrUrls
0 0.5 184 1
CloudSolrClientTest.testNonRetryableRequests
0 0.5 184 1 CloudSolrClientTest.testOverwriteOption
0 0.5 184 1 CloudSolrClientTest.testParallelUpdateQTime
0 0.5 184 1 CloudSolrClientTest.testPing
0 0.5 184 1
CloudSolrClientTest.testRetryUpdatesWhenClusterStateIsStale
0 0.5 184 1 CloudSolrClientTest.testRouting
0 0.5 184 1 CloudSolrClientTest.testVersionsAreReturned
0 0.5 183 1
CollectionReloadTest.testReloadedLeaderStateAfterZkSessionLoss
0 0.6 181 1 CollectionTooManyReplicasTest.testAddShard
0 0.6 181 1
CollectionTooManyReplicasTest.testAddTooManyReplicas
0 0.6 181 1
CollectionTooManyReplicasTest.testDownedShards
0 0.5 183 1
CollectionsAPIAsyncDistributedZkTest.testAsyncRequests
0 0.5 183 1
CollectionsAPIAsyncDistributedZkTest.testSolrJAPICalls
0 0.5 184 1
ConcurrentUpdateHttp2SolrClientMultiCollectionTest.testEnsureDocumentsSentToCorrectCollection
0 0.5 184 1
ConcurrentUpdateSolrClientMultiCollectionTest.testEnsureDocumentsSentToCorrectCollection
0 0.6 180 1 DaemonStreamApiTest.testAPIs
0 0.5 183 1 DistribCursorPagingTest.test
0 0.5 183 1 ExecutePlanActionTest.testExecute
0 0.5 183 1 ExecutePlanActionTest.testIntegration
0 0.5 183 1 ExecutePlanActionTest.testTaskFail
0 0.5 183 1 ExecutePlanActionTest.testTaskTimeout
0 0.6 181 1 LeaderFailureAfterFreshStartTest.test
0 0.5 186 1
LeaderVoteWaitTimeoutTest.testMostInSyncReplicasCanWinElection
0 0.5 184 1 LegacyFieldFacetCloudTest.countTest
0 0.5 184 1 LegacyFieldFacetCloudTest.maxTest
0 0.5 184 1 LegacyFieldFacetCloudTest.meanTest
0 0.5 184 1
LegacyFieldFacetCloudTest.medianFacetAscTest
0 0.5 184 1 LegacyFieldFacetCloudTest.minTest
0 0.5 184 1 LegacyFieldFacetCloudTest.missingFacetTest
0 0.5 184 1 LegacyFieldFacetCloudTest.missingTest
0 0.5 184 1 LegacyFieldFacetCloudTest.multiValueTest
0 0.5 184 1 LegacyFieldFacetCloudTest.perc20Test
0 0.5 184 1 LegacyFieldFacetCloudTest.perc60Test
0 0.5 184 1
LegacyFieldFacetCloudTest.stddevFacetAscTest
0 0.5 184 1 LegacyFieldFacetCloudTest.sumTest
0 0.5 184 1 LegacyFieldFacetCloudTest.uniqueTest
0 0.5 184 1 LegacyFieldFacetExtrasCloudTest.limitTest
0 0.5 184 1 LegacyFieldFacetExtrasCloudTest.offsetTest
0 0.5 184 1 LegacyFieldFacetExtrasCloudTest.sortTest
0 0.5 184 1 LegacyNoFacetCloudTest.countTest
0 0.5 184 1 LegacyNoFacetCloudTest.maxTest
0 0.5 184 1 LegacyNoFacetCloudTest.meanTest
0 0.5 184 1 LegacyNoFacetCloudTest.medianTest
0 0.5 184 1 LegacyNoFacetCloudTest.minTest
0 0.5 184 1 LegacyNoFacetCloudTest.missingDefaultTest
0 0.5 184 1 LegacyNoFacetCloudTest.perc20Test
0 0.5 184 1 LegacyNoFacetCloudTest.perc60Test
0 0.5 184 1 LegacyNoFacetCloudTest.stddevTest
0 0.5 184 1 LegacyNoFacetCloudTest.sumTest
0 0.5 184 1 LegacyNoFacetCloudTest.uniqueTest
0 0.5 184 1 LegacyQueryFacetCloudTest.queryTest
0 0.5 184 1 LegacyRangeFacetCloudTest.hardendRangeTest
0 0.5 184 1 LegacyRangeFacetCloudTest.multiGapTest
0 0.5 184 1 LegacyRangeFacetCloudTest.rangeTest
0 0.5 182 1
MigrateRouteKeyTest.multipleShardMigrateTest
0 0.5 182 1 MigrateRouteKeyTest.testMissingSplitKey
0 0.5 185 1 OverseerModifyCollectionTest.testModifyColl
0 1.1 184 2 RoutingToNodesWithPropertiesTest.test
0 0.5 183 1 RulesTest.doIntegrationTest
0 1.1 184 2 RulesTest.testHostFragmentRule
0 0.5 183 1 RulesTest.testModifyColl
0 1.1 184 2 RulesTest.testPortRule
0 1.1 184 2
RulesTest.testPortRuleInPresenceOfClusterPolicy
0 1.1 182 2
ScheduledTriggerIntegrationTest.testScheduledTrigger
0 0.5 184 1 SearchHandlerTest.testRequireZkConnected
0 0.5 184 1
SearchHandlerTest.testRequireZkConnectedDistrib
0 0.5 184 1 SearchHandlerTest.testZkConnected
0 0.6 181 1 SearchRateTriggerTest.testWaitForElapsed
0 0.5 184 1 ShardRoutingTest.test
0 0.5 183 1 SimpleCollectionCreateDeleteTest.test
0 0.5 184 1 SolrZkClientTest.testWrappingWatches
0 0.5 182 1 SplitByPrefixTest.doTest
0 0.5 184 1 TestAuthenticationFramework.testBasics
0 0.5 184 1
TestCloudCollectionsListeners.testCollectionDeletion
0 0.5 184 1
TestCloudCollectionsListeners.testSimpleCloudCollectionsListener
0 0.5 184 1
TestCloudCollectionsListeners.testWatchesWorkForBothStateFormats
0 0.5 192 1
TestCloudSearcherWarming.testPeersyncFailureReplicationSuccess
0 0.5 183 1 TestCollectionAPI.test
0 0.5 183 1
TestCollectionAPI.testRecreateCollectionAfterFailure
0 0.5 184 1
TestCollectionStateWatchers.testCanWaitForNonexistantCollection
0 0.5 184 1
TestCollectionStateWatchers.testCollectionWatchWithShutdownOfActiveNode
0 0.5 184 1
TestCollectionStateWatchers.testCollectionWatchWithShutdownOfUnusedNode
0 0.5 184 1
TestCollectionStateWatchers.testDeletionsTriggerWatches
0 0.5 184 1
TestCollectionStateWatchers.testLiveNodeChangesTriggerWatches
0 0.5 184 1
TestCollectionStateWatchers.testWaitForStateChecksCurrentState
0 0.5 184 1
TestCollectionStateWatchers.testWaitForStateWatcherIsRetainedOnPredicateFailure
0 0.5 184 1
TestCollectionStateWatchers.testWatchesWorkForStateFormat1
0 0.5 183 1
TestCustomStream.testDynamicLoadingCustomStream
0 17.2 215 37 TestDictionary.testInvalidData
0 1.1 185 2 TestDistribDocBasedVersion.test
0 0.5 183 1 TestDistribIDF.testMultiCollectionQuery
0 0.5 183 1 TestDistribIDF.testSimpleQuery
0 0.5 184 1
TestDocCollectionWatcher.testDeletionsTriggerWatches
0 0.5 184 1
TestDocCollectionWatcher.testWaitForStateChecksCurrentState
0 0.5 184 1
TestDocCollectionWatcher.testWaitForStateWatcherIsRetainedOnPredicateFailure
0 0.5 184 1
TestDocCollectionWatcher.testWatchesWorkForStateFormat1
0 0.5 184 1
TestDownShardTolerantSearch.searchingShouldFailWithoutTolerantSearchSetToTrue
0 0.5 183 1 TestDynamicLoading.testDynamicLoading
0 0.6 181 1 TestDynamicLoadingUrl.testDynamicLoadingUrl
0 0.5 184 1 TestLTROnSolrCloud.testSimpleQuery
0 0.5 188 1
TestLucene50TermVectorsFormat.testRamBytesUsed
0 5.3 19 1
TestLucene70NormsFormat.testSparseNCommonBig
0 0.5 185 1
TestLucene80DocValuesFormat.testRandomAdvanceBinary
0 0.6 173 1 TestPackages.testAPI
0 1.7 173 3 TestPackages.testPluginLoading
0 0.5 183 1
TestPullReplicaErrorHandling.testCantConnectToPullReplica
0 0.5 183 1 TestRecovery.testExistOldBufferLog
0 0.5 182 1
TestSSLRandomization.testRandomizedSslAndClientAuth
0 0.5 184 1 TestSolrCloudWithKerberosAlt.testBasics
0 0.5 183 1 TestSolrConfigHandlerCloud.test
0 0.5 184 1 TestV2Request.testCloudSolrClient
0 0.5 184 1 TestV2Request.testV2Forwarding
0 1.1 185 2 TestWithCollection.testAddReplicaSimple
0 1.1 185 2 TestWithCollection.testAddReplicaWithPolicy
0 1.1 185 2 TestWithCollection.testCreateCollection
0 1.1 185 2
TestWithCollection.testCreateCollectionNoWithCollection
0 1.1 185 2 TestWithCollection.testDeleteWithCollection
0 1.1 185 2
TestWithCollection.testMoveReplicaMainCollection
0 1.1 185 2
TestWithCollection.testMoveReplicaWithCollection
0 1.1 185 2
TestWithCollection.testMultipleWithCollections
0 1.1 185 2 TestWithCollection.testNodeAdded
0 0.5 184 1
TestZKPropertiesWriter.testZKPropertiesWriter
0 0.5 187 1 ZkConfigFilesTest.testCanUploadConfigToZk
123 1.1 558 6 TestTlogReplica.testKillTlogReplica
123 4.2 86 5
TestXYMultiPolygonShapeQueries.testRandomBig
123 9.4 99 6
TimeRoutedAliasUpdateProcessorTest.testDateMathInStart
12 0.6 385 2
ChaosMonkeySafeLeaderWithPullReplicasTest.test
12 5.3 45 5
HdfsTlogReplayBufferedWhileIndexingTest.test
12 1.6 394 4 SplitShardTest.testLiveSplit
12 1.1 391 3
TestConcurrentMergeScheduler.testFlushExceptions
1 3 0.6 435 3 TestSimScenario.testSuggestions
1 0.5 184 1 AnalyticsMergeStrategyTest.test
1 0.6 181 1 BasicAuthOnSingleNodeTest.basicTest
1 0.6 179 1
CollectionsAPISolrJTest.testCreateCollWithDefaultClusterPropertiesNewFormat
1 0.5 185 1 DistributedIntervalFacetingTest.test
1 0.5 182 1 ExitableDirectoryReaderTest.testPrefixQuery
1 0.6 181 1 GraphExpressionTest.testScoreNodesStream
1 0.5 182 1 MathExpressionTest.testZipFDistribution
1 57.6 132 76 PackageManagerCLITest.testPackageManager
1 4.8 21 1 RestartWhileUpdatingTest.test
1 0.6 178 1
ShardSplitTest.testSplitMixedReplicaTypesLink
1 0.6 177 1
SpellCheckCollatorTest.testEstimatedHitCounts
1 1.1 182 2
TestBlockJoin.testMultiChildQueriesOfDiffParentLevels
1 0.5 184 1 TestDistributedGrouping.test
1 0.5 183 1 TestDistributedMissingSort.test
1 18.2 121 22 TestFstDirectAddressing.testDeDupTails
1 0.8 131 1 TestHdfsCloudBackupRestore.test
1 0.6 181 1 TestIndexWriterDelete.testUpdatesOnDiskFull
1 0.6 181 1
TestLucene80DocValuesFormat.testSortedNumericsSingleValuedVsStoredFields
1 3.3 120 4 TestReplicationHandler.testEmptyBackups
1 0.6 174 1 TestTlogReplica.testRealTimeGet
23 0.5 518 3 TestPackedInts.testPackedLongValues
23 1.0 518 3
TestSolrCloudWithDelegationTokens.testDelegationTokenRenew
23 0.5 471 3 TestTlogReplica.testOnlyLeaderIndexes
23 37.6 453 201
ZkShardTermsTest.testCoreRemovalWhileRecovering
2 3.8 26 1
CdcrReplicationHandlerTest.testReplicationWithBufferedUpdates
2 1.0 206 2
ConcurrentUpdateHttp2SolrClientTest.testConcurrentUpdate
2 3.4 29 1 HdfsBasicDistributedZk2Test.test
2 3.8 26 1
HdfsCollectionsAPIDistributedZkTest.testCollectionsAPI
2 10.0 30 3 HdfsWriteToMultipleCollectionsTest.test
2 1.4 216 3
MissingSegmentRecoveryTest.testLeaderRecovery
2 0.5 207 1 OverviewImplTest.testIsOptimized
2 1.0 105 1
TestDirectDocValuesFormat.testSortedNumericsMultipleValuesVsStoredFields
2 0.5 204 1
TestDocumentsWriterStallControl.testAccquireReleaseRace
2 0.5 206 1
TestReplicationHandler.doTestIndexFetchWithMasterUrl
2 0.5 199 1
TestSimTriggerIntegration.testNodeLostTriggerRestoreState
2 2.4 206 5 TestStressCloudBlindAtomicUpdates.test_dv
2 2.4 206 5
TestStressCloudBlindAtomicUpdates.test_dv_idx
2 2.4 206 5
TestStressCloudBlindAtomicUpdates.test_dv_stored
2 2.4 206 5
TestStressCloudBlindAtomicUpdates.test_dv_stored_idx
2 2.4 206 5
TestStressCloudBlindAtomicUpdates.test_stored_idx
2 1.0 203 2 TestTlogReplica.testDeleteById
2 0.5 203 1
TestTlogReplica.testOutOfOrderDBQWithInPlaceUpdates
3 0.3 312 1 AssignBackwardCompatibilityTest.test
3 0.3 311 1 AutoScalingHandlerTest.testReadApi
3 0.3 311 1
CdcrVersionReplicationTest.testCdcrDocVersions
3 1.0 314 3
CollectionsAPISolrJTest.testCreateCollWithDefaultClusterPropertiesOldFormat
3 3.6 28 1 HdfsChaosMonkeyNothingIsSafeTest.test
3 0.6 321 2
HealthCheckHandlerTest.testHealthCheckHandler
3 0.3 321 1 HealthCheckHandlerTest.testHealthCheckV2Api
3 0.3 316 1 HttpPartitionTest.test
3 0.6 320 2 MathExpressionTest.testGammaDistribution
3 0.3 317 1 ShardSplitTest.testSplitShardWithRule
3 22.3 130 29
SolrPluginUtilsTest.testMinShouldMatchBadQueries
3 2.2 323 7
TestBadConfig.testSchemaMutableButNotManaged
3 0.4 262 1
TestDistribPackageStore.testPackageStoreManagement
3 0.3 314 1 TestIndexFileDeleter.testExcInDecRef
3 0.3 313 1 TestIndexWriterDelete.testDeletesOnDiskFull
3 0.3 314 1
TestIndexingSequenceNumbers.testStressConcurrentAddAndDeleteAndCommit
3 0.3 316 1 TestLBHttpSolrClient.testReliability
3 0.3 313 1 TestLFUCache.testTimeDecayParams
3 0.3 312 1
TestLucene80DocValuesFormat.testSortedNumericBlocksOfVariousBitsPerValue
3 0.3 312 1
TestLucene80DocValuesFormat.testTermsEnumVariableWidth
3 0.3 315 1 TestOfflineSorter.testThreadSafety
3 0.3 314 1
TestPerFieldDocValuesFormat.testSparseIntNumericsVsStoredFields
3 0.3 313 1
TestRandomChains.testRandomChainsWithLargeStrings
3 0.3 310 1 TestRecovery.stressLogReplay
3 0.3 309 1
TestSimTriggerIntegration.testTriggerThrottling
3 0.7 268 2 TestTlogReplica.testRecovery
3 2.4 328 8
UpdateRequestProcessorFactoryTest.testConfiguration
***********************Annotations report
Number of AwaitsFix: 40 Number of BadApples: 8
*****************AwaitsFix Annotations:
************Lucene AwaitsFix
TestControlledRealTimeReopenThread.testCRTReopen
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5737";)
TestICUNormalizer2CharFilter.testRandomStrings
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5595";)
TestICUTokenizerCJK.TestICUTokenizerCJK suite
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8222";)
TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-7161";)
************Solr AwaitsFix
AutoAddReplicasIntegrationTest.testRapidStopStartStopWithPropChange
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13811";)
CdcrBidirectionalTest.testBiDir
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12524";)
CdcrBootstrapTest.testBootstrapWithContinousIndexingOnSourceCluster
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12028";)
CollectionsAPISolrJTest.testCreateAndDeleteShard
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13021";)
ComputePlanActionTest.testNodeLost
@LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
ConcurrentCreateRoutedAliasTest.ConcurrentCreateRoutedAliasTest suite
@LuceneTestCase.AwaitsFix(bugUrl =
"https://issues.apache.org/jira/browse/SOLR-12386";) // "Can't find resource"
LeaderTragicEventTest.LeaderTragicEventTest suite
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13237";)
MoveReplicaHDFSTest.MoveReplicaHDFSTest suite
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13924";)
MoveReplicaHDFSTest.testFailedMove
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12080";) //
added 03-Oct-2018
ReplaceNodeNoTargetTest.ReplaceNodeNoTargetTest suite
@LuceneTestCase.AwaitsFix(bugUrl =
"https://issues.apache.org/jira/browse/SOLR-11067";)
ReplaceNodeNoTargetTest.test
@LuceneTestCase.AwaitsFix(bugUrl =
"https://issues.apache.org/jira/browse/SOLR-11067";)
SSLMigrationTest.SSLMigrationTest suite
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
17-Mar-2018
SaslZkACLProviderTest.testSaslZkACLProvider
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13075";)
ScheduledMaintenanceTriggerTest.testInactiveShardCleanup
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
17-Mar-2018
ScheduledTriggerTest.testTrigger
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
added 20-Sep-2018
SearchRateTriggerIntegrationTest.testDeleteNode
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13163";)
SearchRateTriggerTest.testTrigger
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
SolrExporterIntegrationTest.SolrExporterIntegrationTest suite
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13786";)
Tagger2Test.testStopWords
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-8344";)
TestCollapseQParserPlugin.testStringCollapse
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-11974";)
TestHierarchicalDocBuilder.testThreeLevelHierarchy
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12801";) //
this test fails easily under beasting
TestImpersonationWithHadoopAuth.testForwarding
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/HADOOP-9893";)
TestJsonFacetRefinement.testProcessEmptyRefinement
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556";)
TestJsonFacetRefinement.testSortedSubFacetRefinementWhenParentOnlyReturnedByOneShardProcessEmpty
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556";)
TestLTRReRankingPipeline.testDifferentTopN
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-11134";)
TestMinMaxOnMultiValuedField.testDoubleFieldCache
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)
TestMinMaxOnMultiValuedField.testFloatFieldCache
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)
TestMinMaxOnMultiValuedField.testIntFieldCache
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)
TestMinMaxOnMultiValuedField.testLongFieldCache
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)
TestPullReplica.TestPullReplica suite
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
TestSimComputePlanAction.testNodeLost
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12028";) //
if you beast this, eventually you will see
TestSimExtremeIndexing.TestSimExtremeIndexing suite
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12923";)
TestSimLargeCluster.testBasic
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
this test hits a timeout easily
TestStressRecovery.TestStressRecovery suite
@LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
// 6-Sep-2018
TimeRoutedAliasUpdateProcessorTest.testDateMathInStart
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13943";)
TriLevelCompositeIdRoutingTest.test
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13369";)
*****************BadApple Annotations:
************Lucene BadApple
************Solr BadApple
FullSolrCloudDistribCmdsTest.test
@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
annotated on: 24-Dec-2018
MoveReplicaHDFSTest.testNormalFailedMove
@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
14-Oct-2018
MultiThreadedOCPTest.test
@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
annotated on: 24-Dec-2018
SharedFSAutoReplicaFailoverTest.SharedFSAutoReplicaFailoverTest suite
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
// added 20-Jul-2018
SolrZkClientTest.testSimpleUpdateACLs
@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
annotated on: 24-Dec-2018
TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader
@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) //
6-Sep-2018
TimeRoutedAliasUpdateProcessorTest.TimeRoutedAliasUpdateProcessorTest suite
@LuceneTestCase.BadApple(bugUrl =
"https://issues.apache.org/jira/browse/SOLR-13059";)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
