We’re backsliding some. I encourage people to look at:
http://fucit.org/solr-jenkins-reports/failure-report.html, we have a number of
ill-behaved tests, particularly TestRequestRateLimiter,
TestBulkSchemaConcurrent, TestConfig, SchemaApiFailureTest and
TestIndexingSequenceNumbers…
Raw fail count by week totals, most recent week first (corresponds to bits):
Week: 0 had 100 failures
Week: 1 had 82 failures
Week: 2 had 94 failures
Week: 3 had 502 failures
********Failures in Hoss' reports for the last 4 rollups.
There were 585 unannotated tests that failed in Hoss' rollups. Ordered by the
date I downloaded the rollup file, newest->oldest. See above for the dates the
files were collected
These tests were NOT BadApple'd or AwaitsFix'd
Failures in the last 4 reports..
Report Pct runs fails test
0123 4.4 1583 37 BasicDistributedZkTest.test
0123 4.3 1727 77 CloudExitableDirectoryReaderTest.test
0123 2.5 8598 248
CloudExitableDirectoryReaderTest.testCreepThenBite
0123 1.9 1712 36
CloudExitableDirectoryReaderTest.testWhitebox
0123 0.5 1587 11
DocValuesNotIndexedTest.testGroupingDVOnlySortLast
0123 2.2 1679 82 HttpPartitionOnCommitTest.test
0123 0.5 1592 16 HttpPartitionTest.test
0123 1.0 1578 9 HttpPartitionWithTlogReplicasTest.test
0123 1.3 1569 13 LeaderFailoverAfterPartitionTest.test
0123 7.4 1643 59 MultiThreadedOCPTest.test
0123 0.3 1567 8 ReplaceNodeTest.test
0123 0.2 1588 6 ShardSplitTest.testSplitShardWithRule
0123 100.0 38 33 SharedFSAutoReplicaFailoverTest.test
0123 2.1 818 19
TestCircuitBreaker.testBuildingMemoryPressure
0123 2.6 818 13 TestCircuitBreaker.testResponseWithCBTiming
0123 6.2 1848 104 TestContainerPlugin.testApiFromPackage
0123 2.5 1662 33 TestDistributedGrouping.test
0123 0.4 1448 6 TestDynamicLoading.testDynamicLoading
0123 6.4 1614 74 TestExportWriter.testExpr
0123 8.6 1356 70 TestHdfsCloudBackupRestore.test
0123 9.1 1697 136 TestLocalFSCloudBackupRestore.test
0123 0.5 1607 26 TestPackages.testPluginLoading
0123 0.7 1596 15
TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast
0123 1.5 1610 59 TestReRankQParserPlugin.testMinExactCount
0123 0.3 1552 4 TestReplicaProperties.test
0123 0.3 1556 5
TestSolrCloudWithDelegationTokens.testDelegationTokenRenew
0123 0.3 1565 9 TestSolrConfigHandlerCloud.test
********************************************
DO NOT ENABLE LIST:
MoveReplicaHDFSTest.testFailedMove
MoveReplicaHDFSTest.testNormalFailedMove
TestControlledRealTimeReopenThread.testCRTReopen
TestICUNormalizer2CharFilter.testRandomStrings
TestICUTokenizerCJK
TestImpersonationWithHadoopAuth.testForwarding
TestLTRReRankingPipeline.testDifferentTopN
TestRandomChains
DO NOT ANNOTATE LIST
CdcrBidirectionalTest.testBiDir
IndexSizeTriggerTest.testMergeIntegration
IndexSizeTriggerTest.testMixedBounds
IndexSizeTriggerTest.testSplitIntegration
IndexSizeTriggerTest.testTrigger
InfixSuggestersTest.testShutdownDuringBuild
ShardSplitTest.test
ShardSplitTest.testSplitMixedReplicaTypes
ShardSplitTest.testSplitWithChaosMonkey
Test2BPostings.test
TestLatLonShapeQueries.testRandomBig
TestPackedInts.testPackedLongValues
TestRandomChains.testRandomChainsWithLargeStrings
TestTriggerIntegration.testSearchRate
SuppressWarnings count: last week: 4,825, this week: 4,819, delta -6
*************** Files with increased @SuppressWarnings annotations:
Suppress count increase in:
solr/core/src/java/org/apache/solr/handler/ReplicationHandler.java. Was: 13,
now: 15
Suppress count increase in:
solr/core/src/java/org/apache/solr/packagemanager/PackageManager.java. Was: 7,
now: 8
Suppress count increase in:
solr/core/src/test/org/apache/solr/core/TestSolrConfigHandler.java. Was: 14,
now: 17
Suppress count increase in:
solr/solrj/src/java/org/apache/solr/client/solrj/impl/HttpSolrClient.java. Was:
12, now: 13
*************** Files with decreased @SuppressWarnings annotations:
Suppress count decrease in:
solr/core/src/java/org/apache/solr/core/PluginBag.java. Was: 6, now: 5
Processing file (History bit 3): HOSS-2020-08-10.csv
Processing file (History bit 2): HOSS-2020-08-03.csv
Processing file (History bit 1): HOSS-2020-07-27.csv
Processing file (History bit 0): HOSS-2020-07-20.csv
Number of AwaitsFix: 33 Number of BadApples: 4
**Annotated tests that didn't fail in the last 4 weeks.
**Tests removed from the next two lists because they were specified in
'doNotEnable' in the properties file
MoveReplicaHDFSTest.testNormalFailedMove
**Annotations can be removed from the following tests because they haven't
failed in the last 4 rollups.
**Methods: 0
Raw fail count by week totals, most recent week first (corresponds to bits):
Week: 0 had 100 failures
Week: 1 had 82 failures
Week: 2 had 94 failures
Week: 3 had 502 failures
********Failures in Hoss' reports for the last 4 rollups.
There were 585 unannotated tests that failed in Hoss' rollups. Ordered by the
date I downloaded the rollup file, newest->oldest. See above for the dates the
files were collected
These tests were NOT BadApple'd or AwaitsFix'd
Failures in the last 4 reports..
Report Pct runs fails test
0123 4.4 1583 37 BasicDistributedZkTest.test
0123 4.3 1727 77 CloudExitableDirectoryReaderTest.test
0123 2.5 8598 248
CloudExitableDirectoryReaderTest.testCreepThenBite
0123 1.9 1712 36
CloudExitableDirectoryReaderTest.testWhitebox
0123 0.5 1587 11
DocValuesNotIndexedTest.testGroupingDVOnlySortLast
0123 2.2 1679 82 HttpPartitionOnCommitTest.test
0123 0.5 1592 16 HttpPartitionTest.test
0123 1.0 1578 9 HttpPartitionWithTlogReplicasTest.test
0123 1.3 1569 13 LeaderFailoverAfterPartitionTest.test
0123 7.4 1643 59 MultiThreadedOCPTest.test
0123 0.3 1567 8 ReplaceNodeTest.test
0123 0.2 1588 6 ShardSplitTest.testSplitShardWithRule
0123 100.0 38 33 SharedFSAutoReplicaFailoverTest.test
0123 2.1 818 19
TestCircuitBreaker.testBuildingMemoryPressure
0123 2.6 818 13 TestCircuitBreaker.testResponseWithCBTiming
0123 6.2 1848 104 TestContainerPlugin.testApiFromPackage
0123 2.5 1662 33 TestDistributedGrouping.test
0123 0.4 1448 6 TestDynamicLoading.testDynamicLoading
0123 6.4 1614 74 TestExportWriter.testExpr
0123 8.6 1356 70 TestHdfsCloudBackupRestore.test
0123 9.1 1697 136 TestLocalFSCloudBackupRestore.test
0123 0.5 1607 26 TestPackages.testPluginLoading
0123 0.7 1596 15
TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast
0123 1.5 1610 59 TestReRankQParserPlugin.testMinExactCount
0123 0.3 1552 4 TestReplicaProperties.test
0123 0.3 1556 5
TestSolrCloudWithDelegationTokens.testDelegationTokenRenew
0123 0.3 1565 9 TestSolrConfigHandlerCloud.test
********************************************
Failures over the last 4 weeks, but not every week. Ordered most-recent first:
Report Pct runs fails test
012 5.6 72 4 ShardSplitTest.testSplitWithChaosMonkey
01 3 0.7 1203 8
ConnectionManagerTest.testReconnectWhenZkDisappeared
01 3 0.5 815 5
MetricTriggerIntegrationTest.testMetricTrigger
01 3 0.5 812 5 SearchRateTriggerTest.testWaitForElapsed
01 3 0.3 1172 4
SolrCloudReportersTest.testExplicitConfiguration
01 3 0.3 1184 6 SystemCollectionCompatTest.testBackCompat
01 3 0.5 1181 5 TestCollectionAPI.test
0 23 0.3 1167 4 MoveReplicaTest.testFailedMove
0 23 0.3 1167 5 ReplicationFactorTest.test
0 23 0.9 810 6
ScheduledTriggerIntegrationTest.testScheduledTrigger
0 23 2.0 1174 23 TestInPlaceUpdatesDistrib.test
0 23 0.3 1165 5
TestPullReplicaErrorHandling.testPullReplicaDisconnectsFromZooKeeper
0 2 0.3 658 2
SoftAutoCommitTest.testSoftAndHardCommitMaxTimeMixedAdds
0 2 0.3 738 3 TestPackages.testSchemaPlugins
0 3 0.3 785 3
CdcrVersionReplicationTest.testCdcrDocVersions
0 3 0.3 786 4 ChaosMonkeyNothingIsSafeTest.test
0 3 0.3 792 3 CollectionsAPISolrJTest.testColStatus
0 3 0.3 791 3 PeerSyncReplicationTest.test
0 3 0.5 788 3 PeerSyncTest.test
0 3 0.5 794 7
SolrCloudExampleTest.testLoadDocsIntoGettingStartedCollection
0 3 0.3 787 3 TestBlobHandler.doBlobHandlerTest
0 3 0.1 1219 3 TestBulkSchemaConcurrent.test
0 3 0.3 784 2 TestCloudManagedSchema.test
0 3 0.5 792 5
TestCloudSearcherWarming.testPeersyncFailureReplicationSuccess
0 3 1.2 794 8
TestCollectionAPI.testRecreateCollectionAfterFailure
0 3 0.0 4776 2 TestJsonFacets.testTolerant
0 3 0.3 785 3 TestOnReconnectListenerSupport.test
0 3 0.3 786 2 TestPrepRecovery.testLeaderNotResponding
0 3 0.3 791 4 TestShortCircuitedRequests.test
0 3 0.3 792 5 TestStressInPlaceUpdates.stressTest
0 3 0.9 620 10 TestWithCollection.testNodeAdded
0 0.3 398 1 ActionThrottleTest.testBasics
0 2.7 406 11 BJQParserTest.testToParentFilters
0 0.2 414 1 ConnectionManagerTest.testLikelyExpired
0 13.3 15 2 HdfsBasicDistributedZkTest.test
0 0.3 398 1
MetricsHistoryWithAuthIntegrationTest.testValuesAreCollected
0 0.3 398 1
SignatureUpdateProcessorFactoryTest.testMultiThreaded
0 0.3 397 1 SolrGraphiteReporterTest.testReporter
0 0.3 390 1 StreamDecoratorTest.testInnerJoinStream
0 0.3 391 1 StreamingTest.testMergeStream
0 21.0 486 102 TestConfig.testDefaults
0 17.6 17 3
TestIndexingSequenceNumbers.testStressConcurrentAddAndDeleteAndCommit
0 0.3 389 1 TestLBHttp2SolrClient.testReliability
0 0.5 398 2 TestLockTree.testLocks
0 1.5 399 6 TestPointFields.testFloatPointStats
0 43.3 483 209
TestRequestRateLimiter.testConcurrentQueries
0 49.3 483 238 TestRequestRateLimiter.testSlotBorrowing
0 0.2 3970 6
TestSolr4Spatial2.testLLPDecodeIsStableAndPrecise
0 5.6 18 1 TestStressNRTReplication.test
123 0.3 1160 7 RollingRestartTest.test
123 0.5 1189 7
TestIndexWriterDelete.testDeleteAllNoDeadLock
123 0.3 1156 6 UnloadDistributedZkTest.test
12 4.0 56 9
CdcrReplicationHandlerTest.testReplicationWithBufferedUpdates
12 0.3 693 2
LBSolrClientTest.testServerIteratorTimeAllowed
12 16.0 47 5 StressHdfsTest.test
12 0.5 417 2
TriggerSetPropertiesIntegrationTest.testSetProperties
1 3 0.3 784 2
ChaosMonkeySafeLeaderWithPullReplicasTest.test
1 3 0.3 643 2 CheckHdfsIndexTest.testChecksumsOnly
1 3 0.5 606 5 ComputePlanActionTest.testNodeAdded
1 3 0.9 606 4
ComputePlanActionTest.testSelectedCollectionsByPolicy
1 3 0.3 787 5 ReindexCollectionTest.testFailure
1 3 0.2 801 4 ShardSplitTest.testSplitMixedReplicaTypes
1 3 1.0 778 6 TestCloudPivotFacet.test
1 3 0.3 777 3 TestCloudSchemaless.test
1 3 0.3 776 4
TestPullReplicaErrorHandling.testCantConnectToLeader
1 0.5 398 2
DocValuesNotIndexedTest.testGroupingDocAbsent
1 0.3 386 1 MathExpressionTest.testZipFDistribution
1 0.3 391 1 OverseerRolesTest.testOverseerRole
1 0.3 388 1
RandomGeoPolygonTest.testCompareSmallPolygons
1 0.3 337 1
SoftAutoCommitTest.testHardCommitWithinAndSoftCommitMaxTimeRapidAdds
1 2.7 401 11
TestBlockJoin.testMultiChildQueriesOfDiffParentLevels
1 0.5 396 2 TestCloudRecovery2.test
1 0.3 394 1 TestIndexWriterDelete.testDeleteAllRollback
1 0.3 394 1
TestIndexWriterDelete.testMergingAfterDeleteAll
1 0.0 2376 1 TestJsonFacets.testOverrequest
1 1.3 390 5 TestPointFields.testDoublePointStats
1 0.3 393 1 TestRAFDirectory.testRandomShort
1 0.3 391 1 TestRebalanceLeaders.testRebalanceLeaders
1 0.3 388 1 TestTolerantSearch.testGetTopIdsPhaseError
23 0.3 769 4
CustomCollectionTest.testRouteFieldForImplicitRouter
23 0.3 768 2 CustomHighlightComponentTest.test
23 0.3 768 3 DaemonStreamApiTest.testAPIs
23 0.3 778 3
DistribDocExpirationUpdateProcessorTest.testNoAuth
23 0.3 791 2
DocValuesNotIndexedTest.testGroupingDVOnlySortFirst
23 0.5 592 2 ExecutePlanActionTest.testTaskFail
23 0.5 592 2 ExecutePlanActionTest.testTaskTimeout
23 0.3 768 4 LeaderFailureAfterFreshStartTest.test
23 0.5 777 5 ShardRoutingTest.test
23 0.3 784 4 ShardSplitTest.testSplitShardWithRuleLink
23 0.3 772 2
TestDistribPackageStore.testPackageStoreManagement
23 0.3 765 2 TestDynamicFieldNamesIndexCorrectly.test
23 0.3 771 2 TestDynamicLoadingUrl.testDynamicLoadingUrl
23 0.3 795 2 TestIndexWriterDelete.testBothDeletes
23 0.9 609 5 TestSimScenario.testSplitShard
23 0.5 609 3 TestSimScenario.testSuggestions
23 0.3 638 2
TestSolrCloudWithSecureImpersonation.testForwarding
23 0.2 822 7 TestSolrConfigHandlerConcurrent.test
23 0.5 606 8
TestWithCollection.testMultipleWithCollections
2 3.2 31 1
CdcrReplicationHandlerTest.testPartialReplicationWithTruncatedTlog
2 0.5 208 1 IndexSizeTriggerTest.testMergeIntegration
2 0.3 325 1
SoftAutoCommitTest.testHardCommitWithinAndSoftCommitMaxTimeMixedAdds
2 19.0 126 24 SolrQueryParserBaseTest.testGetField
2 19.0 126 24
SolrQueryParserBaseTest.testGetMagicFieldQuery
2 19.0 126 24 SolrQueryParserBaseTest.testInitHappyCases
2 0.5 195 1
StreamDecoratorTest.testParallelTerminatingDaemonUpdateStream
2 0.3 386 1 TestCachePurging.testBackgroundPurges
2 0.3 384 1 TestIndexWriter.testThreadInterruptDeadlock
2 0.5 388 2 TestIndexWriterDelete.testNonRAMDelete
2 0.0 2334 1 TestJsonFacets.testStatsDistrib
2 0.3 373 1 TestLBHttp2SolrClient.testTwoServers
2 0.3 383 1 TestRecovery.stressLogReplay
2 0.3 312 1 TestRecoveryHdfs.testExistOldBufferLog
2 0.3 382 1
TestReplicationHandler.doTestStressReplication
3 1.0 392 4 AddReplicaTest.test
3 1.0 392 4 AddReplicaTest.testAddMultipleReplicas
3 1.0 392 4 AliasIntegrationTest.test
3 1.0 392 4
AliasIntegrationTest.testClusterStateProviderAPI
3 1.0 392 4
AliasIntegrationTest.testDeleteAliasWithExistingCollectionName
3 1.0 392 4
AliasIntegrationTest.testDeleteOneOfTwoCollectionsAliased
3 1.0 392 4 AliasIntegrationTest.testErrorChecks
3 1.0 392 4
AliasIntegrationTest.testModifyPropertiesCAR
3 1.0 392 4 AliasIntegrationTest.testModifyPropertiesV1
3 1.0 392 4 AliasIntegrationTest.testModifyPropertiesV2
3 1.0 392 4 AliasIntegrationTest.testProperties
3 1.0 388 4
AsyncCallRequestStatusResponseTest.testAsyncCallStatusResponse
3 0.5 390 2 AuditLoggerIntegrationTest.authValid
3 0.5 390 2
AuditLoggerIntegrationTest.searchWithException
3 0.3 388 1 AutoAddReplicasPlanActionTest.testSimple
3 0.3 394 1 AutoScalingHandlerTest.testDeleteUsedPolicy
3 0.3 394 1
AutoScalingHandlerTest.testDiagnosticsWithPayload
3 0.5 394 2 AutoScalingHandlerTest.testReadApi
3 0.5 394 2
AutoScalingHandlerTest.testSuggestionsWithPayload
3 0.5 388 2 BasicAuthIntegrationTest.testBasicAuth
3 0.5 387 2 BasicAuthOnSingleNodeTest.basicTest
3 0.5 387 2
BasicAuthOnSingleNodeTest.testDeleteSecurityJsonZnode
3 0.8 390 3 BasicDistributedZk2Test.test
3 0.4 224 1 BasicZkTest.testBasic
3 0.5 386 2
CdcrBootstrapTest.testBootstrapWithMultipleReplicas
3 0.5 386 2
CdcrBootstrapTest.testBootstrapWithSourceCluster
3 0.5 386 2
CdcrBootstrapTest.testConvertClusterToCdcrAndBootstrap
3 0.3 386 1
ChaosMonkeyNothingIsSafeWithPullReplicasTest.test
3 0.3 388 1 ChaosMonkeySafeLeaderTest.test
3 0.5 388 2 CleanupOldIndexTest.test
3 1.8 392 7 CloudHttp2SolrClientRetryTest.testRetry
3 0.5 387 2
CloudHttp2SolrClientTest.checkCollectionParameters
3 0.5 387 2
CloudHttp2SolrClientTest.preferLocalShardsTest
3 0.5 387 2
CloudHttp2SolrClientTest.preferReplicaTypesTest
3 0.5 387 2
CloudHttp2SolrClientTest.singleShardedPreferenceRules
3 0.5 387 2
CloudHttp2SolrClientTest.stateVersionParamTest
3 0.5 387 2 CloudHttp2SolrClientTest.testAliasHandling
3 0.5 387 2
CloudHttp2SolrClientTest.testInitializationWithSolrUrls
3 0.5 387 2
CloudHttp2SolrClientTest.testNonRetryableRequests
3 0.5 387 2
CloudHttp2SolrClientTest.testOverwriteOption
3 0.5 387 2
CloudHttp2SolrClientTest.testParallelUpdateQTime
3 0.5 387 2
CloudHttp2SolrClientTest.testRetryUpdatesWhenClusterStateIsStale
3 0.5 387 2 CloudHttp2SolrClientTest.testRouting
3 0.5 387 2
CloudHttp2SolrClientTest.testVersionsAreReturned
3 0.3 385 1 CloudMLTQParserTest.testBoost
3 0.3 385 1 CloudMLTQParserTest.testHighDFValue
3 0.3 385 1 CloudMLTQParserTest.testHighWLValue
3 0.3 385 1
CloudMLTQParserTest.testInvalidSourceDocument
3 0.3 385 1 CloudMLTQParserTest.testLowMinWLValue
3 0.3 385 1 CloudMLTQParserTest.testMLTQParser
3 0.3 385 1 CloudMLTQParserTest.testMinDF
3 0.3 385 1 CloudMLTQParserTest.testMultipleFields
3 0.3 385 1
CloudMLTQParserTest.testUnstoredAndUnanalyzedFieldsAreIgnored
3 0.5 387 2 CloudSolrClientRetryTest.testRetry
3 0.5 387 2
CloudSolrClientTest.checkCollectionParameters
3 0.5 387 2 CloudSolrClientTest.preferLocalShardsTest
3 0.5 387 2 CloudSolrClientTest.preferReplicaTypesTest
3 0.5 387 2
CloudSolrClientTest.singleShardedPreferenceRules
3 0.5 387 2 CloudSolrClientTest.stateVersionParamTest
3 0.5 387 2 CloudSolrClientTest.testAliasHandling
3 0.5 387 2
CloudSolrClientTest.testInitializationWithSolrUrls
3 0.5 387 2
CloudSolrClientTest.testNonRetryableRequests
3 0.5 387 2 CloudSolrClientTest.testOverwriteOption
3 0.5 387 2 CloudSolrClientTest.testParallelUpdateQTime
3 0.5 387 2 CloudSolrClientTest.testPing
3 0.5 387 2
CloudSolrClientTest.testRetryUpdatesWhenClusterStateIsStale
3 0.5 387 2 CloudSolrClientTest.testRouting
3 0.5 387 2 CloudSolrClientTest.testVersionsAreReturned
3 0.5 389 2 ClusterStateUpdateTest.testCoreRegistration
3 0.5 388 2 CollectionPropsTest.testMultipleWatchers
3 0.5 388 2 CollectionPropsTest.testReadWriteCached
3 0.5 388 2 CollectionPropsTest.testReadWriteNoCache
3 0.5 388 2 CollectionPropsTest.testWatcher
3 0.5 387 2
CollectionReloadTest.testReloadedLeaderStateAfterZkSessionLoss
3 0.4 226 1
CollectionStateFormat2Test.testZkNodeLocation
3 0.6 164 1 CollectionStateZnodeTest.testZkNodeLocation
3 1.6 433 7 CollectionTooManyReplicasTest.testAddShard
3 13.2 433 57
CollectionTooManyReplicasTest.testAddTooManyReplicas
3 1.6 433 7
CollectionTooManyReplicasTest.testDownedShards
3 1.3 390 5
CollectionsAPIAsyncDistributedZkTest.testAsyncRequests
3 1.3 390 5
CollectionsAPIAsyncDistributedZkTest.testSolrJAPICalls
3 0.5 389 2
CollectionsAPIDistributedZkTest.addReplicaTest
3 0.5 389 2
CollectionsAPIDistributedZkTest.deleteCollectionOnlyInZk
3 0.5 389 2
CollectionsAPIDistributedZkTest.deletePartiallyCreatedCollection
3 0.5 389 2
CollectionsAPIDistributedZkTest.testCollectionReload
3 0.5 389 2
CollectionsAPIDistributedZkTest.testCollectionsAPI
3 0.5 389 2
CollectionsAPIDistributedZkTest.testCoresAreDistributedAcrossNodes
3 0.5 389 2
CollectionsAPIDistributedZkTest.testCreationAndDeletion
3 0.5 389 2
CollectionsAPIDistributedZkTest.testDeleteNonExistentCollection
3 0.5 389 2
CollectionsAPIDistributedZkTest.testSpecificConfigsets
3 0.5 394 2
CollectionsAPISolrJTest.testAddAndDeleteReplica
3 0.5 394 2
CollectionsAPISolrJTest.testAddAndDeleteReplicaProp
3 0.5 394 2
CollectionsAPISolrJTest.testBalanceShardUnique
3 0.5 394 2
CollectionsAPISolrJTest.testCloudInfoInCoreStatus
3 0.5 394 2 CollectionsAPISolrJTest.testCollectionProp
3 0.5 394 2
CollectionsAPISolrJTest.testCreateAndDeleteAlias
3 0.5 394 2
CollectionsAPISolrJTest.testCreateAndDeleteCollection
3 0.5 394 2
CollectionsAPISolrJTest.testCreateCollWithDefaultClusterPropertiesNewFormat
3 0.5 394 2
CollectionsAPISolrJTest.testCreateCollWithDefaultClusterPropertiesOldFormat
3 0.5 394 2
CollectionsAPISolrJTest.testCreateCollectionWithPropertyParam
3 0.5 394 2
CollectionsAPISolrJTest.testCreateWithDefaultConfigSet
3 0.5 394 2
CollectionsAPISolrJTest.testDeleteAliasedCollection
3 0.5 394 2
CollectionsAPISolrJTest.testModifyCollectionAttribute
3 0.5 394 2
CollectionsAPISolrJTest.testReadOnlyCollection
3 0.5 394 2
CollectionsAPISolrJTest.testRenameCollection
3 0.5 394 2 CollectionsAPISolrJTest.testSplitShard
3 0.5 391 2
ComputePlanActionTest.testNodeAddedTriggerWithAddReplicaPreferredOpReplicaType_1Shard
3 0.5 391 2
ComputePlanActionTest.testNodeAddedTriggerWithAddReplicaPreferredOp_1Shard
3 0.5 391 2
ComputePlanActionTest.testNodeAddedTriggerWithAddReplicaPreferredOp_2Shard
3 0.5 391 2
ComputePlanActionTest.testNodeLostTriggerWithDeleteNodePreferredOp
3 0.5 391 2
ComputePlanActionTest.testNodeWithMultipleReplicasLost
3 0.5 391 2
ComputePlanActionTest.testSelectedCollectionsByName
3 0.5 389 2
ConcurrentCreateCollectionTest.testConcurrentCreatePlacement
3 0.5 387 2
ConcurrentUpdateHttp2SolrClientMultiCollectionTest.testEnsureDocumentsSentToCorrectCollection
3 0.5 387 2
ConcurrentUpdateSolrClientMultiCollectionTest.testEnsureDocumentsSentToCorrectCollection
3 0.5 390 2 ConfigSetsAPITest.testSharedSchema
3 0.5 389 2
CreateRoutedAliasTest.testCollectionNamesMustBeAbsent
3 0.5 389 2
CreateRoutedAliasTest.testTimezoneAbsoluteDate
3 0.5 389 2 CreateRoutedAliasTest.testV1
3 0.5 389 2 CreateRoutedAliasTest.testV2
3 0.8 388 3
CustomCollectionTest.testCreateShardRepFactor
3 0.8 388 3
CustomCollectionTest.testCustomCollectionsAPI
3 0.8 388 3
CustomCollectionTest.testRouteFieldForHashRouter
3 0.5 386 2
DeleteInactiveReplicaTest.deleteInactiveReplicaTest
3 0.3 387 1 DeleteLastCustomShardedReplicaTest.test
3 0.3 387 1 DeleteNodeTest.test
3 0.3 393 1 DeleteReplicaTest.deleteLiveReplicaTest
3 0.8 393 3
DeleteReplicaTest.deleteReplicaAndVerifyDirectoryCleanup
3 0.3 393 1 DeleteReplicaTest.deleteReplicaByCount
3 0.3 393 1
DeleteReplicaTest.deleteReplicaByCountForAllShards
3 0.3 393 1
DeleteReplicaTest.deleteReplicaFromClusterState
3 0.4 231 1
DeleteReplicaTest.deleteReplicaFromClusterStateLegacy
3 0.3 393 1 DeleteReplicaTest.deleteReplicaOnIndexing
3 0.3 393 1
DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplica
3 0.4 231 1
DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplicaLegacy
3 0.8 388 3 DeleteShardTest.test
3 0.8 388 3
DeleteShardTest.testDirectoryCleanupAfterDeleteShard
3 0.5 389 2 DistribCursorPagingTest.test
3 0.8 395 3
DistribDocExpirationUpdateProcessorTest.testBasicAuth
3 0.8 396 3
DistributedVersionInfoTest.testReplicaVersionHandling
3 0.3 385 1 ExecutePlanActionTest.testExecute
3 0.3 385 1 ExecutePlanActionTest.testIntegration
3 0.3 388 1
FullSolrCloudDistribCmdsTest.testBasicUpdates
3 0.3 388 1
FullSolrCloudDistribCmdsTest.testConcurrentIndexing
3 0.3 388 1
FullSolrCloudDistribCmdsTest.testIndexQueryDeleteHierarchical
3 0.3 388 1
FullSolrCloudDistribCmdsTest.testIndexingBatchPerRequestWithHttpSolrClient
3 0.3 388 1
FullSolrCloudDistribCmdsTest.testIndexingOneDocPerRequestWithHttpSolrClient
3 0.3 388 1
FullSolrCloudDistribCmdsTest.testThatCantForwardToLeaderFails
3 0.8 391 3 FuzzySearchTest.testTooComplex
3 0.5 387 2
HealthCheckHandlerTest.testHealthCheckHandler
3 0.3 390 1 Http2SolrClientTest.testUpdate
3 0.5 386 2
IndexSizeTriggerMixedBoundsTest.testMixedBounds
3 0.5 387 2
JWTAuthPluginIntegrationTest.createCollectionUpdateAndQueryDistributed
3 0.5 387 2 JWTAuthPluginIntegrationTest.testMetrics
3 0.8 390 3
LeaderElectionIntegrationTest.testSimpleSliceLeaderElection
3 0.3 387 1 LeaderElectionTest.testParallelElection
3 0.8 390 3 LeaderVoteWaitTimeoutTest.basicTest
3 0.8 390 3
LeaderVoteWaitTimeoutTest.testMostInSyncReplicasCanWinElection
3 0.8 389 3
MigrateRouteKeyTest.multipleShardMigrateTest
3 0.8 389 3 MigrateRouteKeyTest.testMissingSplitKey
3 0.8 390 3
MissingSegmentRecoveryTest.testLeaderRecovery
3 0.5 387 2 MoveReplicaTest.test
3 1.8 394 7 NestedShardedAtomicUpdateTest.test
3 0.3 389 1
NodeMarkersRegistrationTest.testNodeMarkersRegistration
3 0.5 388 2 OverseerModifyCollectionTest.testModifyColl
3 0.5 389 2 OverseerStatusTest.test
3 0.4 266 1 OverseerTest.testBadQueueItem
3 0.4 266 1 OverseerTest.testDoubleAssignment
3 0.4 266 1 OverseerTest.testDownNodeFailover
3 0.4 266 1 OverseerTest.testOverseerFailure
3 0.4 266 1 OverseerTest.testOverseerStatsReset
3 0.4 266 1 OverseerTest.testShardAssignment
3 1.1 266 3 OverseerTest.testShardLeaderChange
3 0.3 388 1 PackageManagerCLITest.testPackageManager
3 0.5 387 2
PingRequestHandlerTest.testPingInClusterWithNoHealthCheck
3 0.3 388 1 RecoveryAfterSoftCommitTest.test
3 1.0 391 4 RecoveryZkTest.test
3 1.0 395 4 ReindexCollectionTest.testAbort
3 1.0 395 4 ReindexCollectionTest.testBasicReindexing
3 1.0 395 4 ReindexCollectionTest.testLossySchema
3 1.0 395 4 ReindexCollectionTest.testReshapeReindexing
3 1.3 395 5
ReindexCollectionTest.testSameTargetReindexing
3 1.0 390 4 RemoteQueryErrorTest.test
3 1.8 392 7 RoutingToNodesWithPropertiesTest.test
3 0.3 385 1 RulesTest.doIntegrationTest
3 0.3 385 1 RulesTest.testHostFragmentRule
3 0.3 385 1 RulesTest.testModifyColl
3 0.3 385 1 RulesTest.testPortRule
3 0.3 385 1
RulesTest.testPortRuleInPresenceOfClusterPolicy
3 0.5 390 2 ShardRoutingCustomTest.test
3 0.5 398 2 ShardSplitTest.testSplitAfterFailedSplit
3 0.5 398 2 ShardSplitTest.testSplitLocking
3 0.5 398 2
ShardSplitTest.testSplitMixedReplicaTypesLink
3 0.5 398 2
ShardSplitTest.testSplitStaticIndexReplication
3 0.8 398 3
ShardSplitTest.testSplitStaticIndexReplicationLink
3 0.5 387 2 SimpleCollectionCreateDeleteTest.test
3 0.5 386 2 SolrCloudReportersTest.testDefaultPlugins
3 0.5 387 2 SolrShardReporterTest.test
3 0.5 387 2 SolrZkClientTest.testWrappingWatches
3 1.8 392 7 SplitByPrefixTest.doTest
3 0.5 389 2 SplitShardTest.doTest
3 0.5 389 2 SplitShardTest.testLiveSplit
3 0.5 389 2 SplitShardTest.testSplitFuzz
3 0.5 390 2 SyncSliceTest.test
3 0.8 388 3 SystemLogListenerTest.test
3 0.8 388 3 TemplateUpdateProcessorTest.testSimple
3 0.5 389 2 TestAuthenticationFramework.testBasics
3 0.5 387 2
TestAuthorizationFramework.authorizationFrameworkTest
3 1.8 392 7
TestCloudCollectionsListeners.testCollectionDeletion
3 1.8 392 7
TestCloudCollectionsListeners.testSimpleCloudCollectionsListener
3 0.8 390 3
TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader
3 0.8 390 3
TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeaderAfterRestart
3 0.5 387 2 TestCloudRecovery.corruptedLogTest
3 0.5 387 2
TestCloudRecovery.leaderRecoverFromLogOnStartupTest
3 0.5 389 2
TestCloudSearcherWarming.testRepFactor1LeaderStartup
3 0.5 387 2
TestCollectionStateWatchers.testCanWaitForNonexistantCollection
3 0.5 387 2
TestCollectionStateWatchers.testCollectionWatchWithShutdownOfActiveNode
3 0.5 387 2
TestCollectionStateWatchers.testCollectionWatchWithShutdownOfUnusedNode
3 0.5 387 2
TestCollectionStateWatchers.testDeletionsTriggerWatches
3 0.5 387 2
TestCollectionStateWatchers.testLiveNodeChangesTriggerWatches
3 0.5 387 2
TestCollectionStateWatchers.testWaitForStateChecksCurrentState
3 0.5 387 2
TestCollectionStateWatchers.testWaitForStateWatcherIsRetainedOnPredicateFailure
3 0.3 388 1
TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete
3 0.3 388 1
TestCollectionsAPIViaSolrCloudCluster.testStopAllStartAll
3 0.5 387 2 TestConfigReload.test
3 0.5 387 2 TestConfigSetsAPI.testUpload
3 0.3 361 1
TestConfigSetsAPI.testUploadWithScriptUpdateProcessor
3 1.3 396 5 TestCryptoKeys.test
3 0.8 395 3
TestCustomStream.testDynamicLoadingCustomStream
3 0.8 388 3
TestDeleteCollectionOnDownNodes.deleteCollectionWithDownNodes
3 0.8 388 3 TestDistribDocBasedVersion.test
3 0.3 385 1 TestDistribIDF.testMultiCollectionQuery
3 0.3 385 1 TestDistribIDF.testSimpleQuery
3 0.5 387 2
TestDocCollectionWatcher.testDeletionsTriggerWatches
3 0.5 387 2
TestDocCollectionWatcher.testWaitForStateChecksCurrentState
3 0.5 387 2
TestDocCollectionWatcher.testWaitForStateWatcherIsRetainedOnPredicateFailure
3 0.5 387 2
TestDownShardTolerantSearch.searchingShouldFailWithoutTolerantSearchSetToTrue
3 2.4 166 4
TestExactSharedStatsCacheCloud.testBasicStats
3 1.2 165 2 TestExactStatsCacheCloud.testBasicStats
3 2.3 395 9 TestExclusionRuleCollectionAccess.doTest
3 1.3 391 5 TestExportTool.testBasic
3 0.5 396 2 TestFlushByRamOrCountsPolicy.testRandom
3 0.8 388 3 TestJaegerConfigurator.testInjected
3 0.6 164 1 TestLRUStatsCacheCloud.testBasicStats
3 0.8 388 3 TestLTROnSolrCloud.testSimpleQuery
3 0.2 455 1
TestLocalFSCloudBackupRestore.testRestoreFailure
3 2.3 392 9 TestManagedSchemaAPI.test
3 0.8 388 3 TestMiniSolrCloudClusterSSL.testNoSsl
3 0.8 388 3
TestMiniSolrCloudClusterSSL.testNoSslButSillyClientAuth
3 0.9 321 3
TestMiniSolrCloudClusterSSL.testSslAndClientAuth
3 0.8 388 3
TestMiniSolrCloudClusterSSL.testSslAndNoClientAuth
3 0.8 388 3
TestMiniSolrCloudClusterSSL.testSslWithCheckPeerName
3 0.8 388 3
TestMiniSolrCloudClusterSSL.testSslWithInvalidPeerName
3 0.8 385 3 TestNamedUpdateProcessors.test
3 0.3 393 1 TestPackages.testAPI
3 0.5 388 2 TestPolicyCloud.testCreateCollection
3 0.5 388 2
TestPolicyCloud.testCreateCollectionAddReplica
3 0.5 388 2
TestPolicyCloud.testCreateCollectionAddShardUsingPolicy
3 0.5 388 2
TestPolicyCloud.testCreateCollectionAddShardWithReplicaTypeUsingPolicy
3 0.5 388 2
TestPolicyCloud.testCreateCollectionSplitShard
3 0.5 388 2 TestPolicyCloud.testDataProvider
3 0.5 388 2
TestPolicyCloud.testDataProviderPerReplicaDetails
3 0.5 388 2 TestPolicyCloud.testMetricsTag
3 0.3 388 1 TestPrepRecovery.testLeaderUnloaded
3 0.8 389 3
TestPullReplicaErrorHandling.testCantConnectToPullReplica
3 0.8 390 3 TestRandomRequestDistribution.test
3 0.8 390 3
TestRequestForwarding.testMultiCollectionQuery
3 0.8 387 3
TestSSLRandomization.testRandomizedSslAndClientAuth
3 0.8 388 3
TestSegmentSorting.testAtomicUpdateOfSegmentSortField
3 0.8 388 3
TestSegmentSorting.testSegmentTerminateEarly
3 0.3 397 1 TestSimScenario.testIndexing
3 0.3 386 1
TestSkipOverseerOperations.testSkipDownOperations
3 0.3 386 1
TestSkipOverseerOperations.testSkipLeaderOperations
3 0.3 390 1 TestSmileRequest.testDistribJsonRequest
3 0.3 391 1
TestSolrCLIRunExample.testInteractiveSolrCloudExample
3 0.5 388 2 TestSolrCloudSnapshots.testSnapshots
3 0.5 389 2
TestSolrCloudWithDelegationTokens.testDelegationTokenSolrClientWithUpdateRequests
3 0.5 386 2 TestSolrCloudWithKerberosAlt.testBasics
3 0.5 386 2 TestSolrCoreSnapshots.testBackupRestore
3 0.5 386 2 TestSolrCoreSnapshots.testIndexOptimization
3 0.3 389 1
TestSolrDeletionPolicy1.testNumCommitsConfigured
3 1.0 392 4 TestSystemCollAutoCreate.testAutoCreate
3 0.3 391 1 TestTlogReplica.testAddDocs
3 0.3 391 1 TestTlogReplica.testAddRemoveTlogReplica
3 0.3 391 1 TestTlogReplica.testBasicLeaderElection
3 0.3 782 2 TestTlogReplica.testCreateDelete
3 0.3 391 1 TestTlogReplica.testDeleteById
3 0.3 391 1 TestTlogReplica.testKillLeader
3 0.3 391 1 TestTlogReplica.testOnlyLeaderIndexes
3 0.5 391 2
TestTlogReplica.testOutOfOrderDBQWithInPlaceUpdates
3 0.3 391 1 TestTlogReplica.testRealTimeGet
3 0.3 391 1 TestTlogReplica.testRecovery
3 0.3 391 1 TestTlogReplica.testRemoveLeader
3 0.3 386 1
TestTrackingShardHandlerFactory.testRequestTracking
3 0.7 403 3 TestUtilizeNode.test
3 0.5 387 2 TestV2Request.testCloudSolrClient
3 0.5 387 2 TestV2Request.testHttpSolrClient
3 0.5 387 2 TestV2Request.testV2Forwarding
3 0.8 391 3
TestWaitForStateWithJettyShutdowns.testWaitForStateAfterShutDown
3 0.8 391 3
TestWaitForStateWithJettyShutdowns.testWaitForStateBeforeShutDown
3 1.8 399 7 TestWithCollection.testAddReplicaSimple
3 2.0 399 8 TestWithCollection.testAddReplicaWithPolicy
3 1.8 399 7 TestWithCollection.testCreateCollection
3 1.8 399 7
TestWithCollection.testCreateCollectionNoWithCollection
3 1.8 399 7 TestWithCollection.testDeleteWithCollection
3 1.8 399 7
TestWithCollection.testMoveReplicaMainCollection
3 1.8 399 7
TestWithCollection.testMoveReplicaWithCollection
3 0.5 387 2
TestZKPropertiesWriter.testZKPropertiesWriter
3 0.5 388 2
ZkCollectionPropsCachingTest.testReadWriteCached
3 1.0 390 4 ZkFailoverTest.testRestartZkWhenClusterDown
3 1.8 393 7
ZkShardTermsTest.testParticipationOfReplicas
***********************Annotations report
*****************AwaitsFix Annotations:
************Lucene AwaitsFix
TestAllFilesDetectBitFlips.TestAllFilesDetectBitFlips suite
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-9356")
TestAllFilesDetectTruncation.TestAllFilesDetectTruncation suite
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-9409")
TestControlledRealTimeReopenThread.testCRTReopen
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5737")
TestICUNormalizer2CharFilter.testRandomStrings
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5595")
TestICUTokenizerCJK.TestICUTokenizerCJK suite
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8222")
TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-7161")
************Solr AwaitsFix
CdcrBidirectionalTest.testBiDir
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12524")
CdcrBootstrapTest.testBootstrapWithContinousIndexingOnSourceCluster
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12028")
CollectionsAPISolrJTest.testCreateAndDeleteShard
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13021")
ConcurrentCreateRoutedAliasTest.ConcurrentCreateRoutedAliasTest suite
@LuceneTestCase.AwaitsFix(bugUrl =
"https://issues.apache.org/jira/browse/SOLR-12386") // "Can't find resource"
LeaderTragicEventTest.LeaderTragicEventTest suite
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13237")
MoveReplicaHDFSTest.MoveReplicaHDFSTest suite
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13924")
MoveReplicaHDFSTest.testFailedMove
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12080") //
added 03-Oct-2018
RoutedAliasUpdateProcessorTest.alias,
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13696")
SSLMigrationTest.SSLMigrationTest suite
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") //
17-Mar-2018
SaslZkACLProviderTest.testSaslZkACLProvider
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13075")
SolrExporterIntegrationTest.SolrExporterIntegrationTest suite
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13786")
Tagger2Test.testStopWords
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-8344")
TestHierarchicalDocBuilder.testThreeLevelHierarchy
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12801") //
this test fails easily under beasting
TestImpersonationWithHadoopAuth.testForwarding
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/HADOOP-9893")
TestJsonFacetRefinement.testIndexAscRefineConsistency
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-14595")
TestJsonFacetRefinement.testProcessEmptyRefinement
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556")
TestJsonFacetRefinement.testSortedSubFacetRefinementWhenParentOnlyReturnedByOneShardProcessEmpty
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556")
TestLTRReRankingPipeline.testDifferentTopN
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-11134")
TestMinMaxOnMultiValuedField.testDoubleFieldCache
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709")
TestMinMaxOnMultiValuedField.testFloatFieldCache
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709")
TestMinMaxOnMultiValuedField.testIntFieldCache
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709")
TestMinMaxOnMultiValuedField.testLongFieldCache
@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709")
TestPullReplica.TestPullReplica suite
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
TestStressRecovery.TestStressRecovery suite
@LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
// 6-Sep-2018
TestTlogReplayVsRecovery.TestTlogReplayVsRecovery suite
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13486;https://issues.apache.org/jira/browse/SOLR-14183")
TimeRoutedAliasUpdateProcessorTest.testDateMathInStart
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13943")
TriLevelCompositeIdRoutingTest.test
@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13369")
*****************BadApple Annotations:
************Lucene BadApple
************Solr BadApple
MoveReplicaHDFSTest.testNormalFailedMove
@BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028") //
14-Oct-2018
SharedFSAutoReplicaFailoverTest.SharedFSAutoReplicaFailoverTest suite
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028")
// added 20-Jul-2018
TimeRoutedAliasUpdateProcessorTest.TimeRoutedAliasUpdateProcessorTest suite
@LuceneTestCase.BadApple(bugUrl =
"https://issues.apache.org/jira/browse/SOLR-13059")
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]