I’ve attached the full report, but this has been a _really_ ragged week. Take a 
look here for the gory details of what’s failing currently: 
http://fucit.org/solr-jenkins-reports/failure-report.html


The tests that have failed over the last 4 consecutive weeks are:

Failures in the last 4 reports..
   Report   Pct     runs    fails           test
     0123   0.6      784     10      
DimensionalRoutedAliasUpdateProcessorTest.testCatTime
     0123   5.6      743     56      
LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud
     0123  63.2      101     53      MoveReplicaHDFSTest.test
     0123   6.7       85      5      ShardSplitTest.testSplitWithChaosMonkey
     0123   2.4      714      9      SystemCollectionCompatTest.testBackCompat
     0123   9.4      795     47      
TestModelManagerPersistence.testFilePersistence
     0123   9.4      797     49      
TestModelManagerPersistence.testWrapperModelPersistence
     0123   1.5      724     10      TestStressLiveNodes.testStress
************ Will BadApple all tests above this line except ones listed at the 
top**************

Do the attachments even make it through?

DO NOT ENABLE LIST:
    MoveReplicaHDFSTest.testFailedMove
    MoveReplicaHDFSTest.testNormalFailedMove
    TestControlledRealTimeReopenThread.testCRTReopen
    TestICUNormalizer2CharFilter.testRandomStrings
    TestICUTokenizerCJK
    TestImpersonationWithHadoopAuth.testForwarding
    TestLTRReRankingPipeline.testDifferentTopN
    TestRandomChains


DO NOT ANNOTATE LIST
    CdcrBidirectionalTest.testBiDir
    IndexSizeTriggerTest.testMergeIntegration
    IndexSizeTriggerTest.testMixedBounds
    IndexSizeTriggerTest.testSplitIntegration
    IndexSizeTriggerTest.testTrigger
    InfixSuggestersTest.testShutdownDuringBuild
    ShardSplitTest.test
    ShardSplitTest.testSplitMixedReplicaTypes
    ShardSplitTest.testSplitWithChaosMonkey
    TestLatLonShapeQueries.testRandomBig
    TestRandomChains.testRandomChainsWithLargeStrings
    TestTriggerIntegration.testSearchRate

Processing file (History bit 3): HOSS-2019-12-09.csv
Processing file (History bit 2): HOSS-2019-12-02.csv
Processing file (History bit 1): HOSS-2019-11-25.csv
Processing file (History bit 0): HOSS-2019-11-18.csv


Number of AwaitsFix: 40 Number of BadApples: 8


Raw fail count by week totals, most recent week first (corresponds to bits):
Week: 0  had  1170 failures
Week: 1  had  83 failures
Week: 2  had  253 failures
Week: 3  had  56 failures


**Annotated tests that didn't fail in the last 4 weeks.

  **Tests removed from the next two lists because they were specified in 
'doNotEnable' in the properties file
     no tests removed

  **Annotations will be removed from the following tests because they haven't 
failed in the last 4 rollups.

  **Methods: 3
   FullSolrCloudDistribCmdsTest.test
   SolrZkClientTest.testSimpleUpdateACLs
   TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader


********Failures in Hoss' reports for the last 4 rollups.

There were 1427 unannotated tests that failed in Hoss' rollups. Ordered by the 
date I downloaded the rollup file, newest->oldest. See above for the dates the 
files were collected 
These tests were NOT BadApple'd or AwaitsFix'd
All tests that failed 4 weeks running will be BadApple'd unless there are 
objections

Failures in the last 4 reports..
   Report   Pct     runs    fails           test
     0123   0.6      784     10      
DimensionalRoutedAliasUpdateProcessorTest.testCatTime
     0123   5.6      743     56      
LegacyCloudClusterPropTest.testCreateCollectionSwitchLegacyCloud
     0123  63.2      101     53      MoveReplicaHDFSTest.test
     0123   6.7       85      5      ShardSplitTest.testSplitWithChaosMonkey
     0123   2.4      714      9      SystemCollectionCompatTest.testBackCompat
     0123   9.4      795     47      
TestModelManagerPersistence.testFilePersistence
     0123   9.4      797     49      
TestModelManagerPersistence.testWrapperModelPersistence
     0123   1.5      724     10      TestStressLiveNodes.testStress
************ Will BadApple all tests above this line except ones listed at the 
top**************



     012    1.6      542      9      RollingRestartTest.test
     012    8.7       78      9      Test2BPostings.test
     012    1.0      455      3      
TestDelegationWithHadoopAuth.testDelegationTokenRenew
     012   61.6      946    418      TestDictionary.testInvalidData
     012    1.6      529      4      
TestQueryingOnDownCollection.testQueryToDownCollectionShouldFailFast
     01     0.7      349      2      AssignBackwardCompatibilityTest.test
     01     0.6      386      2      ComputePlanActionTest.testNodeAdded
     01     1.4      353      3      
HealthCheckHandlerTest.testHealthCheckHandler
     01     2.2      350      4      
MissingSegmentRecoveryTest.testLeaderRecovery
     01     0.5      395      2      TestPackedInts.testPackedLongValues
     0 23  10.5      513     33      
TestCloudSearcherWarming.testRepFactor1LeaderStartup
     0 23   4.7      524     13      
TestSkipOverseerOperations.testSkipLeaderOperations
     0 2    0.8      311      3      
ScheduledTriggerIntegrationTest.testScheduledTrigger
     0 2    0.8      322      3      ShardSplitTest.testSplitShardWithRuleLink
     0 2    0.8      315      2      
TestPullReplicaErrorHandling.testCantConnectToLeader
     0 2    0.8      315      2      
TestPullReplicaErrorHandling.testCantConnectToPullReplica
     0 2   17.8      334     28      
TestSSLRandomization.testRandomizedSslAndClientAuth
     0 2    0.5      376      2      
TestSearcherManager.testConcurrentIndexCloseSearchAndRefresh
     0 2    5.0      303      7      TestSolrCloudWithKerberosAlt.testBasics
     0 2    0.6      352      3      TestWithCollection.testAddReplicaSimple
     0  3   5.0       44      2      
TestXYMultiPolygonShapeQueries.testRandomBig
     0      1.1      189      2      ArcTangentEvaluatorTest.noValue
     0      1.1      189      2      ArcTangentEvaluatorTest.nullValue
     0      1.1      189      2      ArcTangentEvaluatorTest.oneField
     0      0.5      188      1      ArrayEvaluatorTest.arrayLongSortAscTest
     0      0.5      188      1      ArrayEvaluatorTest.arrayLongSortDescTest
     0      0.5      188      1      ArrayEvaluatorTest.arrayStringSortAscTest
     0      0.5      188      1      ArrayEvaluatorTest.arrayStringSortDescTest
     0      0.5      188      1      ArrayEvaluatorTest.arrayStringUnsortedTest
     0      0.8      121      1      AutoAddReplicasPlanActionTest.testSimple
     0      0.8      129      1      BasicDistributedZk2Test.test
     0      0.7      137      1      
BlobRepositoryMockingTest.testGetBlobIncrRefByUrl
     0      1.1      189      2      
CloudHttp2SolrClientBuilderTest.testByDefaultConfiguresClientToSendUpdatesOnlyToShardLeaders
     0      1.1      189      2      
CloudHttp2SolrClientBuilderTest.testIsDirectUpdatesToLeadersOnlyDefault
     0      1.1      189      2      
CloudHttp2SolrClientBuilderTest.testSeveralZkHostsSpecifiedSingly
     0      1.1      189      2      
CloudHttp2SolrClientBuilderTest.testSeveralZkHostsSpecifiedTogether
     0      1.1      189      2      
CloudHttp2SolrClientBuilderTest.testSingleZkHostSpecified
     0      1.1      189      2      
CloudHttp2SolrClientMultiConstructorTest.testZkConnectionStringConstructorWithValidChroot
     0      0.5      188      1      CloudSolrClientBuilderTest.test0Timeouts
     0      0.5      188      1      
CloudSolrClientBuilderTest.testByDefaultConfiguresClientToSendUpdatesOnlyToShardLeaders
     0      0.5      188      1      
CloudSolrClientBuilderTest.testIsDirectUpdatesToLeadersOnlyDefault
     0      0.5      188      1      
CloudSolrClientBuilderTest.testSeveralZkHostsSpecifiedSingly
     0      0.5      188      1      
CloudSolrClientBuilderTest.testSeveralZkHostsSpecifiedTogether
     0      0.5      188      1      
CloudSolrClientBuilderTest.testSingleZkHostSpecified
     0      0.6      174      1      
ComputePlanActionTest.testNodeAddedTriggerWithAddReplicaPreferredOp_1Shard
     0      0.5      188      1      ConcatOperationTest.concatMultipleFields
     0      0.5      188      1      
ConcatOperationTest.concatMultipleFieldsExpression
     0      0.5      188      1      
ConcatOperationTest.concatMultipleFieldsWithIgnoredFields
     0      0.5      188      1      
ConcatOperationTest.concatMultipleFieldsWithIgnoredFieldsExpression
     0      0.5      188      1      ConcatOperationTest.concatSingleField
     0      0.5      188      1      
ConcatOperationTest.concatSingleFieldExpression
     0      0.5      188      1      ConcatOperationTest.concatWithNullValues
     0      0.5      188      1      
ConcatOperationTest.concatWithNullValuesExpression
     0      0.5      188      1      
ConcurrentUpdateSolrClientBuilderTest.testMissingQueueSize
     0      0.5      188      1      ConversionEvaluatorsTest.testCentimeters
     0      0.5      188      1      ConversionEvaluatorsTest.testInches
     0      0.5      188      1      
ConversionEvaluatorsTest.testInvalidExpression
     0      0.5      188      1      ConversionEvaluatorsTest.testKiloMeters
     0      0.5      188      1      ConversionEvaluatorsTest.testMeters
     0      0.5      188      1      ConversionEvaluatorsTest.testMiles
     0      0.5      188      1      ConversionEvaluatorsTest.testMillimeters
     0      0.5      188      1      ConversionEvaluatorsTest.testYards
     0      3.8      131      5      
CreateCollectionCleanupTest.testAsyncCreateCollectionCleanup
     0      3.8      131      5      
CreateCollectionCleanupTest.testCreateCollectionCleanup
     0      4.4      136      6      
DirectoryFactoryTest.testGetDataHomeByteBuffersDirectory
     0      4.4      136      6      
DirectoryFactoryTest.testGetDataHomeRAMDirectory
     0     23.1      156     36      
DocumentAnalysisRequestHandlerTest.testCharsetOutsideDocument
     0      0.5      188      1      EqualToEvaluatorTest.eqTwoBooleans
     0      0.5      188      1      EqualToEvaluatorTest.eqTwoIntegers
     0      0.5      188      1      EqualToEvaluatorTest.eqTwoStrings
     0      0.5      188      1      EqualToEvaluatorTest.operationFieldName
     0      1.6      190      3      ExclusiveOrEvaluatorTest.eorTwoBooleans
     0      1.6      190      3      
ExclusiveOrEvaluatorTest.eorWithSubAndsBooleans
     0     11.6      138     16      
HadoopSSLCredentialProviderTest.testGetCredentials
     0     20.2      188     38      
HdfsBackupRepositoryTest.testCopyBufferDefaultSize
     0     20.2      188     38      HdfsBackupRepositoryTest.testCopyBufferSet
     0     20.2      188     38      
HdfsBackupRepositoryTest.testHdfsHomePropertySet
     0      0.7      138      1      HealthCheckHandlerTest.testHealthCheckV2Api
     0     35.5      279     99      HttpReplicatorTest.testBasic
     0     35.7      280    100      HttpReplicatorTest.testServerErrors
     0     16.9      142     24      
JWTAuthPluginTest.initFromSecurityJSONUrlJwk
     0      0.5      188      1      JWTIssuerConfigTest.parseJwkSet
     0      0.5      188      1      
JWTIssuerConfigTest.wellKnownConfigNotReachable
     0      0.5      188      1      
LBHttpSolrClientTest.testLBHttpSolrClientHttpClientResponseParserStringArray
     0     18.8      144     27      
MBeansHandlerTest.testXMLDiffWithExternalEntity
     0     39.7      199     79      MetricsHistoryIntegrationTest.testGet
     0      0.5      188      1      OperationsTest.replaceFieldNullWithInt
     0      0.5      188      1      
OperationsTest.replaceFieldNullWithNonExistantField
     0      0.5      188      1      OperationsTest.replaceFieldNullWithString
     0      0.5      188      1      OperationsTest.replaceValueNullWithDouble
     0      0.5      188      1      OperationsTest.replaceValueNullWithFloat
     0      0.5      188      1      OperationsTest.replaceValueNullWithInt
     0      0.5      188      1      OperationsTest.replaceValueNullWithString
     0      1.1      189      2      OrEvaluatorTest.orTwoBooleans
     0      1.1      189      2      OrEvaluatorTest.orWithSubAndsBooleans
     0     24.5      163     40      OutputWriterTest.testTrivialXsltWriter
     0     24.5      163     40      
OutputWriterTest.testTrivialXsltWriterInclude
     0      0.5      188      1      PowerEvaluatorTest.powManyFieldsWithSubpows
     0      0.5      188      1      PowerEvaluatorTest.powTwoFieldWithNulls
     0      0.5      188      1      PowerEvaluatorTest.powTwoFieldsWithValues
     0      0.5      188      1      RawValueEvaluatorTest.rawTypes
     0      1.1      189      2      RecursiveEvaluatorTest.compoundTest
     0      0.5      188      1      RegressionEvaluatorTest.test
     0      0.7      142      1      ReplicationFactorTest.test
     0      0.5      188      1      ReverseEvaluatorTest.test
     0      0.5      188      1      RoundEvaluatorTest.noValue
     0      0.5      188      1      RoundEvaluatorTest.nullValue
     0      0.5      188      1      RoundEvaluatorTest.oneField
     0     11.7      137     16      
SSLConfigurationsTest.testGetClientKeyStorePasswordFromHadoopCredentialProvider
     0     11.7      137     16      
SSLConfigurationsTest.testGetClientTruststorePasswordFromHadoopCredentialProvider
     0     11.7      137     16      
SSLConfigurationsTest.testGetKeyStorePasswordFromHadoopCredentialProvider
     0     11.7      137     16      
SSLConfigurationsTest.testGetTruststorePasswordFromHadoopCredentialProvider
     0     11.7      137     16      
SSLConfigurationsTest.testHadoopCredentialProviderPrioritySysPropAndEnvVars
     0     11.7      137     16      
SSLConfigurationsTest.testSslConfigKeystorePwFromClientKeystoreHadoopCredentialProvider
     0     11.7      137     16      
SSLConfigurationsTest.testSslConfigKeystorePwFromKeystoreHadoopCredentialProvider
     0      2.8       36      1      
SearchRateTriggerIntegrationTest.testAboveSearchRate
     0      0.5      188      1      SineEvaluatorTest.noValue
     0      0.5      188      1      SineEvaluatorTest.nullValue
     0      0.5      188      1      SineEvaluatorTest.oneField
     0      1.1       95      1      
SoftAutoCommitTest.testSoftAndHardCommitMaxTimeMixedAdds
     0      1.1       95      1      
SoftAutoCommitTest.testSoftCommitWithinAndHardCommitMaxTimeRapidAdds
     0      0.5      188      1      SquareRootEvaluatorTest.noValue
     0      0.5      188      1      SquareRootEvaluatorTest.nullValue
     0      0.5      188      1      SquareRootEvaluatorTest.oneField
     0      0.5      188      1      
SubtractEvaluatorTest.subManyFieldsWithSubsubs
     0      0.5      188      1      
SubtractEvaluatorTest.subManyFieldsWithValues
     0      0.5      188      1      SubtractEvaluatorTest.subTwoFieldWithNulls
     0      0.5      188      1      
SubtractEvaluatorTest.subTwoFieldsWithMissingField
     0      0.5      188      1      SubtractEvaluatorTest.subTwoFieldsWithNull
     0      0.5      188      1      
SubtractEvaluatorTest.subTwoFieldsWithValues
     0      0.5      188      1      TemporalEvaluatorsTest.testAllFunctions
     0      0.5      188      1      TemporalEvaluatorsTest.testExplain
     0      0.5      188      1      
TemporalEvaluatorsTest.testFunctionsLocalDateTime
     0      0.5      188      1      TemporalEvaluatorsTest.testFunctionsOnDate
     0      0.5      188      1      
TemporalEvaluatorsTest.testFunctionsOnInstant
     0      0.5      188      1      TemporalEvaluatorsTest.testFunctionsOnLong
     0      0.5      188      1      
TemporalEvaluatorsTest.testInvalidExpression
     0      0.5      188      1      TemporalEvaluatorsTest.testInvalidValues
     0      0.5      188      1      TemporalEvaluatorsTest.testLimitedFunctions
     0     35.8      288    103      Test64kAffixes.test
     0      0.5      192      1      
TestAssertingDocValuesFormat.testSparseLongNumericsVsStoredFields
     0     36.1      280    101      TestCharBlockArray.testArray
     0     35.7      283    101      TestDemo.testDemo
     0     26.8      414    111      
TestDictionary.testCompressedBeforeSetDictionary
     0     26.8      414    111      TestDictionary.testCompressedDictionary
     0     26.8      414    111      
TestDictionary.testCompressedEmptyAliasDictionary
     0     26.8      414    111      TestDictionary.testInvalidFlags
     0     26.8      414    111      TestDictionary.testResourceCleanup
     0     26.8      414    111      TestDictionary.testSimpleDictionary
     0     23.5      230     54      TestFreeTextSuggester.testBasic
     0     22.1      226     50      TestFreeTextSuggester.testEmptyString
     0     18.9      217     41      TestFreeTextSuggester.testEndingHole
     0     21.4      224     48      
TestFreeTextSuggester.testIllegalByteDuringBuild
     0     24.1      232     56      
TestFreeTextSuggester.testIllegalByteDuringQuery
     0     22.1      226     50      TestFreeTextSuggester.testNoDupsAcrossGrams
     0     16.6      211     35      TestFreeTextSuggester.testRandom
     0     25.1      235     59      TestFreeTextSuggester.testTwoEndingHoles
     0     23.5      230     54      TestFreeTextSuggester.testUnigrams
     0     35.7      283    101      TestHandleLimitFS.testTooManyOpenFiles
     0     37.3      292    109      TestHunspellStemFilterFactory.testStemming
     0      0.5      192      1      
TestPerFieldDocValuesFormat.testSparseLongNumericsVsStoredFields
     0     24.8      246     61      TestPerfTasksParse.testParseExamples
     0      9.6      229     22      TestRandomChains.testRandomChains
     0     10.9      229     25      
TestRandomChains.testRandomChainsWithLargeStrings
     0     20.1      139     28      
TestSolrCLIRunExample.testTechproductsExample
     0     24.5      241     59      TestTestFramework.spatialExample
     0     24.8      242     60      TestTestFramework.testQueries
     0     28.7      254     73      
TestXLSXResponseWriter.testForDVEnabledFields
     0     28.7      254     73      TestXLSXResponseWriter.testPseudoFields
     0     28.7      254     73      
TestXLSXResponseWriter.testStructuredDataViaBaseWriters
     0     36.0      325    117      TestXPathEntityProcessor.testMultiValued
     0     11.7      325     38      
TestXPathEntityProcessor.withDefaultSolrAndXsl
     0     41.8      297    124      TestXPathRecordReader.testError
     0      2.4      125      3      TransactionLogTest.testUUID
     0      1.1      189      2      UniformDistributionEvaluatorTest.test
     0      0.5      188      1      UuidEvaluatorTest.testUuid
     0     27.9      154     43      
XmlUpdateRequestHandlerTest.testExternalEntities
     0     27.9      154     43      XmlUpdateRequestHandlerTest.testNamedEntity
     0     23.4      158     37      XsltUpdateRequestHandlerTest.testEntities
     0     23.4      158     37      XsltUpdateRequestHandlerTest.testUpdate
      123  16.7      623     64      BasicAuthIntegrationTest.testBasicAuth
      123   0.5      577      3      
ChaosMonkeyNothingIsSafeWithPullReplicasTest.test
      123   1.8      614     15      
DimensionalRoutedAliasUpdateProcessorTest.testTimeCat
      123   8.0       69      4      HdfsBasicDistributedZkTest.test
      123   0.5      584      3      
TestSimpleTextTermVectorsFormat.testRamBytesUsed
      123   0.5      487      8      TestSolrCachePerf.testGetPutCompute
      123   0.5      538      3      TestTlogReplica.testKillLeader
      12    1.4      399      5      LeaderFailoverAfterPartitionTest.test
      12    0.9      400      4      LeaderVoteWaitTimeoutTest.basicTest
      12   27.6       57     12      StressHdfsTest.test
      12    0.5      368      4      TestPackages.testPluginLoading
      12   34.4       70     22      TestXYPolygonShapeQueries.testRandomBig
      1 3   2.3      401      8      SplitShardTest.testLiveSplit
      1     0.5      212      1      AutoScalingHandlerTest.testReadApi
      1     0.5      212      1      
AutoScalingHandlerTest.testSuggestionsWithPayload
      1     0.5      210      1      AutoscalingHistoryHandlerTest.testHistory
      1     0.5      213      1      
CollectionsAPISolrJTest.testReadOnlyCollection
      1     0.5      215      1      
ConfusionMatrixGeneratorTest.testGetConfusionMatrixWithFLTKNN
      1     4.8       21      1      
ForceLeaderWithTlogReplicasTest.testReplicasInLowerTerms
      1     4.3       23      1      HdfsChaosMonkeyNothingIsSafeTest.test
      1     0.5      210      1      HttpPartitionTest.test
      1     0.5      214      1      ShardSplitTest.testSplitShardWithRule
      1     0.5      212      1      
TestBugInSomething.testUnicodeShinglesAndNgrams
      1     0.9      211      2      
TestFieldCacheSortRandom.testRandomStringSort
      1     0.9      211      2      
TestFieldCacheSortRandom.testRandomStringValSort
      1     0.6      166      1      
TestHdfsCloudBackupRestore.testRestoreFailure
      1     0.5      211      1      TestIndexWriterDelete.testDeletesOnDiskFull
      1     1.2      259      3      
TestLRUQueryCache.testBooleanQueryCachesSubClauses
      1    20.0       75     15      
TestLRUQueryCache.testLRUConcurrentCachingAcrossSegments
      1     5.3       75      4      
TestLRUQueryCache.testLRUConcurrentLoadAndEviction
      1    34.7       75     26      
TestLRUQueryCache.testLRUConcurrentLoadsOfSameQuery
      1     1.2      241      3      
TestLRUQueryCache.testSkipCachingForTermQuery
      1     1.4      216      3      TestLatLonDocValuesQueries.testAllLatEqual
      1     1.4      216      3      
TestLatLonDocValuesQueries.testLowCardinality
      1     1.9      212      4      TestLatLonPointQueries.testRandomMedium
      1     0.9      214      2      
TestLatLonPointShapeQueries.testRandomMedium
      1     0.5      214      1      
TestLucene80DocValuesFormat.testSortedNumericBlocksOfVariousBitsPerValue
      1     0.5      213      1      
TestLucene80DocValuesFormat.testSparseLongNumericsVsStoredFields
      1     0.5      213      1      
TestLucene80DocValuesFormat.testSparseNumericBlocksOfVariousBitsPerValue
      1     0.5      214      1      
TestLucene80DocValuesFormat.testSparseSortedNumericBlocksOfVariousBitsPerValue
      1     4.0      150      6      
TestPhraseWildcardQuery.testOneSingleTermTwoMultiTerms
      1     0.5      211      1      TestRestoreCore.testFailedRestore
      1     0.5      216      1      
TestXYMultiLineShapeQueries.testLowCardinalityShapeManyTimes
      1     3.4       29      1      
TimeRoutedAliasUpdateProcessorTest.testPreemptiveCreation
       23   0.5      366      3      HttpPartitionWithTlogReplicasTest.test
       23   0.5      370      2      
ReindexCollectionTest.testSameTargetReindexing
       23   0.5      367      2      
TestPullReplicaErrorHandling.testPullReplicaDisconnectsFromZooKeeper
       2    0.5      183      1      AliasIntegrationTest.test
       2    0.5      183      1      
AliasIntegrationTest.testClusterStateProviderAPI
       2    0.5      183      1      
AliasIntegrationTest.testDeleteAliasWithExistingCollectionName
       2    0.5      183      1      
AliasIntegrationTest.testDeleteOneOfTwoCollectionsAliased
       2    0.5      183      1      AliasIntegrationTest.testErrorChecks
       2    0.5      183      1      
AliasIntegrationTest.testModifyPropertiesCAR
       2    0.5      183      1      AliasIntegrationTest.testModifyPropertiesV1
       2    0.5      183      1      AliasIntegrationTest.testModifyPropertiesV2
       2    0.5      183      1      AliasIntegrationTest.testProperties
       2    0.5      182      1      
AsyncCallRequestStatusResponseTest.testAsyncCallStatusResponse
       2    0.6      170      1      AuditLoggerIntegrationTest.authValid
       2    0.5      185      1      
AuditLoggerIntegrationTest.searchWithException
       2    0.5      185      1      
CdcrBootstrapTest.testBootstrapWithMultipleReplicas
       2    1.1      185      2      ChaosMonkeySafeLeaderTest.test
       2    0.5      184      1      CloudHttp2SolrClientRetryTest.testRetry
       2    0.5      184      1      
CloudHttp2SolrClientTest.checkCollectionParameters
       2    0.5      184      1      
CloudHttp2SolrClientTest.preferLocalShardsTest
       2    0.5      184      1      
CloudHttp2SolrClientTest.preferReplicaTypesTest
       2    0.5      184      1      
CloudHttp2SolrClientTest.stateVersionParamTest
       2    0.5      184      1      CloudHttp2SolrClientTest.testAliasHandling
       2    0.5      184      1      
CloudHttp2SolrClientTest.testInitializationWithSolrUrls
       2    0.5      184      1      
CloudHttp2SolrClientTest.testNonRetryableRequests
       2    0.5      184      1      
CloudHttp2SolrClientTest.testOverwriteOption
       2    0.5      184      1      
CloudHttp2SolrClientTest.testParallelUpdateQTime
       2    0.5      184      1      
CloudHttp2SolrClientTest.testRetryUpdatesWhenClusterStateIsStale
       2    0.5      184      1      CloudHttp2SolrClientTest.testRouting
       2    0.5      184      1      
CloudHttp2SolrClientTest.testVersionsAreReturned
       2    0.5      184      1      CloudSolrClientRetryTest.testRetry
       2    0.5      184      1      
CloudSolrClientTest.checkCollectionParameters
       2    0.5      184      1      CloudSolrClientTest.preferLocalShardsTest
       2    0.5      184      1      CloudSolrClientTest.preferReplicaTypesTest
       2    0.5      184      1      CloudSolrClientTest.stateVersionParamTest
       2    0.5      184      1      CloudSolrClientTest.testAliasHandling
       2    0.5      184      1      
CloudSolrClientTest.testInitializationWithSolrUrls
       2    0.5      184      1      
CloudSolrClientTest.testNonRetryableRequests
       2    0.5      184      1      CloudSolrClientTest.testOverwriteOption
       2    0.5      184      1      CloudSolrClientTest.testParallelUpdateQTime
       2    0.5      184      1      CloudSolrClientTest.testPing
       2    0.5      184      1      
CloudSolrClientTest.testRetryUpdatesWhenClusterStateIsStale
       2    0.5      184      1      CloudSolrClientTest.testRouting
       2    0.5      184      1      CloudSolrClientTest.testVersionsAreReturned
       2    0.5      183      1      
CollectionReloadTest.testReloadedLeaderStateAfterZkSessionLoss
       2    0.6      181      1      CollectionTooManyReplicasTest.testAddShard
       2    0.6      181      1      
CollectionTooManyReplicasTest.testAddTooManyReplicas
       2    0.6      181      1      
CollectionTooManyReplicasTest.testDownedShards
       2    0.5      183      1      
CollectionsAPIAsyncDistributedZkTest.testAsyncRequests
       2    0.5      183      1      
CollectionsAPIAsyncDistributedZkTest.testSolrJAPICalls
       2    0.5      184      1      
ConcurrentUpdateHttp2SolrClientMultiCollectionTest.testEnsureDocumentsSentToCorrectCollection
       2    0.5      184      1      
ConcurrentUpdateSolrClientMultiCollectionTest.testEnsureDocumentsSentToCorrectCollection
       2    0.6      180      1      DaemonStreamApiTest.testAPIs
       2    0.5      183      1      DistribCursorPagingTest.test
       2    0.5      183      1      ExecutePlanActionTest.testExecute
       2    0.5      183      1      ExecutePlanActionTest.testIntegration
       2    0.5      183      1      ExecutePlanActionTest.testTaskFail
       2    0.5      183      1      ExecutePlanActionTest.testTaskTimeout
       2    0.6      181      1      LeaderFailureAfterFreshStartTest.test
       2    0.5      186      1      
LeaderVoteWaitTimeoutTest.testMostInSyncReplicasCanWinElection
       2    0.5      184      1      LegacyFieldFacetCloudTest.countTest
       2    0.5      184      1      LegacyFieldFacetCloudTest.maxTest
       2    0.5      184      1      LegacyFieldFacetCloudTest.meanTest
       2    0.5      184      1      
LegacyFieldFacetCloudTest.medianFacetAscTest
       2    0.5      184      1      LegacyFieldFacetCloudTest.minTest
       2    0.5      184      1      LegacyFieldFacetCloudTest.missingFacetTest
       2    0.5      184      1      LegacyFieldFacetCloudTest.missingTest
       2    0.5      184      1      LegacyFieldFacetCloudTest.multiValueTest
       2    0.5      184      1      LegacyFieldFacetCloudTest.perc20Test
       2    0.5      184      1      LegacyFieldFacetCloudTest.perc60Test
       2    0.5      184      1      
LegacyFieldFacetCloudTest.stddevFacetAscTest
       2    0.5      184      1      LegacyFieldFacetCloudTest.sumTest
       2    0.5      184      1      LegacyFieldFacetCloudTest.uniqueTest
       2    0.5      184      1      LegacyFieldFacetExtrasCloudTest.limitTest
       2    0.5      184      1      LegacyFieldFacetExtrasCloudTest.offsetTest
       2    0.5      184      1      LegacyFieldFacetExtrasCloudTest.sortTest
       2    0.5      184      1      LegacyNoFacetCloudTest.countTest
       2    0.5      184      1      LegacyNoFacetCloudTest.maxTest
       2    0.5      184      1      LegacyNoFacetCloudTest.meanTest
       2    0.5      184      1      LegacyNoFacetCloudTest.medianTest
       2    0.5      184      1      LegacyNoFacetCloudTest.minTest
       2    0.5      184      1      LegacyNoFacetCloudTest.missingDefaultTest
       2    0.5      184      1      LegacyNoFacetCloudTest.perc20Test
       2    0.5      184      1      LegacyNoFacetCloudTest.perc60Test
       2    0.5      184      1      LegacyNoFacetCloudTest.stddevTest
       2    0.5      184      1      LegacyNoFacetCloudTest.sumTest
       2    0.5      184      1      LegacyNoFacetCloudTest.uniqueTest
       2    0.5      184      1      LegacyQueryFacetCloudTest.queryTest
       2    0.5      184      1      LegacyRangeFacetCloudTest.hardendRangeTest
       2    0.5      184      1      LegacyRangeFacetCloudTest.multiGapTest
       2    0.5      184      1      LegacyRangeFacetCloudTest.rangeTest
       2    0.5      182      1      
MigrateRouteKeyTest.multipleShardMigrateTest
       2    0.5      182      1      MigrateRouteKeyTest.testMissingSplitKey
       2    0.5      185      1      OverseerModifyCollectionTest.testModifyColl
       2    0.5      185      1      PeerSyncReplicationTest.test
       2    1.1      184      2      RoutingToNodesWithPropertiesTest.test
       2    0.5      183      1      RulesTest.doIntegrationTest
       2    1.1      184      2      RulesTest.testHostFragmentRule
       2    0.5      183      1      RulesTest.testModifyColl
       2    1.1      184      2      RulesTest.testPortRule
       2    1.1      184      2      
RulesTest.testPortRuleInPresenceOfClusterPolicy
       2    0.5      184      1      SearchHandlerTest.testRequireZkConnected
       2    0.5      184      1      
SearchHandlerTest.testRequireZkConnectedDistrib
       2    0.5      184      1      SearchHandlerTest.testZkConnected
       2    0.6      181      1      SearchRateTriggerTest.testWaitForElapsed
       2    0.5      184      1      ShardRoutingTest.test
       2    0.5      183      1      SimpleCollectionCreateDeleteTest.test
       2    0.5      184      1      SolrZkClientTest.testWrappingWatches
       2    0.5      182      1      SplitByPrefixTest.doTest
       2    3.5      198      7      SyncSliceTest.test
       2    0.5      184      1      TestAuthenticationFramework.testBasics
       2    0.5      184      1      
TestCloudCollectionsListeners.testCollectionDeletion
       2    0.5      184      1      
TestCloudCollectionsListeners.testSimpleCloudCollectionsListener
       2    0.5      184      1      
TestCloudCollectionsListeners.testWatchesWorkForBothStateFormats
       2    0.5      192      1      
TestCloudSearcherWarming.testPeersyncFailureReplicationSuccess
       2    0.5      183      1      TestCollectionAPI.test
       2    0.5      183      1      
TestCollectionAPI.testRecreateCollectionAfterFailure
       2    0.5      184      1      
TestCollectionStateWatchers.testCanWaitForNonexistantCollection
       2    0.5      184      1      
TestCollectionStateWatchers.testCollectionWatchWithShutdownOfActiveNode
       2    0.5      184      1      
TestCollectionStateWatchers.testCollectionWatchWithShutdownOfUnusedNode
       2    0.5      184      1      
TestCollectionStateWatchers.testDeletionsTriggerWatches
       2    0.5      184      1      
TestCollectionStateWatchers.testLiveNodeChangesTriggerWatches
       2    0.5      184      1      
TestCollectionStateWatchers.testWaitForStateChecksCurrentState
       2    0.5      184      1      
TestCollectionStateWatchers.testWaitForStateWatcherIsRetainedOnPredicateFailure
       2    0.5      184      1      
TestCollectionStateWatchers.testWatchesWorkForStateFormat1
       2    0.5      183      1      
TestCustomStream.testDynamicLoadingCustomStream
       2    1.1      185      2      TestDistribDocBasedVersion.test
       2    0.5      183      1      TestDistribIDF.testMultiCollectionQuery
       2    0.5      183      1      TestDistribIDF.testSimpleQuery
       2    0.5      184      1      
TestDocCollectionWatcher.testDeletionsTriggerWatches
       2    0.5      184      1      
TestDocCollectionWatcher.testWaitForStateChecksCurrentState
       2    0.5      184      1      
TestDocCollectionWatcher.testWaitForStateWatcherIsRetainedOnPredicateFailure
       2    0.5      184      1      
TestDocCollectionWatcher.testWatchesWorkForStateFormat1
       2    0.5      184      1      
TestDownShardTolerantSearch.searchingShouldFailWithoutTolerantSearchSetToTrue
       2    0.5      183      1      TestDynamicLoading.testDynamicLoading
       2    0.6      181      1      TestDynamicLoadingUrl.testDynamicLoadingUrl
       2    7.5      200     15      TestInPlaceUpdatesDistrib.test
       2    0.5      184      1      TestLTROnSolrCloud.testSimpleQuery
       2    0.5      188      1      
TestLucene50TermVectorsFormat.testRamBytesUsed
       2    5.3       19      1      
TestLucene70NormsFormat.testSparseNCommonBig
       2    0.5      185      1      
TestLucene80DocValuesFormat.testRandomAdvanceBinary
       2    0.5      185      1      
TestLucene80DocValuesFormat.testTermsEnumLongSharedPrefixes
       2    0.6      173      1      TestPackages.testAPI
       2    0.5      183      1      TestPrepRecovery.testLeaderNotResponding
       2    0.5      183      1      TestPrepRecovery.testLeaderUnloaded
       2    0.5      183      1      TestRecovery.testExistOldBufferLog
       2    0.5      183      1      TestSolrConfigHandlerCloud.test
       2    0.5      184      1      TestV2Request.testCloudSolrClient
       2    0.5      184      1      TestV2Request.testHttpSolrClient
       2    0.5      184      1      TestV2Request.testV2Forwarding
       2    1.1      185      2      TestWithCollection.testAddReplicaWithPolicy
       2    1.1      185      2      TestWithCollection.testCreateCollection
       2    1.1      185      2      
TestWithCollection.testCreateCollectionNoWithCollection
       2    1.1      185      2      TestWithCollection.testDeleteWithCollection
       2    1.1      185      2      
TestWithCollection.testMoveReplicaMainCollection
       2    1.1      185      2      
TestWithCollection.testMoveReplicaWithCollection
       2    1.1      185      2      
TestWithCollection.testMultipleWithCollections
       2    1.1      185      2      TestWithCollection.testNodeAdded
       2    0.5      184      1      
TestZKPropertiesWriter.testZKPropertiesWriter
       2    0.5      187      1      ZkConfigFilesTest.testCanUploadConfigToZk
        3   0.5      184      1      AnalyticsMergeStrategyTest.test
        3   0.6      181      1      BasicAuthOnSingleNodeTest.basicTest
        3   0.6      180      1      
ChaosMonkeySafeLeaderWithPullReplicasTest.test
        3   0.6      179      1      
CollectionsAPISolrJTest.testCreateCollWithDefaultClusterPropertiesNewFormat
        3   0.5      185      1      DistributedIntervalFacetingTest.test
        3   0.5      182      1      ExitableDirectoryReaderTest.testPrefixQuery
        3   0.6      181      1      GraphExpressionTest.testScoreNodesStream
        3   5.3       19      1      
HdfsTlogReplayBufferedWhileIndexingTest.test
        3   0.5      182      1      MathExpressionTest.testZipFDistribution
        3  57.6      132     76      PackageManagerCLITest.testPackageManager
        3   4.8       21      1      RestartWhileUpdatingTest.test
        3   0.6      178      1      
ShardSplitTest.testSplitMixedReplicaTypesLink
        3   0.6      177      1      
SpellCheckCollatorTest.testEstimatedHitCounts
        3   1.1      182      2      
TestBlockJoin.testMultiChildQueriesOfDiffParentLevels
        3   1.1      184      2      
TestConcurrentMergeScheduler.testFlushExceptions
        3   0.5      184      1      TestDistributedGrouping.test
        3   0.5      183      1      TestDistributedMissingSort.test
        3  18.2      121     22      TestFstDirectAddressing.testDeDupTails
        3   0.8      131      1      TestHdfsCloudBackupRestore.test
        3   0.6      181      1      TestIndexWriterDelete.testUpdatesOnDiskFull
        3   0.6      181      1      
TestLucene80DocValuesFormat.testSortedNumericsSingleValuedVsStoredFields
        3   3.3      120      4      TestReplicationHandler.testEmptyBackups
        3   0.6      168      1      TestSimScenario.testSuggestions
        3   1.1       87      1      TestTlogReplica.testKillTlogReplica
        3   0.6      174      1      TestTlogReplica.testRealTimeGet
        3   9.4       32      3      
TimeRoutedAliasUpdateProcessorTest.testDateMathInStart



***********************Annotations report
   Number of AwaitsFix: 40 Number of BadApples: 8

*****************AwaitsFix Annotations:


************Lucene AwaitsFix
TestControlledRealTimeReopenThread.testCRTReopen
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5737";)

TestICUNormalizer2CharFilter.testRandomStrings
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5595";)

TestICUTokenizerCJK.TestICUTokenizerCJK suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8222";)

TestMoreLikeThis.testMultiFieldShouldReturnPerFieldBooleanQuery
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-7161";)


    ************Solr AwaitsFix
AutoAddReplicasIntegrationTest.testRapidStopStartStopWithPropChange
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13811";)

CdcrBidirectionalTest.testBiDir
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12524";)

CdcrBootstrapTest.testBootstrapWithContinousIndexingOnSourceCluster
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12028";)

CollectionsAPISolrJTest.testCreateAndDeleteShard
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13021";)

ComputePlanActionTest.testNodeLost
   
@LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

ConcurrentCreateRoutedAliasTest.ConcurrentCreateRoutedAliasTest suite
   @LuceneTestCase.AwaitsFix(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-12386";) // "Can't find resource"

LeaderTragicEventTest.LeaderTragicEventTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13237";)

MoveReplicaHDFSTest.MoveReplicaHDFSTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13924";)

MoveReplicaHDFSTest.testFailedMove
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12080";) // 
added 03-Oct-2018

ReplaceNodeNoTargetTest.ReplaceNodeNoTargetTest suite
   @LuceneTestCase.AwaitsFix(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-11067";)

ReplaceNodeNoTargetTest.test
   @LuceneTestCase.AwaitsFix(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-11067";)

SSLMigrationTest.SSLMigrationTest suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
17-Mar-2018

SaslZkACLProviderTest.testSaslZkACLProvider
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-13075";)

ScheduledMaintenanceTriggerTest.testInactiveShardCleanup
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
17-Mar-2018

ScheduledTriggerTest.testTrigger
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
added 20-Sep-2018

SearchRateTriggerIntegrationTest.testDeleteNode
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13163";)

SearchRateTriggerTest.testTrigger
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

SolrExporterIntegrationTest.SolrExporterIntegrationTest suite
   
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13786";)

Tagger2Test.testStopWords
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-8344";)

TestCollapseQParserPlugin.testStringCollapse
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-11974";)

TestHierarchicalDocBuilder.testThreeLevelHierarchy
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12801";) // 
this test fails easily under beasting

TestImpersonationWithHadoopAuth.testForwarding
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/HADOOP-9893";)

TestJsonFacetRefinement.testProcessEmptyRefinement
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556";)

TestJsonFacetRefinement.testSortedSubFacetRefinementWhenParentOnlyReturnedByOneShardProcessEmpty
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12556";)

TestLTRReRankingPipeline.testDifferentTopN
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-11134";)

TestMinMaxOnMultiValuedField.testDoubleFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestMinMaxOnMultiValuedField.testFloatFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestMinMaxOnMultiValuedField.testIntFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestMinMaxOnMultiValuedField.testLongFieldCache
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709";)

TestPullReplica.TestPullReplica suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)

TestSimComputePlanAction.testNodeLost
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-12028";) // 
if you beast this, eventually you will see

TestSimExtremeIndexing.TestSimExtremeIndexing suite
   
@org.apache.lucene.util.LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12923";)

TestSimLargeCluster.testBasic
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
this test hits a timeout easily

TestStressRecovery.TestStressRecovery suite
   
@LuceneTestCase.AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // 6-Sep-2018

TimeRoutedAliasUpdateProcessorTest.testDateMathInStart
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13943";)

TriLevelCompositeIdRoutingTest.test
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-13369";)



*****************BadApple Annotations:

************Lucene BadApple

************Solr BadApple
FullSolrCloudDistribCmdsTest.test
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
annotated on: 24-Dec-2018

MoveReplicaHDFSTest.testNormalFailedMove
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
14-Oct-2018

MultiThreadedOCPTest.test
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
annotated on: 24-Dec-2018

SharedFSAutoReplicaFailoverTest.SharedFSAutoReplicaFailoverTest suite
   
@LuceneTestCase.BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";)
 // added 20-Jul-2018

SolrZkClientTest.testSimpleUpdateACLs
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
annotated on: 24-Dec-2018

TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader
   @BadApple(bugUrl="https://issues.apache.org/jira/browse/SOLR-12028";) // 
6-Sep-2018

TimeRoutedAliasUpdateProcessorTest.TimeRoutedAliasUpdateProcessorTest suite
   @LuceneTestCase.BadApple(bugUrl = 
"https://issues.apache.org/jira/browse/SOLR-13059";)


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to