subject:"Weekly BadApple report\:"

Weekly BadApple report

2018-08-06 Thread Erick Erickson

**Annotated tests/suites that didn't fail in the last 4 weeks.

  **Annotations will be removed from the following tests because they
haven't failed in the last 4 rollups.

  **Methods: 8
   BasicAuthIntegrationTest.testBasicAuth
   CollectionsAPIAsyncDistributedZkTest.testAsyncRequests
   MoveReplicaHDFSTest.testNormalFailedMove
   MoveReplicaTest.testFailedMove
   SaslZkACLProviderTest.testSaslZkACLProvider
   SolrRrdBackendFactoryTest.testBasic
   TestLocalFSCloudBackupRestore
   TestPullReplicaErrorHandling.throws

  **Suites: 0


Failures in Hoss' reports for the last 4 rollups.

These tests were NOT BadApple'd or AwaitsFix'd
All tests that failed 4 weeks running will be BadApple'd unless there
are objections

Failures in the last 4 reports..
   Report   Pct runsfails   test
 0123   2.5 1475 34  ChaosMonkeyNothingIsSafeTest(suite)
 0123   2.5 1660 22
CollectionsAPIDistributedZkTest.testCollectionsAPI
 0123   0.3 1658 15
CustomCollectionTest.testRouteFieldForHashRouter
 0123   0.5 1619  6
DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplica
 0123   0.5 1635 12
DeleteShardTest.testDirectoryCleanupAfterDeleteShard
 0123   7.2 1475 42  GraphTest(suite)
 0123   0.5 1618  8
LIRRollingUpdatesTest.testNewLeaderAndMixedReplicas
 0123   0.3 1618  5
LIRRollingUpdatesTest.testNewLeaderOldReplica
 0123   0.3 1618  5
LIRRollingUpdatesTest.testNewReplicaOldLeader
 0123   2.2 1659 15  LeaderTragicEventTest(suite)
 0123   5.0 1451 68  MoveReplicaHDFSTest.testFailedMove
 0123   3.0 1587 45  SchemaApiFailureTest(suite)
 0123   0.3 1596 10  TestCloudRecovery(suite)
 0123   2.9  134  7
TestGenericDistributedQueue.testDistributedQueue
 0123   3.1 1309 46  TestHdfsCloudBackupRestore.test
 0123   1.7 1426 25  TestHdfsUpdateLog(suite)
 0123   4.3 1474 27  TestLTROnSolrCloud(suite)
 0123   0.4 1448 47  TestLocalFSCloudBackupRestore.test
 0123   3.4 1462 98  TestSQLHandler(suite)
 0123   0.3 1601  7  TestTlogReplica(suite)
 0123  25.0  132 42  TestTlogReplica.testCreateDelete
 0123  14.3 1280164
TestTriggerIntegration.testNodeLostTriggerRestoreState
DO NOT ENABLE LIST:
'IndexSizeTriggerTest.testMergeIntegration'
'IndexSizeTriggerTest.testMixedBounds'
'IndexSizeTriggerTest.testSplitIntegration'
'IndexSizeTriggerTest.testTrigger'
'TestControlledRealTimeReopenThread.testCRTReopen'
'TestICUNormalizer2CharFilter.testRandomStrings'
'TestICUTokenizerCJK'
'TestImpersonationWithHadoopAuth.testForwarding'
'TestLTRReRankingPipeline.testDifferentTopN'
'TestRandomChains'


DO NOT ANNOTATE LIST
CdcrBidirectionalTest.testBiDir
InfixSuggestersTest.testShutdownDuringBuild
ShardSplitTest.test
ShardSplitTest.testSplitMixedReplicaTypes
ShardSplitTest.testSplitWithChaosMonkey
TestLatLonShapeQueries.testRandomBig
TestRandomChains.testRandomChainsWithLargeStrings

Processing file (History bit 3): HOSS-2018-08-06.csv
Processing file (History bit 2): HOSS-2018-07-30.csv
Processing file (History bit 1): HOSS-2018-07-23.csv
Processing file (History bit 0): HOSS-2018-07-16.csv


**Annotated tests/suites that didn't fail in the last 4 weeks.

  **Tests and suites removed from the next two lists because they were 
specified in 'doNotEnable' in the properties file
 no tests removed

  **Annotations will be removed from the following tests because they haven't 
failed in the last 4 rollups.

  **Methods: 8
   BasicAuthIntegrationTest.testBasicAuth
   CollectionsAPIAsyncDistributedZkTest.testAsyncRequests
   MoveReplicaHDFSTest.testNormalFailedMove
   MoveReplicaTest.testFailedMove
   SaslZkACLProviderTest.testSaslZkACLProvider
   SolrRrdBackendFactoryTest.testBasic
   TestLocalFSCloudBackupRestore
   TestPullReplicaErrorHandling.throws

  **Suites: 0


Failures in Hoss' reports for the last 4 rollups.

There were 830 unannotated tests that failed in Hoss' rollups. Ordered by the 
date I downloaded the rollup file, newest->oldest. See above for the dates the 
files were collected 
These tests were NOT BadApple'd or AwaitsFix'd
All tests that failed 4 weeks running will be BadApple'd unless there are 
objections

Failures in the last 4 reports..
   Report   Pct runsfails   test
 0123   9.5 1913248  CdcrBidirectionalTest.testBiDir
 0123   2.5 1475 34  ChaosMonkeyNothingIsSafeTest(suite)
 0123   2.5 1660 22  
CollectionsAPIDistributedZkTest.testCollectionsAPI
 0123   0.3 1658 15  
CustomCollectionTest.testRouteFieldForHashRouter
 0123   0.5 1619  6  
DeleteReplicaTest.raceConditionOnDeleteAndRegisterReplica
 0123   0.5 1635 12

Re: Weekly BadApple report

2018-07-23 Thread David Smiley

Ah, @LogLevel -- fantastic

On Mon, Jul 23, 2018 at 8:28 PM Erick Erickson 
wrote:

> David:
>
> I put it in my "do not BadApple" list. Beasting that test on my Mac
> Pro, 350 iterations or so and no failures FWIW.
>
> Erick
>
> On Mon, Jul 23, 2018 at 2:26 PM, Varun Thacker  wrote:
> > David TestLogLevelAnnotations might help you?
> >
> > On Mon, Jul 23, 2018 at 2:22 PM, David Smiley 
> > wrote:
> >>
> >> Thanks for these reports Erick!
> >>
> >> Please don't BadApple TimeRoutedAliasUpdateProcessorTest.  Failures seem
> >> rare.  At least in the last week, only one of two I consider genuine.
> >>
> >> How can I configure expanded logging but only for one test suite?
> >>
> >> ~ David
> >>
> >> On Mon, Jul 23, 2018 at 4:19 PM Erick Erickson  >
> >> wrote:
> >>>
> >>> Full report attached
> >>>
> >>> **Annotated tests/suites that didn't fail in the last 4 weeks.
> >>>
> >>>   **Annotations will be removed from the following tests because they
> >>> haven't failed in the last 4 rollups.
> >>>
> >>>   **Methods: 10
> >>>AddReplicaTest.test
> >>>HdfsChaosMonkeyNothingIsSafeTest
> >>>MaxSizeAutoCommitTest
> >>>PeerSyncReplicationTest.test
> >>>RecoveryZkTest.test
> >>>RollingRestartTest.test
> >>>SearchRateTriggerTest.testTrigger
> >>>TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader
> >>>TestLargeCluster.testSearchRate
> >>>TestPullReplicaErrorHandling.throws
> >>>
> >>>
> >>> Failures in Hoss' reports for the last 4 collected reports.
> >>>
> >>> Will BadApple these
> >>>
> >>> Failures in the last 4 reports..
> >>>Report   Pct runsfails   test
> >>>  0123   2.3 1725 25
> >>> CloudSolrClientTest.preferLocalShardsTest
> >>>  0123   3.4 1684 29  DistributedMLTComponentTest.test
> >>>  0123   1.0 1643 14  FullSolrCloudDistribCmdsTest.test
> >>>  0123   2.9 1307 13
> >>> HdfsAutoAddReplicasIntegrationTest.testSimple
> >>>  0123   6.3 1634 94  MoveReplicaHDFSTest.testFailedMove
> >>>  0123   5.0 1697 53
> >>> ScheduledTriggerIntegrationTest.testScheduledTrigger
> >>>  0123  40.7  388147  ShardSplitTest.test
> >>>  0123   6.3  308 21
> >>> ShardSplitTest.testSplitMixedReplicaTypes
> >>>  0123   7.3 1562 57
> >>> StreamDecoratorTest.testExecutorStream
> >>>  0123   1.9 1561 15
> >>> StreamDecoratorTest.testParallelCommitStream
> >>>  0123   6.3  132  8  StressHdfsTest(suite)
> >>>  0123   0.3 1642  4
> >>>
> TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeaderAfterRestart
> >>>  0123   6.7  128 12
> >>> TestGenericDistributedQueue.testDistributedQueue
> >>>  0123   8.8  876 40  TestHdfsCloudBackupRestore.test
> >>>  0123   2.0 1068 17  TestHdfsUpdateLog(suite)
> >>>  0123   0.2 1687  4  TestIndexWriterOnVMError(suite)
> >>>  0123   4.3   96  4
> >>> TestIndexWriterOnVMError.testCheckpoint
> >>>  0123   9.0 1646 76  TestLocalFSCloudBackupRestore.test
> >>>  0123   0.2 1691 15  TestLogWatcher.testLog4jWatcher
> >>>  0123   0.2 1701 36  TestPullReplica.testKillLeader
> >>>  0123   0.7 1662 23  TestSolrConfigHandlerCloud.test
> >>>  0123   0.5 1648  9  TestTlogReplica(suite)
> >>>  0123  11.0  364 36
> >>> TestTriggerIntegration.testNodeLostTriggerRestoreState
> >>>  0123   0.3 1650  8
> >>> TimeRoutedAliasUpdateProcessorTest.test
> >>>
> >>> -
> >>> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
> >>> For additional commands, e-mail: dev-h...@lucene.apache.org
> >>
> >> --
> >> Lucene/Solr Search Committer, Consultant, Developer, Author, Speaker
> >> LinkedIn: http://linkedin.com/in/davidwsmiley | Book:
> >> http://www.solrenterprisesearchserver.com
> >
> >
>
> -
> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
> For additional commands, e-mail: dev-h...@lucene.apache.org
>
> --
Lucene/Solr Search Committer, Consultant, Developer, Author, Speaker
LinkedIn: http://linkedin.com/in/davidwsmiley | Book:
http://www.solrenterprisesearchserver.com

Re: Weekly BadApple report

2018-07-23 Thread Erick Erickson

David:

I put it in my "do not BadApple" list. Beasting that test on my Mac
Pro, 350 iterations or so and no failures FWIW.

Erick

On Mon, Jul 23, 2018 at 2:26 PM, Varun Thacker  wrote:
> David TestLogLevelAnnotations might help you?
>
> On Mon, Jul 23, 2018 at 2:22 PM, David Smiley 
> wrote:
>>
>> Thanks for these reports Erick!
>>
>> Please don't BadApple TimeRoutedAliasUpdateProcessorTest.  Failures seem
>> rare.  At least in the last week, only one of two I consider genuine.
>>
>> How can I configure expanded logging but only for one test suite?
>>
>> ~ David
>>
>> On Mon, Jul 23, 2018 at 4:19 PM Erick Erickson 
>> wrote:
>>>
>>> Full report attached
>>>
>>> **Annotated tests/suites that didn't fail in the last 4 weeks.
>>>
>>>   **Annotations will be removed from the following tests because they
>>> haven't failed in the last 4 rollups.
>>>
>>>   **Methods: 10
>>>AddReplicaTest.test
>>>HdfsChaosMonkeyNothingIsSafeTest
>>>MaxSizeAutoCommitTest
>>>PeerSyncReplicationTest.test
>>>RecoveryZkTest.test
>>>RollingRestartTest.test
>>>SearchRateTriggerTest.testTrigger
>>>TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader
>>>TestLargeCluster.testSearchRate
>>>TestPullReplicaErrorHandling.throws
>>>
>>>
>>> Failures in Hoss' reports for the last 4 collected reports.
>>>
>>> Will BadApple these
>>>
>>> Failures in the last 4 reports..
>>>Report   Pct runsfails   test
>>>  0123   2.3 1725 25
>>> CloudSolrClientTest.preferLocalShardsTest
>>>  0123   3.4 1684 29  DistributedMLTComponentTest.test
>>>  0123   1.0 1643 14  FullSolrCloudDistribCmdsTest.test
>>>  0123   2.9 1307 13
>>> HdfsAutoAddReplicasIntegrationTest.testSimple
>>>  0123   6.3 1634 94  MoveReplicaHDFSTest.testFailedMove
>>>  0123   5.0 1697 53
>>> ScheduledTriggerIntegrationTest.testScheduledTrigger
>>>  0123  40.7  388147  ShardSplitTest.test
>>>  0123   6.3  308 21
>>> ShardSplitTest.testSplitMixedReplicaTypes
>>>  0123   7.3 1562 57
>>> StreamDecoratorTest.testExecutorStream
>>>  0123   1.9 1561 15
>>> StreamDecoratorTest.testParallelCommitStream
>>>  0123   6.3  132  8  StressHdfsTest(suite)
>>>  0123   0.3 1642  4
>>> TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeaderAfterRestart
>>>  0123   6.7  128 12
>>> TestGenericDistributedQueue.testDistributedQueue
>>>  0123   8.8  876 40  TestHdfsCloudBackupRestore.test
>>>  0123   2.0 1068 17  TestHdfsUpdateLog(suite)
>>>  0123   0.2 1687  4  TestIndexWriterOnVMError(suite)
>>>  0123   4.3   96  4
>>> TestIndexWriterOnVMError.testCheckpoint
>>>  0123   9.0 1646 76  TestLocalFSCloudBackupRestore.test
>>>  0123   0.2 1691 15  TestLogWatcher.testLog4jWatcher
>>>  0123   0.2 1701 36  TestPullReplica.testKillLeader
>>>  0123   0.7 1662 23  TestSolrConfigHandlerCloud.test
>>>  0123   0.5 1648  9  TestTlogReplica(suite)
>>>  0123  11.0  364 36
>>> TestTriggerIntegration.testNodeLostTriggerRestoreState
>>>  0123   0.3 1650  8
>>> TimeRoutedAliasUpdateProcessorTest.test
>>>
>>> -
>>> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
>>> For additional commands, e-mail: dev-h...@lucene.apache.org
>>
>> --
>> Lucene/Solr Search Committer, Consultant, Developer, Author, Speaker
>> LinkedIn: http://linkedin.com/in/davidwsmiley | Book:
>> http://www.solrenterprisesearchserver.com
>
>

-
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Re: Weekly BadApple report

2018-07-23 Thread Varun Thacker

David TestLogLevelAnnotations might help you?

On Mon, Jul 23, 2018 at 2:22 PM, David Smiley 
wrote:

> Thanks for these reports Erick!
>
> Please don't BadApple TimeRoutedAliasUpdateProcessorTest.  Failures seem
> rare.  At least in the last week, only one of two I consider genuine.
>
> How can I configure expanded logging but only for one test suite?
>
> ~ David
>
> On Mon, Jul 23, 2018 at 4:19 PM Erick Erickson 
> wrote:
>
>> Full report attached
>>
>> **Annotated tests/suites that didn't fail in the last 4 weeks.
>>
>>   **Annotations will be removed from the following tests because they
>> haven't failed in the last 4 rollups.
>>
>>   **Methods: 10
>>AddReplicaTest.test
>>HdfsChaosMonkeyNothingIsSafeTest
>>MaxSizeAutoCommitTest
>>PeerSyncReplicationTest.test
>>RecoveryZkTest.test
>>RollingRestartTest.test
>>SearchRateTriggerTest.testTrigger
>>TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader
>>TestLargeCluster.testSearchRate
>>TestPullReplicaErrorHandling.throws
>>
>>
>> Failures in Hoss' reports for the last 4 collected reports.
>>
>> Will BadApple these
>>
>> Failures in the last 4 reports..
>>Report   Pct runsfails   test
>>  0123   2.3 1725 25  CloudSolrClientTest.
>> preferLocalShardsTest
>>  0123   3.4 1684 29  DistributedMLTComponentTest.test
>>  0123   1.0 1643 14  FullSolrCloudDistribCmdsTest.test
>>  0123   2.9 1307 13
>> HdfsAutoAddReplicasIntegrationTest.testSimple
>>  0123   6.3 1634 94  MoveReplicaHDFSTest.testFailedMove
>>  0123   5.0 1697 53
>> ScheduledTriggerIntegrationTest.testScheduledTrigger
>>  0123  40.7  388147  ShardSplitTest.test
>>  0123   6.3  308 21  ShardSplitTest.
>> testSplitMixedReplicaTypes
>>  0123   7.3 1562 57  StreamDecoratorTest.
>> testExecutorStream
>>  0123   1.9 1561 15
>> StreamDecoratorTest.testParallelCommitStream
>>  0123   6.3  132  8  StressHdfsTest(suite)
>>  0123   0.3 1642  4
>> TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeaderAfterRestart
>>  0123   6.7  128 12
>> TestGenericDistributedQueue.testDistributedQueue
>>  0123   8.8  876 40  TestHdfsCloudBackupRestore.test
>>  0123   2.0 1068 17  TestHdfsUpdateLog(suite)
>>  0123   0.2 1687  4  TestIndexWriterOnVMError(suite)
>>  0123   4.3   96  4  TestIndexWriterOnVMError.
>> testCheckpoint
>>  0123   9.0 1646 76  TestLocalFSCloudBackupRestore.test
>>  0123   0.2 1691 15  TestLogWatcher.testLog4jWatcher
>>  0123   0.2 1701 36  TestPullReplica.testKillLeader
>>  0123   0.7 1662 23  TestSolrConfigHandlerCloud.test
>>  0123   0.5 1648  9  TestTlogReplica(suite)
>>  0123  11.0  364 36
>> TestTriggerIntegration.testNodeLostTriggerRestoreState
>>  0123   0.3 1650  8  TimeRoutedAliasUpdateProcessor
>> Test.test
>>
>> -
>> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
>> For additional commands, e-mail: dev-h...@lucene.apache.org
>
> --
> Lucene/Solr Search Committer, Consultant, Developer, Author, Speaker
> LinkedIn: http://linkedin.com/in/davidwsmiley | Book: http://www.
> solrenterprisesearchserver.com
>

Re: Weekly BadApple report

2018-07-23 Thread David Smiley

Thanks for these reports Erick!

Please don't BadApple TimeRoutedAliasUpdateProcessorTest.  Failures seem
rare.  At least in the last week, only one of two I consider genuine.

How can I configure expanded logging but only for one test suite?

~ David

On Mon, Jul 23, 2018 at 4:19 PM Erick Erickson 
wrote:

> Full report attached
>
> **Annotated tests/suites that didn't fail in the last 4 weeks.
>
>   **Annotations will be removed from the following tests because they
> haven't failed in the last 4 rollups.
>
>   **Methods: 10
>AddReplicaTest.test
>HdfsChaosMonkeyNothingIsSafeTest
>MaxSizeAutoCommitTest
>PeerSyncReplicationTest.test
>RecoveryZkTest.test
>RollingRestartTest.test
>SearchRateTriggerTest.testTrigger
>TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader
>TestLargeCluster.testSearchRate
>TestPullReplicaErrorHandling.throws
>
>
> Failures in Hoss' reports for the last 4 collected reports.
>
> Will BadApple these
>
> Failures in the last 4 reports..
>Report   Pct runsfails   test
>  0123   2.3 1725 25
> CloudSolrClientTest.preferLocalShardsTest
>  0123   3.4 1684 29  DistributedMLTComponentTest.test
>  0123   1.0 1643 14  FullSolrCloudDistribCmdsTest.test
>  0123   2.9 1307 13
> HdfsAutoAddReplicasIntegrationTest.testSimple
>  0123   6.3 1634 94  MoveReplicaHDFSTest.testFailedMove
>  0123   5.0 1697 53
> ScheduledTriggerIntegrationTest.testScheduledTrigger
>  0123  40.7  388147  ShardSplitTest.test
>  0123   6.3  308 21
> ShardSplitTest.testSplitMixedReplicaTypes
>  0123   7.3 1562 57  StreamDecoratorTest.testExecutorStream
>  0123   1.9 1561 15
> StreamDecoratorTest.testParallelCommitStream
>  0123   6.3  132  8  StressHdfsTest(suite)
>  0123   0.3 1642  4
> TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeaderAfterRestart
>  0123   6.7  128 12
> TestGenericDistributedQueue.testDistributedQueue
>  0123   8.8  876 40  TestHdfsCloudBackupRestore.test
>  0123   2.0 1068 17  TestHdfsUpdateLog(suite)
>  0123   0.2 1687  4  TestIndexWriterOnVMError(suite)
>  0123   4.3   96  4
> TestIndexWriterOnVMError.testCheckpoint
>  0123   9.0 1646 76  TestLocalFSCloudBackupRestore.test
>  0123   0.2 1691 15  TestLogWatcher.testLog4jWatcher
>  0123   0.2 1701 36  TestPullReplica.testKillLeader
>  0123   0.7 1662 23  TestSolrConfigHandlerCloud.test
>  0123   0.5 1648  9  TestTlogReplica(suite)
>  0123  11.0  364 36
> TestTriggerIntegration.testNodeLostTriggerRestoreState
>  0123   0.3 1650  8
> TimeRoutedAliasUpdateProcessorTest.test
>
> -
> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
> For additional commands, e-mail: dev-h...@lucene.apache.org

-- 
Lucene/Solr Search Committer, Consultant, Developer, Author, Speaker
LinkedIn: http://linkedin.com/in/davidwsmiley | Book:
http://www.solrenterprisesearchserver.com

Weekly BadApple report

2018-07-23 Thread Erick Erickson

Full report attached

**Annotated tests/suites that didn't fail in the last 4 weeks.

  **Annotations will be removed from the following tests because they
haven't failed in the last 4 rollups.

  **Methods: 10
   AddReplicaTest.test
   HdfsChaosMonkeyNothingIsSafeTest
   MaxSizeAutoCommitTest
   PeerSyncReplicationTest.test
   RecoveryZkTest.test
   RollingRestartTest.test
   SearchRateTriggerTest.testTrigger
   TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader
   TestLargeCluster.testSearchRate
   TestPullReplicaErrorHandling.throws


Failures in Hoss' reports for the last 4 collected reports.

Will BadApple these

Failures in the last 4 reports..
   Report   Pct runsfails   test
 0123   2.3 1725 25  CloudSolrClientTest.preferLocalShardsTest
 0123   3.4 1684 29  DistributedMLTComponentTest.test
 0123   1.0 1643 14  FullSolrCloudDistribCmdsTest.test
 0123   2.9 1307 13
HdfsAutoAddReplicasIntegrationTest.testSimple
 0123   6.3 1634 94  MoveReplicaHDFSTest.testFailedMove
 0123   5.0 1697 53
ScheduledTriggerIntegrationTest.testScheduledTrigger
 0123  40.7  388147  ShardSplitTest.test
 0123   6.3  308 21  ShardSplitTest.testSplitMixedReplicaTypes
 0123   7.3 1562 57  StreamDecoratorTest.testExecutorStream
 0123   1.9 1561 15
StreamDecoratorTest.testParallelCommitStream
 0123   6.3  132  8  StressHdfsTest(suite)
 0123   0.3 1642  4
TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeaderAfterRestart
 0123   6.7  128 12
TestGenericDistributedQueue.testDistributedQueue
 0123   8.8  876 40  TestHdfsCloudBackupRestore.test
 0123   2.0 1068 17  TestHdfsUpdateLog(suite)
 0123   0.2 1687  4  TestIndexWriterOnVMError(suite)
 0123   4.3   96  4  TestIndexWriterOnVMError.testCheckpoint
 0123   9.0 1646 76  TestLocalFSCloudBackupRestore.test
 0123   0.2 1691 15  TestLogWatcher.testLog4jWatcher
 0123   0.2 1701 36  TestPullReplica.testKillLeader
 0123   0.7 1662 23  TestSolrConfigHandlerCloud.test
 0123   0.5 1648  9  TestTlogReplica(suite)
 0123  11.0  364 36
TestTriggerIntegration.testNodeLostTriggerRestoreState
 0123   0.3 1650  8  TimeRoutedAliasUpdateProcessorTest.test
DO NOT ENABLE LIST:
'IndexSizeTriggerTest.testMergeIntegration'
'IndexSizeTriggerTest.testMixedBounds'
'IndexSizeTriggerTest.testSplitIntegration'
'IndexSizeTriggerTest.testTrigger'
'TestControlledRealTimeReopenThread.testCRTReopen'
'TestICUNormalizer2CharFilter.testRandomStrings'
'TestICUTokenizerCJK'
'TestImpersonationWithHadoopAuth.testForwarding'
'TestLTRReRankingPipeline.testDifferentTopN'
'TestRandomChains'


DO NOT ANNOTATE LIST
CdcrBidirectionalTest.testBiDir
TestRandomChains.testRandomChainsWithLargeStrings

Processing file (History bit 3): HOSS-2018-07-23.csv
Processing file (History bit 2): HOSS-2018-07-16.csv
Processing file (History bit 1): HOSS-2018-07-09.csv
Processing file (History bit 0): HOSS-2018-07-02.csv


**Annotated tests/suites that didn't fail in the last 4 weeks.

  **Tests and suites removed from the next two lists because they were 
specified in 'doNotEnable' in the properties file
 no tests removed

  **Annotations will be removed from the following tests because they haven't 
failed in the last 4 rollups.

  **Methods: 10
   AddReplicaTest.test
   HdfsChaosMonkeyNothingIsSafeTest
   MaxSizeAutoCommitTest
   PeerSyncReplicationTest.test
   RecoveryZkTest.test
   RollingRestartTest.test
   SearchRateTriggerTest.testTrigger
   TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader
   TestLargeCluster.testSearchRate
   TestPullReplicaErrorHandling.throws

  **Suites: 0


Failures in Hoss' reports for the last 4 rollups.

There were 953 unannotated tests that failed in Hoss' rollups. Ordered by the 
date I downloaded the rollup file, newest->oldest. See above for the dates the 
files were collected 
These tests were NOT BadApple'd or AwaitsFix'd
All tests that failed 4 weeks running will be BadApple'd unless there are 
objections

Failures in the last 4 reports..
   Report   Pct runsfails   test
 0123  18.3 1933240  CdcrBidirectionalTest.testBiDir
 0123   2.3 1725 25  CloudSolrClientTest.preferLocalShardsTest
 0123   3.4 1684 29  DistributedMLTComponentTest.test
 0123   1.0 1643 14  FullSolrCloudDistribCmdsTest.test
 0123   2.9 1307 13  
HdfsAutoAddReplicasIntegrationTest.testSimple
 0123   6.3 1634 94  MoveReplicaHDFSTest.testFailedMove
 0123   5.0 1697 53  
ScheduledTriggerIntegrationTest.testScheduledTrigger
 0123  40.7  388147

Re: Weekly BadApple report:

2018-05-01 Thread Erick Erickson

OK, won't BadApple any of the CreateRoutedAliasTest then.

On Tue, May 1, 2018 at 9:11 AM, David Smiley  wrote:
> I'm actively working on the Alias ones.  Some have identified root causes
> relating to eventual-consistency timings.  Since I don't have a proper fix
> yet, in the interim I'm tempted to add a temporary Thread.sleep(200) at
> certain places in pertinent tests.
>
> On Tue, May 1, 2018 at 12:59 AM Erick Erickson 
> wrote:
>>
>> In order to reduce some of the make-work, I collect failed tests Fri->Mon
>> so the BadApple'd tests on Thursday don't clutter things up.
>>
>> BadApple candidates: I'll BadApple these on Thursday unless there are
>> objections
>>
>>
>> org.apache.solr.client.solrj.io.stream.MathExpressionTest.testGammaDistribution
>>org.apache.solr.cloud.AddReplicaTest.test
>>
>> org.apache.solr.cloud.CreateRoutedAliasTest.testCollectionNamesMustBeAbsent
>>org.apache.solr.cloud.CreateRoutedAliasTest.testTimezoneAbsoluteDate
>>org.apache.solr.cloud.CreateRoutedAliasTest.testV1
>>org.apache.solr.cloud.CreateRoutedAliasTest.testV2
>>org.apache.solr.cloud.DocValuesNotIndexedTest.testGroupingDVOnly
>>
>> org.apache.solr.cloud.LIRRollingUpdatesTest.testNewLeaderAndMixedReplicas
>>org.apache.solr.cloud.LIRRollingUpdatesTest.testNewLeaderOldReplica
>>
>> org.apache.solr.cloud.LIRRollingUpdatesTest.testOldLeaderAndMixedReplicas
>>
>> org.apache.solr.cloud.LeaderElectionIntegrationTest.testSimpleSliceLeaderElection
>>org.apache.solr.cloud.OverseerRolesTest.testOverseerRole
>>
>> org.apache.solr.cloud.SolrCloudExampleTest.testLoadDocsIntoGettingStartedCollection
>>org.apache.solr.cloud.TestPullReplica.testKillLeader
>>org.apache.solr.cloud.api.collections.TestHdfsCloudBackupRestore.test
>>org.apache.solr.cloud.autoscaling.ComputePlanActionTest.testNodeLost
>>org.apache.solr.cloud.autoscaling.NodeAddedTriggerTest.testRestoreState
>>
>> org.apache.solr.handler.TestReplicationHandler.doTestIndexAndConfigAliasReplication
>>org.apache.solr.schema.TestCloudSchemaless.test
>>org.apache.solr.search.TestStressRecovery.testStressRecovery
>>org.apache.solr.update.TestInPlaceUpdatesDistrib.test
>>
>>
>> I believe these are being worked on, so I will _not_ BadApple them
>> even though they fail.
>> What about the other autoscaling tests?
>>
>>
>> org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testMergeIntegration
>>
>> org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testSplitIntegration
>>org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testTrigger
>>
>>
>> Number of AwaitsFix: 21 Number of BadApples: 90
>>
>> *AwaitsFix Annotations:
>>
>>
>> Lucene AwaitsFix
>> GeoPolygonTest.java
>>testLUCENE8276_case3()
>>
>> //@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8276;)
>>
>> GeoPolygonTest.java
>>testLUCENE8280()
>>
>> //@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8280;)
>>
>> GeoPolygonTest.java
>>testLUCENE8281()
>>
>> //@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8281;)
>>
>> RandomGeoPolygonTest.java
>>testCompareBigPolygons()
>>
>> //@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8281;)
>>
>> RandomGeoPolygonTest.java
>>testCompareSmallPolygons()
>>
>> //@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8281;)
>>
>> TestControlledRealTimeReopenThread.java
>>testCRTReopen()
>>@AwaitsFix(bugUrl =
>> "https://issues.apache.org/jira/browse/LUCENE-5737;)
>>
>> TestICUNormalizer2CharFilter.java
>>testRandomStrings()
>>@AwaitsFix(bugUrl =
>> "https://issues.apache.org/jira/browse/LUCENE-5595;)
>>
>> TestICUTokenizerCJK.java
>>TestICUTokenizerCJK suite
>>@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8222;)
>>
>> TestMoreLikeThis.java
>>testMultiFieldShouldReturnPerFieldBooleanQuery()
>>@AwaitsFix(bugUrl =
>> "https://issues.apache.org/jira/browse/LUCENE-7161;)
>>
>> UIMABaseAnalyzerTest.java
>>testRandomStrings()
>>@Test @AwaitsFix(bugUrl =
>> "https://issues.apache.org/jira/browse/LUCENE-3869;)
>>
>> UIMABaseAnalyzerTest.java
>>testRandomStringsWithConfigurationParameters()
>>@Test @AwaitsFix(bugUrl =
>> "https://issues.apache.org/jira/browse/LUCENE-3869;)
>>
>> UIMATypeAwareAnalyzerTest.java
>>testRandomStrings()
>>@Test @AwaitsFix(bugUrl =
>> "https://issues.apache.org/jira/browse/LUCENE-3869;)
>>
>>
>> Solr AwaitsFix
>> ReplaceNodeNoTargetTest.java
>>ReplaceNodeNoTargetTest suite
>>@LuceneTestCase.AwaitsFix(bugUrl =
>> "https://issues.apache.org/jira/browse/SOLR-11067;)
>>
>> TestCollapseQParserPlugin.java
>>testStringCollapse()
>>@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-11974;)
>>
>> TestImpersonationWithHadoopAuth.java
>>testForwarding()
>>@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/HADOOP-9893;)
>>

Re: Weekly BadApple report:

2018-05-01 Thread David Smiley

I'm actively working on the Alias ones.  Some have identified root causes
relating to eventual-consistency timings.  Since I don't have a proper fix
yet, in the interim I'm tempted to add a temporary Thread.sleep(200) at
certain places in pertinent tests.

On Tue, May 1, 2018 at 12:59 AM Erick Erickson 
wrote:

> In order to reduce some of the make-work, I collect failed tests Fri->Mon
> so the BadApple'd tests on Thursday don't clutter things up.
>
> BadApple candidates: I'll BadApple these on Thursday unless there are
> objections
>
>
>  
> org.apache.solr.client.solrj.io.stream.MathExpressionTest.testGammaDistribution
>org.apache.solr.cloud.AddReplicaTest.test
>
>  org.apache.solr.cloud.CreateRoutedAliasTest.testCollectionNamesMustBeAbsent
>org.apache.solr.cloud.CreateRoutedAliasTest.testTimezoneAbsoluteDate
>org.apache.solr.cloud.CreateRoutedAliasTest.testV1
>org.apache.solr.cloud.CreateRoutedAliasTest.testV2
>org.apache.solr.cloud.DocValuesNotIndexedTest.testGroupingDVOnly
>
>  org.apache.solr.cloud.LIRRollingUpdatesTest.testNewLeaderAndMixedReplicas
>org.apache.solr.cloud.LIRRollingUpdatesTest.testNewLeaderOldReplica
>
>  org.apache.solr.cloud.LIRRollingUpdatesTest.testOldLeaderAndMixedReplicas
>
>  
> org.apache.solr.cloud.LeaderElectionIntegrationTest.testSimpleSliceLeaderElection
>org.apache.solr.cloud.OverseerRolesTest.testOverseerRole
>
>  
> org.apache.solr.cloud.SolrCloudExampleTest.testLoadDocsIntoGettingStartedCollection
>org.apache.solr.cloud.TestPullReplica.testKillLeader
>org.apache.solr.cloud.api.collections.TestHdfsCloudBackupRestore.test
>org.apache.solr.cloud.autoscaling.ComputePlanActionTest.testNodeLost
>org.apache.solr.cloud.autoscaling.NodeAddedTriggerTest.testRestoreState
>
>  
> org.apache.solr.handler.TestReplicationHandler.doTestIndexAndConfigAliasReplication
>org.apache.solr.schema.TestCloudSchemaless.test
>org.apache.solr.search.TestStressRecovery.testStressRecovery
>org.apache.solr.update.TestInPlaceUpdatesDistrib.test
>
>
> I believe these are being worked on, so I will _not_ BadApple them
> even though they fail.
> What about the other autoscaling tests?
>
>
>  org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testMergeIntegration
>
>  org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testSplitIntegration
>org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testTrigger
>
>
> Number of AwaitsFix: 21 Number of BadApples: 90
>
> *AwaitsFix Annotations:
>
>
> Lucene AwaitsFix
> GeoPolygonTest.java
>testLUCENE8276_case3()
>//@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8276
> ")
>
> GeoPolygonTest.java
>testLUCENE8280()
>//@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8280
> ")
>
> GeoPolygonTest.java
>testLUCENE8281()
>//@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8281
> ")
>
> RandomGeoPolygonTest.java
>testCompareBigPolygons()
>//@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8281
> ")
>
> RandomGeoPolygonTest.java
>testCompareSmallPolygons()
>//@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8281
> ")
>
> TestControlledRealTimeReopenThread.java
>testCRTReopen()
>@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5737
> ")
>
> TestICUNormalizer2CharFilter.java
>testRandomStrings()
>@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5595
> ")
>
> TestICUTokenizerCJK.java
>TestICUTokenizerCJK suite
>@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8222;)
>
> TestMoreLikeThis.java
>testMultiFieldShouldReturnPerFieldBooleanQuery()
>@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-7161
> ")
>
> UIMABaseAnalyzerTest.java
>testRandomStrings()
>@Test @AwaitsFix(bugUrl =
> "https://issues.apache.org/jira/browse/LUCENE-3869;)
>
> UIMABaseAnalyzerTest.java
>testRandomStringsWithConfigurationParameters()
>@Test @AwaitsFix(bugUrl =
> "https://issues.apache.org/jira/browse/LUCENE-3869;)
>
> UIMATypeAwareAnalyzerTest.java
>testRandomStrings()
>@Test @AwaitsFix(bugUrl =
> "https://issues.apache.org/jira/browse/LUCENE-3869;)
>
>
> Solr AwaitsFix
> ReplaceNodeNoTargetTest.java
>ReplaceNodeNoTargetTest suite
>@LuceneTestCase.AwaitsFix(bugUrl =
> "https://issues.apache.org/jira/browse/SOLR-11067;)
>
> TestCollapseQParserPlugin.java
>testStringCollapse()
>@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-11974;)
>
> TestImpersonationWithHadoopAuth.java
>testForwarding()
>@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/HADOOP-9893;)
>
> TestLTRReRankingPipeline.java
>testDifferentTopN()
>@AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-11134;)
>
> TestMinMaxOnMultiValuedField.java
>testDoubleFieldCache()
>@AwaitsFix(bugUrl =

Weekly BadApple report:

2018-04-30 Thread Erick Erickson

In order to reduce some of the make-work, I collect failed tests Fri->Mon
so the BadApple'd tests on Thursday don't clutter things up.

BadApple candidates: I'll BadApple these on Thursday unless there are objections

   
org.apache.solr.client.solrj.io.stream.MathExpressionTest.testGammaDistribution
   org.apache.solr.cloud.AddReplicaTest.test
   org.apache.solr.cloud.CreateRoutedAliasTest.testCollectionNamesMustBeAbsent
   org.apache.solr.cloud.CreateRoutedAliasTest.testTimezoneAbsoluteDate
   org.apache.solr.cloud.CreateRoutedAliasTest.testV1
   org.apache.solr.cloud.CreateRoutedAliasTest.testV2
   org.apache.solr.cloud.DocValuesNotIndexedTest.testGroupingDVOnly
   org.apache.solr.cloud.LIRRollingUpdatesTest.testNewLeaderAndMixedReplicas
   org.apache.solr.cloud.LIRRollingUpdatesTest.testNewLeaderOldReplica
   org.apache.solr.cloud.LIRRollingUpdatesTest.testOldLeaderAndMixedReplicas
   
org.apache.solr.cloud.LeaderElectionIntegrationTest.testSimpleSliceLeaderElection
   org.apache.solr.cloud.OverseerRolesTest.testOverseerRole
   
org.apache.solr.cloud.SolrCloudExampleTest.testLoadDocsIntoGettingStartedCollection
   org.apache.solr.cloud.TestPullReplica.testKillLeader
   org.apache.solr.cloud.api.collections.TestHdfsCloudBackupRestore.test
   org.apache.solr.cloud.autoscaling.ComputePlanActionTest.testNodeLost
   org.apache.solr.cloud.autoscaling.NodeAddedTriggerTest.testRestoreState
   
org.apache.solr.handler.TestReplicationHandler.doTestIndexAndConfigAliasReplication
   org.apache.solr.schema.TestCloudSchemaless.test
   org.apache.solr.search.TestStressRecovery.testStressRecovery
   org.apache.solr.update.TestInPlaceUpdatesDistrib.test


I believe these are being worked on, so I will _not_ BadApple them
even though they fail.
What about the other autoscaling tests?

   org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testMergeIntegration
   org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testSplitIntegration
   org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testTrigger


Number of AwaitsFix: 21 Number of BadApples: 90

*AwaitsFix Annotations:


Lucene AwaitsFix
GeoPolygonTest.java
   testLUCENE8276_case3()
   //@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8276;)

GeoPolygonTest.java
   testLUCENE8280()
   //@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8280;)

GeoPolygonTest.java
   testLUCENE8281()
   //@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8281;)

RandomGeoPolygonTest.java
   testCompareBigPolygons()
   //@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8281;)

RandomGeoPolygonTest.java
   testCompareSmallPolygons()
   //@AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8281;)

TestControlledRealTimeReopenThread.java
   testCRTReopen()
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5737;)

TestICUNormalizer2CharFilter.java
   testRandomStrings()
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-5595;)

TestICUTokenizerCJK.java
   TestICUTokenizerCJK suite
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/LUCENE-8222;)

TestMoreLikeThis.java
   testMultiFieldShouldReturnPerFieldBooleanQuery()
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-7161;)

UIMABaseAnalyzerTest.java
   testRandomStrings()
   @Test @AwaitsFix(bugUrl =
"https://issues.apache.org/jira/browse/LUCENE-3869;)

UIMABaseAnalyzerTest.java
   testRandomStringsWithConfigurationParameters()
   @Test @AwaitsFix(bugUrl =
"https://issues.apache.org/jira/browse/LUCENE-3869;)

UIMATypeAwareAnalyzerTest.java
   testRandomStrings()
   @Test @AwaitsFix(bugUrl =
"https://issues.apache.org/jira/browse/LUCENE-3869;)


Solr AwaitsFix
ReplaceNodeNoTargetTest.java
   ReplaceNodeNoTargetTest suite
   @LuceneTestCase.AwaitsFix(bugUrl =
"https://issues.apache.org/jira/browse/SOLR-11067;)

TestCollapseQParserPlugin.java
   testStringCollapse()
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/SOLR-11974;)

TestImpersonationWithHadoopAuth.java
   testForwarding()
   @AwaitsFix(bugUrl="https://issues.apache.org/jira/browse/HADOOP-9893;)

TestLTRReRankingPipeline.java
   testDifferentTopN()
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/SOLR-11134;)

TestMinMaxOnMultiValuedField.java
   testDoubleFieldCache()
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709;)

TestMinMaxOnMultiValuedField.java
   testFloatFieldCache()
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709;)

TestMinMaxOnMultiValuedField.java
   testIntFieldCache()
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709;)

TestMinMaxOnMultiValuedField.java
   testLongFieldCache()
   @AwaitsFix(bugUrl = "https://issues.apache.org/jira/browse/LUCENE-6709;)



*BadApple Annotations:

Lucene BadApple

Solr BadApple
AddReplicaTest.java
   test()

Weekly BadApple report

Re: Weekly BadApple report

Re: Weekly BadApple report

Re: Weekly BadApple report

Re: Weekly BadApple report

Weekly BadApple report

Re: Weekly BadApple report:

Re: Weekly BadApple report:

Weekly BadApple report:

9 matches

Site Navigation

Mail list logo

Footer information