[jira] [Commented] (LUCENE-9168) Test failure after new randomized values in LuceneTestCase

2020-01-24 Thread Ignacio Vera (Jira) 


[ 
https://issues.apache.org/jira/browse/LUCENE-9168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022964#comment-17022964
 ] 

Ignacio Vera commented on LUCENE-9168:
--

Thanks t you [~rcmuir], the effort in speeding up the test is awesome :)

> Test failure after new randomized values in LuceneTestCase
> --
>
> Key: LUCENE-9168
> URL: https://issues.apache.org/jira/browse/LUCENE-9168
> Project: Lucene - Core
>  Issue Type: Test
>Reporter: Ignacio Vera
>Priority: Major
> Fix For: 8.5
>
>
> The error can be reproduced in branch_8x:
> {code:java}
> ant test  -Dtestcase=TestPointValues -Dtests.method=testTieBreakByDocID 
> -Dtests.seed=A7EAA3BF5766C7C0 -Dtests.slow=true -Dtests.badapples=true 
> -Dtests.locale=my -Dtests.timezone=Singapore -Dtests.asserts=true 
> -Dtests.file.encoding=ISO-8859-1 {code}
>  
> And the error looks like:
> {code:java}
>  07:08:28[junit4]> Caused by: 
> org.apache.lucene.index.MergePolicy$MergeException: 
> java.nio.file.FileSystemException: 
> /var/lib/jenkins/workspace/apache+lucene-solr+branch_8x/lucene/build/core/test/J1/temp/lucene.index.TestPointValues_A7EAA3BF5766C7C0-001/tempDir-002/_bd.tip:
>  Too many open files{code}
>  
> I had a look into the issue and the indexWriter in the test is configured to 
> buffer very few docs:
> c.setMaxBufferedDocs(TestUtil.nextInt(r, 2, 15));
>  
> But the merging factor (LogMergePolicy) is too high:
> logmp.setMergeFactor(TestUtil.nextInt(r, 100, 500));
>  
> The test is creating too many files and running over the limit. The last 
> statement was changed in LUCENE-9157 from:
>  
> logmp.setMergeFactor(TestUtil.nextInt(r, 10, 50));
>  
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org

[jira] [Commented] (LUCENE-9168) Test failure after new randomized values in LuceneTestCase

2020-01-24 Thread ASF subversion and git services (Jira) 


[ 
https://issues.apache.org/jira/browse/LUCENE-9168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022947#comment-17022947
 ] 

ASF subversion and git services commented on LUCENE-9168:
-

Commit 5070ee8bbe6347e345a516625d2e834c2c08577d in lucene-solr's branch 
refs/heads/branch_8x from Robert Muir
[ https://gitbox.apache.org/repos/asf?p=lucene-solr.git;h=5070ee8 ]

LUCENE-9168: don't let crazy tests run us out of open files with these params


> Test failure after new randomized values in LuceneTestCase
> --
>
> Key: LUCENE-9168
> URL: https://issues.apache.org/jira/browse/LUCENE-9168
> Project: Lucene - Core
>  Issue Type: Test
>Reporter: Ignacio Vera
>Priority: Major
>
> The error can be reproduced in branch_8x:
> {code:java}
> ant test  -Dtestcase=TestPointValues -Dtests.method=testTieBreakByDocID 
> -Dtests.seed=A7EAA3BF5766C7C0 -Dtests.slow=true -Dtests.badapples=true 
> -Dtests.locale=my -Dtests.timezone=Singapore -Dtests.asserts=true 
> -Dtests.file.encoding=ISO-8859-1 {code}
>  
> And the error looks like:
> {code:java}
>  07:08:28[junit4]> Caused by: 
> org.apache.lucene.index.MergePolicy$MergeException: 
> java.nio.file.FileSystemException: 
> /var/lib/jenkins/workspace/apache+lucene-solr+branch_8x/lucene/build/core/test/J1/temp/lucene.index.TestPointValues_A7EAA3BF5766C7C0-001/tempDir-002/_bd.tip:
>  Too many open files{code}
>  
> I had a look into the issue and the indexWriter in the test is configured to 
> buffer very few docs:
> c.setMaxBufferedDocs(TestUtil.nextInt(r, 2, 15));
>  
> But the merging factor (LogMergePolicy) is too high:
> logmp.setMergeFactor(TestUtil.nextInt(r, 100, 500));
>  
> The test is creating too many files and running over the limit. The last 
> statement was changed in LUCENE-9157 from:
>  
> logmp.setMergeFactor(TestUtil.nextInt(r, 10, 50));
>  
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org

[jira] [Commented] (LUCENE-9168) Test failure after new randomized values in LuceneTestCase

2020-01-24 Thread ASF subversion and git services (Jira) 


[ 
https://issues.apache.org/jira/browse/LUCENE-9168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022945#comment-17022945
 ] 

ASF subversion and git services commented on LUCENE-9168:
-

Commit a29a4f4aa5224fc9a24ab247f0b028994025d820 in lucene-solr's branch 
refs/heads/master from Robert Muir
[ https://gitbox.apache.org/repos/asf?p=lucene-solr.git;h=a29a4f4 ]

LUCENE-9168: don't let crazy tests run us out of open files with these params


> Test failure after new randomized values in LuceneTestCase
> --
>
> Key: LUCENE-9168
> URL: https://issues.apache.org/jira/browse/LUCENE-9168
> Project: Lucene - Core
>  Issue Type: Test
>Reporter: Ignacio Vera
>Priority: Major
>
> The error can be reproduced in branch_8x:
> {code:java}
> ant test  -Dtestcase=TestPointValues -Dtests.method=testTieBreakByDocID 
> -Dtests.seed=A7EAA3BF5766C7C0 -Dtests.slow=true -Dtests.badapples=true 
> -Dtests.locale=my -Dtests.timezone=Singapore -Dtests.asserts=true 
> -Dtests.file.encoding=ISO-8859-1 {code}
>  
> And the error looks like:
> {code:java}
>  07:08:28[junit4]> Caused by: 
> org.apache.lucene.index.MergePolicy$MergeException: 
> java.nio.file.FileSystemException: 
> /var/lib/jenkins/workspace/apache+lucene-solr+branch_8x/lucene/build/core/test/J1/temp/lucene.index.TestPointValues_A7EAA3BF5766C7C0-001/tempDir-002/_bd.tip:
>  Too many open files{code}
>  
> I had a look into the issue and the indexWriter in the test is configured to 
> buffer very few docs:
> c.setMaxBufferedDocs(TestUtil.nextInt(r, 2, 15));
>  
> But the merging factor (LogMergePolicy) is too high:
> logmp.setMergeFactor(TestUtil.nextInt(r, 100, 500));
>  
> The test is creating too many files and running over the limit. The last 
> statement was changed in LUCENE-9157 from:
>  
> logmp.setMergeFactor(TestUtil.nextInt(r, 10, 50));
>  
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org

[jira] [Commented] (LUCENE-9168) Test failure after new randomized values in LuceneTestCase

2020-01-24 Thread Robert Muir (Jira) 


[ 
https://issues.apache.org/jira/browse/LUCENE-9168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022926#comment-17022926
 ] 

Robert Muir commented on LUCENE-9168:
-

oops i will fix. looks like i changed the wrong line. the issue is that it 
indexes thousands of docs.

> Test failure after new randomized values in LuceneTestCase
> --
>
> Key: LUCENE-9168
> URL: https://issues.apache.org/jira/browse/LUCENE-9168
> Project: Lucene - Core
>  Issue Type: Test
>Reporter: Ignacio Vera
>Priority: Major
>
> The error can be reproduced in branch_8x:
> {code:java}
> ant test  -Dtestcase=TestPointValues -Dtests.method=testTieBreakByDocID 
> -Dtests.seed=A7EAA3BF5766C7C0 -Dtests.slow=true -Dtests.badapples=true 
> -Dtests.locale=my -Dtests.timezone=Singapore -Dtests.asserts=true 
> -Dtests.file.encoding=ISO-8859-1 {code}
>  
> And the error looks like:
> {code:java}
>  07:08:28[junit4]> Caused by: 
> org.apache.lucene.index.MergePolicy$MergeException: 
> java.nio.file.FileSystemException: 
> /var/lib/jenkins/workspace/apache+lucene-solr+branch_8x/lucene/build/core/test/J1/temp/lucene.index.TestPointValues_A7EAA3BF5766C7C0-001/tempDir-002/_bd.tip:
>  Too many open files{code}
>  
> I had a look into the issue and the indexWriter in the test is configured to 
> buffer very few docs:
> c.setMaxBufferedDocs(TestUtil.nextInt(r, 2, 15));
>  
> But the merging factor (LogMergePolicy) is too high:
> logmp.setMergeFactor(TestUtil.nextInt(r, 100, 500));
>  
> The test is creating too many files and running over the limit. The last 
> statement was changed in LUCENE-9157 from:
>  
> logmp.setMergeFactor(TestUtil.nextInt(r, 10, 50));
>  
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org

[jira] [Commented] (LUCENE-9168) Test failure after new randomized values in LuceneTestCase

2020-01-24 Thread Ignacio Vera (Jira) 


[ 
https://issues.apache.org/jira/browse/LUCENE-9168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17022905#comment-17022905
 ] 

Ignacio Vera commented on LUCENE-9168:
--

cc [~rmuir]

> Test failure after new randomized values in LuceneTestCase
> --
>
> Key: LUCENE-9168
> URL: https://issues.apache.org/jira/browse/LUCENE-9168
> Project: Lucene - Core
>  Issue Type: Test
>Reporter: Ignacio Vera
>Priority: Major
>
> The error can be reproduced in branch_8x:
> {code:java}
> ant test  -Dtestcase=TestPointValues -Dtests.method=testTieBreakByDocID 
> -Dtests.seed=A7EAA3BF5766C7C0 -Dtests.slow=true -Dtests.badapples=true 
> -Dtests.locale=my -Dtests.timezone=Singapore -Dtests.asserts=true 
> -Dtests.file.encoding=ISO-8859-1 {code}
>  
> And the error looks like:
> {code:java}
>  07:08:28[junit4]> Caused by: 
> org.apache.lucene.index.MergePolicy$MergeException: 
> java.nio.file.FileSystemException: 
> /var/lib/jenkins/workspace/apache+lucene-solr+branch_8x/lucene/build/core/test/J1/temp/lucene.index.TestPointValues_A7EAA3BF5766C7C0-001/tempDir-002/_bd.tip:
>  Too many open files{code}
>  
> I had a look into the issue and the indexWriter in the test is configured to 
> buffer very few docs:
> c.setMaxBufferedDocs(TestUtil.nextInt(r, 2, 15));
>  
> But the merging factor (LogMergePolicy) is too high:
> logmp.setMergeFactor(TestUtil.nextInt(r, 100, 500));
>  
> The test is creating too many files and running over the limit. The last 
> statement was changed in LUCENE-9157 from:
>  
> logmp.setMergeFactor(TestUtil.nextInt(r, 10, 50));
>  
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org