[ 
https://issues.apache.org/jira/browse/HBASE-5064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13172420#comment-13172420
 ] 

nkeywal commented on HBASE-5064:
--------------------------------

There are two issues:

1) open files (-n) 1024
This limit is per process
This is the cause for "too many open file"
This occurs when a test, for a reason or another, goes beyond this limit (some 
of the tests are very close)

2) max user processes (-u) 2048
This limit is per user/machine, not per process!
This is the cause for "unable to create new native thread"
This occurs when the machine runs multiple tests in parallel, and  when all 
tests happen to use a lot of threads.

Both must be changed. As we should limit the number of file descriptor used, it 
makes sense to set open files to something reasonable (like 2048 or 4096), but 
the number of max user processes could be set to unlimited without any issue, 
as when it fails it's because there are other processes using threads as well, 
and we don't control them.



                
> use surefire tests parallelization
> ----------------------------------
>
>                 Key: HBASE-5064
>                 URL: https://issues.apache.org/jira/browse/HBASE-5064
>             Project: HBase
>          Issue Type: Improvement
>          Components: test
>    Affects Versions: 0.94.0
>            Reporter: nkeywal
>            Assignee: nkeywal
>            Priority: Minor
>         Attachments: 5064.patch, 5064.patch, 5064.v2.patch, 5064.v3.patch, 
> 5064.v4.patch, 5064.v5.patch, 5064.v6.patch, 5064.v7.patch
>
>
> To be tried multiple times on hadoop-qa before committing.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to