On Tue, Jun 27, 2017 at 02:06:51PM +0000, Luis Huang wrote:
> I???ve tried setting S_DESCRIPTORS, it still cap it at 65535. When running PE 
> jobs, it also multiplies the cores with the max open file value. Even if I 
> set a realistic ulimit, it will hit the threshold with high slots job.
> 
> Thanks!
> Luis
Assuming linux what does sysctl fs.file-max report?

William



> 
> On 6/27/17, 4:22 AM, "William Hay" <[email protected]> wrote:
> 
>     On Mon, Jun 26, 2017 at 05:24:57PM +0000, Luis Huang wrote:
>     >    Hi,
>     >
>     >
>     >
>     >    To increase the max open file, we have set execd_params in qconf 
> -mconf
>     >    and also on the OS level:
>     >
>     >    execd_params
>     >    H_DESCRIPTORS=262144,H_LOCKS=262144,H_MAXPROC=262144
>     >
>     >
>     >
>     >    On our execution nodes we can see that SGE sets a soft limit of 65535
>     >    despite that we told it to set it to 262144.
>     From the above it appears you set the hard limit
> 
> 
>     >
>     >    Max open files            65535                262144               
> files
>     >
>     >
>     Which appears to have been set.    Perhaps you could try setting the soft 
> limit
>     (S_DESCRIPTORS) to whatever value you think appropriate.
> 
>     William
> 
> 
> This electronic message is intended for the use of the named recipient only, 
> and may contain information that is confidential, privileged or protected 
> from disclosure under applicable law. If you are not the intended recipient, 
> or an employee or agent responsible for delivering this message to the 
> intended recipient, you are hereby notified that any reading, disclosure, 
> dissemination, distribution, copying or use of the contents of this message 
> including any of its attachments is strictly prohibited. If you have received 
> this message in error or are not the named recipient, please notify us 
> immediately by contacting the sender at the electronic mail address noted 
> above, and destroy all copies of this message. Please note, the recipient 
> should check this email and any attachments for the presence of viruses. The 
> organization accepts no liability for any damage caused by any virus 
> transmitted by this email.

Attachment: signature.asc
Description: Digital signature

_______________________________________________
users mailing list
[email protected]
https://gridengine.org/mailman/listinfo/users

Reply via email to