Thanks to all for taking the time and responding, I will set the ulimits to
more reasonable limits
since that seems to work better.

Regards.
Krishna Harathi

On Mon, May 18, 2015 at 9:10 AM, Frank Filz <ffilz...@mindspring.com> wrote:

> > Krishna Harathi [khara...@exablox.com] wrote:
> > >    I am trying to determine the relation between the system imposed
> limit
> > of
> > >    max FDs (4096 now) and
> > >    the Cache Inode HW Mark (100000 default).
> > >    In a test work load, I am getting errno 24 (too many open files)
> error
> > >    returned,
> > >    and here is our current settings.
> > >    15/05/2015 18:48:23 : epoch 5556a1e7 : OneBlox-0333 :
> > >    nfs-ganesha-12814[main] cache_inode_lru_pkginit :INODE LRU :INFO
> > >    :Attempting to increase soft limit from 1024 to hard limit of 4096
> > >    15/05/2015 18:48:23 : epoch 5556a1e7 : OneBlox-0333 :
> > >    nfs-ganesha-12814[main] cache_inode_lru_pkginit :INODE LRU :INFO
> > :Setting
> > >    the system-imposed limit on FDs to 4096
> > >    I looked at the related code in Cache_inode but could not determine
> the
> > >    relationship between
> > >    the system limit and cache_inode or how many file FDs Ganesha will
> try to
> > >    open.
> > >    Any help is (1) What is the system limit to be set, given the
> default
> > >    cache inode HWmark?
> >
> > Cache inode entries can exist without the corresponding file being open.
> > So I don't think there is a relation between  Entries_HWMark and the
> > number of file descriptors a process can open.
> >
> > >    (2) For the given system limit, what is the cache inode setting. We
> are
> > >    using Ganesha 2.1.
> >
> > The number of cache entries is probably related to the available system
> > memory rather than the number of files a process can open. Frank or
> anyone
> > else, what is a good value on systems with 128GB or 256GB system memory?
>
> A good number of cache inodes probably depends on a lot of things.
>
> One thing to consider is if you have lots of large directories that will be
> enumerated with READDIR is that you probably need at least twice that many
> cache inodes to prevent READDIR from upchucking all over the floor.
>
> When multiple filedescriptors come in, we will really need to make sure we
> can have as many open files as possible since there will be lots of extra
> open files.
>
> Frank
>
>
------------------------------------------------------------------------------
One dashboard for servers and applications across Physical-Virtual-Cloud 
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
_______________________________________________
Nfs-ganesha-devel mailing list
Nfs-ganesha-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nfs-ganesha-devel

Reply via email to