Thanks to all for taking the time and responding, I will set the ulimits to
more reasonable limits
since that seems to work better.
Regards.
Krishna Harathi
On Mon, May 18, 2015 at 9:10 AM, Frank Filz <ffilz...@mindspring.com> wrote:
> > Krishna Harathi [khara...@exablox.com] wrote:
> > > I am trying to determine the relation between the system imposed
> limit
> > of
> > > max FDs (4096 now) and
> > > the Cache Inode HW Mark (100000 default).
> > > In a test work load, I am getting errno 24 (too many open files)
> error
> > > returned,
> > > and here is our current settings.
> > > 15/05/2015 18:48:23 : epoch 5556a1e7 : OneBlox-0333 :
> > > nfs-ganesha-12814[main] cache_inode_lru_pkginit :INODE LRU :INFO
> > > :Attempting to increase soft limit from 1024 to hard limit of 4096
> > > 15/05/2015 18:48:23 : epoch 5556a1e7 : OneBlox-0333 :
> > > nfs-ganesha-12814[main] cache_inode_lru_pkginit :INODE LRU :INFO
> > :Setting
> > > the system-imposed limit on FDs to 4096
> > > I looked at the related code in Cache_inode but could not determine
> the
> > > relationship between
> > > the system limit and cache_inode or how many file FDs Ganesha will
> try to
> > > open.
> > > Any help is (1) What is the system limit to be set, given the
> default
> > > cache inode HWmark?
> >
> > Cache inode entries can exist without the corresponding file being open.
> > So I don't think there is a relation between Entries_HWMark and the
> > number of file descriptors a process can open.
> >
> > > (2) For the given system limit, what is the cache inode setting. We
> are
> > > using Ganesha 2.1.
> >
> > The number of cache entries is probably related to the available system
> > memory rather than the number of files a process can open. Frank or
> anyone
> > else, what is a good value on systems with 128GB or 256GB system memory?
>
> A good number of cache inodes probably depends on a lot of things.
>
> One thing to consider is if you have lots of large directories that will be
> enumerated with READDIR is that you probably need at least twice that many
> cache inodes to prevent READDIR from upchucking all over the floor.
>
> When multiple filedescriptors come in, we will really need to make sure we
> can have as many open files as possible since there will be lots of extra
> open files.
>
> Frank
>
>
------------------------------------------------------------------------------
One dashboard for servers and applications across Physical-Virtual-Cloud
Widest out-of-the-box monitoring support with 50+ applications
Performance metrics, stats and reports that give you Actionable Insights
Deep dive visibility with transaction tracing using APM Insight.
http://ad.doubleclick.net/ddm/clk/290420510;117567292;y
_______________________________________________
Nfs-ganesha-devel mailing list
Nfs-ganesha-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nfs-ganesha-devel