Re: file descriptors and threads differing

[Satya Marivada]

We have the same ulimits in both cases.

/proc/2/fd:
lr-x-- 1 Dgisse pg014921_gisse 64 May 12 09:52 124 ->
/sanfs/mnt/vol01/solr/solr-6.3.0/contrib/extraction/lib/apache-mime4j-core-0.7.2.jar
lr-x-- 1 Dgisse pg014921_gisse 64 May 12 09:52 125 ->
/sanfs/mnt/vol01/solr/solr-6.3.0/contrib/extraction/lib/apache-mime4j-core-0.7.2.jar
lr-x-- 1 Dgisse pg014921_gisse 64 May 12 09:52 126 ->
/sanfs/mnt/vol01/solr/solr-6.3.0/contrib/extraction/lib/apache-mime4j-core-0.7.2.jar
lr-x-- 1 Dgisse pg014921_gisse 64 May 12 09:52 127 ->
/sanfs/mnt/vol01/solr/solr-6.3.0/contrib/extraction/lib/apache-mime4j-core-0.7.2.jar
lr-x-- 1 Dgisse pg014921_gisse 64 May 12 09:52 128 ->
/sanfs/mnt/vol01/solr/solr-6.3.0/contrib/extraction/lib/apache-mime4j-dom-0.7.2.jar
lr-x-- 1 Dgisse pg014921_gisse 64 May 12 09:52 129 ->
/sanfs/mnt/vol01/solr/solr-6.3.0/contrib/extraction/lib/apache-mime4j-dom-0.7.2.jar


The same process is opening many files. In linux, isn't it that only one fd
should be opened and referenced by all threads in the process.

In case of other environment, where the jvm is different in minor version,
it opens less number of multiple files. Trying to set both of them at the
same jvm level and see how it goes.


Thanks,
Satya


On Fri, May 12, 2017 at 3:41 PM Erick Erickson 
wrote:

> Check the system settings with ulimit. Differing numbers of user processes
> or open files can cause things like this to be different on different
> boxes.
>
> Can't speak to the Java version.
>
> Best,
> Erick
>
> On Fri, May 12, 2017 at 11:56 AM, Satya Marivada <
> satya.chaita...@gmail.com>
> wrote:
>
> > Hi All,
> >
> > We have a weird problem, with the threads being opened many and crashing
> > the app in PP7 (one of our environment). It is the same index, same
> version
> > of solr (6.3.0) and zookeeper (3.4.9) in both environments.
> > Java minor version is different (1.8.0_102 in PP8 (one of our
> environment)
> > shown below vs 1.8.0_121 in PP7(one other environment)).
> >
> > Any ideas around why files open and threads are more in one environment
> vs
> > other.
> >
> > Files open is found by looking for fd in /proc/ directory and threads
> > found by ps -elfT | wc -l.
> >
> > [image: pasted1]
> >
> > Thanks,
> > Satya
> >
>

Re: file descriptors and threads differing

[Erick Erickson]

Check the system settings with ulimit. Differing numbers of user processes
or open files can cause things like this to be different on different boxes.

Can't speak to the Java version.

Best,
Erick

On Fri, May 12, 2017 at 11:56 AM, Satya Marivada 
wrote:

> Hi All,
>
> We have a weird problem, with the threads being opened many and crashing
> the app in PP7 (one of our environment). It is the same index, same version
> of solr (6.3.0) and zookeeper (3.4.9) in both environments.
> Java minor version is different (1.8.0_102 in PP8 (one of our environment)
> shown below vs 1.8.0_121 in PP7(one other environment)).
>
> Any ideas around why files open and threads are more in one environment vs
> other.
>
> Files open is found by looking for fd in /proc/ directory and threads
> found by ps -elfT | wc -l.
>
> [image: pasted1]
>
> Thanks,
> Satya
>

file descriptors and threads differing

[Satya Marivada]

Hi All,

We have a weird problem, with the threads being opened many and crashing
the app in PP7 (one of our environment). It is the same index, same version
of solr (6.3.0) and zookeeper (3.4.9) in both environments.
Java minor version is different (1.8.0_102 in PP8 (one of our environment)
shown below vs 1.8.0_121 in PP7(one other environment)).

Any ideas around why files open and threads are more in one environment vs
other.

Files open is found by looking for fd in /proc/ directory and threads found
by ps -elfT | wc -l.

[image: pasted1]

Thanks,
Satya