I have been seeing a bunch of random failures, both in Solr tests and my
own SolrJ programs. They all start with the following in the stacktrace:
java.lang.OutOfMemoryError: unable to create new native thread
at java.lang.Thread.start0(Native Method)
at java.lang.Thread.start(Thread.java:691)
Common elements: 1) SolrJ/Solr 4.1-SNAPSHOT. 2) G1 garbage collector.
3) Built and run with oracle jdk 1.7.0_09 on CentOS 6 x64, using RPMs
created with the following guide:
http://www.city-fan.org/tips/OracleJava7OnFedora
One of the programs consistently uses less than 25MB of heap, because it
uses idle moments to do garbage collection. I have watched the heap
with jconsole to verify this. It has been configured with a max heap of
1GB, so I am very sure that there is no actual memory pressure.
Since rebooting and upgrading to 1.7.0_10, I have not seen any further
OOM problems despite pounding on everything repeatedly. Has anyone else
seen anything similar?
Thanks,
Shawn