RE: Too many open files
Yes, had that too in the past, ulimit -H -n 65535 cured the issue. Laurent • This email and any files transmitted with it are CONFIDENTIAL and intended solely for the use of the individual or entity to which they are addressed. • Any unauthorized copying, disclosure, or distribution of the material within this email is strictly forbidden. • Any views or opinions presented within this e-mail are solely those of the author and do not necessarily represent those of Odyssey Financial Technologies SA unless otherwise specifically stated. • An electronic message is not binding on its sender. Any message referring to a binding engagement must be confirmed in writing and duly signed. • If you have received this email in error, please notify the sender immediately and delete the original.
Re: Too many open files
On 16/12/10 16:49, john muth wrote: I hit this problem not too long ago and decided the o/s default limit of 1024 was too low for what we were trying to do. For me, on Redhat, the solution was to edit /etc/security/limits.conf tomcatuser hard nofile 65535 tomcatuser soft nofile 65535 On 17/12/10 08:41, Laurent Medioni wrote: Yes, had that too in the past, ulimit -H -n 65535 cured the issue. Thanks, I'll try. And presumably reboot the server. ///Peter - To unsubscribe, e-mail: users-unsubscr...@cocoon.apache.org For additional commands, e-mail: users-h...@cocoon.apache.org
Re: Too many open files
Hello, Le 16/12/2010 13:58, Peter Flynn a écrit : Caused by: java.net.SocketException: Too many open files at java.net.Socket.createImpl(Socket.java:388) at java.net.Socket.connect(Socket.java:517) at java.net.Socket.connect(Socket.java:469) at sun.net.NetworkClient.doConnect(NetworkClient.java:157) at sun.net.www.http.HttpClient.openServer(HttpClient.java:394) In my ignorance of the internals of Cocoon and Tomcat and Java, is it running out of file handles when making a HTTP call? The server is lightly loaded, but each page does open a significant number of document()s: is there a setting that will increase the number of open files allowed? We already have seen this issue on some cocoon applications ; most of the time, that was due to intensive use of xpath document function with. We observe that using saxon as xslt processor genrerally solved that issue. Most of these issues has been resolved for us doing that ; some are always present but I did not have time to further investigate yet. Is there any way to get it to report *what* it was trying to open (the URI) when it failed? ///Peter Hope that could help you. Regards, -- Johan Cwiklinski AJLSM - To unsubscribe, e-mail: users-unsubscr...@cocoon.apache.org For additional commands, e-mail: users-h...@cocoon.apache.org
Re: Too many open files
On 16/12/10 13:03, Johan Cwiklinski wrote: Hello, Le 16/12/2010 13:58, Peter Flynn a écrit : Caused by: java.net.SocketException: Too many open files at java.net.Socket.createImpl(Socket.java:388) at java.net.Socket.connect(Socket.java:517) at java.net.Socket.connect(Socket.java:469) at sun.net.NetworkClient.doConnect(NetworkClient.java:157) at sun.net.www.http.HttpClient.openServer(HttpClient.java:394) In my ignorance of the internals of Cocoon and Tomcat and Java, is it running out of file handles when making a HTTP call? The server is lightly loaded, but each page does open a significant number of document()s: is there a setting that will increase the number of open files allowed? We already have seen this issue on some cocoon applications ; most of the time, that was due to intensive use of xpath document function with. We observe that using saxon as xslt processor genrerally solved that issue. I have had that on my TODO list for some time. About time to do it...thanks. ///Peter - To unsubscribe, e-mail: users-unsubscr...@cocoon.apache.org For additional commands, e-mail: users-h...@cocoon.apache.org
Re: Too many open files
Hi all, if you're in a Cocoon environment, it's always a good idea to avoid the document function. Cocoon offers so many better ways like map:aggregate or the CInclude transformer preserving the cache functionalities. Greetings Andreas From: Johan Cwiklinski johan.cwiklin...@ajlsm.com To: users@cocoon.apache.org Sent: Thu, December 16, 2010 2:03:25 PM Subject: Re: Too many open files Hello, Le 16/12/2010 13:58, Peter Flynn a écrit : Caused by: java.net.SocketException: Too many open files at java.net.Socket.createImpl(Socket.java:388) at java.net.Socket.connect(Socket.java:517) at java.net.Socket.connect(Socket.java:469) at sun.net.NetworkClient.doConnect(NetworkClient.java:157) at sun.net.www.http.HttpClient.openServer(HttpClient.java:394) In my ignorance of the internals of Cocoon and Tomcat and Java, is it running out of file handles when making a HTTP call? The server is lightly loaded, but each page does open a significant number of document()s: is there a setting that will increase the number of open files allowed? We already have seen this issue on some cocoon applications ; most of the time, that was due to intensive use of xpath document function with. We observe that using saxon as xslt processor genrerally solved that issue. Most of these issues has been resolved for us doing that ; some are always present but I did not have time to further investigate yet. Is there any way to get it to report *what* it was trying to open (the URI) when it failed? ///Peter Hope that could help you. Regards, -- Johan Cwiklinski AJLSM - To unsubscribe, e-mail: users-unsubscr...@cocoon.apache.org For additional commands, e-mail: users-h...@cocoon.apache.org
Re: Too many open files
On 16/12/10 14:39, Andreas Kuehne wrote: Hi all, if you're in a Cocoon environment, it's always a good idea to avoid the document function. Cocoon offers so many better ways like map:aggregate or the CInclude transformer preserving the cache functionalities. Thank you, that sounds like a useful tip, although I wasn't aware of either of them. The problem is that the XSLT I am using also needs to run standalone (ie outside Cocoon) for other reasons, so I was trying to avoid too much Cocoon dependency. ///Peter - To unsubscribe, e-mail: users-unsubscr...@cocoon.apache.org For additional commands, e-mail: users-h...@cocoon.apache.org
Re: Too many open files
I hit this problem not too long ago and decided the o/s default limit of 1024 was too low for what we were trying to do. For me, on Redhat, the solution was to edit /etc/security/limits.conf tomcatuser hard nofile 65535 tomcatuser soft nofile 65535 --- On Thu, 12/16/10, Peter Flynn pfl...@ucc.ie wrote: From: Peter Flynn pfl...@ucc.ie Subject: Re: Too many open files To: users@cocoon.apache.org Date: Thursday, December 16, 2010, 4:00 PM On 16/12/10 14:39, Andreas Kuehne wrote: Hi all, if you're in a Cocoon environment, it's always a good idea to avoid the document function. Cocoon offers so many better ways like map:aggregate or the CInclude transformer preserving the cache functionalities. Thank you, that sounds like a useful tip, although I wasn't aware of either of them. The problem is that the XSLT I am using also needs to run standalone (ie outside Cocoon) for other reasons, so I was trying to avoid too much Cocoon dependency. ///Peter - To unsubscribe, e-mail: users-unsubscr...@cocoon.apache.org For additional commands, e-mail: users-h...@cocoon.apache.org - To unsubscribe, e-mail: users-unsubscr...@cocoon.apache.org For additional commands, e-mail: users-h...@cocoon.apache.org
Re: too many open files
...What do you mean by what kind of app is this?... The question is, what are your application patterns, i.e. do you use many XSLT transforms, or the SQLTransformer, often call external processes, use a lot of Flow and/or CForms, etc.. And i would add: running with Tomcat under Linux with a non-privileged user? (see /etc/security/limits.conf) Cayetano - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
RE: too many open files
I heard something about a Java bug that seemed to cause these kinds of errors. What version of Java are you using and what happens if you update to the latest version (if you are not yet using it?) Kind regards, Geert Drs. G.P.H. Josten Consultant Daidalos BV Source of Innovation Hoekeindsehof 1-4 2665 JZ Bleiswijk Tel.: +31 (0) 10 850 1200 Fax: +31 (0) 10 850 1199 www.daidalos.nl De informatie - verzonden in of met dit emailbericht - is afkomstig van Daidalos BV en is uitsluitend bestemd voor de geadresseerde. Indien u dit bericht onbedoeld hebt ontvangen, verzoeken wij u het te verwijderen. Aan dit bericht kunnen geen rechten worden ontleend. Van: Bokluci Bokluci [mailto:[EMAIL PROTECTED] Verzonden: maandag 3 juli 2006 19:01 Aan: users@cocoon.apache.org Onderwerp: too many open files hi, from time to time my cocoon get this error message: Too Many Open Files Sometimes after refresh it continues work, but sometimes it needs to be restarted. Is there any way to fix this issue? - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
RE: too many open files
Hi Bokluci, In case you're running Cocoon on Linux, these are my experiences with the "too many open files" issue. I used this in the past to raise the number of open files, which might not be the actual solution to your problem, but at least it will give you some pointers for where to look at. * login as root user*check 'ulimit -n', this will show you the current limit of open files*edit /etc/security/limits.conf:** soft nofile 8192** hard nofile 65535*edit /etc/pam.d/sshd:** session required /lib/security/pam_limits.so* 'ulimit -n 8192' (set limit to 8192)* 'service sshd restart' (or /etc/init.d/sshd restart)* logoff* logon again and check 'ulimit -n', this will show you the new values The maximum number of open files is limited to the capabilities of the filesystem in use. You can find the max number for *all processes combined* by doing 'cat /proc/sys/fs/file-max'. It's normally somewhere between 100.000 and 500.000.If you set the hard limit in limits.conf to high, you might block the filesystem which makes the server unreliable and even block SSH shells!! 8192 is a common setting. Good luck, Kind regards,Arjé CahnHippoOosteinde 111017WT AmsterdamThe NetherlandsTel +31 (0)20 5224466-[EMAIL PROTECTED] / www.hippo.nl / [EMAIL PROTECTED]-- From: Bokluci Bokluci [mailto:[EMAIL PROTECTED] Posted At: maandag 3 juli 2006 19:01Posted To: Cocoon User ListConversation: too many open filesSubject: too many open fileshi,from time to time my cocoon get this error message:Too Many Open FilesSometimes after refresh it continues work, but sometimes it needs to be restarted.Is there any way to fix this issue?
Re: too many open files
On 7/4/06, Geert Josten [EMAIL PROTECTED] wrote: ...I heard something about a Java bug that seemed to cause these kinds of errors... Which might be: using the Process object and not explicitely closing its channels, see http://codeconsult.ch/bertrand/archives/000456.html -Bertrand - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
RE: too many open files
As a matter of a fact I'm not using cocoon with combination with tomcat, should I? Are there any drawbacks if I use it alone with the standard bundled server? -Original Message- From: Cayetano [mailto:[EMAIL PROTECTED] Sent: Tuesday, July 04, 2006 8:13 AM To: users@cocoon.apache.org Subject: Re: too many open files ...What do you mean by what kind of app is this?... The question is, what are your application patterns, i.e. do you use many XSLT transforms, or the SQLTransformer, often call external processes, use a lot of Flow and/or CForms, etc.. And i would add: running with Tomcat under Linux with a non-privileged user? (see /etc/security/limits.conf) Cayetano - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: too many open files
On 7/4/06, Bokluci [EMAIL PROTECTED] wrote: ...Are there any drawbacks if I use it alone with the standard bundled server?... Not necessarily, it's not optimized for very high loads but runs just fine on several of my production systems, with up to 9 months uptime until now. -Bertrand - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
RE: too many open files
How high should be very high load? over 10 000 hits a day? Are there any drawbacks running cocoon as non privileged user? -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Bertrand Delacretaz Sent: Tuesday, July 04, 2006 1:34 PM To: users@cocoon.apache.org Subject: Re: too many open files On 7/4/06, Bokluci [EMAIL PROTECTED] wrote: ...Are there any drawbacks if I use it alone with the standard bundled server?... Not necessarily, it's not optimized for very high loads but runs just fine on several of my production systems, with up to 9 months uptime until now. -Bertrand - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: too many open files
On 7/3/06, Bokluci Bokluci [EMAIL PROTECTED] wrote: ...from time to time my cocoon get this error message: Too Many Open Files... We need more info to help, what kind of app is this, what components of Cocoon and what external components are you using? -Bertrand - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
RE: too many open files
No special components, just cocoon started with cocoon servlet. What do you mean by what kind of app is this? -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Bertrand Delacretaz Sent: Monday, July 03, 2006 9:35 PM To: users@cocoon.apache.org Subject: Re: too many open files On 7/3/06, Bokluci Bokluci [EMAIL PROTECTED] wrote: ...from time to time my cocoon get this error message: Too Many Open Files... We need more info to help, what kind of app is this, what components of Cocoon and what external components are you using? -Bertrand - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED] - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
Re: too many open files
On 7/4/06, Bokluci [EMAIL PROTECTED] wrote: ...What do you mean by what kind of app is this?... The question is, what are your application patterns, i.e. do you use many XSLT transforms, or the SQLTransformer, often call external processes, use a lot of Flow and/or CForms, etc.. -Bertrand - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
RE: Too many open files error
I am running a single Cocoon app on the server, and am the only one testing it... despite this, I get a: cause: java.io.FileNotFoundException: /usr/local/jakarta-tomcat-4.1.31/webapps/cocoon/myapp/myfile.xml (Too many open files) error when I try and load CForm-based page. The server is Linux-based, but on my test machine (Windows) I did not notice this problem. Check ulimit -n on the linux box - you may need to increase this setting in the shell script which launches Tomcat (if you can). jon This electronic message contains information which may be privileged and confidential. The information is intended to be for the use of the individual(s) or entity named above. If you are not the intended recipient, be aware that any disclosure, copying, distribution or use of the contents of this information is prohibited. If you have received this electronic message in error, please notify us by telephone on 0131 476 6000 and delete the material from your computer. - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
