Re: Apache Tomcat Memory Pool
- This idea sounds good. Yes there is a table field in this application where all the requests will be displayed as in the overview console. Is it in the field properties of the table field I have to check for the server details if any? No - what I would do is export that form, either as an xml def (preferably an xml def as those are more easily editable) and check for 'hardcoded' server names.. Server names in definitions should appear as @ instead of the real server name value. If you export the definition as a xml file, look for the tag ServerName and you will find the value in that tag.. If you do find hardcoded server names that should not have been hardcoded, then you will need to clean that up - replace that name with @ if that piece of workflow or tablefield or object is referencing the current server. If you do have workflow that points to another server, then make sure that the server it is pointing to, is contactable from your development box that you are having an issue with.. Joe From: remedydon mrohinikanth2...@gmail.com To: arslist@ARSLIST.ORG Sent: Sunday, July 26, 2009 9:10:25 PM Subject: Re: Apache Tomcat Memory Pool Hi Joe, Is there any server or host referenced in the application that you built, that the web server may not have access to? Maybe there is a hard coded server name in the table fields on that application referencing a server that the web server cannot communicate with? - This idea sounds good. Yes there is a table field in this application where all the requests will be displayed as in the overview console. Is it in the field properties of the table field I have to check for the server details if any? Have you looked at the logs in the catalina.out file? These may tell you a thing or two. Also turn on your workflow logging for the mid-tier. This may tell you something too.. - I will check this catalina.out file also and will see if it is of any help. thanks, Joe From: remedydon mrohinikanth2...@gmail.com To: arslist@ARSLIST.ORG Sent: Thursday, July 23, 2009 10:19:59 PM Subject: Re: Apache Tomcat Memory Pool I tried these settings keeping min and max pool sizes same. Tomcat did not crash. I have thread stack size = NuLL. Do I have to set a value for thread stack size ? This mysterious HTTP 500 status error still is not gone when I'm trying toaccess the custom built appllication through mid-tier while other Out of the box apps are opening fine. Thanks, Joe ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor:rmisoluti...@verizon.net ARSlist: Where the Answers Are
Re: Apache Tomcat Memory Pool
I doubt adjusting the stack size in any way will help. HTTP 500 is a web client to web server communication error and changing the stack size will not to much if this communication is failing in the first place. Does the Tomcat server crash at the time you get the 500 errors? I'm doubting it must be but it would be a nice to know kind of a thing.. Is there any server or host referenced in the application that you built, that the web server may not have access to? Maybe there is a hard coded server name in the table fields on that application referencing a server that the web server cannot communicate with? Have you looked at the logs in the catalina.out file? These may tell you a thing or two. Also turn on your workflow logging for the mid-tier. This may tell you something too.. Joe From: remedydon mrohinikanth2...@gmail.com To: arslist@ARSLIST.ORG Sent: Thursday, July 23, 2009 10:19:59 PM Subject: Re: Apache Tomcat Memory Pool I tried these settings keeping min and max pool sizes same. Tomcat did not crash. I have thread stack size = NuLL. Do I have to set a value for thread stack size ? This mysterious HTTP 500 status error still is not gone when I'm trying toaccess the custom built appllication through mid-tier while other Out of the box apps are opening fine. Thanks, Joe ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor:rmisoluti...@verizon.net ARSlist: Where the Answers Are
Re: Apache Tomcat Memory Pool
Hi Joe, Is there any server or host referenced in the application that you built, that the web server may not have access to? Maybe there is a hard coded server name in the table fields on that application referencing a server that the web server cannot communicate with? - This idea sounds good. Yes there is a table field in this application where all the requests will be displayed as in the overview console. Is it in the field properties of the table field I have to check for the server details if any? Have you looked at the logs in the catalina.out file? These may tell you a thing or two. Also turn on your workflow logging for the mid-tier. This may tell you something too.. - I will check this catalina.out file also and will see if it is of any help. thanks, Joe From: remedydon mrohinikanth2...@gmail.com To: arslist@ARSLIST.ORG Sent: Thursday, July 23, 2009 10:19:59 PM Subject: Re: Apache Tomcat Memory Pool I tried these settings keeping min and max pool sizes same. Tomcat did not crash. I have thread stack size = NuLL. Do I have to set a value for thread stack size ? This mysterious HTTP 500 status error still is not gone when I'm trying toaccess the custom built appllication through mid-tier while other Out of the box apps are opening fine. Thanks, Joe ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor:rmisoluti...@verizon.net ARSlist: Where the Answers Are -- View this message in context: http://www.nabble.com/Apache-Tomcat-Memory-Pool-tp21815259p24672211.html Sent from the ARS (Action Request System) mailing list archive at Nabble.com. ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor:rmisoluti...@verizon.net ARSlist: Where the Answers Are
Re: Apache Tomcat Memory Pool
No, we do not have Load balancer. Thanks, J -- View this message in context: http://www.nabble.com/Apache-Tomcat-Memory-Pool-tp21815259p24637524.html Sent from the ARS (Action Request System) mailing list archive at Nabble.com. ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor:rmisoluti...@verizon.net ARSlist: Where the Answers Are
Re: Apache Tomcat Memory Pool
I tried these settings keeping min and max pool sizes same. Tomcat did not crash. I have thread stack size = NuLL. Do I have to set a value for thread stack size ? This mysterious HTTP 500 status error still is not gone when I'm trying to access the custom built appllication through mid-tier while other Out of the box apps are opening fine. Thanks, Joe -- View this message in context: http://www.nabble.com/Apache-Tomcat-Memory-Pool-tp21815259p24637626.html Sent from the ARS (Action Request System) mailing list archive at Nabble.com. ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor:rmisoluti...@verizon.net ARSlist: Where the Answers Are
Re: Apache Tomcat Memory Pool
I did flush the Mid-tier. Restarted the tomcat services. deleted the temporary internet files from the webbrowser. We have ARSystem v.7.1, ITSM 7.1 no patches. Recently upgraded to Mid-Tier 7.1 patch 7. Tomcat 5.5.25 Tomcat does not crash at all. But, somehow when we are trying to access the in-house built application through mid-tier I'm getting thiss HTTP 500 status message as shown in the previous posting. Thanks for your response, J -- View this message in context: http://www.nabble.com/Apache-Tomcat-Memory-Pool-tp21815259p24609631.html Sent from the ARS (Action Request System) mailing list archive at Nabble.com. ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor:rmisoluti...@verizon.net ARSlist: Where the Answers Are
Re: Apache Tomcat Memory Pool
The Operating System would also help as Windows has some very different possibilities than Solaris/HP/Linux Fred -Original Message- From: Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of remedydon Sent: Wednesday, July 22, 2009 11:20 AM To: arslist@ARSLIST.ORG Subject: Re: Apache Tomcat Memory Pool I did flush the Mid-tier. Restarted the tomcat services. deleted the temporary internet files from the web browser. We have ARSystem v.7.1, ITSM 7.1 no patches. Recently upgraded to Mid-Tier 7.1 patch 7. Tomcat 5.5.25 Tomcat does not crash at all. But, somehow when we are trying to access the in-house built application through mid-tier I'm getting this HTTP 500 status message as shown in the previous posting. Thanks for your response, J -Original Message- From: Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Joe DeSouza Sent: Tuesday, July 21, 2009 11:46 PM To: arslist@ARSLIST.ORG Subject: Re: Apache Tomcat Memory Pool Did you flush your Mid-Tier cache would be the first obvious question to ask?? Secondly it would be good to know what versions of your AR Server and Mid-Tier you are dealing with. Joe -Original Message- From: remedydon mrohinikanth2...@gmail.com To: arslist@ARSLIST.ORG Sent: Wednesday, July 22, 2009 12:02:50 AM Subject: Re: Apache Tomcat Memory Pool Hi, I did change the java pool sizes min = 1024 and max = 1536 (BMC recommended). tomcat is not crashing. I'm able to access all the out of the box applications (Helpdesk, Change module, requestor console, etc) but the custom built application which throws the HTTP 500 error (generic error) as follows. java.lang.NullPointerException at com.remedy.arsys.goat.field.GoatField.addToOutputNotes(Unknown Source) at com.remedy.arsys.goat.field.FieldGraph$Node.recurAddToOutputNotes(Unknown Source) at com.remedy.arsys.goat.field.FieldGraph$Node.recurAddToOutputNotes(Unknown Source) at com.remedy.arsys.goat.field.FieldGraph$Node.access$1200(Unknown Source) at com.remedy.arsys.goat.field.FieldGraph.instantiateFields(Unknown Source) at com.remedy.arsys.goat.field.FieldGraph.getHTMLData(Unknown Source) at com.remedy.arsys.goat.field.FieldGraph.transmitHTML(Unknown Source) at com.remedy.arsys.stubs.FormServlet.requestDispatch(Unknown Source) at com.remedy.arsys.stubs.FormServlet.doRequest(Unknown Source) at com.remedy.arsys.stubs.GoatServlet.postInternal(Unknown Source) at com.remedy.arsys.stubs.GoatHttpServlet.doPost(Unknown Source) at javax.servlet.http.HttpServlet.service(HttpServlet.java:710) at javax.servlet.http.HttpServlet.service(HttpServlet.java:803) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:269) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:174) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:117) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:108) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:151) at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:874) at org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:665) at org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:528) at org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:81) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:689) at java.lang.Thread.run(Thread.java:595) - Servlet.service() for servlet FormServlet threw exception Appreciate your response, J ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor:rmisoluti...@verizon.net ARSlist: Where the Answers Are
Re: Apache Tomcat Memory Pool
Hi, I did change the java pool sizes min = 1024 and max = 1536 (BMC recommended). tomcat is not crashing. I'm able to access all the out of the box applications (Helpdesk, Change module, requestor console, etc) but the custom built application which throws the HTTP 500 error (generic error) as follows. java.lang.NullPointerException at com.remedy.arsys.goat.field.GoatField.addToOutputNotes(Unknown Source) at com.remedy.arsys.goat.field.FieldGraph$Node.recurAddToOutputNotes(Unknown Source) at com.remedy.arsys.goat.field.FieldGraph$Node.recurAddToOutputNotes(Unknown Source) at com.remedy.arsys.goat.field.FieldGraph$Node.access$1200(Unknown Source) at com.remedy.arsys.goat.field.FieldGraph.instantiateFields(Unknown Source) at com.remedy.arsys.goat.field.FieldGraph.getHTMLData(Unknown Source) at com.remedy.arsys.goat.field.FieldGraph.transmitHTML(Unknown Source) at com.remedy.arsys.stubs.FormServlet.requestDispatch(Unknown Source) at com.remedy.arsys.stubs.FormServlet.doRequest(Unknown Source) at com.remedy.arsys.stubs.GoatServlet.postInternal(Unknown Source) at com.remedy.arsys.stubs.GoatHttpServlet.doPost(Unknown Source) at javax.servlet.http.HttpServlet.service(HttpServlet.java:710) at javax.servlet.http.HttpServlet.service(HttpServlet.java:803) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:269) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:174) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:117) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:108) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:151) at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:874) at org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:665) at org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:528) at org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:81) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:689) at java.lang.Thread.run(Thread.java:595) - Servlet.service() for servlet FormServlet threw exception Appreciate your response, J -- View this message in context: http://www.nabble.com/Apache-Tomcat-Memory-Pool-tp21815259p24599739.html Sent from the ARS (Action Request System) mailing list archive at Nabble.com. ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor:rmisoluti...@verizon.net ARSlist: Where the Answers Are
Re: Apache Tomcat Memory Pool
Did you flush your Mid-Tier cache would be the first obvious question to ask?? Secondly it would be good to know what versions of your AR Server and Mid-Tier you are dealing with. Joe From: remedydon mrohinikanth2...@gmail.com To: arslist@ARSLIST.ORG Sent: Wednesday, July 22, 2009 12:02:50 AM Subject: Re: Apache Tomcat Memory Pool Hi, I did change the java pool sizes min = 1024 and max = 1536 (BMC recommended). tomcat is not crashing. I'm able to access all the out of the box applications (Helpdesk, Change module, requestor console, etc) but the custom built application which throws the HTTP 500 error (generic error) as follows. java.lang.NullPointerException at com.remedy.arsys.goat.field.GoatField.addToOutputNotes(Unknown Source) at com.remedy.arsys.goat.field.FieldGraph$Node.recurAddToOutputNotes(Unknown Source) at com.remedy.arsys.goat.field.FieldGraph$Node.recurAddToOutputNotes(Unknown Source) at com.remedy.arsys.goat.field.FieldGraph$Node.access$1200(Unknown Source) at com.remedy.arsys.goat.field.FieldGraph.instantiateFields(Unknown Source) at com.remedy.arsys.goat.field.FieldGraph.getHTMLData(Unknown Source) at com.remedy.arsys.goat.field.FieldGraph.transmitHTML(Unknown Source) at com.remedy.arsys.stubs.FormServlet.requestDispatch(Unknown Source) at com.remedy.arsys.stubs.FormServlet.doRequest(Unknown Source) at com.remedy.arsys.stubs.GoatServlet.postInternal(Unknown Source) at com.remedy.arsys.stubs.GoatHttpServlet.doPost(Unknown Source) at javax.servlet.http.HttpServlet.service(HttpServlet.java:710) at javax.servlet.http.HttpServlet.service(HttpServlet.java:803) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:269) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:174) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:117) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:108) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:151) at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:874) at org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:665) at org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:528) at org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:81) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:689) at java.lang.Thread.run(Thread.java:595) - Servlet.service() for servlet FormServlet threw exception Appreciate your response, J ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor:rmisoluti...@verizon.net ARSlist: Where the Answers Are
Re: Apache Tomcat Memory Pool
You might have an undersized max and mean pool from your email.. try raising it a bit. The recommended algoritbm for max memory is to not set it at any higher than about 60% of the total available free memory. If the windows maching you are using is specifically for the web server servicing the mid-tier app, at a total memory of 3.5 GB you must be having at least a total of 3 GB total available free memory so you could do well raising the max towards the 2 GB mark.. Raising it too much on windows will cause your Tomcat server to crash on startup so try to push it as much as you can.. Cheers Joe From: remedydon mrohinikanth2...@gmail.com To: arslist@ARSLIST.ORG Sent: Wednesday, July 15, 2009 8:41:41 PM Subject: Re: Apache Tomcat Memory Pool Hi, I'm on Windows 2003. We have Dev and QA both pointing to a single mid-tier server. Just today I installed MidTier 7.1 Patch 7 on dev box which solved the errors like ARERR 9351, 302 and attachments on Requestor console. But, when I was trying to access a custom built application (has flashboards) through mid-tier I got a Tomcat error HTTP Status 500. (Please see attachments - Screenshot and the log). I have the max pool size = 1024 and min = 512 MB. Ram = 3.5GB. Do you think I have to increase this heap size to eliminate this error ? - Joe ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor:rmisoluti...@verizon.net ARSlist: Where the Answers Are
Re: Apache Tomcat Memory Pool
There are also some other GC options: http://java.sun.com/docs/hotspot/gc5.0/gc_tuning_5.html The latest JVM's have a new GC that has much greater performance: http://java.sun.com/performance/reference/whitepapers/6_performance.html#2.2 http://java.sun.com/javase/6/docs/technotes/guides/vm/par-compaction-6.html http://java.sun.com/javase/6/webnotes/6u14.html Axton Grams The opinions, statements, and/or suggested courses of action expressed in this E-mail do not necessarily reflect those of BMC Software, Inc. My voluntary participation in this forum is not intended to convey a role as a spokesperson, liaison or public relations representative for BMC Software, Inc. On Wed, Jul 15, 2009 at 7:25 PM, Joe DeSouzajoe_rem...@yahoo.com wrote: ** Hi Joe, This is done in the startup of Tomcat by including a startup paramter for java: -Xincgc along with the startup memory and max memory that is defined. If you are on UNIX you will need to modify your startup.sh file where you have these lines: JAVA_OPTS=$JAVA_OPTS -Xms1536m; export JAVA_OPTS JAVA_OPTS=$JAVA_OPTS -Xmx2560m; export JAVA_OPTS to something like JAVA_OPTS=$JAVA_OPTS -Xms1536m; export JAVA_OPTS JAVA_OPTS=$JAVA_OPTS -Xmx2560m -Xincgc; export JAVA_OPTS Restart Tomcat after that and then your process should look something like: aradmin 3984 1 70 08:09 pts/100:00:11 /apps/ar/jre1.6.0_13/bin/java -Xms1536m -Xmx2560m -Xincgc -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -Djava.util.logging.config.file=/apps/ar/tomcat-5.5.25/conf/logging.properties -Djava.endorsed.dirs=/apps/ar/tomcat-5.5.25/common/endorsed -classpath :/apps/ar/tomcat-5.5.25/bin/bootstrap.jar:/apps/ar/tomcat-5.5.25/bin/commons-logging-api.jar -Dcatalina.base=/apps/ar/tomcat-5.5.25 -Dcatalina.home=/apps/ar/tomcat-5.5.25 -Djava.io.tmpdir=/apps/ar/tomcat-5.5.25/temp org.apache.catalina.startup.Bootstrap start Without the incremental garbage collection turned on your process would look like: aradmin 3531 1 0 Jun29 ?00:04:10 /apps/ar/jre1.6.0_13/bin/java -Xms1536m -Xmx2560m -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -Djava.util.logging.config.file=/apps/ar/tomcat-5.5.25/conf/logging.properties -Djava.endorsed.dirs=/apps/ar/tomcat-5.5.25/common/endorsed -classpath :/apps/ar/tomcat-5.5.25/bin/bootstrap.jar:/apps/ar/tomcat-5.5.25/bin/commons-logging-api.jar -Dcatalina.base=/apps/ar/tomcat-5.5.25 -Dcatalina.home=/apps/ar/tomcat-5.5.25 -Djava.io.tmpdir=/apps/ar/tomcat-5.5.25/temp org.apache.catalina.startup.Bootstrap start Are you on UNIX or Windows? The instructions I have given is for UNIX. If you are on windows I think you need to modify your Java Options found in the Java tab of the utility tomcat5w.exe Hope this helps.. Joe From: remedydon mrohinikanth2...@gmail.com To: arslist@ARSLIST.ORG Sent: Wednesday, July 15, 2009 7:54:14 PM Subject: Re: Apache Tomcat Memory Pool Hi Joe, Another useful tip would be to turn on incremental garbage collection. This is always good to free up unused portions of memory that haven't been used for a significant time interval. Where can I find this feature to turn it on ? Joe From: Begosh, Kevin kevin.beg...@lmco.com To: arslist@ARSLIST.ORG Sent: Tuesday, February 3, 2009 3:14:40 PM Subject: Re: Apache Tomcat Memory Pool ** Yes this does help and I am on 7.1 as well so this would help out a lot. We are having those exact issue with Tomcat crashing. Kevin Begosh, RSP Tech Ops Enterprise Business Services 301-791-3540 Phone 410-422-3623 Cell kevin.beg...@lmco.com From:Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Joe DeSouza Sent: Tuesday, February 03, 2009 1:13 PM To: arslist@ARSLIST.ORG Subject: Re: Apache Tomcat Memory Pool ** Thsi is more of a Tomcat setting than a 'BMC recommended' setting. The golden rule for sizing tomcat memory is to not use more than 65% to 70% of the available free memory before the tomcat service is started. This gives the server at least 30% to 35% headroom. With that in mind it is nice to have a max memory of at least around the 3 GB mark where the usage of the servers is about average. Since you are using tomcat, if you are using Mid-Tier 7.1, I would recommend to hop on the patch 006. In my experience here the earlier patches had a memory issue, that addresses OutOfMemory errors that cause Tomcat to crash which was addressed in Patch 006. Also the performance is way better as I have noticed that it takes a relatively short time for the server to build its cache after an initial restart on patch 006 (at least 5 to 10 times faster) than it was on lets say Patch 003. I haven't tried patches in between 003 and 006 Hope this helps.. Cheers Joe From:Begosh, Kevin kevin.beg...@lmco.com To: arslist@ARSLIST.ORG Sent
Re: Apache Tomcat Memory Pool
Hi Joe, Another useful tip would be to turn on incremental garbage collection. This is always good to free up unused portions of memory that haven't been used for a significant time interval. Where can I find this feature to turn it on ? Joe From: Begosh, Kevin kevin.beg...@lmco.com To: arslist@ARSLIST.ORG Sent: Tuesday, February 3, 2009 3:14:40 PM Subject: Re: Apache Tomcat Memory Pool ** Yes this does help and I am on 7.1 as well so this would help out a lot. We are having those exact issue with Tomcat crashing. Kevin Begosh, RSP Tech Ops Enterprise Business Services 301-791-3540 Phone 410-422-3623 Cell kevin.beg...@lmco.com From:Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Joe DeSouza Sent: Tuesday, February 03, 2009 1:13 PM To: arslist@ARSLIST.ORG Subject: Re: Apache Tomcat Memory Pool ** Thsi is more of a Tomcat setting than a 'BMC recommended' setting. The golden rule for sizing tomcat memory is to not use more than 65% to 70% of the available free memory before the tomcat service is started. This gives the server at least 30% to 35% headroom. With that in mind it is nice to have a max memory of at least around the 3 GB mark where the usage of the servers is about average. Since you are using tomcat, if you are using Mid-Tier 7.1, I would recommend to hop on the patch 006. In my experience here the earlier patches had a memory issue, that addresses OutOfMemory errors that cause Tomcat to crash which was addressed in Patch 006. Also the performance is way better as I have noticed that it takes a relatively short time for the server to build its cache after an initial restart on patch 006 (at least 5 to 10 times faster) than it was on lets say Patch 003. I haven't tried patches in between 003 and 006 Hope this helps.. Cheers Joe From:Begosh, Kevin kevin.beg...@lmco.com To: arslist@ARSLIST.ORG Sent: Tuesday, February 3, 2009 12:53:46 PM Subject: Apache Tomcat Memory Pool ** Does anyone know what the BMC recommended or what the best settings are for the Apache Tomcat memory pool for the Mid Tier. We are windows 2003 and we have two mid tiers that are load balanced. Kevin Begosh, RSP Tech Ops Enterprise Business Services 301-791-3540 Phone 410-422-3623 Cell kevin.beg...@lmco.com ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor: RMI Solutions ARSlist: Where the Answers Are -- View this message in context: http://www.nabble.com/Apache-Tomcat-Memory-Pool-tp21815259p24507951.html Sent from the ARS (Action Request System) mailing list archive at Nabble.com. ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor:rmisoluti...@verizon.net ARSlist: Where the Answers Are
Re: Apache Tomcat Memory Pool
Hi Joe, This is done in the startup of Tomcat by including a startup paramter for java: -Xincgc along with the startup memory and max memory that is defined. If you are on UNIX you will need to modify your startup.sh file where you have these lines: JAVA_OPTS=$JAVA_OPTS -Xms1536m; export JAVA_OPTS JAVA_OPTS=$JAVA_OPTS -Xmx2560m; export JAVA_OPTS to something like JAVA_OPTS=$JAVA_OPTS -Xms1536m; export JAVA_OPTS JAVA_OPTS=$JAVA_OPTS -Xmx2560m -Xincgc; export JAVA_OPTS Restart Tomcat after that and then your process should look something like: aradmin 3984 1 70 08:09 pts/1 00:00:11 /apps/ar/jre1.6.0_13/bin/java -Xms1536m -Xmx2560m -Xincgc -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -Djava.util.logging.config.file=/apps/ar/tomcat-5.5.25/conf/logging.properties -Djava.endorsed.dirs=/apps/ar/tomcat-5.5.25/common/endorsed -classpath :/apps/ar/tomcat-5.5.25/bin/bootstrap.jar:/apps/ar/tomcat-5.5.25/bin/commons-logging-api.jar -Dcatalina.base=/apps/ar/tomcat-5.5.25 -Dcatalina.home=/apps/ar/tomcat-5.5.25 -Djava.io.tmpdir=/apps/ar/tomcat-5.5.25/temp org.apache.catalina.startup.Bootstrap start Without the incremental garbage collection turned on your process would look like: aradmin 3531 1 0 Jun29 ? 00:04:10 /apps/ar/jre1.6.0_13/bin/java -Xms1536m -Xmx2560m -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -Djava.util.logging.config.file=/apps/ar/tomcat-5.5.25/conf/logging.properties -Djava.endorsed.dirs=/apps/ar/tomcat-5.5.25/common/endorsed -classpath :/apps/ar/tomcat-5.5.25/bin/bootstrap.jar:/apps/ar/tomcat-5.5.25/bin/commons-logging-api.jar -Dcatalina.base=/apps/ar/tomcat-5.5.25 -Dcatalina.home=/apps/ar/tomcat-5.5.25 -Djava.io.tmpdir=/apps/ar/tomcat-5.5.25/temp org.apache.catalina.startup.Bootstrap start Are you on UNIX or Windows? The instructions I have given is for UNIX. If you are on windows I think you need to modify your Java Options found in the Java tab of the utility tomcat5w.exe Hope this helps.. Joe From: remedydon mrohinikanth2...@gmail.com To: arslist@ARSLIST.ORG Sent: Wednesday, July 15, 2009 7:54:14 PM Subject: Re: Apache Tomcat Memory Pool Hi Joe, Another useful tip would be to turn on incremental garbage collection. This is always good to free up unused portions of memory that haven't been used for a significant time interval. Where can I find this feature to turn it on ? Joe From: Begosh, Kevin kevin.beg...@lmco.com To: arslist@ARSLIST.ORG Sent: Tuesday, February 3, 2009 3:14:40 PM Subject: Re: Apache Tomcat Memory Pool ** Yes this does help and I am on 7.1 as well so this would help out a lot. We are having those exact issue with Tomcat crashing. Kevin Begosh, RSP Tech Ops Enterprise Business Services 301-791-3540 Phone 410-422-3623 Cell kevin.beg...@lmco.com From:Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Joe DeSouza Sent: Tuesday, February 03, 2009 1:13 PM To: arslist@ARSLIST.ORG Subject: Re: Apache Tomcat Memory Pool ** Thsi is more of a Tomcat setting than a 'BMC recommended' setting. The golden rule for sizing tomcat memory is to not use more than 65% to 70% of the available free memory before the tomcat service is started. This gives the server at least 30% to 35% headroom. With that in mind it is nice to have a max memory of at least around the 3 GB mark where the usage of the servers is about average. Since you are using tomcat, if you are using Mid-Tier 7.1, I would recommend to hop on the patch 006. In my experience here the earlier patches had a memory issue, that addresses OutOfMemory errors that cause Tomcat to crash which was addressed in Patch 006. Also the performance is way better as I have noticed that it takes a relatively short time for the server to build its cache after an initial restart on patch 006 (at least 5 to 10 times faster) than it was on lets say Patch 003. I haven't tried patches in between 003 and 006 Hope this helps.. Cheers Joe From:Begosh, Kevin kevin.beg...@lmco.com To: arslist@ARSLIST.ORG Sent: Tuesday, February 3, 2009 12:53:46 PM Subject: Apache Tomcat Memory Pool ** Does anyone know what the BMC recommended or what the best settings are for the Apache Tomcat memory pool for the Mid Tier. We are windows 2003 and we have two mid tiers that are load balanced. Kevin Begosh, RSP Tech Ops Enterprise Business Services 301-791-3540 Phone 410-422-3623 Cell kevin.beg...@lmco.com ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor:rmisoluti...@verizon.net ARSlist: Where the Answers Are
Re: Apache Tomcat Memory Pool
Hi, I'm on Windows 2003. We have Dev and QA both pointing to a single mid-tier server. Just today I installed MidTier 7.1 Patch 7 on dev box which solved the errors like ARERR 9351, 302 and attachments on Requestor console. But, when I was trying to access a custom built application (has flashboards) through mid-tier I got a Tomcat error HTTP Status 500. (Please see attachments - Screenshot and the log). I have the max pool size = 1024 and min = 512 MB. Ram = 3.5GB. Do you think I have to increase this heap size to eliminate this error ? - Joe http://www.nabble.com/file/p24508320/Tomcat_Error.doc Tomcat_Error.doc http://www.nabble.com/file/p24508320/stdout_20090715.log stdout_20090715.log -- View this message in context: http://www.nabble.com/Apache-Tomcat-Memory-Pool-tp21815259p24508320.html Sent from the ARS (Action Request System) mailing list archive at Nabble.com. ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor:rmisoluti...@verizon.net ARSlist: Where the Answers Are
Re: Apache Tomcat Memory Pool
I see in the postings down the line I see some discussion going on default Thread Stack Size. I do not have any thread stack size setup! Unlike the maximum pool size setting to 65% of RAM , Is there any default setting I have to set ? Appreciate your response. - Joe -- View this message in context: http://www.nabble.com/Apache-Tomcat-Memory-Pool-tp21815259p24508378.html Sent from the ARS (Action Request System) mailing list archive at Nabble.com. ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor:rmisoluti...@verizon.net ARSlist: Where the Answers Are
Re: Apache Tomcat Memory Pool
I will try these settings tomorrow and let you guys know how my mid-tier testing goes. Thanks Joe -- View this message in context: http://www.nabble.com/Apache-Tomcat-Memory-Pool-tp21815259p24508398.html Sent from the ARS (Action Request System) mailing list archive at Nabble.com. ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor:rmisoluti...@verizon.net ARSlist: Where the Answers Are
Re: Apache Tomcat Memory Pool
All of my mid-tier, RKM, or other tomcats servers are set to Initial Memory Pool = 1536, Maximum Memory Pool = 1536, Thread Stack Size = 3000, and Shutdown Timeout = 240; all other settings are default as installed. This is on either x86 or x64 Win2K3 servers. Christopher Strauss, Ph.D. Call Tracking Administration Manager University of North Texas Computing IT Center http://itsm.unt.edu/ From: Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Begosh, Kevin Sent: Tuesday, February 03, 2009 11:54 AM To: arslist@ARSLIST.ORG Subject: Apache Tomcat Memory Pool ** Does anyone know what the BMC recommended or what the best settings are for the Apache Tomcat memory pool for the Mid Tier. We are windows 2003 and we have two mid tiers that are load balanced. Kevin Begosh, RSP Tech Ops Enterprise Business Services 301-791-3540 Phone 410-422-3623 Cell kevin.beg...@lmco.commailto:kevin.beg...@lmco.com __Platinum Sponsor: RMI Solutions ARSlist: Where the Answers Are html___ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor: RMI Solutions ARSlist: Where the Answers Are
Re: Apache Tomcat Memory Pool
What about the minimum 1024? Kevin Begosh, RSP Tech Ops Enterprise Business Services 301-791-3540 Phone 410-422-3623 Cell kevin.beg...@lmco.com From: Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of strauss Sent: Tuesday, February 03, 2009 11:03 AM To: arslist@ARSLIST.ORG Subject: Re: Apache Tomcat Memory Pool ** All of my mid-tier, RKM, or other tomcats servers are set to Initial Memory Pool = 1536, Maximum Memory Pool = 1536, Thread Stack Size = 3000, and Shutdown Timeout = 240; all other settings are default as installed. This is on either x86 or x64 Win2K3 servers. Christopher Strauss, Ph.D. Call Tracking Administration Manager University of North Texas Computing IT Center http://itsm.unt.edu/ From: Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Begosh, Kevin Sent: Tuesday, February 03, 2009 11:54 AM To: arslist@ARSLIST.ORG Subject: Apache Tomcat Memory Pool ** Does anyone know what the BMC recommended or what the best settings are for the Apache Tomcat memory pool for the Mid Tier. We are windows 2003 and we have two mid tiers that are load balanced. Kevin Begosh, RSP Tech Ops Enterprise Business Services 301-791-3540 Phone 410-422-3623 Cell kevin.beg...@lmco.com __Platinum Sponsor: RMI Solutions ARSlist: Where the Answers Are html___ __Platinum Sponsor: RMI Solutions ARSlist: Where the Answers Are html___ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor: RMI Solutions ARSlist: Where the Answers Are
Re: Apache Tomcat Memory Pool
I have used that in the past - someone who knew tomcat better than I recommended setting the min and max to the same value, so I have run that way in testing and production for over a year now without any problems. Christopher Strauss, Ph.D. Call Tracking Administration Manager University of North Texas Computing IT Center http://itsm.unt.edu/ From: Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Begosh, Kevin Sent: Tuesday, February 03, 2009 12:14 PM To: arslist@ARSLIST.ORG Subject: Re: Apache Tomcat Memory Pool ** What about the minimum 1024? Kevin Begosh, RSP Tech Ops Enterprise Business Services 301-791-3540 Phone 410-422-3623 Cell kevin.beg...@lmco.commailto:kevin.beg...@lmco.com From: Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of strauss Sent: Tuesday, February 03, 2009 11:03 AM To: arslist@ARSLIST.ORG Subject: Re: Apache Tomcat Memory Pool ** All of my mid-tier, RKM, or other tomcats servers are set to Initial Memory Pool = 1536, Maximum Memory Pool = 1536, Thread Stack Size = 3000, and Shutdown Timeout = 240; all other settings are default as installed. This is on either x86 or x64 Win2K3 servers. Christopher Strauss, Ph.D. Call Tracking Administration Manager University of North Texas Computing IT Center http://itsm.unt.edu/ From: Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Begosh, Kevin Sent: Tuesday, February 03, 2009 11:54 AM To: arslist@ARSLIST.ORG Subject: Apache Tomcat Memory Pool ** Does anyone know what the BMC recommended or what the best settings are for the Apache Tomcat memory pool for the Mid Tier. We are windows 2003 and we have two mid tiers that are load balanced. Kevin Begosh, RSP Tech Ops Enterprise Business Services 301-791-3540 Phone 410-422-3623 Cell kevin.beg...@lmco.commailto:kevin.beg...@lmco.com __Platinum Sponsor: RMI Solutions ARSlist: Where the Answers Are html___ __Platinum Sponsor: RMI Solutions ARSlist: Where the Answers Are html___ __Platinum Sponsor: RMI Solutions ARSlist: Where the Answers Are html___ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor: RMI Solutions ARSlist: Where the Answers Are
Re: Apache Tomcat Memory Pool
Okay thanks Kevin Begosh, RSP Tech Ops Enterprise Business Services 301-791-3540 Phone 410-422-3623 Cell kevin.beg...@lmco.com From: Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of strauss Sent: Tuesday, February 03, 2009 11:21 AM To: arslist@ARSLIST.ORG Subject: Re: Apache Tomcat Memory Pool ** I have used that in the past - someone who knew tomcat better than I recommended setting the min and max to the same value, so I have run that way in testing and production for over a year now without any problems. Christopher Strauss, Ph.D. Call Tracking Administration Manager University of North Texas Computing IT Center http://itsm.unt.edu/ From: Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Begosh, Kevin Sent: Tuesday, February 03, 2009 12:14 PM To: arslist@ARSLIST.ORG Subject: Re: Apache Tomcat Memory Pool ** What about the minimum 1024? Kevin Begosh, RSP Tech Ops Enterprise Business Services 301-791-3540 Phone 410-422-3623 Cell kevin.beg...@lmco.com From: Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of strauss Sent: Tuesday, February 03, 2009 11:03 AM To: arslist@ARSLIST.ORG Subject: Re: Apache Tomcat Memory Pool ** All of my mid-tier, RKM, or other tomcats servers are set to Initial Memory Pool = 1536, Maximum Memory Pool = 1536, Thread Stack Size = 3000, and Shutdown Timeout = 240; all other settings are default as installed. This is on either x86 or x64 Win2K3 servers. Christopher Strauss, Ph.D. Call Tracking Administration Manager University of North Texas Computing IT Center http://itsm.unt.edu/ From: Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Begosh, Kevin Sent: Tuesday, February 03, 2009 11:54 AM To: arslist@ARSLIST.ORG Subject: Apache Tomcat Memory Pool ** Does anyone know what the BMC recommended or what the best settings are for the Apache Tomcat memory pool for the Mid Tier. We are windows 2003 and we have two mid tiers that are load balanced. Kevin Begosh, RSP Tech Ops Enterprise Business Services 301-791-3540 Phone 410-422-3623 Cell kevin.beg...@lmco.com __Platinum Sponsor: RMI Solutions ARSlist: Where the Answers Are html___ __Platinum Sponsor: RMI Solutions ARSlist: Where the Answers Are html___ __Platinum Sponsor: RMI Solutions ARSlist: Where the Answers Are html___ __Platinum Sponsor: RMI Solutions ARSlist: Where the Answers Are html___ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor: RMI Solutions ARSlist: Where the Answers Are
Re: Apache Tomcat Memory Pool
Thsi is more of a Tomcat setting than a 'BMC recommended' setting. The golden rule for sizing tomcat memory is to not use more than 65% to 70% of the available free memory before the tomcat service is started. This gives the server at least 30% to 35% headroom. With that in mind it is nice to have a max memory of at least around the 3 GB mark where the usage of the servers is about average. Since you are using tomcat, if you are using Mid-Tier 7.1, I would recommend to hop on the patch 006. In my experience here the earlier patches had a memory issue, that addresses OutOfMemory errors that cause Tomcat to crash which was addressed in Patch 006. Also the performance is way better as I have noticed that it takes a relatively short time for the server to build its cache after an initial restart on patch 006 (at least 5 to 10 times faster) than it was on lets say Patch 003. I haven't tried patches in between 003 and 006 Hope this helps.. Cheers Joe From: Begosh, Kevin kevin.beg...@lmco.com To: arslist@ARSLIST.ORG Sent: Tuesday, February 3, 2009 12:53:46 PM Subject: Apache Tomcat Memory Pool ** Does anyone know what the BMC recommended or what the best settings are for the Apache Tomcat memory pool for the Mid Tier. We are windows 2003 and we have two mid tiers that are load balanced. Kevin Begosh, RSP Tech Ops Enterprise Business Services 301-791-3540 Phone 410-422-3623 Cell kevin.beg...@lmco.com ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor: RMI Solutions ARSlist: Where the Answers Are
Re: Apache Tomcat Memory Pool
So far all of my attempts to build a stable mid-tier on 7.1.00.006 to replace 002 are failing, with flashboard and CCMCalendar crashes killing the mid-tier tomcat 5.5.25 instance. Considering that the production tomcat 5.5.26 under mid-tier 7.1.00.002 has crashed only once in the last nine months (last October), I'm not convinced yet that 006 is any improvement. Am working with support on it... Christopher Strauss, Ph.D. Call Tracking Administration Manager University of North Texas Computing IT Center http://itsm.unt.edu/ From: Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Joe DeSouza Sent: Tuesday, February 03, 2009 2:21 PM To: arslist@ARSLIST.ORG Subject: Re: Apache Tomcat Memory Pool ** Patch 006 has definitely seen a marked decrease in the tomcat crashes we have experienced here and that too those were not becuase of OutOfMemory errors. If you view the contents of your current catalina.out file, I can bet that your crashes are due to OutOfMemory errors. Another useful tip would be to turn on incremental garbage collection. This is always good to free up unused portions of memory that haven't been used for a significant time interval. Joe From: Begosh, Kevin kevin.beg...@lmco.com To: arslist@ARSLIST.ORG Sent: Tuesday, February 3, 2009 3:14:40 PM Subject: Re: Apache Tomcat Memory Pool ** Yes this does help and I am on 7.1 as well so this would help out a lot. We are having those exact issue with Tomcat crashing. Kevin Begosh, RSP Tech Ops Enterprise Business Services 301-791-3540 Phone 410-422-3623 Cell kevin.beg...@lmco.commailto:kevin.beg...@lmco.com From: Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Joe DeSouza Sent: Tuesday, February 03, 2009 1:13 PM To: arslist@ARSLIST.ORG Subject: Re: Apache Tomcat Memory Pool ** Thsi is more of a Tomcat setting than a 'BMC recommended' setting. The golden rule for sizing tomcat memory is to not use more than 65% to 70% of the available free memory before the tomcat service is started. This gives the server at least 30% to 35% headroom. With that in mind it is nice to have a max memory of at least around the 3 GB mark where the usage of the servers is about average. Since you are using tomcat, if you are using Mid-Tier 7.1, I would recommend to hop on the patch 006. In my experience here the earlier patches had a memory issue, that addresses OutOfMemory errors that cause Tomcat to crash which was addressed in Patch 006. Also the performance is way better as I have noticed that it takes a relatively short time for the server to build its cache after an initial restart on patch 006 (at least 5 to 10 times faster) than it was on lets say Patch 003. I haven't tried patches in between 003 and 006 Hope this helps.. Cheers Joe From: Begosh, Kevin kevin.beg...@lmco.com To: arslist@ARSLIST.ORG Sent: Tuesday, February 3, 2009 12:53:46 PM Subject: Apache Tomcat Memory Pool ** Does anyone know what the BMC recommended or what the best settings are for the Apache Tomcat memory pool for the Mid Tier. We are windows 2003 and we have two mid tiers that are load balanced. Kevin Begosh, RSP Tech Ops Enterprise Business Services 301-791-3540 Phone 410-422-3623 Cell kevin.beg...@lmco.commailto:kevin.beg...@lmco.com __Platinum Sponsor: RMI Solutions ARSlist: Where the Answers Are html___ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor: RMI Solutions ARSlist: Where the Answers Are
Re: Apache Tomcat Memory Pool
Kevin, Its in the startup of tomcat if you start it using the batch file instead of the service on windows (I'm not really a windows expert). The equivalent of that bat file on windows is the startup.sh file in UNIX. On this file there is a JAVA_OPT parameter that already has default settings for -Xms and -Xmx with the sizes as arguments. On that same line after or before these parameters insert the -Xincgc parameter with no arguments. Stop Tomcat and then restart it by running the bat file. Before running the bat file however make sure all the paths for various other parameters such as JAVA_HOME, CATALINA_HOME etc are correct. Alter then if you have used anything other than default paths to install Tomcat. Beyond this my knowledge of setting and running Tomcat from the bat file on windows is limited as I more experience with running it on UNIX / Linux.. Cheers Joe From: Begosh, Kevin kevin.beg...@lmco.com To: arslist@ARSLIST.ORG Sent: Tuesday, February 3, 2009 3:34:57 PM Subject: Re: Apache Tomcat Memory Pool ** How do you turn on Another useful tip would be to turn on incremental garbage collection. This is always good to free up unused portions of memory that haven't been used for a significant time interval. Kevin Begosh, RSP Tech Ops Enterprise Business Services 301-791-3540 Phone 410-422-3623 Cell kevin.beg...@lmco.com From:Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Joe DeSouza Sent: Tuesday, February 03, 2009 1:21 PM To: arslist@ARSLIST.ORG Subject: Re: Apache Tomcat Memory Pool ** Patch 006 has definitely seen a marked decrease in the tomcat crashes we have experienced here and that too those were not becuase of OutOfMemory errors. If you view the contents of your current catalina.out file, I can bet that your crashes are due to OutOfMemory errors. Another useful tip would be to turn on incremental garbage collection. This is always good to free up unused portions of memory that haven't been used for a significant time interval. Joe From:Begosh, Kevin kevin.beg...@lmco.com To: arslist@ARSLIST.ORG Sent: Tuesday, February 3, 2009 3:14:40 PM Subject: Re: Apache Tomcat Memory Pool ** Yes this does help and I am on 7.1 as well so this would help out a lot. We are having those exact issue with Tomcat crashing. Kevin Begosh, RSP Tech Ops Enterprise Business Services 301-791-3540 Phone 410-422-3623 Cell kevin.beg...@lmco.com From:Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Joe DeSouza Sent: Tuesday, February 03, 2009 1:13 PM To: arslist@ARSLIST.ORG Subject: Re: Apache Tomcat Memory Pool ** Thsi is more of a Tomcat setting than a 'BMC recommended' setting. The golden rule for sizing tomcat memory is to not use more than 65% to 70% of the available free memory before the tomcat service is started. This gives the server at least 30% to 35% headroom. With that in mind it is nice to have a max memory of at least around the 3 GB mark where the usage of the servers is about average. Since you are using tomcat, if you are using Mid-Tier 7.1, I would recommend to hop on the patch 006. In my experience here the earlier patches had a memory issue, that addresses OutOfMemory errors that cause Tomcat to crash which was addressed in Patch 006. Also the performance is way better as I have noticed that it takes a relatively short time for the server to build its cache after an initial restart on patch 006 (at least 5 to 10 times faster) than it was on lets say Patch 003. I haven't tried patches in between 003 and 006 Hope this helps.. Cheers Joe From:Begosh, Kevin kevin.beg...@lmco.com To: arslist@ARSLIST.ORG Sent: Tuesday, February 3, 2009 12:53:46 PM Subject: Apache Tomcat Memory Pool ** Does anyone know what the BMC recommended or what the best settings are for the Apache Tomcat memory pool for the Mid Tier. We are windows 2003 and we have two mid tiers that are load balanced. Kevin Begosh, RSP Tech Ops Enterprise Business Services 301-791-3540 Phone 410-422-3623 Cell kevin.beg...@lmco.com ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor: RMI Solutions ARSlist: Where the Answers Are
Re: Apache Tomcat Memory Pool
thanks Kevin Begosh, RSP Tech Ops Enterprise Business Services 301-791-3540 Phone 410-422-3623 Cell kevin.beg...@lmco.com From: Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Joe DeSouza Sent: Tuesday, February 03, 2009 2:02 PM To: arslist@ARSLIST.ORG Subject: Re: Apache Tomcat Memory Pool ** Kevin, Its in the startup of tomcat if you start it using the batch file instead of the service on windows (I'm not really a windows expert). The equivalent of that bat file on windows is the startup.sh file in UNIX. On this file there is a JAVA_OPT parameter that already has default settings for -Xms and -Xmx with the sizes as arguments. On that same line after or before these parameters insert the -Xincgc parameter with no arguments. Stop Tomcat and then restart it by running the bat file. Before running the bat file however make sure all the paths for various other parameters such as JAVA_HOME, CATALINA_HOME etc are correct. Alter then if you have used anything other than default paths to install Tomcat. Beyond this my knowledge of setting and running Tomcat from the bat file on windows is limited as I more experience with running it on UNIX / Linux.. Cheers Joe ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor: RMI Solutions ARSlist: Where the Answers Are
Re: Apache Tomcat Memory Pool
Chris, What problems are you facing? I have it running for a few weeks on UAT with no problems, and just yesterday went live on production and no problems so far. It seems to have ceased crashing as regulary as it used to. I am using Tomcat 5.5.25 and java 1.6 (I can get you the exact version if you want that.). And I have my max memory set as reccommended earlier on this thread by me (about 65% of the total available free memory before tomcat is started with every other service besides tomcat started).. Are you on unix or windows? I am on UNIX. Cheers Joe From: strauss stra...@unt.edu To: arslist@ARSLIST.ORG Sent: Tuesday, February 3, 2009 3:41:49 PM Subject: Re: Apache Tomcat Memory Pool ** So far all of my attempts to build a stable mid-tier on 7.1.00.006 to replace 002 are failing, with flashboard and CCMCalendar crashes killing the mid-tier tomcat 5.5.25 instance. Considering that the production tomcat 5.5.26 under mid-tier 7.1.00.002 has crashed only once in the last nine months (last October), I’m not convinced yet that 006 is any improvement. Am working with support on it… Christopher Strauss, Ph.D. Call Tracking Administration Manager University of North Texas Computing IT Center http://itsm.unt.edu/ From:Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Joe DeSouza Sent: Tuesday, February 03, 2009 2:21 PM To: arslist@ARSLIST.ORG Subject: Re: Apache Tomcat Memory Pool ** Patch 006 has definitely seen a marked decrease in the tomcat crashes we have experienced here and that too those were not becuase of OutOfMemory errors. If you view the contents of your current catalina.out file, I can bet that your crashes are due to OutOfMemory errors. Another useful tip would be to turn on incremental garbage collection. This is always good to free up unused portions of memory that haven't been used for a significant time interval. Joe From:Begosh, Kevin kevin.beg...@lmco.com To: arslist@ARSLIST.ORG Sent: Tuesday, February 3, 2009 3:14:40 PM Subject: Re: Apache Tomcat Memory Pool ** Yes this does help and I am on 7.1 as well so this would help out a lot. We are having those exact issue with Tomcat crashing. Kevin Begosh, RSP Tech Ops Enterprise Business Services 301-791-3540 Phone 410-422-3623 Cell kevin.beg...@lmco.com From:Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Joe DeSouza Sent: Tuesday, February 03, 2009 1:13 PM To: arslist@ARSLIST.ORG Subject: Re: Apache Tomcat Memory Pool ** Thsi is more of a Tomcat setting than a 'BMC recommended' setting. The golden rule for sizing tomcat memory is to not use more than 65% to 70% of the available free memory before the tomcat service is started. This gives the server at least 30% to 35% headroom. With that in mind it is nice to have a max memory of at least around the 3 GB mark where the usage of the servers is about average. Since you are using tomcat, if you are using Mid-Tier 7.1, I would recommend to hop on the patch 006. In my experience here the earlier patches had a memory issue, that addresses OutOfMemory errors that cause Tomcat to crash which was addressed in Patch 006. Also the performance is way better as I have noticed that it takes a relatively short time for the server to build its cache after an initial restart on patch 006 (at least 5 to 10 times faster) than it was on lets say Patch 003. I haven't tried patches in between 003 and 006 Hope this helps.. Cheers Joe From:Begosh, Kevin kevin.beg...@lmco.com To: arslist@ARSLIST.ORG Sent: Tuesday, February 3, 2009 12:53:46 PM Subject: Apache Tomcat Memory Pool ** Does anyone know what the BMC recommended or what the best settings are for the Apache Tomcat memory pool for the Mid Tier. We are windows 2003 and we have two mid tiers that are load balanced. Kevin Begosh, RSP Tech Ops Enterprise Business Services 301-791-3540 Phone 410-422-3623 Cell kevin.beg...@lmco.com ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor: RMI Solutions ARSlist: Where the Answers Are
Re: Apache Tomcat Memory Pool
You are welcome.. and good luck.. Joe From: Begosh, Kevin kevin.beg...@lmco.com To: arslist@ARSLIST.ORG Sent: Tuesday, February 3, 2009 4:05:35 PM Subject: Re: Apache Tomcat Memory Pool ** thanks Kevin Begosh, RSP Tech Ops Enterprise Business Services 301-791-3540 Phone 410-422-3623 Cell kevin.beg...@lmco.com From:Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Joe DeSouza Sent: Tuesday, February 03, 2009 2:02 PM To: arslist@ARSLIST.ORG Subject: Re: Apache Tomcat Memory Pool ** Kevin, Its in the startup of tomcat if you start it using the batch file instead of the service on windows (I'm not really a windows expert). The equivalent of that bat file on windows is the startup.sh file in UNIX. On this file there is a JAVA_OPT parameter that already has default settings for -Xms and -Xmx with the sizes as arguments. On that same line after or before these parameters insert the -Xincgc parameter with no arguments. Stop Tomcat and then restart it by running the bat file. Before running the bat file however make sure all the paths for various other parameters such as JAVA_HOME, CATALINA_HOME etc are correct. Alter then if you have used anything other than default paths to install Tomcat. Beyond this my knowledge of setting and running Tomcat from the bat file on windows is limited as I more experience with running it on UNIX / Linux.. Cheers Joe ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor: RMI Solutions ARSlist: Where the Answers Are
Re: Apache Tomcat Memory Pool
Windows 2003 Enterprise x86 dev w 3 gb ram and 4 cores (production is x64 with 12 gb RAM and 8 cores, but I don't have hardware for equivalent dev box). Dev was running fine as 7.1.00.002 mod with 7.0.00.006 *70 dlls to work properly with CCMCalendar. Flashboards was fine except for the normal errors in the mid-tier log. Tomcat was 5.5.26 per instruction from support last spring, since rescinded. Removed mid-tier and tomcat. Installed mid-tier 7.1.00.006 with bundled tomcat 5.5.25. Upgraded Flashboards to 7.1.00.005 (there is no 006). All of my java is 1.5.0_14 and will remain that way - has been stable for a year with 7.1.00.x code. Flashboards is now crashing in SOME consoles, not others (Change, not Incident or Asset). Was crashing ALL the time until I reinstalled it again... CCMCalendar crashing too, now - had not checked it in a while, though. Lots more testing to do, but it's hardly stable. Christopher Strauss, Ph.D. Call Tracking Administration Manager University of North Texas Computing IT Center http://itsm.unt.edu/ From: Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Joe DeSouza Sent: Tuesday, February 03, 2009 3:07 PM To: arslist@ARSLIST.ORG Subject: Re: Apache Tomcat Memory Pool ** Chris, What problems are you facing? I have it running for a few weeks on UAT with no problems, and just yesterday went live on production and no problems so far. It seems to have ceased crashing as regulary as it used to. I am using Tomcat 5.5.25 and java 1.6 (I can get you the exact version if you want that.). And I have my max memory set as reccommended earlier on this thread by me (about 65% of the total available free memory before tomcat is started with every other service besides tomcat started).. Are you on unix or windows? I am on UNIX. Cheers Joe From: strauss stra...@unt.edu To: arslist@ARSLIST.ORG Sent: Tuesday, February 3, 2009 3:41:49 PM Subject: Re: Apache Tomcat Memory Pool ** So far all of my attempts to build a stable mid-tier on 7.1.00.006 to replace 002 are failing, with flashboard and CCMCalendar crashes killing the mid-tier tomcat 5.5.25 instance. Considering that the production tomcat 5.5.26 under mid-tier 7.1.00.002 has crashed only once in the last nine months (last October), I'm not convinced yet that 006 is any improvement. Am working with support on it... Christopher Strauss, Ph.D. Call Tracking Administration Manager University of North Texas Computing IT Center http://itsm.unt.edu/ From: Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Joe DeSouza Sent: Tuesday, February 03, 2009 2:21 PM To: arslist@ARSLIST.ORG Subject: Re: Apache Tomcat Memory Pool ** Patch 006 has definitely seen a marked decrease in the tomcat crashes we have experienced here and that too those were not becuase of OutOfMemory errors. If you view the contents of your current catalina.out file, I can bet that your crashes are due to OutOfMemory errors. Another useful tip would be to turn on incremental garbage collection. This is always good to free up unused portions of memory that haven't been used for a significant time interval. Joe From: Begosh, Kevin kevin.beg...@lmco.com To: arslist@ARSLIST.ORG Sent: Tuesday, February 3, 2009 3:14:40 PM Subject: Re: Apache Tomcat Memory Pool ** Yes this does help and I am on 7.1 as well so this would help out a lot. We are having those exact issue with Tomcat crashing. Kevin Begosh, RSP Tech Ops Enterprise Business Services 301-791-3540 Phone 410-422-3623 Cell kevin.beg...@lmco.commailto:kevin.beg...@lmco.com From: Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Joe DeSouza Sent: Tuesday, February 03, 2009 1:13 PM To: arslist@ARSLIST.ORG Subject: Re: Apache Tomcat Memory Pool ** Thsi is more of a Tomcat setting than a 'BMC recommended' setting. The golden rule for sizing tomcat memory is to not use more than 65% to 70% of the available free memory before the tomcat service is started. This gives the server at least 30% to 35% headroom. With that in mind it is nice to have a max memory of at least around the 3 GB mark where the usage of the servers is about average. Since you are using tomcat, if you are using Mid-Tier 7.1, I would recommend to hop on the patch 006. In my experience here the earlier patches had a memory issue, that addresses OutOfMemory errors that cause Tomcat to crash which was addressed in Patch 006. Also the performance is way better as I have noticed that it takes a relatively short time for the server to build its cache after an initial restart on patch 006 (at least 5 to 10 times faster) than it was on lets say Patch 003. I haven't tried patches in between 003 and 006 Hope this helps.. Cheers Joe From: Begosh, Kevin kevin.beg...@lmco.com To: arslist
Re: Apache Tomcat Memory Pool
The only difference I see between your environment is your version of java, your operating system that mid-tier is installed on, and the fact that we do not use flashboards to know if displaying them would cause tomcat to crash (we are on ITSP that has no flashboards out of the box). Its over 24 hours now that we upgraded our production to patch 006 (we have 10 mid tier servers behind a load balancer) and none of the servers have crashed as yet whereas on an average with patch 003 at least 5 of them would have crashed in a day. On one freak day we had 9 of them crash. Joe From: strauss stra...@unt.edu To: arslist@ARSLIST.ORG Sent: Tuesday, February 3, 2009 4:20:10 PM Subject: Re: Apache Tomcat Memory Pool ** Windows 2003 Enterprise x86 dev w 3 gb ram and 4 cores (production is x64 with 12 gb RAM and 8 cores, but I don’t have hardware for equivalent dev box). Dev was running fine as 7.1.00.002 mod with 7.0.00.006 *70 dlls to work properly with CCMCalendar. Flashboards was fine except for the “normal” errors in the mid-tier log. Tomcat was 5.5.26 per instruction from support last spring, since rescinded. Removed mid-tier and tomcat. Installed mid-tier 7.1.00.006 with bundled tomcat 5.5.25. Upgraded Flashboards to 7.1.00.005 (there is no 006). All of my java is 1.5.0_14 and will remain that way – has been stable for a year with 7.1.00.x code. Flashboards is now crashing in SOME consoles, not others (Change, not Incident or Asset). Was crashing ALL the time until I reinstalled it again… CCMCalendar crashing too, now – had not checked it in a while, though. Lots more testing to do, but it’s hardly stable. Christopher Strauss, Ph.D. Call Tracking Administration Manager University of North Texas Computing IT Center http://itsm.unt.edu/ From:Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Joe DeSouza Sent: Tuesday, February 03, 2009 3:07 PM To: arslist@ARSLIST.ORG Subject: Re: Apache Tomcat Memory Pool ** Chris, What problems are you facing? I have it running for a few weeks on UAT with no problems, and just yesterday went live on production and no problems so far. It seems to have ceased crashing as regulary as it used to. I am using Tomcat 5.5.25 and java 1.6 (I can get you the exact version if you want that.). And I have my max memory set as reccommended earlier on this thread by me (about 65% of the total available free memory before tomcat is started with every other service besides tomcat started).. Are you on unix or windows? I am on UNIX. Cheers Joe From:strauss stra...@unt.edu To: arslist@ARSLIST.ORG Sent: Tuesday, February 3, 2009 3:41:49 PM Subject: Re: Apache Tomcat Memory Pool ** So far all of my attempts to build a stable mid-tier on 7.1.00.006 to replace 002 are failing, with flashboard and CCMCalendar crashes killing the mid-tier tomcat 5.5.25 instance. Considering that the production tomcat 5.5.26 under mid-tier 7.1.00.002 has crashed only once in the last nine months (last October), I’m not convinced yet that 006 is any improvement. Am working with support on it… Christopher Strauss, Ph.D. Call Tracking Administration Manager University of North Texas Computing IT Center http://itsm.unt.edu/ From:Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Joe DeSouza Sent: Tuesday, February 03, 2009 2:21 PM To: arslist@ARSLIST.ORG Subject: Re: Apache Tomcat Memory Pool ** Patch 006 has definitely seen a marked decrease in the tomcat crashes we have experienced here and that too those were not becuase of OutOfMemory errors. If you view the contents of your current catalina.out file, I can bet that your crashes are due to OutOfMemory errors. Another useful tip would be to turn on incremental garbage collection. This is always good to free up unused portions of memory that haven't been used for a significant time interval. Joe From:Begosh, Kevin kevin.beg...@lmco.com To: arslist@ARSLIST.ORG Sent: Tuesday, February 3, 2009 3:14:40 PM Subject: Re: Apache Tomcat Memory Pool ** Yes this does help and I am on 7.1 as well so this would help out a lot. We are having those exact issue with Tomcat crashing. Kevin Begosh, RSP Tech Ops Enterprise Business Services 301-791-3540 Phone 410-422-3623 Cell kevin.beg...@lmco.com From:Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Joe DeSouza Sent: Tuesday, February 03, 2009 1:13 PM To: arslist@ARSLIST.ORG Subject: Re: Apache Tomcat Memory Pool ** Thsi is more of a Tomcat setting than a 'BMC recommended' setting. The golden rule for sizing tomcat memory is to not use more than 65% to 70% of the available free memory before the tomcat service is started. This gives the server at least 30% to 35% headroom. With that in mind it is nice to have a max
Re: Apache Tomcat Memory Pool
I guess since my customer is still on ITSP 4.x and not yet using ITSM 7, we didn't have to deal with the problem with the CCM Calander that you described. But thats good information to have should we happen to go that route anytime.. Joe From: strauss stra...@unt.edu To: arslist@ARSLIST.ORG Sent: Tuesday, February 3, 2009 5:54:40 PM Subject: Re: Apache Tomcat Memory Pool ** The most likely problem is the fact that they are still shipping mid-tier 7.1.00.006 with ar*70.dlls that are almost guaranteed to crash mid-tier (and tomcat with it) if you try to access the CCM Calendar View from any client. I restored the six Feb 2008 versions of the dlls from 7.0.01.006 and the calendar immediately began working correctly. I can’t believe (okay, yes I can) that they have not incorporated this file correction into 7.1 mid-tier patches post 002 – they’ve known about it since February 2008! At this point the mid-tier patch 006 and flashboards patch 005 appear to be stable, but I still refuse to update production until I see it behave properly over much more testing. Since we are prototyping a lot of Asset and Change configuration and usage on development, we will be pounding on it steadily for the next two weeks. Christopher Strauss, Ph.D. Call Tracking Administration Manager University of North Texas Computing IT Center http://itsm.unt.edu/ From:Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Joe DeSouza Sent: Tuesday, February 03, 2009 4:41 PM To: arslist@ARSLIST.ORG Subject: Re: Apache Tomcat Memory Pool ** The only difference I see between your environment is your version of java, your operating system that mid-tier is installed on, and the fact that we do not use flashboards to know if displaying them would cause tomcat to crash (we are on ITSP that has no flashboards out of the box). Its over 24 hours now that we upgraded our production to patch 006 (we have 10 mid tier servers behind a load balancer) and none of the servers have crashed as yet whereas on an average with patch 003 at least 5 of them would have crashed in a day. On one freak day we had 9 of them crash. Joe From:strauss stra...@unt.edu To: arslist@ARSLIST.ORG Sent: Tuesday, February 3, 2009 4:20:10 PM Subject: Re: Apache Tomcat Memory Pool ** Windows 2003 Enterprise x86 dev w 3 gb ram and 4 cores (production is x64 with 12 gb RAM and 8 cores, but I don’t have hardware for equivalent dev box). Dev was running fine as 7.1.00.002 mod with 7.0.00.006 *70 dlls to work properly with CCMCalendar. Flashboards was fine except for the “normal” errors in the mid-tier log. Tomcat was 5.5.26 per instruction from support last spring, since rescinded. Removed mid-tier and tomcat. Installed mid-tier 7.1.00.006 with bundled tomcat 5.5.25. Upgraded Flashboards to 7.1.00.005 (there is no 006). All of my java is 1.5.0_14 and will remain that way – has been stable for a year with 7.1.00.x code. Flashboards is now crashing in SOME consoles, not others (Change, not Incident or Asset). Was crashing ALL the time until I reinstalled it again… CCMCalendar crashing too, now – had not checked it in a while, though. Lots more testing to do, but it’s hardly stable. Christopher Strauss, Ph.D. Call Tracking Administration Manager University of North Texas Computing IT Center http://itsm.unt.edu/ From:Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Joe DeSouza Sent: Tuesday, February 03, 2009 3:07 PM To: arslist@ARSLIST.ORG Subject: Re: Apache Tomcat Memory Pool ** Chris, What problems are you facing? I have it running for a few weeks on UAT with no problems, and just yesterday went live on production and no problems so far. It seems to have ceased crashing as regulary as it used to. I am using Tomcat 5.5.25 and java 1.6 (I can get you the exact version if you want that.). And I have my max memory set as reccommended earlier on this thread by me (about 65% of the total available free memory before tomcat is started with every other service besides tomcat started).. Are you on unix or windows? I am on UNIX. Cheers Joe From:strauss stra...@unt.edu To: arslist@ARSLIST.ORG Sent: Tuesday, February 3, 2009 3:41:49 PM Subject: Re: Apache Tomcat Memory Pool ** So far all of my attempts to build a stable mid-tier on 7.1.00.006 to replace 002 are failing, with flashboard and CCMCalendar crashes killing the mid-tier tomcat 5.5.25 instance. Considering that the production tomcat 5.5.26 under mid-tier 7.1.00.002 has crashed only once in the last nine months (last October), I’m not convinced yet that 006 is any improvement. Am working with support on it… Christopher Strauss, Ph.D. Call Tracking Administration Manager University of North Texas Computing IT Center http://itsm.unt.edu
Re: Apache Tomcat Memory Pool
Yes this does help and I am on 7.1 as well so this would help out a lot. We are having those exact issue with Tomcat crashing. Kevin Begosh, RSP Tech Ops Enterprise Business Services 301-791-3540 Phone 410-422-3623 Cell kevin.beg...@lmco.com From: Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Joe DeSouza Sent: Tuesday, February 03, 2009 1:13 PM To: arslist@ARSLIST.ORG Subject: Re: Apache Tomcat Memory Pool ** Thsi is more of a Tomcat setting than a 'BMC recommended' setting. The golden rule for sizing tomcat memory is to not use more than 65% to 70% of the available free memory before the tomcat service is started. This gives the server at least 30% to 35% headroom. With that in mind it is nice to have a max memory of at least around the 3 GB mark where the usage of the servers is about average. Since you are using tomcat, if you are using Mid-Tier 7.1, I would recommend to hop on the patch 006. In my experience here the earlier patches had a memory issue, that addresses OutOfMemory errors that cause Tomcat to crash which was addressed in Patch 006. Also the performance is way better as I have noticed that it takes a relatively short time for the server to build its cache after an initial restart on patch 006 (at least 5 to 10 times faster) than it was on lets say Patch 003. I haven't tried patches in between 003 and 006 Hope this helps.. Cheers Joe From: Begosh, Kevin kevin.beg...@lmco.com To: arslist@ARSLIST.ORG Sent: Tuesday, February 3, 2009 12:53:46 PM Subject: Apache Tomcat Memory Pool ** Does anyone know what the BMC recommended or what the best settings are for the Apache Tomcat memory pool for the Mid Tier. We are windows 2003 and we have two mid tiers that are load balanced. Kevin Begosh, RSP Tech Ops Enterprise Business Services 301-791-3540 Phone 410-422-3623 Cell kevin.beg...@lmco.com __Platinum Sponsor: RMI Solutions ARSlist: Where the Answers Are html___ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor: RMI Solutions ARSlist: Where the Answers Are
Re: Apache Tomcat Memory Pool
The most likely problem is the fact that they are still shipping mid-tier 7.1.00.006 with ar*70.dlls that are almost guaranteed to crash mid-tier (and tomcat with it) if you try to access the CCM Calendar View from any client. I restored the six Feb 2008 versions of the dlls from 7.0.01.006 and the calendar immediately began working correctly. I can't believe (okay, yes I can) that they have not incorporated this file correction into 7.1 mid-tier patches post 002 - they've known about it since February 2008! At this point the mid-tier patch 006 and flashboards patch 005 appear to be stable, but I still refuse to update production until I see it behave properly over much more testing. Since we are prototyping a lot of Asset and Change configuration and usage on development, we will be pounding on it steadily for the next two weeks. Christopher Strauss, Ph.D. Call Tracking Administration Manager University of North Texas Computing IT Center http://itsm.unt.edu/ From: Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Joe DeSouza Sent: Tuesday, February 03, 2009 4:41 PM To: arslist@ARSLIST.ORG Subject: Re: Apache Tomcat Memory Pool ** The only difference I see between your environment is your version of java, your operating system that mid-tier is installed on, and the fact that we do not use flashboards to know if displaying them would cause tomcat to crash (we are on ITSP that has no flashboards out of the box). Its over 24 hours now that we upgraded our production to patch 006 (we have 10 mid tier servers behind a load balancer) and none of the servers have crashed as yet whereas on an average with patch 003 at least 5 of them would have crashed in a day. On one freak day we had 9 of them crash. Joe From: strauss stra...@unt.edu To: arslist@ARSLIST.ORG Sent: Tuesday, February 3, 2009 4:20:10 PM Subject: Re: Apache Tomcat Memory Pool ** Windows 2003 Enterprise x86 dev w 3 gb ram and 4 cores (production is x64 with 12 gb RAM and 8 cores, but I don't have hardware for equivalent dev box). Dev was running fine as 7.1.00.002 mod with 7.0.00.006 *70 dlls to work properly with CCMCalendar. Flashboards was fine except for the normal errors in the mid-tier log. Tomcat was 5.5.26 per instruction from support last spring, since rescinded. Removed mid-tier and tomcat. Installed mid-tier 7.1.00.006 with bundled tomcat 5.5.25. Upgraded Flashboards to 7.1.00.005 (there is no 006). All of my java is 1.5.0_14 and will remain that way - has been stable for a year with 7.1.00.x code. Flashboards is now crashing in SOME consoles, not others (Change, not Incident or Asset). Was crashing ALL the time until I reinstalled it again... CCMCalendar crashing too, now - had not checked it in a while, though. Lots more testing to do, but it's hardly stable. Christopher Strauss, Ph.D. Call Tracking Administration Manager University of North Texas Computing IT Center http://itsm.unt.edu/ From: Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Joe DeSouza Sent: Tuesday, February 03, 2009 3:07 PM To: arslist@ARSLIST.ORG Subject: Re: Apache Tomcat Memory Pool ** Chris, What problems are you facing? I have it running for a few weeks on UAT with no problems, and just yesterday went live on production and no problems so far. It seems to have ceased crashing as regulary as it used to. I am using Tomcat 5.5.25 and java 1.6 (I can get you the exact version if you want that.). And I have my max memory set as reccommended earlier on this thread by me (about 65% of the total available free memory before tomcat is started with every other service besides tomcat started).. Are you on unix or windows? I am on UNIX. Cheers Joe From: strauss stra...@unt.edu To: arslist@ARSLIST.ORG Sent: Tuesday, February 3, 2009 3:41:49 PM Subject: Re: Apache Tomcat Memory Pool ** So far all of my attempts to build a stable mid-tier on 7.1.00.006 to replace 002 are failing, with flashboard and CCMCalendar crashes killing the mid-tier tomcat 5.5.25 instance. Considering that the production tomcat 5.5.26 under mid-tier 7.1.00.002 has crashed only once in the last nine months (last October), I'm not convinced yet that 006 is any improvement. Am working with support on it... Christopher Strauss, Ph.D. Call Tracking Administration Manager University of North Texas Computing IT Center http://itsm.unt.edu/ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor: RMI Solutions ARSlist: Where the Answers Are
Re: Apache Tomcat Memory Pool
How do you turn on Another useful tip would be to turn on incremental garbage collection. This is always good to free up unused portions of memory that haven't been used for a significant time interval. Kevin Begosh, RSP Tech Ops Enterprise Business Services 301-791-3540 Phone 410-422-3623 Cell kevin.beg...@lmco.com From: Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Joe DeSouza Sent: Tuesday, February 03, 2009 1:21 PM To: arslist@ARSLIST.ORG Subject: Re: Apache Tomcat Memory Pool ** Patch 006 has definitely seen a marked decrease in the tomcat crashes we have experienced here and that too those were not becuase of OutOfMemory errors. If you view the contents of your current catalina.out file, I can bet that your crashes are due to OutOfMemory errors. Another useful tip would be to turn on incremental garbage collection. This is always good to free up unused portions of memory that haven't been used for a significant time interval. Joe From: Begosh, Kevin kevin.beg...@lmco.com To: arslist@ARSLIST.ORG Sent: Tuesday, February 3, 2009 3:14:40 PM Subject: Re: Apache Tomcat Memory Pool ** Yes this does help and I am on 7.1 as well so this would help out a lot. We are having those exact issue with Tomcat crashing. Kevin Begosh, RSP Tech Ops Enterprise Business Services 301-791-3540 Phone 410-422-3623 Cell kevin.beg...@lmco.com From: Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Joe DeSouza Sent: Tuesday, February 03, 2009 1:13 PM To: arslist@ARSLIST.ORG Subject: Re: Apache Tomcat Memory Pool ** Thsi is more of a Tomcat setting than a 'BMC recommended' setting. The golden rule for sizing tomcat memory is to not use more than 65% to 70% of the available free memory before the tomcat service is started. This gives the server at least 30% to 35% headroom. With that in mind it is nice to have a max memory of at least around the 3 GB mark where the usage of the servers is about average. Since you are using tomcat, if you are using Mid-Tier 7.1, I would recommend to hop on the patch 006. In my experience here the earlier patches had a memory issue, that addresses OutOfMemory errors that cause Tomcat to crash which was addressed in Patch 006. Also the performance is way better as I have noticed that it takes a relatively short time for the server to build its cache after an initial restart on patch 006 (at least 5 to 10 times faster) than it was on lets say Patch 003. I haven't tried patches in between 003 and 006 Hope this helps.. Cheers Joe From: Begosh, Kevin kevin.beg...@lmco.com To: arslist@ARSLIST.ORG Sent: Tuesday, February 3, 2009 12:53:46 PM Subject: Apache Tomcat Memory Pool ** Does anyone know what the BMC recommended or what the best settings are for the Apache Tomcat memory pool for the Mid Tier. We are windows 2003 and we have two mid tiers that are load balanced. Kevin Begosh, RSP Tech Ops Enterprise Business Services 301-791-3540 Phone 410-422-3623 Cell kevin.beg...@lmco.com __Platinum Sponsor: RMI Solutions ARSlist: Where the Answers Are html___ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor: RMI Solutions ARSlist: Where the Answers Are
Re: Apache Tomcat Memory Pool
Patch 006 has definitely seen a marked decrease in the tomcat crashes we have experienced here and that too those were not becuase of OutOfMemory errors. If you view the contents of your current catalina.out file, I can bet that your crashes are due to OutOfMemory errors. Another useful tip would be to turn on incremental garbage collection. This is always good to free up unused portions of memory that haven't been used for a significant time interval. Joe From: Begosh, Kevin kevin.beg...@lmco.com To: arslist@ARSLIST.ORG Sent: Tuesday, February 3, 2009 3:14:40 PM Subject: Re: Apache Tomcat Memory Pool ** Yes this does help and I am on 7.1 as well so this would help out a lot. We are having those exact issue with Tomcat crashing. Kevin Begosh, RSP Tech Ops Enterprise Business Services 301-791-3540 Phone 410-422-3623 Cell kevin.beg...@lmco.com From:Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Joe DeSouza Sent: Tuesday, February 03, 2009 1:13 PM To: arslist@ARSLIST.ORG Subject: Re: Apache Tomcat Memory Pool ** Thsi is more of a Tomcat setting than a 'BMC recommended' setting. The golden rule for sizing tomcat memory is to not use more than 65% to 70% of the available free memory before the tomcat service is started. This gives the server at least 30% to 35% headroom. With that in mind it is nice to have a max memory of at least around the 3 GB mark where the usage of the servers is about average. Since you are using tomcat, if you are using Mid-Tier 7.1, I would recommend to hop on the patch 006. In my experience here the earlier patches had a memory issue, that addresses OutOfMemory errors that cause Tomcat to crash which was addressed in Patch 006. Also the performance is way better as I have noticed that it takes a relatively short time for the server to build its cache after an initial restart on patch 006 (at least 5 to 10 times faster) than it was on lets say Patch 003. I haven't tried patches in between 003 and 006 Hope this helps.. Cheers Joe From:Begosh, Kevin kevin.beg...@lmco.com To: arslist@ARSLIST.ORG Sent: Tuesday, February 3, 2009 12:53:46 PM Subject: Apache Tomcat Memory Pool ** Does anyone know what the BMC recommended or what the best settings are for the Apache Tomcat memory pool for the Mid Tier. We are windows 2003 and we have two mid tiers that are load balanced. Kevin Begosh, RSP Tech Ops Enterprise Business Services 301-791-3540 Phone 410-422-3623 Cell kevin.beg...@lmco.com ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor: RMI Solutions ARSlist: Where the Answers Are