Re: Tomcat 8/Redhat Linux 6.6 /Kernal 2.6.32 - Memory Won't Release
blockquote, div.yahoo_quoted { margin-left: 0 !important; border-left:1px
#715FFA solid !important; padding-left:1ex !important; background-color:white
!important; } I need some direction. It seems like the solution was to use
-XX:MinHeapFreeRatio=25 -XX:MaxheapFreeRatio=50
While looking at the net, are there specific parameters for red hat Linux? If
so, where do you find them? RHL has some parameters for JBoss but can't find
much for tomcat.
Eric
Sent from Yahoo Mail for iPhone
On Monday, March 20, 2017, 7:55 PM, Eric Chua <in_hi...@yahoo.com> wrote:
I use free -m , ps and top. I have three separate web applications. One that
runs one Tomcat7/Java 7, one built on Java8/Tomcat8 and one that was converted
from Java7/Tomcat7 to Java8/tomcat8. When running our Java 7 application, it
takes very little memory running on windows and Linux. For the Java8/Tomcat 8
applications, the memory balloons for both to the point all other applications
slow down. We are running seeing this issue in QA right now. We noticed that
our UAT didn't have this issue so we moved the code over to QA and pointed to
the UAT DB environment. The problem seems to go away but when we take the same
UAT Code on QA server and point to the QA DB, the problem (memory ballooning)
came back. We are still testing but noticed that we do a monthly patch. Our QA
server which was recently patched has a newer patch than our UAT environment.
We are going to try to recreate the same problem with our UAT environment
tomorrow. It is strange that the QA db seems to trigger the issue but it might
be because QA has many more records. What can't be explained is the memory
that disappears. We attempted to clear the memory cache by freeing it
up(Aurelien Suggestion) and it doesn't seem to work. The memory is being held
or utilized. I am not the unix admin so I have to keep going back and forth
with him and we are constantly rebooting the server to recover the memory to
try to figure out this issue.
QA Server - Linux QA 2.6.32-642.15.1.el6.x86_64
UAT - Linux UAT 2.6.32-642.13.1.el6.x86_64
The administrator is pointing to our application and says he believes we have a
memory leak. We are using JProfiler, and can't find any leak. We have a
garbage collection log. Would that help to identify the issue?
Thanks for everyone's input. Still looking. Hoping tomorrow we get a more
definitive answer on the source of the issue.
On Monday, March 20, 2017 5:08 PM, calder <calder@gmail.com> wrote:
On Mon, Mar 20, 2017 at 4:46 PM, Eric Chua <in_hi...@yahoo.com.invalid> wrote:
> siteadm@mavs01web11q:/data/tools/jvmtop $ top -U siteadm
>
> top - 12:41:20 up 19 min, 3 users, load average: 1.25, 1.24, 0.87
>
> Tasks: 130 total, 1 running, 129 sleeping, 0 stopped, 0 zombie
> Cpu(s): 98.5%us, 1.0%sy, 0.0%ni, 0.0%id, 0.0%wa, 0.0%hi, 0.5%si, 0.0%st
> Mem: 16334352k total, 15623536k used, 710816k free, 84096k buffers
> Swap: 4128764k total, 0k used, 4128764k free, 339484k cached
>
> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
> 2019 siteadm 20 0 6054m 4.1g 17m S 98.0 26.5 11:29.56 java
> 2523 siteadm 20 0 19288 1452 1080 R 0.3 0.0 0:00.02 top
> 1950 siteadm 20 0 105m 2100 1560 S 0.0 0.0 0:00.14 bash
>
> On Monday, March 20, 2017, 10:21 AM, Eric Chua <in_hi...@yahoo.com> wrote:
>
> siteadm 2007 1 7 11:04 pts/0 00:00:00
> /data/java/jdk1.8.0_121/bin/java -
[snip]
>
> My kernel is 2.6.32-642.15.1.elf.x86_64
> Memory gets all allocated and after I kill it only a portion is recovered.
> Any ideas?
>
> top - 11:18:36 up 16 min, 2 users, load average: 1.92, 1.39, 0.68
> Tasks: 123 total, 1 running, 122 sleeping, 0 stopped, 0 zombie
> Cpu(s): 0.7%us, 0.0%sy, 0.0%ni, 99.3%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
> Mem: 16334352k total, 11215624k used, 5118728k free, 33788k buffers
> Swap: 4128764k total, 0k used, 4128764k free, 313940k cached
> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
> 1931 siteadm 20 0 105m 2120 1568 S 0.0 0.0 0:00.10 bash
> 2319 siteadm 20 0 19288 1460 1092 R 0.0 0.0 0:00.09 top
Please do not top-post - if that term is unfamiliar to you, please
read this before posting again.
http://www.idallen.com/topposting.html
"top" is simply a "ps" that refreshes its output every so often.
A word of warning - for "ps" (and of course "top"), the output of VSZ
and RSS are almost **always wrong**. If that statement is doubtful
to anyone, choose a process in the ps list and run "pmap -d <pid#>"
and compare the results - you will see that the ps output is usually
over-inflated (we'll not get into the why's here).
If you are worried about the "Mem: 16334352k total, 11215624k used,
5118728k free"
Re: Tomcat 8/Redhat Linux 6.6 /Kernal 2.6.32 - Memory Won't Release
I use free -m , ps and top. I have three separate web applications. One that runs one Tomcat7/Java 7, one built on Java8/Tomcat8 and one that was converted from Java7/Tomcat7 to Java8/tomcat8. When running our Java 7 application, it takes very little memory running on windows and Linux. For the Java8/Tomcat 8 applications, the memory balloons for both to the point all other applications slow down. We are running seeing this issue in QA right now. We noticed that our UAT didn't have this issue so we moved the code over to QA and pointed to the UAT DB environment. The problem seems to go away but when we take the same UAT Code on QA server and point to the QA DB, the problem (memory ballooning) came back. We are still testing but noticed that we do a monthly patch. Our QA server which was recently patched has a newer patch than our UAT environment. We are going to try to recreate the same problem with our UAT environment tomorrow. It is strange that the QA db seems to trigger the issue but it might be because QA has many more records. What can't be explained is the memory that disappears. We attempted to clear the memory cache by freeing it up(Aurelien Suggestion) and it doesn't seem to work. The memory is being held or utilized. I am not the unix admin so I have to keep going back and forth with him and we are constantly rebooting the server to recover the memory to try to figure out this issue. QA Server - Linux QA 2.6.32-642.15.1.el6.x86_64 UAT - Linux UAT 2.6.32-642.13.1.el6.x86_64 The administrator is pointing to our application and says he believes we have a memory leak. We are using JProfiler, and can't find any leak. We have a garbage collection log. Would that help to identify the issue? Thanks for everyone's input. Still looking. Hoping tomorrow we get a more definitive answer on the source of the issue. On Monday, March 20, 2017 5:08 PM, calder <calder@gmail.com> wrote: On Mon, Mar 20, 2017 at 4:46 PM, Eric Chua <in_hi...@yahoo.com.invalid> wrote: > siteadm@mavs01web11q:/data/tools/jvmtop $ top -U siteadm > > top - 12:41:20 up 19 min, 3 users, load average: 1.25, 1.24, 0.87 > > Tasks: 130 total, 1 running, 129 sleeping, 0 stopped, 0 zombie > Cpu(s): 98.5%us, 1.0%sy, 0.0%ni, 0.0%id, 0.0%wa, 0.0%hi, 0.5%si, 0.0%st > Mem: 16334352k total, 15623536k used, 710816k free, 84096k buffers > Swap: 4128764k total, 0k used, 4128764k free, 339484k cached > > PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND > 2019 siteadm 20 0 6054m 4.1g 17m S 98.0 26.5 11:29.56 java > 2523 siteadm 20 0 19288 1452 1080 R 0.3 0.0 0:00.02 top > 1950 siteadm 20 0 105m 2100 1560 S 0.0 0.0 0:00.14 bash > > On Monday, March 20, 2017, 10:21 AM, Eric Chua <in_hi...@yahoo.com> wrote: > > siteadm 2007 1 7 11:04 pts/0 00:00:00 > /data/java/jdk1.8.0_121/bin/java - [snip] > > My kernel is 2.6.32-642.15.1.elf.x86_64 > Memory gets all allocated and after I kill it only a portion is recovered. > Any ideas? > > top - 11:18:36 up 16 min, 2 users, load average: 1.92, 1.39, 0.68 > Tasks: 123 total, 1 running, 122 sleeping, 0 stopped, 0 zombie > Cpu(s): 0.7%us, 0.0%sy, 0.0%ni, 99.3%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st > Mem: 16334352k total, 11215624k used, 5118728k free, 33788k buffers > Swap: 4128764k total, 0k used, 4128764k free, 313940k cached > PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND > 1931 siteadm 20 0 105m 2120 1568 S 0.0 0.0 0:00.10 bash > 2319 siteadm 20 0 19288 1460 1092 R 0.0 0.0 0:00.09 top Please do not top-post - if that term is unfamiliar to you, please read this before posting again. http://www.idallen.com/topposting.html "top" is simply a "ps" that refreshes its output every so often. A word of warning - for "ps" (and of course "top"), the output of VSZ and RSS are almost **always wrong**. If that statement is doubtful to anyone, choose a process in the ps list and run "pmap -d <pid#>" and compare the results - you will see that the ps output is usually over-inflated (we'll not get into the why's here). If you are worried about the "Mem: 16334352k total, 11215624k used, 5118728k free" output from ps/top, don't be - Linux will take up RAM to use for caching, and in many cases, you may see a Linux (or Unix) system where there is almost NO available memory. But don't be alarmed, because Linux will provide memory from the pool at new processes are launched. I firmly believe someone is mis-interpreting the output of ps/top on this machine. I have worked with many a Linux "admins" who don't quite understand how to interpret the output data of the various utilities or how the Kernel works. Let's look at your "before and after" ps output just
Re: Tomcat 8/Redhat Linux 6.6 /Kernal 2.6.32 - Memory Won't Release
blockquote, div.yahoo_quoted { margin-left: 0 !important; border-left:1px
#715FFA solid !important; padding-left:1ex !important; background-color:white
!important; } When I run my application in a windows environment I use a few
hundred megabytes. When I use RHL, it takes up the entire 16gb of memory in QA
with one user within minutes. The memory is also unaccounted for. My user
says I am using a few gigabytes and root doesn't own hardly anything.
Sent from Yahoo Mail for iPhone
On Monday, March 20, 2017, 2:11 PM, Thomas Meyer wrote:
With kind regards
Thomas
> Am 17.03.2017 um 14:54 schrieb Christopher Schultz
> :
>> Note that Java *never* gives any memory back to the OS, even when the
> heap-usage goes down. This is a Java thing, not a Tomcat thing.
>
Are you sure about this? I think I've read otherwise somewhere. A quick google
showed up this: http://stackoverflow.com/a/30464183
With kind regards
Thomas
-
To unsubscribe, e-mail: users-unsubscr...@tomcat.apache.org
For additional commands, e-mail: users-h...@tomcat.apache.org
Re: Tomcat 8/Redhat Linux 6.6 /Kernal 2.6.32 - Memory Won't Release
blockquote, div.yahoo_quoted { margin-left: 0 !important; border-left:1px
#715FFA solid !important; padding-left:1ex !important; background-color:white
!important; } I took a based configuration right from the tar file and started
tomcat. I only changed the http and ajp port numbers. I started the tomcat
container and dropped my war file. I have the same problem. I am going to try
to set the memory options . Does my options look reasonable? Any suggestions
would be appreciated.
export CATALINA_OPTS="-XX:MaxMetaspaceSize=1g -XX:+UseG1GC
-XX:MaxDirectMemorySize=1g -Xms256m -Xmx3500m "
Sent from Yahoo Mail for iPhone
On Monday, March 20, 2017, 12:53 PM, Eric Chua <in_hi...@yahoo.com.INVALID>
wrote:
blockquote, div.yahoo_quoted { margin-left: 0 !important; border-left:1px
#715FFA solid !important; padding-left:1ex !important; background-color:white
!important; } Also the configuration files were taken from tomcat 7. Could
there be an issue there?
Sent from Yahoo Mail for iPhone
On Monday, March 20, 2017, 12:17 PM, Eric Chua <in_hi...@yahoo.com.INVALID>
wrote:
blockquote, div.yahoo_quoted { margin-left: 0 !important; border-left:1px
#715FFA solid !important; padding-left:1ex !important; background-color:white
!important; } That is correct and baffling. My user doesn't own that memory
and the unix admin keeps saying it is an issue with a memory leak but if that
was so wouldn't my user own the memory?
Your thoughts would be helpful. Sorry about the formatting.
Sent from Yahoo Mail for iPhone
On Monday, March 20, 2017, 12:07 PM, André Warnier (tomcat) <a...@ice-sa.com>
wrote:
Hi.
I will exceptionally contravene the usual rules of this list, which are to not
top-post.
But your message below is so badly-formatted, that a comment in the middle
would be
difficut to read otherwise.
One thing attracted my attention below : you mention that "the entire memory
was being
used", which seems substantiated by a part of the "top" display :
> Mem: 16334352k total, 15623536k used, 710816k free, 84096k buffers
But, in the subsequent per-process top display, it shows this :
> 2019 siteadm 20 0 6054m 4.1g 17m S 98.0 26.5 11:29.56 java
So, this java process is using 4.1 GB of real memory.
Where did the other 11.9 GB go ?
You might want to run your Java application, and "top" again (without "-U"),
and this time
enter an "M" when top is running, to sort the processes by memory usage.
On 20.03.2017 17:46, Eric Chua wrote:
> blockquote, div.yahoo_quoted { margin-left: 0 !important; border-left:1px
>#715FFA solid !important; padding-left:1ex !important; background-color:white
>!important; } I used jvmtop. The web application used the entire 16gb and the
>allocated heap. The report I was running never finished
>
> ARGS: start
>
> VMARGS: -Djava.util.logging.config.file=/data/tomcat/AgencyWebApp/conf/lo[...]
>
> VM: Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 1.8.0_121
>
> UP: 0:13m #THR: 41 #THRPEAK: 42 #THRCREATED: 49 USER: siteadm
>
> GC-Time: 0: 5m #GC-Runs: 75 #TotalLoadedClasses: 12440
>
> CPU: 91.16% GC: 0.00% HEAP:3590m /3855m NONHEAP: 115m / n/a
>
>
>
> TID NAME STATE CPU TOTALCPU
>BLOCKEDBY
>
> 42 ajp-nio-8011-exec-8 RUNNABLE 69.88% 4.63%
>
> 35 ajp-nio-8011-exec-1 RUNNABLE 19.04% 15.49%
>
> 55 RMI TCP Connection(9)-127.0.0. RUNNABLE 1.60% 0.20%
>
> 54 JMX server connection timeout TIMED_WAITING 0.09% 0.01%
>
> 12 NioBlockingSelector.BlockPolle RUNNABLE 0.07% 0.14%
>
> 47 ajp-nio-8011-AsyncTimeout TIMED_WAITING 0.02% 0.02%
>
> 32 http-nio-8086-ClientPoller-0 RUNNABLE 0.00% 0.05%
>
> 45 ajp-nio-8011-ClientPoller-0 RUNNABLE 0.00% 0.10%
>
> 11 NioBlockingSelector.BlockPolle RUNNABLE 0.00% 0.01%
>
> 34 http-nio-8086-AsyncTimeout TIMED_WAITING 0.00% 0.01%
>
> Note: Only top 10 threads (according cpu load) are shown!
>
> Mar 20, 2017 12:39:28 PM ClientCommunicatorAdmin Checker-run
>
> WARNING: Failed to check the connection: java.net.SocketTimeoutException:
> Read timed out
>
> ^[[A^C^C^C^C^C^C^C^C^C
>
>
>
> siteadm@mavs01web11q:/data/tools/jvmtop $ top -U siteadm
>
> top - 12:41:20 up 19 min, 3 users, load average: 1.25, 1.24, 0.87
>
> Tasks: 130 total, 1 running, 129 sleeping, 0 stopped, 0 zombie
>
> Cpu(s): 98.5%us, 1.0%sy, 0.0%ni, 0.0%id, 0.0%wa, 0.0%hi, 0.5%si, 0.0%st
>
> Mem: 16334352k total, 15623536k used, 710816k free, 84096k buffers
>
> Swap: 4128764k total, 0k used, 4128764k free, 339484k cached
>
>
>
> PID
Re: Tomcat 8/Redhat Linux 6.6 /Kernal 2.6.32 - Memory Won't Release
blockquote, div.yahoo_quoted { margin-left: 0 !important; border-left:1px
#715FFA solid !important; padding-left:1ex !important; background-color:white
!important; } Also the configuration files were taken from tomcat 7. Could
there be an issue there?
Sent from Yahoo Mail for iPhone
On Monday, March 20, 2017, 12:17 PM, Eric Chua <in_hi...@yahoo.com.INVALID>
wrote:
blockquote, div.yahoo_quoted { margin-left: 0 !important; border-left:1px
#715FFA solid !important; padding-left:1ex !important; background-color:white
!important; } That is correct and baffling. My user doesn't own that memory
and the unix admin keeps saying it is an issue with a memory leak but if that
was so wouldn't my user own the memory?
Your thoughts would be helpful. Sorry about the formatting.
Sent from Yahoo Mail for iPhone
On Monday, March 20, 2017, 12:07 PM, André Warnier (tomcat) <a...@ice-sa.com>
wrote:
Hi.
I will exceptionally contravene the usual rules of this list, which are to not
top-post.
But your message below is so badly-formatted, that a comment in the middle
would be
difficut to read otherwise.
One thing attracted my attention below : you mention that "the entire memory
was being
used", which seems substantiated by a part of the "top" display :
> Mem: 16334352k total, 15623536k used, 710816k free, 84096k buffers
But, in the subsequent per-process top display, it shows this :
> 2019 siteadm 20 0 6054m 4.1g 17m S 98.0 26.5 11:29.56 java
So, this java process is using 4.1 GB of real memory.
Where did the other 11.9 GB go ?
You might want to run your Java application, and "top" again (without "-U"),
and this time
enter an "M" when top is running, to sort the processes by memory usage.
On 20.03.2017 17:46, Eric Chua wrote:
> blockquote, div.yahoo_quoted { margin-left: 0 !important; border-left:1px
>#715FFA solid !important; padding-left:1ex !important; background-color:white
>!important; } I used jvmtop. The web application used the entire 16gb and the
>allocated heap. The report I was running never finished
>
> ARGS: start
>
> VMARGS: -Djava.util.logging.config.file=/data/tomcat/AgencyWebApp/conf/lo[...]
>
> VM: Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 1.8.0_121
>
> UP: 0:13m #THR: 41 #THRPEAK: 42 #THRCREATED: 49 USER: siteadm
>
> GC-Time: 0: 5m #GC-Runs: 75 #TotalLoadedClasses: 12440
>
> CPU: 91.16% GC: 0.00% HEAP:3590m /3855m NONHEAP: 115m / n/a
>
>
>
> TID NAME STATE CPU TOTALCPU
>BLOCKEDBY
>
> 42 ajp-nio-8011-exec-8 RUNNABLE 69.88% 4.63%
>
> 35 ajp-nio-8011-exec-1 RUNNABLE 19.04% 15.49%
>
> 55 RMI TCP Connection(9)-127.0.0. RUNNABLE 1.60% 0.20%
>
> 54 JMX server connection timeout TIMED_WAITING 0.09% 0.01%
>
> 12 NioBlockingSelector.BlockPolle RUNNABLE 0.07% 0.14%
>
> 47 ajp-nio-8011-AsyncTimeout TIMED_WAITING 0.02% 0.02%
>
> 32 http-nio-8086-ClientPoller-0 RUNNABLE 0.00% 0.05%
>
> 45 ajp-nio-8011-ClientPoller-0 RUNNABLE 0.00% 0.10%
>
> 11 NioBlockingSelector.BlockPolle RUNNABLE 0.00% 0.01%
>
> 34 http-nio-8086-AsyncTimeout TIMED_WAITING 0.00% 0.01%
>
> Note: Only top 10 threads (according cpu load) are shown!
>
> Mar 20, 2017 12:39:28 PM ClientCommunicatorAdmin Checker-run
>
> WARNING: Failed to check the connection: java.net.SocketTimeoutException:
> Read timed out
>
> ^[[A^C^C^C^C^C^C^C^C^C
>
>
>
> siteadm@mavs01web11q:/data/tools/jvmtop $ top -U siteadm
>
> top - 12:41:20 up 19 min, 3 users, load average: 1.25, 1.24, 0.87
>
> Tasks: 130 total, 1 running, 129 sleeping, 0 stopped, 0 zombie
>
> Cpu(s): 98.5%us, 1.0%sy, 0.0%ni, 0.0%id, 0.0%wa, 0.0%hi, 0.5%si, 0.0%st
>
> Mem: 16334352k total, 15623536k used, 710816k free, 84096k buffers
>
> Swap: 4128764k total, 0k used, 4128764k free, 339484k cached
>
>
>
> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
>
> 2019 siteadm 20 0 6054m 4.1g 17m S 98.0 26.5 11:29.56 java
>
> 2523 siteadm 20 0 19288 1452 1080 R 0.3 0.0 0:00.02 top
>
> 1950 siteadm 20 0 105m 2100 1560 S 0.0 0.0 0:00.14 bash
>
>
> Sent from Yahoo Mail for iPhone
>
>
> On Monday, March 20, 2017, 10:21 AM, Eric Chua <in_hi...@yahoo.com> wrote:
>
>
> siteadm 2007 1 7 11:04 pts/0 00:00:00
> /data/java/jdk1.8.0_121/bin/java
> -Djava.util.logging.config.file=/data/tomcat/AgencyWebApp/conf/logging.properties
> -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
> -Daccuity.servername=mavs01web11q
> -Dorg.apac
Re: Tomcat 8/Redhat Linux 6.6 /Kernal 2.6.32 - Memory Won't Release
blockquote, div.yahoo_quoted { margin-left: 0 !important; border-left:1px
#715FFA solid !important; padding-left:1ex !important; background-color:white
!important; } That is correct and baffling. My user doesn't own that memory
and the unix admin keeps saying it is an issue with a memory leak but if that
was so wouldn't my user own the memory?
Your thoughts would be helpful. Sorry about the formatting.
Sent from Yahoo Mail for iPhone
On Monday, March 20, 2017, 12:07 PM, André Warnier (tomcat) <a...@ice-sa.com>
wrote:
Hi.
I will exceptionally contravene the usual rules of this list, which are to not
top-post.
But your message below is so badly-formatted, that a comment in the middle
would be
difficut to read otherwise.
One thing attracted my attention below : you mention that "the entire memory
was being
used", which seems substantiated by a part of the "top" display :
> Mem: 16334352k total, 15623536k used, 710816k free, 84096k buffers
But, in the subsequent per-process top display, it shows this :
> 2019 siteadm 20 0 6054m 4.1g 17m S 98.0 26.5 11:29.56 java
So, this java process is using 4.1 GB of real memory.
Where did the other 11.9 GB go ?
You might want to run your Java application, and "top" again (without "-U"),
and this time
enter an "M" when top is running, to sort the processes by memory usage.
On 20.03.2017 17:46, Eric Chua wrote:
> blockquote, div.yahoo_quoted { margin-left: 0 !important; border-left:1px
>#715FFA solid !important; padding-left:1ex !important; background-color:white
>!important; } I used jvmtop. The web application used the entire 16gb and the
>allocated heap. The report I was running never finished
>
> ARGS: start
>
> VMARGS: -Djava.util.logging.config.file=/data/tomcat/AgencyWebApp/conf/lo[...]
>
> VM: Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 1.8.0_121
>
> UP: 0:13m #THR: 41 #THRPEAK: 42 #THRCREATED: 49 USER: siteadm
>
> GC-Time: 0: 5m #GC-Runs: 75 #TotalLoadedClasses: 12440
>
> CPU: 91.16% GC: 0.00% HEAP:3590m /3855m NONHEAP: 115m / n/a
>
>
>
> TID NAME STATE CPU TOTALCPU
>BLOCKEDBY
>
> 42 ajp-nio-8011-exec-8 RUNNABLE 69.88% 4.63%
>
> 35 ajp-nio-8011-exec-1 RUNNABLE 19.04% 15.49%
>
> 55 RMI TCP Connection(9)-127.0.0. RUNNABLE 1.60% 0.20%
>
> 54 JMX server connection timeout TIMED_WAITING 0.09% 0.01%
>
> 12 NioBlockingSelector.BlockPolle RUNNABLE 0.07% 0.14%
>
> 47 ajp-nio-8011-AsyncTimeout TIMED_WAITING 0.02% 0.02%
>
> 32 http-nio-8086-ClientPoller-0 RUNNABLE 0.00% 0.05%
>
> 45 ajp-nio-8011-ClientPoller-0 RUNNABLE 0.00% 0.10%
>
> 11 NioBlockingSelector.BlockPolle RUNNABLE 0.00% 0.01%
>
> 34 http-nio-8086-AsyncTimeout TIMED_WAITING 0.00% 0.01%
>
> Note: Only top 10 threads (according cpu load) are shown!
>
> Mar 20, 2017 12:39:28 PM ClientCommunicatorAdmin Checker-run
>
> WARNING: Failed to check the connection: java.net.SocketTimeoutException:
> Read timed out
>
> ^[[A^C^C^C^C^C^C^C^C^C
>
>
>
> siteadm@mavs01web11q:/data/tools/jvmtop $ top -U siteadm
>
> top - 12:41:20 up 19 min, 3 users, load average: 1.25, 1.24, 0.87
>
> Tasks: 130 total, 1 running, 129 sleeping, 0 stopped, 0 zombie
>
> Cpu(s): 98.5%us, 1.0%sy, 0.0%ni, 0.0%id, 0.0%wa, 0.0%hi, 0.5%si, 0.0%st
>
> Mem: 16334352k total, 15623536k used, 710816k free, 84096k buffers
>
> Swap: 4128764k total, 0k used, 4128764k free, 339484k cached
>
>
>
> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
>
> 2019 siteadm 20 0 6054m 4.1g 17m S 98.0 26.5 11:29.56 java
>
> 2523 siteadm 20 0 19288 1452 1080 R 0.3 0.0 0:00.02 top
>
> 1950 siteadm 20 0 105m 2100 1560 S 0.0 0.0 0:00.14 bash
>
>
> Sent from Yahoo Mail for iPhone
>
>
> On Monday, March 20, 2017, 10:21 AM, Eric Chua <in_hi...@yahoo.com> wrote:
>
>
> siteadm 2007 1 7 11:04 pts/0 00:00:00
> /data/java/jdk1.8.0_121/bin/java
> -Djava.util.logging.config.file=/data/tomcat/AgencyWebApp/conf/logging.properties
> -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
> -Daccuity.servername=mavs01web11q
> -Dorg.apache.jasper.compiler.Parser.STRICT_QUOTE_ESCAPING=false
> -Djdk.tls.ephemeralDHKeySize=2048
> -Djava.protocol.handler.pkgs=org.apache.catalina.webresources -classpath
> /data/tomcat/apache-tomcat/bin/bootstrap.jar:/data/tomcat/apache-tomcat/bin/tomcat-juli.jar
> -Dcatalina.base=/data/tomcat/AgencyWebApp
> -Dcatalina.home=/data/tomcat/apache-tomcat
> -Djava
Re: Tomcat 8/Redhat Linux 6.6 /Kernal 2.6.32 - Memory Won't Release
blockquote, div.yahoo_quoted { margin-left: 0 !important; border-left:1px
#715FFA solid !important; padding-left:1ex !important; background-color:white
!important; } I used jvmtop. The web application used the entire 16gb and the
allocated heap. The report I was running never finished
ARGS: start
VMARGS: -Djava.util.logging.config.file=/data/tomcat/AgencyWebApp/conf/lo[...]
VM: Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 1.8.0_121
UP: 0:13m #THR: 41 #THRPEAK: 42 #THRCREATED: 49 USER: siteadm
GC-Time: 0: 5m #GC-Runs: 75 #TotalLoadedClasses: 12440
CPU: 91.16% GC: 0.00% HEAP:3590m /3855m NONHEAP: 115m / n/a
TID NAME STATE CPU TOTALCPU BLOCKEDBY
42 ajp-nio-8011-exec-8 RUNNABLE 69.88% 4.63%
35 ajp-nio-8011-exec-1 RUNNABLE 19.04% 15.49%
55 RMI TCP Connection(9)-127.0.0. RUNNABLE 1.60% 0.20%
54 JMX server connection timeout TIMED_WAITING 0.09% 0.01%
12 NioBlockingSelector.BlockPolle RUNNABLE 0.07% 0.14%
47 ajp-nio-8011-AsyncTimeout TIMED_WAITING 0.02% 0.02%
32 http-nio-8086-ClientPoller-0 RUNNABLE 0.00% 0.05%
45 ajp-nio-8011-ClientPoller-0 RUNNABLE 0.00% 0.10%
11 NioBlockingSelector.BlockPolle RUNNABLE 0.00% 0.01%
34 http-nio-8086-AsyncTimeout TIMED_WAITING 0.00% 0.01%
Note: Only top 10 threads (according cpu load) are shown!
Mar 20, 2017 12:39:28 PM ClientCommunicatorAdmin Checker-run
WARNING: Failed to check the connection: java.net.SocketTimeoutException: Read
timed out
^[[A^C^C^C^C^C^C^C^C^C
siteadm@mavs01web11q:/data/tools/jvmtop $ top -U siteadm
top - 12:41:20 up 19 min, 3 users, load average: 1.25, 1.24, 0.87
Tasks: 130 total, 1 running, 129 sleeping, 0 stopped, 0 zombie
Cpu(s): 98.5%us, 1.0%sy, 0.0%ni, 0.0%id, 0.0%wa, 0.0%hi, 0.5%si, 0.0%st
Mem: 16334352k total, 15623536k used, 710816k free, 84096k buffers
Swap: 4128764k total, 0k used, 4128764k free, 339484k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
2019 siteadm 20 0 6054m 4.1g 17m S 98.0 26.5 11:29.56 java
2523 siteadm 20 0 19288 1452 1080 R 0.3 0.0 0:00.02 top
1950 siteadm 20 0 105m 2100 1560 S 0.0 0.0 0:00.14 bash
Sent from Yahoo Mail for iPhone
On Monday, March 20, 2017, 10:21 AM, Eric Chua <in_hi...@yahoo.com> wrote:
siteadm 2007 1 7 11:04 pts/0 00:00:00
/data/java/jdk1.8.0_121/bin/java
-Djava.util.logging.config.file=/data/tomcat/AgencyWebApp/conf/logging.properties
-Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
-Daccuity.servername=mavs01web11q
-Dorg.apache.jasper.compiler.Parser.STRICT_QUOTE_ESCAPING=false
-Djdk.tls.ephemeralDHKeySize=2048
-Djava.protocol.handler.pkgs=org.apache.catalina.webresources -classpath
/data/tomcat/apache-tomcat/bin/bootstrap.jar:/data/tomcat/apache-tomcat/bin/tomcat-juli.jar
-Dcatalina.base=/data/tomcat/AgencyWebApp
-Dcatalina.home=/data/tomcat/apache-tomcat
-Djava.io.tmpdir=/data/tomcat/AgencyWebApp/temp
org.apache.catalina.startup.Bootstrap start
My kernel is 2.6.32-642.15.1.elf.x86_64
Memory gets all allocated and after I kill it only a portion is recovered.
Any ideas?
top - 11:18:36 up 16 min, 2 users, load average: 1.92, 1.39, 0.68
Tasks: 123 total, 1 running, 122 sleeping, 0 stopped, 0 zombie
Cpu(s): 0.7%us, 0.0%sy, 0.0%ni, 99.3%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
Mem: 16334352k total, 11215624k used, 5118728k free, 33788k buffers
Swap: 4128764k total, 0k used, 4128764k free, 313940k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
1931 siteadm 20 0 105m 2120 1568 S 0.0 0.0 0:00.10 bash
2319 siteadm 20 0 19288 1460 1092 R 0.0 0.0 0:00.09 top
Sent from Yahoo Mail for iPhone
On Friday, March 17, 2017, 8:54 AM, Christopher Schultz
<ch...@christopherschultz.net> wrote:
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256
Eric,
On 3/16/17 11:01 PM, Eric Chua wrote:
> I am running tomcat 8.0.121. When I start my tomcat, it seems to
> be eating up all the memory on my system. I have 16 GB, and it
> keeps on going.
What are your memory-related parameters when you launch the JVM?
Note that Java *never* gives any memory back to the OS, even when the
heap-usage goes down. This is a Java thing, not a Tomcat thing.
> Then when I try to kill the process, it dies but 12 GB is still
> being used even though everything is turn off.
That makes no sense at all. Please provide some evidence this is
happening.
> The only way to reclaim the memory is to reboot.
If this is true, then you have some kind of awful kernel bug.
> I am running on redhat 6.5 and can't figure out what could be
> causing this. I run the tomcat as a local user, and I know there
> aren't a
Re: Tomcat 8/Redhat Linux 6.6 /Kernal 2.6.32 - Memory Won't Release
blockquote, div.yahoo_quoted { margin-left: 0 !important; border-left:1px
#715FFA solid !important; padding-left:1ex !important; background-color:white
!important; }
siteadm 2007 1 7 11:04 pts/0 00:00:00
/data/java/jdk1.8.0_121/bin/java
-Djava.util.logging.config.file=/data/tomcat/AgencyWebApp/conf/logging.properties
-Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
-Daccuity.servername=mavs01web11q
-Dorg.apache.jasper.compiler.Parser.STRICT_QUOTE_ESCAPING=false
-Djdk.tls.ephemeralDHKeySize=2048
-Djava.protocol.handler.pkgs=org.apache.catalina.webresources -classpath
/data/tomcat/apache-tomcat/bin/bootstrap.jar:/data/tomcat/apache-tomcat/bin/tomcat-juli.jar
-Dcatalina.base=/data/tomcat/AgencyWebApp
-Dcatalina.home=/data/tomcat/apache-tomcat
-Djava.io.tmpdir=/data/tomcat/AgencyWebApp/temp
org.apache.catalina.startup.Bootstrap start
My kernel is 2.6.32-642.15.1.elf.x86_64
Memory gets all allocated and after I kill it only a portion is recovered.
Any ideas?
top - 11:18:36 up 16 min, 2 users, load average: 1.92, 1.39, 0.68
Tasks: 123 total, 1 running, 122 sleeping, 0 stopped, 0 zombie
Cpu(s): 0.7%us, 0.0%sy, 0.0%ni, 99.3%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
Mem: 16334352k total, 11215624k used, 5118728k free, 33788k buffers
Swap: 4128764k total, 0k used, 4128764k free, 313940k cached
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
1931 siteadm 20 0 105m 2120 1568 S 0.0 0.0 0:00.10 bash
2319 siteadm 20 0 19288 1460 1092 R 0.0 0.0 0:00.09 top
Sent from Yahoo Mail for iPhone
On Friday, March 17, 2017, 8:54 AM, Christopher Schultz
<ch...@christopherschultz.net> wrote:
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256
Eric,
On 3/16/17 11:01 PM, Eric Chua wrote:
> I am running tomcat 8.0.121. When I start my tomcat, it seems to
> be eating up all the memory on my system. I have 16 GB, and it
> keeps on going.
What are your memory-related parameters when you launch the JVM?
Note that Java *never* gives any memory back to the OS, even when the
heap-usage goes down. This is a Java thing, not a Tomcat thing.
> Then when I try to kill the process, it dies but 12 GB is still
> being used even though everything is turn off.
That makes no sense at all. Please provide some evidence this is
happening.
> The only way to reclaim the memory is to reboot.
If this is true, then you have some kind of awful kernel bug.
> I am running on redhat 6.5 and can't figure out what could be
> causing this. I run the tomcat as a local user, and I know there
> aren't any other processes running as the local user. I am running
> a spring MVC 4/Java 8/ struts web application. I have two of them
> with the same issue. Any help would be appreciated. When I try to
> view all the running processes I cannot see where most of the 12 gb
> are being used. The system came up with 2.2 gb used and after I
> start one web application it goes to 14-15gb.
Ok.
> The funny thing is that I can kill it to reclaim the memory. Only
> a reboot works.
You mean you CAN'T kill in to reclaim memory, right?
> I am running a VMware instance with vcenter version 6.5. This
> does not happen with Java 7 with tomcat 7. Any help would be
> appreciate.
Something tells me you are reading or interpreting something
incorrectly, here. Can you please share your raw data, and where you
got that raw data? Something like reports from free/ps/top/sar/etc.?
- -chris
-BEGIN PGP SIGNATURE-
Comment: GPGTools - http://gpgtools.org
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/
iQIcBAEBCAAGBQJYy+qWAAoJEBzwKT+lPKRYd38P/34EhmWZaueHBR2cLJeitXa9
SOd5pf1XrtgVyyx6FebFQkNlckzUVV3LCrPMkL+OudWjezqU0c7O/F1sRlVJk18V
A767jMpcSRI183QpDPBmbHKv6zsoVVibyXwMTbTDRAKzV+7JEGA4SrMEzEoyTcIv
gak5ctUvAH6t+jQrLiuVCCIpsKnvDwoYmsbDo0fXmZ+mQgIHYSr3D4UCCEPBtsar
o5uDJrwbGZRtKsHSvRoCxTGXlXIlD8SUE/+SlPsHo+R79AXN0cyI2GYSh8OfAW12
7gLzvrGpRzwyD34V/uFhoTugIx5OnNuN0Pw2jGBjrlRsDvBETiy/1CRKwMDe7u59
7ev9emoq5WpNRrDJuBN4MMzrFtBNOM/o04MPg5KVoM0clHyXOJrXbHJ1EkYWIkLr
fdHr9ejfS9mQhYSYKXXSbjEDGOGGLrLmPbUJ6gfAg5PqsyNTYTYW24+bvpt1MykZ
dkQXAB1CQ0YdNm6YIipYMD/d9kEYVpbXEKuVGT7QWTHRD3z/Pdcfp4hb05ckw0a3
UIa8Jk1yh8Z+f4pjAKFPi1VhhbaGU8VjGXKpdVcso/Ljohe/SzKs+IWuSJ/H97tE
VzEwgYaMEPdtfSnBG5Hf/6HtnME4TCXSBn8rBcGCgn4/rvUIMJZOlXePRT0BLBOt
/vhOk/rN/5h1XOrqVaqF
=hBJ4
-END PGP SIGNATURE-
-
To unsubscribe, e-mail: users-unsubscr...@tomcat.apache.org
For additional commands, e-mail: users-h...@tomcat.apache.org
Re: Tomcat 8/Redhat Linux 6.6 /Kernal 2.6.32 - Memory Won't Release
blockquote, div.yahoo_quoted { margin-left: 0 !important; border-left:1px
#715FFA solid !important; padding-left:1ex !important; background-color:white
!important; } Thanks for getting back to me. The Linux version is 6.8. I am
unable to reclaim the memory on the system without a reboot . Though i kill my
process, i dont see where the memory went. When I run the application in
windows I get no problems. The only difference I can see are the parameters
and jmx. I will try to remove all the parameters and start from scratch.
How do I get you raw data? This is observe behavior using top and free. I am
working with our admin to determine a solution.
Thanks
Sent from Yahoo Mail for iPhone
On Friday, March 17, 2017, 8:54 AM, Christopher Schultz
<ch...@christopherschultz.net> wrote:
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256
Eric,
On 3/16/17 11:01 PM, Eric Chua wrote:
> I am running tomcat 8.0.121. When I start my tomcat, it seems to
> be eating up all the memory on my system. I have 16 GB, and it
> keeps on going.
What are your memory-related parameters when you launch the JVM?
Note that Java *never* gives any memory back to the OS, even when the
heap-usage goes down. This is a Java thing, not a Tomcat thing.
> Then when I try to kill the process, it dies but 12 GB is still
> being used even though everything is turn off.
That makes no sense at all. Please provide some evidence this is
happening.
> The only way to reclaim the memory is to reboot.
If this is true, then you have some kind of awful kernel bug.
> I am running on redhat 6.5 and can't figure out what could be
> causing this. I run the tomcat as a local user, and I know there
> aren't any other processes running as the local user. I am running
> a spring MVC 4/Java 8/ struts web application. I have two of them
> with the same issue. Any help would be appreciated. When I try to
> view all the running processes I cannot see where most of the 12 gb
> are being used. The system came up with 2.2 gb used and after I
> start one web application it goes to 14-15gb.
Ok.
> The funny thing is that I can kill it to reclaim the memory. Only
> a reboot works.
You mean you CAN'T kill in to reclaim memory, right?
> I am running a VMware instance with vcenter version 6.5. This
> does not happen with Java 7 with tomcat 7. Any help would be
> appreciate.
Something tells me you are reading or interpreting something
incorrectly, here. Can you please share your raw data, and where you
got that raw data? Something like reports from free/ps/top/sar/etc.?
- -chris
-BEGIN PGP SIGNATURE-
Comment: GPGTools - http://gpgtools.org
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/
iQIcBAEBCAAGBQJYy+qWAAoJEBzwKT+lPKRYd38P/34EhmWZaueHBR2cLJeitXa9
SOd5pf1XrtgVyyx6FebFQkNlckzUVV3LCrPMkL+OudWjezqU0c7O/F1sRlVJk18V
A767jMpcSRI183QpDPBmbHKv6zsoVVibyXwMTbTDRAKzV+7JEGA4SrMEzEoyTcIv
gak5ctUvAH6t+jQrLiuVCCIpsKnvDwoYmsbDo0fXmZ+mQgIHYSr3D4UCCEPBtsar
o5uDJrwbGZRtKsHSvRoCxTGXlXIlD8SUE/+SlPsHo+R79AXN0cyI2GYSh8OfAW12
7gLzvrGpRzwyD34V/uFhoTugIx5OnNuN0Pw2jGBjrlRsDvBETiy/1CRKwMDe7u59
7ev9emoq5WpNRrDJuBN4MMzrFtBNOM/o04MPg5KVoM0clHyXOJrXbHJ1EkYWIkLr
fdHr9ejfS9mQhYSYKXXSbjEDGOGGLrLmPbUJ6gfAg5PqsyNTYTYW24+bvpt1MykZ
dkQXAB1CQ0YdNm6YIipYMD/d9kEYVpbXEKuVGT7QWTHRD3z/Pdcfp4hb05ckw0a3
UIa8Jk1yh8Z+f4pjAKFPi1VhhbaGU8VjGXKpdVcso/Ljohe/SzKs+IWuSJ/H97tE
VzEwgYaMEPdtfSnBG5Hf/6HtnME4TCXSBn8rBcGCgn4/rvUIMJZOlXePRT0BLBOt
/vhOk/rN/5h1XOrqVaqF
=hBJ4
-END PGP SIGNATURE-
-
To unsubscribe, e-mail: users-unsubscr...@tomcat.apache.org
For additional commands, e-mail: users-h...@tomcat.apache.org
Tomcat 8/Redhat Linux 6.6 /Kernal 2.6.32 - Memory Won't Release
I am running tomcat 8.0.121. When I start my tomcat, it seems to be eating up all the memory on my system. I have 16 GB, and it keeps on going. Then when I try to kill the process, it dies but 12 GB is still being used even though everything is turn off. The only way to reclaim the memory is to reboot. I am running on redhat 6.5 and can't figure out what could be causing this. I run the tomcat as a local user, and I know there aren't any other processes running as the local user. I am running a spring MVC 4/Java 8/ struts web application. I have two of them with the same issue. Any help would be appreciated. When I try to view all the running processes I cannot see where most of the 12 gb are being used. The system came up with 2.2 gb used and after I start one web application it goes to 14-15gb. The funny thing is that I can kill it to reclaim the memory. Only a reboot works. I am running a VMware instance with vcenter version 6.5. This does not happen with Java 7 with tomcat 7. Any help would be appreciate.
