HI Arshiya, MaxGCPauseMillis=100 maybe this is too strict? Causing you run into full gc. Jdk8 G1GC implementation has single thread full gc and these take more time to finish? Just guessing as you have not written if the long pause gcs are young gen pauses or full gc pauses.
Another option which could cause longer gc pauses could be usage of swap file / swap partition. Check and monitor how much memory is used and how the swap is used. Your system has 120gb of ram. That is a lot, but still it does use approx 18gb swap file! There is used 5gb of that swap. I think it may be better to remove that swap file completely or reduce swappiness param in your OS. There is assigned 22gb heap, G1GC in jdk8 uses a lot of memory for G1 GC metadata. It could be up to 6gb in your case. I would consider upgrade to jdk17 and plan upgrades to newer jdk frequently if you can. There are significant improvements in G1GC in new jdk versions, not only metadatas size. I would start troubleshooting removing all gc related params and let G1GC decide all the params during runtime. It is usually a good starting point to troubleshooting G1GC if you don't know what is wrong. Enable gc logs and use gc log analyser to see what is going on there. There is page with list of available GC analyzers here http://fasterj.com/tools/gcloganalysers.shtml Regards, Zdenek On Tue, Aug 30, 2022 at 3:31 PM Arshiya Shariff <arshiya.shar...@ericsson.com.invalid> wrote: > We haven’t made any changes to the gc params when migrating tomcat : > > Please find the configurations: > > Java HotSpot(TM) 64-Bit Server VM (25.241-b07) for linux-amd64 JRE > (1.8.0_241-b07), built on Dec 11 2019 02:22:16 by "java_re" with gcc 7.3.0 > Memory: 4k page, physical 119478416k(781944k free), swap > 18862076k(13762004k free) > -XX:ConcGCThreads=3 -XX:G1HeapRegionSize=8388608 -XX:G1NewSizePercent=10 > -XX:G1ReservePercent=20 -XX:InitialHeapSize=23622320128 > -XX:InitiatingHeapOccupancyPercent=60 -XX:MaxGCPauseMillis=100 > -XX:MaxHeapSize=23622320128 -XX:MaxMetaspaceSize=268435456 > -XX:MaxNewSize=14168358912 -XX:MinHeapDeltaBytes=8388608 > -XX:ParallelGCThreads=6 -XX:+UnlockExperimentalVMOptions > -XX:+UseCompressedClassPointers -XX:+UseCompressedOops -XX:+UseG1GC > -XX:+UseGCLogFileRotation > > Thanks and Regards > Arshiya Shariff > > -----Original Message----- > From: Rob Sargent <rsarg...@xmission.com> > Sent: 30 August 2022 18:22 > To: users@tomcat.apache.org > Subject: Re: Increase in GC Pause time in tomcat http2 9.0.56 > > > > On 8/30/22 06:11, Arshiya Shariff wrote: > > Hi All , > > We have migrated our application (which transports http/2 packets) from > embedded tomcat version 9.0.38 to 9.0.56 in production . > > > > We observe that , in 9.0.56 mixed GC occurs less frequently than in > 9.0.38 , but when it happens there are GC Pauses for more than 1 second , > which is causing the application to be unresponsive during that time and as > a side effect we are facing other issues like delay in WINDOW_UPDATE frames > being sent. > > > > Has anyone faced similar issue with increased GC Pause time ? > > > > Thanks and Regards > > Arshiya Shariff > > > And no change to the JVM? > > --------------------------------------------------------------------- > To unsubscribe, e-mail: users-unsubscr...@tomcat.apache.org > For additional commands, e-mail: users-h...@tomcat.apache.org >
