Chris, Thank you for the input. We will upgrade tomcat and also text on the linux vm. I read the documentation of tomcat that maxConnections parameter refers to the number of connections it can serve. If we have 18 core CPU and 100GB RAM.What value can I set for maxConnections ? Want to make sure we are utilizing the hardware to the max capacity. Is there any config of tomcat which enabled could help serve more requests per tomcat instance.
The current setup is able to handle most of the load, however there are predictable times where there is an avalanche of requests and thinking how to handle it gracefully. On Wed, May 27, 2020 at 5:38 PM Christopher Schultz < ch...@christopherschultz.net> wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA256 > > Ayub, > > On 5/27/20 09:26, Ayub Khan wrote: > > previously I was using HTTP/1.1 connector, recently I changed to > > NIO2 to see the performance. I read that NIO2 is non blocking so > > trying to check how this works. > > Both NIO and NIO2 are non-blocking. They use different strategies for > certain things. Anything but the "BIO" connector will be non-blocking > for most operations. The default is NIO. > > > which connector protocol do you recommend and best configuration > > for the connector ? > This depends on your environment, usage profile, etc. Note that > non-blocking IO means more CPU usage: there is a trade-off. > > > Which stable version of tomcat would you recommend ? > > Always the latest, of course. Tomcat 8.0 is unsupported, replaced by > Tomcat 8.5. Tomcat 9.0 is stable and probably the best version if you > are looking to upgrade. Both Tomcat 8.5 and 9.0 are continuing to get > regular updates. But definitely move away from 8.0. > > > Are there any ubuntu specific configs for tomcat ? > No. There is nothing particular special about Ubuntu. Linux is one of > the most well-performing platforms for the JVM. I wouldn't recommend > switching platforms. > > Why are you using nginx? You already have load-balancing happening in > the ALB. Inserting another layer of proxying is probably just adding > another buffer to the mix. I'd remove nginx if it's not providing any > specific, measurable benefit. > > > We are using OkHttp client library to call rest api and stack trace > > shows failure at the api call. The api being called is running on > > the same tomcat instance (different context) usring url localhost. > > This does not happen when number of requests is less. > > Your Tomcat server is calling this REST API? Or your server is serving > those API requests? If your service is calling itself, then you have > to make sure you have double-capacity: every incoming request will > cause a loopback request to your own service. > > Other than the timeouts, are you able to handle the load with your > existing infrastructure? Sometimes, the solution is simply to throw > most hardware at the problem. > > - -chris > > > On Wed, May 27, 2020 at 11:48 AM Mark Thomas <ma...@apache.org> > > wrote: > > > >> On 26/05/2020 23:28, Ayub Khan wrote: > >>> Hi, > >>> > >>> During high load I am seeing below error on tomcat logs > >>> > >>> java.util.concurrent.ExecutionException: java.net > >> .SocketTimeoutException: > >>> timeout > >> > >> And the rest of that stack trace? It is hard to provide advice > >> without context. We need to know what is timing out when trying > >> to do what. > >> > >>> We have 4 C5.18x large vms running tomcat 8 behind AWS > >>> application load balancer. We are seeing socket timeouts during > >>> peak hours. What should be the configuration of tomcat if we > >>> get 60,000 to 70,000 requests per > >> minute > >>> on an average ? > >>> > >>> Tomcat 8.0.32 on Ubuntu 16.04.5 LTS > >> > >> Tomcat 8.0.x is no longer supported. > >> > >>> Below is the java version: > >>> > >>> java version "1.8.0_181" Java(TM) SE Runtime Environment (build > >>> 1.8.0_181-b13) Java HotSpot(TM) 64-Bit Server VM (build > >>> 25.181-b13, mixed mode) > >>> > >>> > >>> Below is the server.xml connector configuration: > >>> > >>> <Connector port="8080" > >>> protocol="org.apache.coyote.http11.Http11Nio2Protocol" > >> > >> Why NIO2? > >> > >> Mark > >> > >> > >>> connectionTimeout="20000" > >>> > >>> URIEncoding="UTF-8" redirectPort="8443" /> > >>> > >>> We have 4 C5.18x large vms and each vm has nginx and tomcat > >>> instance running. All the 4 vms are connected to AWS > >>> application load balancer. > >>> > >>> I tried to add maxConnections=50000 but this does not seem to > >>> have any affect and still saw the timeouts > >>> > >>> Thanks and Regards Ayub > >>> > >> > >> > >> --------------------------------------------------------------------- > >> > >> > To unsubscribe, e-mail: users-unsubscr...@tomcat.apache.org > >> For additional commands, e-mail: users-h...@tomcat.apache.org > >> > >> > > > -----BEGIN PGP SIGNATURE----- > Comment: Using GnuPG with Thunderbird - https://www.enigmail.net/ > > iQIzBAEBCAAdFiEEMmKgYcQvxMe7tcJcHPApP6U8pFgFAl7Oe3QACgkQHPApP6U8 > pFgNAA//bXoa3Qj+pdop9CizhO1KAja/HSx5Jl1rcFTTQRvDQ79QyWOX/X/21W8A > /ub98MZVBe2K5G5y/SkHYcCkgtNvtI1dPikmgI8DO0PW2kJsEdjVz9KWg9zvC4ae > zBtW0xQ5tD3h8AHboQ9jz4FgWuq18RI+pMgdmfJgRbfaalQ4ZbKwVjnqCseqf6do > IyXbu430qUDHc/uaWKIpMgZbl4Gz/2+fznEHQvgxgQt+nl4GvPZP5JErVC5b5Z0+ > bhGGWatHi2kHSehRpo70A0/8/xC3TabQ4uwkxJiQaluWeZg8RoUhBT18Oo4Fx9/p > CAqsF/8u1zEWA2CERfo2QBTuahX76Gc9e224+MqSyWCIhVF3WiuliNApursXa0ZK > HVi+JgWRHjyCbE1TQ7JoLcpudy0OIQbxY8rslmfcOafdUx6sdssMZ1egGM/GPV4N > Fce75ZLHlTCbtjQVzPGp64SiU84mwLtN7OPVwNVDl7hdHPsx/eXTSHNTEoG5pSPP > rxMnuCcHwKf9OH7ZAchzs6ob7n1npJsJwt77KRyO6iIt3LY9zdIsV5jqSC8hhMB5 > xUQ9ejwd4OgFtUZwnnaxiBMHuPfVb9TaAoJx8tnQZ/8beC+ESjYqfvGh5GuKWOXn > WdNpaxoSikQduNOHt1xazOvVHNZQq/tBvuDsJtL+2sl3UBlLgz4= > =UqCU > -----END PGP SIGNATURE----- > > --------------------------------------------------------------------- > To unsubscribe, e-mail: users-unsubscr...@tomcat.apache.org > For additional commands, e-mail: users-h...@tomcat.apache.org > > -- -------------------------------------------------------------------- Sun Certified Enterprise Architect 1.5 Sun Certified Java Programmer 1.4 Microsoft Certified Systems Engineer 2000 http://in.linkedin.com/pub/ayub-khan/a/811/b81 mobile:+966-502674604 ---------------------------------------------------------------------- It is proved that Hard Work and kowledge will get you close but attitude will get you there. However, it's the Love of God that will put you over the top!!
