tomcat 8.5 config for ecommerce site, seeing request timeouts

[Ayub Khan]

Hi,

During high load I am seeing below error on tomcat logs

java.util.concurrent.ExecutionException: java.net.SocketTimeoutException:
timeout

We have 4 C5.18x large vms running tomcat 8 behind AWS application load
balancer. We are seeing socket timeouts during peak hours. What should be
the configuration of tomcat if we get 60,000 to 70,000 requests per minute
on an average ?

Tomcat 8.0.32 on Ubuntu 16.04.5 LTS
Below is the java version:

java version "1.8.0_181"
Java(TM) SE Runtime Environment (build 1.8.0_181-b13)
Java HotSpot(TM) 64-Bit Server VM (build 25.181-b13, mixed mode)


Below is the server.xml connector configuration:

<Connector port="8080"
protocol="org.apache.coyote.http11.Http11Nio2Protocol"
               connectionTimeout="20000"

               URIEncoding="UTF-8"
               redirectPort="8443" />

We have 4  C5.18x large vms and each vm has nginx and tomcat instance
running. All the 4 vms are connected to AWS application load balancer.

I tried to add maxConnections=50000 but this does not seem to have any
affect and still saw the timeouts

Thanks and Regards
Ayub