> -----Original Message-----
> From: Mark Thomas <ma...@apache.org>
> Sent: Sunday, November 1, 2020 11:50 AM
> To: users@tomcat.apache.org
> Subject: Re: Weirdest Tomcat Behavior Ever?
>
> On 01/11/2020 16:25, Mark Thomas wrote:
> > <snip/>
> >
> > Keeping the previous logs for reference:
> >
> >>> Source Time Activity
> >>> ====================================================
> >>> pcap 15:14:25.375451 SYN proxy to Tomcat
> >>> pcap 15:14:25.375493 SYN, ACK Tomcat to proxy
> >>> pcap 15:14:25.375839 ACK proxy to Tomcat
> >>> pcap 15:14:25.375892 GET request proxy to Tomcat
> >>> pcap 15:14:25.375911 ACK Tomcat to proxy
> >>> debug 15:14:25.376 o.a.c.http11.InternalOutputBuffer.init
> >>> pcap 15:14:25.376777 FIN Tomcat to proxy
> >>> pcap 15:14:25.377036 FIN, ACK proxy to Tomcat
> >>> pcap 15:14:25.377048 ACK Tomcat proxy
> >>> debug 15:14:25.383 o.a.c.http11.InternalOutputBuffer.commit
> >>> debug 15:14:25.383 o.a.c.http11.InternalOutputBuffer$1.doWrite
> >>> debug 15:14:25.383 o.a.c.http11.InternalOutputBuffer$1.nextRequest
> >>> debug 15:14:25.383 o.a.c.http11.InternalOutputBuffer$1.recycle
> >>>
> >>> Tomcat writes the request body to the buffer but when Tomcat tries
> >>> to flush those bytes out to the network it finds that the socket has
> >>> been closed. That normally indicates that the client has dropped the
> >>> connection. This is sufficiently common that Tomcat swallows the
> >>> exception. However, we know (from the pcap file) that the client did
> >>> not drop the connection, Tomcat did.
> >
> > The next round of logging added a little more detail for the
> > InternalOutputBuffer and wrapped the Socket to see when close() was
> called.
> >
> > The results from the next round of logging are:
> >
> > Source Time Activity
> > ====================================================
> > pcap 13:31:26.344453 SYN proxy to Tomcat
> > pcap 13:31:26.344481 SYN, ACK Tomcat to proxy
> > debug 13:31:26.345 DebugSocket object created
> > debug 13:31:26.345 o.a.c.http11.InternalOutputBuffer.init
> > pcap 13:31:26.345138 ACK proxy to Tomcat
> > pcap 13:31:26.345174 GET request proxy to Tomcat
> > pcap 13:31:26.345194 ACK Tomcat to proxy
> > pcap 13:31:26.395281 FIN, ACK Tomcat to proxy
> > pcap 13:31:26.395725 ACK proxy to Tomcat
> > pcap 13:31:26.395741 FIN, ACK proxy to Tomcat
> > pcap 13:31:26.395754 ACK Tomcat to proxy
> > debug 13:31:26.403 o.a.c.http11.InternalOutputBuffer.commit
> > debug 13:31:26.403 o.a.c.http11.InternalOutputBuffer$1.doWrite
> > debug 13:31:26.404 o.a.c.http11.InternalOutputBuffer$1.nextRequest
> > debug 13:31:26.404 o.a.c.http11.InternalOutputBuffer$1.recycle
> > debug 13:31:26.404 DebugSocket.close called
> >
> > This shows that the socket is closed long before Tomcat tries to write
> > to it (that would be after the doWrite but before nextRequest) or
> > Tomcat explicitly closes the socket.
> >
> > This also shows that neither Tomcat nor the application are directly
> > calling close() on the socket to trigger the close shown by pcap.
> >
> > I continue to come up with theories as to what might be happening but
> > they all seem unlikely.
> >
> > This is the BIO connector so the only time the socket should change
> > state is during a method call. While it might seem a little over the
> > top I think the next step is to log every single method call to
> > DebugSocket along with any exception generated. We need to try and
> > correlate the premature socket closure with something in the JVM. If
> > there is no correlation to find then we really are into the realm of
> > very strange JVM and/or OS bugs.
> >
> > I'll start work on v3 of the debug patch.
>
> http://home.apache.org/~markt/dev/v7.0.72-custom-patch-v3/
>
> I opted to wrap both the InputStream and OutputStream associated with the
> socket and log every method call and every exception thrown. I opted not to
> log parameters with the exception of socket timeout since that might be
> relevant.
>
> The debug logs will be noticeably more verbose that last time. Feel free to
> adjust the number/size of debug log files as suits your environment.
>
> Mark
>
I applied the V3 patch and confirmed that content is being written to
debug0.log, but right away I noticed an error recurring repeatedly. See below.
<snip>
02-Nov-2020 06:17:12.992 FINE [http-bio-3016-exec-1]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.close bind
02-Nov-2020 06:17:15.634 FINE [http-bio-3016-Acceptor-0]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.<init> DebugSocket
[783035752], inner Socket [1397828144] for client port [52730]
02-Nov-2020 06:17:15.634 FINE [http-bio-3016-Acceptor-0]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.setSoLinger [783035752]
02-Nov-2020 06:17:15.635 FINE [http-bio-3016-Acceptor-0]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.setSoTimeout [783035752],
timeout [20000]
02-Nov-2020 06:17:15.635 FINE [http-bio-3016-Acceptor-0]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.setTcpNoDelay [783035752]
02-Nov-2020 06:17:15.635 FINE [http-bio-3016-exec-3]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.getInputStream [783035752]
02-Nov-2020 06:17:15.635 FINE [http-bio-3016-exec-3]
org.apache.tomcat.util.net.JIoEndpoint$DebugInputStream.<init> DebugInputStream
[516548719], inner InputStream [1456423668]
02-Nov-2020 06:17:15.635 FINE [http-bio-3016-exec-3]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.getOutputStream DebugSocket
[783035752], inner Socket [1397828144] has OutputStream [1891375218]
02-Nov-2020 06:17:15.635 FINE [http-bio-3016-exec-3]
org.apache.tomcat.util.net.JIoEndpoint$DebugOutputStream.<init>
DebugOutputStream [969837058], inner OutputStream [1891375218]
02-Nov-2020 06:17:15.635 FINE [http-bio-3016-exec-3]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.getPort [783035752]
02-Nov-2020 06:17:15.635 FINE [http-bio-3016-exec-3]
org.apache.coyote.http11.InternalOutputBuffer.init Creating outputStream for
InternalOutputBuffer [1266622558], client port is [52730], outputStream is
[969837058]
02-Nov-2020 06:17:15.635 FINE [http-bio-3016-exec-3]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.setSoTimeout [783035752],
timeout [20000]
02-Nov-2020 06:17:15.635 FINE [http-bio-3016-exec-3]
org.apache.tomcat.util.net.JIoEndpoint$DebugInputStream.read [516548719]
02-Nov-2020 06:17:15.635 FINE [http-bio-3016-exec-3]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.setSoTimeout [783035752],
timeout [20000]
02-Nov-2020 06:17:15.640 FINE [http-bio-3016-exec-3]
org.apache.coyote.http11.InternalOutputBuffer.commit Writing headers of length
[367] for InternalOutputBuffer [1266622558] to socketBuffer [1099385646],
underlying byte[] is [431522739]
02-Nov-2020 06:17:15.640 FINE [http-bio-3016-exec-3]
org.apache.coyote.http11.InternalOutputBuffer$OutputStreamOutputBuffer.doWrite
Writing body of length [313] from ByteChunk [1211819308] with underlying byte[]
[1517838844] for InternalOutputBuffer [1266622558] and OutputStreamOutputBuffer
[1169741633] to socketBuffer [1099385646] with underlying byte[] [431522739]
02-Nov-2020 06:17:15.640 FINE [http-bio-3016-exec-3]
org.apache.tomcat.util.net.JIoEndpoint$DebugOutputStream.write [969837058]
02-Nov-2020 06:17:15.640 FINE [http-bio-3016-exec-3]
org.apache.coyote.http11.InternalOutputBuffer.realWriteBytes Writing body of
length [680] from byte[] [431522739] for InternalOutputBuffer [1266622558] to
outputStream [969837058]
02-Nov-2020 06:17:15.640 FINE [http-bio-3016-exec-3]
org.apache.coyote.http11.InternalOutputBuffer.endRequest InternalOutputBuffer
[1266622558]
02-Nov-2020 06:17:15.640 FINE [http-bio-3016-exec-3]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.getInetAddress [783035752]
02-Nov-2020 06:17:15.640 FINE [http-bio-3016-exec-3]
org.apache.coyote.http11.InternalOutputBuffer.endRequest InternalOutputBuffer
[1266622558]
02-Nov-2020 06:17:15.640 FINE [http-bio-3016-exec-3]
org.apache.coyote.http11.InternalOutputBuffer.nextRequest InternalOutputBuffer
[1266622558]
02-Nov-2020 06:17:15.640 FINE [http-bio-3016-exec-3]
org.apache.coyote.http11.InternalOutputBuffer.nextRequest InternalOutputBuffer
[1266622558]
02-Nov-2020 06:17:15.640 FINE [http-bio-3016-exec-3]
org.apache.coyote.http11.InternalOutputBuffer.recycle Recycling
InternalOutputBuffer [1266622558]
02-Nov-2020 06:17:15.640 FINE [http-bio-3016-exec-3]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.close close [783035752],
inner Socket [1397828144]
java.lang.Exception
at
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.close(JIoEndpoint.java:1085)
at
org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:333)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:748)
02-Nov-2020 06:17:15.640 FINE [http-bio-3016-exec-3]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.close bind
02-Nov-2020 06:17:15.994 FINE [http-bio-3016-Acceptor-0]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.<init> DebugSocket
[1974876552], inner Socket [240336817] for client port [52820]
02-Nov-2020 06:17:15.994 FINE [http-bio-3016-Acceptor-0]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.setSoLinger [1974876552]
02-Nov-2020 06:17:15.994 FINE [http-bio-3016-Acceptor-0]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.setSoTimeout [1974876552],
timeout [20000]
02-Nov-2020 06:17:15.994 FINE [http-bio-3016-Acceptor-0]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.setTcpNoDelay [1974876552]
02-Nov-2020 06:17:15.994 FINE [http-bio-3016-exec-5]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.getInputStream [1974876552]
02-Nov-2020 06:17:15.994 FINE [http-bio-3016-exec-5]
org.apache.tomcat.util.net.JIoEndpoint$DebugInputStream.<init> DebugInputStream
[1514665050], inner InputStream [1640150621]
02-Nov-2020 06:17:15.994 FINE [http-bio-3016-exec-5]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.getOutputStream DebugSocket
[1974876552], inner Socket [240336817] has OutputStream [1369457081]
02-Nov-2020 06:17:15.994 FINE [http-bio-3016-exec-5]
org.apache.tomcat.util.net.JIoEndpoint$DebugOutputStream.<init>
DebugOutputStream [20035960], inner OutputStream [1369457081]
02-Nov-2020 06:17:15.994 FINE [http-bio-3016-exec-5]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.getPort [1974876552]
02-Nov-2020 06:17:15.994 FINE [http-bio-3016-exec-5]
org.apache.coyote.http11.InternalOutputBuffer.init Creating outputStream for
InternalOutputBuffer [1064649574], client port is [52820], outputStream is
[20035960]
02-Nov-2020 06:17:15.994 FINE [http-bio-3016-exec-5]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.setSoTimeout [1974876552],
timeout [20000]
02-Nov-2020 06:17:15.994 FINE [http-bio-3016-exec-5]
org.apache.tomcat.util.net.JIoEndpoint$DebugInputStream.read [1514665050]
02-Nov-2020 06:17:15.994 FINE [http-bio-3016-exec-5]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.setSoTimeout [1974876552],
timeout [20000]
02-Nov-2020 06:17:15.998 FINE [http-bio-3016-exec-5]
org.apache.coyote.http11.InternalOutputBuffer.commit Writing headers of length
[367] for InternalOutputBuffer [1064649574] to socketBuffer [898443286],
underlying byte[] is [1888460995]
02-Nov-2020 06:17:15.998 FINE [http-bio-3016-exec-5]
org.apache.coyote.http11.InternalOutputBuffer$OutputStreamOutputBuffer.doWrite
Writing body of length [313] from ByteChunk [1055384114] with underlying byte[]
[942102746] for InternalOutputBuffer [1064649574] and OutputStreamOutputBuffer
[833792760] to socketBuffer [898443286] with underlying byte[] [1888460995]
02-Nov-2020 06:17:15.998 FINE [http-bio-3016-exec-5]
org.apache.tomcat.util.net.JIoEndpoint$DebugOutputStream.write [20035960]
02-Nov-2020 06:17:15.998 FINE [http-bio-3016-exec-5]
org.apache.coyote.http11.InternalOutputBuffer.realWriteBytes Writing body of
length [680] from byte[] [1888460995] for InternalOutputBuffer [1064649574] to
outputStream [20035960]
02-Nov-2020 06:17:15.998 FINE [http-bio-3016-exec-5]
org.apache.coyote.http11.InternalOutputBuffer.endRequest InternalOutputBuffer
[1064649574]
02-Nov-2020 06:17:15.998 FINE [http-bio-3016-exec-5]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.getInetAddress [1974876552]
02-Nov-2020 06:17:15.999 FINE [http-bio-3016-exec-5]
org.apache.coyote.http11.InternalOutputBuffer.endRequest InternalOutputBuffer
[1064649574]
02-Nov-2020 06:17:15.999 FINE [http-bio-3016-exec-5]
org.apache.coyote.http11.InternalOutputBuffer.nextRequest InternalOutputBuffer
[1064649574]
02-Nov-2020 06:17:15.999 FINE [http-bio-3016-exec-5]
org.apache.coyote.http11.InternalOutputBuffer.nextRequest InternalOutputBuffer
[1064649574]
02-Nov-2020 06:17:15.999 FINE [http-bio-3016-exec-5]
org.apache.coyote.http11.InternalOutputBuffer.recycle Recycling
InternalOutputBuffer [1064649574]
02-Nov-2020 06:17:15.999 FINE [http-bio-3016-exec-5]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.close close [1974876552],
inner Socket [240336817]
java.lang.Exception
at
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.close(JIoEndpoint.java:1085)
at
org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:333)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:748)
02-Nov-2020 06:17:15.999 FINE [http-bio-3016-exec-5]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.close bind
02-Nov-2020 06:17:19.000 FINE [http-bio-3016-Acceptor-0]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.<init> DebugSocket
[1096520830], inner Socket [453060303] for client port [53144]
02-Nov-2020 06:17:19.000 FINE [http-bio-3016-Acceptor-0]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.setSoLinger [1096520830]
02-Nov-2020 06:17:19.000 FINE [http-bio-3016-Acceptor-0]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.setSoTimeout [1096520830],
timeout [20000]
02-Nov-2020 06:17:19.000 FINE [http-bio-3016-Acceptor-0]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.setTcpNoDelay [1096520830]
02-Nov-2020 06:17:19.000 FINE [http-bio-3016-exec-7]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.getInputStream [1096520830]
02-Nov-2020 06:17:19.000 FINE [http-bio-3016-exec-7]
org.apache.tomcat.util.net.JIoEndpoint$DebugInputStream.<init> DebugInputStream
[390721225], inner InputStream [514490958]
02-Nov-2020 06:17:19.000 FINE [http-bio-3016-exec-7]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.getOutputStream DebugSocket
[1096520830], inner Socket [453060303] has OutputStream [438032113]
02-Nov-2020 06:17:19.000 FINE [http-bio-3016-exec-7]
org.apache.tomcat.util.net.JIoEndpoint$DebugOutputStream.<init>
DebugOutputStream [907143655], inner OutputStream [438032113]
02-Nov-2020 06:17:19.000 FINE [http-bio-3016-exec-7]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.getPort [1096520830]
02-Nov-2020 06:17:19.000 FINE [http-bio-3016-exec-7]
org.apache.coyote.http11.InternalOutputBuffer.init Creating outputStream for
InternalOutputBuffer [1792035857], client port is [53144], outputStream is
[907143655]
02-Nov-2020 06:17:19.000 FINE [http-bio-3016-exec-7]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.setSoTimeout [1096520830],
timeout [20000]
02-Nov-2020 06:17:19.000 FINE [http-bio-3016-exec-7]
org.apache.tomcat.util.net.JIoEndpoint$DebugInputStream.read [390721225]
02-Nov-2020 06:17:19.000 FINE [http-bio-3016-exec-7]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.setSoTimeout [1096520830],
timeout [20000]
02-Nov-2020 06:17:19.004 FINE [http-bio-3016-exec-7]
org.apache.coyote.http11.InternalOutputBuffer.commit Writing headers of length
[367] for InternalOutputBuffer [1792035857] to socketBuffer [1613244257],
underlying byte[] is [1704854550]
02-Nov-2020 06:17:19.004 FINE [http-bio-3016-exec-7]
org.apache.coyote.http11.InternalOutputBuffer$OutputStreamOutputBuffer.doWrite
Writing body of length [313] from ByteChunk [790671316] with underlying byte[]
[530352728] for InternalOutputBuffer [1792035857] and OutputStreamOutputBuffer
[1679273787] to socketBuffer [1613244257] with underlying byte[] [1704854550]
02-Nov-2020 06:17:19.004 FINE [http-bio-3016-exec-7]
org.apache.tomcat.util.net.JIoEndpoint$DebugOutputStream.write [907143655]
02-Nov-2020 06:17:19.004 FINE [http-bio-3016-exec-7]
org.apache.coyote.http11.InternalOutputBuffer.realWriteBytes Writing body of
length [680] from byte[] [1704854550] for InternalOutputBuffer [1792035857] to
outputStream [907143655]
02-Nov-2020 06:17:19.004 FINE [http-bio-3016-exec-7]
org.apache.coyote.http11.InternalOutputBuffer.endRequest InternalOutputBuffer
[1792035857]
02-Nov-2020 06:17:19.004 FINE [http-bio-3016-exec-7]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.getInetAddress [1096520830]
02-Nov-2020 06:17:19.004 FINE [http-bio-3016-exec-7]
org.apache.coyote.http11.InternalOutputBuffer.endRequest InternalOutputBuffer
[1792035857]
02-Nov-2020 06:17:19.004 FINE [http-bio-3016-exec-7]
org.apache.coyote.http11.InternalOutputBuffer.nextRequest InternalOutputBuffer
[1792035857]
02-Nov-2020 06:17:19.004 FINE [http-bio-3016-exec-7]
org.apache.coyote.http11.InternalOutputBuffer.nextRequest InternalOutputBuffer
[1792035857]
02-Nov-2020 06:17:19.005 FINE [http-bio-3016-exec-7]
org.apache.coyote.http11.InternalOutputBuffer.recycle Recycling
InternalOutputBuffer [1792035857]
02-Nov-2020 06:17:19.005 FINE [http-bio-3016-exec-7]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.close close [1096520830],
inner Socket [453060303]
java.lang.Exception
at
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.close(JIoEndpoint.java:1085)
at
org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:333)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:748)
02-Nov-2020 06:17:19.005 FINE [http-bio-3016-exec-7]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.close bind
02-Nov-2020 06:17:20.642 FINE [http-bio-3016-Acceptor-0]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.<init> DebugSocket
[1606366814], inner Socket [1216750767] for client port [53346]
02-Nov-2020 06:17:20.642 FINE [http-bio-3016-Acceptor-0]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.setSoLinger [1606366814]
02-Nov-2020 06:17:20.645 FINE [http-bio-3016-Acceptor-0]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.setSoTimeout [1606366814],
timeout [20000]
02-Nov-2020 06:17:20.645 FINE [http-bio-3016-Acceptor-0]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.setTcpNoDelay [1606366814]
02-Nov-2020 06:17:20.645 FINE [http-bio-3016-exec-10]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.getInputStream [1606366814]
02-Nov-2020 06:17:20.645 FINE [http-bio-3016-exec-10]
org.apache.tomcat.util.net.JIoEndpoint$DebugInputStream.<init> DebugInputStream
[1976078131], inner InputStream [1089573615]
02-Nov-2020 06:17:20.645 FINE [http-bio-3016-exec-10]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.getOutputStream DebugSocket
[1606366814], inner Socket [1216750767] has OutputStream [1857501447]
02-Nov-2020 06:17:20.645 FINE [http-bio-3016-exec-10]
org.apache.tomcat.util.net.JIoEndpoint$DebugOutputStream.<init>
DebugOutputStream [387013203], inner OutputStream [1857501447]
02-Nov-2020 06:17:20.645 FINE [http-bio-3016-exec-10]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.getPort [1606366814]
02-Nov-2020 06:17:20.645 FINE [http-bio-3016-exec-10]
org.apache.coyote.http11.InternalOutputBuffer.init Creating outputStream for
InternalOutputBuffer [333394221], client port is [53346], outputStream is
[387013203]
02-Nov-2020 06:17:20.645 FINE [http-bio-3016-exec-10]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.setSoTimeout [1606366814],
timeout [20000]
02-Nov-2020 06:17:20.645 FINE [http-bio-3016-exec-10]
org.apache.tomcat.util.net.JIoEndpoint$DebugInputStream.read [1976078131]
02-Nov-2020 06:17:20.645 FINE [http-bio-3016-exec-10]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.setSoTimeout [1606366814],
timeout [20000]
02-Nov-2020 06:17:20.649 FINE [http-bio-3016-exec-10]
org.apache.coyote.http11.InternalOutputBuffer.commit Writing headers of length
[367] for InternalOutputBuffer [333394221] to socketBuffer [1816828035],
underlying byte[] is [1863475553]
02-Nov-2020 06:17:20.649 FINE [http-bio-3016-exec-10]
org.apache.coyote.http11.InternalOutputBuffer$OutputStreamOutputBuffer.doWrite
Writing body of length [313] from ByteChunk [167150481] with underlying byte[]
[1652911976] for InternalOutputBuffer [333394221] and OutputStreamOutputBuffer
[524834708] to socketBuffer [1816828035] with underlying byte[] [1863475553]
02-Nov-2020 06:17:20.649 FINE [http-bio-3016-exec-10]
org.apache.tomcat.util.net.JIoEndpoint$DebugOutputStream.write [387013203]
02-Nov-2020 06:17:20.650 FINE [http-bio-3016-exec-10]
org.apache.coyote.http11.InternalOutputBuffer.realWriteBytes Writing body of
length [680] from byte[] [1863475553] for InternalOutputBuffer [333394221] to
outputStream [387013203]
02-Nov-2020 06:17:20.650 FINE [http-bio-3016-exec-10]
org.apache.coyote.http11.InternalOutputBuffer.endRequest InternalOutputBuffer
[333394221]
02-Nov-2020 06:17:20.650 FINE [http-bio-3016-exec-10]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.getInetAddress [1606366814]
02-Nov-2020 06:17:20.650 FINE [http-bio-3016-exec-10]
org.apache.coyote.http11.InternalOutputBuffer.endRequest InternalOutputBuffer
[333394221]
02-Nov-2020 06:17:20.650 FINE [http-bio-3016-exec-10]
org.apache.coyote.http11.InternalOutputBuffer.nextRequest InternalOutputBuffer
[333394221]
02-Nov-2020 06:17:20.650 FINE [http-bio-3016-exec-10]
org.apache.coyote.http11.InternalOutputBuffer.nextRequest InternalOutputBuffer
[333394221]
02-Nov-2020 06:17:20.650 FINE [http-bio-3016-exec-10]
org.apache.coyote.http11.InternalOutputBuffer.recycle Recycling
InternalOutputBuffer [333394221]
02-Nov-2020 06:17:20.650 FINE [http-bio-3016-exec-10]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.close close [1606366814],
inner Socket [1216750767]
java.lang.Exception
at
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.close(JIoEndpoint.java:1085)
at
org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:333)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:748)
02-Nov-2020 06:17:20.650 FINE [http-bio-3016-exec-10]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.close bind
02-Nov-2020 06:17:22.006 FINE [http-bio-3016-Acceptor-0]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.<init> DebugSocket
[1432592805], inner Socket [1204212376] for client port [53578]
02-Nov-2020 06:17:22.006 FINE [http-bio-3016-Acceptor-0]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.setSoLinger [1432592805]
02-Nov-2020 06:17:22.006 FINE [http-bio-3016-Acceptor-0]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.setSoTimeout [1432592805],
timeout [20000]
02-Nov-2020 06:17:22.006 FINE [http-bio-3016-Acceptor-0]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.setTcpNoDelay [1432592805]
02-Nov-2020 06:17:22.007 FINE [http-bio-3016-exec-9]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.getInputStream [1432592805]
02-Nov-2020 06:17:22.007 FINE [http-bio-3016-exec-9]
org.apache.tomcat.util.net.JIoEndpoint$DebugInputStream.<init> DebugInputStream
[1424019493], inner InputStream [1827092398]
02-Nov-2020 06:17:22.007 FINE [http-bio-3016-exec-9]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.getOutputStream DebugSocket
[1432592805], inner Socket [1204212376] has OutputStream [1335150781]
02-Nov-2020 06:17:22.007 FINE [http-bio-3016-exec-9]
org.apache.tomcat.util.net.JIoEndpoint$DebugOutputStream.<init>
DebugOutputStream [1404089830], inner OutputStream [1335150781]
02-Nov-2020 06:17:22.007 FINE [http-bio-3016-exec-9]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.getPort [1432592805]
02-Nov-2020 06:17:22.007 FINE [http-bio-3016-exec-9]
org.apache.coyote.http11.InternalOutputBuffer.init Creating outputStream for
InternalOutputBuffer [1806171306], client port is [53578], outputStream is
[1404089830]
02-Nov-2020 06:17:22.007 FINE [http-bio-3016-exec-9]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.setSoTimeout [1432592805],
timeout [19999]
02-Nov-2020 06:17:22.007 FINE [http-bio-3016-exec-9]
org.apache.tomcat.util.net.JIoEndpoint$DebugInputStream.read [1424019493]
02-Nov-2020 06:17:22.007 FINE [http-bio-3016-exec-9]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.setSoTimeout [1432592805],
timeout [20000]
02-Nov-2020 06:17:22.011 FINE [http-bio-3016-exec-9]
org.apache.coyote.http11.InternalOutputBuffer.commit Writing headers of length
[367] for InternalOutputBuffer [1806171306] to socketBuffer [1915165875],
underlying byte[] is [1564626224]
02-Nov-2020 06:17:22.011 FINE [http-bio-3016-exec-9]
org.apache.coyote.http11.InternalOutputBuffer$OutputStreamOutputBuffer.doWrite
Writing body of length [313] from ByteChunk [1650015667] with underlying byte[]
[1271712161] for InternalOutputBuffer [1806171306] and OutputStreamOutputBuffer
[1222724924] to socketBuffer [1915165875] with underlying byte[] [1564626224]
02-Nov-2020 06:17:22.011 FINE [http-bio-3016-exec-9]
org.apache.tomcat.util.net.JIoEndpoint$DebugOutputStream.write [1404089830]
02-Nov-2020 06:17:22.011 FINE [http-bio-3016-exec-9]
org.apache.coyote.http11.InternalOutputBuffer.realWriteBytes Writing body of
length [680] from byte[] [1564626224] for InternalOutputBuffer [1806171306] to
outputStream [1404089830]
02-Nov-2020 06:17:22.011 FINE [http-bio-3016-exec-9]
org.apache.coyote.http11.InternalOutputBuffer.endRequest InternalOutputBuffer
[1806171306]
02-Nov-2020 06:17:22.011 FINE [http-bio-3016-exec-9]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.getInetAddress [1432592805]
02-Nov-2020 06:17:22.012 FINE [http-bio-3016-exec-9]
org.apache.coyote.http11.InternalOutputBuffer.endRequest InternalOutputBuffer
[1806171306]
02-Nov-2020 06:17:22.012 FINE [http-bio-3016-exec-9]
org.apache.coyote.http11.InternalOutputBuffer.nextRequest InternalOutputBuffer
[1806171306]
02-Nov-2020 06:17:22.012 FINE [http-bio-3016-exec-9]
org.apache.coyote.http11.InternalOutputBuffer.nextRequest InternalOutputBuffer
[1806171306]
02-Nov-2020 06:17:22.012 FINE [http-bio-3016-exec-9]
org.apache.coyote.http11.InternalOutputBuffer.recycle Recycling
InternalOutputBuffer [1806171306]
02-Nov-2020 06:17:22.012 FINE [http-bio-3016-exec-9]
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.close close [1432592805],
inner Socket [1204212376]
java.lang.Exception
at
org.apache.tomcat.util.net.JIoEndpoint$DebugSocket.close(JIoEndpoint.java:1085)
at
org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:333)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:748)
</snip>
--Eric
Disclaimer : This email and any files transmitted with it are confidential and
intended solely for intended recipients. If you are not the named addressee you
should not disseminate, distribute, copy or alter this email. Any views or
opinions presented in this email are solely those of the author and might not
represent those of Physician Select Management. Warning: Although Physician
Select Management has taken reasonable precautions to ensure no viruses are
present in this email, the company cannot accept responsibility for any loss or
damage arising from the use of this email or attachments.
