ant5 opened a new issue, #13389: URL: https://github.com/apache/trafficserver/issues/13389
I have a big delay from (quite many) sites when using ATS. In a browser the issue appeared as "hanging" for 5-20 seconds before page appears. Corresponding error in ATS log is something like ``` 20260715.17h54m42s CONNECT: attempt fail [CONNECTION_ERROR] to 72.167.35.147:443 for host='docs.trafficserver.apache.org' sm_id=2098 connection_result=ETIMEDOUT [60] error=ETIMEDOUT [60] retry_attempts=0 url='https://docs.trafficserver.apache.org/en/latest/_static/override.css?v=cbacab0b' ``` Connections to origin (alpn) is http/1.1,http/1.0. In the access.log nothing but large times for problematic request: ``` 1784129931.310 6289 fd05:562e:5a23::212:2e01 TCP_MISS/200 67779 GET https://docs.trafficserver.apache.org/en/latest/_static/css/fonts/Roboto-Slab-Bold.woff2?9984f4a9bda09be08e83f2506954adbe - DIRECT/docs.trafficserver.apache.org font/woff2 ``` The strange things is on the wire. This is a tcpdump file: [ats-orig-15.07.zip](https://github.com/user-attachments/files/30054806/ats-orig-15.07.zip) Typical TCP dialog is: ``` No. Time Source Destination Protocol Length Info 17 0.627632 89.125.138.120 72.167.35.147 TCP 74 23383 → 443 [SYN] Seq=0 Win=65535 Len=0 MSS=1460 WS=64 SACK_PERM TSval=1348780720 TSecr=0 27 0.795626 72.167.35.147 89.125.138.120 TCP 74 443 → 23383 [SYN, ACK] Seq=0 Ack=1 Win=65160 Len=0 MSS=1460 SACK_PERM TSval=1151516899 TSecr=1348780720 WS=128 28 0.795766 89.125.138.120 72.167.35.147 TCP 66 23383 → 443 [ACK] Seq=1 Ack=1 Win=65728 Len=0 TSval=1348780890 TSecr=1151516899 29 0.796264 89.125.138.120 72.167.35.147 TLSv1.3 808 Client Hello (SNI=docs.trafficserver.apache.org) 42 0.964264 72.167.35.147 89.125.138.120 TCP 66 443 → 23383 [ACK] Seq=1 Ack=743 Win=64512 Len=0 TSval=1151517067 TSecr=1348780890 43 0.965923 72.167.35.147 89.125.138.120 TLSv1.3 348 Server Hello, Change Cipher Spec, Application Data, Application Data 44 0.966773 89.125.138.120 72.167.35.147 TLSv1.3 146 Change Cipher Spec, Application Data 46 0.967454 89.125.138.120 72.167.35.147 TLSv1.3 759 Application Data 63 1.134677 72.167.35.147 89.125.138.120 TCP 66 443 → 23383 [ACK] Seq=283 Ack=823 Win=64512 Len=0 TSval=1151517238 TSecr=1348781060 64 1.135241 72.167.35.147 89.125.138.120 TLSv1.3 409 Application Data 65 1.159851 72.167.35.147 89.125.138.120 TLSv1.3 1893 Application Data, Application Data 66 1.159891 72.167.35.147 89.125.138.120 TLSv1.3 1514 Application Data 67 1.159911 72.167.35.147 89.125.138.120 TLSv1.3 1514 Application Data 68 1.159961 89.125.138.120 72.167.35.147 TCP 66 23383 → 443 [ACK] Seq=1516 Ack=2453 Win=63936 Len=0 TSval=1348781260 TSecr=1151517239 69 1.159979 89.125.138.120 72.167.35.147 TCP 66 23383 → 443 [ACK] Seq=1516 Ack=5349 Win=61056 Len=0 TSval=1348781260 TSecr=1151517263 70 1.160084 72.167.35.147 89.125.138.120 TLSv1.3 2962 Application Data, Application Data 71 1.160100 72.167.35.147 89.125.138.120 TLSv1.3 1514 Application Data 72 1.160102 72.167.35.147 89.125.138.120 TLSv1.3 1514 Application Data 73 1.160256 89.125.138.120 72.167.35.147 TLSv1.3 90 Application Data 74 1.160315 89.125.138.120 72.167.35.147 TCP 66 23383 → 443 [FIN, ACK] Seq=1540 Ack=5349 Win=65728 Len=0 TSval=1348781260 TSecr=1151517263 75 1.160482 72.167.35.147 89.125.138.120 TLSv1.3 1514 Application Data 76 1.160675 89.125.138.120 72.167.35.147 TCP 54 23383 → 443 [RST] Seq=1516 Win=0 Len=0 77 1.160683 89.125.138.120 72.167.35.147 TCP 54 23383 → 443 [RST] Seq=1516 Win=0 Len=0 78 1.160686 89.125.138.120 72.167.35.147 TCP 54 23383 → 443 [RST] Seq=1516 Win=0 Len=0 79 1.160690 89.125.138.120 72.167.35.147 TCP 54 23383 → 443 [RST] Seq=1516 Win=0 Len=0 118 1.327955 72.167.35.147 89.125.138.120 TLSv1.3 1514 Application Data 119 1.327969 72.167.35.147 89.125.138.120 TLSv1.3 1514 Application Data 120 1.328080 72.167.35.147 89.125.138.120 TLSv1.3 1514 Application Data 121 1.328098 72.167.35.147 89.125.138.120 TLSv1.3 1514 Application Data, Application Data 122 1.328100 72.167.35.147 89.125.138.120 TLSv1.3 1514 Application Data 123 1.328103 72.167.35.147 89.125.138.120 TLSv1.3 1514 Application Data 124 1.328124 89.125.138.120 72.167.35.147 TCP 54 23383 → 443 [RST] Seq=1516 Win=0 Len=0 125 1.328136 89.125.138.120 72.167.35.147 TCP 54 23383 → 443 [RST] Seq=1516 Win=0 Len=0 126 1.328140 89.125.138.120 72.167.35.147 TCP 54 23383 → 443 [RST] Seq=1516 Win=0 Len=0 127 1.328143 89.125.138.120 72.167.35.147 TCP 54 23383 → 443 [RST] Seq=1516 Win=0 Len=0 128 1.328145 89.125.138.120 72.167.35.147 TCP 54 23383 → 443 [RST] Seq=1541 Win=0 Len=0 129 1.328147 89.125.138.120 72.167.35.147 TCP 54 23383 → 443 [RST] Seq=1541 Win=0 Len=0 130 1.328366 72.167.35.147 89.125.138.120 TLSv1.3 1514 Application Data 131 1.328380 72.167.35.147 89.125.138.120 TLSv1.3 1514 Application Data 132 1.328402 72.167.35.147 89.125.138.120 TLSv1.3 738 Application Data 133 1.328403 72.167.35.147 89.125.138.120 TCP 66 443 → 23383 [FIN, ACK] Seq=24845 Ack=1541 Win=64128 Len=0 TSval=1151517432 TSecr=1348781260 134 1.328512 89.125.138.120 72.167.35.147 TCP 54 23383 → 443 [RST] Seq=1541 Win=0 Len=0 135 1.328524 89.125.138.120 72.167.35.147 TCP 54 23383 → 443 [RST] Seq=1541 Win=0 Len=0 136 1.328527 89.125.138.120 72.167.35.147 TCP 54 23383 → 443 [RST] Seq=1541 Win=0 Len=0 137 1.328529 89.125.138.120 72.167.35.147 TCP 54 23383 → 443 [RST] Seq=1541 Win=0 Len=0 ``` ATS closed connection while data still arrive. Consequently TCP connection goes to TCP_FINWAIT_1 state and the system sends RST until FIN/ACK from origin. I don't fully understand how to debug this because there is no issue when browser goes to origin directly without ATS proxy. P.S. ATS 10.2.X, FreeBSD 14-STABLE. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
