Sebastian Nagel created NUTCH-2890: -------------------------------------- Summary: Protocok-okhttp: upgrade okhttp to 4.9.1 to address infinite connection retries Key: NUTCH-2890 URL: https://issues.apache.org/jira/browse/NUTCH-2890 Project: Nutch Issue Type: Bug Components: plugin, protocol Affects Versions: 1.18 Reporter: Sebastian Nagel Assignee: Sebastian Nagel Fix For: 1.19
In rare situations and under heavy load (> 100 fetcher threads) I've seen that the protocol-okhttp plugin gets into a state where a significant amount of CPU time is spent in handling failed connections, see [async-profiler|https://github.com/jvm-profiling-tools/async-profiler] screenshot. This is caused by [okhttp#5819|https://github.com/square/okhttp/issues/5819] which is fixed with okhttp [4.5.0|https://square.github.io/okhttp/changelog/#version-450]). We should upgrade to the okhttp 4.9.1 (the current stable version). -- This message was sent by Atlassian Jira (v8.3.4#803005)