sebastian-nagel opened a new pull request, #1757: URL: https://github.com/apache/stormcrawler/pull/1757
OkHttp supports zstd [Content-Encoding](https://developer.mozilla.org/en-US/docs/Web/HTTP/Reference/Headers/Content-Encoding) since version [5.2.0](https://square.github.io/okhttp/changelogs/changelog/#version-520). This PR adds the necessary dependency on `okhttp-zstd` and enables support for zstd content-encoding in the OkHttp protocol implementation. Tested with `http.store.headers: true`: ``` $> java ... org.apache.stormcrawler.protocol.okhttp.HttpProtocol https://www.llama.com/faq/ ... _protocol_versions_: h2,TLS_1_3,TLS_AES_128_GCM_SHA256 ... _request.headers_: GET /faq/ HTTP/2 User-Agent: ... Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8 Accept-Language: en-us,en-gb,en;q=0.7,*;q=0.3 Accept-Encoding: zstd, br, gzip Host: www.llama.com Connection: Keep-Alive _response.headers_: HTTP/2 200 vary: Accept-Encoding content-encoding: zstd ... ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
