Maxsparrow commented on issue #10478:
URL: https://github.com/apache/datafusion/issues/10478#issuecomment-2118409774
We've been hitting this issue too, the object store doesn't retry these
errors even if you set retries:
```
Error: External(ParquetError(General("AsyncChunkReader::get_bytes error:
Generic S3 error: Error after 0 retries in 621.914125ms, max_retries:120,
retry_timeout:600s, source:error sending request for url(...): connection
error: Connection reset by peer (os error 54)")))
```
I believe it may be fixed by https://github.com/apache/arrow-rs/pull/5609
which is in object store release 0.10.0
@alamb - will the next DataFusion release include an object store bump?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For additional commands, e-mail: github-h...@datafusion.apache.org
