Hi, My PR to make this the default in PyArrow is being released in version 10.0: https://github.com/apache/arrow/pull/13633/files
Maybe that would provide a useful starting point if you wanted to do something similar in client libraries for other languages. Thanks, Duncan On Tue, Nov 1, 2022 at 7:21 PM 1057445597 <[email protected]> wrote: > > https://github.com/apache/arrow/blob/master/cpp/src/arrow/filesystem/s3fs.cc#L791 > > Why not use the exponential retry policy? In recent days our datasets have > been timeout due to read/write exceptions. It seems that 6s time is not > enough in some cases. For example, when backend storage encounters a large > number of simultaneous reads and writes. > > ------------------------------ > 1057445597 > [email protected] > > <https://wx.mail.qq.com/home/index?t=readmail_businesscard_midpage&nocheck=true&name=1057445597&icon=http%3A%2F%2Fthirdqq.qlogo.cn%2Fg%3Fb%3Dsdk%26k%3DIlyZtc5eQb1ZfPd0rzpQlQ%26s%3D100%26t%3D1551800738%3Frand%3D1648208978&mail=1057445597%40qq.com&code=> > >
