[jira] [Commented] (ARROW-17961) Add read/write optimization for pyarrow.fs.S3FileSystem

2022-10-10 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17614936#comment-17614936 ] Joris Van den Bossche commented on ARROW-17961: --- We (somewhat inconsistently) enabled

[jira] [Commented] (ARROW-17961) Add read/write optimization for pyarrow.fs.S3FileSystem

2022-10-07 Thread Weston Pace (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17614189#comment-17614189 ] Weston Pace commented on ARROW-17961: - I think David's right. If you know you're going to read the

[jira] [Commented] (ARROW-17961) Add read/write optimization for pyarrow.fs.S3FileSystem

2022-10-07 Thread David Li (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17614153#comment-17614153 ] David Li commented on ARROW-17961: -- That said assuming that is the cause, I don't think we necessarily

[jira] [Commented] (ARROW-17961) Add read/write optimization for pyarrow.fs.S3FileSystem

2022-10-07 Thread David Li (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17614148#comment-17614148 ] David Li commented on ARROW-17961: -- [~westonpace] probably has better context here, but from what I

[jira] [Commented] (ARROW-17961) Add read/write optimization for pyarrow.fs.S3FileSystem

2022-10-07 Thread Jacob Wujciak-Jens (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17614053#comment-17614053 ] Jacob Wujciak-Jens commented on ARROW-17961: Things like readahead and metadata caching cc

[jira] [Commented] (ARROW-17961) Add read/write optimization for pyarrow.fs.S3FileSystem

2022-10-07 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17613978#comment-17613978 ] Antoine Pitrou commented on ARROW-17961: Which "optimization" is that? > Add read/write