[jira] [Commented] (ARROW-18113) Implement a read range process without caching

2022-11-16 Thread Weston Pace (Jira)
[ https://issues.apache.org/jira/browse/ARROW-18113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17634916#comment-17634916 ] Weston Pace commented on ARROW-18113: - {quote} or we just can include caching.h in every filesystem

[jira] [Commented] (ARROW-18113) Implement a read range process without caching

2022-11-16 Thread David Li (Jira)
[ https://issues.apache.org/jira/browse/ARROW-18113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17634819#comment-17634819 ] David Li commented on ARROW-18113: -- Ah sorry, ignore what I said - Weston is right. Though if you still

[jira] [Commented] (ARROW-18113) Implement a read range process without caching

2022-11-15 Thread Jira
[ https://issues.apache.org/jira/browse/ARROW-18113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17634647#comment-17634647 ] Percy Camilo Triveño Aucahuasi commented on ARROW-18113: ??Sounds reasonable to

[jira] [Commented] (ARROW-18113) Implement a read range process without caching

2022-11-14 Thread Weston Pace (Jira)
[ https://issues.apache.org/jira/browse/ARROW-18113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17634111#comment-17634111 ] Weston Pace commented on ARROW-18113: - I would think that coalescing would be an implementation

[jira] [Commented] (ARROW-18113) Implement a read range process without caching

2022-11-14 Thread David Li (Jira)
[ https://issues.apache.org/jira/browse/ARROW-18113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17634082#comment-17634082 ] David Li commented on ARROW-18113: -- Sounds reasonable to me, at first glance. Maybe leave behind a

[jira] [Commented] (ARROW-18113) Implement a read range process without caching

2022-11-14 Thread Jira
[ https://issues.apache.org/jira/browse/ARROW-18113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17634076#comment-17634076 ] Percy Camilo Triveño Aucahuasi commented on ARROW-18113: Thanks for all the

[jira] [Commented] (ARROW-18113) Implement a read range process without caching

2022-10-24 Thread Sasha Krassovsky (Jira)
[ https://issues.apache.org/jira/browse/ARROW-18113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623419#comment-17623419 ] Sasha Krassovsky commented on ARROW-18113: -- Yes, io_uring has `io_uring_wait_cqe` which will

[jira] [Commented] (ARROW-18113) Implement a read range process without caching

2022-10-24 Thread David Li (Jira)
[ https://issues.apache.org/jira/browse/ARROW-18113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623416#comment-17623416 ] David Li commented on ARROW-18113: -- For Parquet, the reader can submit reads for all ColumnChunks at

[jira] [Commented] (ARROW-18113) Implement a read range process without caching

2022-10-24 Thread Weston Pace (Jira)
[ https://issues.apache.org/jira/browse/ARROW-18113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623386#comment-17623386 ] Weston Pace commented on ARROW-18113: - {quote} Linking io_uring to the Future API could be a bit

[jira] [Commented] (ARROW-18113) Implement a read range process without caching

2022-10-22 Thread Sasha Krassovsky (Jira)
[ https://issues.apache.org/jira/browse/ARROW-18113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622565#comment-17622565 ] Sasha Krassovsky commented on ARROW-18113: -- Linking io_uring to the Future API could be a bit

[jira] [Commented] (ARROW-18113) Implement a read range process without caching

2022-10-20 Thread David Li (Jira)
[ https://issues.apache.org/jira/browse/ARROW-18113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621428#comment-17621428 ] David Li commented on ARROW-18113: -- Ah ok I was forgetting that we could theoretically split up reads.

[jira] [Commented] (ARROW-18113) Implement a read range process without caching

2022-10-20 Thread Weston Pace (Jira)
[ https://issues.apache.org/jira/browse/ARROW-18113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621427#comment-17621427 ] Weston Pace commented on ARROW-18113: - > Just to be clear: to the filesystem, or on the reader

[jira] [Commented] (ARROW-18113) Implement a read range process without caching

2022-10-20 Thread David Li (Jira)
[ https://issues.apache.org/jira/browse/ARROW-18113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621401#comment-17621401 ] David Li commented on ARROW-18113: -- Just to be clear: to the filesystem, or on the reader itself?

[jira] [Commented] (ARROW-18113) Implement a read range process without caching

2022-10-20 Thread Weston Pace (Jira)
[ https://issues.apache.org/jira/browse/ARROW-18113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621398#comment-17621398 ] Weston Pace commented on ARROW-18113: - On reflection, I don't really prefer my automagic suggestion.

[jira] [Commented] (ARROW-18113) Implement a read range process without caching

2022-10-20 Thread David Li (Jira)
[ https://issues.apache.org/jira/browse/ARROW-18113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621309#comment-17621309 ] David Li commented on ARROW-18113: -- (Of course, that's only if you choose to go with an explicit API,

[jira] [Commented] (ARROW-18113) Implement a read range process without caching

2022-10-20 Thread David Li (Jira)
[ https://issues.apache.org/jira/browse/ARROW-18113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17621308#comment-17621308 ] David Li commented on ARROW-18113: -- I'd like to raise my comments in ARROW-17913 and ARROW-17917 as