[ 
https://issues.apache.org/jira/browse/ARROW-8152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17093429#comment-17093429
 ] 

David Li commented on ARROW-8152:
---------------------------------

FWIW, I'm not sure this specific task is needed anymore - I originally didn't 
realize the Parquet reader issued individual reads for each column chunk. 
Splitting large reads hence isn't needed. It may help for people who have very 
large column chunks, but that can be pursued separately if it comes up.

> [C++] IO: split large coalesced reads into smaller ones
> -------------------------------------------------------
>
>                 Key: ARROW-8152
>                 URL: https://issues.apache.org/jira/browse/ARROW-8152
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: C++
>            Reporter: David Li
>            Priority: Major
>             Fix For: 1.0.0
>
>
> We have a facility to coalesce small reads, but remote filesystems may also 
> benefit from splitting large reads to take advantage of concurrency.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to