[
https://issues.apache.org/jira/browse/PARQUET-1422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16625848#comment-16625848
]
Wes McKinney commented on PARQUET-1422:
---------------------------------------
Also on
> doing this as described will require more Arrow headers to be included in the
> build of the core parquet library
This does not cause Parquet core to depend on additional Arrow headers. This
work is in line with having less "platform code" in the Parquet core libraries,
one of our objectives in bringing the communities closer together.
I will post a patch sometime soon for comment
> [C++] Use Arrow IO interfaces natively rather than current parquet:: wrappers
> -----------------------------------------------------------------------------
>
> Key: PARQUET-1422
> URL: https://issues.apache.org/jira/browse/PARQUET-1422
> Project: Parquet
> Issue Type: Improvement
> Components: parquet-cpp
> Reporter: Wes McKinney
> Assignee: Wes McKinney
> Priority: Major
> Fix For: cpp-1.6.0
>
>
> We are beginning to do some work on asynchronous IO in Arrow and it would be
> great to be able to leverage this in the Parquet core internals.
> I am proposing to remove the Parquet-specific virtual file interfaces in
> https://github.com/apache/arrow/blob/master/cpp/src/parquet/util/memory.h#L221
> and instead rely directly on the Arrow ones in arrow::io. In addition to
> reducing the amount of code we have to maintain, we will also be able to
> improve performance of Parquet by utilizing common utilities for managing
> asynchronous / background IO
> cc [~mdeepak] [~xhochy]
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
