Provide pluggable APIs to support user customized compression codec

2020-03-03 Thread Dong, Xin
Hi, In demand of better performance, quite some end users want to leverage accelerators (e.g. FPGA, Intel QAT) to offload compression computation. However, in current parquet-mr code, codec implementation can't be customized to leverage accelerators. We would like to proposal a pluggable API to

[jira] [Created] (PARQUET-1809) Add new APIs for nested predicate pushdown

2020-03-03 Thread DB Tsai (Jira)
DB Tsai created PARQUET-1809: Summary: Add new APIs for nested predicate pushdown Key: PARQUET-1809 URL: https://issues.apache.org/jira/browse/PARQUET-1809 Project: Parquet Issue Type: New

Provide pluggable APIs to support user customized compression codec

2020-03-03 Thread Dong, Xin
Hi, In demand of better performance, quite some end users want to leverage accelerators (e.g. FPGA, Intel QAT) to offload compression computation. However, in current parquet-mr code, codec implementation can't be customized to leverage accelerators. We would like to proposal a pluggable API to

[jira] [Updated] (PARQUET-1806) [C++] [CI] Improve fuzzing seed corpus

2020-03-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated PARQUET-1806: Labels: pull-request-available (was: ) > [C++] [CI] Improve fuzzing seed corpus >

[jira] [Assigned] (PARQUET-1806) [C++] [CI] Improve fuzzing seed corpus

2020-03-03 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou reassigned PARQUET-1806: --- Assignee: Antoine Pitrou > [C++] [CI] Improve fuzzing seed corpus >

[jira] [Commented] (PARQUET-1808) SimpleGroup.toString() uses String += and so has poor performance

2020-03-03 Thread Gabor Szadovszky (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17050013#comment-17050013 ] Gabor Szadovszky commented on PARQUET-1808: --- [~tiddman], Thanks for filing this issue.