[
https://issues.apache.org/jira/browse/PARQUET-1872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17243881#comment-17243881
]
Gabor Szadovszky commented on PARQUET-1872:
-------------------------------------------
[~sha...@uber.com], based on the git logs this feature is more or less
complete. Could you please resolve the jiras accordingly?
Also, bloom filter support is missing from the feature. Do you have bandwidth
to implement it for 1.12.0? If not do you think it would be a good idea to show
in the command that bloom filters are not supported (yet)?
> Add TransCompression command
> -----------------------------
>
> Key: PARQUET-1872
> URL: https://issues.apache.org/jira/browse/PARQUET-1872
> Project: Parquet
> Issue Type: Improvement
> Components: parquet-mr
> Affects Versions: 1.12.0
> Reporter: Xinli Shang
> Assignee: Xinli Shang
> Priority: Major
>
> When ZSTD becomes more popular, there is a need to translate existing data to
> ZSTD compressed which can achieve a higher compression ratio. It would be
> useful if we can have a tool to convert a Parquet file directly by just
> decompressing/compressing each page without decoding/encoding or assembling
> the record because it is much faster. The initial result shows it is ~5 times
> faster.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
