RE: Proposal for CompressionCodec Provider-aware Compression Codec Lookup for parquet-mr

2020-06-04 Thread Dong, Xin
Hi, Walid, We've moved the doc here for public access: https://docs.google.com/document/d/1ueSYq2FIzaom23cpHXppig93ylOxe8CU6EwS82dov2E/ Thanks, Xin Dong -Original Message- From: Gara Walid Sent: Thursday, June 4, 2020 2:14 PM To: dev@parquet.apache.org Subject: Re: Proposal for Compres

[jira] [Commented] (PARQUET-1866) Replace Hadoop ZSTD with JNI-ZSTD

2020-06-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17126361#comment-17126361 ] ASF GitHub Bot commented on PARQUET-1866: - shangxinli commented on pull request

[GitHub] [parquet-mr] shangxinli commented on pull request #793: PARQUET-1866: Replace Hadoop ZSTD with JNI-ZSTD

2020-06-04 Thread GitBox
shangxinli commented on pull request #793: URL: https://github.com/apache/parquet-mr/pull/793#issuecomment-639245331 > @shangxinli do we have benchmark comparing to native hadoop codec both in size and speed? Thanks. Hi @dbtsai, I didn't because I don't have Hadoop host installed wit

[jira] [Commented] (PARQUET-1807) Encryption: Interop and Function test suite for Java version

2020-06-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17125903#comment-17125903 ] ASF GitHub Bot commented on PARQUET-1807: - andersonm-ibm commented on pull requ

[jira] [Commented] (PARQUET-1807) Encryption: Interop and Function test suite for Java version

2020-06-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17125902#comment-17125902 ] ASF GitHub Bot commented on PARQUET-1807: - andersonm-ibm commented on a change

[GitHub] [parquet-mr] andersonm-ibm commented on pull request #782: PARQUET-1807: Encryption: Interop and Function test suite for Java version

2020-06-04 Thread GitBox
andersonm-ibm commented on pull request #782: URL: https://github.com/apache/parquet-mr/pull/782#issuecomment-638834993 Thank you very much, @gszadovszky ! I'm on it. This is an automated message from the Apache Git Service.

[GitHub] [parquet-mr] andersonm-ibm commented on a change in pull request #782: PARQUET-1807: Encryption: Interop and Function test suite for Java version

2020-06-04 Thread GitBox
andersonm-ibm commented on a change in pull request #782: URL: https://github.com/apache/parquet-mr/pull/782#discussion_r435237663 ## File path: parquet-hadoop/src/test/java/org/apache/parquet/hadoop/TestEncryptionOptions.java ## @@ -0,0 +1,660 @@ +/* + * Licensed to the Apach

[jira] [Commented] (PARQUET-1373) Encryption key management tools

2020-06-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17125745#comment-17125745 ] ASF GitHub Bot commented on PARQUET-1373: - ggershinsky commented on pull reques

[GitHub] [parquet-mr] ggershinsky commented on pull request #615: PARQUET-1373: Encryption key tools

2020-06-04 Thread GitBox
ggershinsky commented on pull request #615: URL: https://github.com/apache/parquet-mr/pull/615#issuecomment-638737727 > @ggershinsky, is it still in draft state? @gszadovszky The pr is completed, ready for a review Thi

[GitHub] [parquet-mr] ggershinsky commented on pull request #615: PARQUET-1373: Encryption key tools

2020-06-04 Thread GitBox
ggershinsky commented on pull request #615: URL: https://github.com/apache/parquet-mr/pull/615#issuecomment-638677887 the implementation is complete. with the recent addition of a unitest, the draft state can be switched off. I'll rebase it first, to make sure the Travis checks pass. ---

[jira] [Commented] (PARQUET-1373) Encryption key management tools

2020-06-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17125659#comment-17125659 ] ASF GitHub Bot commented on PARQUET-1373: - ggershinsky commented on pull reques

[GitHub] [parquet-mr] gszadovszky commented on pull request #615: PARQUET-1373: Encryption key tools

2020-06-04 Thread GitBox
gszadovszky commented on pull request #615: URL: https://github.com/apache/parquet-mr/pull/615#issuecomment-638646464 @ggershinsky, is it still in draft state? This is an automated message from the Apache Git Service. To resp

[jira] [Commented] (PARQUET-1373) Encryption key management tools

2020-06-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17125604#comment-17125604 ] ASF GitHub Bot commented on PARQUET-1373: - gszadovszky commented on pull reques