Re: [VOTE] Release Apache Parquet 1.11.1 RC1

2020-08-11 Thread Daniel C . Weeks
+1 (binding) verified sigs/sums/build/test I did have some problems with the tests. It appears that you cannot run specific project tests in isolation in some cases (e.g. mvn test -pl parquet-tools fails, but works in conjunction with other tests). Nothing to hold up the release for, but appe

[GitHub] [parquet-mr] shangxinli commented on pull request #808: Parquet-1396: Cryptodata Interface for Schema Activation of Parquet E…

2020-08-11 Thread GitBox
shangxinli commented on pull request #808: URL: https://github.com/apache/parquet-mr/pull/808#issuecomment-672148979 @gszadovszky Thanks for the correction of PARQUET-1784! Regarding the serialized/deserialized, it is not done. I was aware of that when I use ExtType. But that is somethi

[GitHub] [parquet-mr] shangxinli commented on pull request #808: Parquet-1396: Cryptodata Interface for Schema Activation of Parquet E…

2020-08-11 Thread GitBox
shangxinli commented on pull request #808: URL: https://github.com/apache/parquet-mr/pull/808#issuecomment-672093542 @ggershinsky, from what we have discussed above I think now the different opinions narrow to 'how to transport the settings from the extended ParquetWriteSupport to CryptoPr

[jira] [Resolved] (PARQUET-1793) Support writing INT96 timestamp from avro

2020-08-11 Thread Gabor Szadovszky (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Szadovszky resolved PARQUET-1793. --- Resolution: Won't Fix > Support writing INT96 timestamp from avro > ---

[GitHub] [parquet-mr] gszadovszky commented on pull request #808: Parquet-1396: Cryptodata Interface for Schema Activation of Parquet E…

2020-08-11 Thread GitBox
gszadovszky commented on pull request #808: URL: https://github.com/apache/parquet-mr/pull/808#issuecomment-671925400 @shangxinli, The column-wise configuration you are talking about (PARQUET-1784: Column-wise configuration (#754)) is only a specified key format and the related helper impl

[GitHub] [parquet-mr] ggershinsky commented on pull request #808: Parquet-1396: Cryptodata Interface for Schema Activation of Parquet E…

2020-08-11 Thread GitBox
ggershinsky commented on pull request #808: URL: https://github.com/apache/parquet-mr/pull/808#issuecomment-671793784 Yep, a couple of concerns related to encryption. The stated goal of the crypto factory design is to be "transparent to analytic frameworks, so they can leverage Parquet