parquet column number type can add sum, avg metadata information?

2019-07-12 Thread melin li
parquet column number type can add sum, avg metadata information?

[jira] [Commented] (PARQUET-1488) UserDefinedPredicate throw NullPointerException

2019-07-12 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884204#comment-16884204 ] Ryan Blue commented on PARQUET-1488: We discussed this on SPARK-28371. Previously, Parquet did not 

[jira] [Assigned] (PARQUET-1488) UserDefinedPredicate throw NullPointerException

2019-07-12 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue reassigned PARQUET-1488: -- Assignee: Yuming Wang (was: Gabor Szadovszky) > UserDefinedPredicate throw

[jira] [Reopened] (PARQUET-1488) UserDefinedPredicate throw NullPointerException

2019-07-12 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue reopened PARQUET-1488: > UserDefinedPredicate throw NullPointerException > ---

Re: Floating point data compression for Apache Parquet

2019-07-12 Thread Wes McKinney
I think we need to vote to make any changes to the Parquet format. New features carry a heavy responsibility On Fri, Jul 12, 2019 at 10:04 AM Michael Heuer wrote: > > Hello Martin, > > I'm willing to run some tests at scale on our genomics data when a parquet-mr > pull request for the Java

Re: Floating point data compression for Apache Parquet

2019-07-12 Thread Michael Heuer
Hello Martin, I'm willing to run some tests at scale on our genomics data when a parquet-mr pull request for the Java implementation is ready. Cheers, michael > On Jul 11, 2019, at 1:09 PM, Radev, Martin wrote: > > Dear all, > > > I created a Jira issue for the new feature and also

[jira] [Commented] (PARQUET-1609) support xxhash in bloom filter

2019-07-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883673#comment-16883673 ] ASF GitHub Bot commented on PARQUET-1609: - zivanfi commented on pull request #143:

[jira] [Resolved] (PARQUET-1623) [C++] Invalid memory access with a magic number of records

2019-07-12 Thread Hatem Helal (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hatem Helal resolved PARQUET-1623. -- Resolution: Fixed Issue resolved by pull request 4857