[jira] [Commented] (PARQUET-1472) Dictionary filter fails on FIXED_LEN_BYTE_ARRAY

2018-12-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16720178#comment-16720178 ] ASF GitHub Bot commented on PARQUET-1472: - gszadovszky closed pull request #562

[jira] [Created] (PARQUET-1476) Don't emit a warning message for files without new logical type

2018-12-13 Thread Nandor Kollar (JIRA)
Nandor Kollar created PARQUET-1476: -- Summary: Don't emit a warning message for files without new logical type Key: PARQUET-1476 URL: https://issues.apache.org/jira/browse/PARQUET-1476 Project: Parque

[jira] [Commented] (PARQUET-1476) Don't emit a warning message for files without new logical type

2018-12-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16720218#comment-16720218 ] ASF GitHub Bot commented on PARQUET-1476: - nandorKollar opened a new pull reque

[jira] [Updated] (PARQUET-1476) Don't emit a warning message for files without new logical type

2018-12-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated PARQUET-1476: Labels: pull-request-available (was: ) > Don't emit a warning message for files without

[jira] [Resolved] (PARQUET-1473) [C++] Add helper function that converts ParquetVersion to human-friendly string

2018-12-13 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved PARQUET-1473. --- Resolution: Fixed Fix Version/s: cpp-1.6.0 Issue resolved by pull request 3148 [http

Re: Arrow read write support on Java

2018-12-13 Thread Masayuki Takahashi
Hi Wes, I could not understand about "IP lineage / transfer issues". Could you tell me the details? I will try to conform to the rules of Parquet Community as much as possible. thank. 2018年12月13日(木) 0:38 Wes McKinney : > > hi Masayuki -- this is great to hear. Since this software was not > devel

Re: Arrow read write support on Java

2018-12-13 Thread Masayuki Takahashi
Hi Ryan, Which part do you want to discuss? May I create JIRA for? thanks. 2018年12月13日(木) 3:28 Ryan Blue : > > We've had a lot of discussion about this in the Iceberg community as well, > since Parquet to Arrow is going to be the easiest path to vectorized reads > for Spark. It would be great to

Re: Arrow read write support on Java

2018-12-13 Thread Wes McKinney
hi, This software was developed outside of Apache Parquet: https://github.com/masayuki038/parquet-to-arrow. It would be different if this had been developed as pull requests into apache/parquet-mr, for example. We have a procedure for accepting foreign IP into Apache projects: http://incubator.ap

[jira] [Commented] (PARQUET-1474) Less verbose and lower level logging for missing column/offset indexes

2018-12-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16720333#comment-16720333 ] ASF GitHub Bot commented on PARQUET-1474: - gszadovszky closed pull request #563

[jira] [Resolved] (PARQUET-1472) Dictionary filter fails on FIXED_LEN_BYTE_ARRAY

2018-12-13 Thread Gabor Szadovszky (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Szadovszky resolved PARQUET-1472. --- Resolution: Fixed Fix Version/s: 1.11.0 > Dictionary filter fails on FIXED_L

[jira] [Resolved] (PARQUET-1474) Less verbose and lower level logging for missing column/offset indexes

2018-12-13 Thread Gabor Szadovszky (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Szadovszky resolved PARQUET-1474. --- Resolution: Fixed Assignee: Gabor Szadovszky Fix Version/s: 1.11.0

Summary of Column Index Testing Efforts

2018-12-13 Thread Zoltan Ivanfi
Hi, In the last Parquet sync we have been asked to share details of the testing we had done to validate the correctness of column indexes. We were also asked to validate the column index structures of a random-generated data set against the contracts. Please see my summary of our efforts below: -

[jira] [Commented] (PARQUET-1476) Don't emit a warning message for files without new logical type

2018-12-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16720425#comment-16720425 ] ASF GitHub Bot commented on PARQUET-1476: - zivanfi closed pull request #577: PA

[VOTE] Release Apache Parquet 1.11.0 RC2

2018-12-13 Thread Zoltan Ivanfi
Dear Parquet Users and Developers, I propose the following RC to be released as the official Apache Parquet 1.11.0 release: The commit id is a01a4dbbee892cbe920657e75f7750d33e277fbb * This corresponds to the tag: apache-parquet-1.11.0 * https://github.com/apache/parquet-mr/tree/a01a4dbbee892cbe9