[ 
https://issues.apache.org/jira/browse/PIG-4092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431929#comment-16431929
 ] 

Nandor Kollar commented on PIG-4092:
------------------------------------

[~rohini] I upgraded the Parquet to the latest and the constructor of 
ParquetInputSplit [parses the schema | 
https://github.com/apache/parquet-mr/blob/master/parquet-hadoop/src/main/java/org/apache/parquet/hadoop/ParquetInputSplit.java#L95],
 thus invalid schema is not allowed any more. I couldn't find the old code, but 
the constructor just set the private schema field before, it didn't parse the 
given string. I guess in this test case we can use just a simple dummy schema, 
it is not important for the test.

> Predicate pushdown for Parquet
> ------------------------------
>
>                 Key: PIG-4092
>                 URL: https://issues.apache.org/jira/browse/PIG-4092
>             Project: Pig
>          Issue Type: Sub-task
>            Reporter: Rohini Palaniswamy
>            Assignee: Nandor Kollar
>            Priority: Major
>             Fix For: 0.18.0
>
>         Attachments: PIG-4092_1.patch, PIG-4092_2.patch
>
>
> See:
> https://github.com/apache/incubator-parquet-mr/pull/4
> and:
> https://github.com/apache/incubator-parquet-mr/blob/master/parquet-column/src/main/java/parquet/filter2/predicate/FilterApi.java
> [~alexlevenson] is the main author of this API



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to