[jira] [Updated] (PARQUET-425) Fix the bug when predicate contains columns not specified in prejection, to prevent filtering out data improperly

2016-01-12 Thread Liwei Lin (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liwei Lin updated PARQUET-425: -- Description: As is reported in Parquet-427, data will be filtered out improperly under the case

[jira] [Created] (PARQUET-425) Fix the bug when predicate contains columns not specified in prejection, to prevent filtering out data improperly

2016-01-12 Thread Liwei Lin (JIRA)
Liwei Lin created PARQUET-425: - Summary: Fix the bug when predicate contains columns not specified in prejection, to prevent filtering out data improperly Key: PARQUET-425 URL:

[jira] [Updated] (PARQUET-427) Push predicates into the whole read path

2016-01-12 Thread Liwei Lin (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liwei Lin updated PARQUET-427: -- Attachment: Parquet-427 v0.1.pdf [~julienledem][~rdblue] would you take a look at it, please? Any

[jira] [Updated] (PARQUET-425) Fix the bug when predicate contains columns not specified in prejection, to prevent filtering out data improperly

2016-01-12 Thread Liwei Lin (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liwei Lin updated PARQUET-425: -- Description: As is reported in Parquet-427, data will be filtered out improperly under the case

[jira] [Updated] (PARQUET-425) Fix the bug when predicate contains columns not specified in prejection, to prevent filtering out data improperly

2016-01-12 Thread Liwei Lin (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liwei Lin updated PARQUET-425: -- Description: As is reported in Parquet-427, data will be filtered out improperly under the case

[jira] [Updated] (PARQUET-426) Throw Exception when predicate contains columns not specified in prejection, to prevent filtering out data improperly

2016-01-12 Thread Liwei Lin (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liwei Lin updated PARQUET-426: -- External issue URL: https://issues.apache.org/jira/browse/PARQUET-425 External issue ID: (was:

[jira] [Created] (PARQUET-426) Throw Exception when predicate contains columns not specified in prejection, to prevent filtering out data improperly

2016-01-12 Thread Liwei Lin (JIRA)
Liwei Lin created PARQUET-426: - Summary: Throw Exception when predicate contains columns not specified in prejection, to prevent filtering out data improperly Key: PARQUET-426 URL:

[jira] [Updated] (PARQUET-425) Fix the bug when predicate contains columns not specified in prejection, to prevent filtering out data improperly

2016-01-12 Thread Liwei Lin (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liwei Lin updated PARQUET-425: -- Description: As is reported in Parquet-427, data will be filtered out improperly under the case

Protocol Buffer write question

2016-01-12 Thread McCudden, James
I have a Protocol buffer defined as such: message A { optional string id = 1; repeated B extension = 2; } The B message is: Message B { optional string id = 1; repeated B extension = 2; } The self referencing message "B" causes

Re: Protocol Buffer write question

2016-01-12 Thread Ryan Blue
James, I think this is a bug. Parquet turns nested structures into a static number of columns, but this is limited to types that aren't recursive. Recursive types are not currently supported because it would be pretty difficult for a columnar format like Parquet. The bug is that the Protobuf

Re: Protocol Buffer write question

2016-01-12 Thread lukas nalezenec
Hi, This is known issue. There is no code for detecting loops in messages. Lukas James, I think this is a bug. Parquet turns nested structures into a static number of columns, but this is limited to types that aren't recursive. Recursive types are not currently supported because it would be pretty

[jira] [Created] (PARQUET-423) Make writing Avro to Parquet less noisy

2016-01-12 Thread Niels Basjes (JIRA)
Niels Basjes created PARQUET-423: Summary: Make writing Avro to Parquet less noisy Key: PARQUET-423 URL: https://issues.apache.org/jira/browse/PARQUET-423 Project: Parquet Issue Type:

[jira] [Resolved] (PARQUET-421) Fix mismatch of javadoc names and method parameters in module encoding, column, and hadoop

2016-01-12 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue resolved PARQUET-421. --- Resolution: Fixed I merged #307. Thanks for contributing this fix, [~proflin]! > Fix mismatch of

[jira] [Resolved] (PARQUET-212) Implement nested type read rules in parquet-thrift

2016-01-12 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue resolved PARQUET-212. --- Resolution: Fixed Fix Version/s: 1.9.0 Merged #300. Thanks for reviewing, Sergio and

[jira] [Updated] (PARQUET-421) Fix mismatch of javadoc names and method parameters in module encoding, column, and hadoop

2016-01-12 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue updated PARQUET-421: -- Assignee: Liwei Lin > Fix mismatch of javadoc names and method parameters in module encoding, >

[jira] [Updated] (PARQUET-422) Fix a potential bug in MessageTypeParser where we ignore and overwrite the initial value of a method parameter

2016-01-12 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue updated PARQUET-422: -- Assignee: Liwei Lin > Fix a potential bug in MessageTypeParser where we ignore and overwrite the >

[jira] [Commented] (PARQUET-420) Provide example to write/save your own object (without thrift, avro, protoc)

2016-01-12 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15095115#comment-15095115 ] Ryan Blue commented on PARQUET-420: --- Great, thanks for your feedback! > Provide example to write/save

[jira] [Commented] (PARQUET-256) Deprecate ConversionPatterns

2016-01-12 Thread Liwei Lin (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15095420#comment-15095420 ] Liwei Lin commented on PARQUET-256: --- [~rdblue] could you share some updates for this, please? >