Filter Push Down

2018-10-05 Thread Anton Okolnychyi
Hi there, there is an ongoing effort in Spark to support filter push down for nested columns while reading Parquet. I was wondering if this work could be extended to predicates on elements of arrays, keys/values of maps. After my investigation, it seems impossible. I would appreciate your comments

[jira] [Commented] (PARQUET-1433) Parquet-format doesn't compile with Thrift 0.10.0

2018-10-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639687#comment-16639687 ] ASF GitHub Bot commented on PARQUET-1433: - zivanfi closed pull request #111: PA

[jira] [Commented] (PARQUET-1436) TimestampMicrosStringifier shows wrong microseconds for timestamps before 1970

2018-10-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/PARQUET-1436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639525#comment-16639525 ] ASF GitHub Bot commented on PARQUET-1436: - zivanfi closed pull request #529: PA