[jira] [Commented] (SPARK-35785) Cleanup support for RocksDB instance

2021-07-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17373317#comment-17373317 ] Apache Spark commented on SPARK-35785: -- User 'xuanyuanking' has created a pull request for this

[jira] [Assigned] (SPARK-35968) Make sure partitions are not too small in AQE partition coalescing

2021-07-02 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35968: --- Assignee: Wenchen Fan > Make sure partitions are not too small in AQE partition coalescing

[jira] [Resolved] (SPARK-35968) Make sure partitions are not too small in AQE partition coalescing

2021-07-02 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35968. - Fix Version/s: 3.2.0 3.3.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-35785) Cleanup support for RocksDB instance

2021-07-02 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-35785: --- Assignee: Yuanjian Li (was: Apache Spark) > Cleanup support for RocksDB instance >

[jira] [Assigned] (SPARK-35785) Cleanup support for RocksDB instance

2021-07-02 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-35785: --- Assignee: Apache Spark > Cleanup support for RocksDB instance >

[jira] [Resolved] (SPARK-35785) Cleanup support for RocksDB instance

2021-07-02 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-35785. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 32933

[jira] [Created] (SPARK-35985) File source V2 ignores partition filters when empty readDataSchema

2021-07-02 Thread Steven Aerts (Jira)
}} of the {{FileScan}} is empty, partition filters are not pushed down and all data is scanned. Some examples where this happens: {code:java} scala> spark.sql("SELECT count(*) FROM parq WHERE day=20210702").explain == Physical Plan == *(2) HashAggregate(keys=[], functions=[count(1)]

[jira] [Commented] (SPARK-35972) NestColumnPruning cause execute loss output

2021-07-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17373258#comment-17373258 ] Apache Spark commented on SPARK-35972: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-35972) NestColumnPruning cause execute loss output

2021-07-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17373255#comment-17373255 ] Apache Spark commented on SPARK-35972: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-35972) NestColumnPruning cause execute loss output

2021-07-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35972: Assignee: (was: Apache Spark) > NestColumnPruning cause execute loss output >

[jira] [Assigned] (SPARK-35972) NestColumnPruning cause execute loss output

2021-07-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35972: Assignee: Apache Spark > NestColumnPruning cause execute loss output >

<    1   2