[jira] [Comment Edited] (SPARK-33582) Hive partition pruning support not-equals

[ https://issues.apache.org/jira/browse/SPARK-33582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239919#comment-17239919 ] Yuming Wang edited comment on SPARK-33582 at 11/28/20, 7:52 AM: This

[jira] [Commented] (SPARK-33582) Hive partition pruning support not-equals

[ https://issues.apache.org/jira/browse/SPARK-33582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239919#comment-17239919 ] Yuming Wang commented on SPARK-33582: - This changed should after SPARK-33581, I have prepared the

[jira] [Created] (SPARK-33582) Hive partition pruning support not-equals

Yuming Wang created SPARK-33582: --- Summary: Hive partition pruning support not-equals Key: SPARK-33582 URL: https://issues.apache.org/jira/browse/SPARK-33582 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-33581) Refactor HivePartitionFilteringSuite

[ https://issues.apache.org/jira/browse/SPARK-33581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239887#comment-17239887 ] Apache Spark commented on SPARK-33581: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33581) Refactor HivePartitionFilteringSuite

[ https://issues.apache.org/jira/browse/SPARK-33581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33581: Assignee: Apache Spark > Refactor HivePartitionFilteringSuite >

[jira] [Assigned] (SPARK-33581) Refactor HivePartitionFilteringSuite

[ https://issues.apache.org/jira/browse/SPARK-33581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33581: Assignee: (was: Apache Spark) > Refactor HivePartitionFilteringSuite >

[jira] [Updated] (SPARK-33581) Refactor HivePartitionFilteringSuite

[ https://issues.apache.org/jira/browse/SPARK-33581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33581: Description: Refactor HivePartitionFilteringSuite, to make it easy to maintain. (was: Refactor

[jira] [Created] (SPARK-33581) Refactor HivePartitionFilteringSuite

Yuming Wang created SPARK-33581: --- Summary: Refactor HivePartitionFilteringSuite Key: SPARK-33581 URL: https://issues.apache.org/jira/browse/SPARK-33581 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-33580) resolveDependencyPaths should use classifier attribute of artifact

[ https://issues.apache.org/jira/browse/SPARK-33580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239882#comment-17239882 ] Apache Spark commented on SPARK-33580: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33580) resolveDependencyPaths should use classifier attribute of artifact

[ https://issues.apache.org/jira/browse/SPARK-33580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33580: Assignee: L. C. Hsieh (was: Apache Spark) > resolveDependencyPaths should use

[jira] [Assigned] (SPARK-33580) resolveDependencyPaths should use classifier attribute of artifact

[ https://issues.apache.org/jira/browse/SPARK-33580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33580: Assignee: Apache Spark (was: L. C. Hsieh) > resolveDependencyPaths should use

[jira] [Commented] (SPARK-33580) resolveDependencyPaths should use classifier attribute of artifact

[ https://issues.apache.org/jira/browse/SPARK-33580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239881#comment-17239881 ] Apache Spark commented on SPARK-33580: -- User 'viirya' has created a pull request for this issue:

[jira] [Updated] (SPARK-33580) resolveDependencyPaths should use classifier attribute of artifact

[ https://issues.apache.org/jira/browse/SPARK-33580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-33580: Description: `resolveDependencyPaths` now takes artifact type to decide to add "-tests" postfix.

[jira] [Created] (SPARK-33580) resolveDependencyPaths should use classifier attribute of artifact

L. C. Hsieh created SPARK-33580: --- Summary: resolveDependencyPaths should use classifier attribute of artifact Key: SPARK-33580 URL: https://issues.apache.org/jira/browse/SPARK-33580 Project: Spark

[jira] [Commented] (SPARK-33579) Executors blank page behind proxy

[ https://issues.apache.org/jira/browse/SPARK-33579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239782#comment-17239782 ] Apache Spark commented on SPARK-33579: -- User 'pgillet' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33579) Executors blank page behind proxy

[ https://issues.apache.org/jira/browse/SPARK-33579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33579: Assignee: (was: Apache Spark) > Executors blank page behind proxy >

[jira] [Commented] (SPARK-33579) Executors blank page behind proxy

[ https://issues.apache.org/jira/browse/SPARK-33579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239780#comment-17239780 ] Apache Spark commented on SPARK-33579: -- User 'pgillet' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33579) Executors blank page behind proxy

[ https://issues.apache.org/jira/browse/SPARK-33579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33579: Assignee: Apache Spark > Executors blank page behind proxy >

[jira] [Updated] (SPARK-33579) Executors blank page behind proxy

[ https://issues.apache.org/jira/browse/SPARK-33579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pascal GILLET updated SPARK-33579: -- Description: When accessing the Web UI behind a proxy (e.g. a Kubernetes ingress), executors

[jira] [Updated] (SPARK-33579) Executors blank page behind proxy

[ https://issues.apache.org/jira/browse/SPARK-33579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pascal GILLET updated SPARK-33579: -- Description: When accessing the Web UI behind a proxy (e.g. a Kubernetes ingress), executors

[jira] [Created] (SPARK-33579) Executors blank page behind proxy

Pascal GILLET created SPARK-33579: - Summary: Executors blank page behind proxy Key: SPARK-33579 URL: https://issues.apache.org/jira/browse/SPARK-33579 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

[ https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simon updated SPARK-33571: -- Description: The handling of old dates written with older Spark versions (<2.4.6) using the hybrid calendar

[jira] [Updated] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

[ https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simon updated SPARK-33571: -- Component/s: PySpark > Handling of hybrid to proleptic calendar when reading and writing Parquet > data not

[jira] [Assigned] (SPARK-33141) capture SQL configs when creating permanent views

[ https://issues.apache.org/jira/browse/SPARK-33141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33141: --- Assignee: Leanken.Lin > capture SQL configs when creating permanent views >

[jira] [Resolved] (SPARK-33141) capture SQL configs when creating permanent views

[ https://issues.apache.org/jira/browse/SPARK-33141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33141. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30289

[jira] [Resolved] (SPARK-33498) Datetime parsing should fail if the input string can't be parsed, or the pattern string is invalid

[ https://issues.apache.org/jira/browse/SPARK-33498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33498. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30442

[jira] [Assigned] (SPARK-33498) Datetime parsing should fail if the input string can't be parsed, or the pattern string is invalid

[ https://issues.apache.org/jira/browse/SPARK-33498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33498: --- Assignee: Leanken.Lin > Datetime parsing should fail if the input string can't be parsed,

[jira] [Commented] (SPARK-33578) enableHiveSupport is invalid after sparkContext that without hive support created

[ https://issues.apache.org/jira/browse/SPARK-33578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239653#comment-17239653 ] Apache Spark commented on SPARK-33578: -- User 'yui2010' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33578) enableHiveSupport is invalid after sparkContext that without hive support created

[ https://issues.apache.org/jira/browse/SPARK-33578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33578: Assignee: (was: Apache Spark) > enableHiveSupport is invalid after sparkContext that

[jira] [Assigned] (SPARK-33578) enableHiveSupport is invalid after sparkContext that without hive support created

[ https://issues.apache.org/jira/browse/SPARK-33578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33578: Assignee: Apache Spark > enableHiveSupport is invalid after sparkContext that without

[jira] [Updated] (SPARK-33578) enableHiveSupport is invalid after sparkContext that without hive support created

[ https://issues.apache.org/jira/browse/SPARK-33578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] steven zhang updated SPARK-33578: - Description: reproduce as follow code:         SparkConf sparkConf = new

[jira] [Created] (SPARK-33578) enableHiveSupport is invalid after sparkContext that without hive support created

steven zhang created SPARK-33578: Summary: enableHiveSupport is invalid after sparkContext that without hive support created Key: SPARK-33578 URL: https://issues.apache.org/jira/browse/SPARK-33578

[jira] [Commented] (SPARK-33557) spark.storage.blockManagerSlaveTimeoutMs default value does not follow spark.network.timeout value when the latter was changed

[ https://issues.apache.org/jira/browse/SPARK-33557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239646#comment-17239646 ] Yang Jie commented on SPARK-33557: --  I'm not sure whether the configurations related to

[jira] [Commented] (SPARK-33557) spark.storage.blockManagerSlaveTimeoutMs default value does not follow spark.network.timeout value when the latter was changed

[ https://issues.apache.org/jira/browse/SPARK-33557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239631#comment-17239631 ] Yang Jie commented on SPARK-33557: -- It seems that changing value of "spark.network.timeout" doesn't

[jira] [Commented] (SPARK-28646) Allow usage of `count` only for parameterless aggregate function

[ https://issues.apache.org/jira/browse/SPARK-28646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239619#comment-17239619 ] jiaan.geng commented on SPARK-28646: I will take a look! > Allow usage of `count` only for

[jira] [Resolved] (SPARK-28645) Throw an error on window redefinition

[ https://issues.apache.org/jira/browse/SPARK-28645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28645. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30512

[jira] [Assigned] (SPARK-28645) Throw an error on window redefinition

[ https://issues.apache.org/jira/browse/SPARK-28645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-28645: --- Assignee: jiaan.geng > Throw an error on window redefinition >

[jira] [Assigned] (SPARK-33522) Improve exception messages while handling UnresolvedTableOrView

[ https://issues.apache.org/jira/browse/SPARK-33522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33522: --- Assignee: Terry Kim > Improve exception messages while handling UnresolvedTableOrView >

[jira] [Resolved] (SPARK-33522) Improve exception messages while handling UnresolvedTableOrView

[ https://issues.apache.org/jira/browse/SPARK-33522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33522. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30475

[jira] [Updated] (SPARK-33576) PythonException: An exception was thrown from a UDF: 'OSError: Invalid IPC message: negative bodyLength'.

[ https://issues.apache.org/jira/browse/SPARK-33576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Darshat updated SPARK-33576: Description: Hello, We are using Databricks on Azure to process large amount of ecommerce data.

[jira] [Commented] (SPARK-33577) Add support for V1Table in stream writer table API

[ https://issues.apache.org/jira/browse/SPARK-33577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239577#comment-17239577 ] Apache Spark commented on SPARK-33577: -- User 'xuanyuanking' has created a pull request for this

[jira] [Assigned] (SPARK-33577) Add support for V1Table in stream writer table API

[ https://issues.apache.org/jira/browse/SPARK-33577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33577: Assignee: Apache Spark > Add support for V1Table in stream writer table API >

[jira] [Assigned] (SPARK-33577) Add support for V1Table in stream writer table API

[ https://issues.apache.org/jira/browse/SPARK-33577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33577: Assignee: (was: Apache Spark) > Add support for V1Table in stream writer table API >

[jira] [Commented] (SPARK-33577) Add support for V1Table in stream writer table API

[ https://issues.apache.org/jira/browse/SPARK-33577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239576#comment-17239576 ] Apache Spark commented on SPARK-33577: -- User 'xuanyuanking' has created a pull request for this

[jira] [Updated] (SPARK-33577) Add support for V1Table in stream writer table API

[ https://issues.apache.org/jira/browse/SPARK-33577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanjian Li updated SPARK-33577: Description: After SPARK-32896, we have table API for stream writer but only support DataSource

[jira] [Created] (SPARK-33577) Add support for V1Table in stream writer table API

Yuanjian Li created SPARK-33577: --- Summary: Add support for V1Table in stream writer table API Key: SPARK-33577 URL: https://issues.apache.org/jira/browse/SPARK-33577 Project: Spark Issue Type:

[jira] [Updated] (SPARK-33486) Collapse Partial and Final Aggregation into Complete Aggregation mode

[ https://issues.apache.org/jira/browse/SPARK-33486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prakhar Jain updated SPARK-33486: - Issue Type: Improvement (was: Task) > Collapse Partial and Final Aggregation into Complete

[jira] [Commented] (SPARK-33486) Collapse Partial and Final Aggregation into Complete Aggregation mode

[ https://issues.apache.org/jira/browse/SPARK-33486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239574#comment-17239574 ] Prakhar Jain commented on SPARK-33486: -- [~dongjoon] Sure. Updating the Issue Type to Improvement.