[jira] [Updated] (SPARK-39565) “SPARK_HOME” usage in bin/docker-image-tool.sh might be explained

2022-06-22 Thread Sookyung Park (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sookyung Park updated SPARK-39565: -- Description: Hello, I am using docker-image-tool.sh on building docker images for k8s, as

[jira] [Commented] (SPARK-39430) The inconsistent timezone in Spark History Server UI

2022-06-22 Thread Surbhi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17557820#comment-17557820 ] Surbhi commented on SPARK-39430: Is this the Spark UI default behaviour that  all the timestamp values

[jira] [Resolved] (SPARK-39548) CreateView Command with a window clause query hit a wrong window definition not found issue

2022-06-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39548. - Fix Version/s: 3.3.1 3.2.2 3.4.0 Resolution: Fixed

[jira] [Assigned] (SPARK-39548) CreateView Command with a window clause query hit a wrong window definition not found issue

2022-06-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39548: --- Assignee: Rui Wang > CreateView Command with a window clause query hit a wrong window

[jira] [Assigned] (SPARK-39547) V2SessionCatalog should not throw NoSuchDatabaseException in loadNamespaceMetadata

2022-06-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39547: --- Assignee: Prashant Singh > V2SessionCatalog should not throw NoSuchDatabaseException in >

[jira] [Resolved] (SPARK-39547) V2SessionCatalog should not throw NoSuchDatabaseException in loadNamespaceMetadata

2022-06-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39547. - Fix Version/s: 3.4.0 3.3.1 Resolution: Fixed > V2SessionCatalog

[jira] [Assigned] (SPARK-39543) The option of DataFrameWriterV2 should be passed to storage properties if fallback to v1

2022-06-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39543: --- Assignee: Yi kaifei > The option of DataFrameWriterV2 should be passed to storage

[jira] [Resolved] (SPARK-39543) The option of DataFrameWriterV2 should be passed to storage properties if fallback to v1

2022-06-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39543. - Fix Version/s: 3.3.1 3.2.2 Resolution: Fixed Issue resolved by pull

[jira] [Commented] (SPARK-39564) Expose the information of catalog table to the logical plan in streaming query

2022-06-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17557806#comment-17557806 ] Apache Spark commented on SPARK-39564: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Assigned] (SPARK-39564) Expose the information of catalog table to the logical plan in streaming query

2022-06-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39564: Assignee: (was: Apache Spark) > Expose the information of catalog table to the

[jira] [Commented] (SPARK-39564) Expose the information of catalog table to the logical plan in streaming query

2022-06-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17557805#comment-17557805 ] Apache Spark commented on SPARK-39564: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Assigned] (SPARK-39564) Expose the information of catalog table to the logical plan in streaming query

2022-06-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39564: Assignee: Apache Spark > Expose the information of catalog table to the logical plan in

[jira] [Created] (SPARK-39565) “SPARK_HOME” usage in bin/docker-image-tool.sh might be explained

2022-06-22 Thread Sookyung Park (Jira)
Sookyung Park created SPARK-39565: - Summary: “SPARK_HOME” usage in bin/docker-image-tool.sh might be explained Key: SPARK-39565 URL: https://issues.apache.org/jira/browse/SPARK-39565 Project: Spark

[jira] [Commented] (SPARK-30696) Wrong result of the combination of from_utc_timestamp and to_utc_timestamp

2022-06-22 Thread Manu Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17557794#comment-17557794 ] Manu Zhang commented on SPARK-30696: [~maxgekk], any update on this? I find another issue in 3.1.1.

[jira] [Commented] (SPARK-39564) Expose the information of catalog table to the logical plan in streaming query

2022-06-22 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17557770#comment-17557770 ] Jungtaek Lim commented on SPARK-39564: -- Will submit a PR soon. > Expose the information of catalog

[jira] [Created] (SPARK-39564) Expose the information of catalog table to the logical plan in streaming query

2022-06-22 Thread Jungtaek Lim (Jira)
Jungtaek Lim created SPARK-39564: Summary: Expose the information of catalog table to the logical plan in streaming query Key: SPARK-39564 URL: https://issues.apache.org/jira/browse/SPARK-39564

[jira] [Updated] (SPARK-39554) insertIntoHive ExternalTmpPath won't be clear when the app being killed

2022-06-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-39554: - Priority: Major (was: Critical) > insertIntoHive ExternalTmpPath won't be clear when the app

[jira] [Commented] (SPARK-17728) UDFs are run too many times

2022-06-22 Thread Josh Rosen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-17728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17557756#comment-17557756 ] Josh Rosen commented on SPARK-17728: As of SPARK-36718 in Spark 3.3 I think the

[jira] [Assigned] (SPARK-39563) Use localHostNameForURI in UISuite

2022-06-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39563: - Assignee: William Hyun (was: Apache Spark) > Use localHostNameForURI in UISuite >

[jira] [Updated] (SPARK-39563) Use localHostNameForURI in UISuite

2022-06-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39563: -- Parent: SPARK-39457 Issue Type: Sub-task (was: Improvement) > Use

[jira] [Commented] (SPARK-39563) Use localHostNameForURI in UISuite

2022-06-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17557754#comment-17557754 ] Dongjoon Hyun commented on SPARK-39563: --- I'll collect this as a subtask of SPARK-39457,

[jira] [Resolved] (SPARK-39563) Use localHostNameForURI in UISuite

2022-06-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39563. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36962

[jira] [Resolved] (SPARK-38614) After Spark update, df.show() shows incorrect F.percent_rank results

2022-06-22 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-38614. - Fix Version/s: 3.2.2 3.4.0 3.3.1 Assignee: Bruce

[jira] [Commented] (SPARK-39563) Use localHostNameForURI in UISuite

2022-06-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17557748#comment-17557748 ] Apache Spark commented on SPARK-39563: -- User 'williamhyun' has created a pull request for this

[jira] [Assigned] (SPARK-39563) Use localHostNameForURI in UISuite

2022-06-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39563: Assignee: Apache Spark > Use localHostNameForURI in UISuite >

[jira] [Assigned] (SPARK-39563) Use localHostNameForURI in UISuite

2022-06-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39563: Assignee: Apache Spark > Use localHostNameForURI in UISuite >

[jira] [Resolved] (SPARK-39562) Make hive-thrift server module passes in IPv6 environment

2022-06-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39562. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36961

[jira] [Commented] (SPARK-39563) Use localHostNameForURI in UISuite

2022-06-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17557749#comment-17557749 ] Apache Spark commented on SPARK-39563: -- User 'williamhyun' has created a pull request for this

[jira] [Assigned] (SPARK-39562) Make hive-thrift server module passes in IPv6 environment

2022-06-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39562: - Assignee: Dongjoon Hyun > Make hive-thrift server module passes in IPv6 environment >

[jira] [Assigned] (SPARK-39563) Use localHostNameForURI in UISuite

2022-06-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39563: Assignee: (was: Apache Spark) > Use localHostNameForURI in UISuite >

[jira] [Created] (SPARK-39563) Use localHostNameForURI in UISuite

2022-06-22 Thread William Hyun (Jira)
William Hyun created SPARK-39563: Summary: Use localHostNameForURI in UISuite Key: SPARK-39563 URL: https://issues.apache.org/jira/browse/SPARK-39563 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-39562) Make hive-thrift server module passes in IPv6 environment

2022-06-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17557736#comment-17557736 ] Apache Spark commented on SPARK-39562: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-39562) Make hive-thrift server module passes in IPv6 environment

2022-06-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17557735#comment-17557735 ] Apache Spark commented on SPARK-39562: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-39562) Make hive-thrift server module passes in IPv6 environment

2022-06-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39562: Assignee: Apache Spark > Make hive-thrift server module passes in IPv6 environment >

[jira] [Assigned] (SPARK-39562) Make hive-thrift server module passes in IPv6 environment

2022-06-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39562: Assignee: (was: Apache Spark) > Make hive-thrift server module passes in IPv6

[jira] [Assigned] (SPARK-39538) Convert CaseInsensitiveStringMap#logger to static

2022-06-22 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-39538: Assignee: Cheng Pan > Convert CaseInsensitiveStringMap#logger to static >

[jira] [Resolved] (SPARK-39538) Convert CaseInsensitiveStringMap#logger to static

2022-06-22 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39538. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36930

[jira] [Updated] (SPARK-39538) Convert CaseInsensitiveStringMap#logger to static

2022-06-22 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-39538: - Priority: Trivial (was: Major) > Convert CaseInsensitiveStringMap#logger to static >

[jira] [Assigned] (SPARK-39545) Override `concat` method for `ExpressionSet` in Scala 2.13 to improve the performance

2022-06-22 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-39545: Assignee: Yang Jie > Override `concat` method for `ExpressionSet` in Scala 2.13 to

[jira] [Resolved] (SPARK-39545) Override `concat` method for `ExpressionSet` in Scala 2.13 to improve the performance

2022-06-22 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39545. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36942

[jira] [Created] (SPARK-39562) Make hive-thrift server module passes in IPv6 environment

2022-06-22 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-39562: - Summary: Make hive-thrift server module passes in IPv6 environment Key: SPARK-39562 URL: https://issues.apache.org/jira/browse/SPARK-39562 Project: Spark

[jira] [Updated] (SPARK-39562) Make hive-thrift server module passes in IPv6 environment

2022-06-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39562: -- Component/s: Tests > Make hive-thrift server module passes in IPv6 environment >

[jira] [Assigned] (SPARK-39557) Support ARRAY, STRUCT, MAP types as DEFAULT values

2022-06-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39557: Assignee: (was: Apache Spark) > Support ARRAY, STRUCT, MAP types as DEFAULT values >

[jira] [Commented] (SPARK-39557) Support ARRAY, STRUCT, MAP types as DEFAULT values

2022-06-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17557722#comment-17557722 ] Apache Spark commented on SPARK-39557: -- User 'dtenedor' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39557) Support ARRAY, STRUCT, MAP types as DEFAULT values

2022-06-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39557: Assignee: Apache Spark > Support ARRAY, STRUCT, MAP types as DEFAULT values >

[jira] [Assigned] (SPARK-39559) Support IPv6 in WebUI

2022-06-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39559: - Assignee: Dongjoon Hyun > Support IPv6 in WebUI > - > >

[jira] [Resolved] (SPARK-39559) Support IPv6 in WebUI

2022-06-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39559. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36958

[jira] [Resolved] (SPARK-39561) Improve SparkContext to propagate `java.net.preferIPv6Addresses`

2022-06-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39561. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36959

[jira] [Assigned] (SPARK-39561) Improve SparkContext to propagate `java.net.preferIPv6Addresses`

2022-06-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39561: - Assignee: Dongjoon Hyun > Improve SparkContext to propagate

[jira] [Commented] (SPARK-38934) Provider TemporaryAWSCredentialsProvider has no credentials

2022-06-22 Thread Jason Sleight (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17557682#comment-17557682 ] Jason Sleight commented on SPARK-38934: --- After continuing to see some errors in a few edge cases

[jira] [Comment Edited] (SPARK-39560) Certain conditions raise error with when..otherwise but not with where

2022-06-22 Thread Kboh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17557672#comment-17557672 ] Kboh edited comment on SPARK-39560 at 6/22/22 8:10 PM: --- Closing, appears to be

[jira] [Commented] (SPARK-39561) Improve SparkContext to propagate `java.net.preferIPv6Addresses`

2022-06-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17557676#comment-17557676 ] Apache Spark commented on SPARK-39561: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-39561) Improve SparkContext to propagate `java.net.preferIPv6Addresses`

2022-06-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39561: Assignee: Apache Spark > Improve SparkContext to propagate

[jira] [Assigned] (SPARK-39561) Improve SparkContext to propagate `java.net.preferIPv6Addresses`

2022-06-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39561: Assignee: (was: Apache Spark) > Improve SparkContext to propagate

[jira] [Commented] (SPARK-39561) Improve SparkContext to propagate `java.net.preferIPv6Addresses`

2022-06-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17557675#comment-17557675 ] Apache Spark commented on SPARK-39561: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-39561) Improve SparkContext to propagate `java.net.preferIPv6Addresses`

2022-06-22 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-39561: - Summary: Improve SparkContext to propagate `java.net.preferIPv6Addresses` Key: SPARK-39561 URL: https://issues.apache.org/jira/browse/SPARK-39561 Project: Spark

[jira] [Commented] (SPARK-39560) Certain conditions raise error with when..otherwise but not with where

2022-06-22 Thread Kboh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17557672#comment-17557672 ] Kboh commented on SPARK-39560: -- Closing, appears to be related to Photon. Disabled Photon and it worked. >

[jira] [Resolved] (SPARK-39560) Certain conditions raise error with when..otherwise but not with where

2022-06-22 Thread Kboh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kboh resolved SPARK-39560. -- Resolution: Information Provided > Certain conditions raise error with when..otherwise but not with where >

[jira] [Updated] (SPARK-39560) Certain conditions raise error with when..otherwise but not with where

2022-06-22 Thread Kboh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kboh updated SPARK-39560: - Environment: DBR 11.0 Photon > Certain conditions raise error with when..otherwise but not with where >

[jira] [Updated] (SPARK-39560) Certain conditions raise error with when..otherwise but not with where

2022-06-22 Thread Kboh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kboh updated SPARK-39560: - Description: Please view the attachment. Certain conditions raise error with when..otherwise but not with

[jira] [Updated] (SPARK-39560) Certain conditions raise error with when..otherwise but not with where

2022-06-22 Thread Kboh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kboh updated SPARK-39560: - Attachment: spark_query_bug.png > Certain conditions raise error with when..otherwise but not with where >

[jira] [Created] (SPARK-39560) Certain conditions raise error with when..otherwise but not with where

2022-06-22 Thread Kboh (Jira)
Kboh created SPARK-39560: Summary: Certain conditions raise error with when..otherwise but not with where Key: SPARK-39560 URL: https://issues.apache.org/jira/browse/SPARK-39560 Project: Spark

[jira] [Assigned] (SPARK-39559) Support IPv6 in WebUI

2022-06-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39559: Assignee: Apache Spark > Support IPv6 in WebUI > - > >

[jira] [Commented] (SPARK-39559) Support IPv6 in WebUI

2022-06-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17557667#comment-17557667 ] Apache Spark commented on SPARK-39559: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-39559) Support IPv6 in WebUI

2022-06-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39559: Assignee: (was: Apache Spark) > Support IPv6 in WebUI > - > >

[jira] [Created] (SPARK-39559) Support IPv6 in WebUI

2022-06-22 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-39559: - Summary: Support IPv6 in WebUI Key: SPARK-39559 URL: https://issues.apache.org/jira/browse/SPARK-39559 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-39558) Store error message parameters as Map instead of Array

2022-06-22 Thread Serge Rielau (Jira)
Serge Rielau created SPARK-39558: Summary: Store error message parameters as Map instead of Array Key: SPARK-39558 URL: https://issues.apache.org/jira/browse/SPARK-39558 Project: Spark

[jira] [Created] (SPARK-39557) Support ARRAY, STRUCT, MAP types as DEFAULT values

2022-06-22 Thread Daniel (Jira)
Daniel created SPARK-39557: -- Summary: Support ARRAY, STRUCT, MAP types as DEFAULT values Key: SPARK-39557 URL: https://issues.apache.org/jira/browse/SPARK-39557 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-39549) How to get access to the data created in different Spark Applications

2022-06-22 Thread Chenyang Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17557577#comment-17557577 ] Chenyang Zhang commented on SPARK-39549: thanks! > How to get access to the data created in

[jira] [Updated] (SPARK-38687) Use error classes in the compilation errors of generators

2022-06-22 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38687: - Fix Version/s: 3.3.1 > Use error classes in the compilation errors of generators >

[jira] [Commented] (SPARK-38292) Support `na_filter` for pyspark.pandas.read_csv

2022-06-22 Thread pralabhkumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17557537#comment-17557537 ] pralabhkumar commented on SPARK-38292: -- [~hyukjin.kwon] Thx for the suggestion .    After going

[jira] [Assigned] (SPARK-39529) Refactor and merge all related job selection logic into precondition

2022-06-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39529: - Assignee: Hyukjin Kwon > Refactor and merge all related job selection logic into

[jira] [Resolved] (SPARK-39529) Refactor and merge all related job selection logic into precondition

2022-06-22 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39529. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36940

[jira] [Updated] (SPARK-39340) DS v2 agg pushdown should allow dots in the name of top-level columns

2022-06-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-39340: Fix Version/s: 3.4.0 3.3.1 > DS v2 agg pushdown should allow dots in the name

[jira] [Assigned] (SPARK-39551) Add AQE invalid plan check

2022-06-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39551: --- Assignee: Wei Xue > Add AQE invalid plan check > -- > >

[jira] [Resolved] (SPARK-39551) Add AQE invalid plan check

2022-06-22 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39551. - Fix Version/s: 3.3.1 3.4.0 Resolution: Fixed Issue resolved by pull

[jira] [Commented] (SPARK-33436) PySpark equivalent of SparkContext.hadoopConfiguration

2022-06-22 Thread j g (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17557480#comment-17557480 ] j g commented on SPARK-33436: - [~hyukjin.kwon] same question as above.   > PySpark equivalent of

[jira] [Resolved] (SPARK-39556) Propagate empty relation if maxRows is 0

2022-06-22 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-39556. - Resolution: Not A Problem It already supported through OptimizeLimitZero and 

[jira] (SPARK-39527) V2Catalog rename not support newIdent with catalog

2022-06-22 Thread panbingkun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39527 ] panbingkun deleted comment on SPARK-39527: was (Author: panbingkun): I working on it! > V2Catalog rename not support newIdent with catalog >

[jira] [Created] (SPARK-39556) Propagate empty relation if maxRows is 0

2022-06-22 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-39556: --- Summary: Propagate empty relation if maxRows is 0 Key: SPARK-39556 URL: https://issues.apache.org/jira/browse/SPARK-39556 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-39533) Deprecate scoreLabelsWeight in BinaryClassificationMetrics

2022-06-22 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-39533: Assignee: zhengruifeng > Deprecate scoreLabelsWeight in BinaryClassificationMetrics >

[jira] [Resolved] (SPARK-39533) Deprecate scoreLabelsWeight in BinaryClassificationMetrics

2022-06-22 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39533. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36926

[jira] [Assigned] (SPARK-39555) Make createTable and listTables in the python side support 3-layer-namespace

2022-06-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39555: Assignee: Apache Spark > Make createTable and listTables in the python side support

[jira] [Commented] (SPARK-39555) Make createTable and listTables in the python side support 3-layer-namespace

2022-06-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17557431#comment-17557431 ] Apache Spark commented on SPARK-39555: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-39555) Make createTable and listTables in the python side support 3-layer-namespace

2022-06-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39555: Assignee: (was: Apache Spark) > Make createTable and listTables in the python side

[jira] [Updated] (SPARK-39555) Make createTable and listTables in the python side support 3-layer-namespace

2022-06-22 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-39555: - Description: Corresponding changes in the python side of SPARK-39236 (Make CreateTable API and

[jira] [Created] (SPARK-39555) Make createTable and listTables in the python side support 3-layer-namespace

2022-06-22 Thread zhengruifeng (Jira)
zhengruifeng created SPARK-39555: Summary: Make createTable and listTables in the python side support 3-layer-namespace Key: SPARK-39555 URL: https://issues.apache.org/jira/browse/SPARK-39555

[jira] [Updated] (SPARK-39555) Make createTable and listTables in the python side support 3-layer-namespace

2022-06-22 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-39555: - Description: Corresponding changes in the python side to make > Make createTable and

[jira] [Assigned] (SPARK-39527) V2Catalog rename not support newIdent with catalog

2022-06-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39527: Assignee: (was: Apache Spark) > V2Catalog rename not support newIdent with catalog >

[jira] [Commented] (SPARK-39527) V2Catalog rename not support newIdent with catalog

2022-06-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17557418#comment-17557418 ] Apache Spark commented on SPARK-39527: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-39527) V2Catalog rename not support newIdent with catalog

2022-06-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39527: Assignee: Apache Spark > V2Catalog rename not support newIdent with catalog >

[jira] [Commented] (SPARK-39527) V2Catalog rename not support newIdent with catalog

2022-06-22 Thread panbingkun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17557393#comment-17557393 ] panbingkun commented on SPARK-39527: I working on it! > V2Catalog rename not support newIdent with

[jira] [Assigned] (SPARK-39519) Test failure in SPARK-39387 with JDK 11

2022-06-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39519: Assignee: Apache Spark (was: Yang Jie) > Test failure in SPARK-39387 with JDK 11 >

[jira] [Assigned] (SPARK-39519) Test failure in SPARK-39387 with JDK 11

2022-06-22 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39519: Assignee: Yang Jie (was: Apache Spark) > Test failure in SPARK-39387 with JDK 11 >

[jira] [Assigned] (SPARK-39523) JDBCV2Suite fails with Scala 2.13

2022-06-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39523: Assignee: Bruce Robbins > JDBCV2Suite fails with Scala 2.13 >

[jira] [Reopened] (SPARK-39519) Test failure in SPARK-39387 with JDK 11

2022-06-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-39519: -- > Test failure in SPARK-39387 with JDK 11 > --- > >

[jira] [Assigned] (SPARK-39525) AdaptiveQueryExecSuite fails with Scala 2.13

2022-06-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39525: Assignee: Bruce Robbins > AdaptiveQueryExecSuite fails with Scala 2.13 >

[jira] [Assigned] (SPARK-39518) Plan stability test is broken with Scala 2.13

2022-06-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39518: Assignee: Bruce Robbins > Plan stability test is broken with Scala 2.13 >

[jira] [Assigned] (SPARK-39524) GeneratorFunctionSuite fails with Scala 2.13

2022-06-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39524: Assignee: Bruce Robbins > GeneratorFunctionSuite fails with Scala 2.13 >

[jira] [Updated] (SPARK-39554) insertIntoHive ExternalTmpPath won't be clear when the app being killed

2022-06-22 Thread GuangkunJiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GuangkunJiang updated SPARK-39554: -- External issue ID: https://issues.apache.org/jira/browse/SPARK-22642 (was: spark-22642) >

  1   2   >