[jira] [Updated] (SPARK-39889) Use different error classes for numeric/interval divided by 0

2022-07-26 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-39889: --- Summary: Use different error classes for numeric/interval divided by 0 (was: Use a new

[jira] [Commented] (SPARK-39832) regexp_replace should support column arguments

2022-07-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571748#comment-17571748 ] Hyukjin Kwon commented on SPARK-39832: -- Yeah, are you interested in submitting a PR? >

[jira] [Created] (SPARK-39890) Make TakeOrderedAndProjectExec inherit AliasAwareOutputOrdering

2022-07-26 Thread XiDuo You (Jira)
XiDuo You created SPARK-39890: - Summary: Make TakeOrderedAndProjectExec inherit AliasAwareOutputOrdering Key: SPARK-39890 URL: https://issues.apache.org/jira/browse/SPARK-39890 Project: Spark

[jira] [Created] (SPARK-39889) Use a new error class for "Interval divided by 0" instead of using "DIVIDE_BY_ZERO"

2022-07-26 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-39889: -- Summary: Use a new error class for "Interval divided by 0" instead of using "DIVIDE_BY_ZERO" Key: SPARK-39889 URL: https://issues.apache.org/jira/browse/SPARK-39889

[jira] [Updated] (SPARK-39866) Memory leak when closing a session of Spark Thrift Server

2022-07-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-39866: - Priority: Major (was: Critical) > Memory leak when closing a session of Spark Thrift Server >

[jira] [Updated] (SPARK-39845) 0.0 and -0.0 are not consistent in set operations

2022-07-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-39845: - Priority: Major (was: Critical) > 0.0 and -0.0 are not consistent in set operations >

[jira] [Updated] (SPARK-39887) Expression transform error

2022-07-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-39887: - Component/s: SQL (was: Optimizer) > Expression transform error >

[jira] [Resolved] (SPARK-39864) ExecutionListenerManager's registration of the ExecutionListenerBus should be lazy

2022-07-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39864. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37282

[jira] [Assigned] (SPARK-39868) StageFailed event should attach with the root cause

2022-07-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39868: Assignee: BingKun Pan > StageFailed event should attach with the root cause >

[jira] [Resolved] (SPARK-39868) StageFailed event should attach with the root cause

2022-07-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39868. -- Resolution: Fixed Issue resolved by pull request 37292

[jira] [Assigned] (SPARK-39882) Upgrade rocksdbjni to 7.4.3

2022-07-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39882: - Assignee: Yang Jie > Upgrade rocksdbjni to 7.4.3 > --- > >

[jira] [Resolved] (SPARK-39882) Upgrade rocksdbjni to 7.4.3

2022-07-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39882. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37302

[jira] [Assigned] (SPARK-39888) Fix scala code style in SecurityManagerSuite

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39888: Assignee: (was: Apache Spark) > Fix scala code style in SecurityManagerSuite >

[jira] [Assigned] (SPARK-39888) Fix scala code style in SecurityManagerSuite

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39888: Assignee: Apache Spark > Fix scala code style in SecurityManagerSuite >

[jira] [Created] (SPARK-39888) Fix scala code style in SecurityManagerSuite

2022-07-26 Thread xiaoping.huang (Jira)
xiaoping.huang created SPARK-39888: -- Summary: Fix scala code style in SecurityManagerSuite Key: SPARK-39888 URL: https://issues.apache.org/jira/browse/SPARK-39888 Project: Spark Issue Type:

[jira] [Commented] (SPARK-39865) Show proper error messages on the overflow errors of table insert

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571724#comment-17571724 ] Apache Spark commented on SPARK-39865: -- User 'gengliangwang' has created a pull request for this

[jira] [Resolved] (SPARK-39886) Disable DEFAULT column SQLConf until implementation is complete

2022-07-26 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel resolved SPARK-39886. Fix Version/s: 3.3.0 Resolution: Not A Problem It turns out that the Spark 3.3 release does not

[jira] [Assigned] (SPARK-39886) Disable DEFAULT column SQLConf until implementation is complete

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39886: Assignee: Apache Spark > Disable DEFAULT column SQLConf until implementation is complete

[jira] [Assigned] (SPARK-39886) Disable DEFAULT column SQLConf until implementation is complete

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39886: Assignee: (was: Apache Spark) > Disable DEFAULT column SQLConf until implementation

[jira] [Commented] (SPARK-39886) Disable DEFAULT column SQLConf until implementation is complete

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571700#comment-17571700 ] Apache Spark commented on SPARK-39886: -- User 'dtenedor' has created a pull request for this issue:

[jira] [Created] (SPARK-39887) Expression transform error

2022-07-26 Thread zhuml (Jira)
zhuml created SPARK-39887: - Summary: Expression transform error Key: SPARK-39887 URL: https://issues.apache.org/jira/browse/SPARK-39887 Project: Spark Issue Type: Bug Components: Optimizer

[jira] [Created] (SPARK-39886) Disable DEFAULT column SQLConf until implementation is complete

2022-07-26 Thread Daniel (Jira)
Daniel created SPARK-39886: -- Summary: Disable DEFAULT column SQLConf until implementation is complete Key: SPARK-39886 URL: https://issues.apache.org/jira/browse/SPARK-39886 Project: Spark Issue

[jira] [Updated] (SPARK-39457) Support IPv6-only environment

2022-07-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39457: -- Description: Spark doesn't fully work in pure IPV6 environment that doesn't have IPV4 at

[jira] [Updated] (SPARK-39457) Support IPv6-only environment

2022-07-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39457: -- Description: Spark doesn't fully work in pure IPV6 environment that doesn't have IPV4 at

[jira] [Updated] (SPARK-39457) Support IPv6-only environment

2022-07-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39457: -- Description: Spark doesn't fully work in pure IPV6 environment that doesn't have IPV4 at

[jira] [Resolved] (SPARK-39457) Support IPv6-only environment

2022-07-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39457. --- Fix Version/s: 3.4.0 Resolution: Fixed > Support IPv6-only environment >

[jira] [Assigned] (SPARK-39875) The method in final class should not declare as protected

2022-07-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-39875: Assignee: Yang Jie > The method in final class should not declare as protected >

[jira] [Resolved] (SPARK-39875) The method in final class should not declare as protected

2022-07-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39875. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37296

[jira] [Updated] (SPARK-39875) The method in final class should not declare as protected

2022-07-26 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-39875: - Priority: Trivial (was: Minor) > The method in final class should not declare as protected >

[jira] [Commented] (SPARK-39871) [SparkHistoryServer] Rewrite JMXJsonServlet to work with the current version of Spark

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571688#comment-17571688 ] Apache Spark commented on SPARK-39871: -- User 'Hwloser' has created a pull request for this issue:

[jira] [Commented] (SPARK-39871) [SparkHistoryServer] Rewrite JMXJsonServlet to work with the current version of Spark

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571687#comment-17571687 ] Apache Spark commented on SPARK-39871: -- User 'Hwloser' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39870) Add flag to run-tests.py to retain the test output.

2022-07-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39870: Assignee: Martin Grund > Add flag to run-tests.py to retain the test output. >

[jira] [Resolved] (SPARK-39870) Add flag to run-tests.py to retain the test output.

2022-07-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39870. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37288

[jira] [Resolved] (SPARK-39879) Reduce local-cluster memory configuration in BroadcastJoinSuite* and HiveSparkSubmitSuite

2022-07-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39879. -- Fix Version/s: 3.0.4 3.1.4 3.4.0

[jira] [Assigned] (SPARK-39823) add DataFrame.as(StructType) in PySpark

2022-07-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-39823: - Assignee: Ruifeng Zheng > add DataFrame.as(StructType) in PySpark >

[jira] [Resolved] (SPARK-39823) add DataFrame.as(StructType) in PySpark

2022-07-26 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-39823. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37233

[jira] [Resolved] (SPARK-39884) KubernetesExecutorBackend should handle IPv6 hostname

2022-07-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39884. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37306

[jira] [Assigned] (SPARK-39884) KubernetesExecutorBackend should handle IPv6 hostname

2022-07-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39884: - Assignee: Dongjoon Hyun > KubernetesExecutorBackend should handle IPv6 hostname >

[jira] [Commented] (SPARK-37287) Pull out dynamic partition and bucket sort from FileFormatWriter

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571645#comment-17571645 ] Apache Spark commented on SPARK-37287: -- User 'allisonwang-db' has created a pull request for this

[jira] [Commented] (SPARK-37287) Pull out dynamic partition and bucket sort from FileFormatWriter

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571646#comment-17571646 ] Apache Spark commented on SPARK-37287: -- User 'allisonwang-db' has created a pull request for this

[jira] [Updated] (SPARK-39885) Behavior differs between array_overlap and array_contains for negative 0.0

2022-07-26 Thread David Vogelbacher (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Vogelbacher updated SPARK-39885: -- Description: {{array_contains([0.0], -0.0)}} will return true.

[jira] [Updated] (SPARK-39885) Behavior differs between array_overlap and array_contains for negative 0.0

2022-07-26 Thread David Vogelbacher (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Vogelbacher updated SPARK-39885: -- Description: {{array_contains([0.0], -0.0)}} will return true.

[jira] [Created] (SPARK-39885) Behavior differs between array_overlap and array_contains for negative 0.0

2022-07-26 Thread David Vogelbacher (Jira)
David Vogelbacher created SPARK-39885: - Summary: Behavior differs between array_overlap and array_contains for negative 0.0 Key: SPARK-39885 URL: https://issues.apache.org/jira/browse/SPARK-39885

[jira] [Commented] (SPARK-39319) Make query context as part of SparkThrowable

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571638#comment-17571638 ] Apache Spark commented on SPARK-39319: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-39319) Make query context as part of SparkThrowable

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571637#comment-17571637 ] Apache Spark commented on SPARK-39319: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-39884) KubernetesExecutorBackend should handle IPv6 hostname

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39884: Assignee: (was: Apache Spark) > KubernetesExecutorBackend should handle IPv6

[jira] [Assigned] (SPARK-39884) KubernetesExecutorBackend should handle IPv6 hostname

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39884: Assignee: Apache Spark > KubernetesExecutorBackend should handle IPv6 hostname >

[jira] [Commented] (SPARK-39884) KubernetesExecutorBackend should handle IPv6 hostname

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571627#comment-17571627 ] Apache Spark commented on SPARK-39884: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-39884) KubernetesExecutorBackend should handle IPv6 hostname

2022-07-26 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-39884: - Summary: KubernetesExecutorBackend should handle IPv6 hostname Key: SPARK-39884 URL: https://issues.apache.org/jira/browse/SPARK-39884 Project: Spark

[jira] [Assigned] (SPARK-39881) Python Lint does not actually check for `black` formatter

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39881: Assignee: Apache Spark > Python Lint does not actually check for `black` formatter >

[jira] [Commented] (SPARK-39881) Python Lint does not actually check for `black` formatter

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571600#comment-17571600 ] Apache Spark commented on SPARK-39881: -- User 'grundprinzip' has created a pull request for this

[jira] [Assigned] (SPARK-39881) Python Lint does not actually check for `black` formatter

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39881: Assignee: (was: Apache Spark) > Python Lint does not actually check for `black`

[jira] [Assigned] (SPARK-39877) Unpivot / melt function for PySpark

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39877: Assignee: (was: Apache Spark) > Unpivot / melt function for PySpark >

[jira] [Assigned] (SPARK-39877) Unpivot / melt function for PySpark

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39877: Assignee: Apache Spark > Unpivot / melt function for PySpark >

[jira] [Commented] (SPARK-39877) Unpivot / melt function for PySpark

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571595#comment-17571595 ] Apache Spark commented on SPARK-39877: -- User 'EnricoMi' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39883) Add DataFrame function parity check

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39883: Assignee: (was: Apache Spark) > Add DataFrame function parity check >

[jira] [Commented] (SPARK-39883) Add DataFrame function parity check

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571591#comment-17571591 ] Apache Spark commented on SPARK-39883: -- User 'aray' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39883) Add DataFrame function parity check

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39883: Assignee: Apache Spark > Add DataFrame function parity check >

[jira] [Created] (SPARK-39883) Add DataFrame function parity check

2022-07-26 Thread Andrew Ray (Jira)
Andrew Ray created SPARK-39883: -- Summary: Add DataFrame function parity check Key: SPARK-39883 URL: https://issues.apache.org/jira/browse/SPARK-39883 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-39457) Support IPv6-only environment

2022-07-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39457: - Assignee: Dongjoon Hyun > Support IPv6-only environment >

[jira] [Assigned] (SPARK-39882) Upgrade rocksdbjni to 7.4.3

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39882: Assignee: (was: Apache Spark) > Upgrade rocksdbjni to 7.4.3 >

[jira] [Assigned] (SPARK-39882) Upgrade rocksdbjni to 7.4.3

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39882: Assignee: Apache Spark > Upgrade rocksdbjni to 7.4.3 > --- > >

[jira] [Commented] (SPARK-39882) Upgrade rocksdbjni to 7.4.3

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571554#comment-17571554 ] Apache Spark commented on SPARK-39882: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-39882) Upgrade rocksdbjni to 7.4.3

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571555#comment-17571555 ] Apache Spark commented on SPARK-39882: -- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-39882) Upgrade rocksdbjni to 7.4.3

2022-07-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-39882: Summary: Upgrade rocksdbjni to 7.4.3 Key: SPARK-39882 URL: https://issues.apache.org/jira/browse/SPARK-39882 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-39881) Python Lint does not actually check for `black` formatter

2022-07-26 Thread Martin Grund (Jira)
Martin Grund created SPARK-39881: Summary: Python Lint does not actually check for `black` formatter Key: SPARK-39881 URL: https://issues.apache.org/jira/browse/SPARK-39881 Project: Spark

[jira] [Commented] (SPARK-39880) V2 SHOW FUNCTIONS command should print qualified function name like v1

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571504#comment-17571504 ] Apache Spark commented on SPARK-39880: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39880) V2 SHOW FUNCTIONS command should print qualified function name like v1

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39880: Assignee: (was: Apache Spark) > V2 SHOW FUNCTIONS command should print qualified

[jira] [Commented] (SPARK-39880) V2 SHOW FUNCTIONS command should print qualified function name like v1

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571503#comment-17571503 ] Apache Spark commented on SPARK-39880: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39880) V2 SHOW FUNCTIONS command should print qualified function name like v1

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39880: Assignee: Apache Spark > V2 SHOW FUNCTIONS command should print qualified function name

[jira] [Created] (SPARK-39880) V2 SHOW FUNCTIONS command should print qualified function name like v1

2022-07-26 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-39880: --- Summary: V2 SHOW FUNCTIONS command should print qualified function name like v1 Key: SPARK-39880 URL: https://issues.apache.org/jira/browse/SPARK-39880 Project: Spark

[jira] [Assigned] (SPARK-39319) Make query context as part of SparkThrowable

2022-07-26 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-39319: Assignee: Max Gekk (was: Gengliang Wang) > Make query context as part of SparkThrowable >

[jira] [Resolved] (SPARK-39319) Make query context as part of SparkThrowable

2022-07-26 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-39319. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37209

[jira] [Commented] (SPARK-39871) [SparkHistoryServer] Rewrite JMXJsonServlet to work with the current version of Spark

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571493#comment-17571493 ] Apache Spark commented on SPARK-39871: -- User 'Hwloser' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39871) [SparkHistoryServer] Rewrite JMXJsonServlet to work with the current version of Spark

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39871: Assignee: Apache Spark > [SparkHistoryServer] Rewrite JMXJsonServlet to work with the

[jira] [Commented] (SPARK-39871) [SparkHistoryServer] Rewrite JMXJsonServlet to work with the current version of Spark

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571492#comment-17571492 ] Apache Spark commented on SPARK-39871: -- User 'Hwloser' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39871) [SparkHistoryServer] Rewrite JMXJsonServlet to work with the current version of Spark

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39871: Assignee: (was: Apache Spark) > [SparkHistoryServer] Rewrite JMXJsonServlet to work

[jira] [Commented] (SPARK-39500) Ivy doesn't work correctly on IPv6-only environment

2022-07-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571488#comment-17571488 ] Dongjoon Hyun commented on SPARK-39500: --- For a record, we need the following to use the official

[jira] [Commented] (SPARK-37888) Unify v1 and v2 DESCRIBE TABLE tests

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571482#comment-17571482 ] Apache Spark commented on SPARK-37888: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-37888) Unify v1 and v2 DESCRIBE TABLE tests

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571480#comment-17571480 ] Apache Spark commented on SPARK-37888: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39879) Reduce local-cluster memory configuration in BroadcastJoinSuite* and HiveSparkSubmitSuite

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39879: Assignee: (was: Apache Spark) > Reduce local-cluster memory configuration in

[jira] [Commented] (SPARK-39879) Reduce local-cluster memory configuration in BroadcastJoinSuite* and HiveSparkSubmitSuite

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571468#comment-17571468 ] Apache Spark commented on SPARK-39879: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-39879) Reduce local-cluster memory configuration in BroadcastJoinSuite* and HiveSparkSubmitSuite

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39879: Assignee: Apache Spark > Reduce local-cluster memory configuration in

[jira] [Created] (SPARK-39879) Reduce local-cluster memory configuration in BroadcastJoinSuite* and HiveSparkSubmitSuite

2022-07-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-39879: Summary: Reduce local-cluster memory configuration in BroadcastJoinSuite* and HiveSparkSubmitSuite Key: SPARK-39879 URL: https://issues.apache.org/jira/browse/SPARK-39879

[jira] [Resolved] (SPARK-39874) Deflake BroadcastJoinSuite*

2022-07-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39874. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37297

[jira] [Assigned] (SPARK-39874) Deflake BroadcastJoinSuite*

2022-07-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39874: Assignee: Hyukjin Kwon > Deflake BroadcastJoinSuite* > --- > >

[jira] [Created] (SPARK-39878) Migrate melt function in Pandas API to PySpark / Scala unpivot

2022-07-26 Thread Enrico Minack (Jira)
Enrico Minack created SPARK-39878: - Summary: Migrate melt function in Pandas API to PySpark / Scala unpivot Key: SPARK-39878 URL: https://issues.apache.org/jira/browse/SPARK-39878 Project: Spark

[jira] [Created] (SPARK-39877) Unpivot / melt function for PySpark

2022-07-26 Thread Enrico Minack (Jira)
Enrico Minack created SPARK-39877: - Summary: Unpivot / melt function for PySpark Key: SPARK-39877 URL: https://issues.apache.org/jira/browse/SPARK-39877 Project: Spark Issue Type: New

[jira] [Created] (SPARK-39876) Unpivot / melt function for SQL

2022-07-26 Thread Enrico Minack (Jira)
Enrico Minack created SPARK-39876: - Summary: Unpivot / melt function for SQL Key: SPARK-39876 URL: https://issues.apache.org/jira/browse/SPARK-39876 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-39874) Deflake BroadcastJoinSuite*

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571409#comment-17571409 ] Apache Spark commented on SPARK-39874: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-39874) Deflake BroadcastJoinSuite*

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39874: Assignee: Apache Spark > Deflake BroadcastJoinSuite* > --- > >

[jira] [Assigned] (SPARK-39874) Deflake BroadcastJoinSuite*

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39874: Assignee: (was: Apache Spark) > Deflake BroadcastJoinSuite* >

[jira] [Commented] (SPARK-39874) Deflake BroadcastJoinSuite*

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571408#comment-17571408 ] Apache Spark commented on SPARK-39874: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Updated] (SPARK-38864) Unpivot / melt function for Dataset API

2022-07-26 Thread Enrico Minack (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enrico Minack updated SPARK-38864: -- Summary: Unpivot / melt function for Dataset API (was: Melt function for Dataset API) >

[jira] [Assigned] (SPARK-39875) The method in final class should not declare as protected

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39875: Assignee: (was: Apache Spark) > The method in final class should not declare as

[jira] [Assigned] (SPARK-39875) The method in final class should not declare as protected

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39875: Assignee: Apache Spark > The method in final class should not declare as protected >

[jira] [Commented] (SPARK-39875) The method in final class should not declare as protected

2022-07-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571405#comment-17571405 ] Apache Spark commented on SPARK-39875: -- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-39875) The method in final class should not declare as protected

2022-07-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-39875: Summary: The method in final class should not declare as protected Key: SPARK-39875 URL: https://issues.apache.org/jira/browse/SPARK-39875 Project: Spark Issue

[jira] [Created] (SPARK-39874) Deflake BroadcastJoinSuite*

2022-07-26 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-39874: Summary: Deflake BroadcastJoinSuite* Key: SPARK-39874 URL: https://issues.apache.org/jira/browse/SPARK-39874 Project: Spark Issue Type: Test

[jira] [Commented] (SPARK-26664) Make DecimalType's minimum adjusted scale configurable

2022-07-26 Thread Ines Hiverlet (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17571394#comment-17571394 ] Ines Hiverlet commented on SPARK-26664: --- Hello, are there any news regarding this issue ? Because

  1   2   >