[jira] [Updated] (SPARK-44759) Do not combine multiple Generate operators in the same WholeStageCodeGen node because it can easily cause OOM failures if arrays are relatively large

2023-08-12 Thread Franck Tago (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Franck Tago updated SPARK-44759: Component/s: Deploy Spark Core > Do not combine multiple Generate operators in th

[jira] [Created] (SPARK-44793) WholeStageCodeGen pipelineTime metric incorrect result.

2023-08-12 Thread Abhishek Modi (Jira)
Abhishek Modi created SPARK-44793: - Summary: WholeStageCodeGen pipelineTime metric incorrect result. Key: SPARK-44793 URL: https://issues.apache.org/jira/browse/SPARK-44793 Project: Spark Iss

[jira] [Commented] (SPARK-44792) Upgrade curator to 5.2.0

2023-08-12 Thread Snoot.io (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17753654#comment-17753654 ] Snoot.io commented on SPARK-44792: -- User 'wangyum' has created a pull request for this

[jira] [Updated] (SPARK-44792) Upgrade curator to 5.2.0

2023-08-12 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44792: Description: https://issues.apache.org/jira/browse/HADOOP-17612 https://issues.apache.org/jira/bro

[jira] [Updated] (SPARK-44792) Upgrade curator to 5.2.0

2023-08-12 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44792: Description: https://issues.apache.org/jira/browse/HADOOP-17612 > Upgrade curator to 5.2.0 > -

[jira] [Created] (SPARK-44792) Upgrade curator to 5.2.0

2023-08-12 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-44792: --- Summary: Upgrade curator to 5.2.0 Key: SPARK-44792 URL: https://issues.apache.org/jira/browse/SPARK-44792 Project: Spark Issue Type: Improvement Comp

[jira] [Commented] (SPARK-44162) Support G1GC in `spark.eventLog.gcMetrics.*` without warning

2023-08-12 Thread Snoot.io (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17753651#comment-17753651 ] Snoot.io commented on SPARK-44162: -- User 'Hisoka-X' has created a pull request for this

[jira] [Updated] (SPARK-44791) Make ArrowDeserializer work with REPL generated classes

2023-08-12 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-44791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell updated SPARK-44791: -- Priority: Blocker (was: Major) > Make ArrowDeserializer work with REPL generated clas

[jira] [Updated] (SPARK-44791) Make ArrowDeserializer work with REPL generated classes

2023-08-12 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-44791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell updated SPARK-44791: -- Issue Type: Bug (was: New Feature) > Make ArrowDeserializer work with REPL generated

[jira] [Created] (SPARK-44791) Make ArrowDeserializer work with REPL generated classes

2023-08-12 Thread Jira
Herman van Hövell created SPARK-44791: - Summary: Make ArrowDeserializer work with REPL generated classes Key: SPARK-44791 URL: https://issues.apache.org/jira/browse/SPARK-44791 Project: Spark

[jira] [Created] (SPARK-44790) XML: to_xml

2023-08-12 Thread Sandip Agarwala (Jira)
Sandip Agarwala created SPARK-44790: --- Summary: XML: to_xml Key: SPARK-44790 URL: https://issues.apache.org/jira/browse/SPARK-44790 Project: Spark Issue Type: Sub-task Components:

[jira] [Created] (SPARK-44789) XML: Spark connect support

2023-08-12 Thread Sandip Agarwala (Jira)
Sandip Agarwala created SPARK-44789: --- Summary: XML: Spark connect support Key: SPARK-44789 URL: https://issues.apache.org/jira/browse/SPARK-44789 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-44788) XML: Add pyspark.sql.functions

2023-08-12 Thread Sandip Agarwala (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandip Agarwala updated SPARK-44788: Summary: XML: Add pyspark.sql.functions (was: XML Add pyspark.sql.functions) > XML: Add

[jira] [Created] (SPARK-44788) XML Add pyspark.sql.functions

2023-08-12 Thread Sandip Agarwala (Jira)
Sandip Agarwala created SPARK-44788: --- Summary: XML Add pyspark.sql.functions Key: SPARK-44788 URL: https://issues.apache.org/jira/browse/SPARK-44788 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-44787) XML: Add SQL Expressions

2023-08-12 Thread Sandip Agarwala (Jira)
Sandip Agarwala created SPARK-44787: --- Summary: XML: Add SQL Expressions Key: SPARK-44787 URL: https://issues.apache.org/jira/browse/SPARK-44787 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-44786) Convert common Spark exceptions

2023-08-12 Thread Yihong He (Jira)
Yihong He created SPARK-44786: - Summary: Convert common Spark exceptions Key: SPARK-44786 URL: https://issues.apache.org/jira/browse/SPARK-44786 Project: Spark Issue Type: New Feature C

[jira] [Created] (SPARK-44785) Convert common alreadyExistsExceptions and noSuchExceptions

2023-08-12 Thread Yihong He (Jira)
Yihong He created SPARK-44785: - Summary: Convert common alreadyExistsExceptions and noSuchExceptions Key: SPARK-44785 URL: https://issues.apache.org/jira/browse/SPARK-44785 Project: Spark Issue

[jira] [Commented] (SPARK-44447) Use PartitionEvaluator API in FlatMapGroupsInPandasExec, FlatMapCoGroupsInPandasExec

2023-08-12 Thread GridGain Integration (Jira)
[ https://issues.apache.org/jira/browse/SPARK-7?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17753564#comment-17753564 ] GridGain Integration commented on SPARK-7: -- User 'vinodkc' has created

[jira] [Commented] (SPARK-44305) Broadcast operation is not required when no parameters are specified

2023-08-12 Thread GridGain Integration (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17753565#comment-17753565 ] GridGain Integration commented on SPARK-44305: -- User '7mming7' has created

[jira] [Commented] (SPARK-44407) Prohibit using `enum` as a variable or function name

2023-08-12 Thread GridGain Integration (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17753563#comment-17753563 ] GridGain Integration commented on SPARK-44407: -- User 'LuciferYang' has crea

[jira] [Created] (SPARK-44784) Failure in testing `SparkSessionE2ESuite` using Maven

2023-08-12 Thread Yang Jie (Jira)
Yang Jie created SPARK-44784: Summary: Failure in testing `SparkSessionE2ESuite` using Maven Key: SPARK-44784 URL: https://issues.apache.org/jira/browse/SPARK-44784 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-44783) Test arrays as parameters

2023-08-12 Thread Max Gekk (Jira)
Max Gekk created SPARK-44783: Summary: Test arrays as parameters Key: SPARK-44783 URL: https://issues.apache.org/jira/browse/SPARK-44783 Project: Spark Issue Type: Test Components: SQL

[jira] [Created] (SPARK-44782) Adjust Pull Request Template to incorporate the ASF Generative Tooling Guidance recommendations

2023-08-12 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-44782: -- Summary: Adjust Pull Request Template to incorporate the ASF Generative Tooling Guidance recommendations Key: SPARK-44782 URL: https://issues.apache.org/jira/browse/SP

[jira] [Commented] (SPARK-44749) Support named arguments in Python UDTF

2023-08-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17753492#comment-17753492 ] ASF GitHub Bot commented on SPARK-44749: User 'ueshin' has created a pull reques

[jira] [Commented] (SPARK-44749) Support named arguments in Python UDTF

2023-08-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17753491#comment-17753491 ] ASF GitHub Bot commented on SPARK-44749: User 'ueshin' has created a pull reques

[jira] [Assigned] (SPARK-44404) Assign names to the error class _LEGACY_ERROR_TEMP_[1009,1010,1013,1015,1016,1278]

2023-08-12 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-44404: Assignee: BingKun Pan > Assign names to the error class > _LEGACY_ERROR_TEMP_[1009,1010,1013,101

[jira] [Resolved] (SPARK-44404) Assign names to the error class _LEGACY_ERROR_TEMP_[1009,1010,1013,1015,1016,1278]

2023-08-12 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-44404. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42109 [https://github.com

[jira] [Commented] (SPARK-37487) CollectMetrics is executed twice if it is followed by a sort

2023-08-12 Thread Huw (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17753471#comment-17753471 ] Huw commented on SPARK-37487: - I think I've seen crashes because of this in production. I c