[jira] [Commented] (SPARK-42508) Extract the common .ml classes to `mllib-common`

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703503#comment-17703503 ] Apache Spark commented on SPARK-42508: -- User 'zhengruifeng' has created a pull requ

[jira] [Resolved] (SPARK-40082) DAGScheduler may not schduler new stage in condition of push-based shuffle enabled

2023-03-21 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-40082. - Fix Version/s: 3.5.0 Assignee: Fencheng Mei Resolution: Fixed >

[jira] [Assigned] (SPARK-42894) Implement cache, persist, unpersist, and storageLevel

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42894: Assignee: Apache Spark > Implement cache, persist, unpersist, and storageLevel >

[jira] [Assigned] (SPARK-42894) Implement cache, persist, unpersist, and storageLevel

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42894: Assignee: (was: Apache Spark) > Implement cache, persist, unpersist, and storageLevel

[jira] [Commented] (SPARK-42894) Implement cache, persist, unpersist, and storageLevel

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703493#comment-17703493 ] Apache Spark commented on SPARK-42894: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-42894) Implement cache, persist, unpersist, and storageLevel

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703492#comment-17703492 ] Apache Spark commented on SPARK-42894: -- User 'LuciferYang' has created a pull reque

[jira] [Resolved] (SPARK-42880) Improve the yarn document for lo4j2 configuration

2023-03-21 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-42880. -- Fix Version/s: 3.5.0 Assignee: Zhifang Li Resolution: Fixed Resolved by https:

[jira] [Updated] (SPARK-42880) Improve the yarn document for lo4j2 configuration

2023-03-21 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-42880: - Component/s: Documentation > Improve the yarn document for lo4j2 configuration > ---

[jira] [Updated] (SPARK-42880) Improve the yarn document for lo4j2 configuration

2023-03-21 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-42880: - Priority: Trivial (was: Minor) > Improve the yarn document for lo4j2 configuration > --

[jira] [Assigned] (SPARK-42052) Codegen Support for HiveSimpleUDF

2023-03-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42052: --- Assignee: BingKun Pan > Codegen Support for HiveSimpleUDF > ---

[jira] [Resolved] (SPARK-42052) Codegen Support for HiveSimpleUDF

2023-03-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42052. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40397 [https://gith

[jira] [Updated] (SPARK-42894) Implement cache, persist, unpersist, and storageLevel

2023-03-21 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42894: - Affects Version/s: (was: 3.4.0) > Implement cache, persist, unpersist, and storageLevel > --

[jira] [Updated] (SPARK-42894) Implement cache, persist, unpersist, and storageLevel

2023-03-21 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42894: - Summary: Implement cache, persist, unpersist, and storageLevel (was: Implement cache, persist, unpersis

[jira] [Created] (SPARK-42894) Implement cache, persist, unpersist

2023-03-21 Thread Yang Jie (Jira)
Yang Jie created SPARK-42894: Summary: Implement cache, persist, unpersist Key: SPARK-42894 URL: https://issues.apache.org/jira/browse/SPARK-42894 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-42786) Impl typed select in Dataset

2023-03-21 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-42786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-42786. --- Fix Version/s: 3.5.0 Assignee: Zhen Li Resolution: Fixed > Impl type

[jira] [Commented] (SPARK-42884) Add Ammonite REPL support

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703459#comment-17703459 ] Apache Spark commented on SPARK-42884: -- User 'hvanhovell' has created a pull reques

[jira] [Assigned] (SPARK-42884) Add Ammonite REPL support

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42884: Assignee: Apache Spark (was: Herman van Hövell) > Add Ammonite REPL support > --

[jira] [Assigned] (SPARK-42884) Add Ammonite REPL support

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42884: Assignee: Herman van Hövell (was: Apache Spark) > Add Ammonite REPL support > --

[jira] [Commented] (SPARK-42884) Add Ammonite REPL support

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703458#comment-17703458 ] Apache Spark commented on SPARK-42884: -- User 'hvanhovell' has created a pull reques

[jira] [Commented] (SPARK-41233) High-order function: array_prepend

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703454#comment-17703454 ] Apache Spark commented on SPARK-41233: -- User 'ueshin' has created a pull request fo

[jira] [Commented] (SPARK-41233) High-order function: array_prepend

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703455#comment-17703455 ] Apache Spark commented on SPARK-41233: -- User 'ueshin' has created a pull request fo

[jira] [Assigned] (SPARK-42893) Block Arrow-optimized Python UDFs

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42893: Assignee: Apache Spark > Block Arrow-optimized Python UDFs >

[jira] [Commented] (SPARK-42893) Block Arrow-optimized Python UDFs

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703446#comment-17703446 ] Apache Spark commented on SPARK-42893: -- User 'xinrong-meng' has created a pull requ

[jira] [Commented] (SPARK-42893) Block Arrow-optimized Python UDFs

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703447#comment-17703447 ] Apache Spark commented on SPARK-42893: -- User 'xinrong-meng' has created a pull requ

[jira] [Assigned] (SPARK-42893) Block Arrow-optimized Python UDFs

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42893: Assignee: (was: Apache Spark) > Block Arrow-optimized Python UDFs > -

[jira] [Reopened] (SPARK-40307) Introduce Arrow-optimized Python UDFs

2023-03-21 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng reopened SPARK-40307: -- > Introduce Arrow-optimized Python UDFs > - > >

[jira] [Updated] (SPARK-40307) Introduce Arrow-optimized Python UDFs

2023-03-21 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40307: - Affects Version/s: 3.5.0 > Introduce Arrow-optimized Python UDFs > -

[jira] [Updated] (SPARK-42893) Block the usage of Arrow-optimized Python UDFs

2023-03-21 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-42893: - Description: Considering the upcoming improvements on the result inconsistencies between tradit

[jira] [Updated] (SPARK-42893) Block Arrow-optimized Python UDFs

2023-03-21 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-42893: - Summary: Block Arrow-optimized Python UDFs (was: Block the usage of Arrow-optimized Python UDFs

[jira] [Created] (SPARK-42893) Block the usage of Arrow-optimized Python UDFs

2023-03-21 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-42893: Summary: Block the usage of Arrow-optimized Python UDFs Key: SPARK-42893 URL: https://issues.apache.org/jira/browse/SPARK-42893 Project: Spark Issue Type: Su

[jira] [Assigned] (SPARK-42892) Move sameType and relevant methods out of DataType

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42892: Assignee: Rui Wang (was: Apache Spark) > Move sameType and relevant methods out of DataT

[jira] [Assigned] (SPARK-42892) Move sameType and relevant methods out of DataType

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42892: Assignee: Apache Spark (was: Rui Wang) > Move sameType and relevant methods out of DataT

[jira] [Commented] (SPARK-42892) Move sameType and relevant methods out of DataType

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703436#comment-17703436 ] Apache Spark commented on SPARK-42892: -- User 'amaliujia' has created a pull request

[jira] [Created] (SPARK-42892) Move sameType and relevant methods out of DataType

2023-03-21 Thread Rui Wang (Jira)
Rui Wang created SPARK-42892: Summary: Move sameType and relevant methods out of DataType Key: SPARK-42892 URL: https://issues.apache.org/jira/browse/SPARK-42892 Project: Spark Issue Type: Sub-ta

[jira] [Assigned] (SPARK-42889) Implement cache, persist, unpersist, and storageLevel

2023-03-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42889: Assignee: Takuya Ueshin > Implement cache, persist, unpersist, and storageLevel > ---

[jira] [Resolved] (SPARK-42889) Implement cache, persist, unpersist, and storageLevel

2023-03-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42889. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40510 [https://gi

[jira] [Assigned] (SPARK-42816) Increase max message size to 128MB

2023-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42816: - Assignee: Martin Grund > Increase max message size to 128MB > -

[jira] [Resolved] (SPARK-42816) Increase max message size to 128MB

2023-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42816. --- Fix Version/s: 3.4.1 Resolution: Fixed Issue resolved by pull request 40447 [https://

[jira] [Assigned] (SPARK-42891) Implement CoGrouped Map API

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42891: Assignee: (was: Apache Spark) > Implement CoGrouped Map API > ---

[jira] [Commented] (SPARK-42891) Implement CoGrouped Map API

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703429#comment-17703429 ] Apache Spark commented on SPARK-42891: -- User 'xinrong-meng' has created a pull requ

[jira] [Commented] (SPARK-42891) Implement CoGrouped Map API

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703428#comment-17703428 ] Apache Spark commented on SPARK-42891: -- User 'xinrong-meng' has created a pull requ

[jira] [Assigned] (SPARK-42891) Implement CoGrouped Map API

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42891: Assignee: Apache Spark > Implement CoGrouped Map API > --- > >

[jira] [Updated] (SPARK-42340) Implement Grouped Map API

2023-03-21 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-42340: - Summary: Implement Grouped Map API (was: Implement GroupedData.applyInPandas) > Implement Grou

[jira] [Created] (SPARK-42891) Implement CoGrouped Map API

2023-03-21 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-42891: Summary: Implement CoGrouped Map API Key: SPARK-42891 URL: https://issues.apache.org/jira/browse/SPARK-42891 Project: Spark Issue Type: Sub-task Co

[jira] [Updated] (SPARK-42888) Upgrade GCS connector to 2.2.11.

2023-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42888: -- Affects Version/s: 3.4.0 (was: 3.4.1) > Upgrade GCS connector to 2.

[jira] [Updated] (SPARK-42888) Upgrade GCS connector to 2.2.11.

2023-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42888: -- Fix Version/s: 3.4.1 (was: 3.4.0) > Upgrade GCS connector to 2.2.11. >

[jira] [Assigned] (SPARK-42888) Upgrade GCS connector to 2.2.11.

2023-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42888: - Assignee: Chris Nauroth > Upgrade GCS connector to 2.2.11. > --

[jira] [Resolved] (SPARK-42888) Upgrade GCS connector to 2.2.11.

2023-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42888. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40511 [https://

[jira] [Created] (SPARK-42890) Add Identifier to the InMemoryTableScan node on the SQL page

2023-03-21 Thread Yian Liou (Jira)
Yian Liou created SPARK-42890: - Summary: Add Identifier to the InMemoryTableScan node on the SQL page Key: SPARK-42890 URL: https://issues.apache.org/jira/browse/SPARK-42890 Project: Spark Issue

[jira] [Updated] (SPARK-42829) Add Identifier to the cached RDD node on the Stages page

2023-03-21 Thread Yian Liou (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yian Liou updated SPARK-42829: -- Summary: Add Identifier to the cached RDD node on the Stages page (was: Added Identifier to the cach

[jira] [Updated] (SPARK-42194) Allow `columns` parameter when creating DataFrame with Series.

2023-03-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42194: - Fix Version/s: 3.4.1 (was: 3.4.0) > Allow `columns` parameter when creati

[jira] [Updated] (SPARK-42194) Allow `columns` parameter when creating DataFrame with Series.

2023-03-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42194: - Component/s: Pandas API on Spark (was: ps) > Allow `columns` parameter when

[jira] [Assigned] (SPARK-42871) Upgrade slf4j to 2.0.7

2023-03-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42871: Assignee: Yang Jie > Upgrade slf4j to 2.0.7 > -- > >

[jira] [Resolved] (SPARK-42871) Upgrade slf4j to 2.0.7

2023-03-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42871. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40489 [https://gi

[jira] [Resolved] (SPARK-42662) Add proto message for pandas API on Spark default index

2023-03-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42662. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40507 [https://gi

[jira] [Assigned] (SPARK-42662) Add proto message for pandas API on Spark default index

2023-03-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42662: Assignee: Haejoon Lee > Add proto message for pandas API on Spark default index > ---

[jira] [Updated] (SPARK-42888) Upgrade GCS connector to 2.2.11.

2023-03-21 Thread Chris Nauroth (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated SPARK-42888: -- Summary: Upgrade GCS connector to 2.2.11. (was: Upgrade GCS connector from 2.2.7 to 2.2.11.)

[jira] [Commented] (SPARK-42829) Added Identifier to the cached RDD operator on the Stages page

2023-03-21 Thread Yian Liou (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703403#comment-17703403 ] Yian Liou commented on SPARK-42829: --- Will file another Jira for adding repeat identifi

[jira] [Commented] (SPARK-42888) Upgrade GCS connector from 2.2.7 to 2.2.11.

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703401#comment-17703401 ] Apache Spark commented on SPARK-42888: -- User 'cnauroth' has created a pull request

[jira] [Assigned] (SPARK-42888) Upgrade GCS connector from 2.2.7 to 2.2.11.

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42888: Assignee: (was: Apache Spark) > Upgrade GCS connector from 2.2.7 to 2.2.11. > ---

[jira] [Assigned] (SPARK-42888) Upgrade GCS connector from 2.2.7 to 2.2.11.

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42888: Assignee: Apache Spark > Upgrade GCS connector from 2.2.7 to 2.2.11. > --

[jira] [Commented] (SPARK-42888) Upgrade GCS connector from 2.2.7 to 2.2.11.

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703400#comment-17703400 ] Apache Spark commented on SPARK-42888: -- User 'cnauroth' has created a pull request

[jira] [Commented] (SPARK-42889) Implement cache, persist, unpersist, and storageLevel

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703392#comment-17703392 ] Apache Spark commented on SPARK-42889: -- User 'ueshin' has created a pull request fo

[jira] [Assigned] (SPARK-42889) Implement cache, persist, unpersist, and storageLevel

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42889: Assignee: (was: Apache Spark) > Implement cache, persist, unpersist, and storageLevel

[jira] [Assigned] (SPARK-42889) Implement cache, persist, unpersist, and storageLevel

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42889: Assignee: Apache Spark > Implement cache, persist, unpersist, and storageLevel >

[jira] [Created] (SPARK-42889) Implement cache, persist, unpersist, and storageLevel

2023-03-21 Thread Takuya Ueshin (Jira)
Takuya Ueshin created SPARK-42889: - Summary: Implement cache, persist, unpersist, and storageLevel Key: SPARK-42889 URL: https://issues.apache.org/jira/browse/SPARK-42889 Project: Spark Issue

[jira] [Resolved] (SPARK-42885) Upgrade `kubernetes-client` to 6.5.1

2023-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42885. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40509 [https://

[jira] [Assigned] (SPARK-42885) Upgrade `kubernetes-client` to 6.5.1

2023-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42885: - Assignee: Dongjoon Hyun > Upgrade `kubernetes-client` to 6.5.1 > --

[jira] [Commented] (SPARK-42888) Upgrade GCS connector from 2.2.7 to 2.2.11.

2023-03-21 Thread Chris Nauroth (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703357#comment-17703357 ] Chris Nauroth commented on SPARK-42888: --- I have a patch in progress and will send

[jira] [Created] (SPARK-42888) Upgrade GCS connector from 2.2.7 to 2.2.11.

2023-03-21 Thread Chris Nauroth (Jira)
Chris Nauroth created SPARK-42888: - Summary: Upgrade GCS connector from 2.2.7 to 2.2.11. Key: SPARK-42888 URL: https://issues.apache.org/jira/browse/SPARK-42888 Project: Spark Issue Type: Imp

[jira] [Created] (SPARK-42887) Simple DataType interface

2023-03-21 Thread Rui Wang (Jira)
Rui Wang created SPARK-42887: Summary: Simple DataType interface Key: SPARK-42887 URL: https://issues.apache.org/jira/browse/SPARK-42887 Project: Spark Issue Type: Task Components: SQL

[jira] [Created] (SPARK-42886) ClassNotFoundException: scala.math.Ordering$Reverse

2023-03-21 Thread Steve Chong (Jira)
Steve Chong created SPARK-42886: --- Summary: ClassNotFoundException: scala.math.Ordering$Reverse Key: SPARK-42886 URL: https://issues.apache.org/jira/browse/SPARK-42886 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-42838) Assign a name to the error class _LEGACY_ERROR_TEMP_2000

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42838: Assignee: (was: Apache Spark) > Assign a name to the error class _LEGACY_ERROR_TEMP_2

[jira] [Commented] (SPARK-42838) Assign a name to the error class _LEGACY_ERROR_TEMP_2000

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703286#comment-17703286 ] Apache Spark commented on SPARK-42838: -- User 'unical1988' has created a pull reques

[jira] [Assigned] (SPARK-42838) Assign a name to the error class _LEGACY_ERROR_TEMP_2000

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42838: Assignee: Apache Spark > Assign a name to the error class _LEGACY_ERROR_TEMP_2000 > -

[jira] [Assigned] (SPARK-42885) Upgrade `kubernetes-client` to 6.5.1

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42885: Assignee: (was: Apache Spark) > Upgrade `kubernetes-client` to 6.5.1 > --

[jira] [Assigned] (SPARK-42885) Upgrade `kubernetes-client` to 6.5.1

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42885: Assignee: Apache Spark > Upgrade `kubernetes-client` to 6.5.1 > -

[jira] [Commented] (SPARK-42885) Upgrade `kubernetes-client` to 6.5.1

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703272#comment-17703272 ] Apache Spark commented on SPARK-42885: -- User 'dongjoon-hyun' has created a pull req

[jira] [Created] (SPARK-42885) Upgrade `kubernetes-client` to 6.5.1

2023-03-21 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-42885: - Summary: Upgrade `kubernetes-client` to 6.5.1 Key: SPARK-42885 URL: https://issues.apache.org/jira/browse/SPARK-42885 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-42813) Print application info when waitAppCompletion is false

2023-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42813: - Assignee: Cheng Pan > Print application info when waitAppCompletion is false >

[jira] [Resolved] (SPARK-42813) Print application info when waitAppCompletion is false

2023-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42813. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40444 [https://

[jira] [Created] (SPARK-42884) Add Ammonite REPL support

2023-03-21 Thread Jira
Herman van Hövell created SPARK-42884: - Summary: Add Ammonite REPL support Key: SPARK-42884 URL: https://issues.apache.org/jira/browse/SPARK-42884 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-42662) Add proto message for pandas API on Spark default index

2023-03-21 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-42662: Description: Add `DistributedSequenceID` into proto message to support the distributed-sequence in

[jira] [Updated] (SPARK-42662) Add proto message for pandas API on Spark default index

2023-03-21 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-42662: Summary: Add proto message for pandas API on Spark default index (was: Add `_distributed_sequence

[jira] [Resolved] (SPARK-42808) Avoid getting availableProcessors every time in MapOutputTrackerMaster#getStatistics

2023-03-21 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-42808. -- Fix Version/s: 3.5.0 Assignee: dzcxzl Resolution: Fixed Resolved by https://gi

[jira] [Resolved] (SPARK-42536) Upgrade log4j2 to 2.20.0

2023-03-21 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-42536. -- Fix Version/s: 3.5.0 Assignee: Yang Jie Resolution: Fixed Resolved by https://

[jira] [Resolved] (SPARK-42851) EquivalentExpressions methods need to be consistently guarded by supportedExpression

2023-03-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42851. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40473 [https://gith

[jira] [Assigned] (SPARK-42851) EquivalentExpressions methods need to be consistently guarded by supportedExpression

2023-03-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42851: --- Assignee: Kris Mok > EquivalentExpressions methods need to be consistently guarded by > su

[jira] [Commented] (SPARK-32893) Structured Streaming and Dynamic Allocation on StandaloneCluster

2023-03-21 Thread Ranga Reddy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703182#comment-17703182 ] Ranga Reddy commented on SPARK-32893: - Similar kind of issue is created for [Kubern

[jira] [Commented] (SPARK-32893) Structured Streaming and Dynamic Allocation on StandaloneCluster

2023-03-21 Thread Ranga Reddy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703177#comment-17703177 ] Ranga Reddy commented on SPARK-32893: - I can see similar behaviour Spark Structured

[jira] [Commented] (SPARK-41006) ConfigMap has the same name when launching two pods on the same namespace

2023-03-21 Thread Cedric van Eetvelde (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703145#comment-17703145 ] Cedric van Eetvelde commented on SPARK-41006: - As mentionned above, I create

[jira] [Comment Edited] (SPARK-41006) ConfigMap has the same name when launching two pods on the same namespace

2023-03-21 Thread Cedric van Eetvelde (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703145#comment-17703145 ] Cedric van Eetvelde edited comment on SPARK-41006 at 3/21/23 11:03 AM: ---

[jira] [Comment Edited] (SPARK-40327) Increase pandas API coverage for pandas API on Spark

2023-03-21 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703123#comment-17703123 ] Xinrong Meng edited comment on SPARK-40327 at 3/21/23 9:48 AM: ---

[jira] [Updated] (SPARK-40327) Increase pandas API coverage for pandas API on Spark

2023-03-21 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40327: - Affects Version/s: 3.5.0 (was: 3.4.0) > Increase pandas API coverage

[jira] [Commented] (SPARK-40327) Increase pandas API coverage for pandas API on Spark

2023-03-21 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703123#comment-17703123 ] Xinrong Meng commented on SPARK-40327: -- Hi, all resolved issues are moved to https

[jira] [Updated] (SPARK-40327) Increase pandas API coverage for pandas API on Spark

2023-03-21 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40327: - Fix Version/s: (was: 3.4.0) > Increase pandas API coverage for pandas API on Spark > ---

[jira] [Updated] (SPARK-40340) Implement `Expanding.sem`.

2023-03-21 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40340: - Parent: SPARK-40327 (was: SPARK-42882) > Implement `Expanding.sem`. > -

[jira] [Updated] (SPARK-40341) Implement `Rolling.median`.

2023-03-21 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40341: - Parent: SPARK-40327 (was: SPARK-42882) > Implement `Rolling.median`. >

[jira] [Commented] (SPARK-39199) Implement pandas API missing parameters

2023-03-21 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17703121#comment-17703121 ] Xinrong Meng commented on SPARK-39199: -- Please see https://issues.apache.org/jira/b

[jira] [Resolved] (SPARK-42883) Implement Pandas API Missing Parameters

2023-03-21 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-42883. -- Resolution: Resolved > Implement Pandas API Missing Parameters > -

  1   2   >