[jira] [Assigned] (SPARK-42894) Implement cache, persist, unpersist, and storageLevel

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42894: Assignee: Apache Spark > Implement cache, persist, unpersist, and storageLevel >

[jira] [Assigned] (SPARK-42894) Implement cache, persist, unpersist, and storageLevel

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42894: Assignee: (was: Apache Spark) > Implement cache, persist, unpersist, and

[jira] [Commented] (SPARK-42894) Implement cache, persist, unpersist, and storageLevel

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703493#comment-17703493 ] Apache Spark commented on SPARK-42894: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-42894) Implement cache, persist, unpersist, and storageLevel

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703492#comment-17703492 ] Apache Spark commented on SPARK-42894: -- User 'LuciferYang' has created a pull request for this

[jira] [Resolved] (SPARK-42880) Improve the yarn document for lo4j2 configuration

2023-03-21 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-42880. -- Fix Version/s: 3.5.0 Assignee: Zhifang Li Resolution: Fixed Resolved by

[jira] [Updated] (SPARK-42880) Improve the yarn document for lo4j2 configuration

2023-03-21 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-42880: - Component/s: Documentation > Improve the yarn document for lo4j2 configuration >

[jira] [Updated] (SPARK-42880) Improve the yarn document for lo4j2 configuration

2023-03-21 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-42880: - Priority: Trivial (was: Minor) > Improve the yarn document for lo4j2 configuration >

[jira] [Assigned] (SPARK-42052) Codegen Support for HiveSimpleUDF

2023-03-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42052: --- Assignee: BingKun Pan > Codegen Support for HiveSimpleUDF >

[jira] [Resolved] (SPARK-42052) Codegen Support for HiveSimpleUDF

2023-03-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42052. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40397

[jira] [Updated] (SPARK-42894) Implement cache, persist, unpersist, and storageLevel

2023-03-21 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42894: - Affects Version/s: (was: 3.4.0) > Implement cache, persist, unpersist, and storageLevel >

[jira] [Updated] (SPARK-42894) Implement cache, persist, unpersist, and storageLevel

2023-03-21 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42894: - Summary: Implement cache, persist, unpersist, and storageLevel (was: Implement cache, persist,

[jira] [Created] (SPARK-42894) Implement cache, persist, unpersist

2023-03-21 Thread Yang Jie (Jira)
Yang Jie created SPARK-42894: Summary: Implement cache, persist, unpersist Key: SPARK-42894 URL: https://issues.apache.org/jira/browse/SPARK-42894 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-42786) Impl typed select in Dataset

2023-03-21 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-42786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-42786. --- Fix Version/s: 3.5.0 Assignee: Zhen Li Resolution: Fixed > Impl

[jira] [Commented] (SPARK-42884) Add Ammonite REPL support

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703459#comment-17703459 ] Apache Spark commented on SPARK-42884: -- User 'hvanhovell' has created a pull request for this

[jira] [Assigned] (SPARK-42884) Add Ammonite REPL support

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42884: Assignee: Apache Spark (was: Herman van Hövell) > Add Ammonite REPL support >

[jira] [Assigned] (SPARK-42884) Add Ammonite REPL support

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42884: Assignee: Herman van Hövell (was: Apache Spark) > Add Ammonite REPL support >

[jira] [Commented] (SPARK-42884) Add Ammonite REPL support

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703458#comment-17703458 ] Apache Spark commented on SPARK-42884: -- User 'hvanhovell' has created a pull request for this

[jira] [Commented] (SPARK-41233) High-order function: array_prepend

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703454#comment-17703454 ] Apache Spark commented on SPARK-41233: -- User 'ueshin' has created a pull request for this issue:

[jira] [Commented] (SPARK-41233) High-order function: array_prepend

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703455#comment-17703455 ] Apache Spark commented on SPARK-41233: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42893) Block Arrow-optimized Python UDFs

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42893: Assignee: Apache Spark > Block Arrow-optimized Python UDFs >

[jira] [Commented] (SPARK-42893) Block Arrow-optimized Python UDFs

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703446#comment-17703446 ] Apache Spark commented on SPARK-42893: -- User 'xinrong-meng' has created a pull request for this

[jira] [Commented] (SPARK-42893) Block Arrow-optimized Python UDFs

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703447#comment-17703447 ] Apache Spark commented on SPARK-42893: -- User 'xinrong-meng' has created a pull request for this

[jira] [Assigned] (SPARK-42893) Block Arrow-optimized Python UDFs

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42893: Assignee: (was: Apache Spark) > Block Arrow-optimized Python UDFs >

[jira] [Reopened] (SPARK-40307) Introduce Arrow-optimized Python UDFs

2023-03-21 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng reopened SPARK-40307: -- > Introduce Arrow-optimized Python UDFs > - > >

[jira] [Updated] (SPARK-40307) Introduce Arrow-optimized Python UDFs

2023-03-21 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40307: - Affects Version/s: 3.5.0 > Introduce Arrow-optimized Python UDFs >

[jira] [Updated] (SPARK-42893) Block the usage of Arrow-optimized Python UDFs

2023-03-21 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-42893: - Description: Considering the upcoming improvements on the result inconsistencies between

[jira] [Updated] (SPARK-42893) Block Arrow-optimized Python UDFs

2023-03-21 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-42893: - Summary: Block Arrow-optimized Python UDFs (was: Block the usage of Arrow-optimized Python

[jira] [Created] (SPARK-42893) Block the usage of Arrow-optimized Python UDFs

2023-03-21 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-42893: Summary: Block the usage of Arrow-optimized Python UDFs Key: SPARK-42893 URL: https://issues.apache.org/jira/browse/SPARK-42893 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-42892) Move sameType and relevant methods out of DataType

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42892: Assignee: Rui Wang (was: Apache Spark) > Move sameType and relevant methods out of

[jira] [Assigned] (SPARK-42892) Move sameType and relevant methods out of DataType

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42892: Assignee: Apache Spark (was: Rui Wang) > Move sameType and relevant methods out of

[jira] [Commented] (SPARK-42892) Move sameType and relevant methods out of DataType

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703436#comment-17703436 ] Apache Spark commented on SPARK-42892: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Created] (SPARK-42892) Move sameType and relevant methods out of DataType

2023-03-21 Thread Rui Wang (Jira)
Rui Wang created SPARK-42892: Summary: Move sameType and relevant methods out of DataType Key: SPARK-42892 URL: https://issues.apache.org/jira/browse/SPARK-42892 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-42889) Implement cache, persist, unpersist, and storageLevel

2023-03-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42889: Assignee: Takuya Ueshin > Implement cache, persist, unpersist, and storageLevel >

[jira] [Resolved] (SPARK-42889) Implement cache, persist, unpersist, and storageLevel

2023-03-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42889. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40510

[jira] [Assigned] (SPARK-42816) Increase max message size to 128MB

2023-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42816: - Assignee: Martin Grund > Increase max message size to 128MB >

[jira] [Resolved] (SPARK-42816) Increase max message size to 128MB

2023-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42816. --- Fix Version/s: 3.4.1 Resolution: Fixed Issue resolved by pull request 40447

[jira] [Assigned] (SPARK-42891) Implement CoGrouped Map API

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42891: Assignee: (was: Apache Spark) > Implement CoGrouped Map API >

[jira] [Commented] (SPARK-42891) Implement CoGrouped Map API

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703429#comment-17703429 ] Apache Spark commented on SPARK-42891: -- User 'xinrong-meng' has created a pull request for this

[jira] [Commented] (SPARK-42891) Implement CoGrouped Map API

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703428#comment-17703428 ] Apache Spark commented on SPARK-42891: -- User 'xinrong-meng' has created a pull request for this

[jira] [Assigned] (SPARK-42891) Implement CoGrouped Map API

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42891: Assignee: Apache Spark > Implement CoGrouped Map API > --- > >

[jira] [Updated] (SPARK-42340) Implement Grouped Map API

2023-03-21 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-42340: - Summary: Implement Grouped Map API (was: Implement GroupedData.applyInPandas) > Implement

[jira] [Created] (SPARK-42891) Implement CoGrouped Map API

2023-03-21 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-42891: Summary: Implement CoGrouped Map API Key: SPARK-42891 URL: https://issues.apache.org/jira/browse/SPARK-42891 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-42888) Upgrade GCS connector to 2.2.11.

2023-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42888: -- Affects Version/s: 3.4.0 (was: 3.4.1) > Upgrade GCS connector to

[jira] [Updated] (SPARK-42888) Upgrade GCS connector to 2.2.11.

2023-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42888: -- Fix Version/s: 3.4.1 (was: 3.4.0) > Upgrade GCS connector to 2.2.11. >

[jira] [Assigned] (SPARK-42888) Upgrade GCS connector to 2.2.11.

2023-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42888: - Assignee: Chris Nauroth > Upgrade GCS connector to 2.2.11. >

[jira] [Resolved] (SPARK-42888) Upgrade GCS connector to 2.2.11.

2023-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42888. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40511

[jira] [Created] (SPARK-42890) Add Identifier to the InMemoryTableScan node on the SQL page

2023-03-21 Thread Yian Liou (Jira)
Yian Liou created SPARK-42890: - Summary: Add Identifier to the InMemoryTableScan node on the SQL page Key: SPARK-42890 URL: https://issues.apache.org/jira/browse/SPARK-42890 Project: Spark

[jira] [Updated] (SPARK-42829) Add Identifier to the cached RDD node on the Stages page

2023-03-21 Thread Yian Liou (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yian Liou updated SPARK-42829: -- Summary: Add Identifier to the cached RDD node on the Stages page (was: Added Identifier to the

[jira] [Updated] (SPARK-42194) Allow `columns` parameter when creating DataFrame with Series.

2023-03-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42194: - Fix Version/s: 3.4.1 (was: 3.4.0) > Allow `columns` parameter when

[jira] [Updated] (SPARK-42194) Allow `columns` parameter when creating DataFrame with Series.

2023-03-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-42194: - Component/s: Pandas API on Spark (was: ps) > Allow `columns` parameter

[jira] [Assigned] (SPARK-42871) Upgrade slf4j to 2.0.7

2023-03-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42871: Assignee: Yang Jie > Upgrade slf4j to 2.0.7 > -- > >

[jira] [Resolved] (SPARK-42871) Upgrade slf4j to 2.0.7

2023-03-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42871. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40489

[jira] [Resolved] (SPARK-42662) Add proto message for pandas API on Spark default index

2023-03-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42662. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40507

[jira] [Assigned] (SPARK-42662) Add proto message for pandas API on Spark default index

2023-03-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42662: Assignee: Haejoon Lee > Add proto message for pandas API on Spark default index >

[jira] [Updated] (SPARK-42888) Upgrade GCS connector to 2.2.11.

2023-03-21 Thread Chris Nauroth (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated SPARK-42888: -- Summary: Upgrade GCS connector to 2.2.11. (was: Upgrade GCS connector from 2.2.7 to 2.2.11.)

[jira] [Commented] (SPARK-42829) Added Identifier to the cached RDD operator on the Stages page

2023-03-21 Thread Yian Liou (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703403#comment-17703403 ] Yian Liou commented on SPARK-42829: --- Will file another Jira for adding repeat identifier for

[jira] [Commented] (SPARK-42888) Upgrade GCS connector from 2.2.7 to 2.2.11.

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703401#comment-17703401 ] Apache Spark commented on SPARK-42888: -- User 'cnauroth' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42888) Upgrade GCS connector from 2.2.7 to 2.2.11.

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42888: Assignee: (was: Apache Spark) > Upgrade GCS connector from 2.2.7 to 2.2.11. >

[jira] [Assigned] (SPARK-42888) Upgrade GCS connector from 2.2.7 to 2.2.11.

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42888: Assignee: Apache Spark > Upgrade GCS connector from 2.2.7 to 2.2.11. >

[jira] [Commented] (SPARK-42888) Upgrade GCS connector from 2.2.7 to 2.2.11.

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703400#comment-17703400 ] Apache Spark commented on SPARK-42888: -- User 'cnauroth' has created a pull request for this issue:

[jira] [Commented] (SPARK-42889) Implement cache, persist, unpersist, and storageLevel

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703392#comment-17703392 ] Apache Spark commented on SPARK-42889: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42889) Implement cache, persist, unpersist, and storageLevel

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42889: Assignee: (was: Apache Spark) > Implement cache, persist, unpersist, and

[jira] [Assigned] (SPARK-42889) Implement cache, persist, unpersist, and storageLevel

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42889: Assignee: Apache Spark > Implement cache, persist, unpersist, and storageLevel >

[jira] [Created] (SPARK-42889) Implement cache, persist, unpersist, and storageLevel

2023-03-21 Thread Takuya Ueshin (Jira)
Takuya Ueshin created SPARK-42889: - Summary: Implement cache, persist, unpersist, and storageLevel Key: SPARK-42889 URL: https://issues.apache.org/jira/browse/SPARK-42889 Project: Spark

[jira] [Resolved] (SPARK-42885) Upgrade `kubernetes-client` to 6.5.1

2023-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42885. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40509

[jira] [Assigned] (SPARK-42885) Upgrade `kubernetes-client` to 6.5.1

2023-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42885: - Assignee: Dongjoon Hyun > Upgrade `kubernetes-client` to 6.5.1 >

[jira] [Commented] (SPARK-42888) Upgrade GCS connector from 2.2.7 to 2.2.11.

2023-03-21 Thread Chris Nauroth (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703357#comment-17703357 ] Chris Nauroth commented on SPARK-42888: --- I have a patch in progress and will send a pull request.

[jira] [Created] (SPARK-42888) Upgrade GCS connector from 2.2.7 to 2.2.11.

2023-03-21 Thread Chris Nauroth (Jira)
Chris Nauroth created SPARK-42888: - Summary: Upgrade GCS connector from 2.2.7 to 2.2.11. Key: SPARK-42888 URL: https://issues.apache.org/jira/browse/SPARK-42888 Project: Spark Issue Type:

[jira] [Created] (SPARK-42887) Simple DataType interface

2023-03-21 Thread Rui Wang (Jira)
Rui Wang created SPARK-42887: Summary: Simple DataType interface Key: SPARK-42887 URL: https://issues.apache.org/jira/browse/SPARK-42887 Project: Spark Issue Type: Task Components: SQL

[jira] [Created] (SPARK-42886) ClassNotFoundException: scala.math.Ordering$Reverse

2023-03-21 Thread Steve Chong (Jira)
Steve Chong created SPARK-42886: --- Summary: ClassNotFoundException: scala.math.Ordering$Reverse Key: SPARK-42886 URL: https://issues.apache.org/jira/browse/SPARK-42886 Project: Spark Issue

[jira] [Assigned] (SPARK-42838) Assign a name to the error class _LEGACY_ERROR_TEMP_2000

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42838: Assignee: (was: Apache Spark) > Assign a name to the error class

[jira] [Commented] (SPARK-42838) Assign a name to the error class _LEGACY_ERROR_TEMP_2000

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703286#comment-17703286 ] Apache Spark commented on SPARK-42838: -- User 'unical1988' has created a pull request for this

[jira] [Assigned] (SPARK-42838) Assign a name to the error class _LEGACY_ERROR_TEMP_2000

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42838: Assignee: Apache Spark > Assign a name to the error class _LEGACY_ERROR_TEMP_2000 >

[jira] [Assigned] (SPARK-42885) Upgrade `kubernetes-client` to 6.5.1

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42885: Assignee: (was: Apache Spark) > Upgrade `kubernetes-client` to 6.5.1 >

[jira] [Assigned] (SPARK-42885) Upgrade `kubernetes-client` to 6.5.1

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42885: Assignee: Apache Spark > Upgrade `kubernetes-client` to 6.5.1 >

[jira] [Commented] (SPARK-42885) Upgrade `kubernetes-client` to 6.5.1

2023-03-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703272#comment-17703272 ] Apache Spark commented on SPARK-42885: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-42885) Upgrade `kubernetes-client` to 6.5.1

2023-03-21 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-42885: - Summary: Upgrade `kubernetes-client` to 6.5.1 Key: SPARK-42885 URL: https://issues.apache.org/jira/browse/SPARK-42885 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-42813) Print application info when waitAppCompletion is false

2023-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42813: - Assignee: Cheng Pan > Print application info when waitAppCompletion is false >

[jira] [Resolved] (SPARK-42813) Print application info when waitAppCompletion is false

2023-03-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42813. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40444

[jira] [Created] (SPARK-42884) Add Ammonite REPL support

2023-03-21 Thread Jira
Herman van Hövell created SPARK-42884: - Summary: Add Ammonite REPL support Key: SPARK-42884 URL: https://issues.apache.org/jira/browse/SPARK-42884 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-42662) Add proto message for pandas API on Spark default index

2023-03-21 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-42662: Description: Add `DistributedSequenceID` into proto message to support the distributed-sequence

[jira] [Updated] (SPARK-42662) Add proto message for pandas API on Spark default index

2023-03-21 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-42662: Summary: Add proto message for pandas API on Spark default index (was: Add

[jira] [Resolved] (SPARK-42808) Avoid getting availableProcessors every time in MapOutputTrackerMaster#getStatistics

2023-03-21 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-42808. -- Fix Version/s: 3.5.0 Assignee: dzcxzl Resolution: Fixed Resolved by

[jira] [Resolved] (SPARK-42536) Upgrade log4j2 to 2.20.0

2023-03-21 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-42536. -- Fix Version/s: 3.5.0 Assignee: Yang Jie Resolution: Fixed Resolved by

[jira] [Resolved] (SPARK-42851) EquivalentExpressions methods need to be consistently guarded by supportedExpression

2023-03-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42851. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40473

[jira] [Assigned] (SPARK-42851) EquivalentExpressions methods need to be consistently guarded by supportedExpression

2023-03-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42851: --- Assignee: Kris Mok > EquivalentExpressions methods need to be consistently guarded by >

[jira] [Commented] (SPARK-32893) Structured Streaming and Dynamic Allocation on StandaloneCluster

2023-03-21 Thread Ranga Reddy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703182#comment-17703182 ] Ranga Reddy commented on SPARK-32893: - Similar kind of issue is created for

[jira] [Commented] (SPARK-32893) Structured Streaming and Dynamic Allocation on StandaloneCluster

2023-03-21 Thread Ranga Reddy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703177#comment-17703177 ] Ranga Reddy commented on SPARK-32893: - I can see similar behaviour Spark Structured Streaming with

[jira] [Commented] (SPARK-41006) ConfigMap has the same name when launching two pods on the same namespace

2023-03-21 Thread Cedric van Eetvelde (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703145#comment-17703145 ] Cedric van Eetvelde commented on SPARK-41006: - As mentionned above, I create a Pull Request

[jira] [Comment Edited] (SPARK-41006) ConfigMap has the same name when launching two pods on the same namespace

2023-03-21 Thread Cedric van Eetvelde (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703145#comment-17703145 ] Cedric van Eetvelde edited comment on SPARK-41006 at 3/21/23 11:03 AM:

[jira] [Comment Edited] (SPARK-40327) Increase pandas API coverage for pandas API on Spark

2023-03-21 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703123#comment-17703123 ] Xinrong Meng edited comment on SPARK-40327 at 3/21/23 9:48 AM: --- All

[jira] [Updated] (SPARK-40327) Increase pandas API coverage for pandas API on Spark

2023-03-21 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40327: - Affects Version/s: 3.5.0 (was: 3.4.0) > Increase pandas API coverage

[jira] [Commented] (SPARK-40327) Increase pandas API coverage for pandas API on Spark

2023-03-21 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703123#comment-17703123 ] Xinrong Meng commented on SPARK-40327: -- Hi, all resolved issues are moved to

[jira] [Updated] (SPARK-40327) Increase pandas API coverage for pandas API on Spark

2023-03-21 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40327: - Fix Version/s: (was: 3.4.0) > Increase pandas API coverage for pandas API on Spark >

[jira] [Updated] (SPARK-40340) Implement `Expanding.sem`.

2023-03-21 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40340: - Parent: SPARK-40327 (was: SPARK-42882) > Implement `Expanding.sem`. >

[jira] [Updated] (SPARK-40341) Implement `Rolling.median`.

2023-03-21 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40341: - Parent: SPARK-40327 (was: SPARK-42882) > Implement `Rolling.median`. >

[jira] [Commented] (SPARK-39199) Implement pandas API missing parameters

2023-03-21 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703121#comment-17703121 ] Xinrong Meng commented on SPARK-39199: -- Please see

[jira] [Resolved] (SPARK-42883) Implement Pandas API Missing Parameters

2023-03-21 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-42883. -- Resolution: Resolved > Implement Pandas API Missing Parameters >

[jira] [Updated] (SPARK-38552) Implement `keep` parameter of `frame.nlargest/nsmallest` to decide how to resolve ties

2023-03-21 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-38552: - Parent: SPARK-42883 (was: SPARK-39199) > Implement `keep` parameter of

[jira] [Resolved] (SPARK-42882) Pandas API Coverage Improvements

2023-03-21 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-42882. -- Resolution: Resolved > Pandas API Coverage Improvements > >

  1   2   >