[jira] [Created] (SPARK-39690) Reuse exchange across subqueries is broken with AQE if subquery side exchange materialized first

2022-07-05 Thread Kapil Singh (Jira)
Kapil Singh created SPARK-39690: --- Summary: Reuse exchange across subqueries is broken with AQE if subquery side exchange materialized first Key: SPARK-39690 URL: https://issues.apache.org/jira/browse/SPARK-39690

[jira] [Created] (SPARK-39689) Support 2-chars lineSep in CSV datasource

2022-07-05 Thread Yaohua Zhao (Jira)
Yaohua Zhao created SPARK-39689: --- Summary: Support 2-chars lineSep in CSV datasource Key: SPARK-39689 URL: https://issues.apache.org/jira/browse/SPARK-39689 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-31749) Allow to set owner reference for the driver pod (cluster mode)

2022-07-05 Thread magaoyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17562935#comment-17562935 ] magaoyun edited comment on SPARK-31749 at 7/6/22 3:23 AM: -- I haven't found this

[jira] [Commented] (SPARK-31749) Allow to set owner reference for the driver pod (cluster mode)

2022-07-05 Thread magaoyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17562935#comment-17562935 ] magaoyun commented on SPARK-31749: -- I have found this settings on

[jira] [Commented] (SPARK-39616) Upgrade Breeze to 2.0

2022-07-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17562930#comment-17562930 ] Apache Spark commented on SPARK-39616: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-39616) Upgrade Breeze to 2.0

2022-07-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17562929#comment-17562929 ] Apache Spark commented on SPARK-39616: -- User 'zhengruifeng' has created a pull request for this

[jira] [Updated] (SPARK-39522) Add Apache Spark infra GA image cache

2022-07-05 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-39522: Summary: Add Apache Spark infra GA image cache (was: Uses Docker image cache over a custom

[jira] [Resolved] (SPARK-39522) Uses Docker image cache over a custom image

2022-07-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39522. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37003

[jira] [Assigned] (SPARK-39522) Uses Docker image cache over a custom image

2022-07-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39522: Assignee: Yikun Jiang > Uses Docker image cache over a custom image >

[jira] [Commented] (SPARK-39681) PySpark build broken in branch-3.2 with Scala 2.13

2022-07-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17562890#comment-17562890 ] Hyukjin Kwon commented on SPARK-39681: -- Thanks [~yikunkero] > PySpark build broken in branch-3.2

[jira] [Assigned] (SPARK-39687) Make sure new catalog methods listed in API reference

2022-07-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39687: Assignee: Ruifeng Zheng > Make sure new catalog methods listed in API reference >

[jira] [Resolved] (SPARK-39687) Make sure new catalog methods listed in API reference

2022-07-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39687. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37092

[jira] [Resolved] (SPARK-39686) Disable scheduled builds that do not pass even once

2022-07-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39686. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37091

[jira] [Assigned] (SPARK-39686) Disable scheduled builds that do not pass even once

2022-07-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39686: Assignee: Hyukjin Kwon > Disable scheduled builds that do not pass even once >

[jira] [Assigned] (SPARK-39584) Fix TPCDSQueryBenchmark Measuring Performance of Wrong Query Results

2022-07-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39584: Assignee: (was: Apache Spark) > Fix TPCDSQueryBenchmark Measuring Performance of

[jira] [Commented] (SPARK-39584) Fix TPCDSQueryBenchmark Measuring Performance of Wrong Query Results

2022-07-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17562841#comment-17562841 ] Apache Spark commented on SPARK-39584: -- User 'kazuyukitanimura' has created a pull request for this

[jira] [Commented] (SPARK-39584) Fix TPCDSQueryBenchmark Measuring Performance of Wrong Query Results

2022-07-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17562840#comment-17562840 ] Apache Spark commented on SPARK-39584: -- User 'kazuyukitanimura' has created a pull request for this

[jira] [Assigned] (SPARK-39584) Fix TPCDSQueryBenchmark Measuring Performance of Wrong Query Results

2022-07-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39584: Assignee: Apache Spark > Fix TPCDSQueryBenchmark Measuring Performance of Wrong Query

[jira] [Resolved] (SPARK-39688) getReusablePVCs should handle accounts with no PVC permission

2022-07-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39688. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37095

[jira] [Assigned] (SPARK-34927) Support TPCDSQueryBenchmark in Benchmarks

2022-07-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34927: - Assignee: Kazuaki Ishizaki > Support TPCDSQueryBenchmark in Benchmarks >

[jira] [Resolved] (SPARK-34927) Support TPCDSQueryBenchmark in Benchmarks

2022-07-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34927. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37020

[jira] [Assigned] (SPARK-34927) Support TPCDSQueryBenchmark in Benchmarks

2022-07-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34927: - Assignee: Kazuyuki Tanimura (was: Kazuaki Ishizaki) > Support TPCDSQueryBenchmark in

[jira] [Assigned] (SPARK-39688) getReusablePVCs should handle accounts with no PVC permission

2022-07-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39688: - Assignee: Dongjoon Hyun > getReusablePVCs should handle accounts with no PVC

[jira] [Resolved] (SPARK-39616) Upgrade Breeze to 2.0

2022-07-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39616. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37002

[jira] [Assigned] (SPARK-39616) Upgrade Breeze to 2.0

2022-07-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39616: - Assignee: Ruifeng Zheng > Upgrade Breeze to 2.0 > - > >

[jira] [Assigned] (SPARK-39688) getReusablePVCs should handle accounts with no PVC permission

2022-07-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39688: Assignee: (was: Apache Spark) > getReusablePVCs should handle accounts with no PVC

[jira] [Assigned] (SPARK-39688) getReusablePVCs should handle accounts with no PVC permission

2022-07-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39688: Assignee: Apache Spark > getReusablePVCs should handle accounts with no PVC permission >

[jira] [Commented] (SPARK-39688) getReusablePVCs should handle accounts with no PVC permission

2022-07-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17562820#comment-17562820 ] Apache Spark commented on SPARK-39688: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-39688) getReusablePVCs should handle accounts with no PVC permission

2022-07-05 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-39688: - Summary: getReusablePVCs should handle accounts with no PVC permission Key: SPARK-39688 URL: https://issues.apache.org/jira/browse/SPARK-39688 Project: Spark

[jira] [Updated] (SPARK-39018) Add support for YARN decommissioning when ESS is Disabled

2022-07-05 Thread Abhishek Dixit (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Dixit updated SPARK-39018: --- Fix Version/s: 3.4.0 > Add support for YARN decommissioning when ESS is Disabled >

[jira] [Resolved] (SPARK-39018) Add support for YARN decommissioning when ESS is Disabled

2022-07-05 Thread Abhishek Dixit (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Dixit resolved SPARK-39018. Resolution: Fixed > Add support for YARN decommissioning when ESS is Disabled >

[jira] [Comment Edited] (SPARK-35662) Support Timestamp without time zone data type

2022-07-05 Thread Bill Schneider (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17562724#comment-17562724 ] Bill Schneider edited comment on SPARK-35662 at 7/5/22 5:07 PM: Is this

[jira] [Comment Edited] (SPARK-39681) PySpark build broken in branch-3.2 with Scala 2.13

2022-07-05 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17562735#comment-17562735 ] Yikun Jiang edited comment on SPARK-39681 at 7/5/22 4:06 PM: -

[jira] [Comment Edited] (SPARK-39681) PySpark build broken in branch-3.2 with Scala 2.13

2022-07-05 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17562735#comment-17562735 ] Yikun Jiang edited comment on SPARK-39681 at 7/5/22 4:04 PM: -

[jira] [Comment Edited] (SPARK-39681) PySpark build broken in branch-3.2 with Scala 2.13

2022-07-05 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17562735#comment-17562735 ] Yikun Jiang edited comment on SPARK-39681 at 7/5/22 4:04 PM: - I think this

[jira] [Commented] (SPARK-39681) PySpark build broken in branch-3.2 with Scala 2.13

2022-07-05 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17562735#comment-17562735 ] Yikun Jiang commented on SPARK-39681: - I think this should be backport first.

[jira] [Commented] (SPARK-35662) Support Timestamp without time zone data type

2022-07-05 Thread Bill Schneider (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17562724#comment-17562724 ] Bill Schneider commented on SPARK-35662: Is this delayed until 3.4.0?  It did not appear to work

[jira] [Updated] (SPARK-39677) Wrong args item formatting of the regexp functions

2022-07-05 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-39677: - Fix Version/s: 3.2.2 > Wrong args item formatting of the regexp functions >

[jira] [Updated] (SPARK-39677) Wrong args item formatting of the regexp functions

2022-07-05 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-39677: - Fix Version/s: 3.1.4 > Wrong args item formatting of the regexp functions >

[jira] [Commented] (SPARK-39623) partitionng by datestamp leads to wrong query on backend?

2022-07-05 Thread Dmitry (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17562695#comment-17562695 ] Dmitry commented on SPARK-39623: It is quoted in my issue, here it is again: I see this query on DB

[jira] [Commented] (SPARK-39609) PySpark need to support pypy3.8 to avoid "No module named '_pickle"

2022-07-05 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17562682#comment-17562682 ] Yikun Jiang commented on SPARK-39609: - [https://github.com/cloudpipe/cloudpickle/pull/461]  

[jira] [Commented] (SPARK-39677) Wrong args item formatting of the regexp functions

2022-07-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17562641#comment-17562641 ] Apache Spark commented on SPARK-39677: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-39677) Wrong args item formatting of the regexp functions

2022-07-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17562642#comment-17562642 ] Apache Spark commented on SPARK-39677: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39687) Make sure new catalog methods listed in API reference

2022-07-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39687: Assignee: (was: Apache Spark) > Make sure new catalog methods listed in API

[jira] [Commented] (SPARK-39687) Make sure new catalog methods listed in API reference

2022-07-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17562639#comment-17562639 ] Apache Spark commented on SPARK-39687: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-39687) Make sure new catalog methods listed in API reference

2022-07-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39687: Assignee: Apache Spark > Make sure new catalog methods listed in API reference >

[jira] [Created] (SPARK-39687) Make sure new catalog methods listed in API reference

2022-07-05 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-39687: - Summary: Make sure new catalog methods listed in API reference Key: SPARK-39687 URL: https://issues.apache.org/jira/browse/SPARK-39687 Project: Spark

[jira] [Resolved] (SPARK-39539) Overflow on converting valid Milliseconds to Microseconds

2022-07-05 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39539. -- Resolution: Not A Problem > Overflow on converting valid Milliseconds to Microseconds >

[jira] [Assigned] (SPARK-39610) Add safe.directory for container based job

2022-07-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39610: Assignee: Yikun Jiang > Add safe.directory for container based job >

[jira] [Resolved] (SPARK-39610) Add safe.directory for container based job

2022-07-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39610. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37079

[jira] [Resolved] (SPARK-39611) PySpark support numpy 1.23.X

2022-07-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39611. -- Fix Version/s: 3.3.1 3.2.2 3.4.0 Resolution:

[jira] [Assigned] (SPARK-39611) PySpark support numpy 1.23.X

2022-07-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39611: Assignee: Yikun Jiang > PySpark support numpy 1.23.X > > >

[jira] [Resolved] (SPARK-39612) The dataframe returned by exceptAll() can no longer perform operations such as count() or isEmpty(), or an exception will be thrown.

2022-07-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39612. -- Fix Version/s: 3.3.1 3.4.0 Resolution: Fixed Issue resolved by pull

[jira] [Commented] (SPARK-39686) Disable scheduled builds that do not pass even once

2022-07-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17562622#comment-17562622 ] Apache Spark commented on SPARK-39686: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-39612) The dataframe returned by exceptAll() can no longer perform operations such as count() or isEmpty(), or an exception will be thrown.

2022-07-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39612: Assignee: Hyukjin Kwon > The dataframe returned by exceptAll() can no longer perform

[jira] [Commented] (SPARK-39686) Disable scheduled builds that do not pass even once

2022-07-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17562620#comment-17562620 ] Apache Spark commented on SPARK-39686: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Resolved] (SPARK-39606) Use child stats to estimate order operator

2022-07-05 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-39606. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36994

[jira] [Assigned] (SPARK-39686) Disable scheduled builds that do not pass even once

2022-07-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39686: Assignee: (was: Apache Spark) > Disable scheduled builds that do not pass even once

[jira] [Assigned] (SPARK-39606) Use child stats to estimate order operator

2022-07-05 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-39606: --- Assignee: Yuming Wang > Use child stats to estimate order operator >

[jira] [Assigned] (SPARK-39686) Disable scheduled builds that do not pass even once

2022-07-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39686: Assignee: Apache Spark > Disable scheduled builds that do not pass even once >

[jira] [Updated] (SPARK-39681) PySpark build broken in branch-3.2 with Scala 2.13

2022-07-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-39681: - Description: https://github.com/apache/spark/runs/7189972241?check_suite_focus=true {code}

[jira] [Created] (SPARK-39686) Disable scheduled builds that do not pass even once

2022-07-05 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-39686: Summary: Disable scheduled builds that do not pass even once Key: SPARK-39686 URL: https://issues.apache.org/jira/browse/SPARK-39686 Project: Spark Issue

[jira] [Updated] (SPARK-39684) Docker IT build broken in master with Hadoop 2

2022-07-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-39684: - Affects Version/s: 3.4.0 (was: 3.2.1) > Docker IT build broken in

[jira] [Created] (SPARK-39685) Linter build broken in branch-3.2 with Scala 2.13

2022-07-05 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-39685: Summary: Linter build broken in branch-3.2 with Scala 2.13 Key: SPARK-39685 URL: https://issues.apache.org/jira/browse/SPARK-39685 Project: Spark Issue

[jira] [Updated] (SPARK-39681) PySpark build broken in branch-3.2 with Scala 2.13

2022-07-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-39681: - Component/s: Tests > PySpark build broken in branch-3.2 with Scala 2.13 >

[jira] [Updated] (SPARK-39682) Docker IT build broken in branch-3.2 with Scala 2.13

2022-07-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-39682: - Component/s: SQL > Docker IT build broken in branch-3.2 with Scala 2.13 >

[jira] [Created] (SPARK-39684) Docker IT build broken in master with Hadoop 2

2022-07-05 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-39684: Summary: Docker IT build broken in master with Hadoop 2 Key: SPARK-39684 URL: https://issues.apache.org/jira/browse/SPARK-39684 Project: Spark Issue Type:

[jira] [Updated] (SPARK-39683) Did not find value which can be converted into java.lang.String

2022-07-05 Thread zehra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zehra updated SPARK-39683: -- Description: Hi, I have a problem with loading the model in pyspark. I wrote it in a detail at this link.

[jira] [Updated] (SPARK-39683) Did not find value which can be converted into java.lang.String

2022-07-05 Thread zehra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zehra updated SPARK-39683: -- Description: Hi, I have a problem with loading the ALS model in pyspark. I wrote it in a detail at this

[jira] [Updated] (SPARK-39683) Did not find value which can be converted into java.lang.String

2022-07-05 Thread zehra (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zehra updated SPARK-39683: -- Description: Hi, I have a problem with loading the model in pyspark. I wrote it in a detail at this link.

[jira] [Created] (SPARK-39683) Did not find value which can be converted into java.lang.String

2022-07-05 Thread zehra (Jira)
zehra created SPARK-39683: - Summary: Did not find value which can be converted into java.lang.String Key: SPARK-39683 URL: https://issues.apache.org/jira/browse/SPARK-39683 Project: Spark Issue

[jira] [Updated] (SPARK-39681) PySpark build broken in branch-3.2 with Scala 2.13

2022-07-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-39681: - Summary: PySpark build broken in branch-3.2 with Scala 2.13 (was: PySpark build in branch-3.2

[jira] [Created] (SPARK-39682) Docker IT build broken in branch-3.2 with Scala 2.13

2022-07-05 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-39682: Summary: Docker IT build broken in branch-3.2 with Scala 2.13 Key: SPARK-39682 URL: https://issues.apache.org/jira/browse/SPARK-39682 Project: Spark Issue

[jira] [Created] (SPARK-39681) PySpark build in branch-3.2 with Scala 2.13 fails

2022-07-05 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-39681: Summary: PySpark build in branch-3.2 with Scala 2.13 fails Key: SPARK-39681 URL: https://issues.apache.org/jira/browse/SPARK-39681 Project: Spark Issue

[jira] [Updated] (SPARK-39677) Wrong args item formatting of the regexp functions

2022-07-05 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-39677: - Fix Version/s: 3.4.0 3.3.1 > Wrong args item formatting of the regexp functions >

[jira] [Resolved] (SPARK-39677) Wrong args item formatting of the regexp functions

2022-07-05 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-39677. -- Resolution: Fixed > Wrong args item formatting of the regexp functions >

[jira] [Commented] (SPARK-37527) Translate more standard aggregate functions for pushdown

2022-07-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17562538#comment-17562538 ] Apache Spark commented on SPARK-37527: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-39579) Make ListFunctions/getFunction/functionExists API compatible

2022-07-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17562520#comment-17562520 ] Apache Spark commented on SPARK-39579: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-39447) Only non-broadcast query stage can propagate empty relation

2022-07-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17562514#comment-17562514 ] Apache Spark commented on SPARK-39447: -- User 'ulysses-you' has created a pull request for this

[jira] [Commented] (SPARK-39680) Remove `hasSpaceForAnotherRecord` from `UnsafeExternalSorter`

2022-07-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17562513#comment-17562513 ] Apache Spark commented on SPARK-39680: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-39680) Remove `hasSpaceForAnotherRecord` from `UnsafeExternalSorter`

2022-07-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39680: Assignee: (was: Apache Spark) > Remove `hasSpaceForAnotherRecord` from

[jira] [Commented] (SPARK-39680) Remove `hasSpaceForAnotherRecord` from `UnsafeExternalSorter`

2022-07-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17562512#comment-17562512 ] Apache Spark commented on SPARK-39680: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-39680) Remove `hasSpaceForAnotherRecord` from `UnsafeExternalSorter`

2022-07-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39680: Assignee: Apache Spark > Remove `hasSpaceForAnotherRecord` from `UnsafeExternalSorter` >

[jira] [Assigned] (SPARK-39612) The dataframe returned by exceptAll() can no longer perform operations such as count() or isEmpty(), or an exception will be thrown.

2022-07-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39612: Assignee: (was: Apache Spark) > The dataframe returned by exceptAll() can no longer

[jira] [Commented] (SPARK-39612) The dataframe returned by exceptAll() can no longer perform operations such as count() or isEmpty(), or an exception will be thrown.

2022-07-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17562511#comment-17562511 ] Apache Spark commented on SPARK-39612: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-39612) The dataframe returned by exceptAll() can no longer perform operations such as count() or isEmpty(), or an exception will be thrown.

2022-07-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39612: Assignee: Apache Spark > The dataframe returned by exceptAll() can no longer perform

[jira] [Assigned] (SPARK-39679) TakeOrderedAndProjectExec should respect child output ordering

2022-07-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39679: Assignee: Apache Spark > TakeOrderedAndProjectExec should respect child output ordering

[jira] [Assigned] (SPARK-39679) TakeOrderedAndProjectExec should respect child output ordering

2022-07-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39679: Assignee: (was: Apache Spark) > TakeOrderedAndProjectExec should respect child

[jira] [Commented] (SPARK-39679) TakeOrderedAndProjectExec should respect child output ordering

2022-07-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17562510#comment-17562510 ] Apache Spark commented on SPARK-39679: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-38531) "Prune unrequired child index" branch of ColumnPruning has wrong condition

2022-07-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38531: Assignee: (was: Apache Spark) > "Prune unrequired child index" branch of

[jira] [Assigned] (SPARK-38531) "Prune unrequired child index" branch of ColumnPruning has wrong condition

2022-07-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38531: Assignee: Apache Spark > "Prune unrequired child index" branch of ColumnPruning has

[jira] [Created] (SPARK-39680) Remove `hasSpaceForAnotherRecord` from `UnsafeExternalSorter`

2022-07-05 Thread Yang Jie (Jira)
Yang Jie created SPARK-39680: Summary: Remove `hasSpaceForAnotherRecord` from `UnsafeExternalSorter` Key: SPARK-39680 URL: https://issues.apache.org/jira/browse/SPARK-39680 Project: Spark Issue

[jira] [Created] (SPARK-39679) TakeOrderedAndProjectExec should respect child output ordering

2022-07-05 Thread XiDuo You (Jira)
XiDuo You created SPARK-39679: - Summary: TakeOrderedAndProjectExec should respect child output ordering Key: SPARK-39679 URL: https://issues.apache.org/jira/browse/SPARK-39679 Project: Spark

[jira] [Commented] (SPARK-38531) "Prune unrequired child index" branch of ColumnPruning has wrong condition

2022-07-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17562496#comment-17562496 ] Hyukjin Kwon commented on SPARK-38531: -- Ah, maybe I should have filed a new JIRA > "Prune

[jira] [Updated] (SPARK-38531) "Prune unrequired child index" branch of ColumnPruning has wrong condition

2022-07-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-38531: - Fix Version/s: (was: 3.3.0) > "Prune unrequired child index" branch of ColumnPruning has

[jira] [Reopened] (SPARK-38531) "Prune unrequired child index" branch of ColumnPruning has wrong condition

2022-07-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-38531: -- Assignee: (was: Min Yang) > "Prune unrequired child index" branch of ColumnPruning has

[jira] [Commented] (SPARK-38531) "Prune unrequired child index" branch of ColumnPruning has wrong condition

2022-07-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17562495#comment-17562495 ] Hyukjin Kwon commented on SPARK-38531: -- Reverted at

[jira] [Updated] (SPARK-38531) "Prune unrequired child index" branch of ColumnPruning has wrong condition

2022-07-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-38531: - Affects Version/s: 3.4.0 3.3.1 > "Prune unrequired child index" branch

[jira] [Assigned] (SPARK-39678) Improve stats estimation for v2 tables

2022-07-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39678: Assignee: (was: Apache Spark) > Improve stats estimation for v2 tables >

[jira] [Commented] (SPARK-39678) Improve stats estimation for v2 tables

2022-07-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17562475#comment-17562475 ] Apache Spark commented on SPARK-39678: -- User 'singhpk234' has created a pull request for this

  1   2   >