[jira] [Assigned] (SPARK-40606) Eliminate `to_pandas` warnings in test

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40606: Assignee: (was: Apache Spark) > Eliminate `to_pandas` warnings in test >

[jira] [Commented] (SPARK-40606) Eliminate `to_pandas` warnings in test

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610809#comment-17610809 ] Apache Spark commented on SPARK-40606: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-40606) Eliminate `to_pandas` warnings in test

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40606: Assignee: Apache Spark > Eliminate `to_pandas` warnings in test >

[jira] [Created] (SPARK-40606) Eliminate `to_pandas` warnings in test

2022-09-28 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-40606: - Summary: Eliminate `to_pandas` warnings in test Key: SPARK-40606 URL: https://issues.apache.org/jira/browse/SPARK-40606 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-40604) Verify the temporary column names in PS

2022-09-28 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-40604. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38040

[jira] [Assigned] (SPARK-40604) Verify the temporary column names in PS

2022-09-28 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-40604: - Assignee: Ruifeng Zheng > Verify the temporary column names in PS >

[jira] [Commented] (SPARK-40605) Connect module should use log4j2.properties to configure test log output as other modules

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610775#comment-17610775 ] Apache Spark commented on SPARK-40605: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-40605) Connect module should use log4j2.properties to configure test log output as other modules

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40605: Assignee: (was: Apache Spark) > Connect module should use log4j2.properties to

[jira] [Assigned] (SPARK-40605) Connect module should use log4j2.properties to configure test log output as other modules

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40605: Assignee: Apache Spark > Connect module should use log4j2.properties to configure test

[jira] [Commented] (SPARK-40605) Connect module should use log4j2.properties to configure test log output as other modules

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610776#comment-17610776 ] Apache Spark commented on SPARK-40605: -- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-40605) Connect module should use log4j2.properties to configure test log output as other modules

2022-09-28 Thread Yang Jie (Jira)
Yang Jie created SPARK-40605: Summary: Connect module should use log4j2.properties to configure test log output as other modules Key: SPARK-40605 URL: https://issues.apache.org/jira/browse/SPARK-40605

[jira] [Commented] (SPARK-40593) protoc-3.21.1-linux-x86_64.exe requires GLIBC_2.14

2022-09-28 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610774#comment-17610774 ] Yang Jie commented on SPARK-40593: -- [~hyukjin.kwon] [~grundprinzip-db] Besides upgrading the default

[jira] [Resolved] (SPARK-40580) Update the document for DataFrame.to_orc

2022-09-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40580. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38018

[jira] [Commented] (SPARK-40604) Verify the temporary column names in PS

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610764#comment-17610764 ] Apache Spark commented on SPARK-40604: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-40604) Verify the temporary column names in PS

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40604: Assignee: Apache Spark > Verify the temporary column names in PS >

[jira] [Commented] (SPARK-40604) Verify the temporary column names in PS

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610761#comment-17610761 ] Apache Spark commented on SPARK-40604: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-40604) Verify the temporary column names in PS

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40604: Assignee: (was: Apache Spark) > Verify the temporary column names in PS >

[jira] [Created] (SPARK-40604) Verify the temporary column names in PS

2022-09-28 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-40604: - Summary: Verify the temporary column names in PS Key: SPARK-40604 URL: https://issues.apache.org/jira/browse/SPARK-40604 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-40580) Update the document for DataFrame.to_orc

2022-09-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40580: Assignee: Haejoon Lee > Update the document for DataFrame.to_orc >

[jira] (SPARK-38723) Test the error class: CONCURRENT_QUERY

2022-09-28 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38723 ] Haejoon Lee deleted comment on SPARK-38723: - was (Author: itholic): I'm working on it :) > Test the error class: CONCURRENT_QUERY > -- > >

[jira] [Comment Edited] (SPARK-39725) Upgrade jetty-http from 9.4.46.v20220331 to 9.4.48.v20220622

2022-09-28 Thread phoebe chen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610741#comment-17610741 ] phoebe chen edited comment on SPARK-39725 at 9/28/22 10:13 PM: ---

[jira] [Commented] (SPARK-39725) Upgrade jetty-http from 9.4.46.v20220331 to 9.4.48.v20220622

2022-09-28 Thread phoebe chen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610741#comment-17610741 ] phoebe chen commented on SPARK-39725: - [~bjornjorgensen][~hyukjin.kwon] Thanks for the quick fix. In

[jira] [Commented] (SPARK-40574) Add PURGE to DROP TABLE doc

2022-09-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610717#comment-17610717 ] Dongjoon Hyun commented on SPARK-40574: --- I updated the Fix Version from 3.3.1 to 3.3.2 because

[jira] [Commented] (SPARK-40583) Documentation error in "Integration with Cloud Infrastructures"

2022-09-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610716#comment-17610716 ] Dongjoon Hyun commented on SPARK-40583: --- I updated the Fix Version from 3.3.1 to 3.3.2 because

[jira] [Commented] (SPARK-40562) Add spark.sql.legacy.groupingIdWithAppendedUserGroupBy

2022-09-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610715#comment-17610715 ] Dongjoon Hyun commented on SPARK-40562: --- I updated the Fix Version from 3.3.1 to 3.3.2 because

[jira] [Commented] (SPARK-38717) Handle Hive's bucket spec case preserving behaviour

2022-09-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610714#comment-17610714 ] Dongjoon Hyun commented on SPARK-38717: --- I updated the Fix Version from 3.3.1 to 3.3.2 because

[jira] [Commented] (SPARK-39200) Stream is corrupted Exception while fetching the blocks from fallback storage system

2022-09-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610711#comment-17610711 ] Dongjoon Hyun commented on SPARK-39200: --- I updated the Fix Version from 3.3.1 to 3.3.2 because

[jira] [Commented] (SPARK-40547) Fix dead links in sparkr-vignettes.Rmd

2022-09-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610712#comment-17610712 ] Dongjoon Hyun commented on SPARK-40547: --- I updated the Fix Version from 3.3.1 to 3.3.2 because

[jira] [Commented] (SPARK-40535) NPE from observe of collect_list

2022-09-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610710#comment-17610710 ] Dongjoon Hyun commented on SPARK-40535: --- I updated the Fix Version from 3.3.1 to 3.3.2 because

[jira] [Updated] (SPARK-40547) Fix dead links in sparkr-vignettes.Rmd

2022-09-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-40547: -- Fix Version/s: 3.3.2 (was: 3.3.1) > Fix dead links in

[jira] [Updated] (SPARK-40535) NPE from observe of collect_list

2022-09-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-40535: -- Fix Version/s: 3.3.2 (was: 3.3.1) > NPE from observe of collect_list >

[jira] [Updated] (SPARK-40322) Fix all dead links

2022-09-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-40322: -- Fix Version/s: 3.3.2 (was: 3.3.1) > Fix all dead links >

[jira] [Updated] (SPARK-39200) Stream is corrupted Exception while fetching the blocks from fallback storage system

2022-09-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39200: -- Fix Version/s: 3.3.2 (was: 3.3.1) > Stream is corrupted Exception

[jira] [Updated] (SPARK-38717) Handle Hive's bucket spec case preserving behaviour

2022-09-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38717: -- Fix Version/s: 3.3.2 (was: 3.3.1) > Handle Hive's bucket spec case

[jira] [Updated] (SPARK-40562) Add spark.sql.legacy.groupingIdWithAppendedUserGroupBy

2022-09-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-40562: -- Fix Version/s: 3.3.2 (was: 3.3.1) > Add

[jira] [Updated] (SPARK-40574) Add PURGE to DROP TABLE doc

2022-09-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-40574: -- Fix Version/s: (was: 3.3.1) 3.3.2 > Add PURGE to DROP TABLE doc >

[jira] [Updated] (SPARK-40583) Documentation error in "Integration with Cloud Infrastructures"

2022-09-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-40583: -- Fix Version/s: 3.3.2 (was: 3.3.1) > Documentation error in

[jira] [Commented] (SPARK-39804) Override Spark Core_2.12 (v3.3.0) logging configuration

2022-09-28 Thread cornel creanga (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610696#comment-17610696 ] cornel creanga commented on SPARK-39804: Spark will only load the default file when no custom

[jira] [Resolved] (SPARK-40595) Improve error message for unused CTE relations

2022-09-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40595. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38029

[jira] [Assigned] (SPARK-40595) Improve error message for unused CTE relations

2022-09-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-40595: Assignee: Wenchen Fan > Improve error message for unused CTE relations >

[jira] [Assigned] (SPARK-40603) throw the original error from catalog implementations

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40603: Assignee: (was: Apache Spark) > throw the original error from catalog

[jira] [Assigned] (SPARK-40603) throw the original error from catalog implementations

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40603: Assignee: Apache Spark > throw the original error from catalog implementations >

[jira] [Commented] (SPARK-40603) throw the original error from catalog implementations

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610643#comment-17610643 ] Apache Spark commented on SPARK-40603: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Created] (SPARK-40603) throw the original error from catalog implementations

2022-09-28 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-40603: --- Summary: throw the original error from catalog implementations Key: SPARK-40603 URL: https://issues.apache.org/jira/browse/SPARK-40603 Project: Spark Issue

[jira] [Assigned] (SPARK-40537) Re-enable mypi supoprt

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40537: Assignee: Apache Spark > Re-enable mypi supoprt > -- > >

[jira] [Commented] (SPARK-40537) Re-enable mypi supoprt

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610594#comment-17610594 ] Apache Spark commented on SPARK-40537: -- User 'grundprinzip' has created a pull request for this

[jira] [Assigned] (SPARK-40537) Re-enable mypi supoprt

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40537: Assignee: (was: Apache Spark) > Re-enable mypi supoprt > -- > >

[jira] [Assigned] (SPARK-40601) Improve error when cogrouping groups with mismatching key sizes

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40601: Assignee: Apache Spark > Improve error when cogrouping groups with mismatching key sizes

[jira] [Commented] (SPARK-40601) Improve error when cogrouping groups with mismatching key sizes

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610588#comment-17610588 ] Apache Spark commented on SPARK-40601: -- User 'EnricoMi' has created a pull request for this issue:

[jira] [Commented] (SPARK-40601) Improve error when cogrouping groups with mismatching key sizes

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610589#comment-17610589 ] Apache Spark commented on SPARK-40601: -- User 'EnricoMi' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40601) Improve error when cogrouping groups with mismatching key sizes

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40601: Assignee: (was: Apache Spark) > Improve error when cogrouping groups with

[jira] [Created] (SPARK-40602) RunTimeException for ETL job

2022-09-28 Thread Zhixian Hu (Jira)
Zhixian Hu created SPARK-40602: -- Summary: RunTimeException for ETL job Key: SPARK-40602 URL: https://issues.apache.org/jira/browse/SPARK-40602 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-40601) Improve error when cogrouping groups with mismatching key sizes

2022-09-28 Thread Enrico Minack (Jira)
Enrico Minack created SPARK-40601: - Summary: Improve error when cogrouping groups with mismatching key sizes Key: SPARK-40601 URL: https://issues.apache.org/jira/browse/SPARK-40601 Project: Spark

[jira] [Commented] (SPARK-40599) Add multiTransform methods to TreeNode to generate alternatives

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610576#comment-17610576 ] Apache Spark commented on SPARK-40599: -- User 'peter-toth' has created a pull request for this

[jira] [Assigned] (SPARK-40599) Add multiTransform methods to TreeNode to generate alternatives

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40599: Assignee: (was: Apache Spark) > Add multiTransform methods to TreeNode to generate

[jira] [Assigned] (SPARK-40599) Add multiTransform methods to TreeNode to generate alternatives

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40599: Assignee: Apache Spark > Add multiTransform methods to TreeNode to generate alternatives

[jira] [Created] (SPARK-40600) Support recursiveFileLookup for partitioned datasource

2022-09-28 Thread Zhen Wang (Jira)
Zhen Wang created SPARK-40600: - Summary: Support recursiveFileLookup for partitioned datasource Key: SPARK-40600 URL: https://issues.apache.org/jira/browse/SPARK-40600 Project: Spark Issue Type:

[jira] [Updated] (SPARK-40599) Add multiTransform methods to TreeNode to generate alternatives

2022-09-28 Thread Peter Toth (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-40599: --- Summary: Add multiTransform methods to TreeNode to generate alternatives (was: Add multiTransform

[jira] [Created] (SPARK-40599) Add multiTransform methods to TreeNode to generate alternative transformations

2022-09-28 Thread Peter Toth (Jira)
Peter Toth created SPARK-40599: -- Summary: Add multiTransform methods to TreeNode to generate alternative transformations Key: SPARK-40599 URL: https://issues.apache.org/jira/browse/SPARK-40599 Project:

[jira] [Commented] (SPARK-40598) Fix plotting features work properly with pandas 1.5.0.

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610552#comment-17610552 ] Apache Spark commented on SPARK-40598: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40598) Fix plotting features work properly with pandas 1.5.0.

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40598: Assignee: (was: Apache Spark) > Fix plotting features work properly with pandas

[jira] [Assigned] (SPARK-40598) Fix plotting features work properly with pandas 1.5.0.

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40598: Assignee: Apache Spark > Fix plotting features work properly with pandas 1.5.0. >

[jira] [Commented] (SPARK-40598) Fix plotting features work properly with pandas 1.5.0.

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610550#comment-17610550 ] Apache Spark commented on SPARK-40598: -- User 'itholic' has created a pull request for this issue:

[jira] [Updated] (SPARK-40598) Fix plotting features work properly with pandas 1.5.0.

2022-09-28 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-40598: Summary: Fix plotting features work properly with pandas 1.5.0. (was: Fix PandasOnSpark*Plot

[jira] [Created] (SPARK-40598) Fix PandasOnSpark*Plot work properly with pandas 1.5.0.

2022-09-28 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-40598: --- Summary: Fix PandasOnSpark*Plot work properly with pandas 1.5.0. Key: SPARK-40598 URL: https://issues.apache.org/jira/browse/SPARK-40598 Project: Spark Issue

[jira] [Commented] (SPARK-40597) local mode should respect TASK_MAX_FAILURES like all other cluster managers

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610526#comment-17610526 ] Apache Spark commented on SPARK-40597: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40597) local mode should respect TASK_MAX_FAILURES like all other cluster managers

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40597: Assignee: (was: Apache Spark) > local mode should respect TASK_MAX_FAILURES like all

[jira] [Assigned] (SPARK-40597) local mode should respect TASK_MAX_FAILURES like all other cluster managers

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40597: Assignee: Apache Spark > local mode should respect TASK_MAX_FAILURES like all other

[jira] [Commented] (SPARK-40597) local mode should respect TASK_MAX_FAILURES like all other cluster managers

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610525#comment-17610525 ] Apache Spark commented on SPARK-40597: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Created] (SPARK-40597) local mode should respect TASK_MAX_FAILURES like all other cluster managers

2022-09-28 Thread Kent Yao (Jira)
Kent Yao created SPARK-40597: Summary: local mode should respect TASK_MAX_FAILURES like all other cluster managers Key: SPARK-40597 URL: https://issues.apache.org/jira/browse/SPARK-40597 Project: Spark

[jira] [Commented] (SPARK-40589) Fix test for `DataFrame.corr_with` to skip the pandas regression

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610497#comment-17610497 ] Apache Spark commented on SPARK-40589: -- User 'itholic' has created a pull request for this issue:

[jira] [Commented] (SPARK-40589) Fix test for `DataFrame.corr_with` to skip the pandas regression

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610498#comment-17610498 ] Apache Spark commented on SPARK-40589: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40589) Fix test for `DataFrame.corr_with` to skip the pandas regression

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40589: Assignee: (was: Apache Spark) > Fix test for `DataFrame.corr_with` to skip the

[jira] [Assigned] (SPARK-40589) Fix test for `DataFrame.corr_with` to skip the pandas regression

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40589: Assignee: Apache Spark > Fix test for `DataFrame.corr_with` to skip the pandas

[jira] [Updated] (SPARK-40589) Fix test for `DataFrame.corr_with` to skip the pandas regression

2022-09-28 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-40589: Description: There is a regression in pandas 1.5.0 for DataFrame.corrwith

[jira] [Updated] (SPARK-40589) Fix test for `DataFrame.corr_with` to skip the pandas regression

2022-09-28 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-40589: Summary: Fix test for `DataFrame.corr_with` to skip the pandas regression (was: Fix

[jira] [Commented] (SPARK-40596) Populate ExecutorDecommission with more informative messages

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610491#comment-17610491 ] Apache Spark commented on SPARK-40596: -- User 'bozhang2820' has created a pull request for this

[jira] [Commented] (SPARK-40596) Populate ExecutorDecommission with more informative messages

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610490#comment-17610490 ] Apache Spark commented on SPARK-40596: -- User 'bozhang2820' has created a pull request for this

[jira] [Assigned] (SPARK-40596) Populate ExecutorDecommission with more informative messages

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40596: Assignee: (was: Apache Spark) > Populate ExecutorDecommission with more informative

[jira] [Created] (SPARK-40596) Populate ExecutorDecommission with more informative messages

2022-09-28 Thread Bo Zhang (Jira)
Bo Zhang created SPARK-40596: Summary: Populate ExecutorDecommission with more informative messages Key: SPARK-40596 URL: https://issues.apache.org/jira/browse/SPARK-40596 Project: Spark Issue

[jira] [Updated] (SPARK-40594) Eagerly release hashed relation in ShuffledHashJoin

2022-09-28 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-40594: -- Description: ShuffledHashJoin releases the built hashed relation at the end of task using

[jira] [Updated] (SPARK-40593) protoc-3.21.1-linux-x86_64.exe requires GLIBC_2.14

2022-09-28 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-40593: - Priority: Minor (was: Major) > protoc-3.21.1-linux-x86_64.exe requires GLIBC_2.14 >

[jira] [Commented] (SPARK-40593) protoc-3.21.1-linux-x86_64.exe requires GLIBC_2.14

2022-09-28 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610448#comment-17610448 ] Yang Jie commented on SPARK-40593: -- This requirement should be declared in a document   >

[jira] [Commented] (SPARK-40595) Improve error message for unused CTE relations

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610432#comment-17610432 ] Apache Spark commented on SPARK-40595: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40595) Improve error message for unused CTE relations

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40595: Assignee: (was: Apache Spark) > Improve error message for unused CTE relations >

[jira] [Assigned] (SPARK-40595) Improve error message for unused CTE relations

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40595: Assignee: Apache Spark > Improve error message for unused CTE relations >

[jira] [Commented] (SPARK-40595) Improve error message for unused CTE relations

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610429#comment-17610429 ] Apache Spark commented on SPARK-40595: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-40442) Unstable Spark history server: DB is closed

2022-09-28 Thread Santosh Pingale (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610427#comment-17610427 ] Santosh Pingale edited comment on SPARK-40442 at 9/28/22 8:30 AM: --

[jira] [Resolved] (SPARK-40592) Implement `min_count` in `GroupBy.max`

2022-09-28 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-40592. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38026

[jira] [Commented] (SPARK-40442) Unstable Spark history server: DB is closed

2022-09-28 Thread Santosh Pingale (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610427#comment-17610427 ] Santosh Pingale commented on SPARK-40442: - {code:java} 2022-09-28 10:20:57,000 WARN 

[jira] [Created] (SPARK-40595) Improve error message for unused CTE relations

2022-09-28 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-40595: --- Summary: Improve error message for unused CTE relations Key: SPARK-40595 URL: https://issues.apache.org/jira/browse/SPARK-40595 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-40592) Implement `min_count` in `GroupBy.max`

2022-09-28 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-40592: - Assignee: Ruifeng Zheng > Implement `min_count` in `GroupBy.max` >

[jira] [Commented] (SPARK-40435) Add test suites for applyInPandasWithState in PySpark

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610407#comment-17610407 ] Apache Spark commented on SPARK-40435: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-40435) Add test suites for applyInPandasWithState in PySpark

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610408#comment-17610408 ] Apache Spark commented on SPARK-40435: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-40509) Construct an example of applyInPandasWithState in examples directory

2022-09-28 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-40509: Assignee: Chaoqin Li > Construct an example of applyInPandasWithState in examples

[jira] [Resolved] (SPARK-40509) Construct an example of applyInPandasWithState in examples directory

2022-09-28 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-40509. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38013

[jira] [Commented] (SPARK-40540) Migrate compilation errors onto error classes

2022-09-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17610395#comment-17610395 ] Apache Spark commented on SPARK-40540: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Created] (SPARK-40594) Eagerly release hashed relation in ShuffledHashJoin

2022-09-28 Thread XiDuo You (Jira)
XiDuo You created SPARK-40594: - Summary: Eagerly release hashed relation in ShuffledHashJoin Key: SPARK-40594 URL: https://issues.apache.org/jira/browse/SPARK-40594 Project: Spark Issue Type:

[jira] [Created] (SPARK-40593) protoc-3.21.1-linux-x86_64.exe requires GLIBC_2.14

2022-09-28 Thread Yang Jie (Jira)
Yang Jie created SPARK-40593: Summary: protoc-3.21.1-linux-x86_64.exe requires GLIBC_2.14 Key: SPARK-40593 URL: https://issues.apache.org/jira/browse/SPARK-40593 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-40575) Add badges for PySpark downloads

2022-09-28 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-40575. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38014

  1   2   >