[jira] [Commented] (SPARK-42680) Create the helper function withSQLConf for connect's test

2023-03-05 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696739#comment-17696739 ] jiaan.geng commented on SPARK-42680: I'm working on. > Create the helper function withSQLConf for

[jira] [Resolved] (SPARK-42678) Create the helper function withSQLConf for connect's test

2023-03-05 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng resolved SPARK-42678. Resolution: Duplicate > Create the helper function withSQLConf for connect's test >

[jira] [Created] (SPARK-42680) Create the helper function withSQLConf for connect's test

2023-03-05 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-42680: -- Summary: Create the helper function withSQLConf for connect's test Key: SPARK-42680 URL: https://issues.apache.org/jira/browse/SPARK-42680 Project: Spark Issue

[jira] [Commented] (SPARK-42678) Create the helper function withSQLConf for connect's test

2023-03-05 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696738#comment-17696738 ] jiaan.geng commented on SPARK-42678: https://issues.apache.org/jira/browse/SPARK-42680 duplicated >

[jira] [Updated] (SPARK-42678) Create the helper function withSQLConf for connect's test

2023-03-05 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-42678: --- Parent: (was: SPARK-42554) Issue Type: New Feature (was: Sub-task) > Create the helper

[jira] [Created] (SPARK-42679) createDataFrame doesn't work with non-nullable schema.

2023-03-05 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-42679: --- Summary: createDataFrame doesn't work with non-nullable schema. Key: SPARK-42679 URL: https://issues.apache.org/jira/browse/SPARK-42679 Project: Spark Issue

[jira] [Resolved] (SPARK-42676) Write temp checkpoints for streaming queries to local filesystem even if default FS is set differently

2023-03-05 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-42676. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40292

[jira] [Assigned] (SPARK-42676) Write temp checkpoints for streaming queries to local filesystem even if default FS is set differently

2023-03-05 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-42676: Assignee: Anish Shrigondekar > Write temp checkpoints for streaming queries to local

[jira] [Commented] (SPARK-40610) Spark fall back to use getPartitions instead of getPartitionsByFilter when date_add functions used in where clause

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696716#comment-17696716 ] Apache Spark commented on SPARK-40610: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40610) Spark fall back to use getPartitions instead of getPartitionsByFilter when date_add functions used in where clause

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40610: Assignee: Apache Spark > Spark fall back to use getPartitions instead of

[jira] [Assigned] (SPARK-40610) Spark fall back to use getPartitions instead of getPartitionsByFilter when date_add functions used in where clause

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40610: Assignee: (was: Apache Spark) > Spark fall back to use getPartitions instead of

[jira] [Commented] (SPARK-40610) Spark fall back to use getPartitions instead of getPartitionsByFilter when date_add functions used in where clause

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696715#comment-17696715 ] Apache Spark commented on SPARK-40610: -- User 'wangyum' has created a pull request for this issue:

[jira] [Updated] (SPARK-42673) Make build/mvn build Spark only with the verified maven version

2023-03-05 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42673: - Summary: Make build/mvn build Spark only with the verified maven version (was: Ban maven 3.9.x for

[jira] [Resolved] (SPARK-41874) Implement DataFrame `sameSemantics`

2023-03-05 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41874. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40228

[jira] [Created] (SPARK-42678) Create the helper function withSQLConf for connect's test

2023-03-05 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-42678: -- Summary: Create the helper function withSQLConf for connect's test Key: SPARK-42678 URL: https://issues.apache.org/jira/browse/SPARK-42678 Project: Spark Issue

[jira] [Commented] (SPARK-42677) Fix the invalid tests for broadcast hint

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696687#comment-17696687 ] Apache Spark commented on SPARK-42677: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42677) Fix the invalid tests for broadcast hint

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42677: Assignee: Apache Spark > Fix the invalid tests for broadcast hint >

[jira] [Commented] (SPARK-42677) Fix the invalid tests for broadcast hint

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696686#comment-17696686 ] Apache Spark commented on SPARK-42677: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42677) Fix the invalid tests for broadcast hint

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42677: Assignee: (was: Apache Spark) > Fix the invalid tests for broadcast hint >

[jira] [Updated] (SPARK-42677) Fix the invalid tests for broadcast hint

2023-03-05 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-42677: --- Description: Currently, there are a lot of test cases for broadcast hint is invalid. Because the

[jira] [Updated] (SPARK-42677) Fix the invalid tests for broadcast hint

2023-03-05 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-42677: --- Description: Currently, there are a lot of test cases for > Fix the invalid tests for broadcast

[jira] [Created] (SPARK-42677) Fix the invalid tests for broadcast hint

2023-03-05 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-42677: -- Summary: Fix the invalid tests for broadcast hint Key: SPARK-42677 URL: https://issues.apache.org/jira/browse/SPARK-42677 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-42676) Write temp checkpoints for streaming queries to local filesystem even if default FS is set differently

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696680#comment-17696680 ] Apache Spark commented on SPARK-42676: -- User 'anishshri-db' has created a pull request for this

[jira] [Commented] (SPARK-42676) Write temp checkpoints for streaming queries to local filesystem even if default FS is set differently

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696678#comment-17696678 ] Apache Spark commented on SPARK-42676: -- User 'anishshri-db' has created a pull request for this

[jira] [Assigned] (SPARK-42676) Write temp checkpoints for streaming queries to local filesystem even if default FS is set differently

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42676: Assignee: (was: Apache Spark) > Write temp checkpoints for streaming queries to

[jira] [Assigned] (SPARK-42676) Write temp checkpoints for streaming queries to local filesystem even if default FS is set differently

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42676: Assignee: Apache Spark > Write temp checkpoints for streaming queries to local

[jira] [Resolved] (SPARK-34145) Combine scalar subqueries

2023-03-05 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-34145. - Resolution: Not A Problem Issue fixed through SPARK-34079. > Combine scalar subqueries >

[jira] [Resolved] (SPARK-34117) Disable LeftSemi/LeftAnti push down over Aggregate

2023-03-05 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-34117. - Resolution: Not A Problem Issue fixed through SPARK-34081. > Disable LeftSemi/LeftAnti push

[jira] [Commented] (SPARK-42676) Write temp checkpoints for streaming queries to local filesystem even if default FS is set differently

2023-03-05 Thread Anish Shrigondekar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696672#comment-17696672 ] Anish Shrigondekar commented on SPARK-42676: Will send the PR soon    cc - [~kabhwan]  >

[jira] [Created] (SPARK-42676) Write temp checkpoints for streaming queries to local filesystem even if default FS is set differently

2023-03-05 Thread Anish Shrigondekar (Jira)
Anish Shrigondekar created SPARK-42676: -- Summary: Write temp checkpoints for streaming queries to local filesystem even if default FS is set differently Key: SPARK-42676 URL:

[jira] [Assigned] (SPARK-42578) Add JDBC to DataFrameWriter

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42578: Assignee: (was: Apache Spark) > Add JDBC to DataFrameWriter >

[jira] [Assigned] (SPARK-42578) Add JDBC to DataFrameWriter

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42578: Assignee: Apache Spark > Add JDBC to DataFrameWriter > --- > >

[jira] [Commented] (SPARK-42578) Add JDBC to DataFrameWriter

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696671#comment-17696671 ] Apache Spark commented on SPARK-42578: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-42478) Make a serializable jobTrackerId instead of a non-serializable JobID in FileWriterFactory

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696668#comment-17696668 ] Apache Spark commented on SPARK-42478: -- User 'Yikf' has created a pull request for this issue:

[jira] [Commented] (SPARK-42478) Make a serializable jobTrackerId instead of a non-serializable JobID in FileWriterFactory

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696667#comment-17696667 ] Apache Spark commented on SPARK-42478: -- User 'Yikf' has created a pull request for this issue:

[jira] [Commented] (SPARK-42478) Make a serializable jobTrackerId instead of a non-serializable JobID in FileWriterFactory

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1769#comment-1769 ] Apache Spark commented on SPARK-42478: -- User 'Yikf' has created a pull request for this issue:

[jira] [Commented] (SPARK-42650) link issue SPARK-42550

2023-03-05 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696665#comment-17696665 ] Yuming Wang commented on SPARK-42650: - It seems to be caused by

[jira] [Assigned] (SPARK-42496) Introduction Spark Connect at main page.

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42496: Assignee: (was: Apache Spark) > Introduction Spark Connect at main page. >

[jira] [Assigned] (SPARK-42496) Introduction Spark Connect at main page.

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42496: Assignee: Apache Spark > Introduction Spark Connect at main page. >

[jira] [Commented] (SPARK-42496) Introduction Spark Connect at main page.

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696655#comment-17696655 ] Apache Spark commented on SPARK-42496: -- User 'itholic' has created a pull request for this issue:

[jira] [Resolved] (SPARK-42654) Upgrade dropwizard metrics 4.2.17

2023-03-05 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-42654. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40254

[jira] [Updated] (SPARK-42654) Upgrade dropwizard metrics 4.2.17

2023-03-05 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-42654: - Priority: Trivial (was: Major) > Upgrade dropwizard metrics 4.2.17 >

[jira] [Assigned] (SPARK-42654) Upgrade dropwizard metrics 4.2.17

2023-03-05 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-42654: Assignee: Yang Jie > Upgrade dropwizard metrics 4.2.17 >

[jira] [Resolved] (SPARK-41527) Implement DataFrame.observe

2023-03-05 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-41527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-41527. --- Fix Version/s: 3.4.1 Assignee: jiaan.geng Resolution: Fixed >

[jira] [Assigned] (SPARK-42558) Implement DataFrameStatFunctions

2023-03-05 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-42558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell reassigned SPARK-42558: - Assignee: Yang Jie > Implement DataFrameStatFunctions >

[jira] [Resolved] (SPARK-42558) Implement DataFrameStatFunctions

2023-03-05 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-42558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-42558. --- Fix Version/s: 3.4.1 Resolution: Fixed > Implement DataFrameStatFunctions >

[jira] [Resolved] (SPARK-42557) Add Broadcast to functions

2023-03-05 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-42557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-42557. --- Fix Version/s: 3.4.1 Assignee: jiaan.geng Resolution: Fixed > Add

[jira] [Resolved] (SPARK-42671) Fix bug for createDataFrame from complex type schema

2023-03-05 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-42671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-42671. --- Fix Version/s: 3.4.1 Assignee: BingKun Pan Resolution: Fixed > Fix

[jira] [Updated] (SPARK-42671) Fix bug for createDataFrame from complex type schema

2023-03-05 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-42671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell updated SPARK-42671: -- Epic Link: SPARK-42554 > Fix bug for createDataFrame from complex type schema >

[jira] [Assigned] (SPARK-42562) UnresolvedLambdaVariables in python do not need unique names

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42562: Assignee: (was: Apache Spark) > UnresolvedLambdaVariables in python do not need

[jira] [Commented] (SPARK-42562) UnresolvedLambdaVariables in python do not need unique names

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696647#comment-17696647 ] Apache Spark commented on SPARK-42562: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42562) UnresolvedLambdaVariables in python do not need unique names

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42562: Assignee: Apache Spark > UnresolvedLambdaVariables in python do not need unique names >

[jira] (SPARK-42562) UnresolvedLambdaVariables in python do not need unique names

2023-03-05 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42562 ] jiaan.geng deleted comment on SPARK-42562: was (Author: beliefer): I will take a look! > UnresolvedLambdaVariables in python do not need unique names >

[jira] [Commented] (SPARK-42650) link issue SPARK-42550

2023-03-05 Thread kevinshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696645#comment-17696645 ] kevinshin commented on SPARK-42650: --- Thanks [~ulysses] , I can reproduced it without any spark's

[jira] [Assigned] (SPARK-42674) Upgrade scalafmt from 3.7.1 to 3.7.2

2023-03-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42674: Assignee: BingKun Pan > Upgrade scalafmt from 3.7.1 to 3.7.2 >

[jira] [Resolved] (SPARK-42674) Upgrade scalafmt from 3.7.1 to 3.7.2

2023-03-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42674. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40284

[jira] [Resolved] (SPARK-42675) Should clean up temp view after test

2023-03-05 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-42675. - Fix Version/s: 3.4.0 Assignee: Yang Jie (was: Apache Spark) Resolution: Fixed

[jira] [Commented] (SPARK-40610) Spark fall back to use getPartitions instead of getPartitionsByFilter when date_add functions used in where clause

2023-03-05 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696634#comment-17696634 ] Yuming Wang commented on SPARK-40610: - This is because of

[jira] [Commented] (SPARK-42577) A large stage could run indefinitely due to executor lost

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696570#comment-17696570 ] Apache Spark commented on SPARK-42577: -- User 'ivoson' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42577) A large stage could run indefinitely due to executor lost

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42577: Assignee: (was: Apache Spark) > A large stage could run indefinitely due to executor

[jira] [Commented] (SPARK-42577) A large stage could run indefinitely due to executor lost

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696569#comment-17696569 ] Apache Spark commented on SPARK-42577: -- User 'ivoson' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42577) A large stage could run indefinitely due to executor lost

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42577: Assignee: Apache Spark > A large stage could run indefinitely due to executor lost >

[jira] [Assigned] (SPARK-42675) Should clean up temp view after test

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42675: Assignee: (was: Apache Spark) > Should clean up temp view after test >

[jira] [Commented] (SPARK-42675) Should clean up temp view after test

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696564#comment-17696564 ] Apache Spark commented on SPARK-42675: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-42675) Should clean up temp view after test

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42675: Assignee: Apache Spark > Should clean up temp view after test >

[jira] [Assigned] (SPARK-42675) Should clean up temp view after test

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42675: Assignee: Apache Spark > Should clean up temp view after test >

[jira] [Created] (SPARK-42675) Should clean up temp view after test

2023-03-05 Thread Yang Jie (Jira)
Yang Jie created SPARK-42675: Summary: Should clean up temp view after test Key: SPARK-42675 URL: https://issues.apache.org/jira/browse/SPARK-42675 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-34145) Combine scalar subqueries

2023-03-05 Thread Sujith Chacko (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696545#comment-17696545 ] Sujith Chacko commented on SPARK-34145: --- [~yumwang]  Is anyone working on this feature? > Combine

[jira] [Commented] (SPARK-27714) Support Join Reorder based on Genetic Algorithm when the # of joined tables > 12

2023-03-05 Thread Sujith Chacko (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696543#comment-17696543 ] Sujith Chacko commented on SPARK-27714: --- [~xinxianyin]  any work is in progress for this issue? I

[jira] [Comment Edited] (SPARK-34117) Disable LeftSemi/LeftAnti push down over Aggregate

2023-03-05 Thread Sujith Chacko (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696541#comment-17696541 ] Sujith Chacko edited comment on SPARK-34117 at 3/5/23 8:57 AM: --- [~yumwang]

[jira] [Commented] (SPARK-34117) Disable LeftSemi/LeftAnti push down over Aggregate

2023-03-05 Thread Sujith Chacko (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696541#comment-17696541 ] Sujith Chacko commented on SPARK-34117: --- Is any work going for this improvement, do we have any PR

[jira] [Assigned] (SPARK-42674) Upgrade scalafmt from 3.7.1 to 3.7.2

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42674: Assignee: (was: Apache Spark) > Upgrade scalafmt from 3.7.1 to 3.7.2 >

[jira] [Assigned] (SPARK-42674) Upgrade scalafmt from 3.7.1 to 3.7.2

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42674: Assignee: Apache Spark > Upgrade scalafmt from 3.7.1 to 3.7.2 >

[jira] [Commented] (SPARK-42674) Upgrade scalafmt from 3.7.1 to 3.7.2

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696539#comment-17696539 ] Apache Spark commented on SPARK-42674: -- User 'panbingkun' has created a pull request for this

[jira] [Updated] (SPARK-42673) Ban maven 3.9.x for Spark Build

2023-03-05 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42673: - Description: GA  (was: {code:java} [ERROR] An error occurred attempting to read POM

[jira] [Resolved] (SPARK-42646) Upgrad cyclonedx from 2.7.3 to 2.7.5

2023-03-05 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan resolved SPARK-42646. - Resolution: Duplicate > Upgrad cyclonedx from 2.7.3 to 2.7.5 >

[jira] [Created] (SPARK-42674) Upgrade scalafmt from 3.7.1 to 3.7.2

2023-03-05 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-42674: --- Summary: Upgrade scalafmt from 3.7.1 to 3.7.2 Key: SPARK-42674 URL: https://issues.apache.org/jira/browse/SPARK-42674 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-42673) Ban maven 3.9.x for Spark Build

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42673: Assignee: (was: Apache Spark) > Ban maven 3.9.x for Spark Build >

[jira] [Assigned] (SPARK-42673) Ban maven 3.9.x for Spark Build

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42673: Assignee: Apache Spark > Ban maven 3.9.x for Spark Build >

[jira] [Commented] (SPARK-42673) Ban maven 3.9.x for Spark Build

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696537#comment-17696537 ] Apache Spark commented on SPARK-42673: -- User 'LuciferYang' has created a pull request for this

[jira] [Updated] (SPARK-42673) Ban maven 3.9.x for Spark Build

2023-03-05 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42673: - Description: {code:java} [ERROR] An error occurred attempting to read POM

[jira] [Created] (SPARK-42673) Ban maven 3.9.x for Spark Build

2023-03-05 Thread Yang Jie (Jira)
Yang Jie created SPARK-42673: Summary: Ban maven 3.9.x for Spark Build Key: SPARK-42673 URL: https://issues.apache.org/jira/browse/SPARK-42673 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-42672) Document error class list

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696536#comment-17696536 ] Apache Spark commented on SPARK-42672: -- User 'itholic' has created a pull request for this issue:

[jira] [Commented] (SPARK-42672) Document error class list

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696535#comment-17696535 ] Apache Spark commented on SPARK-42672: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42672) Document error class list

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42672: Assignee: (was: Apache Spark) > Document error class list >

[jira] [Assigned] (SPARK-42672) Document error class list

2023-03-05 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42672: Assignee: Apache Spark > Document error class list > - > >