[jira] [Assigned] (SPARK-35483) Add a new GA test job for the docker integration tests

[ https://issues.apache.org/jira/browse/SPARK-35483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35483: Assignee: Apache Spark (was: Kousuke Saruta) > Add a new GA test job for the docker

[jira] [Assigned] (SPARK-35483) Add a new GA test job for the docker integration tests

[ https://issues.apache.org/jira/browse/SPARK-35483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35483: Assignee: Kousuke Saruta (was: Apache Spark) > Add a new GA test job for the docker

[jira] [Reopened] (SPARK-35483) Add a new GA test job for the docker integration tests

[ https://issues.apache.org/jira/browse/SPARK-35483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-35483: -- Reverted at https://github.com/apache/spark/commit/d189cf75f99dff4211afc4e318b4399c5c6e8219 >

[jira] [Updated] (SPARK-35483) Add a new GA test job for the docker integration tests

[ https://issues.apache.org/jira/browse/SPARK-35483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-35483: - Fix Version/s: (was: 3.2.0) > Add a new GA test job for the docker integration tests >

[jira] [Commented] (SPARK-35510) Reenable test_stats_on_non_numeric_columns_should_be_discarded_if_numeric_only_is_true

[ https://issues.apache.org/jira/browse/SPARK-35510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17352966#comment-17352966 ] Apache Spark commented on SPARK-35510: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-35510) Reenable test_stats_on_non_numeric_columns_should_be_discarded_if_numeric_only_is_true

[ https://issues.apache.org/jira/browse/SPARK-35510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35510: Assignee: (was: Apache Spark) > Reenable >

[jira] [Commented] (SPARK-35510) Reenable test_stats_on_non_numeric_columns_should_be_discarded_if_numeric_only_is_true

[ https://issues.apache.org/jira/browse/SPARK-35510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17352965#comment-17352965 ] Apache Spark commented on SPARK-35510: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-35510) Reenable test_stats_on_non_numeric_columns_should_be_discarded_if_numeric_only_is_true

[ https://issues.apache.org/jira/browse/SPARK-35510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35510: Assignee: Apache Spark > Reenable >

[jira] [Created] (SPARK-35554) Support outer references in Aggregate

Allison Wang created SPARK-35554: Summary: Support outer references in Aggregate Key: SPARK-35554 URL: https://issues.apache.org/jira/browse/SPARK-35554 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-35552) Make query stage materialized more readable

[ https://issues.apache.org/jira/browse/SPARK-35552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35552: Assignee: (was: Apache Spark) > Make query stage materialized more readable >

[jira] [Assigned] (SPARK-35552) Make query stage materialized more readable

[ https://issues.apache.org/jira/browse/SPARK-35552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35552: Assignee: Apache Spark > Make query stage materialized more readable >

[jira] [Commented] (SPARK-35552) Make query stage materialized more readable

[ https://issues.apache.org/jira/browse/SPARK-35552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17352962#comment-17352962 ] Apache Spark commented on SPARK-35552: -- User 'ulysses-you' has created a pull request for this

[jira] [Commented] (SPARK-35552) Make query stage materialized more readable

[ https://issues.apache.org/jira/browse/SPARK-35552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17352963#comment-17352963 ] Apache Spark commented on SPARK-35552: -- User 'ulysses-you' has created a pull request for this

[jira] [Updated] (SPARK-34974) Improve the subquery decorrelation framework

[ https://issues.apache.org/jira/browse/SPARK-34974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-34974: - Parent: SPARK-35553 Issue Type: Sub-task (was: Improvement) > Improve the subquery

[jira] [Created] (SPARK-35553) Improve correlated subquery

Allison Wang created SPARK-35553: Summary: Improve correlated subquery Key: SPARK-35553 URL: https://issues.apache.org/jira/browse/SPARK-35553 Project: Spark Issue Type: Umbrella

[jira] [Updated] (SPARK-35553) Improve correlated subquery

[ https://issues.apache.org/jira/browse/SPARK-35553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-35553: - Description: This umbrella ticket is used to keep track of correlated subquery improvements and

[jira] [Created] (SPARK-35552) Make query stage materialized more readable

XiDuo You created SPARK-35552: - Summary: Make query stage materialized more readable Key: SPARK-35552 URL: https://issues.apache.org/jira/browse/SPARK-35552 Project: Spark Issue Type:

[jira] [Created] (SPARK-35551) Handle the COUNT bug when rewriting lateral subqueries

Allison Wang created SPARK-35551: Summary: Handle the COUNT bug when rewriting lateral subqueries Key: SPARK-35551 URL: https://issues.apache.org/jira/browse/SPARK-35551 Project: Spark Issue

[jira] [Resolved] (SPARK-35530) Fix rounding error in DifferentiableLossAggregatorSuite with Java 11

[ https://issues.apache.org/jira/browse/SPARK-35530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35530. -- Fix Version/s: 3.2.0 Resolution: Fixed fixed in

[jira] [Assigned] (SPARK-35550) Upgrade Jackson to 2.12.3

[ https://issues.apache.org/jira/browse/SPARK-35550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35550: Assignee: Apache Spark > Upgrade Jackson to 2.12.3 > - > >

[jira] [Commented] (SPARK-35550) Upgrade Jackson to 2.12.3

[ https://issues.apache.org/jira/browse/SPARK-35550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17352927#comment-17352927 ] Apache Spark commented on SPARK-35550: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-35550) Upgrade Jackson to 2.12.3

[ https://issues.apache.org/jira/browse/SPARK-35550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35550: Assignee: (was: Apache Spark) > Upgrade Jackson to 2.12.3 >

[jira] [Updated] (SPARK-35550) Upgrade Jackson to 2.12.3

[ https://issues.apache.org/jira/browse/SPARK-35550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-35550: - Description: Bring some bug fixes like: *

[jira] [Updated] (SPARK-35550) Upgrade Jackson to 2.12.3

[ https://issues.apache.org/jira/browse/SPARK-35550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-35550: - Description: Bring some bug fixes like: *

[jira] [Created] (SPARK-35550) Upgrade Jackson to 2.12.3

Yang Jie created SPARK-35550: Summary: Upgrade Jackson to 2.12.3 Key: SPARK-35550 URL: https://issues.apache.org/jira/browse/SPARK-35550 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-35549) Register merge status even after shuffle dependency is merge finalized

Venkata krishnan Sowrirajan created SPARK-35549: --- Summary: Register merge status even after shuffle dependency is merge finalized Key: SPARK-35549 URL:

[jira] [Created] (SPARK-35548) Handling new attempt has started error message in BlockPushErrorHandler in client

Ye Zhou created SPARK-35548: --- Summary: Handling new attempt has started error message in BlockPushErrorHandler in client Key: SPARK-35548 URL: https://issues.apache.org/jira/browse/SPARK-35548 Project:

[jira] [Created] (SPARK-35547) Support push based shuffle when barrier scheduling is enabled

Venkata krishnan Sowrirajan created SPARK-35547: --- Summary: Support push based shuffle when barrier scheduling is enabled Key: SPARK-35547 URL: https://issues.apache.org/jira/browse/SPARK-35547

[jira] [Created] (SPARK-35546) Handling race condition and memory leak in RemoteBlockPushResolver

Ye Zhou created SPARK-35546: --- Summary: Handling race condition and memory leak in RemoteBlockPushResolver Key: SPARK-35546 URL: https://issues.apache.org/jira/browse/SPARK-35546 Project: Spark

[jira] [Resolved] (SPARK-35483) Add a new GA test job for the docker integration tests

[ https://issues.apache.org/jira/browse/SPARK-35483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35483. -- Fix Version/s: 3.2.0 Assignee: Kousuke Saruta Resolution: Fixed Fixed in

[jira] [Commented] (SPARK-35545) Split SubqueryExpression's children field into outer attributes and join conditions

[ https://issues.apache.org/jira/browse/SPARK-35545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17352778#comment-17352778 ] Apache Spark commented on SPARK-35545: -- User 'allisonwang-db' has created a pull request for this

[jira] [Assigned] (SPARK-35545) Split SubqueryExpression's children field into outer attributes and join conditions

[ https://issues.apache.org/jira/browse/SPARK-35545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35545: Assignee: Apache Spark > Split SubqueryExpression's children field into outer attributes

[jira] [Assigned] (SPARK-35545) Split SubqueryExpression's children field into outer attributes and join conditions

[ https://issues.apache.org/jira/browse/SPARK-35545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35545: Assignee: (was: Apache Spark) > Split SubqueryExpression's children field into outer

[jira] [Commented] (SPARK-35545) Split SubqueryExpression's children field into outer attributes and join conditions

[ https://issues.apache.org/jira/browse/SPARK-35545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17352777#comment-17352777 ] Apache Spark commented on SPARK-35545: -- User 'allisonwang-db' has created a pull request for this

[jira] [Created] (SPARK-35545) Split SubqueryExpression's children field into outer attributes and join conditions

Allison Wang created SPARK-35545: Summary: Split SubqueryExpression's children field into outer attributes and join conditions Key: SPARK-35545 URL: https://issues.apache.org/jira/browse/SPARK-35545

[jira] [Assigned] (SPARK-35544) Add tree pattern pruning into Analyzer rules

[ https://issues.apache.org/jira/browse/SPARK-35544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35544: Assignee: (was: Apache Spark) > Add tree pattern pruning into Analyzer rules >

[jira] [Assigned] (SPARK-35544) Add tree pattern pruning into Analyzer rules

[ https://issues.apache.org/jira/browse/SPARK-35544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35544: Assignee: Apache Spark > Add tree pattern pruning into Analyzer rules >

[jira] [Commented] (SPARK-35544) Add tree pattern pruning into Analyzer rules

[ https://issues.apache.org/jira/browse/SPARK-35544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17352696#comment-17352696 ] Apache Spark commented on SPARK-35544: -- User 'sigmod' has created a pull request for this issue:

[jira] [Created] (SPARK-35544) Add tree pattern pruning into Analyzer rules

Yingyi Bu created SPARK-35544: - Summary: Add tree pattern pruning into Analyzer rules Key: SPARK-35544 URL: https://issues.apache.org/jira/browse/SPARK-35544 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-35541) Simplify OptimizeSkewedJoin

[ https://issues.apache.org/jira/browse/SPARK-35541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-35541: --- Assignee: Wenchen Fan > Simplify OptimizeSkewedJoin > --- > >

[jira] [Resolved] (SPARK-35541) Simplify OptimizeSkewedJoin

[ https://issues.apache.org/jira/browse/SPARK-35541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-35541. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32685

[jira] [Resolved] (SPARK-35172) The implementation of RocksDBCheckpointMetadata

[ https://issues.apache.org/jira/browse/SPARK-35172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-35172. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32272

[jira] [Assigned] (SPARK-33428) Match the behavior of conv function to MySQL's

[ https://issues.apache.org/jira/browse/SPARK-33428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33428: --- Assignee: dc-heros > Match the behavior of conv function to MySQL's >

[jira] [Updated] (SPARK-33428) Match the behavior of conv function to MySQL's

[ https://issues.apache.org/jira/browse/SPARK-33428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-33428: Summary: Match the behavior of conv function to MySQL's (was: conv UDF returns incorrect value)

[jira] [Updated] (SPARK-33428) Match the behavior of conv function to MySQL's

[ https://issues.apache.org/jira/browse/SPARK-33428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-33428: Description: # MySQL allows leading spaces but Spark does not. # If the input string is way too

[jira] [Resolved] (SPARK-33428) conv UDF returns incorrect value

[ https://issues.apache.org/jira/browse/SPARK-33428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33428. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32684

[jira] [Updated] (SPARK-35543) Small memory leak in BlockManagerMasterEndpoint

[ https://issues.apache.org/jira/browse/SPARK-35543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-35543: --- Description: It is regarding _blockStatusByShuffleService_ when all the blocks are

[jira] [Assigned] (SPARK-35543) Small memory leak in BlockManagerMasterEndpoint

[ https://issues.apache.org/jira/browse/SPARK-35543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros reassigned SPARK-35543: -- Assignee: Attila Zsolt Piros > Small memory leak in

[jira] [Created] (SPARK-35543) Small memory leak in BlockManagerMasterEndpoint

Attila Zsolt Piros created SPARK-35543: -- Summary: Small memory leak in BlockManagerMasterEndpoint Key: SPARK-35543 URL: https://issues.apache.org/jira/browse/SPARK-35543 Project: Spark

[jira] [Resolved] (SPARK-35535) New data source V2 API: LocalScan

[ https://issues.apache.org/jira/browse/SPARK-35535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35535. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32678

[jira] [Updated] (SPARK-35542) Bucketizer created for multiple columns with parameters splitsArray,  inputCols and outputCols can not be loaded after saving it.

[ https://issues.apache.org/jira/browse/SPARK-35542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srikanth Pusarla updated SPARK-35542: - Attachment: Code-error.PNG > Bucketizer created for multiple columns with parameters

[jira] [Updated] (SPARK-35542) Bucketizer created for multiple columns with parameters splitsArray,  inputCols and outputCols can not be loaded after saving it.

[ https://issues.apache.org/jira/browse/SPARK-35542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srikanth Pusarla updated SPARK-35542: - Attachment: traceback.png > Bucketizer created for multiple columns with parameters

[jira] [Created] (SPARK-35542) Bucketizer created for multiple columns with parameters splitsArray,  inputCols and outputCols can not be loaded after saving it.

Srikanth Pusarla created SPARK-35542: Summary: Bucketizer created for multiple columns with parameters splitsArray,  inputCols and outputCols can not be loaded after saving it. Key: SPARK-35542 URL:

[jira] [Reopened] (SPARK-35442) Eliminate unnecessary join through Aggregate

[ https://issues.apache.org/jira/browse/SPARK-35442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You reopened SPARK-35442: --- > Eliminate unnecessary join through Aggregate > > >

[jira] [Resolved] (SPARK-35057) Group exception messages in hive/thriftserver

[ https://issues.apache.org/jira/browse/SPARK-35057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35057. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32646

[jira] [Assigned] (SPARK-35057) Group exception messages in hive/thriftserver

[ https://issues.apache.org/jira/browse/SPARK-35057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35057: --- Assignee: jiaan.geng > Group exception messages in hive/thriftserver >

[jira] [Commented] (SPARK-35541) Simplify OptimizeSkewedJoin

[ https://issues.apache.org/jira/browse/SPARK-35541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17352306#comment-17352306 ] Apache Spark commented on SPARK-35541: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35541) Simplify OptimizeSkewedJoin

[ https://issues.apache.org/jira/browse/SPARK-35541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35541: Assignee: (was: Apache Spark) > Simplify OptimizeSkewedJoin >

[jira] [Assigned] (SPARK-35541) Simplify OptimizeSkewedJoin

[ https://issues.apache.org/jira/browse/SPARK-35541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35541: Assignee: Apache Spark > Simplify OptimizeSkewedJoin > --- > >

[jira] [Created] (SPARK-35541) Simplify OptimizeSkewedJoin

Wenchen Fan created SPARK-35541: --- Summary: Simplify OptimizeSkewedJoin Key: SPARK-35541 URL: https://issues.apache.org/jira/browse/SPARK-35541 Project: Spark Issue Type: Improvement