[jira] [Commented] (SPARK-37224) Optimize write path on RocksDB state store provider

[ https://issues.apache.org/jira/browse/SPARK-37224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17439611#comment-17439611 ] Jungtaek Lim commented on SPARK-37224: -- will submit a PR sooner > Optimize write p

[jira] [Created] (SPARK-37224) Optimize write path on RocksDB state store provider

Jungtaek Lim created SPARK-37224: Summary: Optimize write path on RocksDB state store provider Key: SPARK-37224 URL: https://issues.apache.org/jira/browse/SPARK-37224 Project: Spark Issue Typ

[jira] [Assigned] (SPARK-37223) Fix unit test check in JoinHintSuite

[ https://issues.apache.org/jira/browse/SPARK-37223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37223: Assignee: (was: Apache Spark) > Fix unit test check in JoinHintSuite > --

[jira] [Assigned] (SPARK-37223) Fix unit test check in JoinHintSuite

[ https://issues.apache.org/jira/browse/SPARK-37223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37223: Assignee: Apache Spark > Fix unit test check in JoinHintSuite > -

[jira] [Commented] (SPARK-37223) Fix unit test check in JoinHintSuite

[ https://issues.apache.org/jira/browse/SPARK-37223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17439609#comment-17439609 ] Apache Spark commented on SPARK-37223: -- User 'c21' has created a pull request for t

[jira] [Commented] (SPARK-37223) Fix unit test check in JoinHintSuite

[ https://issues.apache.org/jira/browse/SPARK-37223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17439608#comment-17439608 ] Apache Spark commented on SPARK-37223: -- User 'c21' has created a pull request for t

[jira] [Updated] (SPARK-37223) Fix unit test check in JoinHintSuite

[ https://issues.apache.org/jira/browse/SPARK-37223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Su updated SPARK-37223: - Issue Type: Improvement (was: Bug) > Fix unit test check in JoinHintSuite > ---

[jira] [Updated] (SPARK-37223) Fix unit test check in JoinHintSuite

[ https://issues.apache.org/jira/browse/SPARK-37223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Su updated SPARK-37223: - Issue Type: Test (was: Improvement) > Fix unit test check in JoinHintSuite > --

[jira] [Created] (SPARK-37223) Fix unit test check in JoinHintSuite

Cheng Su created SPARK-37223: Summary: Fix unit test check in JoinHintSuite Key: SPARK-37223 URL: https://issues.apache.org/jira/browse/SPARK-37223 Project: Spark Issue Type: Bug Compon

[jira] [Assigned] (SPARK-33574) Improve locality for push-based shuffle especially for join like operations

[ https://issues.apache.org/jira/browse/SPARK-33574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33574: Assignee: (was: Apache Spark) > Improve locality for push-based shuffle especially fo

[jira] [Assigned] (SPARK-33574) Improve locality for push-based shuffle especially for join like operations

[ https://issues.apache.org/jira/browse/SPARK-33574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33574: Assignee: Apache Spark > Improve locality for push-based shuffle especially for join like

[jira] [Commented] (SPARK-33574) Improve locality for push-based shuffle especially for join like operations

[ https://issues.apache.org/jira/browse/SPARK-33574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17439603#comment-17439603 ] Apache Spark commented on SPARK-33574: -- User 'rmcyang' has created a pull request f

[jira] [Issue Comment Deleted] (SPARK-33245) Add built-in UDF - GETBIT

[ https://issues.apache.org/jira/browse/SPARK-33245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-33245: --- Comment: was deleted (was: I'm working on.) > Add built-in UDF - GETBIT >

[jira] [Assigned] (SPARK-37221) The collect-like API in SparkPlan should support columnar output

[ https://issues.apache.org/jira/browse/SPARK-37221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37221: Assignee: Apache Spark > The collect-like API in SparkPlan should support columnar output

[jira] [Assigned] (SPARK-37221) The collect-like API in SparkPlan should support columnar output

[ https://issues.apache.org/jira/browse/SPARK-37221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37221: Assignee: (was: Apache Spark) > The collect-like API in SparkPlan should support colu

[jira] [Commented] (SPARK-37221) The collect-like API in SparkPlan should support columnar output

[ https://issues.apache.org/jira/browse/SPARK-37221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17439577#comment-17439577 ] Apache Spark commented on SPARK-37221: -- User 'viirya' has created a pull request fo

[jira] [Commented] (SPARK-37222) Max iterations reached in Operator Optimization w/left_anti or left_semi join and nested structures

[ https://issues.apache.org/jira/browse/SPARK-37222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17439575#comment-17439575 ] Shawn Smith commented on SPARK-37222: - Plan at the start of one iteration: {noformat

[jira] [Created] (SPARK-37222) Max iterations reached in Operator Optimization w/left_anti or left_semi join and nested structures

Shawn Smith created SPARK-37222: --- Summary: Max iterations reached in Operator Optimization w/left_anti or left_semi join and nested structures Key: SPARK-37222 URL: https://issues.apache.org/jira/browse/SPARK-37222

[jira] [Assigned] (SPARK-37220) Do not split input file for Parquet reader with aggregate push down

[ https://issues.apache.org/jira/browse/SPARK-37220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37220: Assignee: Apache Spark > Do not split input file for Parquet reader with aggregate push d

[jira] [Assigned] (SPARK-37220) Do not split input file for Parquet reader with aggregate push down

[ https://issues.apache.org/jira/browse/SPARK-37220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37220: Assignee: (was: Apache Spark) > Do not split input file for Parquet reader with aggre

[jira] [Commented] (SPARK-37220) Do not split input file for Parquet reader with aggregate push down

[ https://issues.apache.org/jira/browse/SPARK-37220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17439570#comment-17439570 ] Apache Spark commented on SPARK-37220: -- User 'c21' has created a pull request for t

[jira] [Created] (SPARK-37221) The collect-like API in SparkPlan should support columnar output

L. C. Hsieh created SPARK-37221: --- Summary: The collect-like API in SparkPlan should support columnar output Key: SPARK-37221 URL: https://issues.apache.org/jira/browse/SPARK-37221 Project: Spark

[jira] [Created] (SPARK-37220) Do not split input file for Parquet reader with aggregate push down

Cheng Su created SPARK-37220: Summary: Do not split input file for Parquet reader with aggregate push down Key: SPARK-37220 URL: https://issues.apache.org/jira/browse/SPARK-37220 Project: Spark

[jira] [Commented] (SPARK-37167) Add benchmark for aggregate push down

[ https://issues.apache.org/jira/browse/SPARK-37167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17439569#comment-17439569 ] Cheng Su commented on SPARK-37167: -- Just FYI, I am working on it. > Add benchmark for

[jira] [Assigned] (SPARK-36998) Handle concurrent eviction of same application in SHS

[ https://issues.apache.org/jira/browse/SPARK-36998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36998: - Assignee: Thejdeep > Handle concurrent eviction of same application in SHS > --

[jira] [Resolved] (SPARK-36998) Handle concurrent eviction of same application in SHS

[ https://issues.apache.org/jira/browse/SPARK-36998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36998. --- Fix Version/s: 3.2.1 3.3.0 Resolution: Fixed Issue resolved by pul

[jira] [Assigned] (SPARK-37218) Parameterize `spark.sql.shuffle.partitions` in TPCDSQueryBenchmark

[ https://issues.apache.org/jira/browse/SPARK-37218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37218: - Assignee: Dongjoon Hyun > Parameterize `spark.sql.shuffle.partitions` in TPCDSQueryBenc

[jira] [Commented] (SPARK-37218) Parameterize `spark.sql.shuffle.partitions` in TPCDSQueryBenchmark

[ https://issues.apache.org/jira/browse/SPARK-37218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17439554#comment-17439554 ] Chao Sun commented on SPARK-37218: -- [~dongjoon] please assign this to yourself - someho

[jira] [Updated] (SPARK-37218) Parameterize `spark.sql.shuffle.partitions` in TPCDSQueryBenchmark

[ https://issues.apache.org/jira/browse/SPARK-37218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37218: -- Fix Version/s: 3.2.1 > Parameterize `spark.sql.shuffle.partitions` in TPCDSQueryBenchmark > --

[jira] [Assigned] (SPARK-37219) support AS OF syntax

[ https://issues.apache.org/jira/browse/SPARK-37219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37219: Assignee: (was: Apache Spark) > support AS OF syntax > > >

[jira] [Assigned] (SPARK-37219) support AS OF syntax

[ https://issues.apache.org/jira/browse/SPARK-37219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37219: Assignee: Apache Spark > support AS OF syntax > > >

[jira] [Commented] (SPARK-37219) support AS OF syntax

[ https://issues.apache.org/jira/browse/SPARK-37219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17439528#comment-17439528 ] Apache Spark commented on SPARK-37219: -- User 'huaxingao' has created a pull request

[jira] [Resolved] (SPARK-37218) Parameterize `spark.sql.shuffle.partitions` in TPCDSQueryBenchmark

[ https://issues.apache.org/jira/browse/SPARK-37218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved SPARK-37218. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34496 [https://github.com

[jira] [Updated] (SPARK-37219) support AS OF syntax

[ https://issues.apache.org/jira/browse/SPARK-37219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-37219: --- Description: https://docs.databricks.com/delta/quick-start.html#query-an-earlier-version-of-the-tabl

[jira] [Created] (SPARK-37219) support AS OF syntax

Huaxin Gao created SPARK-37219: -- Summary: support AS OF syntax Key: SPARK-37219 URL: https://issues.apache.org/jira/browse/SPARK-37219 Project: Spark Issue Type: New Feature Components

[jira] [Updated] (SPARK-33539) Standardize exception messages in Spark

[ https://issues.apache.org/jira/browse/SPARK-33539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-33539: - Description: In the SPIP: Standardize Exception Messages in Spark, there are three major improv

[jira] [Commented] (SPARK-37210) An error occurred while concurrently writing to different static partitions

[ https://issues.apache.org/jira/browse/SPARK-37210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17439518#comment-17439518 ] Dongjoon Hyun commented on SPARK-37210: --- Is this a correct use case? bq. When mult

[jira] [Resolved] (SPARK-35496) Upgrade Scala 2.13 to 2.13.7

[ https://issues.apache.org/jira/browse/SPARK-35496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-35496. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 32648 [https://

[jira] [Assigned] (SPARK-35496) Upgrade Scala 2.13 to 2.13.7

[ https://issues.apache.org/jira/browse/SPARK-35496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-35496: - Assignee: Yang Jie > Upgrade Scala 2.13 to 2.13.7 > > >

[jira] [Assigned] (SPARK-37208) Support mapping Spark gpu/fpga resource types to custom YARN resource type

[ https://issues.apache.org/jira/browse/SPARK-37208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37208: - Assignee: Thomas Graves > Support mapping Spark gpu/fpga resource types to custom YARN

[jira] [Resolved] (SPARK-37208) Support mapping Spark gpu/fpga resource types to custom YARN resource type

[ https://issues.apache.org/jira/browse/SPARK-37208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37208. --- Fix Version/s: 3.2.1 3.3.0 Resolution: Fixed Issue resolved by pul

[jira] [Resolved] (SPARK-37151) Avoid executor state sync attempt fail continuously in a short timeframe

[ https://issues.apache.org/jira/browse/SPARK-37151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37151. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34428 [https://

[jira] [Updated] (SPARK-37218) Parameterize `spark.sql.shuffle.partitions` in TPCDSQueryBenchmark

[ https://issues.apache.org/jira/browse/SPARK-37218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37218: -- Summary: Parameterize `spark.sql.shuffle.partitions` in TPCDSQueryBenchmark (was: Parameteriz

[jira] [Assigned] (SPARK-37218) Parameterize shuffle partitions in TPCDSQueryBenchmark

[ https://issues.apache.org/jira/browse/SPARK-37218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37218: Assignee: (was: Apache Spark) > Parameterize shuffle partitions in TPCDSQueryBenchmar

[jira] [Commented] (SPARK-37218) Parameterize shuffle partitions in TPCDSQueryBenchmark

[ https://issues.apache.org/jira/browse/SPARK-37218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17439493#comment-17439493 ] Apache Spark commented on SPARK-37218: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-37218) Parameterize shuffle partitions in TPCDSQueryBenchmark

[ https://issues.apache.org/jira/browse/SPARK-37218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37218: Assignee: Apache Spark > Parameterize shuffle partitions in TPCDSQueryBenchmark > ---

[jira] [Created] (SPARK-37218) Parameterize shuffle partitions in TPCDSQueryBenchmark

Dongjoon Hyun created SPARK-37218: - Summary: Parameterize shuffle partitions in TPCDSQueryBenchmark Key: SPARK-37218 URL: https://issues.apache.org/jira/browse/SPARK-37218 Project: Spark Issu

[jira] [Commented] (SPARK-34230) Let AQE determine the right parallelism in DistributionAndOrderingUtils

[ https://issues.apache.org/jira/browse/SPARK-34230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17439399#comment-17439399 ] Anton Okolnychyi commented on SPARK-34230: -- A bit more context [here|https://g

[jira] [Commented] (SPARK-36182) Support TimestampNTZ type in Parquet file source

[ https://issues.apache.org/jira/browse/SPARK-36182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17439268#comment-17439268 ] Apache Spark commented on SPARK-36182: -- User 'gengliangwang' has created a pull req

[jira] [Commented] (SPARK-36182) Support TimestampNTZ type in Parquet file source

[ https://issues.apache.org/jira/browse/SPARK-36182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17439266#comment-17439266 ] Apache Spark commented on SPARK-36182: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-37212) Improve the implement of aggregate pushdown.

[ https://issues.apache.org/jira/browse/SPARK-37212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37212: --- Assignee: jiaan.geng > Improve the implement of aggregate pushdown. > -

[jira] [Resolved] (SPARK-37212) Improve the implement of aggregate pushdown.

[ https://issues.apache.org/jira/browse/SPARK-37212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37212. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34488 [https://gith

[jira] [Commented] (SPARK-37217) Dynamic partitions should fail quickly when writing to external tables to prevent data deletion

[ https://issues.apache.org/jira/browse/SPARK-37217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17439206#comment-17439206 ] Apache Spark commented on SPARK-37217: -- User 'cxzl25' has created a pull request fo

[jira] [Assigned] (SPARK-37217) Dynamic partitions should fail quickly when writing to external tables to prevent data deletion

[ https://issues.apache.org/jira/browse/SPARK-37217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37217: Assignee: Apache Spark > Dynamic partitions should fail quickly when writing to external

[jira] [Commented] (SPARK-36924) CAST between ANSI intervals and numerics

[ https://issues.apache.org/jira/browse/SPARK-36924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17439205#comment-17439205 ] Apache Spark commented on SPARK-36924: -- User 'Peng-Lei' has created a pull request

[jira] [Assigned] (SPARK-36924) CAST between ANSI intervals and numerics

[ https://issues.apache.org/jira/browse/SPARK-36924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36924: Assignee: (was: Apache Spark) > CAST between ANSI intervals and numerics > --

[jira] [Assigned] (SPARK-37217) Dynamic partitions should fail quickly when writing to external tables to prevent data deletion

[ https://issues.apache.org/jira/browse/SPARK-37217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37217: Assignee: (was: Apache Spark) > Dynamic partitions should fail quickly when writing t

[jira] [Assigned] (SPARK-36924) CAST between ANSI intervals and numerics

[ https://issues.apache.org/jira/browse/SPARK-36924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36924: Assignee: Apache Spark > CAST between ANSI intervals and numerics > -

[jira] [Created] (SPARK-37217) Dynamic partitions should fail quickly when writing to external tables to prevent data deletion

dzcxzl created SPARK-37217: -- Summary: Dynamic partitions should fail quickly when writing to external tables to prevent data deletion Key: SPARK-37217 URL: https://issues.apache.org/jira/browse/SPARK-37217 P

[jira] [Assigned] (SPARK-37216) Add the Hive macro functionality to SparkSQL

[ https://issues.apache.org/jira/browse/SPARK-37216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37216: Assignee: (was: Apache Spark) > Add the Hive macro functionality to SparkSQL > --

[jira] [Assigned] (SPARK-37216) Add the Hive macro functionality to SparkSQL

[ https://issues.apache.org/jira/browse/SPARK-37216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37216: Assignee: Apache Spark > Add the Hive macro functionality to SparkSQL > -

[jira] [Commented] (SPARK-37216) Add the Hive macro functionality to SparkSQL

[ https://issues.apache.org/jira/browse/SPARK-37216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17439146#comment-17439146 ] Apache Spark commented on SPARK-37216: -- User 'hgs19921112' has created a pull reque

[jira] [Created] (SPARK-37216) Add the Hive macro functionality to SparkSQL

hgs created SPARK-37216: --- Summary: Add the Hive macro functionality to SparkSQL Key: SPARK-37216 URL: https://issues.apache.org/jira/browse/SPARK-37216 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-37215) Support Application Timeouts on YARN

[ https://issues.apache.org/jira/browse/SPARK-37215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17439131#comment-17439131 ] Apache Spark commented on SPARK-37215: -- User 'yaooqinn' has created a pull request

[jira] [Assigned] (SPARK-37215) Support Application Timeouts on YARN

[ https://issues.apache.org/jira/browse/SPARK-37215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37215: Assignee: (was: Apache Spark) > Support Application Timeouts on YARN > --

[jira] [Commented] (SPARK-37215) Support Application Timeouts on YARN

[ https://issues.apache.org/jira/browse/SPARK-37215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17439129#comment-17439129 ] Apache Spark commented on SPARK-37215: -- User 'yaooqinn' has created a pull request

[jira] [Assigned] (SPARK-37215) Support Application Timeouts on YARN

[ https://issues.apache.org/jira/browse/SPARK-37215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37215: Assignee: Apache Spark > Support Application Timeouts on YARN > -

[jira] [Assigned] (SPARK-37214) Fail query analysis earlier with invalid identifiers

[ https://issues.apache.org/jira/browse/SPARK-37214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37214: Assignee: Apache Spark (was: Wenchen Fan) > Fail query analysis earlier with invalid ide

[jira] [Assigned] (SPARK-37214) Fail query analysis earlier with invalid identifiers

[ https://issues.apache.org/jira/browse/SPARK-37214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37214: Assignee: Wenchen Fan (was: Apache Spark) > Fail query analysis earlier with invalid ide

[jira] [Commented] (SPARK-37214) Fail query analysis earlier with invalid identifiers

[ https://issues.apache.org/jira/browse/SPARK-37214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17439126#comment-17439126 ] Apache Spark commented on SPARK-37214: -- User 'cloud-fan' has created a pull request

[jira] [Created] (SPARK-37215) Support Application Timeouts on YARN

Kent Yao created SPARK-37215: Summary: Support Application Timeouts on YARN Key: SPARK-37215 URL: https://issues.apache.org/jira/browse/SPARK-37215 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-32940) Collect, first and last should be deterministic aggregate functions

[ https://issues.apache.org/jira/browse/SPARK-32940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32940. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 29810 [https://gith

[jira] [Assigned] (SPARK-32940) Collect, first and last should be deterministic aggregate functions

[ https://issues.apache.org/jira/browse/SPARK-32940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32940: --- Assignee: Tanel Kiis > Collect, first and last should be deterministic aggregate functions

[jira] [Created] (SPARK-37214) Fail query analysis earlier with invalid identifiers

Wenchen Fan created SPARK-37214: --- Summary: Fail query analysis earlier with invalid identifiers Key: SPARK-37214 URL: https://issues.apache.org/jira/browse/SPARK-37214 Project: Spark Issue Type

[jira] [Assigned] (SPARK-37210) An error occurred while concurrently writing to different static partitions

[ https://issues.apache.org/jira/browse/SPARK-37210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37210: Assignee: (was: Apache Spark) > An error occurred while concurrently writing to diffe

[jira] [Assigned] (SPARK-37210) An error occurred while concurrently writing to different static partitions

[ https://issues.apache.org/jira/browse/SPARK-37210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37210: Assignee: Apache Spark > An error occurred while concurrently writing to different static

[jira] [Commented] (SPARK-37210) An error occurred while concurrently writing to different static partitions

[ https://issues.apache.org/jira/browse/SPARK-37210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17439079#comment-17439079 ] Apache Spark commented on SPARK-37210: -- User 'wForget' has created a pull request f

[jira] [Assigned] (SPARK-37203) Fix NotSerializableException when observe with TypedImperativeAggregate

[ https://issues.apache.org/jira/browse/SPARK-37203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37203: --- Assignee: jiaan.geng > Fix NotSerializableException when observe with TypedImperativeAggreg

[jira] [Resolved] (SPARK-37203) Fix NotSerializableException when observe with TypedImperativeAggregate

[ https://issues.apache.org/jira/browse/SPARK-37203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37203. - Fix Version/s: 3.1.3 3.2.1 3.3.0 Resolution: Fixed

[jira] [Commented] (SPARK-37213) In the latest version release (Spark.3.2.O) in the Apache Spark documentation, the "O" at the end feels wrong, and it is written as the English letter "O"

[ https://issues.apache.org/jira/browse/SPARK-37213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17439075#comment-17439075 ] Jungtaek Lim commented on SPARK-37213: -- Thanks for reporting! I just checked with h

[jira] [Resolved] (SPARK-37213) In the latest version release (Spark.3.2.O) in the Apache Spark documentation, the "O" at the end feels wrong, and it is written as the English letter "O"

[ https://issues.apache.org/jira/browse/SPARK-37213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-37213. -- Resolution: Invalid > In the latest version release (Spark.3.2.O) in the Apache Spark > docum

[jira] [Updated] (SPARK-37213) In the latest version release (Spark.3.2.O) in the Apache Spark documentation, the "O" at the end feels wrong, and it is written as the English letter "O"

[ https://issues.apache.org/jira/browse/SPARK-37213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liu zhuang updated SPARK-37213: --- Attachment: Spark3.2.0.png > In the latest version release (Spark.3.2.O) in the Apache Spark > docu

[jira] [Created] (SPARK-37213) In the latest version release (Spark.3.2.O) in the Apache Spark documentation, the "O" at the end feels wrong, and it is written as the English letter "O"

liu zhuang created SPARK-37213: -- Summary: In the latest version release (Spark.3.2.O) in the Apache Spark documentation, the "O" at the end feels wrong, and it is written as the English letter "O" Key: SPARK-37213 U

[jira] [Comment Edited] (SPARK-37210) An error occurred while concurrently writing to different static partitions

[ https://issues.apache.org/jira/browse/SPARK-37210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17439061#comment-17439061 ] Zhen Wang edited comment on SPARK-37210 at 11/5/21, 7:55 AM: -

[jira] [Commented] (SPARK-37212) Improve the implement of aggregate pushdown.

[ https://issues.apache.org/jira/browse/SPARK-37212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17439062#comment-17439062 ] Apache Spark commented on SPARK-37212: -- User 'beliefer' has created a pull request

[jira] [Assigned] (SPARK-37212) Improve the implement of aggregate pushdown.

[ https://issues.apache.org/jira/browse/SPARK-37212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37212: Assignee: Apache Spark > Improve the implement of aggregate pushdown. > -

[jira] [Assigned] (SPARK-37212) Improve the implement of aggregate pushdown.

[ https://issues.apache.org/jira/browse/SPARK-37212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37212: Assignee: (was: Apache Spark) > Improve the implement of aggregate pushdown. > --

[jira] [Created] (SPARK-37212) Improve the implement of aggregate pushdown.

jiaan.geng created SPARK-37212: -- Summary: Improve the implement of aggregate pushdown. Key: SPARK-37212 URL: https://issues.apache.org/jira/browse/SPARK-37212 Project: Spark Issue Type: Improvem

[jira] [Comment Edited] (SPARK-37210) An error occurred while concurrently writing to different static partitions

[ https://issues.apache.org/jira/browse/SPARK-37210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17439061#comment-17439061 ] Zhen Wang edited comment on SPARK-37210 at 11/5/21, 7:28 AM: -

[jira] [Commented] (SPARK-37210) An error occurred while concurrently writing to different static partitions

[ https://issues.apache.org/jira/browse/SPARK-37210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17439061#comment-17439061 ] Zhen Wang commented on SPARK-37210: --- In DataSourceAnalysis, static partition writing i

[jira] [Updated] (SPARK-37210) An error occurred while concurrently writing to different static partitions

[ https://issues.apache.org/jira/browse/SPARK-37210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhen Wang updated SPARK-37210: -- Attachment: [SPARK-37210]_Write_to_static_partition_in_dynamic_write_mode.patch > An error occurred w