[jira] [Assigned] (SPARK-39223) implement skew and kurt in Rolling/RollingGroupby/Expanding/ExpandingGroupby

2022-05-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39223: Assignee: zhengruifeng > implement skew and kurt in Rolling/RollingGroupby/Expanding/Expa

[jira] [Resolved] (SPARK-39223) implement skew and kurt in Rolling/RollingGroupby/Expanding/ExpandingGroupby

2022-05-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39223. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36594 [https://gi

[jira] [Resolved] (SPARK-39229) Separate query contexts from error-classes.json

2022-05-19 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-39229. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36604 [https://github.com

[jira] [Assigned] (SPARK-37939) Use error classes in the parsing errors of properties

2022-05-19 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-37939: Assignee: panbingkun > Use error classes in the parsing errors of properties > --

[jira] [Resolved] (SPARK-37939) Use error classes in the parsing errors of properties

2022-05-19 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-37939. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36561 [https://github.com

[jira] [Updated] (SPARK-39212) Use double quotes for values of SQL configs/DS options in error messages

2022-05-19 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-39212: --- Affects Version/s: 3.3.0 > Use double quotes for values of SQL configs/DS options in error m

[jira] [Updated] (SPARK-39212) Use double quotes for values of SQL configs/DS options in error messages

2022-05-19 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-39212: --- Fix Version/s: 3.3.0 (was: 3.4.0) > Use double quotes for values of S

[jira] [Commented] (SPARK-39229) Separate query contexts from error-classes.json

2022-05-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539421#comment-17539421 ] Apache Spark commented on SPARK-39229: -- User 'gengliangwang' has created a pull req

[jira] [Commented] (SPARK-39230) Support ANSI Aggregate Function: regr_slope

2022-05-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539422#comment-17539422 ] Apache Spark commented on SPARK-39230: -- User 'beliefer' has created a pull request

[jira] [Assigned] (SPARK-39230) Support ANSI Aggregate Function: regr_slope

2022-05-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39230: Assignee: (was: Apache Spark) > Support ANSI Aggregate Function: regr_slope > ---

[jira] [Assigned] (SPARK-39230) Support ANSI Aggregate Function: regr_slope

2022-05-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39230: Assignee: Apache Spark > Support ANSI Aggregate Function: regr_slope > --

[jira] [Assigned] (SPARK-38947) Support Groupby positional indexing

2022-05-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38947: Assignee: Yikun Jiang > Support Groupby positional indexing > ---

[jira] [Commented] (SPARK-38681) Support nested generic case classes

2022-05-19 Thread Emil Ejbyfeldt (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539441#comment-17539441 ] Emil Ejbyfeldt commented on SPARK-38681: While testing the spark 3.3.0 release c

[jira] [Resolved] (SPARK-38947) Support Groupby positional indexing

2022-05-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38947. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36464 [https://gi

[jira] [Created] (SPARK-39233) Remove the check for TimestampNTZ output in Analyzer

2022-05-19 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-39233: -- Summary: Remove the check for TimestampNTZ output in Analyzer Key: SPARK-39233 URL: https://issues.apache.org/jira/browse/SPARK-39233 Project: Spark Issu

[jira] [Updated] (SPARK-39233) Remove the check for TimestampNTZ output in Analyzer

2022-05-19 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-39233: --- Description: In [#36094|https://github.com/apache/spark/pull/36094], a check for failing Ti

[jira] [Assigned] (SPARK-39201) Implement `ignore_index` of `DataFrame.explode` and `DataFrame.drop_duplicates`

2022-05-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39201: Assignee: Xinrong Meng > Implement `ignore_index` of `DataFrame.explode` and > `DataFram

[jira] [Resolved] (SPARK-39201) Implement `ignore_index` of `DataFrame.explode` and `DataFrame.drop_duplicates`

2022-05-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39201. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36569 [https://gi

[jira] [Commented] (SPARK-39233) Remove the check for TimestampNTZ output in Analyzer

2022-05-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539452#comment-17539452 ] Apache Spark commented on SPARK-39233: -- User 'gengliangwang' has created a pull req

[jira] [Commented] (SPARK-39233) Remove the check for TimestampNTZ output in Analyzer

2022-05-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539451#comment-17539451 ] Apache Spark commented on SPARK-39233: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-39233) Remove the check for TimestampNTZ output in Analyzer

2022-05-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39233: Assignee: Apache Spark (was: Gengliang Wang) > Remove the check for TimestampNTZ output

[jira] [Assigned] (SPARK-39233) Remove the check for TimestampNTZ output in Analyzer

2022-05-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39233: Assignee: Gengliang Wang (was: Apache Spark) > Remove the check for TimestampNTZ output

[jira] [Updated] (SPARK-39229) Separate query contexts from error-classes.json

2022-05-19 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-39229: --- Fix Version/s: 3.3.0 (was: 3.4.0) > Separate query contexts from erro

[jira] [Reopened] (SPARK-39043) Hive client should not gather statistic by default.

2022-05-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reopened SPARK-39043: - > Hive client should not gather statistic by default. >

[jira] [Assigned] (SPARK-39043) Hive client should not gather statistic by default.

2022-05-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39043: Assignee: Apache Spark (was: angerszhu) > Hive client should not gather statistic by def

[jira] [Assigned] (SPARK-39043) Hive client should not gather statistic by default.

2022-05-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39043: Assignee: angerszhu (was: Apache Spark) > Hive client should not gather statistic by def

[jira] [Assigned] (SPARK-39204) Replace `Utils.createTempDir` related methods with JavaUtils

2022-05-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39204: Assignee: Apache Spark > Replace `Utils.createTempDir` related methods with JavaUtils > -

[jira] [Assigned] (SPARK-39204) Replace `Utils.createTempDir` related methods with JavaUtils

2022-05-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39204: Assignee: (was: Apache Spark) > Replace `Utils.createTempDir` related methods with Ja

[jira] [Commented] (SPARK-39204) Replace `Utils.createTempDir` related methods with JavaUtils

2022-05-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539507#comment-17539507 ] Apache Spark commented on SPARK-39204: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-39204) Replace `Utils.createTempDir` related methods with JavaUtils

2022-05-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539508#comment-17539508 ] Apache Spark commented on SPARK-39204: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-39204) Replace `Utils.createTempDir` related methods with JavaUtils

2022-05-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539511#comment-17539511 ] Apache Spark commented on SPARK-39204: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-39204) Replace `Utils.createTempDir` related methods with JavaUtils

2022-05-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539514#comment-17539514 ] Apache Spark commented on SPARK-39204: -- User 'LuciferYang' has created a pull reque

[jira] [Resolved] (SPARK-39233) Remove the check for TimestampNTZ output in Analyzer

2022-05-19 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-39233. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 36609 [https:

[jira] [Commented] (SPARK-19609) Broadcast joins should pushdown join constraints as Filter to the larger relation

2022-05-19 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-19609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539527#comment-17539527 ] Victor Delépine commented on SPARK-19609: - Hey [~hyukjin.kwon], I can confirm t

[jira] [Created] (SPARK-39234) Code clean up in SparkThrowableHelper.getMessage

2022-05-19 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-39234: -- Summary: Code clean up in SparkThrowableHelper.getMessage Key: SPARK-39234 URL: https://issues.apache.org/jira/browse/SPARK-39234 Project: Spark Issue Ty

[jira] [Commented] (SPARK-39234) Code clean up in SparkThrowableHelper.getMessage

2022-05-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539546#comment-17539546 ] Apache Spark commented on SPARK-39234: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-39234) Code clean up in SparkThrowableHelper.getMessage

2022-05-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39234: Assignee: Apache Spark > Code clean up in SparkThrowableHelper.getMessage > -

[jira] [Assigned] (SPARK-39234) Code clean up in SparkThrowableHelper.getMessage

2022-05-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39234: Assignee: (was: Apache Spark) > Code clean up in SparkThrowableHelper.getMessage > --

[jira] [Resolved] (SPARK-38529) Prevent GeneratorNestedColumnAliasing to be applied to non-Explode generators

2022-05-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38529. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35850 [https://gith

[jira] [Assigned] (SPARK-38529) Prevent GeneratorNestedColumnAliasing to be applied to non-Explode generators

2022-05-19 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38529: --- Assignee: Min Yang > Prevent GeneratorNestedColumnAliasing to be applied to non-Explode gen

[jira] [Assigned] (SPARK-39043) Hive client should not gather statistic by default.

2022-05-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39043: - Assignee: (was: angerszhu) > Hive client should not gather statistic by default. >

[jira] [Updated] (SPARK-39043) Hive client should not gather statistic by default.

2022-05-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39043: -- Fix Version/s: (was: 3.4.0) > Hive client should not gather statistic by default. > --

[jira] [Resolved] (SPARK-39234) Code clean up in SparkThrowableHelper.getMessage

2022-05-19 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-39234. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36612 [https://github.com

[jira] [Assigned] (SPARK-39234) Code clean up in SparkThrowableHelper.getMessage

2022-05-19 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-39234: Assignee: Gengliang Wang > Code clean up in SparkThrowableHelper.getMessage > ---

[jira] [Assigned] (SPARK-30983) Support more than 5 typed column in typed Dataset.select API

2022-05-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30983: Assignee: Apache Spark > Support more than 5 typed column in typed Dataset.select API > -

[jira] [Commented] (SPARK-30983) Support more than 5 typed column in typed Dataset.select API

2022-05-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539690#comment-17539690 ] Apache Spark commented on SPARK-30983: -- User 'nkronenfeld' has created a pull reque

[jira] [Assigned] (SPARK-30983) Support more than 5 typed column in typed Dataset.select API

2022-05-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30983: Assignee: (was: Apache Spark) > Support more than 5 typed column in typed Dataset.sel

[jira] [Commented] (SPARK-38934) Provider TemporaryAWSCredentialsProvider has no credentials

2022-05-19 Thread Jason Sleight (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539699#comment-17539699 ] Jason Sleight commented on SPARK-38934: --- I had a similar issue and found a workaro

[jira] [Assigned] (SPARK-39163) Throw an exception w/ error class for an invalid bucket file

2022-05-19 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-39163: Assignee: panbingkun > Throw an exception w/ error class for an invalid bucket file > ---

[jira] [Resolved] (SPARK-39163) Throw an exception w/ error class for an invalid bucket file

2022-05-19 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-39163. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36603 [https://github.com

[jira] [Created] (SPARK-39235) Make Catalog API be compatible with 3-layer-namespace

2022-05-19 Thread Rui Wang (Jira)
Rui Wang created SPARK-39235: Summary: Make Catalog API be compatible with 3-layer-namespace Key: SPARK-39235 URL: https://issues.apache.org/jira/browse/SPARK-39235 Project: Spark Issue Type: Imp

[jira] [Created] (SPARK-39236) Make CreateTable API and ListTables API compatible

2022-05-19 Thread Rui Wang (Jira)
Rui Wang created SPARK-39236: Summary: Make CreateTable API and ListTables API compatible Key: SPARK-39236 URL: https://issues.apache.org/jira/browse/SPARK-39236 Project: Spark Issue Type: Sub-t

[jira] [Updated] (SPARK-39235) Make Catalog API be compatible with 3-layer-namespace

2022-05-19 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-39235: - Component/s: SQL (was: Spark Core) > Make Catalog API be compatible with 3-layer-na

[jira] [Assigned] (SPARK-39236) Make CreateTable API and ListTables API compatible

2022-05-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39236: Assignee: (was: Apache Spark) > Make CreateTable API and ListTables API compatible >

[jira] [Assigned] (SPARK-39236) Make CreateTable API and ListTables API compatible

2022-05-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39236: Assignee: Apache Spark > Make CreateTable API and ListTables API compatible > --

[jira] [Commented] (SPARK-39236) Make CreateTable API and ListTables API compatible

2022-05-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539760#comment-17539760 ] Apache Spark commented on SPARK-39236: -- User 'amaliujia' has created a pull request

[jira] [Commented] (SPARK-39236) Make CreateTable API and ListTables API compatible

2022-05-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539761#comment-17539761 ] Apache Spark commented on SPARK-39236: -- User 'amaliujia' has created a pull request

[jira] [Commented] (SPARK-39236) Make CreateTable API and ListTables API compatible

2022-05-19 Thread Rui Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539762#comment-17539762 ] Rui Wang commented on SPARK-39236: -- https://github.com/apache/spark/pull/36586 > Make

[jira] [Resolved] (SPARK-39225) Support spark.history.fs.update.batchSize

2022-05-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39225. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36597 [https://

[jira] [Assigned] (SPARK-39225) Support spark.history.fs.update.batchSize

2022-05-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39225: - Assignee: Hai Tao > Support spark.history.fs.update.batchSize > ---

[jira] [Resolved] (SPARK-38681) Support nested generic case classes

2022-05-19 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38681. -- Fix Version/s: 3.3.1 Resolution: Fixed Issue resolved by pull request 36004 [https://gi

[jira] [Assigned] (SPARK-38681) Support nested generic case classes

2022-05-19 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-38681: Assignee: Emil Ejbyfeldt > Support nested generic case classes >

[jira] [Commented] (SPARK-39220) codegen cause NullPointException

2022-05-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539874#comment-17539874 ] Hyukjin Kwon commented on SPARK-39220: -- [~chenxusheng] mind showing the reproducibl

[jira] [Commented] (SPARK-39220) codegen cause NullPointException

2022-05-19 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539876#comment-17539876 ] XiDuo You commented on SPARK-39220: --- is it possible to also provide a stack log ? > c

[jira] [Assigned] (SPARK-39221) sensitive information is not redacted correctly on thrift job/stage page

2022-05-19 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-39221: Assignee: Kent Yao > sensitive information is not redacted correctly on thrift job/stage page > -

[jira] [Resolved] (SPARK-39221) sensitive information is not redacted correctly on thrift job/stage page

2022-05-19 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-39221. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36592 [https://github.com

[jira] [Commented] (SPARK-19609) Broadcast joins should pushdown join constraints as Filter to the larger relation

2022-05-19 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-19609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539884#comment-17539884 ] Yuming Wang commented on SPARK-19609: - [~devict] Do you have benchmark number if pus

[jira] [Created] (SPARK-39237) Remove the Experimental notation in ANSI SQL compliance doc

2022-05-19 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-39237: -- Summary: Remove the Experimental notation in ANSI SQL compliance doc Key: SPARK-39237 URL: https://issues.apache.org/jira/browse/SPARK-39237 Project: Spark

[jira] [Closed] (SPARK-39023) Add Executor Pod inter-pod anti-affinity

2022-05-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-39023. - > Add Executor Pod inter-pod anti-affinity > > >

[jira] [Resolved] (SPARK-39023) Add Executor Pod inter-pod anti-affinity

2022-05-19 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39023. --- Resolution: Duplicate > Add Executor Pod inter-pod anti-affinity > -

[jira] [Updated] (SPARK-39237) Update the ANSI SQL mode documentation

2022-05-19 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-39237: --- Description: 1. Remove the Experimental notation in ANSI SQL compliance doc 2. Update the de

[jira] [Updated] (SPARK-39237) Update the ANSI SQL mode documentation

2022-05-19 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-39237: --- Summary: Update the ANSI SQL mode documentation (was: Remove the Experimental notation in A

[jira] [Assigned] (SPARK-39218) Python foreachBatch streaming query cannot be stopped gracefully after pin thread mode is enabled

2022-05-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39218: Assignee: Hyukjin Kwon > Python foreachBatch streaming query cannot be stopped gracefully

[jira] [Resolved] (SPARK-39218) Python foreachBatch streaming query cannot be stopped gracefully after pin thread mode is enabled

2022-05-19 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39218. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 36589 [https://gi

[jira] [Created] (SPARK-39238) Decimal precision loss from applying WidenSetOperationTypes before DecimalPrecision

2022-05-19 Thread Manu Zhang (Jira)
Manu Zhang created SPARK-39238: -- Summary: Decimal precision loss from applying WidenSetOperationTypes before DecimalPrecision Key: SPARK-39238 URL: https://issues.apache.org/jira/browse/SPARK-39238 Proj

[jira] [Updated] (SPARK-39238) Decimal precision loss from applying WidenSetOperationTypes before DecimalPrecision

2022-05-19 Thread Manu Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manu Zhang updated SPARK-39238: --- Description: The result of following SQL is 1.00 while 1. is expected {code:java

[jira] [Assigned] (SPARK-39237) Update the ANSI SQL mode documentation

2022-05-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39237: Assignee: Gengliang Wang (was: Apache Spark) > Update the ANSI SQL mode documentation >

[jira] [Commented] (SPARK-39237) Update the ANSI SQL mode documentation

2022-05-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539915#comment-17539915 ] Apache Spark commented on SPARK-39237: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-39237) Update the ANSI SQL mode documentation

2022-05-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39237: Assignee: Apache Spark (was: Gengliang Wang) > Update the ANSI SQL mode documentation >

[jira] [Updated] (SPARK-39238) Decimal precision loss from applying WidenSetOperationTypes before DecimalPrecision

2022-05-19 Thread Manu Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manu Zhang updated SPARK-39238: --- Description: The result of following SQL is 1.00 while 1. is expected {code:java

[jira] [Commented] (SPARK-39238) Decimal precision loss from applying WidenSetOperationTypes before DecimalPrecision

2022-05-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539919#comment-17539919 ] Apache Spark commented on SPARK-39238: -- User 'manuzhang' has created a pull request

[jira] [Assigned] (SPARK-39238) Decimal precision loss from applying WidenSetOperationTypes before DecimalPrecision

2022-05-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39238: Assignee: Apache Spark > Decimal precision loss from applying WidenSetOperationTypes befo

[jira] [Assigned] (SPARK-39238) Decimal precision loss from applying WidenSetOperationTypes before DecimalPrecision

2022-05-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39238: Assignee: (was: Apache Spark) > Decimal precision loss from applying WidenSetOperatio

[jira] [Assigned] (SPARK-39231) Change to use `ConstantColumnVector` to store partition columns in `VectorizedParquetRecordReader`

2022-05-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39231: Assignee: (was: Apache Spark) > Change to use `ConstantColumnVector` to store partiti

[jira] [Commented] (SPARK-39231) Change to use `ConstantColumnVector` to store partition columns in `VectorizedParquetRecordReader`

2022-05-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539928#comment-17539928 ] Apache Spark commented on SPARK-39231: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-39231) Change to use `ConstantColumnVector` to store partition columns in `VectorizedParquetRecordReader`

2022-05-19 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39231: Assignee: Apache Spark > Change to use `ConstantColumnVector` to store partition columns

[jira] [Updated] (SPARK-39188) Provide query context in runtime error of cast overflow

2022-05-19 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-39188: - Fix Version/s: 3.3.1 (was: 3.3.0) > Provide query context in runtime error of cas