[jira] [Created] (SPARK-35872) automatic some work for Spark releases

Wenchen Fan created SPARK-35872: --- Summary: automatic some work for Spark releases Key: SPARK-35872 URL: https://issues.apache.org/jira/browse/SPARK-35872 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-35605) Move to_pandas_on_spark to the Spark DataFrame.

[ https://issues.apache.org/jira/browse/SPARK-35605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35605: Assignee: (was: Apache Spark) > Move to_pandas_on_spark to the Spark DataFrame. > ---

[jira] [Commented] (SPARK-35605) Move to_pandas_on_spark to the Spark DataFrame.

[ https://issues.apache.org/jira/browse/SPARK-35605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17368666#comment-17368666 ] Apache Spark commented on SPARK-35605: -- User 'itholic' has created a pull request f

[jira] [Assigned] (SPARK-35605) Move to_pandas_on_spark to the Spark DataFrame.

[ https://issues.apache.org/jira/browse/SPARK-35605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35605: Assignee: Apache Spark > Move to_pandas_on_spark to the Spark DataFrame. > --

[jira] [Commented] (SPARK-35605) Move to_pandas_on_spark to the Spark DataFrame.

[ https://issues.apache.org/jira/browse/SPARK-35605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17368665#comment-17368665 ] Apache Spark commented on SPARK-35605: -- User 'itholic' has created a pull request f

[jira] [Assigned] (SPARK-35872) automatic some work for Spark releases

[ https://issues.apache.org/jira/browse/SPARK-35872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35872: Assignee: Apache Spark (was: Wenchen Fan) > automatic some work for Spark releases > ---

[jira] [Assigned] (SPARK-35872) automatic some work for Spark releases

[ https://issues.apache.org/jira/browse/SPARK-35872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35872: Assignee: Wenchen Fan (was: Apache Spark) > automatic some work for Spark releases > ---

[jira] [Commented] (SPARK-35872) automatic some work for Spark releases

[ https://issues.apache.org/jira/browse/SPARK-35872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17368670#comment-17368670 ] Apache Spark commented on SPARK-35872: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-35872) automatic some work for Spark releases

[ https://issues.apache.org/jira/browse/SPARK-35872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17368671#comment-17368671 ] Apache Spark commented on SPARK-35872: -- User 'cloud-fan' has created a pull request

[jira] [Created] (SPARK-35873) Remove the version check from the __init__ from pyspark.pandas

Haejoon Lee created SPARK-35873: --- Summary: Remove the version check from the __init__ from pyspark.pandas Key: SPARK-35873 URL: https://issues.apache.org/jira/browse/SPARK-35873 Project: Spark

[jira] [Assigned] (SPARK-35730) Check all day-time interval types in UDF

[ https://issues.apache.org/jira/browse/SPARK-35730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-35730: Assignee: angerszhu > Check all day-time interval types in UDF >

[jira] [Resolved] (SPARK-35730) Check all day-time interval types in UDF

[ https://issues.apache.org/jira/browse/SPARK-35730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-35730. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33047 [https://github.com

[jira] [Assigned] (SPARK-35871) Literal.create(value, dataType) should support fields

[ https://issues.apache.org/jira/browse/SPARK-35871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35871: Assignee: (was: Apache Spark) > Literal.create(value, dataType) should support fields

[jira] [Commented] (SPARK-35871) Literal.create(value, dataType) should support fields

[ https://issues.apache.org/jira/browse/SPARK-35871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17368684#comment-17368684 ] Apache Spark commented on SPARK-35871: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-35871) Literal.create(value, dataType) should support fields

[ https://issues.apache.org/jira/browse/SPARK-35871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35871: Assignee: Apache Spark > Literal.create(value, dataType) should support fields >

[jira] [Assigned] (SPARK-35768) Take into account year-month interval fields in cast

[ https://issues.apache.org/jira/browse/SPARK-35768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35768: --- Assignee: angerszhu > Take into account year-month interval fields in cast > --

[jira] [Resolved] (SPARK-35768) Take into account year-month interval fields in cast

[ https://issues.apache.org/jira/browse/SPARK-35768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35768. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32940 [https://gith

[jira] [Resolved] (SPARK-35090) Extract a field from ANSI interval

[ https://issues.apache.org/jira/browse/SPARK-35090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35090. - Fix Version/s: 3.2.0 Assignee: Kent Yao Resolution: Fixed > Extract a field from

[jira] [Resolved] (SPARK-35076) Parse interval literals as ANSI intervals

[ https://issues.apache.org/jira/browse/SPARK-35076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35076. - Resolution: Duplicate > Parse interval literals as ANSI intervals >

[jira] [Commented] (SPARK-35736) Parse any day-time interval types in SQL

[ https://issues.apache.org/jira/browse/SPARK-35736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17368705#comment-17368705 ] Apache Spark commented on SPARK-35736: -- User 'sarutak' has created a pull request f

[jira] [Commented] (SPARK-35774) Parse any year-month interval types in SQL

[ https://issues.apache.org/jira/browse/SPARK-35774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17368706#comment-17368706 ] Apache Spark commented on SPARK-35774: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-35841) Casting string to decimal type doesn't work if the sum of the digits is greater than 38

[ https://issues.apache.org/jira/browse/SPARK-35841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35841: --- Assignee: dgd_contributor > Casting string to decimal type doesn't work if the sum of the d

[jira] [Resolved] (SPARK-35841) Casting string to decimal type doesn't work if the sum of the digits is greater than 38

[ https://issues.apache.org/jira/browse/SPARK-35841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35841. - Fix Version/s: 3.1.3 3.2.0 Resolution: Fixed Issue resolved by pull re

[jira] [Resolved] (SPARK-35301) Document migration guide from Koalas to pandas APIs on Spark

[ https://issues.apache.org/jira/browse/SPARK-35301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35301. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33050 [https://gi

[jira] [Assigned] (SPARK-35301) Document migration guide from Koalas to pandas APIs on Spark

[ https://issues.apache.org/jira/browse/SPARK-35301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35301: Assignee: Hyukjin Kwon > Document migration guide from Koalas to pandas APIs on Spark > -

[jira] [Resolved] (SPARK-35786) Add a new operator to distingush if AQE can optimize safely

[ https://issues.apache.org/jira/browse/SPARK-35786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35786. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32932 [https://gith

[jira] [Assigned] (SPARK-35786) Add a new operator to distingush if AQE can optimize safely

[ https://issues.apache.org/jira/browse/SPARK-35786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35786: --- Assignee: XiDuo You > Add a new operator to distingush if AQE can optimize safely > ---

[jira] [Resolved] (SPARK-35728) Check multiply/divide of day-time intervals of any fields by numeric

[ https://issues.apache.org/jira/browse/SPARK-35728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-35728. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33014 [https://github.com

[jira] [Assigned] (SPARK-35728) Check multiply/divide of day-time intervals of any fields by numeric

[ https://issues.apache.org/jira/browse/SPARK-35728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-35728: Assignee: PengLei > Check multiply/divide of day-time intervals of any fields by numeric > --

[jira] [Assigned] (SPARK-35778) Check multiply/divide of year-month intervals of any fields by numeric

[ https://issues.apache.org/jira/browse/SPARK-35778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-35778: Assignee: PengLei > Check multiply/divide of year-month intervals of any fields by numeric >

[jira] [Resolved] (SPARK-35778) Check multiply/divide of year-month intervals of any fields by numeric

[ https://issues.apache.org/jira/browse/SPARK-35778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-35778. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33051 [https://github.com

[jira] [Resolved] (SPARK-35802) Error loading the stages/stage/ page in spark UI

[ https://issues.apache.org/jira/browse/SPARK-35802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-35802. Resolution: Not A Problem > Error loading the stages/stage/ page in spark UI > ---

[jira] [Assigned] (SPARK-35476) Enable disallow_untyped_defs mypy check for pyspark.pandas.series.

[ https://issues.apache.org/jira/browse/SPARK-35476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35476: Assignee: Takuya Ueshin > Enable disallow_untyped_defs mypy check for pyspark.pandas.seri

[jira] [Resolved] (SPARK-35476) Enable disallow_untyped_defs mypy check for pyspark.pandas.series.

[ https://issues.apache.org/jira/browse/SPARK-35476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35476. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33045 [https://gi

[jira] [Created] (SPARK-35874) AQE Shuffle should wait for its subqueries to finish before materializing

Wenchen Fan created SPARK-35874: --- Summary: AQE Shuffle should wait for its subqueries to finish before materializing Key: SPARK-35874 URL: https://issues.apache.org/jira/browse/SPARK-35874 Project: Spar

[jira] [Assigned] (SPARK-35874) AQE Shuffle should wait for its subqueries to finish before materializing

[ https://issues.apache.org/jira/browse/SPARK-35874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35874: Assignee: Apache Spark > AQE Shuffle should wait for its subqueries to finish before mate

[jira] [Commented] (SPARK-35874) AQE Shuffle should wait for its subqueries to finish before materializing

[ https://issues.apache.org/jira/browse/SPARK-35874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17368777#comment-17368777 ] Apache Spark commented on SPARK-35874: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-35874) AQE Shuffle should wait for its subqueries to finish before materializing

[ https://issues.apache.org/jira/browse/SPARK-35874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35874: Assignee: (was: Apache Spark) > AQE Shuffle should wait for its subqueries to finish

[jira] [Commented] (SPARK-35778) Check multiply/divide of year-month intervals of any fields by numeric

[ https://issues.apache.org/jira/browse/SPARK-35778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17368780#comment-17368780 ] Apache Spark commented on SPARK-35778: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-35728) Check multiply/divide of day-time intervals of any fields by numeric

[ https://issues.apache.org/jira/browse/SPARK-35728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17368781#comment-17368781 ] Apache Spark commented on SPARK-35728: -- User 'MaxGekk' has created a pull request f

[jira] [Created] (SPARK-35875) SparkThriftServer can not start when HMS use DBTokenStore

YulongZ created SPARK-35875: --- Summary: SparkThriftServer can not start when HMS use DBTokenStore Key: SPARK-35875 URL: https://issues.apache.org/jira/browse/SPARK-35875 Project: Spark Issue Type: B

[jira] [Created] (SPARK-35876) array_zip unexpected column names

Derk Crezee created SPARK-35876: --- Summary: array_zip unexpected column names Key: SPARK-35876 URL: https://issues.apache.org/jira/browse/SPARK-35876 Project: Spark Issue Type: Bug Com

[jira] [Updated] (SPARK-35876) array_zip unexpected column names

[ https://issues.apache.org/jira/browse/SPARK-35876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Derk Crezee updated SPARK-35876: Description: {{When I'm using the array_zip function in combination with renamed columns, I get a

[jira] [Updated] (SPARK-35876) array_zip unexpected column names

[ https://issues.apache.org/jira/browse/SPARK-35876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Derk Crezee updated SPARK-35876: Description: {{When I'm using the array_zip function in combination with renamed columns, I get a

[jira] [Commented] (SPARK-35862) Watermark timestamp only can be format in UTC timeZone, unfriendly to users in other time zones

[ https://issues.apache.org/jira/browse/SPARK-35862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17368801#comment-17368801 ] Apache Spark commented on SPARK-35862: -- User 'toujours33' has created a pull reques

[jira] [Commented] (SPARK-35862) Watermark timestamp only can be format in UTC timeZone, unfriendly to users in other time zones

[ https://issues.apache.org/jira/browse/SPARK-35862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17368800#comment-17368800 ] Apache Spark commented on SPARK-35862: -- User 'toujours33' has created a pull reques

[jira] [Assigned] (SPARK-35862) Watermark timestamp only can be format in UTC timeZone, unfriendly to users in other time zones

[ https://issues.apache.org/jira/browse/SPARK-35862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35862: Assignee: Apache Spark > Watermark timestamp only can be format in UTC timeZone, unfriend

[jira] [Assigned] (SPARK-35862) Watermark timestamp only can be format in UTC timeZone, unfriendly to users in other time zones

[ https://issues.apache.org/jira/browse/SPARK-35862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35862: Assignee: (was: Apache Spark) > Watermark timestamp only can be format in UTC timeZon

[jira] [Commented] (SPARK-35623) Volcano resource manager for Spark on Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-35623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17368807#comment-17368807 ] Dipanjan Kailthya commented on SPARK-35623: --- I added our WIP code on Github:

[jira] [Created] (SPARK-35877) Spark Protobuf jar has CVE issue CVE-2015-5237

jobit mathew created SPARK-35877: Summary: Spark Protobuf jar has CVE issue CVE-2015-5237 Key: SPARK-35877 URL: https://issues.apache.org/jira/browse/SPARK-35877 Project: Spark Issue Type: Bu

[jira] [Comment Edited] (SPARK-35623) Volcano resource manager for Spark on Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-35623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17368807#comment-17368807 ] Dipanjan Kailthya edited comment on SPARK-35623 at 6/24/21, 12:16 PM:

[jira] [Commented] (SPARK-35877) Spark Protobuf jar has CVE issue CVE-2015-5237

[ https://issues.apache.org/jira/browse/SPARK-35877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17368810#comment-17368810 ] pavithra ramachandran commented on SPARK-35877: --- i ll raise PR soon > Spa

[jira] [Commented] (SPARK-35623) Volcano resource manager for Spark on Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-35623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17368814#comment-17368814 ] Dipanjan Kailthya commented on SPARK-35623: --- [~pingsutw] - I sent you an invit

[jira] [Commented] (SPARK-35868) Add fs.s3a.downgrade.syncable.exceptions if not set

[ https://issues.apache.org/jira/browse/SPARK-35868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17368822#comment-17368822 ] Steve Loughran commented on SPARK-35868: Which bits of code was this failing on?

[jira] [Created] (SPARK-35878) add fs.s3a.endpoint if unset and fs.s3a.endpoint.region is null

Steve Loughran created SPARK-35878: -- Summary: add fs.s3a.endpoint if unset and fs.s3a.endpoint.region is null Key: SPARK-35878 URL: https://issues.apache.org/jira/browse/SPARK-35878 Project: Spark

[jira] [Assigned] (SPARK-35877) Spark Protobuf jar has CVE issue CVE-2015-5237

[ https://issues.apache.org/jira/browse/SPARK-35877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35877: Assignee: (was: Apache Spark) > Spark Protobuf jar has CVE issue CVE-2015-5237 >

[jira] [Commented] (SPARK-35877) Spark Protobuf jar has CVE issue CVE-2015-5237

[ https://issues.apache.org/jira/browse/SPARK-35877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17368829#comment-17368829 ] Apache Spark commented on SPARK-35877: -- User 'PavithraRamachandran' has created a p

[jira] [Assigned] (SPARK-35877) Spark Protobuf jar has CVE issue CVE-2015-5237

[ https://issues.apache.org/jira/browse/SPARK-35877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35877: Assignee: Apache Spark > Spark Protobuf jar has CVE issue CVE-2015-5237 > ---

[jira] [Commented] (SPARK-35877) Spark Protobuf jar has CVE issue CVE-2015-5237

[ https://issues.apache.org/jira/browse/SPARK-35877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17368828#comment-17368828 ] Apache Spark commented on SPARK-35877: -- User 'PavithraRamachandran' has created a p

[jira] [Created] (SPARK-35879) Fix performance regression caused by collectFetchRequests

Kent Yao created SPARK-35879: Summary: Fix performance regression caused by collectFetchRequests Key: SPARK-35879 URL: https://issues.apache.org/jira/browse/SPARK-35879 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-35879) Fix performance regression caused by collectFetchRequests

[ https://issues.apache.org/jira/browse/SPARK-35879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35879: Assignee: Apache Spark > Fix performance regression caused by collectFetchRequests >

[jira] [Commented] (SPARK-35879) Fix performance regression caused by collectFetchRequests

[ https://issues.apache.org/jira/browse/SPARK-35879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17368855#comment-17368855 ] Apache Spark commented on SPARK-35879: -- User 'yaooqinn' has created a pull request

[jira] [Assigned] (SPARK-35879) Fix performance regression caused by collectFetchRequests

[ https://issues.apache.org/jira/browse/SPARK-35879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35879: Assignee: (was: Apache Spark) > Fix performance regression caused by collectFetchRequ

[jira] [Commented] (SPARK-35879) Fix performance regression caused by collectFetchRequests

[ https://issues.apache.org/jira/browse/SPARK-35879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17368856#comment-17368856 ] Apache Spark commented on SPARK-35879: -- User 'yaooqinn' has created a pull request

[jira] [Resolved] (SPARK-35871) Literal.create(value, dataType) should support fields

[ https://issues.apache.org/jira/browse/SPARK-35871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-35871. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33056 [https://github.com

[jira] [Assigned] (SPARK-35871) Literal.create(value, dataType) should support fields

[ https://issues.apache.org/jira/browse/SPARK-35871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-35871: Assignee: angerszhu > Literal.create(value, dataType) should support fields > ---

[jira] [Commented] (SPARK-34723) Correct parameter type for subexpression elimination under whole-stage

[ https://issues.apache.org/jira/browse/SPARK-34723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17368894#comment-17368894 ] Andrew Olson commented on SPARK-34723: -- In case it might be helpful to anyone, the

[jira] [Assigned] (SPARK-34320) Migrate ALTER TABLE drop columns command to the new resolution framework

[ https://issues.apache.org/jira/browse/SPARK-34320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34320: --- Assignee: Terry Kim > Migrate ALTER TABLE drop columns command to the new resolution framew

[jira] [Resolved] (SPARK-34320) Migrate ALTER TABLE drop columns command to the new resolution framework

[ https://issues.apache.org/jira/browse/SPARK-34320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34320. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32854 [https://gith

[jira] [Created] (SPARK-35880) [SS] Track the number of duplicates dropped in streaming dedupe operator

Venki Korukanti created SPARK-35880: --- Summary: [SS] Track the number of duplicates dropped in streaming dedupe operator Key: SPARK-35880 URL: https://issues.apache.org/jira/browse/SPARK-35880 Projec

[jira] [Created] (SPARK-35881) [SQL] AQE does not support columnar execution for the final query stage

Andy Grove created SPARK-35881: -- Summary: [SQL] AQE does not support columnar execution for the final query stage Key: SPARK-35881 URL: https://issues.apache.org/jira/browse/SPARK-35881 Project: Spark

[jira] [Updated] (SPARK-35881) [SQL] AQE does not support columnar execution for the final query stage

[ https://issues.apache.org/jira/browse/SPARK-35881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Grove updated SPARK-35881: --- Description: In AdaptiveSparkPlanExec, a query is broken down into stages and these stages are exec

[jira] [Updated] (SPARK-35881) [SQL] AQE does not support columnar execution for the final query stage

[ https://issues.apache.org/jira/browse/SPARK-35881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Grove updated SPARK-35881: --- Description: In AdaptiveSparkPlanExec, a query is broken down into stages and these stages are exec

[jira] [Commented] (SPARK-35878) add fs.s3a.endpoint if unset and fs.s3a.endpoint.region is null

[ https://issues.apache.org/jira/browse/SPARK-35878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17368943#comment-17368943 ] Apache Spark commented on SPARK-35878: -- User 'steveloughran' has created a pull req

[jira] [Assigned] (SPARK-35878) add fs.s3a.endpoint if unset and fs.s3a.endpoint.region is null

[ https://issues.apache.org/jira/browse/SPARK-35878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35878: Assignee: Apache Spark > add fs.s3a.endpoint if unset and fs.s3a.endpoint.region is null

[jira] [Assigned] (SPARK-35878) add fs.s3a.endpoint if unset and fs.s3a.endpoint.region is null

[ https://issues.apache.org/jira/browse/SPARK-35878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35878: Assignee: (was: Apache Spark) > add fs.s3a.endpoint if unset and fs.s3a.endpoint.regi

[jira] [Assigned] (SPARK-35290) unionByName with null filling fails for some nested structs

[ https://issues.apache.org/jira/browse/SPARK-35290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-35290: --- Assignee: Adam Binford > unionByName with null filling fails for some nested structs >

[jira] [Resolved] (SPARK-35290) unionByName with null filling fails for some nested structs

[ https://issues.apache.org/jira/browse/SPARK-35290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-35290. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33040 [https://gith

[jira] [Assigned] (SPARK-35880) [SS] Track the number of duplicates dropped in streaming dedupe operator

[ https://issues.apache.org/jira/browse/SPARK-35880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35880: Assignee: Apache Spark > [SS] Track the number of duplicates dropped in streaming dedupe

[jira] [Assigned] (SPARK-35880) [SS] Track the number of duplicates dropped in streaming dedupe operator

[ https://issues.apache.org/jira/browse/SPARK-35880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35880: Assignee: (was: Apache Spark) > [SS] Track the number of duplicates dropped in stream

[jira] [Commented] (SPARK-35880) [SS] Track the number of duplicates dropped in streaming dedupe operator

[ https://issues.apache.org/jira/browse/SPARK-35880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17368965#comment-17368965 ] Apache Spark commented on SPARK-35880: -- User 'vkorukanti' has created a pull reques

[jira] [Commented] (SPARK-35880) [SS] Track the number of duplicates dropped in streaming dedupe operator

[ https://issues.apache.org/jira/browse/SPARK-35880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17368966#comment-17368966 ] Apache Spark commented on SPARK-35880: -- User 'vkorukanti' has created a pull reques

[jira] [Commented] (SPARK-35471) Enable disallow_untyped_defs mypy check for pyspark.pandas.frame.

[ https://issues.apache.org/jira/browse/SPARK-35471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17368970#comment-17368970 ] Takuya Ueshin commented on SPARK-35471: --- I'm working on this. > Enable disallow_u

[jira] [Created] (SPARK-35882) Query performance degradation additional predicate and UDF call for explode

John Bateman created SPARK-35882: Summary: Query performance degradation additional predicate and UDF call for explode Key: SPARK-35882 URL: https://issues.apache.org/jira/browse/SPARK-35882 Project:

[jira] [Updated] (SPARK-35882) Query performance degradation additional predicate and UDF call for explode

[ https://issues.apache.org/jira/browse/SPARK-35882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Bateman updated SPARK-35882: - Description: This issue cannot be seen in 3.0.1, but has been introduced since and observed in

[jira] [Commented] (SPARK-34927) Support TPCDSQueryBenchmark in Benchmarks

[ https://issues.apache.org/jira/browse/SPARK-34927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17369030#comment-17369030 ] Dongjoon Hyun commented on SPARK-34927: --- Is there any update for this JIRA, [~Myeo

[jira] [Resolved] (SPARK-35870) Upgrade Jetty to 9.4.42

[ https://issues.apache.org/jira/browse/SPARK-35870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-35870. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved inhttps://github.com/apache/s

[jira] [Created] (SPARK-35883) Migrate ALTER TABLE rename column command to the new resolution framework

Terry Kim created SPARK-35883: - Summary: Migrate ALTER TABLE rename column command to the new resolution framework Key: SPARK-35883 URL: https://issues.apache.org/jira/browse/SPARK-35883 Project: Spark

[jira] [Assigned] (SPARK-35883) Migrate ALTER TABLE rename column command to the new resolution framework

[ https://issues.apache.org/jira/browse/SPARK-35883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35883: Assignee: Apache Spark > Migrate ALTER TABLE rename column command to the new resolution

[jira] [Commented] (SPARK-35883) Migrate ALTER TABLE rename column command to the new resolution framework

[ https://issues.apache.org/jira/browse/SPARK-35883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17369038#comment-17369038 ] Apache Spark commented on SPARK-35883: -- User 'imback82' has created a pull request

[jira] [Assigned] (SPARK-35883) Migrate ALTER TABLE rename column command to the new resolution framework

[ https://issues.apache.org/jira/browse/SPARK-35883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35883: Assignee: (was: Apache Spark) > Migrate ALTER TABLE rename column command to the new

[jira] [Resolved] (SPARK-35403) Migrate ALTER TABLE commands that alter columns to new framework

[ https://issues.apache.org/jira/browse/SPARK-35403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Kim resolved SPARK-35403. --- Resolution: Duplicate Will be done as a separate subtask for each command. > Migrate ALTER TABLE co

[jira] [Resolved] (SPARK-30535) Migrate ALTER TABLE commands to the new resolution framework

[ https://issues.apache.org/jira/browse/SPARK-30535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Kim resolved SPARK-30535. --- Resolution: Duplicate Will be done as a separate subtask for each command. > Migrate ALTER TABLE co

[jira] [Resolved] (SPARK-30283) V2 Command logical plan should use UnresolvedV2Relation for a table

[ https://issues.apache.org/jira/browse/SPARK-30283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Kim resolved SPARK-30283. --- Resolution: Duplicate Already resolved as separate subtasks. > V2 Command logical plan should use U

[jira] [Created] (SPARK-35884) EXPLAIN FORMATTED for AQE

Wenchen Fan created SPARK-35884: --- Summary: EXPLAIN FORMATTED for AQE Key: SPARK-35884 URL: https://issues.apache.org/jira/browse/SPARK-35884 Project: Spark Issue Type: New Feature Com

[jira] [Updated] (SPARK-35884) EXPLAIN FORMATTED for AQE

[ https://issues.apache.org/jira/browse/SPARK-35884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-35884: Issue Type: Bug (was: New Feature) > EXPLAIN FORMATTED for AQE > - > >

[jira] [Commented] (SPARK-35868) Add fs.s3a.downgrade.syncable.exceptions if not set

[ https://issues.apache.org/jira/browse/SPARK-35868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17369061#comment-17369061 ] Dongjoon Hyun commented on SPARK-35868: --- Thank you for the comment, [~ste...@apach

[jira] [Assigned] (SPARK-35884) EXPLAIN FORMATTED for AQE

[ https://issues.apache.org/jira/browse/SPARK-35884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35884: Assignee: (was: Apache Spark) > EXPLAIN FORMATTED for AQE > -

[jira] [Commented] (SPARK-35884) EXPLAIN FORMATTED for AQE

[ https://issues.apache.org/jira/browse/SPARK-35884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17369063#comment-17369063 ] Apache Spark commented on SPARK-35884: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-35884) EXPLAIN FORMATTED for AQE

[ https://issues.apache.org/jira/browse/SPARK-35884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35884: Assignee: Apache Spark > EXPLAIN FORMATTED for AQE > - > >

  1   2   >