[jira] [Resolved] (SPARK-31948) expose mapSideCombine in aggByKey/reduceByKey/foldByKey

[ https://issues.apache.org/jira/browse/SPARK-31948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-31948. -- Resolution: Not A Problem > expose mapSideCombine in aggByKey/reduceByKey/foldByKey >

[jira] [Commented] (SPARK-33791) grouping__id() result does not consistent with hive's version < 2.3

[ https://issues.apache.org/jira/browse/SPARK-33791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251547#comment-17251547 ] Apache Spark commented on SPARK-33791: -- User 'sqlwindspeaker' has created a pull request for this

[jira] [Assigned] (SPARK-33791) grouping__id() result does not consistent with hive's version < 2.3

[ https://issues.apache.org/jira/browse/SPARK-33791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33791: Assignee: (was: Apache Spark) > grouping__id() result does not consistent with

[jira] [Assigned] (SPARK-33791) grouping__id() result does not consistent with hive's version < 2.3

[ https://issues.apache.org/jira/browse/SPARK-33791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33791: Assignee: Apache Spark > grouping__id() result does not consistent with hive's version <

[jira] [Resolved] (SPARK-26341) Expose executor memory metrics at the stage level, in the Stages tab

[ https://issues.apache.org/jira/browse/SPARK-26341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-26341. Fix Version/s: 3.2.0 3.1.0 Assignee: angerszhu

[jira] [Updated] (SPARK-33836) Expose DataStreamReader.table and DataStreamWriter.toTable to PySpark

[ https://issues.apache.org/jira/browse/SPARK-33836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-33836: - Affects Version/s: (was: 3.1.0) 3.2.0 > Expose

[jira] [Resolved] (SPARK-33825) Is Spark SQL able to auto update partition stats like hive by setting hive.stats.autogather=true

[ https://issues.apache.org/jira/browse/SPARK-33825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33825. -- Resolution: Invalid Let's ask questions to dev mailing list before filing it as an issue. See

[jira] [Updated] (SPARK-33825) Is Spark SQL able to auto update partition stats like hive by setting hive.stats.autogather=true

[ https://issues.apache.org/jira/browse/SPARK-33825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33825: - Target Version/s: (was: 3.0.1) > Is Spark SQL able to auto update partition stats like hive

[jira] [Commented] (SPARK-33791) grouping__id() result does not consistent with hive's version < 2.3

[ https://issues.apache.org/jira/browse/SPARK-33791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251516#comment-17251516 ] Hyukjin Kwon commented on SPARK-33791: -- Can you document it in

[jira] [Commented] (SPARK-33795) gapply fails execution with rbind error

[ https://issues.apache.org/jira/browse/SPARK-33795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251515#comment-17251515 ] Hyukjin Kwon commented on SPARK-33795: -- [~n8shdw] can you check if this happens in Apache Spark

[jira] [Commented] (SPARK-33826) InsertIntoHiveTable generate HDFS file with invalid user

[ https://issues.apache.org/jira/browse/SPARK-33826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251513#comment-17251513 ] Hyukjin Kwon commented on SPARK-33826: -- [~AlberyZJG] are you able to show the self-contained

[jira] [Commented] (SPARK-33833) Allow Spark Structured Streaming report Kafka Lag through Burrow

[ https://issues.apache.org/jira/browse/SPARK-33833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251512#comment-17251512 ] Hyukjin Kwon commented on SPARK-33833: -- Looks like it leverages listenters. Can you use

[jira] [Assigned] (SPARK-33836) Expose DataStreamReader.table and DataStreamWriter.toTable to PySpark

[ https://issues.apache.org/jira/browse/SPARK-33836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33836: Assignee: Apache Spark > Expose DataStreamReader.table and DataStreamWriter.toTable to

[jira] [Assigned] (SPARK-33836) Expose DataStreamReader.table and DataStreamWriter.toTable to PySpark

[ https://issues.apache.org/jira/browse/SPARK-33836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33836: Assignee: (was: Apache Spark) > Expose DataStreamReader.table and

[jira] [Commented] (SPARK-33836) Expose DataStreamReader.table and DataStreamWriter.toTable to PySpark

[ https://issues.apache.org/jira/browse/SPARK-33836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251510#comment-17251510 ] Apache Spark commented on SPARK-33836: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Commented] (SPARK-33836) Expose DataStreamReader.table and DataStreamWriter.toTable to PySpark

[ https://issues.apache.org/jira/browse/SPARK-33836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251509#comment-17251509 ] Hyukjin Kwon commented on SPARK-33836: -- cc [~zero323] FYI > Expose DataStreamReader.table and

[jira] [Created] (SPARK-33836) Expose DataStreamReader.table and DataStreamWriter.toTable to PySpark

Jungtaek Lim created SPARK-33836: Summary: Expose DataStreamReader.table and DataStreamWriter.toTable to PySpark Key: SPARK-33836 URL: https://issues.apache.org/jira/browse/SPARK-33836 Project: Spark

[jira] [Updated] (SPARK-33593) Vector reader got incorrect data with binary partition value

[ https://issues.apache.org/jira/browse/SPARK-33593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33593: -- Affects Version/s: 2.0.2 > Vector reader got incorrect data with binary partition value >

[jira] [Updated] (SPARK-33593) Vector reader got incorrect data with binary partition value

[ https://issues.apache.org/jira/browse/SPARK-33593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33593: -- Target Version/s: 2.4.8, 3.0.2, 3.1.0 > Vector reader got incorrect data with binary

[jira] [Updated] (SPARK-33593) Vector reader got incorrect data with binary partition value

[ https://issues.apache.org/jira/browse/SPARK-33593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33593: -- Affects Version/s: 2.1.3 > Vector reader got incorrect data with binary partition value >

[jira] [Commented] (SPARK-33593) Vector reader got incorrect data with binary partition value

[ https://issues.apache.org/jira/browse/SPARK-33593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251502#comment-17251502 ] Dongjoon Hyun commented on SPARK-33593: --- Although this is not a regression, I marked this as a

[jira] [Updated] (SPARK-33593) Vector reader got incorrect data with binary partition value

[ https://issues.apache.org/jira/browse/SPARK-33593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33593: -- Affects Version/s: 2.2.3 > Vector reader got incorrect data with binary partition value >

[jira] [Updated] (SPARK-33593) Vector reader got incorrect data with binary partition value

[ https://issues.apache.org/jira/browse/SPARK-33593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33593: -- Priority: Blocker (was: Major) > Vector reader got incorrect data with binary partition

[jira] [Updated] (SPARK-33593) Vector reader got incorrect data with binary partition value

[ https://issues.apache.org/jira/browse/SPARK-33593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33593: -- Affects Version/s: (was: 3.0.0) 2.3.4 > Vector reader got

[jira] [Updated] (SPARK-33593) Vector reader got incorrect data with binary partition value

[ https://issues.apache.org/jira/browse/SPARK-33593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33593: -- Affects Version/s: 2.4.7 > Vector reader got incorrect data with binary partition value >

[jira] [Resolved] (SPARK-33817) Use a logical plan to cache instead of dataframe

[ https://issues.apache.org/jira/browse/SPARK-33817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33817. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30815

[jira] [Assigned] (SPARK-33817) Use a logical plan to cache instead of dataframe

[ https://issues.apache.org/jira/browse/SPARK-33817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33817: --- Assignee: Terry Kim > Use a logical plan to cache instead of dataframe >

[jira] [Updated] (SPARK-33593) Vector reader got incorrect data with binary partition value

[ https://issues.apache.org/jira/browse/SPARK-33593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33593: -- Affects Version/s: 3.2.0 3.0.0 3.0.1 > Vector

[jira] [Updated] (SPARK-33593) Parquet vector reader incorrect with binary partition value

[ https://issues.apache.org/jira/browse/SPARK-33593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33593: -- Labels: correctness (was: ) > Parquet vector reader incorrect with binary partition value >

[jira] [Updated] (SPARK-33593) Vector reader got incorrect data with binary partition value

[ https://issues.apache.org/jira/browse/SPARK-33593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33593: -- Summary: Vector reader got incorrect data with binary partition value (was: Parquet vector

[jira] [Commented] (SPARK-33834) Verify ALTER TABLE CHANGE COLUMN with Char and Varchar

[ https://issues.apache.org/jira/browse/SPARK-33834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251482#comment-17251482 ] Apache Spark commented on SPARK-33834: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33834) Verify ALTER TABLE CHANGE COLUMN with Char and Varchar

[ https://issues.apache.org/jira/browse/SPARK-33834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33834: Assignee: (was: Apache Spark) > Verify ALTER TABLE CHANGE COLUMN with Char and

[jira] [Assigned] (SPARK-33834) Verify ALTER TABLE CHANGE COLUMN with Char and Varchar

[ https://issues.apache.org/jira/browse/SPARK-33834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33834: Assignee: Apache Spark > Verify ALTER TABLE CHANGE COLUMN with Char and Varchar >

[jira] [Commented] (SPARK-33834) Verify ALTER TABLE CHANGE COLUMN with Char and Varchar

[ https://issues.apache.org/jira/browse/SPARK-33834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251481#comment-17251481 ] Apache Spark commented on SPARK-33834: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Commented] (SPARK-33489) Support null for conversion from and to Arrow type

[ https://issues.apache.org/jira/browse/SPARK-33489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251480#comment-17251480 ] Apache Spark commented on SPARK-33489: -- User 'Cactice' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33489) Support null for conversion from and to Arrow type

[ https://issues.apache.org/jira/browse/SPARK-33489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33489: Assignee: Apache Spark > Support null for conversion from and to Arrow type >

[jira] [Assigned] (SPARK-33489) Support null for conversion from and to Arrow type

[ https://issues.apache.org/jira/browse/SPARK-33489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33489: Assignee: (was: Apache Spark) > Support null for conversion from and to Arrow type >

[jira] [Assigned] (SPARK-33835) Refector AbstractCommandBuilder

[ https://issues.apache.org/jira/browse/SPARK-33835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33835: Assignee: Apache Spark > Refector AbstractCommandBuilder >

[jira] [Assigned] (SPARK-33835) Refector AbstractCommandBuilder

[ https://issues.apache.org/jira/browse/SPARK-33835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33835: Assignee: (was: Apache Spark) > Refector AbstractCommandBuilder >

[jira] [Commented] (SPARK-33835) Refector AbstractCommandBuilder

[ https://issues.apache.org/jira/browse/SPARK-33835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251479#comment-17251479 ] Apache Spark commented on SPARK-33835: -- User 'offthewall123' has created a pull request for this

[jira] [Updated] (SPARK-30186) support Dynamic Partition Pruning in Adaptive Execution

[ https://issues.apache.org/jira/browse/SPARK-30186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-30186: Parent: SPARK-33828 Issue Type: Sub-task (was: Improvement) > support Dynamic Partition

[jira] [Created] (SPARK-33835) Refector AbstractCommandBuilder

Xudingyu created SPARK-33835: Summary: Refector AbstractCommandBuilder Key: SPARK-33835 URL: https://issues.apache.org/jira/browse/SPARK-33835 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-33834) Verify ALTER TABLE CHANGE COLUMN with Char and Varchar

Kent Yao created SPARK-33834: Summary: Verify ALTER TABLE CHANGE COLUMN with Char and Varchar Key: SPARK-33834 URL: https://issues.apache.org/jira/browse/SPARK-33834 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-33831) Update Jetty to 9.4.34

[ https://issues.apache.org/jira/browse/SPARK-33831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33831. --- Fix Version/s: 2.4.8 3.0.2 3.1.0 Resolution:

[jira] [Assigned] (SPARK-33831) Update Jetty to 9.4.34

[ https://issues.apache.org/jira/browse/SPARK-33831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33831: - Assignee: Sean R. Owen > Update Jetty to 9.4.34 > -- > >

[jira] [Updated] (SPARK-33822) TPCDS Q5 fails if spark.sql.adaptive.enabled=true

[ https://issues.apache.org/jira/browse/SPARK-33822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33822: -- Fix Version/s: 3.0.2 > TPCDS Q5 fails if spark.sql.adaptive.enabled=true >

[jira] [Updated] (SPARK-33831) Update Jetty to 9.4.34

[ https://issues.apache.org/jira/browse/SPARK-33831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33831: -- Issue Type: Bug (was: Improvement) > Update Jetty to 9.4.34 > -- > >

[jira] [Resolved] (SPARK-33797) Update SS doc about State Store and task locality

[ https://issues.apache.org/jira/browse/SPARK-33797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-33797. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30789

[jira] [Updated] (SPARK-33831) Update Jetty to 9.4.34

[ https://issues.apache.org/jira/browse/SPARK-33831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-33831: - Description: We should update Jetty to 9.4.34, from 9.4.28, to pick up fixes, plus a possible

[jira] [Commented] (SPARK-33822) TPCDS Q5 fails if spark.sql.adaptive.enabled=true

[ https://issues.apache.org/jira/browse/SPARK-33822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251431#comment-17251431 ] Apache Spark commented on SPARK-33822: -- User 'maropu' has created a pull request for this issue:

[jira] [Commented] (SPARK-33822) TPCDS Q5 fails if spark.sql.adaptive.enabled=true

[ https://issues.apache.org/jira/browse/SPARK-33822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251430#comment-17251430 ] Apache Spark commented on SPARK-33822: -- User 'maropu' has created a pull request for this issue:

[jira] [Resolved] (SPARK-33824) Restructure and improve Python package management page

[ https://issues.apache.org/jira/browse/SPARK-33824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33824. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30822

[jira] [Assigned] (SPARK-33824) Restructure and improve Python package management page

[ https://issues.apache.org/jira/browse/SPARK-33824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33824: Assignee: Hyukjin Kwon > Restructure and improve Python package management page >

[jira] [Updated] (SPARK-33822) TPCDS Q5 fails if spark.sql.adaptive.enabled=true

[ https://issues.apache.org/jira/browse/SPARK-33822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33822: -- Target Version/s: 3.0.2, 3.1.0 (was: 3.2.0) > TPCDS Q5 fails if

[jira] [Updated] (SPARK-33822) TPCDS Q5 fails if spark.sql.adaptive.enabled=true

[ https://issues.apache.org/jira/browse/SPARK-33822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33822: -- Fix Version/s: (was: 3.0.2) > TPCDS Q5 fails if spark.sql.adaptive.enabled=true >

[jira] [Assigned] (SPARK-33822) TPCDS Q5 fails if spark.sql.adaptive.enabled=true

[ https://issues.apache.org/jira/browse/SPARK-33822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33822: - Assignee: Takeshi Yamamuro > TPCDS Q5 fails if spark.sql.adaptive.enabled=true >

[jira] [Resolved] (SPARK-33822) TPCDS Q5 fails if spark.sql.adaptive.enabled=true

[ https://issues.apache.org/jira/browse/SPARK-33822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33822. --- Fix Version/s: 3.0.2 3.1.0 Resolution: Fixed Issue resolved by

[jira] [Commented] (SPARK-33832) Add an option in AQE to mitigate skew even if it causes an new shuffle

[ https://issues.apache.org/jira/browse/SPARK-33832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251408#comment-17251408 ] Apache Spark commented on SPARK-33832: -- User 'ekoifman' has created a pull request for this issue:

[jira] [Commented] (SPARK-33832) Add an option in AQE to mitigate skew even if it causes an new shuffle

[ https://issues.apache.org/jira/browse/SPARK-33832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251409#comment-17251409 ] Apache Spark commented on SPARK-33832: -- User 'ekoifman' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33832) Add an option in AQE to mitigate skew even if it causes an new shuffle

[ https://issues.apache.org/jira/browse/SPARK-33832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33832: Assignee: Apache Spark > Add an option in AQE to mitigate skew even if it causes an new

[jira] [Assigned] (SPARK-33832) Add an option in AQE to mitigate skew even if it causes an new shuffle

[ https://issues.apache.org/jira/browse/SPARK-33832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33832: Assignee: (was: Apache Spark) > Add an option in AQE to mitigate skew even if it

[jira] [Assigned] (SPARK-27620) Update jetty to 9.4.18.v20190429

[ https://issues.apache.org/jira/browse/SPARK-27620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-27620: --- Assignee: Yuming Wang (was: yuming.wang) > Update jetty to 9.4.18.v20190429 >

[jira] [Commented] (SPARK-33828) SQL Adaptive Query Execution QA

[ https://issues.apache.org/jira/browse/SPARK-33828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251403#comment-17251403 ] Takeshi Yamamuro commented on SPARK-33828: -- Thanks for letting me know, Dongjoon~ > SQL

[jira] [Created] (SPARK-33833) Allow Spark Structured Streaming report Kafka Lag through Burrow

Sam Davarnia created SPARK-33833: Summary: Allow Spark Structured Streaming report Kafka Lag through Burrow Key: SPARK-33833 URL: https://issues.apache.org/jira/browse/SPARK-33833 Project: Spark

[jira] [Updated] (SPARK-33828) SQL Adaptive Query Execution QA

[ https://issues.apache.org/jira/browse/SPARK-33828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33828: -- Description: Since SPARK-31412 is delivered at 3.0.0, we received and handled many JIRA

[jira] [Updated] (SPARK-33832) Add an option in AQE to mitigate skew even if it causes an new shuffle

[ https://issues.apache.org/jira/browse/SPARK-33832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated SPARK-33832: --- Description: Currently {{OptimizeSkewedJoin}} will not apply if skew mitigation causes a

[jira] [Updated] (SPARK-33832) Add an option in AQE to mitigate skew even if it causes an new shuffle

[ https://issues.apache.org/jira/browse/SPARK-33832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Koifman updated SPARK-33832: --- Description: Currently {{OptimizeSkewdJoin}} will not apply if skew mitigation causes a new

[jira] [Created] (SPARK-33832) Add an option in AQE to mitigate skew even if it causes an new shuffle

Eugene Koifman created SPARK-33832: -- Summary: Add an option in AQE to mitigate skew even if it causes an new shuffle Key: SPARK-33832 URL: https://issues.apache.org/jira/browse/SPARK-33832 Project:

[jira] [Assigned] (SPARK-33831) Update Jetty to 9.4.35

[ https://issues.apache.org/jira/browse/SPARK-33831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33831: Assignee: Apache Spark > Update Jetty to 9.4.35 > -- > >

[jira] [Assigned] (SPARK-33831) Update Jetty to 9.4.35

[ https://issues.apache.org/jira/browse/SPARK-33831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33831: Assignee: (was: Apache Spark) > Update Jetty to 9.4.35 > -- > >

[jira] [Commented] (SPARK-33831) Update Jetty to 9.4.35

[ https://issues.apache.org/jira/browse/SPARK-33831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251365#comment-17251365 ] Apache Spark commented on SPARK-33831: -- User 'srowen' has created a pull request for this issue:

[jira] [Created] (SPARK-33831) Update Jetty to 9.4.35

Sean R. Owen created SPARK-33831: Summary: Update Jetty to 9.4.35 Key: SPARK-33831 URL: https://issues.apache.org/jira/browse/SPARK-33831 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-27620) Update jetty to 9.4.18.v20190429

[ https://issues.apache.org/jira/browse/SPARK-27620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-27620: - Priority: Minor (was: Major) > Update jetty to 9.4.18.v20190429 >

[jira] [Commented] (SPARK-33827) Unload State Store asap once it becomes inactive

[ https://issues.apache.org/jira/browse/SPARK-33827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251353#comment-17251353 ] Apache Spark commented on SPARK-33827: -- User 'viirya' has created a pull request for this issue:

[jira] [Commented] (SPARK-33827) Unload State Store asap once it becomes inactive

[ https://issues.apache.org/jira/browse/SPARK-33827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251354#comment-17251354 ] Apache Spark commented on SPARK-33827: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33827) Unload State Store asap once it becomes inactive

[ https://issues.apache.org/jira/browse/SPARK-33827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33827: Assignee: Apache Spark > Unload State Store asap once it becomes inactive >

[jira] [Assigned] (SPARK-33827) Unload State Store asap once it becomes inactive

[ https://issues.apache.org/jira/browse/SPARK-33827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33827: Assignee: (was: Apache Spark) > Unload State Store asap once it becomes inactive >

[jira] [Assigned] (SPARK-33830) Describe the PURGE option of ALTER TABLE .. DROP PARTITION

[ https://issues.apache.org/jira/browse/SPARK-33830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33830: Assignee: (was: Apache Spark) > Describe the PURGE option of ALTER TABLE .. DROP

[jira] [Assigned] (SPARK-33830) Describe the PURGE option of ALTER TABLE .. DROP PARTITION

[ https://issues.apache.org/jira/browse/SPARK-33830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33830: Assignee: Apache Spark > Describe the PURGE option of ALTER TABLE .. DROP PARTITION >

[jira] [Commented] (SPARK-33830) Describe the PURGE option of ALTER TABLE .. DROP PARTITION

[ https://issues.apache.org/jira/browse/SPARK-33830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251302#comment-17251302 ] Apache Spark commented on SPARK-33830: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-33829) ALTER TABLE ... RENAME TO should recreate cache for v2 tables.

[ https://issues.apache.org/jira/browse/SPARK-33829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251301#comment-17251301 ] Apache Spark commented on SPARK-33829: -- User 'imback82' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33829) ALTER TABLE ... RENAME TO should recreate cache for v2 tables.

[ https://issues.apache.org/jira/browse/SPARK-33829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33829: Assignee: Apache Spark > ALTER TABLE ... RENAME TO should recreate cache for v2 tables.

[jira] [Commented] (SPARK-33829) ALTER TABLE ... RENAME TO should recreate cache for v2 tables.

[ https://issues.apache.org/jira/browse/SPARK-33829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251300#comment-17251300 ] Apache Spark commented on SPARK-33829: -- User 'imback82' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33829) ALTER TABLE ... RENAME TO should recreate cache for v2 tables.

[ https://issues.apache.org/jira/browse/SPARK-33829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33829: Assignee: (was: Apache Spark) > ALTER TABLE ... RENAME TO should recreate cache for

[jira] [Updated] (SPARK-33830) Describe the PURGE option of ALTER TABLE .. DROP PARTITION

[ https://issues.apache.org/jira/browse/SPARK-33830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-33830: --- Summary: Describe the PURGE option of ALTER TABLE .. DROP PARTITION (was: Describe the PURGE

[jira] [Created] (SPARK-33830) Describe the PURGE option of ALTER TABLE .. DROP PATITION

Maxim Gekk created SPARK-33830: -- Summary: Describe the PURGE option of ALTER TABLE .. DROP PATITION Key: SPARK-33830 URL: https://issues.apache.org/jira/browse/SPARK-33830 Project: Spark Issue

[jira] [Created] (SPARK-33829) ALTER TABLE ... RENAME TO should recreate cache for v2 tables.

Terry Kim created SPARK-33829: - Summary: ALTER TABLE ... RENAME TO should recreate cache for v2 tables. Key: SPARK-33829 URL: https://issues.apache.org/jira/browse/SPARK-33829 Project: Spark

[jira] [Commented] (SPARK-33827) Unload State Store asap once it becomes inactive

[ https://issues.apache.org/jira/browse/SPARK-33827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251274#comment-17251274 ] L. C. Hsieh commented on SPARK-33827: - Another thought: Can we just make maintenance interval as

[jira] [Commented] (SPARK-33828) SQL Adaptive Query Execution QA

[ https://issues.apache.org/jira/browse/SPARK-33828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251265#comment-17251265 ] Dongjoon Hyun commented on SPARK-33828: --- I created this JIRA to collect all community issues for

[jira] [Commented] (SPARK-33827) Unload State Store asap once it becomes inactive

[ https://issues.apache.org/jira/browse/SPARK-33827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251264#comment-17251264 ] L. C. Hsieh commented on SPARK-33827: - cc [~dbtsai] [~dongjoon] > Unload State Store asap once it

[jira] [Updated] (SPARK-33827) Unload State Store asap once it becomes inactive

[ https://issues.apache.org/jira/browse/SPARK-33827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-33827: Description: SS maintains state stores in executors across batches. Due to the nature of Spark

[jira] [Updated] (SPARK-33828) SQL Adaptive Query Execution QA

[ https://issues.apache.org/jira/browse/SPARK-33828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33828: -- Description: Since SPARK-31412 is delivered at 3.0.0, we received and handled seen many JIRA

[jira] [Updated] (SPARK-33828) SQL Adaptive Query Execution QA

[ https://issues.apache.org/jira/browse/SPARK-33828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33828: -- Summary: SQL Adaptive Query Execution QA (was: Adaptive Query Execution QA) > SQL Adaptive

[jira] [Updated] (SPARK-33828) Adaptive Query Execution QA

[ https://issues.apache.org/jira/browse/SPARK-33828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33828: -- Description: SPARK-31412 > Adaptive Query Execution QA > --- > >

[jira] [Closed] (SPARK-33823) Use the `CastSupport.cast` method in HashJoin

[ https://issues.apache.org/jira/browse/SPARK-33823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-33823. - > Use the `CastSupport.cast` method in HashJoin > - > >

[jira] [Updated] (SPARK-33828) Adaptive Query Execution QA

[ https://issues.apache.org/jira/browse/SPARK-33828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33828: -- Priority: Critical (was: Major) > Adaptive Query Execution QA > ---

[jira] [Updated] (SPARK-33679) Enable spark.sql.adaptive.enabled true by default

[ https://issues.apache.org/jira/browse/SPARK-33679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33679: -- Parent: SPARK-33828 Issue Type: Sub-task (was: Improvement) > Enable

[jira] [Updated] (SPARK-33794) [ANSI mode][SQL] next_day function should throw runtime exception when receiving invalid input under ANSI mode

[ https://issues.apache.org/jira/browse/SPARK-33794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-33794: Parent: SPARK-33275 Issue Type: Sub-task (was: Improvement) > [ANSI mode][SQL] next_day

[jira] [Updated] (SPARK-33794) next_day function should throw runtime exception when receiving invalid input under ANSI mode

[ https://issues.apache.org/jira/browse/SPARK-33794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-33794: Summary: next_day function should throw runtime exception when receiving invalid input under ANSI

[jira] [Commented] (SPARK-33827) Unload State Store asap once it becomes inactive

[ https://issues.apache.org/jira/browse/SPARK-33827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251262#comment-17251262 ] L. C. Hsieh commented on SPARK-33827: - [~kabhwan] Thanks for the discussion before. Though,

  1   2   >