[jira] [Updated] (SPARK-43182) Mutilple tables join with limit when AE is enabled and one table is skewed

2023-04-19 Thread Liu Shuo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu Shuo updated SPARK-43182: - Description: When we test AE in Spark3.4.0 with the following case, we find If we disable AE or enable

[jira] [Updated] (SPARK-43182) Mutilple tables join with limit when AE is enabled and one table is skewed

2023-04-19 Thread Liu Shuo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu Shuo updated SPARK-43182: - Attachment: part-m-9.zip part-m-8.zip part-m-7.zip

[jira] [Updated] (SPARK-43182) Mutilple tables join with limit when AE is enabled and one table is skewed

2023-04-19 Thread Liu Shuo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu Shuo updated SPARK-43182: - Attachment: (was: part-m-0.zip) > Mutilple tables join with limit when AE is enabled and one tab

[jira] [Updated] (SPARK-43182) Mutilple tables join with limit when AE is enabled and one table is skewed

2023-04-19 Thread Liu Shuo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu Shuo updated SPARK-43182: - Attachment: part-m-0.zip > Mutilple tables join with limit when AE is enabled and one table is skewe

[jira] [Updated] (SPARK-43182) Mutilple tables join with limit when AE is enabled and one table is skewed

2023-04-19 Thread Liu Shuo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu Shuo updated SPARK-43182: - Description: When we test AE in Spark3.4.0 with the following case, we find If we disable AE or enable

[jira] [Updated] (SPARK-43182) Mutilple tables join with limit when AE is enabled and one table is skewed

2023-04-19 Thread Liu Shuo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu Shuo updated SPARK-43182: - Description: When we test AE in Spark3.4.0 with the following case, we find If we disable AE or enable

[jira] [Updated] (SPARK-43182) Mutilple tables join with limit when AE is enabled and one table is skewed

2023-04-19 Thread Liu Shuo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu Shuo updated SPARK-43182: - Description: [^data.rar][^data.zip]When we test AE in Spark3.4.0 with the following case, we find If we

[jira] [Updated] (SPARK-43182) Mutilple tables join with limit when AE is enabled and one table is skewed

2023-04-19 Thread Liu Shuo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu Shuo updated SPARK-43182: - Description: When we test AE in Spark3.4.0 with the following case, we find If we disable AE or enable

[jira] [Updated] (SPARK-43182) Mutilple tables join with limit when AE is enabled and one table is skewed

2023-04-19 Thread Liu Shuo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu Shuo updated SPARK-43182: - Description: [^data.zip]When we test AE in Spark3.4.0 with the following case, we find If we disable AE

[jira] [Updated] (SPARK-43182) Mutilple tables join with limit when AE is enabled and one table is skewed

2023-04-19 Thread Liu Shuo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu Shuo updated SPARK-43182: - Description: [^data.zip]When we test AE in Spark3.4.0 with the following case, we find If we disable AE

[jira] [Updated] (SPARK-43182) Mutilple tables join with limit when AE is enabled and one table is skewed

2023-04-19 Thread Liu Shuo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu Shuo updated SPARK-43182: - Summary: Mutilple tables join with limit when AE is enabled and one table is skewed (was: Mutiple table

[jira] [Updated] (SPARK-43182) Mutiple tables join with limit when AE is enabled and one table is skewed

2023-04-19 Thread Liu Shuo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu Shuo updated SPARK-43182: - Summary: Mutiple tables join with limit when AE is enabled and one table is skewed (was: 3 tables join

[jira] [Created] (SPARK-43182) 3 tables join with limit when AE is enabled and one table is skewed

2023-04-19 Thread Liu Shuo (Jira)
Liu Shuo created SPARK-43182: Summary: 3 tables join with limit when AE is enabled and one table is skewed Key: SPARK-43182 URL: https://issues.apache.org/jira/browse/SPARK-43182 Project: Spark

[jira] [Resolved] (SPARK-42734) deal with timestamp partition column when spark.sql.storeAssignmentPolicy=LEGACY

2023-03-09 Thread Liu Shuo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu Shuo resolved SPARK-42734. -- Resolution: Abandoned > deal with timestamp partition column when > spark.sql.storeAssignmentPolicy=L

[jira] [Commented] (SPARK-42734) deal with timestamp partition column when spark.sql.storeAssignmentPolicy=LEGACY

2023-03-09 Thread Liu Shuo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17698705#comment-17698705 ] Liu Shuo commented on SPARK-42734: -- The following PR has fixed this issue [SPARK-40798

[jira] [Updated] (SPARK-42734) deal with timestamp partition column when spark.sql.storeAssignmentPolicy=LEGACY

2023-03-09 Thread Liu Shuo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu Shuo updated SPARK-42734: - Description: We create a table which has a partition column with timestamp type, when we execute `alter

[jira] [Created] (SPARK-42734) deal with timestamp partition column when spark.sql.storeAssignmentPolicy=LEGACY

2023-03-09 Thread Liu Shuo (Jira)
Liu Shuo created SPARK-42734: Summary: deal with timestamp partition column when spark.sql.storeAssignmentPolicy=LEGACY Key: SPARK-42734 URL: https://issues.apache.org/jira/browse/SPARK-42734 Project: Spa

[jira] [Updated] (SPARK-39866) Memory leak when closing a session of Spark Thrift Server

2022-07-25 Thread Liu Shuo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu Shuo updated SPARK-39866: - Description: we are using Spark Thrift Server as a distributed sql query engine, the queries are relate

[jira] [Updated] (SPARK-39866) Memory leak when closing a session of Spark Thrift Server

2022-07-25 Thread Liu Shuo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu Shuo updated SPARK-39866: - Attachment: image-2022-07-26-11-54-06-826.png > Memory leak when closing a session of Spark Thrift Serv

[jira] [Updated] (SPARK-39866) Memory leak when closing a session of Spark Thrift Server

2022-07-25 Thread Liu Shuo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu Shuo updated SPARK-39866: - Description: we are using Spark Thrift Server as a distributed sql query engine, the queries are relate

[jira] [Updated] (SPARK-39866) Memory leak when closing a session of Spark Thrift Server

2022-07-25 Thread Liu Shuo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu Shuo updated SPARK-39866: - Description: we are using Spark Thrift Server as a distributed sql query engine, the queries are relate

[jira] [Created] (SPARK-39866) Memory leak when closing a session of Spark Thrift Server

2022-07-25 Thread Liu Shuo (Jira)
Liu Shuo created SPARK-39866: Summary: Memory leak when closing a session of Spark Thrift Server Key: SPARK-39866 URL: https://issues.apache.org/jira/browse/SPARK-39866 Project: Spark Issue Type

[jira] [Commented] (SPARK-37119) parse_url can not handle `{` and `}` correctly

2021-10-26 Thread Liu Shuo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17434326#comment-17434326 ] Liu Shuo commented on SPARK-37119: -- As discussed in `https://github.com/apache/spark/pu

[jira] [Updated] (SPARK-37119) parse_url can not handle `{` and `}` correctly

2021-10-26 Thread Liu Shuo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu Shuo updated SPARK-37119: - Description: when we execute the follow sql command {code:java} select parse_url('http://facebook.com/pa

[jira] [Created] (SPARK-37119) parse_url can not handle `{` and `}` correctly

2021-10-26 Thread Liu Shuo (Jira)
Liu Shuo created SPARK-37119: Summary: parse_url can not handle `{` and `}` correctly Key: SPARK-37119 URL: https://issues.apache.org/jira/browse/SPARK-37119 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-36955) when we change the complex column's comment of hive table , it should succeed but fails

2021-10-08 Thread Liu Shuo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu Shuo updated SPARK-36955: - Description: 1. create a hive table {code:java} CREATE TABLE tbl STORED AS PARQUET AS SELECT '1st' AS k