[jira] [Updated] (SPARK-34705) Add code-gen for all join types of sort merge join

2021-05-08 Thread Cheng Su (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Su updated SPARK-34705: - Issue Type: Umbrella (was: Improvement) > Add code-gen for all join types of sort merge join >

[jira] [Created] (SPARK-35349) Add code-gen for left/right outer sort merge join

2021-05-08 Thread Cheng Su (Jira)
Cheng Su created SPARK-35349: Summary: Add code-gen for left/right outer sort merge join Key: SPARK-35349 URL: https://issues.apache.org/jira/browse/SPARK-35349 Project: Spark Issue Type: Sub-tas

[jira] [Commented] (SPARK-34705) Add code-gen for all join types of sort merge join

2021-05-08 Thread Cheng Su (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341219#comment-17341219 ] Cheng Su commented on SPARK-34705: -- Just FYI, we are working on each sub-tasks now. Tar

[jira] [Created] (SPARK-35350) Add code-gen for left semi sort merge join

2021-05-08 Thread Cheng Su (Jira)
Cheng Su created SPARK-35350: Summary: Add code-gen for left semi sort merge join Key: SPARK-35350 URL: https://issues.apache.org/jira/browse/SPARK-35350 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-35349) Add code-gen for left/right outer sort merge join

2021-05-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341221#comment-17341221 ] Apache Spark commented on SPARK-35349: -- User 'c21' has created a pull request for t

[jira] [Commented] (SPARK-34775) Push down limit through window when partitionSpec is not empty

2021-05-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341220#comment-17341220 ] Apache Spark commented on SPARK-34775: -- User 'AngersZh' has created a pull requ

[jira] [Commented] (SPARK-35349) Add code-gen for left/right outer sort merge join

2021-05-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341222#comment-17341222 ] Apache Spark commented on SPARK-35349: -- User 'c21' has created a pull request for t

[jira] [Assigned] (SPARK-35349) Add code-gen for left/right outer sort merge join

2021-05-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35349: Assignee: Apache Spark > Add code-gen for left/right outer sort merge join >

[jira] [Created] (SPARK-35351) Add code-gen for left anti sort merge join

2021-05-08 Thread Cheng Su (Jira)
Cheng Su created SPARK-35351: Summary: Add code-gen for left anti sort merge join Key: SPARK-35351 URL: https://issues.apache.org/jira/browse/SPARK-35351 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-34775) Push down limit through window when partitionSpec is not empty

2021-05-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341223#comment-17341223 ] Apache Spark commented on SPARK-34775: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-35349) Add code-gen for left/right outer sort merge join

2021-05-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35349: Assignee: (was: Apache Spark) > Add code-gen for left/right outer sort merge join > -

[jira] [Commented] (SPARK-35351) Add code-gen for left anti sort merge join

2021-05-08 Thread Cheng Su (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341225#comment-17341225 ] Cheng Su commented on SPARK-35351: -- Will raise a PR soon. [|https://issues.apache.org/j

[jira] [Commented] (SPARK-35350) Add code-gen for left semi sort merge join

2021-05-08 Thread Cheng Su (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341224#comment-17341224 ] Cheng Su commented on SPARK-35350: -- Will raise a PR soon. > Add code-gen for left semi

[jira] [Created] (SPARK-35352) Add code-gen for full outer sort merge join

2021-05-08 Thread Cheng Su (Jira)
Cheng Su created SPARK-35352: Summary: Add code-gen for full outer sort merge join Key: SPARK-35352 URL: https://issues.apache.org/jira/browse/SPARK-35352 Project: Spark Issue Type: Sub-task

[jira] [Comment Edited] (SPARK-35351) Add code-gen for left anti sort merge join

2021-05-08 Thread Cheng Su (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341225#comment-17341225 ] Cheng Su edited comment on SPARK-35351 at 5/8/21, 7:28 AM: --- Wi

[jira] [Commented] (SPARK-35352) Add code-gen for full outer sort merge join

2021-05-08 Thread Cheng Su (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341226#comment-17341226 ] Cheng Su commented on SPARK-35352: -- Will raise a PR soon. > Add code-gen for full oute

[jira] [Commented] (SPARK-35332) Not Coalesce shuffle partitions when cache table

2021-05-08 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341233#comment-17341233 ] Takeshi Yamamuro commented on SPARK-35332: -- Yea, right. As [~ulysses] said, tha

[jira] [Comment Edited] (SPARK-35332) Not Coalesce shuffle partitions when cache table

2021-05-08 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341233#comment-17341233 ] Takeshi Yamamuro edited comment on SPARK-35332 at 5/8/21, 8:05 AM: ---

[jira] [Commented] (SPARK-35348) Support the utils for escapse the regex for ANSI SQL: SIMILAR TO ... ESCAPE syntax

2021-05-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341239#comment-17341239 ] Apache Spark commented on SPARK-35348: -- User 'beliefer' has created a pull request

[jira] [Assigned] (SPARK-35348) Support the utils for escapse the regex for ANSI SQL: SIMILAR TO ... ESCAPE syntax

2021-05-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35348: Assignee: Apache Spark > Support the utils for escapse the regex for ANSI SQL: SIMILAR TO

[jira] [Assigned] (SPARK-35348) Support the utils for escapse the regex for ANSI SQL: SIMILAR TO ... ESCAPE syntax

2021-05-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35348: Assignee: (was: Apache Spark) > Support the utils for escapse the regex for ANSI SQL:

[jira] [Commented] (SPARK-35348) Support the utils for escapse the regex for ANSI SQL: SIMILAR TO ... ESCAPE syntax

2021-05-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341240#comment-17341240 ] Apache Spark commented on SPARK-35348: -- User 'beliefer' has created a pull request

[jira] [Issue Comment Deleted] (SPARK-35348) Support the utils for escapse the regex for ANSI SQL: SIMILAR TO ... ESCAPE syntax

2021-05-08 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-35348: --- Comment: was deleted (was: I'm working on.) > Support the utils for escapse the regex for ANSI SQL:

[jira] [Commented] (SPARK-35332) Not Coalesce shuffle partitions when cache table

2021-05-08 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341244#comment-17341244 ] XiDuo You commented on SPARK-35332: --- Adding a new cache-specific option in a CACHE sta

[jira] [Commented] (SPARK-34257) Improve performance for last_value over unbounded window frame

2021-05-08 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341252#comment-17341252 ] jiaan.geng commented on SPARK-34257: Because it's not worth do the optimization for

[jira] [Issue Comment Deleted] (SPARK-34257) Improve performance for last_value over unbounded window frame

2021-05-08 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-34257: --- Comment: was deleted (was: I'm working on.) > Improve performance for last_value over unbounded win

[jira] [Issue Comment Deleted] (SPARK-34096) Improve performance for nth_value ignore nulls over offset window

2021-05-08 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-34096: --- Comment: was deleted (was: I'm working on.) > Improve performance for nth_value ignore nulls over o

[jira] [Issue Comment Deleted] (SPARK-33443) LEAD/LAG should support [ IGNORE NULLS | RESPECT NULLS ]

2021-05-08 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-33443: --- Comment: was deleted (was: I am working on.) > LEAD/LAG should support [ IGNORE NULLS | RESPECT NUL

[jira] [Issue Comment Deleted] (SPARK-30825) Add documents information for window function.

2021-05-08 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-30825: --- Comment: was deleted (was: I'm working on.) > Add documents information for window function. >

[jira] [Issue Comment Deleted] (SPARK-30758) Spark SQL can't display bracketed comments well in generated golden files

2021-05-08 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-30758: --- Comment: was deleted (was: I'm working on.) > Spark SQL can't display bracketed comments well in ge

[jira] [Issue Comment Deleted] (SPARK-32540) Eliminate filter clause in aggregate

2021-05-08 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-32540: --- Comment: was deleted (was: I'm working on.) > Eliminate filter clause in aggregate > --

[jira] [Issue Comment Deleted] (SPARK-30276) Support Filter expression allows simultaneous use of DISTINCT

2021-05-08 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-30276: --- Comment: was deleted (was: I'm working.) > Support Filter expression allows simultaneous use of DIS

[jira] [Issue Comment Deleted] (SPARK-28410) ANSI SQL(E021-05): OCTET_LENGTH function

2021-05-08 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-28410: --- Comment: was deleted (was: I'm working on.) > ANSI SQL(E021-05): OCTET_LENGTH function > --

[jira] [Issue Comment Deleted] (SPARK-28580) ANSI SQL: unique predicate

2021-05-08 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-28580: --- Comment: was deleted (was: I'm working on.) > ANSI SQL: unique predicate >

[jira] [Issue Comment Deleted] (SPARK-28412) ANSI SQL: OVERLAY function support byte array(T312)

2021-05-08 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-28412: --- Comment: was deleted (was: I'm working on.) > ANSI SQL: OVERLAY function support byte array(T312) >

[jira] [Issue Comment Deleted] (SPARK-28880) ANSI SQL: Nested bracketed comments

2021-05-08 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-28880: --- Comment: was deleted (was: I'm working on.) > ANSI SQL: Nested bracketed comments > ---

[jira] [Issue Comment Deleted] (SPARK-28083) Support ANSI SQL: LIKE ... ESCAPE syntax

2021-05-08 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-28083: --- Comment: was deleted (was: I'm working on.) > Support ANSI SQL: LIKE ... ESCAPE syntax > --

[jira] [Issue Comment Deleted] (SPARK-28077) ANSI SQL: OVERLAY function(T312)

2021-05-08 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-28077: --- Comment: was deleted (was: I'm working on.) > ANSI SQL: OVERLAY function(T312) > --

[jira] [Issue Comment Deleted] (SPARK-27951) ANSI SQL: NTH_VALUE function

2021-05-08 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-27951: --- Comment: was deleted (was: I'm working on.) > ANSI SQL: NTH_VALUE function > --

[jira] [Issue Comment Deleted] (SPARK-27924) Support ANSI SQL Boolean-Predicate syntax

2021-05-08 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-27924: --- Comment: was deleted (was: I'm working on.) > Support ANSI SQL Boolean-Predicate syntax > -

[jira] [Commented] (SPARK-35063) Group exception messages in sql/catalyst

2021-05-08 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341264#comment-17341264 ] jiaan.geng commented on SPARK-35063: I'm working on. > Group exception messages in

[jira] [Assigned] (SPARK-35063) Group exception messages in sql/catalyst

2021-05-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35063: Assignee: Apache Spark > Group exception messages in sql/catalyst > -

[jira] [Commented] (SPARK-35063) Group exception messages in sql/catalyst

2021-05-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341266#comment-17341266 ] Apache Spark commented on SPARK-35063: -- User 'beliefer' has created a pull request

[jira] [Assigned] (SPARK-35063) Group exception messages in sql/catalyst

2021-05-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35063: Assignee: (was: Apache Spark) > Group exception messages in sql/catalyst > --

[jira] [Issue Comment Deleted] (SPARK-35063) Group exception messages in sql/catalyst

2021-05-08 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-35063: --- Comment: was deleted (was: I'm working on.) > Group exception messages in sql/catalyst > --

[jira] [Resolved] (SPARK-35331) Attributes become unknown in RepartitionByExpression after aliased

2021-05-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-35331. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32465 [https://

[jira] [Assigned] (SPARK-35331) Attributes become unknown in RepartitionByExpression after aliased

2021-05-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-35331: - Assignee: Kent Yao > Attributes become unknown in RepartitionByExpression after aliased

[jira] [Commented] (SPARK-35332) Not Coalesce shuffle partitions when cache table

2021-05-08 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341313#comment-17341313 ] Takeshi Yamamuro commented on SPARK-35332: -- okay, sgtm. cc: [~cloud_fan] could

[jira] [Resolved] (SPARK-35327) Filters out the TPC-DS queries that can cause flaky test results

2021-05-08 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-35327. -- Fix Version/s: 3.2.0 Assignee: Takeshi Yamamuro Resolution: Fixed Reso

[jira] [Commented] (SPARK-35327) Filters out the TPC-DS queries that can cause flaky test results

2021-05-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341319#comment-17341319 ] Apache Spark commented on SPARK-35327: -- User 'maropu' has created a pull request fo

[jira] [Commented] (SPARK-34795) Adds a new job in GitHub Actions to check the output of TPC-DS queries

2021-05-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341320#comment-17341320 ] Apache Spark commented on SPARK-34795: -- User 'maropu' has created a pull request fo

[jira] [Commented] (SPARK-35192) Port minimal TPC-DS datagen code from databricks/spark-sql-perf

2021-05-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341321#comment-17341321 ] Apache Spark commented on SPARK-35192: -- User 'maropu' has created a pull request fo

[jira] [Commented] (SPARK-35293) Use the newer dsdgen for TPCDSQueryTestSuite

2021-05-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341322#comment-17341322 ] Apache Spark commented on SPARK-35293: -- User 'maropu' has created a pull request fo

[jira] [Commented] (SPARK-35327) Filters out the TPC-DS queries that can cause flaky test results

2021-05-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341323#comment-17341323 ] Apache Spark commented on SPARK-35327: -- User 'maropu' has created a pull request fo

[jira] [Created] (SPARK-35353) Cross-building docker images to ARM64 is failing

2021-05-08 Thread Andy Grove (Jira)
Andy Grove created SPARK-35353: -- Summary: Cross-building docker images to ARM64 is failing Key: SPARK-35353 URL: https://issues.apache.org/jira/browse/SPARK-35353 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-35321) Spark 3.x can't talk to HMS 1.2.x and lower due to get_all_functions Thrift API missing

2021-05-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35321: -- Fix Version/s: (was: 3.0.3) (was: 3.1.2) (was

[jira] [Reopened] (SPARK-35321) Spark 3.x can't talk to HMS 1.2.x and lower due to get_all_functions Thrift API missing

2021-05-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-35321: --- Assignee: (was: Chao Sun) > Spark 3.x can't talk to HMS 1.2.x and lower due to get_all

[jira] [Assigned] (SPARK-35321) Spark 3.x can't talk to HMS 1.2.x and lower due to get_all_functions Thrift API missing

2021-05-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35321: Assignee: Apache Spark > Spark 3.x can't talk to HMS 1.2.x and lower due to get_all_funct

[jira] [Assigned] (SPARK-35321) Spark 3.x can't talk to HMS 1.2.x and lower due to get_all_functions Thrift API missing

2021-05-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35321: Assignee: (was: Apache Spark) > Spark 3.x can't talk to HMS 1.2.x and lower due to ge

[jira] [Commented] (SPARK-35321) Spark 3.x can't talk to HMS 1.2.x and lower due to get_all_functions Thrift API missing

2021-05-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341396#comment-17341396 ] Dongjoon Hyun commented on SPARK-35321: --- This is reverted due to https://github.c

[jira] [Updated] (SPARK-35192) Port minimal TPC-DS datagen code from databricks/spark-sql-perf

2021-05-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35192: -- Fix Version/s: 3.1.2 > Port minimal TPC-DS datagen code from databricks/spark-sql-perf > -

[jira] [Updated] (SPARK-34795) Adds a new job in GitHub Actions to check the output of TPC-DS queries

2021-05-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34795: -- Fix Version/s: 3.1.2 > Adds a new job in GitHub Actions to check the output of TPC-DS queries

[jira] [Updated] (SPARK-35293) Use the newer dsdgen for TPCDSQueryTestSuite

2021-05-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35293: -- Fix Version/s: 3.1.2 > Use the newer dsdgen for TPCDSQueryTestSuite >

[jira] [Updated] (SPARK-35327) Filters out the TPC-DS queries that can cause flaky test results

2021-05-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35327: -- Fix Version/s: 3.1.2 > Filters out the TPC-DS queries that can cause flaky test results >

[jira] [Resolved] (SPARK-35347) Use MethodUtils for method looking up in Invoke and StaticInvoke

2021-05-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-35347. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32474 [https://

[jira] [Created] (SPARK-35354) Minor cleanup to replace BaseJoinExec with ShuffledJoin in CoalesceBucketsInJoin

2021-05-08 Thread Cheng Su (Jira)
Cheng Su created SPARK-35354: Summary: Minor cleanup to replace BaseJoinExec with ShuffledJoin in CoalesceBucketsInJoin Key: SPARK-35354 URL: https://issues.apache.org/jira/browse/SPARK-35354 Project: Spa

[jira] [Assigned] (SPARK-35354) Minor cleanup to replace BaseJoinExec with ShuffledJoin in CoalesceBucketsInJoin

2021-05-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35354: Assignee: Apache Spark > Minor cleanup to replace BaseJoinExec with ShuffledJoin in > Co

[jira] [Assigned] (SPARK-35354) Minor cleanup to replace BaseJoinExec with ShuffledJoin in CoalesceBucketsInJoin

2021-05-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35354: Assignee: (was: Apache Spark) > Minor cleanup to replace BaseJoinExec with ShuffledJo

[jira] [Commented] (SPARK-35354) Minor cleanup to replace BaseJoinExec with ShuffledJoin in CoalesceBucketsInJoin

2021-05-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341432#comment-17341432 ] Apache Spark commented on SPARK-35354: -- User 'c21' has created a pull request for t

[jira] [Commented] (SPARK-35354) Minor cleanup to replace BaseJoinExec with ShuffledJoin in CoalesceBucketsInJoin

2021-05-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341433#comment-17341433 ] Apache Spark commented on SPARK-35354: -- User 'c21' has created a pull request for t

[jira] [Updated] (SPARK-35327) Filters out the TPC-DS queries that can cause flaky test results

2021-05-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35327: -- Fix Version/s: 3.0.3 > Filters out the TPC-DS queries that can cause flaky test results >

[jira] [Updated] (SPARK-34795) Adds a new job in GitHub Actions to check the output of TPC-DS queries

2021-05-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34795: -- Fix Version/s: 3.0.3 > Adds a new job in GitHub Actions to check the output of TPC-DS queries

[jira] [Updated] (SPARK-35293) Use the newer dsdgen for TPCDSQueryTestSuite

2021-05-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35293: -- Fix Version/s: 3.0.3 > Use the newer dsdgen for TPCDSQueryTestSuite >

[jira] [Updated] (SPARK-35192) Port minimal TPC-DS datagen code from databricks/spark-sql-perf

2021-05-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35192: -- Fix Version/s: 3.0.3 > Port minimal TPC-DS datagen code from databricks/spark-sql-perf > -

[jira] [Commented] (SPARK-35261) Support static invoke for stateless UDF

2021-05-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341448#comment-17341448 ] Apache Spark commented on SPARK-35261: -- User 'sunchao' has created a pull request f

[jira] [Commented] (SPARK-35261) Support static invoke for stateless UDF

2021-05-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341449#comment-17341449 ] Apache Spark commented on SPARK-35261: -- User 'sunchao' has created a pull request f

[jira] [Assigned] (SPARK-35332) Not Coalesce shuffle partitions when cache table

2021-05-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35332: Assignee: (was: Apache Spark) > Not Coalesce shuffle partitions when cache table > --

[jira] [Assigned] (SPARK-35332) Not Coalesce shuffle partitions when cache table

2021-05-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35332: Assignee: Apache Spark > Not Coalesce shuffle partitions when cache table > -

[jira] [Commented] (SPARK-35332) Not Coalesce shuffle partitions when cache table

2021-05-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341454#comment-17341454 ] Apache Spark commented on SPARK-35332: -- User 'ulysses-you' has created a pull reque

[jira] [Commented] (SPARK-35332) Not Coalesce shuffle partitions when cache table

2021-05-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341455#comment-17341455 ] Apache Spark commented on SPARK-35332: -- User 'ulysses-you' has created a pull reque

[jira] [Created] (SPARK-35355) improve execution performance in insert...select...limit case

2021-05-08 Thread yikf (Jira)
yikf created SPARK-35355: Summary: improve execution performance in insert...select...limit case Key: SPARK-35355 URL: https://issues.apache.org/jira/browse/SPARK-35355 Project: Spark Issue Type: I

[jira] [Updated] (SPARK-35355) improve execution performance in insert...select...limit case

2021-05-08 Thread yikf (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yikf updated SPARK-35355: - Description: In the case of `insert into...select...limit` , `CollectLimitExec` has better execution performanc