[jira] [Resolved] (SPARK-36194) Remove the aggregation from left semi/anti join if the same aggregation has already been done on left side

2022-03-14 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-36194. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35779

[jira] [Assigned] (SPARK-36194) Remove the aggregation from left semi/anti join if the same aggregation has already been done on left side

2022-03-14 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-36194: --- Assignee: Yuming Wang > Remove the aggregation from left semi/anti join if the same

[jira] [Resolved] (SPARK-38540) Upgrade compress-lzf from 1.0.3 to 1.1.0

2022-03-13 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-38540. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35834

[jira] [Assigned] (SPARK-38540) Upgrade compress-lzf from 1.0.3 to 1.1.0

2022-03-13 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-38540: --- Assignee: Yang Jie > Upgrade compress-lzf from 1.0.3 to 1.1.0 >

[jira] [Created] (HIVE-26032) Upgrade cron-utils to 9.1.6

2022-03-13 Thread Yuming Wang (Jira)
Yuming Wang created HIVE-26032: -- Summary: Upgrade cron-utils to 9.1.6 Key: HIVE-26032 URL: https://issues.apache.org/jira/browse/HIVE-26032 Project: Hive Issue Type: Task Components:

[jira] [Assigned] (SPARK-38538) Fix driver environment verification in BasicDriverFeatureStepSuite

2022-03-12 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-38538: --- Assignee: Dongjoon Hyun > Fix driver environment verification in

[jira] [Resolved] (SPARK-38538) Fix driver environment verification in BasicDriverFeatureStepSuite

2022-03-12 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-38538. - Fix Version/s: 3.3.0 3.0.4 3.2.2 3.1.3

[jira] [Updated] (HIVE-25996) Backport HIVE-25098

2022-03-11 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/HIVE-25996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated HIVE-25996: --- Summary: Backport HIVE-25098 (was: Backport HIVE-21498 and HIVE-25098 to fix CVE-2020-13949) >

[jira] [Created] (HIVE-26030) Backport HIVE-21498 to branch-2.3

2022-03-11 Thread Yuming Wang (Jira)
Yuming Wang created HIVE-26030: -- Summary: Backport HIVE-21498 to branch-2.3 Key: HIVE-26030 URL: https://issues.apache.org/jira/browse/HIVE-26030 Project: Hive Issue Type: Task

[jira] [Updated] (SPARK-38516) Add log4j-core, log4j-api and log4j-slf4j-impl to classpath if active hadoop-provided

2022-03-10 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-38516: Summary: Add log4j-core, log4j-api and log4j-slf4j-impl to classpath if active hadoop-provided

[jira] [Created] (SPARK-38516) Add log4j-core and log4j-api to classpath if active hadoop-provided

2022-03-10 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-38516: --- Summary: Add log4j-core and log4j-api to classpath if active hadoop-provided Key: SPARK-38516 URL: https://issues.apache.org/jira/browse/SPARK-38516 Project: Spark

[jira] [Created] (SPARK-38506) Push partial aggregation through join

2022-03-10 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-38506: --- Summary: Push partial aggregation through join Key: SPARK-38506 URL: https://issues.apache.org/jira/browse/SPARK-38506 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-38505) Make partial aggregation adaptive

2022-03-10 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-38505: --- Summary: Make partial aggregation adaptive Key: SPARK-38505 URL: https://issues.apache.org/jira/browse/SPARK-38505 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-38489) Aggregate.groupOnly support foldable expressions

2022-03-09 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-38489: Description: {code:scala} spark.range(200L).selectExpr("id AS a").createTempView("t1")

[jira] [Updated] (SPARK-38489) Aggregate.groupOnly support foldable expressions

2022-03-09 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-38489: Description: {code:scala} spark.range(200L).selectExpr("id AS a").createTempView("t1")

[jira] [Updated] (SPARK-38489) Aggregate.groupOnly support foldable expressions

2022-03-09 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-38489: Description: {code:scala} spark.range(200L).selectExpr("id AS a").createTempView("t1")

[jira] [Created] (SPARK-38489) Aggregate.groupOnly support foldable expressions

2022-03-09 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-38489: --- Summary: Aggregate.groupOnly support foldable expressions Key: SPARK-38489 URL: https://issues.apache.org/jira/browse/SPARK-38489 Project: Spark Issue Type:

[jira] [Updated] (SPARK-38489) Aggregate.groupOnly support foldable expressions

2022-03-09 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-38489: Fix Version/s: (was: 3.3.0) > Aggregate.groupOnly support foldable expressions >

[jira] [Assigned] (SPARK-38489) Aggregate.groupOnly support foldable expressions

2022-03-09 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-38489: --- Assignee: (was: Yuming Wang) > Aggregate.groupOnly support foldable expressions >

[jira] [Commented] (SPARK-38282) Avoid duplicating complex partitioning expressions

2022-03-07 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17502674#comment-17502674 ] Yuming Wang commented on SPARK-38282: - Some related PRs: https://github.com/apache/spark/pull/33522

[jira] [Created] (HIVE-25996) Backport HIVE-21498 and HIVE-25098 to fix CVE-2020-13949

2022-03-01 Thread Yuming Wang (Jira)
Yuming Wang created HIVE-25996: -- Summary: Backport HIVE-21498 and HIVE-25098 to fix CVE-2020-13949 Key: HIVE-25996 URL: https://issues.apache.org/jira/browse/HIVE-25996 Project: Hive Issue

[jira] [Commented] (SPARK-37989) Push down limit through Aggregate if it is group only

2022-01-24 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17480963#comment-17480963 ] Yuming Wang commented on SPARK-37989: - Benchmark 5 {code:java} import

[jira] [Commented] (SPARK-37989) Push down limit through Aggregate if it is group only

2022-01-24 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17480892#comment-17480892 ] Yuming Wang commented on SPARK-37989: - Benchmark 4 {code:scala} import

[jira] [Commented] (SPARK-37989) Push down limit through Aggregate if it is group only

2022-01-23 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17480882#comment-17480882 ] Yuming Wang commented on SPARK-37989: - Benchmark 3 {noformat} import

[jira] [Commented] (SPARK-37989) Push down limit through Aggregate if it is group only

2022-01-23 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17480855#comment-17480855 ] Yuming Wang commented on SPARK-37989: - Benchmark 2 {code:scala} import

[jira] [Commented] (SPARK-37989) Push down limit through Aggregate if it is group only

2022-01-23 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17480839#comment-17480839 ] Yuming Wang commented on SPARK-37989: - Benchmark 1 {code:scala} import

[jira] [Created] (SPARK-37989) Push down limit through Aggregate if it is group only

2022-01-22 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-37989: --- Summary: Push down limit through Aggregate if it is group only Key: SPARK-37989 URL: https://issues.apache.org/jira/browse/SPARK-37989 Project: Spark Issue

[jira] [Updated] (SPARK-37922) Combine to one cast if we can safely up-cast two casts

2022-01-18 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-37922: Summary: Combine to one cast if we can safely up-cast two casts (was: Remove useless cast) >

[jira] [Updated] (HIVE-25869) Add GitHub Action job to publish snapshot

2022-01-17 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/HIVE-25869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated HIVE-25869: --- Description: Publish Hive snapshots:

[jira] [Created] (HIVE-25869) Add GitHub Action job to publish snapshot

2022-01-17 Thread Yuming Wang (Jira)
Yuming Wang created HIVE-25869: -- Summary: Add GitHub Action job to publish snapshot Key: HIVE-25869 URL: https://issues.apache.org/jira/browse/HIVE-25869 Project: Hive Issue Type: Improvement

[jira] [Created] (SPARK-37922) Remove useless cast

2022-01-16 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-37922: --- Summary: Remove useless cast Key: SPARK-37922 URL: https://issues.apache.org/jira/browse/SPARK-37922 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-37917) Push down limit 1 for right side of left semi/anti join

2022-01-15 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-37917: Summary: Push down limit 1 for right side of left semi/anti join (was: Push down limit for right

[jira] [Created] (SPARK-37917) Push down limit for right side of left semi/anti join

2022-01-15 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-37917: --- Summary: Push down limit for right side of left semi/anti join Key: SPARK-37917 URL: https://issues.apache.org/jira/browse/SPARK-37917 Project: Spark Issue

[jira] [Assigned] (SPARK-34514) Push down limit for LEFT SEMI and LEFT ANTI join

2022-01-15 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-34514: --- Assignee: Cheng Su (was: Apache Spark) > Push down limit for LEFT SEMI and LEFT ANTI join

[jira] [Created] (SPARK-37915) Push down deterministic projection through SQL UNION

2022-01-14 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-37915: --- Summary: Push down deterministic projection through SQL UNION Key: SPARK-37915 URL: https://issues.apache.org/jira/browse/SPARK-37915 Project: Spark Issue

[jira] [Updated] (SPARK-37899) EliminateInnerJoin to support convert inner join to left semi join

2022-01-13 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-37899: Summary: EliminateInnerJoin to support convert inner join to left semi join (was:

[jira] [Created] (SPARK-37899) EliminateInnerJoin

2022-01-13 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-37899: --- Summary: EliminateInnerJoin Key: SPARK-37899 URL: https://issues.apache.org/jira/browse/SPARK-37899 Project: Spark Issue Type: Improvement

[jira] [Commented] (HIVE-25855) Make a branch-3 release

2022-01-10 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/HIVE-25855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472400#comment-17472400 ] Yuming Wang commented on HIVE-25855: +1 for 3.2.0. > Make a branch-3 release >

[jira] [Resolved] (SPARK-37828) Push down filters through RebalancePartitions

2022-01-09 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-37828. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35118

[jira] [Assigned] (SPARK-37828) Push down filters through RebalancePartitions

2022-01-09 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-37828: --- Assignee: Yuming Wang > Push down filters through RebalancePartitions >

[jira] [Assigned] (SPARK-37838) Upgrade scalatestplus artifacts to 3.3.0-SNAP3

2022-01-09 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-37838: --- Assignee: Yuming Wang > Upgrade scalatestplus artifacts to 3.3.0-SNAP3 >

[jira] [Resolved] (SPARK-37838) Upgrade scalatestplus artifacts to 3.3.0-SNAP3

2022-01-09 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-37838. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35128

[jira] [Created] (SPARK-37838) Upgrade scalatestplus artifacts to 3.3.0-SNAP3

2022-01-06 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-37838: --- Summary: Upgrade scalatestplus artifacts to 3.3.0-SNAP3 Key: SPARK-37838 URL: https://issues.apache.org/jira/browse/SPARK-37838 Project: Spark Issue Type:

[jira] [Created] (SPARK-37828) Push down filters through RebalancePartitions

2022-01-06 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-37828: --- Summary: Push down filters through RebalancePartitions Key: SPARK-37828 URL: https://issues.apache.org/jira/browse/SPARK-37828 Project: Spark Issue Type:

[jira] [Updated] (SPARK-37807) Hivethriftserver2 send proper exception message

2022-01-04 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-37807: Fix Version/s: (was: 3.3.0) > Hivethriftserver2 send proper exception message >

[jira] [Created] (SPARK-37642) Fall back to SortMergeJoin if BroadcastHashJoin has OOM issue

2021-12-14 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-37642: --- Summary: Fall back to SortMergeJoin if BroadcastHashJoin has OOM issue Key: SPARK-37642 URL: https://issues.apache.org/jira/browse/SPARK-37642 Project: Spark

[jira] [Commented] (SPARK-37626) Upgrade libthrift to 1.15.0

2021-12-12 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458173#comment-17458173 ] Yuming Wang commented on SPARK-37626: - We need to upgrade to 0.16.0 because we need [this

[jira] [Resolved] (SPARK-37565) Upgrade mysql-connector-java to 8.0.27

2021-12-10 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-37565. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34827

[jira] [Assigned] (SPARK-37565) Upgrade mysql-connector-java to 8.0.27

2021-12-10 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-37565: --- Assignee: Yuming Wang > Upgrade mysql-connector-java to 8.0.27 >

[jira] [Commented] (SPARK-37609) Transient StackOverflowError on DataFrame from Catalyst QueryPlan

2021-12-10 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17457481#comment-17457481 ] Yuming Wang commented on SPARK-37609: - How to reproduce this issue? > Transient StackOverflowError

[jira] [Commented] (SPARK-37603) org.apache.spark.sql.catalyst.expressions.ListQuery; no valid constructor

2021-12-09 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17456920#comment-17456920 ] Yuming Wang commented on SPARK-37603: - How to reproduce this issue. >

[jira] [Created] (SPARK-37565) Upgrade mysql-connector-java to 8.0.27

2021-12-06 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-37565: --- Summary: Upgrade mysql-connector-java to 8.0.27 Key: SPARK-37565 URL: https://issues.apache.org/jira/browse/SPARK-37565 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-37549) Support set parallel through data source properties

2021-12-05 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-37549: --- Summary: Support set parallel through data source properties Key: SPARK-37549 URL: https://issues.apache.org/jira/browse/SPARK-37549 Project: Spark Issue

[jira] [Commented] (PARQUET-1203) Corrupted parquet file from Spark

2021-12-03 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/PARQUET-1203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17453288#comment-17453288 ] Yuming Wang commented on PARQUET-1203: -- It may be caused by hardware issue. You can add this line:

[jira] [Created] (SPARK-37535) Change default spark.io.compression.codec to zstd

2021-12-03 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-37535: --- Summary: Change default spark.io.compression.codec to zstd Key: SPARK-37535 URL: https://issues.apache.org/jira/browse/SPARK-37535 Project: Spark Issue Type:

[jira] [Commented] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

2021-12-02 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17452730#comment-17452730 ] Yuming Wang commented on SPARK-18105: - Workaround this issue by set spark.io.compression.codec=zstd.

[jira] [Resolved] (SPARK-37270) Incorect result of filter using isNull condition

2021-11-18 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-37270. - Fix Version/s: 3.2.1 Resolution: Fixed Issue resolved by pull request 34627

[jira] [Assigned] (SPARK-37270) Incorect result of filter using isNull condition

2021-11-18 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-37270: --- Assignee: Yuming Wang > Incorect result of filter using isNull condition >

[jira] [Assigned] (SPARK-37345) Add java.security.jgss/sun.security.krb5 to DEFAULT_MODULE_OPTIONS

2021-11-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-37345: --- Assignee: Yuming Wang > Add java.security.jgss/sun.security.krb5 to DEFAULT_MODULE_OPTIONS

[jira] [Resolved] (SPARK-37345) Add java.security.jgss/sun.security.krb5 to DEFAULT_MODULE_OPTIONS

2021-11-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-37345. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34615

[jira] [Updated] (SPARK-37347) Spark Thrift Server (STS) driver fullFC becourse of timeoutExecutor not shutdown correctly

2021-11-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-37347: Target Version/s: (was: 3.1.2, 3.2.0) > Spark Thrift Server (STS) driver fullFC becourse of

[jira] [Updated] (SPARK-37347) Spark Thrift Server (STS) driver fullFC becourse of timeoutExecutor not shutdown correctly

2021-11-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-37347: Fix Version/s: (was: 3.1.3) (was: 3.2.1) > Spark Thrift Server (STS)

[jira] [Commented] (SPARK-37345) Add java.security.jgss/sun.security.krb5 to DEFAULT_MODULE_OPTIONS

2021-11-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1728#comment-1728 ] Yuming Wang commented on SPARK-37345: - Related changes:

[jira] [Created] (SPARK-37345) Add java.security.jgss/sun.security.krb5 to DEFAULT_MODULE_OPTIONS

2021-11-16 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-37345: --- Summary: Add java.security.jgss/sun.security.krb5 to DEFAULT_MODULE_OPTIONS Key: SPARK-37345 URL: https://issues.apache.org/jira/browse/SPARK-37345 Project: Spark

[jira] [Commented] (SPARK-37270) Incorect result of filter using isNull condition

2021-11-12 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443018#comment-17443018 ] Yuming Wang commented on SPARK-37270: - Thank you [~bersprockets] I will fix it soon. > Incorect

[jira] [Updated] (SPARK-37292) Removes outer join if it only has DISTINCT on streamed side with alias

2021-11-11 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-37292: Description: {code:scala} spark.range(200L).selectExpr("id AS a").createTempView("t1")

[jira] [Created] (SPARK-37292) Removes outer join if it only has DISTINCT on streamed side with alias

2021-11-11 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-37292: --- Summary: Removes outer join if it only has DISTINCT on streamed side with alias Key: SPARK-37292 URL: https://issues.apache.org/jira/browse/SPARK-37292 Project: Spark

[jira] [Resolved] (SPARK-35933) PartitionFilters and pushFilters not applied to window functions

2021-11-07 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-35933. - Resolution: Not A Problem > PartitionFilters and pushFilters not applied to window functions >

[jira] [Created] (SPARK-37226) Filter push down through window

2021-11-06 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-37226: --- Summary: Filter push down through window Key: SPARK-37226 URL: https://issues.apache.org/jira/browse/SPARK-37226 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-37172) Push down filters having both partitioning and non-partitioning columns

2021-10-31 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17436574#comment-17436574 ] Yuming Wang commented on SPARK-37172: - Is there a data source can handle these filters? > Push down

[jira] [Commented] (SPARK-32268) Bloom Filter Join

2021-10-28 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17435782#comment-17435782 ] Yuming Wang commented on SPARK-32268: - [~Penglei Shi] Please add my WeChat: yumwang666. We can

[jira] [Resolved] (SPARK-37109) Install Java 17 on all of the Jenkins workers

2021-10-26 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-37109. - Resolution: Won't Do OK. I do not know this plan. > Install Java 17 on all of the Jenkins

[jira] [Resolved] (SPARK-37110) Add Java 17 support for spark pull request builds

2021-10-26 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-37110. - Resolution: Won't Do OK. I do not know this plan. > Add Java 17 support for spark pull request

[jira] [Updated] (SPARK-37110) Add Java 17 support for spark pull request builds

2021-10-26 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-37110: Summary: Add Java 17 support for spark pull request builds (was: Add java17 support for spark

[jira] [Created] (SPARK-37110) Add java17 support for spark pull request builds

2021-10-25 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-37110: --- Summary: Add java17 support for spark pull request builds Key: SPARK-37110 URL: https://issues.apache.org/jira/browse/SPARK-37110 Project: Spark Issue Type:

[jira] [Commented] (SPARK-37109) Install Java 17 on all of the Jenkins workers

2021-10-25 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17433799#comment-17433799 ] Yuming Wang commented on SPARK-37109: - cc [~shaneknapp] > Install Java 17 on all of the Jenkins

[jira] [Updated] (SPARK-37109) Install Java 17 on all of the Jenkins workers

2021-10-25 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-37109: Summary: Install Java 17 on all of the Jenkins workers (was: Add Java 17 in our Jenkins) >

[jira] [Created] (SPARK-37109) Add Java 17 in our Jenkins

2021-10-25 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-37109: --- Summary: Add Java 17 in our Jenkins Key: SPARK-37109 URL: https://issues.apache.org/jira/browse/SPARK-37109 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-37101) In class ShuffleBlockPusher, use config instead of key

2021-10-24 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-37101: Affects Version/s: (was: 3.2.0) 3.3.0 > In class ShuffleBlockPusher,

[jira] [Updated] (HIVE-25635) Upgrade Thrift to 0.15.0

2021-10-21 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/HIVE-25635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated HIVE-25635: --- Description: To addresses CVEs: ||Component Name||Component Version Name||Vulnerability||Fixed

[jira] [Created] (HIVE-25635) Upgrade Thrift to 0.15.0

2021-10-21 Thread Yuming Wang (Jira)
Yuming Wang created HIVE-25635: -- Summary: Upgrade Thrift to 0.15.0 Key: HIVE-25635 URL: https://issues.apache.org/jira/browse/HIVE-25635 Project: Hive Issue Type: Improvement

[jira] [Resolved] (SPARK-37041) Backport HIVE-15025: Secure-Socket-Layer (SSL) support for HMS

2021-10-19 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-37041. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34312

[jira] [Assigned] (SPARK-37041) Backport HIVE-15025: Secure-Socket-Layer (SSL) support for HMS

2021-10-19 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-37041: --- Assignee: Yuming Wang > Backport HIVE-15025: Secure-Socket-Layer (SSL) support for HMS >

[jira] [Created] (SPARK-37041) Backport HIVE-15025: Secure-Socket-Layer (SSL) support for HMS

2021-10-18 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-37041: --- Summary: Backport HIVE-15025: Secure-Socket-Layer (SSL) support for HMS Key: SPARK-37041 URL: https://issues.apache.org/jira/browse/SPARK-37041 Project: Spark

[jira] [Created] (SPARK-36840) Support DPP if there is no selective predicate on the filtering side

2021-09-24 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-36840: --- Summary: Support DPP if there is no selective predicate on the filtering side Key: SPARK-36840 URL: https://issues.apache.org/jira/browse/SPARK-36840 Project: Spark

[jira] [Commented] (SPARK-36763) Pull out ordering expressions

2021-09-21 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17418386#comment-17418386 ] Yuming Wang commented on SPARK-36763: - Benchmark and benchmark result: {code:scala} import

[jira] [Resolved] (SPARK-25936) InsertIntoDataSourceCommand does not use Cached Data

2021-09-18 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-25936. - Resolution: Not A Bug > InsertIntoDataSourceCommand does not use Cached Data >

[jira] [Created] (SPARK-36796) Make all unit tests pass on Java 17

2021-09-17 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-36796: --- Summary: Make all unit tests pass on Java 17 Key: SPARK-36796 URL: https://issues.apache.org/jira/browse/SPARK-36796 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-36780) Make dev/mima runs on Java 17

2021-09-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-36780: Summary: Make dev/mima runs on Java 17 (was: Make dev/mima runs on Java 17+) > Make dev/mima

[jira] [Updated] (SPARK-36777) Move Java 17 on GitHub Actions from EA to LTS release

2021-09-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-36777: Affects Version/s: (was: 3.3.0) 3.2.0 > Move Java 17 on GitHub Actions

[jira] [Created] (SPARK-36780) Make dev/mima runs on Java 17+

2021-09-16 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-36780: --- Summary: Make dev/mima runs on Java 17+ Key: SPARK-36780 URL: https://issues.apache.org/jira/browse/SPARK-36780 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-36777) Move Java 17 on GitHub Actions from EA to LTS release

2021-09-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-36777. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 34017

[jira] [Created] (SPARK-36763) Pull out ordering expressions

2021-09-15 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-36763: --- Summary: Pull out ordering expressions Key: SPARK-36763 URL: https://issues.apache.org/jira/browse/SPARK-36763 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-36716) Join estimation support LeftExistence join type

2021-09-12 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-36716: Attachment: (was: image-2021-09-10-17-17-33-082.png) > Join estimation support LeftExistence

[jira] [Created] (SPARK-36716) Join estimation support LeftExistence join type

2021-09-10 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-36716: --- Summary: Join estimation support LeftExistence join type Key: SPARK-36716 URL: https://issues.apache.org/jira/browse/SPARK-36716 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-35967) Update nullability based on column statistics

2021-09-09 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-35967. - Resolution: Won't Fix > Update nullability based on column statistics >

[jira] [Resolved] (SPARK-36376) Collapse repartitions if there is a project between them

2021-09-09 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-36376. - Resolution: Won't Fix > Collapse repartitions if there is a project between them >

[jira] [Created] (SPARK-36703) Remove the Sort if it is the child of RepartitionByExpression

2021-09-09 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-36703: --- Summary: Remove the Sort if it is the child of RepartitionByExpression Key: SPARK-36703 URL: https://issues.apache.org/jira/browse/SPARK-36703 Project: Spark

[jira] [Updated] (SPARK-36444) Remove OptimizeSubqueries from batch of PartitionPruning

2021-08-19 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-36444: Affects Version/s: 3.0.3 3.1.2 > Remove OptimizeSubqueries from batch of

[jira] [Updated] (SPARK-36444) Remove OptimizeSubqueries from batch of PartitionPruning

2021-08-19 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-36444: Affects Version/s: (was: 3.3.0) 3.2.0 > Remove OptimizeSubqueries from

<    4   5   6   7   8   9   10   11   12   13   >