[jira] [Created] (SPARK-44562) Add OptimizeOneRowRelationSubquery in batch of Subquery

2023-07-26 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-44562: --- Summary: Add OptimizeOneRowRelationSubquery in batch of Subquery Key: SPARK-44562 URL: https://issues.apache.org/jira/browse/SPARK-44562 Project: Spark Issue

[jira] [Resolved] (SPARK-44466) Exclude configs starting with SPARK_DRIVER_PREFIX and SPARK_EXECUTOR_PREFIX from modifiedConfigs

2023-07-24 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-44466. - Fix Version/s: 3.5.0 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-44466) Exclude configs starting with SPARK_DRIVER_PREFIX and SPARK_EXECUTOR_PREFIX from modifiedConfigs

2023-07-24 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-44466: --- Assignee: Yuming Wang > Exclude configs starting with SPARK_DRIVER_PREFIX and

[jira] [Commented] (SPARK-44527) Simplify BinaryComparison if its children contain ScalarSubquery with empty output

2023-07-24 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17746488#comment-17746488 ] Yuming Wang commented on SPARK-44527: - https://github.com/apache/spark/pull/42129 > Simplify

[jira] [Created] (SPARK-44527) Simplify BinaryComparison if its children contain ScalarSubquery with empty output

2023-07-24 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-44527: --- Summary: Simplify BinaryComparison if its children contain ScalarSubquery with empty output Key: SPARK-44527 URL: https://issues.apache.org/jira/browse/SPARK-44527

[jira] [Updated] (SPARK-44523) Filter's maxRows/maxRowsPerPartition is 0 if condition is FalseLiteral

2023-07-24 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44523: Summary: Filter's maxRows/maxRowsPerPartition is 0 if condition is FalseLiteral (was: Filter's

[jira] [Commented] (SPARK-44523) Filter's maxRows should be 0 if condition is FalseLiteral

2023-07-24 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17746290#comment-17746290 ] Yuming Wang commented on SPARK-44523: - https://github.com/apache/spark/pull/42126 > Filter's

[jira] [Created] (SPARK-44523) Filter's maxRows should be 0 if condition is FalseLiteral

2023-07-24 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-44523: --- Summary: Filter's maxRows should be 0 if condition is FalseLiteral Key: SPARK-44523 URL: https://issues.apache.org/jira/browse/SPARK-44523 Project: Spark

[jira] [Updated] (SPARK-44514) Optimize join if maximum number of rows on one side is 1

2023-07-23 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44514: Summary: Optimize join if maximum number of rows on one side is 1 (was: Rewrite the join to

[jira] [Commented] (SPARK-44514) Rewrite the join to filter if one side maximum number of rows is 1

2023-07-23 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17746143#comment-17746143 ] Yuming Wang commented on SPARK-44514: - https://github.com/apache/spark/pull/42114 > Rewrite the

[jira] [Created] (SPARK-44514) Rewrite the join to filter if one side maximum number of rows is 1

2023-07-23 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-44514: --- Summary: Rewrite the join to filter if one side maximum number of rows is 1 Key: SPARK-44514 URL: https://issues.apache.org/jira/browse/SPARK-44514 Project: Spark

[jira] [Updated] (SPARK-44466) Exclude configs starting with SPARK_DRIVER_PREFIX and SPARK_EXECUTOR_PREFIX from modifiedConfigs

2023-07-20 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44466: Summary: Exclude configs starting with SPARK_DRIVER_PREFIX and SPARK_EXECUTOR_PREFIX from

[jira] [Updated] (SPARK-44493) Extract pushable predicates from disjunctive predicates

2023-07-20 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44493: Attachment: before.png > Extract pushable predicates from disjunctive predicates >

[jira] [Created] (SPARK-44493) Extract pushable predicates from disjunctive predicates

2023-07-20 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-44493: --- Summary: Extract pushable predicates from disjunctive predicates Key: SPARK-44493 URL: https://issues.apache.org/jira/browse/SPARK-44493 Project: Spark Issue

[jira] [Updated] (SPARK-44493) Extract pushable predicates from disjunctive predicates

2023-07-20 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44493: Description: Example: {code:sql} select count(*) from db.very_large_table where

[jira] [Updated] (SPARK-44493) Extract pushable predicates from disjunctive predicates

2023-07-20 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44493: Attachment: after.png > Extract pushable predicates from disjunctive predicates >

[jira] [Commented] (SPARK-44466) Update initialSessionOptions to the value after supplementation

2023-07-17 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17744040#comment-17744040 ] Yuming Wang commented on SPARK-44466: - https://github.com/apache/spark/pull/42049 > Update

[jira] [Updated] (SPARK-44466) Update initialSessionOptions to the value after supplementation

2023-07-17 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44466: Description: Should not include this value: !screenshot-1.png! > Update initialSessionOptions

[jira] [Updated] (SPARK-44466) Update initialSessionOptions to the value after supplementation

2023-07-17 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44466: Attachment: screenshot-1.png > Update initialSessionOptions to the value after supplementation >

[jira] [Created] (SPARK-44466) Update initialSessionOptions to the value after supplementation

2023-07-17 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-44466: --- Summary: Update initialSessionOptions to the value after supplementation Key: SPARK-44466 URL: https://issues.apache.org/jira/browse/SPARK-44466 Project: Spark

[jira] [Commented] (SPARK-44448) Wrong results for dense_rank() <= k from InferWindowGroupLimit and DenseRankLimitIterator

2023-07-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-8?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17743592#comment-17743592 ] Yuming Wang commented on SPARK-8: - cc [~beliefer] > Wrong results for dense_rank() <= k from

[jira] [Updated] (SPARK-44448) Wrong results for dense_rank() <= k from InferWindowGroupLimit and DenseRankLimitIterator

2023-07-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-8?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-8: Target Version/s: 3.5.0 > Wrong results for dense_rank() <= k from InferWindowGroupLimit and >

[jira] [Updated] (SPARK-44444) Enabled ANSI mode by default

2023-07-15 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-4: Description: To avoid data issue. > Enabled ANSI mode by default > >

[jira] [Created] (SPARK-44444) Enabled ANSI mode by default

2023-07-15 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-4: --- Summary: Enabled ANSI mode by default Key: SPARK-4 URL: https://issues.apache.org/jira/browse/SPARK-4 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-44415) Upgrade snappy-java to 1.1.10.2

2023-07-14 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-44415. - Fix Version/s: 4.0.0 3.4.2 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-44415) Upgrade snappy-java to 1.1.10.2

2023-07-14 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-44415: --- Assignee: Yuming Wang > Upgrade snappy-java to 1.1.10.2 > ---

[jira] [Created] (SPARK-44430) Enhance error message when option or property key is invalid

2023-07-14 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-44430: --- Summary: Enhance error message when option or property key is invalid Key: SPARK-44430 URL: https://issues.apache.org/jira/browse/SPARK-44430 Project: Spark

[jira] [Created] (SPARK-44429) Make MsSqlServerIntegrationSuite robust in ANSI mode

2023-07-14 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-44429: --- Summary: Make MsSqlServerIntegrationSuite robust in ANSI mode Key: SPARK-44429 URL: https://issues.apache.org/jira/browse/SPARK-44429 Project: Spark Issue

[jira] [Created] (SPARK-44415) Upgrade snappy-java to 1.1.10.2

2023-07-13 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-44415: --- Summary: Upgrade snappy-java to 1.1.10.2 Key: SPARK-44415 URL: https://issues.apache.org/jira/browse/SPARK-44415 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-44251) Potential for incorrect results or NPE when full outer USING join has null key value

2023-07-10 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44251: Fix Version/s: 3.5.0 (was: 4.0.0) > Potential for incorrect results or NPE

[jira] [Resolved] (SPARK-44251) Potential for incorrect results or NPE when full outer USING join has null key value

2023-07-10 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-44251. - Fix Version/s: 3.3.3 4.0.0 3.4.2 Resolution: Fixed

[jira] [Assigned] (SPARK-44251) Potential for incorrect results or NPE when full outer USING join has null key value

2023-07-10 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-44251: --- Assignee: Bruce Robbins > Potential for incorrect results or NPE when full outer USING

[jira] [Commented] (SPARK-44339) spark3-shell errors org.apache.hadoop.hive.ql.metadata.HiveException: Unable to fetch table . Permission denied: user [AD user] does not have [SELECT]

2023-07-08 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17741340#comment-17741340 ] Yuming Wang commented on SPARK-44339: - It seems it's cloudera spark issue. > spark3-shell errors

[jira] [Resolved] (SPARK-44185) Inconsistent path qualifying between catalog and data operations

2023-07-03 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-44185. - Fix Version/s: 3.5.0 Assignee: Kent Yao Resolution: Fixed Issue resolved by

[jira] [Commented] (SPARK-44213) CTAS missing the child info on UI when groupSQLSubExecutionEnabled is enabled

2023-06-27 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737770#comment-17737770 ] Yuming Wang commented on SPARK-44213: - Related issue ticket: SPARK-41752. > CTAS missing the child

[jira] [Commented] (SPARK-44213) CTAS missing the child info on UI when groupSQLSubExecutionEnabled is enabled

2023-06-27 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737768#comment-17737768 ] Yuming Wang commented on SPARK-44213: - cc [~linhongliu-db] > CTAS missing the child info on UI when

[jira] [Updated] (SPARK-44213) CTAS missing the child info on UI when groupSQLSubExecutionEnabled is enabled

2023-06-27 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44213: Description: {code:sql} create table tbl using parquet as select t1.id from range(10) as t1 join

[jira] [Updated] (SPARK-44213) CTAS missing the child info on UI when groupSQLSubExecutionEnabled is enabled

2023-06-27 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44213: Attachment: screenshot-1.png > CTAS missing the child info on UI when groupSQLSubExecutionEnabled

[jira] [Created] (SPARK-44213) CTAS missing the child info on UI when groupSQLSubExecutionEnabled is enabled

2023-06-27 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-44213: --- Summary: CTAS missing the child info on UI when groupSQLSubExecutionEnabled is enabled Key: SPARK-44213 URL: https://issues.apache.org/jira/browse/SPARK-44213 Project:

[jira] [Updated] (SPARK-44213) CTAS missing the child info on UI when groupSQLSubExecutionEnabled is enabled

2023-06-27 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44213: Attachment: enabled.png > CTAS missing the child info on UI when groupSQLSubExecutionEnabled is

[jira] [Commented] (SPARK-42260) Log when the K8s Exec Pods Allocator Stalls

2023-06-27 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17737563#comment-17737563 ] Yuming Wang commented on SPARK-42260: - Remove the target version since 3.4.1 is released. > Log

[jira] [Updated] (SPARK-42260) Log when the K8s Exec Pods Allocator Stalls

2023-06-27 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-42260: Target Version/s: (was: 3.4.1) > Log when the K8s Exec Pods Allocator Stalls >

[jira] [Updated] (SPARK-44025) CSV Table Read Error with CharType(length) column

2023-06-27 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44025: Target Version/s: (was: 3.4.1) > CSV Table Read Error with CharType(length) column >

[jira] [Resolved] (SPARK-44168) Add Apache Spark 3.4.1 Dockerfiles

2023-06-25 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-44168. - Fix Version/s: 3.4.1 Resolution: Fixed > Add Apache Spark 3.4.1 Dockerfiles >

[jira] [Commented] (SPARK-43816) Spark Corrupts Data In-Transit for High Volume (> 20 TB/hr) of Data

2023-06-24 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17736811#comment-17736811 ] Yuming Wang commented on SPARK-43816: - [~saiallu2020] This is similar to

[jira] [Commented] (SPARK-44114) Upgrade built-in Hive to 3+

2023-06-21 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17735557#comment-17735557 ] Yuming Wang commented on SPARK-44114: - There is a lot of work to upgrade Hive, but the user

[jira] [Commented] (SPARK-43339) LEFT JOIN is treated as INNER JOIN when being in a middle of double join

2023-06-17 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17733780#comment-17733780 ] Yuming Wang commented on SPARK-43339: - This is not a bug. The final result is correct.

[jira] [Resolved] (SPARK-43339) LEFT JOIN is treated as INNER JOIN when being in a middle of double join

2023-06-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-43339. - Resolution: Not A Problem It is optimized by EliminateOuterJoin. > LEFT JOIN is treated as

[jira] [Commented] (SPARK-43816) Spark Corrupts Data In-Transit for High Volume (> 20 TB/hr) of Data

2023-06-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17733690#comment-17733690 ] Yuming Wang commented on SPARK-43816: - You can also set another config:

[jira] [Updated] (SPARK-44080) Update Spark SQL config default value for thriftserver

2023-06-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44080: Description: To support updating the Spark SQL config default value for new connections without

[jira] [Assigned] (SPARK-44070) Bump snappy-java 1.1.10.1

2023-06-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-44070: --- Assignee: Cheng Pan > Bump snappy-java 1.1.10.1 > - > >

[jira] [Resolved] (SPARK-44070) Bump snappy-java 1.1.10.1

2023-06-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-44070. - Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed Issue resolved by pull

[jira] [Commented] (SPARK-44080) Update Spark SQL config default value for thriftserver

2023-06-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17733556#comment-17733556 ] Yuming Wang commented on SPARK-44080: - https://github.com/apache/spark/pull/41630 > Update Spark

[jira] [Created] (SPARK-44080) Update Spark SQL config default value for thriftserver

2023-06-16 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-44080: --- Summary: Update Spark SQL config default value for thriftserver Key: SPARK-44080 URL: https://issues.apache.org/jira/browse/SPARK-44080 Project: Spark Issue

[jira] [Assigned] (SPARK-44072) Update the incorrect sql example of insert table documentation

2023-06-15 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-44072: --- Assignee: Yang Zhang > Update the incorrect sql example of insert table documentation >

[jira] [Updated] (SPARK-44072) Update the incorrect sql example of insert table documentation

2023-06-15 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44072: Fix Version/s: (was: 3.4.1) (was: 3.3.3) > Update the incorrect sql

[jira] [Updated] (SPARK-44072) Update the incorrect sql example of insert table documentation

2023-06-15 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44072: Fix Version/s: 3.3.3 3.4.1 > Update the incorrect sql example of insert table

[jira] [Assigned] (SPARK-44040) Incorrect result after count distinct

2023-06-15 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-44040: --- Assignee: Yuming Wang > Incorrect result after count distinct >

[jira] [Resolved] (SPARK-44040) Incorrect result after count distinct

2023-06-15 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-44040. - Fix Version/s: 3.3.3 3.5.0 3.4.1 Resolution: Fixed

[jira] [Resolved] (SPARK-44031) Upgrade silencer to 1.7.13

2023-06-15 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-44031. - Fix Version/s: 3.5.0 Assignee: Dongjoon Hyun Resolution: Fixed > Upgrade

[jira] [Commented] (SPARK-44058) Remove deprecated API usage in HiveShim.scala

2023-06-14 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732851#comment-17732851 ] Yuming Wang commented on SPARK-44058: - This is used to connect Hive metastore 0.12. > Remove

[jira] [Commented] (SPARK-44058) Remove deprecated API usage in HiveShim.scala

2023-06-14 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732806#comment-17732806 ] Yuming Wang commented on SPARK-44058: - For Hive 0.13 and later, we use

[jira] [Updated] (SPARK-44053) Update ORC to 1.8.4

2023-06-14 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44053: Affects Version/s: 3.5.0 (was: 3.4.1) > Update ORC to 1.8.4 >

[jira] [Commented] (SPARK-44048) Remove sql-migration-old.md

2023-06-13 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732336#comment-17732336 ] Yuming Wang commented on SPARK-44048: - https://github.com/apache/spark/pull/41583 > Remove

[jira] [Created] (SPARK-44048) Remove sql-migration-old.md

2023-06-13 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-44048: --- Summary: Remove sql-migration-old.md Key: SPARK-44048 URL: https://issues.apache.org/jira/browse/SPARK-44048 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-38162) Optimize one row plan in normal and AQE Optimizer

2023-06-13 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-38162: --- Assignee: XiDuo You > Optimize one row plan in normal and AQE Optimizer >

[jira] [Updated] (SPARK-44040) Incorrect result after count distinct

2023-06-13 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44040: Affects Version/s: 3.3.2 > Incorrect result after count distinct >

[jira] [Commented] (SPARK-44040) Incorrect result after count distinct

2023-06-13 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732170#comment-17732170 ] Yuming Wang commented on SPARK-44040: - https://github.com/apache/spark/pull/41576 > Incorrect

[jira] [Commented] (SPARK-44040) Incorrect result after count distinct

2023-06-13 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732159#comment-17732159 ] Yuming Wang commented on SPARK-44040: - Thanks for reporting this bug. We will fix it soon. >

[jira] [Updated] (SPARK-44040) Incorrect result after count distinct

2023-06-13 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44040: Target Version/s: 3.4.1 > Incorrect result after count distinct >

[jira] [Updated] (SPARK-44025) CSV Table Read Error with CharType(length) column

2023-06-11 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44025: Target Version/s: 3.4.1 > CSV Table Read Error with CharType(length) column >

[jira] [Created] (SPARK-44021) Add a config to make it do not generate too many partitions

2023-06-11 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-44021: --- Summary: Add a config to make it do not generate too many partitions Key: SPARK-44021 URL: https://issues.apache.org/jira/browse/SPARK-44021 Project: Spark

[jira] [Resolved] (SPARK-43866) Partition filter condition should pushed down to metastore query if it is equivalence Predicate

2023-06-10 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-43866. - Resolution: Workaround > Partition filter condition should pushed down to metastore query if it

[jira] [Updated] (SPARK-43273) Support lz4raw compression codec for Parquet

2023-06-08 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-43273: Priority: Major (was: Trivial) > Support lz4raw compression codec for Parquet >

[jira] [Commented] (SPARK-43273) Support writing Parquet files with lz4raw compression

2023-06-07 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17730383#comment-17730383 ] Yuming Wang commented on SPARK-43273: - https://github.com/apache/spark/pull/41507 > Support writing

[jira] (SPARK-43273) Support writing Parquet files with lz4raw compression

2023-06-07 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43273 ] Yuming Wang deleted comment on SPARK-43273: - was (Author: q79969786): https://github.com/apache/spark/pull/41507 > Support writing Parquet files with lz4raw compression >

[jira] [Updated] (SPARK-43273) Support writing Parquet files with lz4raw compression

2023-06-07 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-43273: Summary: Support writing Parquet files with lz4raw compression (was: Spark can't read parquet

[jira] [Commented] (SPARK-43980) Add support for EXCEPT in select clause, similar to what databricks provides

2023-06-06 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17729773#comment-17729773 ] Yuming Wang commented on SPARK-43980: - Spark SQL current supports regex column specification,

[jira] [Updated] (SPARK-43911) Use toSet to deduplicate the iterator data to prevent the creation of large Array

2023-06-05 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-43911: Fix Version/s: (was: 3.5.0) (was: 3.4.1) > Use toSet to deduplicate

[jira] [Reopened] (SPARK-43911) Use toSet to deduplicate the iterator data to prevent the creation of large Array

2023-06-05 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reopened SPARK-43911: - Assignee: (was: mcdull_zhang) > Use toSet to deduplicate the iterator data to prevent the

[jira] [Assigned] (SPARK-43911) Use toSet to deduplicate the iterator data to prevent the creation of large Array

2023-06-04 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-43911: --- Assignee: mcdull_zhang > Use toSet to deduplicate the iterator data to prevent the

[jira] [Resolved] (SPARK-43911) Use toSet to deduplicate the iterator data to prevent the creation of large Array

2023-06-04 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-43911. - Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-43956) Fix the bug doesn't display column's sql for Percentile[Cont|Disc]

2023-06-02 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-43956. - Assignee: jiaan.geng Resolution: Fixed > Fix the bug doesn't display column's sql for

[jira] [Resolved] (SPARK-43865) spark cluster deploy mode cannot initialize metastore java.sql.SQLException: No suitable driver found for jdbc:mysql

2023-06-01 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-43865. - Resolution: Not A Problem > spark cluster deploy mode cannot initialize metastore

[jira] [Assigned] (SPARK-43859) Override toString in LateralColumnAliasReference

2023-05-30 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-43859: --- Assignee: Yuming Wang > Override toString in LateralColumnAliasReference >

[jira] [Resolved] (SPARK-43859) Override toString in LateralColumnAliasReference

2023-05-30 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-43859. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41359

[jira] [Resolved] (SPARK-43868) Remove `originalUDFs` from TestHive

2023-05-30 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-43868. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41369

[jira] [Assigned] (SPARK-43868) Remove `originalUDFs` from TestHive

2023-05-30 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-43868: --- Assignee: Yang Jie > Remove `originalUDFs` from TestHive >

[jira] [Assigned] (SPARK-28476) Support ALTER DATABASE SET LOCATION

2023-05-30 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-28476: --- Assignee: Yuming Wang (was: yuming.wang) > Support ALTER DATABASE SET LOCATION >

[jira] [Commented] (SPARK-43865) spark cluster deploy mode cannot initialize metastore java.sql.SQLException: No suitable driver found for jdbc:mysql

2023-05-29 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17727269#comment-17727269 ] Yuming Wang commented on SPARK-43865: - Could you add the [JDBC driver for

[jira] [Updated] (SPARK-43851) Support LCA in grouping expressions

2023-05-29 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-43851: Parent: SPARK-27561 Issue Type: Sub-task (was: Improvement) > Support LCA in grouping

[jira] [Commented] (SPARK-43859) Override toString in LateralColumnAliasReference

2023-05-29 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17727019#comment-17727019 ] Yuming Wang commented on SPARK-43859: - https://github.com/apache/spark/pull/41359 > Override

[jira] [Created] (SPARK-43859) Override toString in LateralColumnAliasReference

2023-05-28 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-43859: --- Summary: Override toString in LateralColumnAliasReference Key: SPARK-43859 URL: https://issues.apache.org/jira/browse/SPARK-43859 Project: Spark Issue Type:

[jira] [Updated] (SPARK-43851) Support LCA in grouping expressions

2023-05-28 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-43851: Description: Teradata supports it: {code:sql} create table t1(a int) using parquet; select a + 1

[jira] [Created] (SPARK-43851) Support LCA in grouping expressions

2023-05-28 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-43851: --- Summary: Support LCA in grouping expressions Key: SPARK-43851 URL: https://issues.apache.org/jira/browse/SPARK-43851 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-43818) Spark Glue job introduces duplicates while writing a dataframe as file to S3

2023-05-26 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-43818: Language: (was: English) > Spark Glue job introduces duplicates while writing a dataframe as

[jira] [Commented] (SPARK-43801) Support unwrap date type to string type in UnwrapCastInBinaryComparison

2023-05-25 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17726450#comment-17726450 ] Yuming Wang commented on SPARK-43801: - Would you like to add this feature

[jira] [Created] (SPARK-43743) Port HIVE-12188: DoAs does not work properly in non-kerberos secured HS2

2023-05-23 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-43743: --- Summary: Port HIVE-12188: DoAs does not work properly in non-kerberos secured HS2 Key: SPARK-43743 URL: https://issues.apache.org/jira/browse/SPARK-43743 Project:

[jira] [Updated] (SPARK-43538) Spark Homebrew Formulae currently depends on non-officially-supported Java 20

2023-05-22 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-43538: Issue Type: Bug (was: Request) > Spark Homebrew Formulae currently depends on

[jira] [Resolved] (SPARK-43538) Spark Homebrew Formulae currently depends on non-officially-supported Java 20

2023-05-22 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-43538. - Fix Version/s: 3.4.0 Assignee: Yuming Wang Resolution: Fixed Issue resolved by

<    1   2   3   4   5   6   7   8   9   10   >