[
https://issues.apache.org/jira/browse/SPARK-42063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang reassigned SPARK-42063:
---
Assignee: Dongjoon Hyun
> Register `byte[][]` to KyroSerializer
>
Yuming Wang created SPARK-42064:
---
Summary: Implement bloom filter join hint
Key: SPARK-42064
URL: https://issues.apache.org/jira/browse/SPARK-42064
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-39217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang reassigned SPARK-39217:
---
Assignee: Wan Kun
> Makes DPP support the pruning side has Union
>
[
https://issues.apache.org/jira/browse/SPARK-39217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved SPARK-39217.
-
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 39460
Yuming Wang created SPARK-41986:
---
Summary: Introduce shuffle on SinglePartition
Key: SPARK-41986
URL: https://issues.apache.org/jira/browse/SPARK-41986
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-41741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17655893#comment-17655893
]
Yuming Wang commented on SPARK-41741:
-
What is your env? you can put the env in your terminal.
>
[
https://issues.apache.org/jira/browse/SPARK-41741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17655882#comment-17655882
]
Yuming Wang commented on SPARK-41741:
-
What is your {{file.encoding}}?
> [SQL] ParquetFilters
[
https://issues.apache.org/jira/browse/SPARK-41498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-41498:
Fix Version/s: (was: 3.4.0)
> Union does not propagate Metadata output
>
[
https://issues.apache.org/jira/browse/SPARK-41459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17645111#comment-17645111
]
Yuming Wang commented on SPARK-41459:
-
cc [~LuciferYang]
> Spark Thrift Server operation log output
[
https://issues.apache.org/jira/browse/SPARK-34987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved SPARK-34987.
-
Resolution: Not A Problem
> AQE improve: change shuffle hash join to sort merge join when
[
https://issues.apache.org/jira/browse/SPARK-41167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved SPARK-41167.
-
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 38682
[
https://issues.apache.org/jira/browse/SPARK-41167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang reassigned SPARK-41167:
---
Assignee: Wan Kun
> Optimize LikeSimplification rule to improve multi like performance
>
[
https://issues.apache.org/jira/browse/SPARK-41336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17641191#comment-17641191
]
Yuming Wang commented on SPARK-41336:
-
Could you use Spark 3.3.1?
> BroadcastExchange does not
[
https://issues.apache.org/jira/browse/SPARK-41324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17641155#comment-17641155
]
Yuming Wang commented on SPARK-41324:
-
cc [~LuciferYang]
> Follow-up on JDK-8180450
>
[
https://issues.apache.org/jira/browse/SPARK-41299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17640347#comment-17640347
]
Yuming Wang commented on SPARK-41299:
-
Do you have the query plan?
> OOM when filter pushdown
[
https://issues.apache.org/jira/browse/SPARK-41219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17637102#comment-17637102
]
Yuming Wang commented on SPARK-41219:
-
cc [~ulysses]
> Regression in IntegralDivide returning null
[
https://issues.apache.org/jira/browse/SPARK-41207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17636383#comment-17636383
]
Yuming Wang commented on SPARK-41207:
-
cc [~ulysses]
> Regression in IntegralDivide
>
[
https://issues.apache.org/jira/browse/SPARK-41207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-41207:
Target Version/s: (was: 3.4.0)
> Regression in IntegralDivide
>
>
[
https://issues.apache.org/jira/browse/SPARK-41207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-41207:
Fix Version/s: (was: 3.4.0)
> Regression in IntegralDivide
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-41017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved SPARK-41017.
-
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 38511
[
https://issues.apache.org/jira/browse/SPARK-41141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-41141:
Target Version/s: (was: 3.3.1)
> avoid introducing a new aggregate expression in the analysis
Yuming Wang created SPARK-41088:
---
Summary: Add PartialAggregate and FinalAggregate logic operators
Key: SPARK-41088
URL: https://issues.apache.org/jira/browse/SPARK-41088
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-41071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved SPARK-41071.
-
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 38577
[
https://issues.apache.org/jira/browse/SPARK-41071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang reassigned SPARK-41071:
---
Assignee: Yang Jie
> Metaspace OOM when Local run dev/make-distribution.sh
>
[
https://issues.apache.org/jira/browse/SPARK-41013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17629240#comment-17629240
]
Yuming Wang commented on SPARK-41013:
-
Could you test the Spark 3.3.1?
> spark-3.1.2以cluster模式提交作业报
[
https://issues.apache.org/jira/browse/SPARK-40999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40999:
Fix Version/s: (was: 3.4.0)
> Hints on subqueries are not properly propagated
>
[
https://issues.apache.org/jira/browse/SPARK-40248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved SPARK-40248.
-
Fix Version/s: 3.4.0
Assignee: Yuming Wang
Resolution: Fixed
This is resolved
[
https://issues.apache.org/jira/browse/SPARK-40983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved SPARK-40983.
-
Fix Version/s: 3.3.2
3.2.3
3.4.0
Resolution: Fixed
[
https://issues.apache.org/jira/browse/SPARK-40983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang reassigned SPARK-40983:
---
Assignee: Cheng Pan
> Remove Hadoop requirements for zstd mention in Parquet compression
[
https://issues.apache.org/jira/browse/SPARK-40972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626490#comment-17626490
]
Yuming Wang commented on SPARK-40972:
-
cc [~michaelzhang-db]
> OptimizeLocalShuffleReader causing
[
https://issues.apache.org/jira/browse/SPARK-35904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved SPARK-35904.
-
Resolution: Not A Problem
> Collapse above RebalancePartitions
>
[
https://issues.apache.org/jira/browse/PARQUET-1355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved PARQUET-1355.
--
Resolution: Won't Fix
> Improvement Binary write performance
>
[
https://issues.apache.org/jira/browse/HIVE-14112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved HIVE-14112.
Resolution: Won't Fix
> Join a HBase mapped big table shouldn't convert to MapJoin
>
[
https://issues.apache.org/jira/browse/SPARK-40929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved SPARK-40929.
-
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 20
[
https://issues.apache.org/jira/browse/SPARK-40929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang reassigned SPARK-40929:
---
Assignee: Yikun Jiang
> Add official image dockerfile for Spark v3.3.1
>
[
https://issues.apache.org/jira/browse/SPARK-36057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang reassigned SPARK-36057:
---
Assignee: Yikun Jiang
> SPIP: Support Customized Kubernetes Schedulers
>
[
https://issues.apache.org/jira/browse/SPARK-40874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40874:
Fix Version/s: 3.3.2
(was: 3.3.1)
> Fix broadcasts in Python UDFs when
[
https://issues.apache.org/jira/browse/SPARK-36057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17623505#comment-17623505
]
Yuming Wang commented on SPARK-36057:
-
Thank you [~dongjoon].
> SPIP: Support Customized Kubernetes
[
https://issues.apache.org/jira/browse/SPARK-34966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17315591#comment-17315591
]
Yuming Wang edited comment on SPARK-34966 at 10/24/22 11:37 AM:
[
https://issues.apache.org/jira/browse/SPARK-40885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40885:
Fix Version/s: (was: 3.4.0)
> Spark will filter out data field sorting when dynamic
[
https://issues.apache.org/jira/browse/SPARK-40303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17619978#comment-17619978
]
Yuming Wang commented on SPARK-40303:
-
How to run benchmark code:
# Download latest spark:
[
https://issues.apache.org/jira/browse/SPARK-40736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved SPARK-40736.
-
Resolution: Invalid
> Spark 3.3.0 doesn't works with Hive 3.1.2
>
[
https://issues.apache.org/jira/browse/SPARK-40736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17619501#comment-17619501
]
Yuming Wang commented on SPARK-40736:
-
Please do not copy Hive related jars to ${SPARK_HOME}/jars.
[
https://issues.apache.org/jira/browse/SPARK-40736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17619433#comment-17619433
]
Yuming Wang commented on SPARK-40736:
-
Do you copy hive related jars to ${SPARK_HOME}/jars and then
[
https://issues.apache.org/jira/browse/SPARK-34966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17315591#comment-17315591
]
Yuming Wang edited comment on SPARK-34966 at 10/18/22 7:37 AM:
---
[
https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17619189#comment-17619189
]
Yuming Wang commented on SPARK-40563:
-
Thank you [~Zing]
> Error at where clause, when sql case
[
https://issues.apache.org/jira/browse/SPARK-39951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang reassigned SPARK-39951:
---
Assignee: Adam Binford (was: Apache Spark)
> Support columnar batches with nested fields
[
https://issues.apache.org/jira/browse/SPARK-40563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618234#comment-17618234
]
Yuming Wang commented on SPARK-40563:
-
[~Zing] Does branch-3.3 also fixed this issue?
> Error at
[
https://issues.apache.org/jira/browse/SPARK-39200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-39200:
Fix Version/s: 3.3.1
(was: 3.3.2)
> Stream is corrupted Exception while
[
https://issues.apache.org/jira/browse/SPARK-40535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40535:
Fix Version/s: 3.3.1
(was: 3.3.2)
> NPE from observe of collect_list
>
[
https://issues.apache.org/jira/browse/SPARK-40547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40547:
Fix Version/s: 3.3.1
(was: 3.3.2)
> Fix dead links in sparkr-vignettes.Rmd
[
https://issues.apache.org/jira/browse/SPARK-40322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40322:
Fix Version/s: 3.4.0
3.3.1
(was: 3.3.2)
> Fix all dead
[
https://issues.apache.org/jira/browse/SPARK-40562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40562:
Fix Version/s: 3.3.1
(was: 3.3.2)
> Add
[
https://issues.apache.org/jira/browse/SPARK-38717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-38717:
Fix Version/s: 3.3.1
(was: 3.3.2)
> Handle Hive's bucket spec case
[
https://issues.apache.org/jira/browse/SPARK-40583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40583:
Fix Version/s: 3.3.1
(was: 3.3.2)
> Documentation error in "Integration
[
https://issues.apache.org/jira/browse/SPARK-40636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40636:
Fix Version/s: 3.3.1
(was: 3.3.2)
> Fix wrong remained shuffles log in
[
https://issues.apache.org/jira/browse/SPARK-40648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40648:
Fix Version/s: 3.3.1
(was: 3.3.2)
> Add `@ExtendedLevelDBTest` to the
[
https://issues.apache.org/jira/browse/SPARK-40574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40574:
Fix Version/s: 3.3.1
(was: 3.3.2)
> Add PURGE to DROP TABLE doc
>
[
https://issues.apache.org/jira/browse/SPARK-40612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40612:
Fix Version/s: 3.3.1
(was: 3.3.2)
> On Kubernetes for long running app
[
https://issues.apache.org/jira/browse/SPARK-39725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-39725:
Fix Version/s: 3.3.1
(was: 3.3.2)
> Upgrade jetty-http from
[
https://issues.apache.org/jira/browse/SPARK-40682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40682:
Fix Version/s: 3.3.1
(was: 3.3.2)
> Set spark.driver.maxResultSize to 3g
[
https://issues.apache.org/jira/browse/SPARK-40801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40801:
Fix Version/s: 3.3.2
(was: 3.3.1)
> Upgrade Apache Commons Text to 1.10
>
[
https://issues.apache.org/jira/browse/SPARK-40736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618047#comment-17618047
]
Yuming Wang commented on SPARK-40736:
-
Could you just upgrade Hive metastore to 3.1.2?
> Spark
[
https://issues.apache.org/jira/browse/SPARK-40741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17618044#comment-17618044
]
Yuming Wang commented on SPARK-40741:
-
[~lkqqingcao] How to reproduce this issue?
>
[
https://issues.apache.org/jira/browse/SPARK-40801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved SPARK-40801.
-
Fix Version/s: 3.3.1
3.4.0
Resolution: Fixed
Issue resolved by pull
[
https://issues.apache.org/jira/browse/SPARK-40801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang reassigned SPARK-40801:
---
Assignee: Bjørn Jørgensen
> Upgrade Apache Commons Text to 1.10
>
[
https://issues.apache.org/jira/browse/SPARK-8731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-8731:
---
Fix Version/s: 3.3.1
(was: 3.3.2)
> Beeline doesn't work with -e option when
[
https://issues.apache.org/jira/browse/SPARK-40703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang reassigned SPARK-40703:
---
Assignee: Chao Sun
> Performance regression for joins in Spark 3.3 vs Spark 3.2
>
[
https://issues.apache.org/jira/browse/SPARK-40703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved SPARK-40703.
-
Fix Version/s: 3.3.1
3.4.0
Resolution: Fixed
Issue resolved by pull
[
https://issues.apache.org/jira/browse/SPARK-40764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17616303#comment-17616303
]
Yuming Wang commented on SPARK-40764:
-
Another case if pull out join condition:
{code:scala}
[
https://issues.apache.org/jira/browse/SPARK-40764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17616301#comment-17616301
]
Yuming Wang commented on SPARK-40764:
-
Another case:
{code:scala}
[
https://issues.apache.org/jira/browse/SPARK-40767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40767:
Description:
!screenshot-1.png!
{noformat}
yumwang@LM-SHC-16508156 spark-release % jcmd | grep
[
https://issues.apache.org/jira/browse/SPARK-40767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40767:
Summary: Compile Spark example module will hang (was: Spark example module
will hang if built on
[
https://issues.apache.org/jira/browse/SPARK-40767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40767:
Attachment: screenshot-1.png
> Compile Spark example module will hang
>
Yuming Wang created SPARK-40767:
---
Summary: Spark example module will hang if built on JDK 8
Key: SPARK-40767
URL: https://issues.apache.org/jira/browse/SPARK-40767
Project: Spark
Issue Type:
Yuming Wang created SPARK-40764:
---
Summary: Extract partitioning through all children output
expressions
Key: SPARK-40764
URL: https://issues.apache.org/jira/browse/SPARK-40764
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-40703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40703:
Target Version/s: 3.3.1
> Performance regression for joins in Spark 3.3 vs Spark 3.2
>
Yuming Wang created SPARK-40708:
---
Summary: Auto update table statistics based on write metrics
Key: SPARK-40708
URL: https://issues.apache.org/jira/browse/SPARK-40708
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-40660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40660:
Issue Type: Bug (was: Improvement)
> Switch to XORShiftRandom to distribute elements
>
[
https://issues.apache.org/jira/browse/SPARK-40660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40660:
Fix Version/s: 3.3.1
3.2.3
> Switch to XORShiftRandom to distribute elements
>
[
https://issues.apache.org/jira/browse/SPARK-40664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17612970#comment-17612970
]
Yuming Wang commented on SPARK-40664:
-
This is a know issue, please see comment:
[
https://issues.apache.org/jira/browse/SPARK-40660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40660:
Summary: Switch to XORShiftRandom to distribute elements (was: Switch
XORShiftRandom to
Yuming Wang created SPARK-40660:
---
Summary: Switch XORShiftRandom to distribute elements
Key: SPARK-40660
URL: https://issues.apache.org/jira/browse/SPARK-40660
Project: Spark
Issue Type:
Yuming Wang created SPARK-40632:
---
Summary: Do not inject runtime filter if join condition reference
non simple expression
Key: SPARK-40632
URL: https://issues.apache.org/jira/browse/SPARK-40632
[
https://issues.apache.org/jira/browse/SPARK-40626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40626:
Attachment: Pull out complex join condition and infer more filters.png
> Reorder join keys impact
Yuming Wang created SPARK-40628:
---
Summary: Do not push complex left semi/anti join condition through
project
Key: SPARK-40628
URL: https://issues.apache.org/jira/browse/SPARK-40628
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-40626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40626:
Description:
{code:scala}
sql("CREATE TABLE t1 (itemid BIGINT, eventType STRING, dt STRING) USING
[
https://issues.apache.org/jira/browse/SPARK-40626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40626:
Summary: Reorder join keys impact performance (was: Do not reorder join
keys in
[
https://issues.apache.org/jira/browse/SPARK-40626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40626:
Attachment: Pull out complex join condition.png
> Do not reorder join keys in EnsureRequirements
[
https://issues.apache.org/jira/browse/SPARK-40626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40626:
Attachment: (was: Pull out complex join condition.png)
> Do not reorder join keys in
[
https://issues.apache.org/jira/browse/SPARK-40626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40626:
Attachment: Pull out complex join condition.png
> Do not reorder join keys in EnsureRequirements
[
https://issues.apache.org/jira/browse/SPARK-40626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40626:
Attachment: change the aggregate key order.png
> Do not reorder join keys in EnsureRequirements
[
https://issues.apache.org/jira/browse/SPARK-40626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40626:
Attachment: default(join order will change).png
> Do not reorder join keys in EnsureRequirements
[
https://issues.apache.org/jira/browse/SPARK-40626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40626:
Description:
{code:scala}
sql("CREATE TABLE t1 (itemid BIGINT, eventType STRING, dt STRING)
Yuming Wang created SPARK-40626:
---
Summary: Do not reorder join keys in EnsureRequirements if they
are not simple expressions
Key: SPARK-40626
URL: https://issues.apache.org/jira/browse/SPARK-40626
[
https://issues.apache.org/jira/browse/SPARK-40616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17611328#comment-17611328
]
Yuming Wang commented on SPARK-40616:
-
Please try to set
[
https://issues.apache.org/jira/browse/SPARK-40613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40613:
Parent: SPARK-39375
Issue Type: Sub-task (was: Improvement)
> Update sbt-protoc to 1.0.6
[
https://issues.apache.org/jira/browse/SPARK-40605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang reassigned SPARK-40605:
---
Assignee: Yang Jie
> Connect module should use log4j2.properties to configure test log
[
https://issues.apache.org/jira/browse/SPARK-40605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang resolved SPARK-40605.
-
Fix Version/s: 3.4.0
Resolution: Fixed
Issue resolved by pull request 38041
[
https://issues.apache.org/jira/browse/SPARK-40613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-40613:
Attachment: screenshot-1.png
> Update sbt-protoc to 1.0.6
> --
>
>
401 - 500 of 3600 matches
Mail list logo
