XiDuo You created SPARK-35853:
-
Summary: Remark the shuffle origin to ENSURE_REQUIREMENTS as far
as possible
Key: SPARK-35853
URL: https://issues.apache.org/jira/browse/SPARK-35853
Project: Spark
XiDuo You created SPARK-35813:
-
Summary: Add new adaptive config into sql-performance-tuning docs
Key: SPARK-35813
URL: https://issues.apache.org/jira/browse/SPARK-35813
Project: Spark
Issue Type
[
https://issues.apache.org/jira/browse/SPARK-35786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
XiDuo You updated SPARK-35786:
--
Summary: Add a new operator to distingush if AQE can optimize safely (was:
Add a new hint to distingu
[
https://issues.apache.org/jira/browse/SPARK-35786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
XiDuo You updated SPARK-35786:
--
Summary: Add a new hint to distingush if AQE can optimize safely (was:
Support optimize repartition b
[
https://issues.apache.org/jira/browse/SPARK-35786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
XiDuo You updated SPARK-35786:
--
Description:
Add a new hint to distingush if we can optimize it safely.
was:Currently, we only sup
[
https://issues.apache.org/jira/browse/SPARK-35786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
XiDuo You updated SPARK-35786:
--
Summary: Support optimize repartition by expression in AQE (was: Support
adaptive repartition by expr
[
https://issues.apache.org/jira/browse/SPARK-35786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
XiDuo You updated SPARK-35786:
--
Summary: Support adaptive repartition by expression (was: Support adaptive
repartition with repartiti
[
https://issues.apache.org/jira/browse/SPARK-35786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
XiDuo You updated SPARK-35786:
--
Summary: Support adaptive repartition with repartition by expression (was:
Support adaptive repartiti
XiDuo You created SPARK-35786:
-
Summary: Support adaptive repartition
Key: SPARK-35786
URL: https://issues.apache.org/jira/browse/SPARK-35786
Project: Spark
Issue Type: Improvement
Comp
[
https://issues.apache.org/jira/browse/SPARK-35725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
XiDuo You updated SPARK-35725:
--
Summary: Support repartition expand partitions in AQE (was: Support
repartition expand partitions)
>
[
https://issues.apache.org/jira/browse/SPARK-35725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
XiDuo You updated SPARK-35725:
--
Parent: SPARK-33828
Issue Type: Sub-task (was: Improvement)
> Support repartition expand part
XiDuo You created SPARK-35725:
-
Summary: Support repartition expand partitions
Key: SPARK-35725
URL: https://issues.apache.org/jira/browse/SPARK-35725
Project: Spark
Issue Type: Improvement
XiDuo You created SPARK-35687:
-
Summary: PythonUDFSuite move assume into its methods
Key: SPARK-35687
URL: https://issues.apache.org/jira/browse/SPARK-35687
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-33832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17359190#comment-17359190
]
XiDuo You commented on SPARK-33832:
---
hi [~ekoifman] I created a PR for this issue, do
[
https://issues.apache.org/jira/browse/SPARK-35675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
XiDuo You updated SPARK-35675:
--
Description:
Currently EnsureRequirements only check if child has semantic equal
HashPartitioning and
XiDuo You created SPARK-35675:
-
Summary: EnsureRequirements remove shuffle should respect
PartitioningCollection
Key: SPARK-35675
URL: https://issues.apache.org/jira/browse/SPARK-35675
Project: Spark
XiDuo You created SPARK-35629:
-
Summary: Drop database should check if exists
Key: SPARK-35629
URL: https://issues.apache.org/jira/browse/SPARK-35629
Project: Spark
Issue Type: Improvement
XiDuo You created SPARK-35608:
-
Summary: Support AQE optimizer side transformUpWithPruning
Key: SPARK-35608
URL: https://issues.apache.org/jira/browse/SPARK-35608
Project: Spark
Issue Type: Impro
XiDuo You created SPARK-35585:
-
Summary: Support propagate empty relation through project/filter
Key: SPARK-35585
URL: https://issues.apache.org/jira/browse/SPARK-35585
Project: Spark
Issue Type:
XiDuo You created SPARK-35552:
-
Summary: Make query stage materialized more readable
Key: SPARK-35552
URL: https://issues.apache.org/jira/browse/SPARK-35552
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-35442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
XiDuo You reopened SPARK-35442:
---
> Eliminate unnecessary join through Aggregate
>
>
>
XiDuo You created SPARK-35540:
-
Summary: Make config maxShuffledHashJoinLocalMapThreshold fallback
to advisoryPartitionSizeInBytes
Key: SPARK-35540
URL: https://issues.apache.org/jira/browse/SPARK-35540
P
[
https://issues.apache.org/jira/browse/SPARK-35282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
XiDuo You updated SPARK-35282:
--
Description:
Use AQE runtime statistics to decide if we can use shuffled hash join instead
of sort me
[
https://issues.apache.org/jira/browse/SPARK-35442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
XiDuo You resolved SPARK-35442.
---
Resolution: Duplicate
> Eliminate unnecessary join through Aggregate
> -
[
https://issues.apache.org/jira/browse/SPARK-35455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
XiDuo You updated SPARK-35455:
--
Priority: Major (was: Minor)
> Enhance EliminateUnnecessaryJoin
>
>
[
https://issues.apache.org/jira/browse/SPARK-35455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
XiDuo You updated SPARK-35455:
--
Parent: SPARK-33828
Issue Type: Sub-task (was: Improvement)
> Enhance EliminateUnnecessaryJoi
XiDuo You created SPARK-35455:
-
Summary: Enhance EliminateUnnecessaryJoin
Key: SPARK-35455
URL: https://issues.apache.org/jira/browse/SPARK-35455
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-35442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
XiDuo You updated SPARK-35442:
--
Description:
If Aggregate and Join have the same output partitioning, the plan will look
like:
{code:
[
https://issues.apache.org/jira/browse/SPARK-35442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
XiDuo You updated SPARK-35442:
--
Description:
If Aggregate and Join have the same output partitioning, the plan will look
like:
{code:
[
https://issues.apache.org/jira/browse/SPARK-35442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
XiDuo You updated SPARK-35442:
--
Description:
If Aggregate and Join have the same output partitioning, the plan will look
like:
{code:
XiDuo You created SPARK-35442:
-
Summary: Eliminate unnecessary join through Aggregate
Key: SPARK-35442
URL: https://issues.apache.org/jira/browse/SPARK-35442
Project: Spark
Issue Type: Improvemen
[
https://issues.apache.org/jira/browse/SPARK-35332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17344501#comment-17344501
]
XiDuo You commented on SPARK-35332:
---
[~luxianghao] Now you can `set
spark.sql.optimiz
XiDuo You created SPARK-35376:
-
Summary: Fallback config should override defaultValue
Key: SPARK-35376
URL: https://issues.apache.org/jira/browse/SPARK-35376
Project: Spark
Issue Type: Improvemen
[
https://issues.apache.org/jira/browse/SPARK-35332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341244#comment-17341244
]
XiDuo You commented on SPARK-35332:
---
Adding a new cache-specific option in a CACHE sta
[
https://issues.apache.org/jira/browse/SPARK-35332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341107#comment-17341107
]
XiDuo You commented on SPARK-35332:
---
The reason is Spark force disable the AQE during
401 - 435 of 435 matches
Mail list logo
