Szehon Ho created SPARK-3186:
Summary: Enable parallelism for Reduce Side Join [Spark Branch]
Key: SPARK-3186
URL: https://issues.apache.org/jira/browse/SPARK-3186
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-3186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szehon Ho updated SPARK-3186:
-
Description: (was: Blocked by SPARK-2978. See parent JIRA for design
details.)
> Enable parallelism
[
https://issues.apache.org/jira/browse/SPARK-3186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szehon Ho resolved SPARK-3186.
--
Resolution: Invalid
Sorry please ignore, meant to file this in Hive project.
> Enable parallelism for
[
https://issues.apache.org/jira/browse/SPARK-3186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szehon Ho closed SPARK-3186.
> Enable parallelism for Reduce Side Join [Spark Branch]
> ---
Szehon Ho created SPARK-48012:
-
Summary: SPJ: Support Transfrom Expressions for One Side Shuffle
Key: SPARK-48012
URL: https://issues.apache.org/jira/browse/SPARK-48012
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-48012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szehon Ho updated SPARK-48012:
--
Parent: SPARK-37375
Issue Type: Sub-task (was: New Feature)
> SPJ: Support Transfrom Expressi
Szehon Ho created SPARK-48065:
-
Summary: SPJ: allowJoinKeysSubsetOfPartitionKeys is too strict
Key: SPARK-48065
URL: https://issues.apache.org/jira/browse/SPARK-48065
Project: Spark
Issue Type: S
Szehon Ho created SPARK-48329:
-
Summary: Default
spark.sql.sources.v2.bucketing.pushPartValues.enabled to true
Key: SPARK-48329
URL: https://issues.apache.org/jira/browse/SPARK-48329
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-48329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17847962#comment-17847962
]
Szehon Ho commented on SPARK-48329:
---
Oh sorry I just saw this, I was about to make thi
[
https://issues.apache.org/jira/browse/SPARK-48329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17847962#comment-17847962
]
Szehon Ho edited comment on SPARK-48329 at 5/20/24 6:58 PM:
[
https://issues.apache.org/jira/browse/SPARK-48329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17847963#comment-17847963
]
Szehon Ho commented on SPARK-48329:
---
I cherry picked your doc change to my pr to be co
[
https://issues.apache.org/jira/browse/SPARK-48329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17847963#comment-17847963
]
Szehon Ho edited comment on SPARK-48329 at 5/20/24 10:37 PM:
-
Szehon Ho created SPARK-48421:
-
Summary: SPJ: Add documentation
Key: SPARK-48421
URL: https://issues.apache.org/jira/browse/SPARK-48421
Project: Spark
Issue Type: Documentation
Componen
Szehon Ho created SPARK-48613:
-
Summary: Umbrella: Storage Partition Join Improvements
Key: SPARK-48613
URL: https://issues.apache.org/jira/browse/SPARK-48613
Project: Spark
Issue Type: New Featu
[
https://issues.apache.org/jira/browse/SPARK-48613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17854665#comment-17854665
]
Szehon Ho commented on SPARK-48613:
---
Adding new umbrella Jira as discussed in
[https:
Szehon Ho created SPARK-48655:
-
Summary: SPJ: Add tests for shuffle skipping for aggregate queries
Key: SPARK-48655
URL: https://issues.apache.org/jira/browse/SPARK-48655
Project: Spark
Issue Typ
Szehon Ho created SPARK-48690:
-
Summary: SPJ: Support auto-shuffle one side + less join keys than
partition keys
Key: SPARK-48690
URL: https://issues.apache.org/jira/browse/SPARK-48690
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-48421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szehon Ho updated SPARK-48421:
--
Parent: SPARK-48613
Issue Type: Sub-task (was: Documentation)
> SPJ: Add documentation
>
Szehon Ho created SPARK-48821:
-
Summary: Support Update in DataFrameWriterV2
Key: SPARK-48821
URL: https://issues.apache.org/jira/browse/SPARK-48821
Project: Spark
Issue Type: Task
Comp
[
https://issues.apache.org/jira/browse/SPARK-48690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17867423#comment-17867423
]
Szehon Ho commented on SPARK-48690:
---
Hi [~chaosun] sorry i made a typo in the title
[
[
https://issues.apache.org/jira/browse/SPARK-48690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17867423#comment-17867423
]
Szehon Ho edited comment on SPARK-48690 at 7/19/24 8:56 PM:
[
https://issues.apache.org/jira/browse/SPARK-48655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szehon Ho resolved SPARK-48655.
---
Fix Version/s: 4.0.0
Resolution: Fixed
> SPJ: Add tests for shuffle skipping for aggregate qu
[
https://issues.apache.org/jira/browse/SPARK-48690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17867423#comment-17867423
]
Szehon Ho edited comment on SPARK-48690 at 7/19/24 8:59 PM:
Szehon Ho created SPARK-48949:
-
Summary: SPJ: Runtime Partition Filtering
Key: SPARK-48949
URL: https://issues.apache.org/jira/browse/SPARK-48949
Project: Spark
Issue Type: Sub-task
Com
[
https://issues.apache.org/jira/browse/SPARK-48613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szehon Ho updated SPARK-48613:
--
Description: As SPARK-37375 is resolved by release of Spark 4.0, this is
for tracking further SPJ enha
Szehon Ho created SPARK-44641:
-
Summary: Results duplicated when SPJ partial-cluster and pushdown
enabled but conditions unmet
Key: SPARK-44641
URL: https://issues.apache.org/jira/browse/SPARK-44641
Proje
[
https://issues.apache.org/jira/browse/SPARK-44641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szehon Ho updated SPARK-44641:
--
Description:
Adding the following test case in KeyGroupedPartitionSuite demonstrates the
problem.
Szehon Ho created SPARK-44647:
-
Summary: Support SPJ when join key is subset of partition keys
Key: SPARK-44647
URL: https://issues.apache.org/jira/browse/SPARK-44647
Project: Spark
Issue Type: N
[
https://issues.apache.org/jira/browse/SPARK-44641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szehon Ho updated SPARK-44641:
--
Description:
Adding the following test case in KeyGroupedPartitionSuite demonstrates the
problem.
[
https://issues.apache.org/jira/browse/SPARK-44647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szehon Ho updated SPARK-44647:
--
Parent: SPARK-37375
Issue Type: Sub-task (was: New Feature)
> Support SPJ when join key is su
[
https://issues.apache.org/jira/browse/SPARK-47094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szehon Ho updated SPARK-47094:
--
Parent: SPARK-37375
Issue Type: Sub-task (was: New Feature)
> SPJ : Dynamically rebalance num
Szehon Ho created SPARK-44060:
-
Summary: Code-gen for build side outer shuffled hash join
Key: SPARK-44060
URL: https://issues.apache.org/jira/browse/SPARK-44060
Project: Spark
Issue Type: Sub-ta
[
https://issues.apache.org/jira/browse/SPARK-44060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szehon Ho updated SPARK-44060:
--
Description:
Here, build side outer join means LEFT OUTER join with build left, or RIGHT
OUTER join w
[
https://issues.apache.org/jira/browse/SPARK-44060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szehon Ho updated SPARK-44060:
--
Description:
Here, build side outer join means LEFT OUTER join with build left, or RIGHT
OUTER join w
Szehon Ho created SPARK-49098:
-
Summary: Support Table Options for Insert SQL
Key: SPARK-49098
URL: https://issues.apache.org/jira/browse/SPARK-49098
Project: Spark
Issue Type: New Feature
Szehon Ho created SPARK-49839:
-
Summary: SPJ: Skip shuffles if possible for sorts
Key: SPARK-49839
URL: https://issues.apache.org/jira/browse/SPARK-49839
Project: Spark
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/SPARK-51119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szehon Ho updated SPARK-51119:
--
Description:
Summary: Spark executors unnecessary contacts catalogs when resolving
EXISTS_DEFAULTS (u
Szehon Ho created SPARK-51119:
-
Summary: Readers on executors should not read catalogs resolving
EXISTS_DEFAULT
Key: SPARK-51119
URL: https://issues.apache.org/jira/browse/SPARK-51119
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-51119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szehon Ho updated SPARK-51119:
--
Summary: Readers on executors resolving EXISTS_DEFAULT should not call
catalogs (was: Readers on exec
[
https://issues.apache.org/jira/browse/SPARK-50593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szehon Ho updated SPARK-50593:
--
Description:
Truncate transform is not supported in SPJ.
Support was added for write distribution and
Szehon Ho created SPARK-50593:
-
Summary: SPJ: Support truncate transform
Key: SPARK-50593
URL: https://issues.apache.org/jira/browse/SPARK-50593
Project: Spark
Issue Type: Sub-task
Comp
[
https://issues.apache.org/jira/browse/SPARK-49839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szehon Ho updated SPARK-49839:
--
Parent: SPARK-48613
Issue Type: Sub-task (was: New Feature)
> SPJ: Skip shuffles if possible
Szehon Ho created SPARK-51222:
-
Summary: Optimize ReplaceCurrentLike rule
Key: SPARK-51222
URL: https://issues.apache.org/jira/browse/SPARK-51222
Project: Spark
Issue Type: Bug
Componen
Szehon Ho created SPARK-51615:
-
Summary: Refactor ShowNamespaces to use RunnableCommand
Key: SPARK-51615
URL: https://issues.apache.org/jira/browse/SPARK-51615
Project: Spark
Issue Type: New Feat
[
https://issues.apache.org/jira/browse/SPARK-51615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szehon Ho updated SPARK-51615:
--
Issue Type: Improvement (was: New Feature)
> Refactor ShowNamespaces to use RunnableCommand
> ---
[
https://issues.apache.org/jira/browse/SPARK-51350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szehon Ho updated SPARK-51350:
--
Description: As part of SPARK-44167 , implement Show Procedures to show all
stored procedures in the g
Szehon Ho created SPARK-51780:
-
Summary: Implement Describe Procedure
Key: SPARK-51780
URL: https://issues.apache.org/jira/browse/SPARK-51780
Project: Spark
Issue Type: New Feature
Comp
[
https://issues.apache.org/jira/browse/SPARK-51780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szehon Ho updated SPARK-51780:
--
Parent: SPARK-44167
Issue Type: Sub-task (was: New Feature)
> Implement Describe Procedure
>
Szehon Ho created SPARK-51906:
-
Summary: DSv2 expressions in Alter table add columns
Key: SPARK-51906
URL: https://issues.apache.org/jira/browse/SPARK-51906
Project: Spark
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/SPARK-51906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szehon Ho updated SPARK-51906:
--
Description: Similar to SPARK-51786 but for Alter table add column (was:
Similar to SPARK-51789 but f
[
https://issues.apache.org/jira/browse/SPARK-51350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szehon Ho updated SPARK-51350:
--
Summary: Implement Show Procedures (was: [SQL] Implement Show Procedures)
> Implement Show Procedures
Szehon Ho created SPARK-51350:
-
Summary: [SQL] Implement Show Procedures
Key: SPARK-51350
URL: https://issues.apache.org/jira/browse/SPARK-51350
Project: Spark
Issue Type: New Feature
C
Szehon Ho created SPARK-51208:
-
Summary: ColumnDefinition.toV1Column should preserve
EXISTS_DEFAULT resolution
Key: SPARK-51208
URL: https://issues.apache.org/jira/browse/SPARK-51208
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-51273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szehon Ho updated SPARK-51273:
--
Priority: Blocker (was: Major)
> Spark Connect Call Procedure runs the procedure twice
>
Szehon Ho created SPARK-51273:
-
Summary: Spark Connect Call Procedure runs the procedure twice
Key: SPARK-51273
URL: https://issues.apache.org/jira/browse/SPARK-51273
Project: Spark
Issue Type: B
Szehon Ho created SPARK-52029:
-
Summary: Support external field-id to column-name mapping for
Parquet
Key: SPARK-52029
URL: https://issues.apache.org/jira/browse/SPARK-52029
Project: Spark
Issue
Szehon Ho created SPARK-52095:
-
Summary: DSv2 expressions in Alter table Alter column
Key: SPARK-52095
URL: https://issues.apache.org/jira/browse/SPARK-52095
Project: Spark
Issue Type: New Featur
Szehon Ho created SPARK-52236:
-
Summary: Standardize analyze exceptions for default value
Key: SPARK-52236
URL: https://issues.apache.org/jira/browse/SPARK-52236
Project: Spark
Issue Type: Improv
Szehon Ho created SPARK-52235:
-
Summary: Add Implict cast for default value expression passed to
DSV2
Key: SPARK-52235
URL: https://issues.apache.org/jira/browse/SPARK-52235
Project: Spark
Issue
Szehon Ho created SPARK-52272:
-
Summary: HiveExternalCatalog alter table loses comment updates
Key: SPARK-52272
URL: https://issues.apache.org/jira/browse/SPARK-52272
Project: Spark
Issue Type: B
Szehon Ho created SPARK-52403:
-
Summary: Add numRowsCopied metric to MergeRowExec
Key: SPARK-52403
URL: https://issues.apache.org/jira/browse/SPARK-52403
Project: Spark
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/SPARK-52403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szehon Ho updated SPARK-52403:
--
Summary: Add numTargetRowsCopied metric to MergeRowExec (was: Add
numRowsCopied metric to MergeRowExe
Szehon Ho created SPARK-52417:
-
Summary: Simplify Table properties handling in View Schema
Evolution Mode
Key: SPARK-52417
URL: https://issues.apache.org/jira/browse/SPARK-52417
Project: Spark
I
[
https://issues.apache.org/jira/browse/SPARK-52417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szehon Ho updated SPARK-52417:
--
Description:
When a View is created, ex CREATE VIEW v (a1, a2) AS select c1, c2, it needs to
save bot
Szehon Ho created SPARK-52475:
-
Summary: Remove deprecated table.schema method from tests
Key: SPARK-52475
URL: https://issues.apache.org/jira/browse/SPARK-52475
Project: Spark
Issue Type: Test
65 matches
Mail list logo
