[
https://issues.apache.org/jira/browse/SPARK-37980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17486654#comment-17486654
]
Prakhar Jain commented on SPARK-37980:
--
Thanks [~cloud_fan] [~lian cheng] for your input. Yes -
[
https://issues.apache.org/jira/browse/SPARK-37980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17482845#comment-17482845
]
Prakhar Jain edited comment on SPARK-37980 at 1/27/22, 2:55 AM:
[
https://issues.apache.org/jira/browse/SPARK-37980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17482845#comment-17482845
]
Prakhar Jain edited comment on SPARK-37980 at 1/27/22, 2:55 AM:
[
https://issues.apache.org/jira/browse/SPARK-37980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17482845#comment-17482845
]
Prakhar Jain commented on SPARK-37980:
--
[~cloud_fan] I did some more investigation on this. Looks
[
https://issues.apache.org/jira/browse/SPARK-37980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17482142#comment-17482142
]
Prakhar Jain edited comment on SPARK-37980 at 1/26/22, 1:58 AM:
Yeah -
[
https://issues.apache.org/jira/browse/SPARK-37980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17482142#comment-17482142
]
Prakhar Jain commented on SPARK-37980:
--
Yes - this needs implementation in the underlying
[
https://issues.apache.org/jira/browse/SPARK-37980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prakhar Jain updated SPARK-37980:
-
Description:
Spark recently added hidden metadata column support for File based datasources
as
[
https://issues.apache.org/jira/browse/SPARK-37980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prakhar Jain updated SPARK-37980:
-
Description:
Spark recently added hidden metadata column support for File based datasources
as
[
https://issues.apache.org/jira/browse/SPARK-37980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prakhar Jain updated SPARK-37980:
-
Summary: Extend METADATA column to support row indices for file based data
sources (was:
Prakhar Jain created SPARK-37980:
Summary: Extend METADATA column to support row indexes for file
based data sources
Key: SPARK-37980
URL: https://issues.apache.org/jira/browse/SPARK-37980
Project:
[
https://issues.apache.org/jira/browse/SPARK-33758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prakhar Jain updated SPARK-33758:
-
Description:
Consider the query:
{noformat}
val planned = sql(
"""
|
Prakhar Jain created SPARK-33758:
Summary: Prune unnecessary output partitioning when the attribute
is not part of output.
Key: SPARK-33758
URL: https://issues.apache.org/jira/browse/SPARK-33758
[
https://issues.apache.org/jira/browse/SPARK-33486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prakhar Jain updated SPARK-33486:
-
Issue Type: Improvement (was: Task)
> Collapse Partial and Final Aggregation into Complete
[
https://issues.apache.org/jira/browse/SPARK-33486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239574#comment-17239574
]
Prakhar Jain commented on SPARK-33486:
--
[~dongjoon] Sure. Updating the Issue Type to Improvement.
Prakhar Jain created SPARK-33503:
Summary: Refactor SortOrder class to allow multiple childrens
Key: SPARK-33503
URL: https://issues.apache.org/jira/browse/SPARK-33503
Project: Spark
Issue
Prakhar Jain created SPARK-33486:
Summary: Collapse Partial and Final Aggregation into Complete
Aggregation mode
Key: SPARK-33486
URL: https://issues.apache.org/jira/browse/SPARK-33486
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-33400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prakhar Jain updated SPARK-33400:
-
Summary: Normalize sameOrderExpressions in SortOrder (was: Reduce unneeded
sorts between two
[
https://issues.apache.org/jira/browse/SPARK-33399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prakhar Jain updated SPARK-33399:
-
Summary: Normalize output partitioning and sortorder with respect to
aliases to avoid unneeded
Prakhar Jain created SPARK-33400:
Summary: Reduce unneeded sorts between two SortMergeJoins
Key: SPARK-33400
URL: https://issues.apache.org/jira/browse/SPARK-33400
Project: Spark
Issue Type:
Prakhar Jain created SPARK-33399:
Summary: Reduce unneeded exchanges after SortMerge joins
Key: SPARK-33399
URL: https://issues.apache.org/jira/browse/SPARK-33399
Project: Spark
Issue Type:
Prakhar Jain created SPARK-32509:
Summary: Unused DPP Filter causes issue in canonicalization and
prevents reuse exchange
Key: SPARK-32509
URL: https://issues.apache.org/jira/browse/SPARK-32509
Prakhar Jain created SPARK-32041:
Summary: Exchange reuse won't work in cases when DPP, subqueries
are involved
Key: SPARK-32041
URL: https://issues.apache.org/jira/browse/SPARK-32041
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-31810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prakhar Jain updated SPARK-31810:
-
Component/s: Tests
> Fix recoverPartitions test in DDLSuite
>
Prakhar Jain created SPARK-31810:
Summary: Fix recoverPartitions test in DDLSuite
Key: SPARK-31810
URL: https://issues.apache.org/jira/browse/SPARK-31810
Project: Spark
Issue Type: Bug
Prakhar Jain created SPARK-31618:
Summary: Pushdown Distinct through Join in IntersectDistinct based
on stats
Key: SPARK-31618
URL: https://issues.apache.org/jira/browse/SPARK-31618
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-30786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prakhar Jain updated SPARK-30786:
-
Component/s: Spark Core
> Block replication is not retried on other BlockManagers when it fails
[
https://issues.apache.org/jira/browse/SPARK-30786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17034210#comment-17034210
]
Prakhar Jain commented on SPARK-30786:
--
I am working on this.
> Block replication is not retried
Prakhar Jain created SPARK-30786:
Summary: Block replication is not retried on other BlockManagers
when it fails on 1 of the peers
Key: SPARK-30786
URL: https://issues.apache.org/jira/browse/SPARK-30786
[
https://issues.apache.org/jira/browse/SPARK-29938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prakhar Jain updated SPARK-29938:
-
Description:
When lot of new partitions are added by an Insert query on a partitioned
[
https://issues.apache.org/jira/browse/SPARK-29938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prakhar Jain updated SPARK-29938:
-
Description:
When lot of new partitions are added by an Insert query on a partitioned
Prakhar Jain created SPARK-29938:
Summary: Add batching in alter table add partition flow
Key: SPARK-29938
URL: https://issues.apache.org/jira/browse/SPARK-29938
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-21040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16974162#comment-16974162
]
Prakhar Jain commented on SPARK-21040:
--
Hi [~holden], At Microsoft, we are also facing same issues
32 matches
Mail list logo