[
https://issues.apache.org/jira/browse/SPARK-49982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ziqi Liu updated SPARK-49982:
-
Description:
When we use a cached an AQE plan, it will do `cachedPlan.execute` to build the
RDD, which
Ziqi Liu created SPARK-49982:
Summary: Negative AQE caching in SQL cache
Key: SPARK-49982
URL: https://issues.apache.org/jira/browse/SPARK-49982
Project: Spark
Issue Type: Bug
Component
Ziqi Liu created SPARK-49979:
Summary: AQE hang forever when collecting twice on a failed plan
Key: SPARK-49979
URL: https://issues.apache.org/jira/browse/SPARK-49979
Project: Spark
Issue Type: B
Ziqi Liu created SPARK-49852:
Summary: Fix deadlock between shuffle dependency initialization
and explain string generation
Key: SPARK-49852
URL: https://issues.apache.org/jira/browse/SPARK-49852
Project:
[
https://issues.apache.org/jira/browse/SPARK-49460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ziqi Liu updated SPARK-49460:
-
Affects Version/s: (was: 3.5.2)
(was: 3.5.3)
> NPE error in EmptyRelation
[
https://issues.apache.org/jira/browse/SPARK-49460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ziqi Liu updated SPARK-49460:
-
Description:
This bug was introduced in [https://github.com/apache/spark/pull/46830] :
*{{cleanupResour
[
https://issues.apache.org/jira/browse/SPARK-49460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ziqi Liu updated SPARK-49460:
-
Description:
This bug was introduced in [https://github.com/apache/spark/pull/46830] where
it wrongly a
Ziqi Liu created SPARK-49460:
Summary: NPE error in EmptyRelationExec.cleanupResources()
Key: SPARK-49460
URL: https://issues.apache.org/jira/browse/SPARK-49460
Project: Spark
Issue Type: Improve
[
https://issues.apache.org/jira/browse/SPARK-49460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ziqi Liu updated SPARK-49460:
-
Issue Type: Bug (was: Improvement)
> NPE error in EmptyRelationExec.cleanupResources()
> --
[
https://issues.apache.org/jira/browse/SPARK-48628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ziqi Liu updated SPARK-48628:
-
Description:
Currently there is no task on/off heap execution memory metrics. There is a
[peakExecution
Ziqi Liu created SPARK-48788:
Summary: Accumulate task-level execution memory in stage and
display in Spark UI
Key: SPARK-48788
URL: https://issues.apache.org/jira/browse/SPARK-48788
Project: Spark
Ziqi Liu created SPARK-48628:
Summary: Add task peak on/off heap execution memory metrics
Key: SPARK-48628
URL: https://issues.apache.org/jira/browse/SPARK-48628
Project: Spark
Issue Type: Improv
Ziqi Liu created SPARK-48610:
Summary: Remove ExplainUtils.processPlan synchronize
Key: SPARK-48610
URL: https://issues.apache.org/jira/browse/SPARK-48610
Project: Spark
Issue Type: Improvement
Ziqi Liu created SPARK-48468:
Summary: Add LogicalQueryStage interface in catalyst
Key: SPARK-48468
URL: https://issues.apache.org/jira/browse/SPARK-48468
Project: Spark
Issue Type: Improvement
Ziqi Liu created SPARK-48465:
Summary: Avoid no-op empty relation propagation in AQE
Key: SPARK-48465
URL: https://issues.apache.org/jira/browse/SPARK-48465
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-47177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ziqi Liu updated SPARK-47177:
-
Description:
AQE plan is expected to display final plan after execution. This is not true
for cached SQ
[
https://issues.apache.org/jira/browse/SPARK-47177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ziqi Liu updated SPARK-47177:
-
Description:
AQE plan is expected to display final plan after execution. This is not true
for cached SQ
[
https://issues.apache.org/jira/browse/SPARK-47177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ziqi Liu updated SPARK-47177:
-
Description:
AQE plan is expected to display final plan after execution. This is not true
for cached SQ
[
https://issues.apache.org/jira/browse/SPARK-47177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ziqi Liu updated SPARK-47177:
-
Description:
AQE plan is expected to display final plan after execution. This is not true
for cached SQ
Ziqi Liu created SPARK-47177:
Summary: Cached SQL plan do not display final AQE plan in explain
string
Key: SPARK-47177
URL: https://issues.apache.org/jira/browse/SPARK-47177
Project: Spark
Issu
[
https://issues.apache.org/jira/browse/SPARK-46995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ziqi Liu updated SPARK-46995:
-
Component/s: SQL
> Allow AQE coalesce final stage in SQL cached plan
> -
Ziqi Liu created SPARK-46995:
Summary: Allow AQE coalesce final stage in SQL cached plan
Key: SPARK-46995
URL: https://issues.apache.org/jira/browse/SPARK-46995
Project: Spark
Issue Type: Improve
Ziqi Liu created SPARK-44485:
Summary: optimize generateTreeString code path
Key: SPARK-44485
URL: https://issues.apache.org/jira/browse/SPARK-44485
Project: Spark
Issue Type: Improvement
Ziqi Liu created SPARK-43300:
Summary: Cascade failure in Guava cache due to fate-sharing
Key: SPARK-43300
URL: https://issues.apache.org/jira/browse/SPARK-43300
Project: Spark
Issue Type: Bug
Ziqi Liu created SPARK-42980:
Summary: SmallBroadcast
Key: SPARK-42980
URL: https://issues.apache.org/jira/browse/SPARK-42980
Project: Spark
Issue Type: New Feature
Components: Spark Co
[
https://issues.apache.org/jira/browse/SPARK-42980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ziqi Liu updated SPARK-42980:
-
Summary: lightweight Broadcast implementation (was: SmallBroadcast)
> lightweight Broadcast implementat
[
https://issues.apache.org/jira/browse/SPARK-40622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ziqi Liu updated SPARK-40622:
-
Description:
when collecting results, data from single partition/task is serialized through
byte array
Ziqi Liu created SPARK-40622:
Summary: Result of a single task in collect() must fit in 2GB
Key: SPARK-40622
URL: https://issues.apache.org/jira/browse/SPARK-40622
Project: Spark
Issue Type: Bug
Ziqi Liu created SPARK-40418:
Summary: Increase default initialNumPartitions to 10
Key: SPARK-40418
URL: https://issues.apache.org/jira/browse/SPARK-40418
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-40261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ziqi Liu updated SPARK-40261:
-
Summary: DirectTaskResult meta should not be counted into result size
(was: TaskResult meta should not
[
https://issues.apache.org/jira/browse/SPARK-40261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ziqi Liu updated SPARK-40261:
-
Description:
This issue exists for a long time (since
[https://github.com/liuzqt/spark/commit/c33e55008
Ziqi Liu created SPARK-40261:
Summary: TaskResult meta should not be counted into result size
Key: SPARK-40261
URL: https://issues.apache.org/jira/browse/SPARK-40261
Project: Spark
Issue Type: Bu
Ziqi Liu created SPARK-40238:
Summary: support scaleUpFactor and initialNumPartition in pyspark
rdd API
Key: SPARK-40238
URL: https://issues.apache.org/jira/browse/SPARK-40238
Project: Spark
Iss
[
https://issues.apache.org/jira/browse/SPARK-40221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17585191#comment-17585191
]
Ziqi Liu commented on SPARK-40221:
--
[~hyukjin.kwon] I think running in master should a
[
https://issues.apache.org/jira/browse/SPARK-40221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ziqi Liu updated SPARK-40221:
-
Description:
I'm following the guidance in [https://spark.apache.org/developer-tools.html]
using
{code
Ziqi Liu created SPARK-40221:
Summary: Not able to format using scalafmt
Key: SPARK-40221
URL: https://issues.apache.org/jira/browse/SPARK-40221
Project: Spark
Issue Type: Question
Comp
[
https://issues.apache.org/jira/browse/SPARK-40211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17584458#comment-17584458
]
Ziqi Liu commented on SPARK-40211:
--
I'm actively working on this
> Allow executeTake()
Ziqi Liu created SPARK-40211:
Summary: Allow executeTake() / collectLimit's number of starting
partitions to be customized
Key: SPARK-40211
URL: https://issues.apache.org/jira/browse/SPARK-40211
Project:
38 matches
Mail list logo
