Carson Wang created SPARK-28356:
---
Summary: Do not reduce the number of partitions for repartition in
adaptive execution
Key: SPARK-28356
URL: https://issues.apache.org/jira/browse/SPARK-28356
Project:
Carson Wang created SPARK-28339:
---
Summary: Rename Spark SQL adaptive execution configuration name
Key: SPARK-28339
URL: https://issues.apache.org/jira/browse/SPARK-28339
Project: Spark
Issue
Carson Wang created SPARK-28177:
---
Summary: Adjust post shuffle partition number in adaptive execution
Key: SPARK-28177
URL: https://issues.apache.org/jira/browse/SPARK-28177
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-25299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Carson Wang updated SPARK-25299:
Comment: was deleted
(was: I am on a vacation and will be back on January 2, 2019. Please expect
[
https://issues.apache.org/jira/browse/SPARK-25299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16729294#comment-16729294
]
Carson Wang commented on SPARK-25299:
-
I am on a vacation and will be back on January 2, 2019.
[
https://issues.apache.org/jira/browse/SPARK-9850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16561326#comment-16561326
]
Carson Wang commented on SPARK-9850:
We have a new proposal and implementation for Spark SQL adaptive
[
https://issues.apache.org/jira/browse/SPARK-23128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16556961#comment-16556961
]
Carson Wang commented on SPARK-23128:
-
Thanks [~tgraves] very much. I'll follow this and post it to
[
https://issues.apache.org/jira/browse/SPARK-23128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16553700#comment-16553700
]
Carson Wang commented on SPARK-23128:
-
[~tgraves], We have split the code into 7 PRs based on Spark
[
https://issues.apache.org/jira/browse/SPARK-23128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Carson Wang updated SPARK-23128:
Affects Version/s: (was: 2.2.1)
2.3.0
> A new approach to do adaptive
[
https://issues.apache.org/jira/browse/SPARK-23128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Carson Wang updated SPARK-23128:
Description:
SPARK-9850 proposed the basic idea of adaptive execution in Spark. In
DAGScheduler,
[
https://issues.apache.org/jira/browse/SPARK-23128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Carson Wang updated SPARK-23128:
Summary: A new approach to do adaptive execution in Spark SQL (was:
Introduce QueryStage to
Carson Wang created SPARK-23128:
---
Summary: Introduce QueryStage to improve adaptive execution in
Spark SQL
Key: SPARK-23128
URL: https://issues.apache.org/jira/browse/SPARK-23128
Project: Spark
Carson Wang created SPARK-22681:
---
Summary: Accumulator should only be updated once for each task in
result stage
Key: SPARK-22681
URL: https://issues.apache.org/jira/browse/SPARK-22681
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-9860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094076#comment-16094076
]
Carson Wang commented on SPARK-9860:
We are working on this and also improving the current
Carson Wang created SPARK-20222:
---
Summary: No Spark SQL UI when executing queries in Spark SQL CLI
Key: SPARK-20222
URL: https://issues.apache.org/jira/browse/SPARK-20222
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-19674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Carson Wang updated SPARK-19674:
Description: In SQLListener.getExecutionMetrics, driver accumulator updates
don't belong to the
[
https://issues.apache.org/jira/browse/SPARK-19674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Carson Wang updated SPARK-19674:
Summary: Ignore driver accumulator updates don't belong to the execution
when merging all
[
https://issues.apache.org/jira/browse/SPARK-19674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Carson Wang updated SPARK-19674:
Summary: Ignore non-existing driver accumulator updates when merging all
accumulator updates in
Carson Wang created SPARK-19674:
---
Summary: Ignore non-existing driver accumulator updates in
SQLListener
Key: SPARK-19674
URL: https://issues.apache.org/jira/browse/SPARK-19674
Project: Spark
Carson Wang created SPARK-19620:
---
Summary: Incorrect exchange coordinator Id in physical plan
Key: SPARK-19620
URL: https://issues.apache.org/jira/browse/SPARK-19620
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-16333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15367283#comment-15367283
]
Carson Wang commented on SPARK-16333:
-
This doesn't look like related to SPARK-11206 as this is
[
https://issues.apache.org/jira/browse/SPARK-14232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Carson Wang updated SPARK-14232:
Description:
The event timeline doesn't show on job page if an executor is removed with
multiple
Carson Wang created SPARK-14232:
---
Summary: Event timeline on job page doesn't show if an executor is
removed with multiple line reason
Key: SPARK-14232
URL: https://issues.apache.org/jira/browse/SPARK-14232
Carson Wang created SPARK-13889:
---
Summary: Integer overflow when calculating the max number of
executor failure
Key: SPARK-13889
URL: https://issues.apache.org/jira/browse/SPARK-13889
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-13185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Carson Wang updated SPARK-13185:
Summary: Improve the performance of DateTimeUtils by reusing Calendar
objects (was: Improve the
[
https://issues.apache.org/jira/browse/SPARK-13185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Carson Wang updated SPARK-13185:
Summary: Improve the performance of DateTimeUtils.StringToDate by reusing
Calendar objects (was:
Carson Wang created SPARK-13185:
---
Summary: Improve the performance of DateTimeUtils by reusing
TimeZone and Calendar objects
Key: SPARK-13185
URL: https://issues.apache.org/jira/browse/SPARK-13185
[
https://issues.apache.org/jira/browse/SPARK-13185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Carson Wang updated SPARK-13185:
Description: It is expensive to create java TimeZone and Calendar objects
in each method of
Carson Wang created SPARK-12690:
---
Summary: NullPointerException in UnsafeInMemorySorter.free()
Key: SPARK-12690
URL: https://issues.apache.org/jira/browse/SPARK-12690
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-12399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Carson Wang updated SPARK-12399:
Description:
I got an exception when accessing the below REST API with an unknown
application Id.
Carson Wang created SPARK-12399:
---
Summary: Display correct error message when accessing REST API
with an unknown app Id
Key: SPARK-12399
URL: https://issues.apache.org/jira/browse/SPARK-12399
Project:
[
https://issues.apache.org/jira/browse/SPARK-11206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029357#comment-15029357
]
Carson Wang commented on SPARK-11206:
-
Yes, this is being fixed by
[
https://issues.apache.org/jira/browse/SPARK-11206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021363#comment-15021363
]
Carson Wang commented on SPARK-11206:
-
To support SQL UI on the history server:
1. I added an
[
https://issues.apache.org/jira/browse/SPARK-11206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14973700#comment-14973700
]
Carson Wang commented on SPARK-11206:
-
For the live SQL UI, the SQLContext is responsible for
[
https://issues.apache.org/jira/browse/SPARK-11247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14968517#comment-14968517
]
Carson Wang commented on SPARK-11247:
-
You can set SPARK_MASTER_IP to your master's IP address in
Carson Wang created SPARK-11206:
---
Summary: Support SQL UI on the history server
Key: SPARK-11206
URL: https://issues.apache.org/jira/browse/SPARK-11206
Project: Spark
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/SPARK-11206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14964841#comment-14964841
]
Carson Wang commented on SPARK-11206:
-
I am working on this. I plan to add an onOtherEvent method to
Carson Wang created SPARK-11047:
---
Summary: Internal accumulators miss the internal flag when
replaying events in the history server
Key: SPARK-11047
URL: https://issues.apache.org/jira/browse/SPARK-11047
Carson Wang created SPARK-9809:
--
Summary: Task crashes because the internal accumulators are not
properly initialized
Key: SPARK-9809
URL: https://issues.apache.org/jira/browse/SPARK-9809
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Carson Wang updated SPARK-9809:
---
Description:
When a stage failed and another stage was resubmitted with only part of
partitions to
[
https://issues.apache.org/jira/browse/SPARK-9731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14661221#comment-14661221
]
Carson Wang commented on SPARK-9731:
This is related to SPARK-8881 and SPARK-9353
Carson Wang created SPARK-9731:
--
Summary: Standalone scheduling incorrect cores if
spark.executor.cores is not set
Key: SPARK-9731
URL: https://issues.apache.org/jira/browse/SPARK-9731
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643748#comment-14643748
]
Carson Wang commented on SPARK-8778:
I think this has been fixed by SPARK-9187. Can
[
https://issues.apache.org/jira/browse/SPARK-9187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Carson Wang updated SPARK-9187:
---
Attachment: TimeLineNegativeValue.png
Timeline view may show negative value for running tasks
Carson Wang created SPARK-9187:
--
Summary: Timeline view may show negative value for running tasks
Key: SPARK-9187
URL: https://issues.apache.org/jira/browse/SPARK-9187
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-8405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14631024#comment-14631024
]
Carson Wang commented on SPARK-8405:
I think we can improve the doc so users will know
Carson Wang created SPARK-8950:
--
Summary: Correct the calculation of SchedulerDelayTime in
StagePage
Key: SPARK-8950
URL: https://issues.apache.org/jira/browse/SPARK-8950
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-8405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605126#comment-14605126
]
Carson Wang commented on SPARK-8405:
Thank you very much, [~hshreedharan]
After I
[
https://issues.apache.org/jira/browse/SPARK-8372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14602405#comment-14602405
]
Carson Wang commented on SPARK-8372:
[~vanzin] The log path name may also end with an
[
https://issues.apache.org/jira/browse/SPARK-8405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589475#comment-14589475
]
Carson Wang commented on SPARK-8405:
I had some in progress works and here is the
Carson Wang created SPARK-8405:
--
Summary: Show executor logs on Web UI when Yarn log aggregation is
enabled
Key: SPARK-8405
URL: https://issues.apache.org/jira/browse/SPARK-8405
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-8405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Carson Wang updated SPARK-8405:
---
Attachment: SparkLogError.png
Show executor logs on Web UI when Yarn log aggregation is enabled
[
https://issues.apache.org/jira/browse/SPARK-8275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587360#comment-14587360
]
Carson Wang commented on SPARK-8275:
This seems to be the same issue to SPARK-7889
Carson Wang created SPARK-8372:
--
Summary: History server shows incorrect information for
application not started
Key: SPARK-8372
URL: https://issues.apache.org/jira/browse/SPARK-8372
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-8372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Carson Wang updated SPARK-8372:
---
Attachment: IncorrectAppInfo.png
History server shows incorrect information for application not
[
https://issues.apache.org/jira/browse/SPARK-8372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Carson Wang updated SPARK-8372:
---
Description: The history server may show an incorrect App ID for an
incomplete application like App
Carson Wang created SPARK-8098:
--
Summary: Show correct length of bytes on log page
Key: SPARK-8098
URL: https://issues.apache.org/jira/browse/SPARK-8098
Project: Spark
Issue Type: Bug
Carson Wang created SPARK-7864:
--
Summary: Clicking a job's DAG graph on Web UI kills the job as the
link is broken
Key: SPARK-7864
URL: https://issues.apache.org/jira/browse/SPARK-7864
Project: Spark
58 matches
Mail list logo
