[
https://issues.apache.org/jira/browse/SPARK-35865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Baohe Zhang updated SPARK-35865:
Description:
SPARK-24355 introduces syncMode to mitigate the issue of sasl timeout by
throting
[
https://issues.apache.org/jira/browse/SPARK-35865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Baohe Zhang updated SPARK-35865:
Description:
SPARK-24355 introduces syncMode to mitigate the issue of sasl timeout by
throting
[
https://issues.apache.org/jira/browse/SPARK-35865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Baohe Zhang updated SPARK-35865:
Attachment: openblock-compare.png
> Remove await (syncMode) in ChunkFetchRequestHandler
>
Baohe Zhang created SPARK-35865:
---
Summary: Remove await (syncMode) in ChunkFetchRequestHandler
Key: SPARK-35865
URL: https://issues.apache.org/jira/browse/SPARK-35865
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-35865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Baohe Zhang updated SPARK-35865:
Attachment: openblock.png
> Remove await (syncMode) in ChunkFetchRequestHandler
>
Baohe Zhang created SPARK-35010:
---
Summary: nestedSchemaPruning causes issue when reading hive
generated Orc files
Key: SPARK-35010
URL: https://issues.apache.org/jira/browse/SPARK-35010
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-34779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17312498#comment-17312498
]
Baohe Zhang commented on SPARK-34779:
-
Thanks for pointing it out! I didn't aware that task peak
[
https://issues.apache.org/jira/browse/SPARK-34845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Baohe Zhang updated SPARK-34845:
Description:
When the procfs metrics of some child pids are unavailable,
[
https://issues.apache.org/jira/browse/SPARK-34845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Baohe Zhang updated SPARK-34845:
Description:
When the procfs metrics of some child pids are unavailable,
[
https://issues.apache.org/jira/browse/SPARK-34845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Baohe Zhang updated SPARK-34845:
Description:
When the procfs metrics of some child pids are unavailable,
[
https://issues.apache.org/jira/browse/SPARK-34845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Baohe Zhang updated SPARK-34845:
Description:
When the procfs metrics of some child pids are unavailable,
Baohe Zhang created SPARK-34845:
---
Summary: ProcfsMetricsGetter.computeAllMetrics shouldn't return
partial metrics when some of child pids metrics are missing
Key: SPARK-34845
URL:
Baohe Zhang created SPARK-34779:
---
Summary: ExecutoMetricsPoller should keep stage entry in stageTCMP
until a heartbeat occurs
Key: SPARK-34779
URL: https://issues.apache.org/jira/browse/SPARK-34779
[
https://issues.apache.org/jira/browse/SPARK-32924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17295639#comment-17295639
]
Baohe Zhang commented on SPARK-32924:
-
[~dongjoon] This is my Jira id.
> Web UI sort on duration is
[
https://issues.apache.org/jira/browse/SPARK-34545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291954#comment-17291954
]
Baohe Zhang commented on SPARK-34545:
-
A simpler code to reproduce the error:
{code:python}
>>> from
[
https://issues.apache.org/jira/browse/SPARK-34545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291896#comment-17291896
]
Baohe Zhang commented on SPARK-34545:
-
This is a correctness bug, so I would like to raise the
[
https://issues.apache.org/jira/browse/SPARK-34545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Baohe Zhang updated SPARK-34545:
Priority: Blocker (was: Critical)
> PySpark Python UDF return inconsistent results when applying
[
https://issues.apache.org/jira/browse/SPARK-34545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Baohe Zhang updated SPARK-34545:
Summary: PySpark Python UDF return inconsistent results when applying 2
UDFs with different
[
https://issues.apache.org/jira/browse/SPARK-34545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Baohe Zhang updated SPARK-34545:
Description:
Python UDF returns inconsistent results between evaluating 2 columns together
and
Baohe Zhang created SPARK-34545:
---
Summary: PySpark Python UDF return inconsistent results when
applying UDFs to 2 columns together
Key: SPARK-34545
URL: https://issues.apache.org/jira/browse/SPARK-34545
[
https://issues.apache.org/jira/browse/SPARK-34545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Baohe Zhang updated SPARK-34545:
Priority: Critical (was: Major)
> PySpark Python UDF return inconsistent results when applying
[
https://issues.apache.org/jira/browse/SPARK-34545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Baohe Zhang updated SPARK-34545:
Component/s: SQL
> PySpark Python UDF return inconsistent results when applying UDFs to 2
>
[
https://issues.apache.org/jira/browse/SPARK-34545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Baohe Zhang updated SPARK-34545:
Description:
Python UDF returns inconsistent results between evaluating 2 columns together
and
[
https://issues.apache.org/jira/browse/SPARK-34336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277485#comment-17277485
]
Baohe Zhang commented on SPARK-34336:
-
Full benchmark results are added as txt attachments.
> Use
[
https://issues.apache.org/jira/browse/SPARK-34336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Baohe Zhang updated SPARK-34336:
Attachment: generic_data_read.txt
> Use GenericData as Avro serialization data model can improve
[
https://issues.apache.org/jira/browse/SPARK-34336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Baohe Zhang updated SPARK-34336:
Attachment: base_read.txt
> Use GenericData as Avro serialization data model can improve Avro
[
https://issues.apache.org/jira/browse/SPARK-34336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Baohe Zhang updated SPARK-34336:
Attachment: generic_data_write.txt
> Use GenericData as Avro serialization data model can improve
[
https://issues.apache.org/jira/browse/SPARK-34336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Baohe Zhang updated SPARK-34336:
Attachment: read_comparison.png
> Use GenericData as Avro serialization data model can improve
[
https://issues.apache.org/jira/browse/SPARK-34336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277483#comment-17277483
]
Baohe Zhang commented on SPARK-34336:
-
Column chart comparison on avg time:
Avro write:
[
https://issues.apache.org/jira/browse/SPARK-34336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Baohe Zhang updated SPARK-34336:
Attachment: base_write.txt
> Use GenericData as Avro serialization data model can improve Avro
[
https://issues.apache.org/jira/browse/SPARK-34336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Baohe Zhang updated SPARK-34336:
Attachment: write_comparison.png
> Use GenericData as Avro serialization data model can improve
Baohe Zhang created SPARK-34336:
---
Summary: Use GenericData as Avro serialization data model can
improve Avro write/read performance
Key: SPARK-34336
URL: https://issues.apache.org/jira/browse/SPARK-34336
[
https://issues.apache.org/jira/browse/SPARK-33031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255685#comment-17255685
]
Baohe Zhang commented on SPARK-33031:
-
New tasks won't be scheduled because the node is marked as
[
https://issues.apache.org/jira/browse/SPARK-33029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255682#comment-17255682
]
Baohe Zhang commented on SPARK-33029:
-
With the blacklist feature enabled, by default, a node will
[
https://issues.apache.org/jira/browse/SPARK-33906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254669#comment-17254669
]
Baohe Zhang commented on SPARK-33906:
-
The more underlay reason seems to be that the stage complete
[
https://issues.apache.org/jira/browse/SPARK-33906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254668#comment-17254668
]
Baohe Zhang commented on SPARK-33906:
-
[~dongjoon] Yes.
> SPARK UI Executors page stuck when
[
https://issues.apache.org/jira/browse/SPARK-33906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Baohe Zhang updated SPARK-33906:
Description:
How to reproduce it?
In mac OS standalone mode, open a spark-shell and run
[
https://issues.apache.org/jira/browse/SPARK-33906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254647#comment-17254647
]
Baohe Zhang commented on SPARK-33906:
-
I will put a PR soon.
> SPARK UI Executors page stuck when
[
https://issues.apache.org/jira/browse/SPARK-33906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Baohe Zhang updated SPARK-33906:
Description:
How to reproduce it?
In mac OS standalone mode, open a spark-shell and run
[
https://issues.apache.org/jira/browse/SPARK-33906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Baohe Zhang updated SPARK-33906:
Attachment: executor-page.png
> SPARK UI Executors page stuck when
Baohe Zhang created SPARK-33906:
---
Summary: SPARK UI Executors page stuck when
ExecutorSummary.peakMemoryMetrics is unset
Key: SPARK-33906
URL: https://issues.apache.org/jira/browse/SPARK-33906
Project:
[
https://issues.apache.org/jira/browse/SPARK-26399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17244341#comment-17244341
]
Baohe Zhang commented on SPARK-26399:
-
Seems the work of this ticket is already done by
Baohe Zhang created SPARK-33215:
---
Summary: Speed up event log download by skipping UI rebuild
Key: SPARK-33215
URL: https://issues.apache.org/jira/browse/SPARK-33215
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-32350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Baohe Zhang updated SPARK-32350:
Description:
The idea is to improve the performance of HybridStore by adding batch write
support
Baohe Zhang created SPARK-32350:
---
Summary: Add batch write support on LevelDB to improve performance
of HybridStore
Key: SPARK-32350
URL: https://issues.apache.org/jira/browse/SPARK-32350
Project:
Baohe Zhang created SPARK-31664:
---
Summary: Race in YARN scheduler shutdown leads to uncaught
SparkException "Could not find CoarseGrainedScheduler"
Key: SPARK-31664
URL:
[
https://issues.apache.org/jira/browse/SPARK-31608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Baohe Zhang updated SPARK-31608:
Description:
This is a follow-up for the work done by Hieu Huynh in 2019.
Add a new class
[
https://issues.apache.org/jira/browse/SPARK-31608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Baohe Zhang updated SPARK-31608:
Description:
This is a follow-up for the work done by Hieu Huynh in 2019.
Add a new class
Baohe Zhang created SPARK-31608:
---
Summary: Add a hybrid KVStore to make UI loading faster
Key: SPARK-31608
URL: https://issues.apache.org/jira/browse/SPARK-31608
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-31584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Baohe Zhang updated SPARK-31584:
Attachment: errorstack.txt
> NullPointerException when parsing event log with InMemoryStore
>
Baohe Zhang created SPARK-31584:
---
Summary: NullPointerException when parsing event log with
InMemoryStore
Key: SPARK-31584
URL: https://issues.apache.org/jira/browse/SPARK-31584
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-31380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17084431#comment-17084431
]
Baohe Zhang commented on SPARK-31380:
-
Did you run your application with Spark 3? I tested it in my
[
https://issues.apache.org/jira/browse/SPARK-31380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Baohe Zhang updated SPARK-31380:
Attachment: image-2020-04-15-18-16-18-254.png
> Peak Execution Memory Quantile is not displayed
53 matches
Mail list logo
