[
https://issues.apache.org/jira/browse/SPARK-27021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27021:
Assignee: Apache Spark
> Leaking Netty event loop group for shuffle chunk fetch requests
[
https://issues.apache.org/jira/browse/SPARK-27021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27021:
Assignee: (was: Apache Spark)
> Leaking Netty event loop group for shuffle chunk
[
https://issues.apache.org/jira/browse/SPARK-27021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Zsolt Piros updated SPARK-27021:
---
Summary: Netty related thread leaks () (was: Netty related thread leaks)
> Netty
[
https://issues.apache.org/jira/browse/SPARK-27021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Zsolt Piros updated SPARK-27021:
---
Summary: Leaking Netty event loop group for shuffle chunk fetch requests
(was:
[
https://issues.apache.org/jira/browse/SPARK-27021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Zsolt Piros updated SPARK-27021:
---
Summary: Netty related thread leaks (event loop group for shuffle chunk
fetch
[
https://issues.apache.org/jira/browse/SPARK-26346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781953#comment-16781953
]
Xinli Shang commented on SPARK-26346:
-
+1, [~yumwang] , Is there any pre-testing done on RC4 or RC3?
[
https://issues.apache.org/jira/browse/SPARK-26967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-26967.
---
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 23869
[
https://issues.apache.org/jira/browse/SPARK-26967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen reassigned SPARK-26967:
-
Assignee: SongYadong
> Put MetricsSystem instance names together for clearer management
>
[
https://issues.apache.org/jira/browse/SPARK-26839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781903#comment-16781903
]
Sean Owen commented on SPARK-26839:
---
Just sharing where I have gotten to with this as well:
I think we
[
https://issues.apache.org/jira/browse/SPARK-24295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781879#comment-16781879
]
Iqbal Singh commented on SPARK-24295:
-
Agree, [~kabhwan]. It's very tricky to purge metadata as it
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781826#comment-16781826
]
shahid edited comment on SPARK-27019 at 3/1/19 4:11 PM:
Yes. The issue happened
Erik van Oosten created SPARK-27025:
---
Summary: Speed up toLocalIterator
Key: SPARK-27025
URL: https://issues.apache.org/jira/browse/SPARK-27025
Project: Spark
Issue Type: Wish
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781826#comment-16781826
]
shahid commented on SPARK-27019:
Yes. The issue happened because of the event reordering when the query
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shahid updated SPARK-27019:
---
Attachment: Screenshot from 2019-03-01 21-31-48.png
> Spark UI's SQL tab shows inconsistent values
>
[
https://issues.apache.org/jira/browse/SPARK-27022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27022:
Assignee: Apache Spark
> Kafka delegation token support
> --
[
https://issues.apache.org/jira/browse/SPARK-27022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27022:
Assignee: (was: Apache Spark)
> Kafka delegation token support
>
[
https://issues.apache.org/jira/browse/SPARK-27024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781734#comment-16781734
]
Thomas Graves commented on SPARK-27024:
---
I will be looking at this and propose a design.
> Design
Xingbo Jiang created SPARK-27024:
Summary: Design executor interface to support GPU resources
Key: SPARK-27024
URL: https://issues.apache.org/jira/browse/SPARK-27024
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-26969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781731#comment-16781731
]
ABHISHEK KUMAR GUPTA commented on SPARK-26969:
--
ODBC INSTALLATION
Follow Below Steps :
1.
[
https://issues.apache.org/jira/browse/SPARK-27005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781728#comment-16781728
]
Thomas Graves commented on SPARK-27005:
---
It seems like we are mixing gpu's as static resource vs
[
https://issues.apache.org/jira/browse/SPARK-27023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27023:
Assignee: Apache Spark
> Kubernetes client timeouts should be configurable
>
[
https://issues.apache.org/jira/browse/SPARK-27023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27023:
Assignee: (was: Apache Spark)
> Kubernetes client timeouts should be configurable
>
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
peay updated SPARK-27019:
-
Attachment: application_1550040445209_4748
> Spark UI's SQL tab shows inconsistent values
>
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781718#comment-16781718
]
peay commented on SPARK-27019:
--
Attached: [^application_1550040445209_4748]
> Spark UI's SQL tab shows
Gabor Somogyi created SPARK-27022:
-
Summary: Kafka delegation token support
Key: SPARK-27022
URL: https://issues.apache.org/jira/browse/SPARK-27022
Project: Spark
Issue Type: Improvement
Onur Satici created SPARK-27023:
---
Summary: Kubernetes client timeouts should be configurable
Key: SPARK-27023
URL: https://issues.apache.org/jira/browse/SPARK-27023
Project: Spark
Issue Type:
Attila Zsolt Piros created SPARK-27021:
--
Summary: Netty related thread leaks
Key: SPARK-27021
URL: https://issues.apache.org/jira/browse/SPARK-27021
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-27021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781707#comment-16781707
]
Attila Zsolt Piros commented on SPARK-27021:
I am already working on it.
> Netty related
[
https://issues.apache.org/jira/browse/SPARK-27020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781697#comment-16781697
]
Yuming Wang commented on SPARK-27020:
-
cc @[~hyukjin.kwon]
> Unable to insert data with partial
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781670#comment-16781670
]
shahid commented on SPARK-27019:
seems event reordering has happened. Job start event came after sql
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781670#comment-16781670
]
shahid edited comment on SPARK-27019 at 3/1/19 1:33 PM:
seems event reordering
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781670#comment-16781670
]
shahid edited comment on SPARK-27019 at 3/1/19 1:29 PM:
seems event reordering
[
https://issues.apache.org/jira/browse/SPARK-27018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781657#comment-16781657
]
Marco Gaido commented on SPARK-27018:
-
First the issue is fixed on master and then it is backported
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781651#comment-16781651
]
peay edited comment on SPARK-27019 at 3/1/19 1:06 PM:
--
Sure does.
I've done one
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781651#comment-16781651
]
peay commented on SPARK-27019:
--
Sure does.
I've done one more test, using no executors and running the
[
https://issues.apache.org/jira/browse/SPARK-27018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781640#comment-16781640
]
Piotr Kołaczkowski commented on SPARK-27018:
For master only? Why not for 2.2, 2.3, master?
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781638#comment-16781638
]
Jungtaek Lim commented on SPARK-27019:
--
Submitted date feels me as "-1", as UNIX epoch 0 represents
[
https://issues.apache.org/jira/browse/SPARK-26176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781607#comment-16781607
]
Denes Gerencser commented on SPARK-26176:
-
Hi,
I think this ticket is not valid any more as
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
peay updated SPARK-27019:
-
Attachment: query-job-1.png
query-1-details.png
query-1-list.png
> Spark UI's
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shahid updated SPARK-27019:
---
Comment: was deleted
(was: Seems event reordering has happened. ie. JobStart event came after
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781606#comment-16781606
]
shahid commented on SPARK-27019:
Seems event reordering has happened. ie. JobStart event came after
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781604#comment-16781604
]
peay commented on SPARK-27019:
--
OK, I can actually reproduce it pretty easily with pyspark:
{code:java}
Truong Duc Kien created SPARK-27020:
---
Summary: Unable to insert data with partial dynamic partition with
Spark & Hive 3
Key: SPARK-27020
URL: https://issues.apache.org/jira/browse/SPARK-27020
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781595#comment-16781595
]
peay commented on SPARK-27019:
--
I don't really have a minimal example - this uses a bunch of python jobs
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781595#comment-16781595
]
peay edited comment on SPARK-27019 at 3/1/19 11:40 AM:
---
I don't really have a
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781588#comment-16781588
]
shahid commented on SPARK-27019:
Hi [~peay] Could you please add test to reproduce it?
> Spark UI's SQL
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781583#comment-16781583
]
peay commented on SPARK-27019:
--
Also seeing this both for the Spark UI for live jobs, and when accessing
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
peay updated SPARK-27019:
-
Description:
Since 2.4.0, I am frequently seeing broken outputs in the SQL tab of the Spark
UI, where
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781581#comment-16781581
]
peay edited comment on SPARK-27019 at 3/1/19 11:10 AM:
---
Seems like the screenshots
[
https://issues.apache.org/jira/browse/SPARK-26727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781582#comment-16781582
]
Udbhav Agrawal commented on SPARK-26727:
works fine for me, cannot reproduce it
> CREATE OR
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
peay updated SPARK-27019:
-
Attachment: screenshot-spark-ui-list.png
screenshot-spark-ui-details.png
> Spark UI's SQL tab
[
https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781581#comment-16781581
]
peay commented on SPARK-27019:
--
Seems like the screenshot did not embed, attaching them instead.
> Spark
peay created SPARK-27019:
Summary: Spark UI's SQL tab shows inconsistent values
Key: SPARK-27019
URL: https://issues.apache.org/jira/browse/SPARK-27019
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-26872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-26872:
Assignee: Apache Spark
> Use a configurable value for final termination in the
[
https://issues.apache.org/jira/browse/SPARK-26872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-26872:
Assignee: (was: Apache Spark)
> Use a configurable value for final termination in
[
https://issues.apache.org/jira/browse/SPARK-27018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781558#comment-16781558
]
Marco Gaido commented on SPARK-27018:
-
[~pkolaczk] thanks for reporting the issue. Spark works with
[
https://issues.apache.org/jira/browse/SPARK-26815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781556#comment-16781556
]
Yuming Wang commented on SPARK-26815:
-
I thinks it's your environment issue. It works for me:
[
https://issues.apache.org/jira/browse/SPARK-26815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuming Wang updated SPARK-26815:
Attachment: image-2019-03-01-18-38-18-173.png
> run command "Spark-shell --proxy-user " failed in
[
https://issues.apache.org/jira/browse/SPARK-27018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Piotr Kołaczkowski updated SPARK-27018:
---
Affects Version/s: 2.2.3
> Checkpointed RDD deleted prematurely when using
[
https://issues.apache.org/jira/browse/SPARK-27018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Piotr Kołaczkowski updated SPARK-27018:
---
Affects Version/s: 2.3.3
> Checkpointed RDD deleted prematurely when using
[
https://issues.apache.org/jira/browse/SPARK-27018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781501#comment-16781501
]
Piotr Kołaczkowski commented on SPARK-27018:
Atached patch for Spark 2.2.2. Should be
[
https://issues.apache.org/jira/browse/SPARK-27018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781501#comment-16781501
]
Piotr Kołaczkowski edited comment on SPARK-27018 at 3/1/19 9:32 AM:
[
https://issues.apache.org/jira/browse/SPARK-27018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Piotr Kołaczkowski updated SPARK-27018:
---
Attachment:
[
https://issues.apache.org/jira/browse/SPARK-26991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781487#comment-16781487
]
Jungtaek Lim commented on SPARK-26991:
--
This issue could be extended to investigate the difference
[
https://issues.apache.org/jira/browse/SPARK-27018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781492#comment-16781492
]
Piotr Kołaczkowski commented on SPARK-27018:
PeriodicCheckpointer:
{noformat}
// Remove
[
https://issues.apache.org/jira/browse/SPARK-27018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781481#comment-16781481
]
Piotr Kołaczkowski edited comment on SPARK-27018 at 3/1/19 9:04 AM:
[
https://issues.apache.org/jira/browse/SPARK-27018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781481#comment-16781481
]
Piotr Kołaczkowski commented on SPARK-27018:
The checkpoint is deleted here (stacktrace):
[
https://issues.apache.org/jira/browse/SPARK-26388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780365#comment-16780365
]
nivedita singh edited comment on SPARK-26388 at 3/1/19 8:45 AM:
I even
[
https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781458#comment-16781458
]
Jungtaek Lim commented on SPARK-26961:
--
Which distribution of Spark are you using? Specifically the
Piotr Kołaczkowski created SPARK-27018:
--
Summary: Checkpointed RDD deleted prematurely when using
GBTClassifier
Key: SPARK-27018
URL: https://issues.apache.org/jira/browse/SPARK-27018
Project:
101 - 170 of 170 matches
Mail list logo