[
https://issues.apache.org/jira/browse/SPARK-21065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17040456#comment-17040456
]
Artur Sukhenko commented on SPARK-21065:
[~zsxwing] Is `spark.streaming.concurrentJobs` still
[
https://issues.apache.org/jira/browse/SPARK-16709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Artur Sukhenko closed SPARK-16709.
--
Resolution: Duplicate
Fix Version/s: 1.6.2
> Task with commit failed will retry
[
https://issues.apache.org/jira/browse/SPARK-21593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109101#comment-16109101
]
Artur Sukhenko commented on SPARK-21593:
[~srowen] Yes, {code}
[
https://issues.apache.org/jira/browse/SPARK-21593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Artur Sukhenko updated SPARK-21593:
---
Description:
Latest configuration page for Spark 2.2.0 has broken menu list and named
[
https://issues.apache.org/jira/browse/SPARK-21593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16108966#comment-16108966
]
Artur Sukhenko commented on SPARK-21593:
Yes, as well as having {code}### Dynamic
[
https://issues.apache.org/jira/browse/SPARK-21593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Artur Sukhenko updated SPARK-21593:
---
Description:
Latest configuration page for Spark 2.2.0 has broken menu list and named
[
https://issues.apache.org/jira/browse/SPARK-21593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Artur Sukhenko updated SPARK-21593:
---
Description:
Latest configuration page for Spark 2.2.0 has broken menu list and named
[
https://issues.apache.org/jira/browse/SPARK-21593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Artur Sukhenko updated SPARK-21593:
---
Attachment: (was: doc_211.png)
> Fix broken configuration page
>
[
https://issues.apache.org/jira/browse/SPARK-21593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Artur Sukhenko updated SPARK-21593:
---
Attachment: doc_latest.jpg
doc_211.jpg
dyn_211.jpg
[
https://issues.apache.org/jira/browse/SPARK-21593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Artur Sukhenko updated SPARK-21593:
---
Attachment: (was: doc_latest.png)
> Fix broken configuration page
>
[
https://issues.apache.org/jira/browse/SPARK-21593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Artur Sukhenko updated SPARK-21593:
---
Description:
Latest configuration page for Spark 2.2.0 has broken menu list and named
[
https://issues.apache.org/jira/browse/SPARK-21593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Artur Sukhenko updated SPARK-21593:
---
Description:
Latest configuration page for Spark 2.2.0 has broken menu list and named
[
https://issues.apache.org/jira/browse/SPARK-21593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Artur Sukhenko updated SPARK-21593:
---
Attachment: doc_latest.png
doc_211.png
Latest documentation page with broken
Artur Sukhenko created SPARK-21593:
--
Summary: Fix broken configuration page
Key: SPARK-21593
URL: https://issues.apache.org/jira/browse/SPARK-21593
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-18191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16073860#comment-16073860
]
Artur Sukhenko commented on SPARK-18191:
[~shridharama] Yes, updated 'Fix Version' from 2.1 to
[
https://issues.apache.org/jira/browse/SPARK-18191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Artur Sukhenko updated SPARK-18191:
---
Fix Version/s: (was: 2.1.0)
2.2.0
> Port RDD API to use commit
[
https://issues.apache.org/jira/browse/SPARK-19360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Artur Sukhenko updated SPARK-19360:
---
Summary: Spark 2.X does not support stored by clause (was: Spark 2.X does
not support
[
https://issues.apache.org/jira/browse/SPARK-4906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Artur Sukhenko updated SPARK-4906:
--
Affects Version/s: 1.6.1
> Spark master OOMs with exception stack trace stored in
[
https://issues.apache.org/jira/browse/SPARK-17922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Artur Sukhenko updated SPARK-17922:
---
Affects Version/s: 2.0.1
> ClassCastException java.lang.ClassCastException:
>
[
https://issues.apache.org/jira/browse/SPARK-19578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994617#comment-15994617
]
Artur Sukhenko commented on SPARK-19578:
[~nchammas] I've opened separate issue for Incorrect UI
[
https://issues.apache.org/jira/browse/SPARK-19578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Artur Sukhenko updated SPARK-19578:
---
Description:
Simple job in pyspark takes 14 minutes to complete.
The text file used to
[
https://issues.apache.org/jira/browse/SPARK-19578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Artur Sukhenko updated SPARK-19578:
---
Attachment: (was: spark_shell_correct_inputsize.png)
> Poor pyspark performance
>
[
https://issues.apache.org/jira/browse/SPARK-19578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Artur Sukhenko updated SPARK-19578:
---
Attachment: (was: pyspark_incorrect_inputsize.png)
> Poor pyspark performance
>
[
https://issues.apache.org/jira/browse/SPARK-19578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Artur Sukhenko updated SPARK-19578:
---
Summary: Poor pyspark performance (was: Poor pyspark performance +
incorrect UI input-size
[
https://issues.apache.org/jira/browse/SPARK-20308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Artur Sukhenko resolved SPARK-20308.
Resolution: Duplicate
> org.apache.spark.shuffle.FetchFailedException: Too large frame
>
[
https://issues.apache.org/jira/browse/SPARK-20244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Artur Sukhenko updated SPARK-20244:
---
Attachment: pyspark_incorrect_inputsize.png
sparkshell_correct_inputsize.png
Artur Sukhenko created SPARK-20244:
--
Summary: Incorrect input size in UI with pyspark
Key: SPARK-20244
URL: https://issues.apache.org/jira/browse/SPARK-20244
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-19068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Artur Sukhenko resolved SPARK-19068.
Resolution: Duplicate
Fix Version/s: 2.2.0
Closing as duplicate of SPARK-19146.
[
https://issues.apache.org/jira/browse/SPARK-19068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Artur Sukhenko updated SPARK-19068:
---
Affects Version/s: 2.0.1
> Large number of executors causing a ton of ERROR
[
https://issues.apache.org/jira/browse/SPARK-19068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957258#comment-15957258
]
Artur Sukhenko commented on SPARK-19068:
Having similar problem.
Reproduce:
[
https://issues.apache.org/jira/browse/SPARK-19578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Artur Sukhenko updated SPARK-19578:
---
Description:
Simple job in pyspark takes 14 minutes to complete.
The text file used to
[
https://issues.apache.org/jira/browse/SPARK-19578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Artur Sukhenko updated SPARK-19578:
---
Attachment: reproduce_log
spark_shell_correct_inputsize.png
Artur Sukhenko created SPARK-19578:
--
Summary: Poor pyspark performance + incorrect UI input-size metrics
Key: SPARK-19578
URL: https://issues.apache.org/jira/browse/SPARK-19578
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Artur Sukhenko updated SPARK-4105:
--
Affects Version/s: 2.0.0
> FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with
[
https://issues.apache.org/jira/browse/SPARK-17340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15470574#comment-15470574
]
Artur Sukhenko commented on SPARK-17340:
Agree with [~jerryshao].
> .sparkStaging not cleaned if
[
https://issues.apache.org/jira/browse/SPARK-17340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15470514#comment-15470514
]
Artur Sukhenko edited comment on SPARK-17340 at 9/7/16 12:57 PM:
-
I
[
https://issues.apache.org/jira/browse/SPARK-17340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15470514#comment-15470514
]
Artur Sukhenko commented on SPARK-17340:
I thought you can do
{code}
$yarn application -list
[
https://issues.apache.org/jira/browse/SPARK-17379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15464604#comment-15464604
]
Artur Sukhenko commented on SPARK-17379:
Tried to use spark with 4.1.5, after fixing deprecated
[
https://issues.apache.org/jira/browse/SPARK-17340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15455086#comment-15455086
]
Artur Sukhenko commented on SPARK-17340:
Yes, I can.
However some users will stop app like this
[
https://issues.apache.org/jira/browse/SPARK-17340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15455077#comment-15455077
]
Artur Sukhenko commented on SPARK-17340:
Oh, now I get this.
However, if you stop it in
[
https://issues.apache.org/jira/browse/SPARK-17340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15455038#comment-15455038
]
Artur Sukhenko commented on SPARK-17340:
With yarn-client it will be cleaned up.
I am talking
[
https://issues.apache.org/jira/browse/SPARK-17340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15453102#comment-15453102
]
Artur Sukhenko edited comment on SPARK-17340 at 8/31/16 7:14 PM:
-
Tested
[
https://issues.apache.org/jira/browse/SPARK-17340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15453102#comment-15453102
]
Artur Sukhenko edited comment on SPARK-17340 at 8/31/16 7:12 PM:
-
Tested
[
https://issues.apache.org/jira/browse/SPARK-17340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15453102#comment-15453102
]
Artur Sukhenko commented on SPARK-17340:
Tested on 1.6.1: exitCode 15 (EXIT_EXCEPTION_USER_CLASS)
[
https://issues.apache.org/jira/browse/SPARK-17340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Artur Sukhenko updated SPARK-17340:
---
Summary: .sparkStaging not cleaned if application exited incorrectly (was:
.sparkStaging is
[
https://issues.apache.org/jira/browse/SPARK-17340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Artur Sukhenko updated SPARK-17340:
---
Component/s: YARN
> .sparkStaging is not cleaned if killed
>
[
https://issues.apache.org/jira/browse/SPARK-17340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Artur Sukhenko updated SPARK-17340:
---
Description:
When running Spark (yarn,cluster mode) and killing application
.sparkStaging is
[
https://issues.apache.org/jira/browse/SPARK-17340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Artur Sukhenko updated SPARK-17340:
---
Summary: .sparkStaging is not cleaned if killed (was: .sparkStaging not
cleaned in
Artur Sukhenko created SPARK-17340:
--
Summary: .sparkStaging not cleaned in yarn-cluster mode
Key: SPARK-17340
URL: https://issues.apache.org/jira/browse/SPARK-17340
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Artur Sukhenko updated SPARK-4105:
--
Affects Version/s: 1.5.1
> FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with
[
https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Artur Sukhenko updated SPARK-4105:
--
Affects Version/s: 1.6.1
> FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with
51 matches
Mail list logo
