[jira] [Commented] (SPARK-20421) Mark JobProgressListener (and related classes) as deprecated

[ https://issues.apache.org/jira/browse/SPARK-20421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15996301#comment-15996301 ] Saisai Shao commented on SPARK-20421: - [~vanzin], what will you do to {{StorageStatus

[jira] [Created] (SPARK-20605) Deprecate not used AM and executor port configuration

Saisai Shao created SPARK-20605: --- Summary: Deprecate not used AM and executor port configuration Key: SPARK-20605 URL: https://issues.apache.org/jira/browse/SPARK-20605 Project: Spark Issue Typ

[jira] [Commented] (SPARK-20658) spark.yarn.am.attemptFailuresValidityInterval doesn't seem to have an effect

[ https://issues.apache.org/jira/browse/SPARK-20658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16001917#comment-16001917 ] Saisai Shao commented on SPARK-20658: - It is mainly depends on YARN to measure the fa

[jira] [Commented] (SPARK-20772) Add support for query parameters in redirects on Yarn

[ https://issues.apache.org/jira/browse/SPARK-20772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16013431#comment-16013431 ] Saisai Shao commented on SPARK-20772: - I'm guessing if it is an issue of {{AmIpFilter

[jira] [Commented] (SPARK-19569) could not get APP ID and cause failed to connect to spark driver on yarn-client mode

[ https://issues.apache.org/jira/browse/SPARK-19569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16017066#comment-16017066 ] Saisai Shao commented on SPARK-19569: - [~ouyangxc.zte] In you above code you directly

[jira] [Commented] (SPARK-20898) spark.blacklist.killBlacklistedExecutors doesn't work in YARN

[ https://issues.apache.org/jira/browse/SPARK-20898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16030710#comment-16030710 ] Saisai Shao commented on SPARK-20898: - [~tgraves], I addressed this issue in https:/

[jira] [Commented] (SPARK-20943) Correct BypassMergeSortShuffleWriter's comment

[ https://issues.apache.org/jira/browse/SPARK-20943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16033016#comment-16033016 ] Saisai Shao commented on SPARK-20943: - I don't think the previous comment is incorrec

[jira] [Commented] (SPARK-20943) Correct BypassMergeSortShuffleWriter's comment

[ https://issues.apache.org/jira/browse/SPARK-20943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16034296#comment-16034296 ] Saisai Shao commented on SPARK-20943: - I think the original purpose of comment is to

[jira] [Created] (SPARK-20981) Add --repositories equivalent configuration for Spark

Saisai Shao created SPARK-20981: --- Summary: Add --repositories equivalent configuration for Spark Key: SPARK-20981 URL: https://issues.apache.org/jira/browse/SPARK-20981 Project: Spark Issue Typ

[jira] [Created] (SPARK-20982) Consider adding SSL support for Spark REST submission server and client

Saisai Shao created SPARK-20982: --- Summary: Consider adding SSL support for Spark REST submission server and client Key: SPARK-20982 URL: https://issues.apache.org/jira/browse/SPARK-20982 Project: Spark

[jira] [Commented] (SPARK-20982) Consider adding SSL support for Spark REST submission server and client

[ https://issues.apache.org/jira/browse/SPARK-20982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037994#comment-16037994 ] Saisai Shao commented on SPARK-20982: - Thanks a lot [~vanzin] for your response. Thou

[jira] [Commented] (SPARK-20943) Correct BypassMergeSortShuffleWriter's comment

[ https://issues.apache.org/jira/browse/SPARK-20943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16037998#comment-16037998 ] Saisai Shao commented on SPARK-20943: - >From my point, it is not really necessary to

[jira] [Updated] (SPARK-20996) Better handling AM reattempt based on exit code in yarn mode

[ https://issues.apache.org/jira/browse/SPARK-20996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-20996: Description: Yarn provides max attempt configuration for applications running on it, application h

[jira] [Created] (SPARK-20996) Better handling AM reattempt based on exit code in yarn mode

Saisai Shao created SPARK-20996: --- Summary: Better handling AM reattempt based on exit code in yarn mode Key: SPARK-20996 URL: https://issues.apache.org/jira/browse/SPARK-20996 Project: Spark I

[jira] [Updated] (SPARK-13669) Job will always fail in the external shuffle service unavailable situation

[ https://issues.apache.org/jira/browse/SPARK-13669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-13669: Description: Currently we are running into an issue with Yarn work preserving enabled + external s

[jira] [Created] (SPARK-21012) Support glob path for resources adding to Spark

Saisai Shao created SPARK-21012: --- Summary: Support glob path for resources adding to Spark Key: SPARK-21012 URL: https://issues.apache.org/jira/browse/SPARK-21012 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-21012) Support glob path for resources adding to Spark

[ https://issues.apache.org/jira/browse/SPARK-21012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-21012: Priority: Minor (was: Major) > Support glob path for resources adding to Spark > -

[jira] [Updated] (SPARK-21012) Support glob path for resources adding to Spark

[ https://issues.apache.org/jira/browse/SPARK-21012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-21012: Issue Type: Improvement (was: Bug) > Support glob path for resources adding to Spark > ---

[jira] [Updated] (SPARK-21012) Support glob path for resources adding to Spark

[ https://issues.apache.org/jira/browse/SPARK-21012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-21012: Description: Current "\-\-jars (spark.jars)", "\-\-files (spark.files)", "\-\-py-files (spark.subm

[jira] [Updated] (SPARK-21013) Spark History Server does not show the logs of completed Yarn Jobs

[ https://issues.apache.org/jira/browse/SPARK-21013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-21013: Priority: Minor (was: Major) > Spark History Server does not show the logs of completed Yarn Jobs

[jira] [Commented] (SPARK-21008) Streaming applications read stale credentials file when recovering from checkpoint.

[ https://issues.apache.org/jira/browse/SPARK-21008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16042341#comment-16042341 ] Saisai Shao commented on SPARK-21008: - This is duplicated with SPARK-19588, can we pl

[jira] [Comment Edited] (SPARK-21008) Streaming applications read stale credentials file when recovering from checkpoint.

[ https://issues.apache.org/jira/browse/SPARK-21008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16042341#comment-16042341 ] Saisai Shao edited comment on SPARK-21008 at 6/8/17 7:19 AM: -

[jira] [Closed] (SPARK-21008) Streaming applications read stale credentials file when recovering from checkpoint.

[ https://issues.apache.org/jira/browse/SPARK-21008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao closed SPARK-21008. --- Resolution: Duplicate > Streaming applications read stale credentials file when recovering from > ch

[jira] [Reopened] (SPARK-19688) Spark on Yarn Credentials File set to different application directory

[ https://issues.apache.org/jira/browse/SPARK-19688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao reopened SPARK-19688: - The issue still exists in master branch, so reopen it. > Spark on Yarn Credentials File set to diffe

[jira] [Commented] (SPARK-21082) Consider Executor's memory usage when scheduling task

[ https://issues.apache.org/jira/browse/SPARK-21082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16049906#comment-16049906 ] Saisai Shao commented on SPARK-21082: - Is it due to fast node and slow node problem?

[jira] [Commented] (SPARK-21080) Workaround for HDFS delegation token expiry broken with some Hadoop versions

[ https://issues.apache.org/jira/browse/SPARK-21080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16049920#comment-16049920 ] Saisai Shao commented on SPARK-21080: - Are you getting this issue in HDFS HA mode? If

[jira] [Commented] (SPARK-21082) Consider Executor's memory usage when scheduling task

[ https://issues.apache.org/jira/browse/SPARK-21082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16049940#comment-16049940 ] Saisai Shao commented on SPARK-21082: - Fast node actually equals to idle node, since

<    8   9   10   11   12   13