[ https://issues.apache.org/jira/browse/SPARK-10987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14947743#comment-14947743 ]
Marcelo Vanzin commented on SPARK-10987: ---------------------------------------- The {{ExecutorRunnable}} process (client-mode AM) was also running at the time, although I didn't notice anything interesting in the stack trace. > yarn-cluster mode misbehaving with netty-based RPC backend > ---------------------------------------------------------- > > Key: SPARK-10987 > URL: https://issues.apache.org/jira/browse/SPARK-10987 > Project: Spark > Issue Type: Bug > Components: Spark Core, YARN > Affects Versions: 1.6.0 > Reporter: Marcelo Vanzin > Priority: Blocker > > YARN running in cluster deploy mode seems to be having issues with the new > RPC backend; if you look at unit test runs, tests that run in cluster mode > are taking several minutes to run, instead of the more usual 20-30 seconds. > For example, > https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43349/consoleFull: > {noformat} > [info] YarnClusterSuite: > [info] - run Spark in yarn-client mode (13 seconds, 953 milliseconds) > [info] - run Spark in yarn-cluster mode (6 minutes, 50 seconds) > [info] - run Spark in yarn-cluster mode unsuccessfully (1 minute, 53 seconds) > [info] - run Python application in yarn-client mode (21 seconds, 842 > milliseconds) > [info] - run Python application in yarn-cluster mode (7 minutes, 0 seconds) > [info] - user class path first in client mode (1 minute, 58 seconds) > [info] - user class path first in cluster mode (4 minutes, 49 seconds) > {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org