[
https://issues.apache.org/jira/browse/SPARK-19964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16416091#comment-16416091
]
Marcelo Vanzin commented on SPARK-19964:
----------------------------------------
I ran into this failure in our internal jenkins also... the logs look similar
to the above failure. It seems the code is taking a long time inside ivy
libraries:
{noformat}
18/03/27 02:20:43.516 Utils: SLF4J: Class path contains multiple SLF4J bindings.
...
18/03/27 02:21:22.384 Utils: found my.great.lib#mylib;0.1 in repo-1
{noformat}
Those are the first and last log lines for the test. In our internal jenkins
spark-submit makes further progress, but still the timeout is caused by the
call into ivy taking a long time:
{noformat}
18/03/27 11:21:20.307 Ivy Default Cache set to: /var/lib/jenkins/.ivy2/cache
...
18/03/27 11:21:20.582 :: resolving dependencies ::
org.apache.spark#spark-submit-parent;1.0
18/03/27 11:21:20.582 confs: [default]
18/03/27 11:21:41.618 found my.great.lib#mylib;0.1 in repo-1
18/03/27 11:22:11.271 found my.great.dep#mylib;0.1 in repo-1
...
18/03/27 11:22:18.878 INFO BlockManagerMasterEndpoint: Registering block
manager 172.28.195.10:58362 with 366.3 MB RAM, BlockManagerId(0, 172.28.195.10,
58362, None)
{noformat}
Wonder if it has anything to to with ivy trying to access the network during
these tests, or some local lock maybe (which would be affected by multiple
jenkins jobs on the same machine).
> Flaky test: SparkSubmitSuite "includes jars passed in through --packages"
> -------------------------------------------------------------------------
>
> Key: SPARK-19964
> URL: https://issues.apache.org/jira/browse/SPARK-19964
> Project: Spark
> Issue Type: Bug
> Components: Deploy, Tests
> Affects Versions: 2.2.0
> Reporter: Eren Avsarogullari
> Priority: Major
> Labels: flaky-test
> Attachments: SparkSubmitSuite_Stacktrace
>
>
> The following test case has been failed due to TestFailedDueToTimeoutException
> *Test Suite:* SparkSubmitSuite
> *Test Case:* includes jars passed in through --packages
> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74413/testReport/
> *Stacktrace is also attached.*
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
