I think this is a symptom of not running "mvn ... package" and then
"mvn ... test"?
On Mon, Aug 24, 2015 at 1:27 AM, Luciano Resende <luckbr1...@gmail.com> wrote:
> On Fri, Aug 21, 2015 at 9:28 AM, Sean Owen <so...@cloudera.com> wrote:
>>
>> Signatures, license, etc. look good. I'm getting some fairly
>> consistent failures using Java 7 + Ubuntu 15 + "-Pyarn -Phive
>> -Phive-thriftserver -Phadoop-2.6" -- does anyone else see these? they
>> are likely just test problems, but worth asking. Stack traces are at
>> the end.
>>
>> There are currently 79 issues targeted for 1.5.0, of which 19 are
>> bugs, of which 1 is a blocker. (1032 have been resolved for 1.5.0.)
>> That's significantly better than at the last release. I presume a lot
>> of what's still targeted is not critical and can now be
>> untargeted/retargeted.
>>
>> It occurs to me that the flurry of planning that took place at the
>> start of the 1.5 QA cycle a few weeks ago was quite helpful, and is
>> the kind of thing that would be even more useful at the start of a
>> release cycle. So would be great to do this for 1.6 in a few weeks.
>> Indeed there are already 267 issues targeted for 1.6.0 -- a decent
>> roadmap already.
>>
>>
>> Test failures:
>>
>> Core
>>
>> - Unpersisting TorrentBroadcast on executors and driver in distributed
>> mode *** FAILED ***
>> java.util.concurrent.TimeoutException: Can't find 2 executors before
>> 10000 milliseconds elapsed
>> at
>> org.apache.spark.ui.jobs.JobProgressListener.waitUntilExecutorsUp(JobProgressListener.scala:561)
>> at
>> org.apache.spark.broadcast.BroadcastSuite.testUnpersistBroadcast(BroadcastSuite.scala:313)
>> at
>> org.apache.spark.broadcast.BroadcastSuite.org$apache$spark$broadcast$BroadcastSuite$$testUnpersistTorrentBroadcast(BroadcastSuite.scala:287)
>> at
>> org.apache.spark.broadcast.BroadcastSuite$$anonfun$16.apply$mcV$sp(BroadcastSuite.scala:165)
>> at
>> org.apache.spark.broadcast.BroadcastSuite$$anonfun$16.apply(BroadcastSuite.scala:165)
>> at
>> org.apache.spark.broadcast.BroadcastSuite$$anonfun$16.apply(BroadcastSuite.scala:165)
>> at
>> org.scalatest.Transformer$$anonfun$apply$1.apply$mcV$sp(Transformer.scala:22)
>> at org.scalatest.OutcomeOf$class.outcomeOf(OutcomeOf.scala:85)
>> at org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104)
>> at org.scalatest.Transformer.apply(Transformer.scala:22)
>> ...
>>
>> Streaming
>>
>> - stop slow receiver gracefully *** FAILED ***
>> 0 was not greater than 0 (StreamingContextSuite.scala:324)
>>
>> Kafka
>>
>> - offset recovery *** FAILED ***
>> The code passed to eventually never returned normally. Attempted 191
>> times over 10.043196973 seconds. Last failure message:
>> strings.forall({
>> ((elem: Any) => DirectKafkaStreamSuite.collectedData.contains(elem))
>> }) was false. (DirectKafkaStreamSuite.scala:249)
>>
>
>
> Hi Sean,
>
> Were you able to resolve this ? I am trying it on Linux (Ubuntu 14.04.3 LTS)
> and when building with a clean maven repo I am getting issues where it can't
> find lib_managed/jar when trying to build the Launcher. But looks like you
> went a bit further on this ?
>
> Running org.apache.spark.launcher.SparkSubmitCommandBuilderSuite
> Tests run: 7, Failures: 0, Errors: 4, Skipped: 0, Time elapsed: 0.018 sec
> <<< FAILURE! - in org.apache.spark.launcher.SparkSubmitCommandBuilderSuite
> testDriverCmdBuilder(org.apache.spark.launcher.SparkSubmitCommandBuilderSuite)
> Time elapsed: 0.005 sec <<< ERROR!
> java.lang.IllegalStateException: Library directory
> '/home/lresende/dev/spark/source/releases/spark-1.5.0/lib_managed/jars' does
> not exist.
> at
> org.apache.spark.launcher.CommandBuilderUtils.checkState(CommandBuilderUtils.java:249)
> at
> org.apache.spark.launcher.AbstractCommandBuilder.buildClassPath(AbstractCommandBuilder.java:218)
> at
> org.apache.spark.launcher.AbstractCommandBuilder.buildJavaCommand(AbstractCommandBuilder.java:115)
> at
> org.apache.spark.launcher.SparkSubmitCommandBuilder.buildSparkSubmitCommand(SparkSubmitCommandBuilder.java:196)
> at
> org.apache.spark.launcher.SparkSubmitCommandBuilder.buildCommand(SparkSubmitCommandBuilder.java:121)
> at
> org.apache.spark.launcher.SparkSubmitCommandBuilderSuite.testCmdBuilder(SparkSubmitCommandBuilderSuite.java:174)
> at
> org.apache.spark.launcher.SparkSubmitCommandBuilderSuite.testDriverCmdBuilder(SparkSubmitCommandBuilderSuite.java:51)
>
>
> --
> Luciano Resende
> http://people.apache.org/~lresende
> http://twitter.com/lresende1975
> http://lresende.blogspot.com/
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
For additional commands, e-mail: dev-h...@spark.apache.org
