make check passes, and setup mini cluster so, +1
---------------------------------------------------
However, fwiw I decided to verify against Spark-0.9 and it appears they had
some implied context, which I think is actually a bug in Spark:
in
core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerBackend.scala
( createExecutorInfo) :
/// Begin excerpt
val uri = sc.conf.get("spark.executor.uri", null)
if (uri == null) {
command.setValue(new File(sparkHome, "/sbin/spark-executor").getCanonicalPath)
} else {
// Grab everything to the first '.'. We'll use that and '*' to
// glob the directory "correctly".
val basename = uri.split('/').last.split('.').head
command.setValue("cd %s*; ./sbin/spark-executor".format(basename))
command.addUris(CommandInfo.URI.newBuilder().setValue(uri))
}
/// end exceprt
WARNING: Logging before InitGoogleLogging() is written to STDERR
I0403 11:40:34.945070 4108 fetcher.cpp:73] Fetching URI
'hdfs://grid7.lab.bos.redhat.com:8020/spark/spark-0.9.tar.gz'
I0403 11:40:34.945248 4108 fetcher.cpp:99] Downloading resource from
'hdfs://grid7.lab.bos.redhat.com:8020/spark/spark-0.9.tar.gz' to
'/var/run/mesos/slaves/20140403-103606-1898713098-5050-28035-0/frameworks/20140403-103606-1898713098-5050-28035-0000/executors/20140403-103606-1898713098-5050-28035-0/runs/7e2a86e9-5b4c-4a19-940f-0cdd6148d66b/spark-0.9.tar.gz'
I0403 11:40:47.086099 4108 fetcher.cpp:61] Extracted resource
'/var/run/mesos/slaves/20140403-103606-1898713098-5050-28035-0/frameworks/20140403-103606-1898713098-5050-28035-0000/executors/20140403-103606-1898713098-5050-28035-0/runs/7e2a86e9-5b4c-4a19-940f-0cdd6148d66b/spark-0.9.tar.gz'
into
'/var/run/mesos/slaves/20140403-103606-1898713098-5050-28035-0/frameworks/20140403-103606-1898713098-5050-28035-0000/executors/20140403-103606-1898713098-5050-28035-0/runs/7e2a86e9-5b4c-4a19-940f-0cdd6148d66b'
sh: line 0: cd: spark-0.9.tar.gz: Not a directory
sh: ./sbin/spark-executor: No such file or directory
--
Cheers,
Tim
Freedom, Features, Friends, First -> Fedora
https://fedoraproject.org/wiki/SIGs/bigdata
----- Original Message -----
> From: "Vinod Kone" <[email protected]>
> To: "dev" <[email protected]>, [email protected]
> Sent: Tuesday, April 1, 2014 10:35:39 PM
> Subject: [VOTE] Release Apache Mesos 0.18.0 (rc6)
> Hi all,
> Please vote on releasing the following candidate as Apache Mesos 0.18.0.
> 0.18.0 includes the following:
> --------------------------------------------------------------------------------
> * The primary feature of this release is a refactor of the isolation
> abstraction to make it easy to add pluggable isolators/containerizers.
> The CHANGELOG for the release is available at:
> https://git-wip-us.apache.org/repos/asf?p=mesos.git;a=blob_plain;f=CHANGELOG;hb=0.18.0-rc6
> --------------------------------------------------------------------------------
> The candidate for Mesos 0.18.0 release is available at:
> https://dist.apache.org/repos/dist/dev/mesos/0.18.0-rc6/mesos-0.18.0.tar.gz
> The tag to be voted on is 0.18.0-rc6:
> https://git-wip-us.apache.org/repos/asf?p=mesos.git;a=commit;h=0.18.0-rc6
> The MD5 checksum of the tarball can be found at:
> https://dist.apache.org/repos/dist/dev/mesos/0.18.0-rc6/mesos-0.18.0.tar.gz.md5
> The signature of the tarball can be found at:
> https://dist.apache.org/repos/dist/dev/mesos/0.18.0-rc6/mesos-0.18.0.tar.gz.asc
> The PGP key used to sign the release is here:
> https://dist.apache.org/repos/dist/release/mesos/KEYS
> The JAR is up in Maven in a staging repository here:
> https://repository.apache.org/content/repositories/orgapachemesos-1013
> Please vote on releasing this package as Apache Mesos 0.18.0!
> The vote is open until Fri Apr 4 20:29:44 PDT 2014 and passes if a majority
> of at least 3 +1 PMC votes are cast.
> [ ] +1 Release this package as Apache Mesos 0.18.0
> [ ] -1 Do not release this package because ...
> Thanks,
