Excellent start! Nice links I was not aware of (thanks).
Folks can use distcc now to test new rollouts of mesos?
That was the quest of the thread was/is to establish some codes for
testing new rollouts of mesos.
It'll need to be 'extended' for cross compiling too for my needs.
I'd like to follow up with anyone that get's distcc working with cross
compiling for different arches. arm64 would be really cool. (LLVM?)
My small cluster needs some work, much of it not related to mesos, but
my efforts to run mesos and spark without the HDFS and use Cephfs, btrfs
and supporting codes. So I'm not sure when I'll get this mesos-distcc
installed and running in the near future; but I am most interested in
follow the issues other encounter on compiling and cross compiling on a
mesos cluster.
What would be really cool is to run this distcc-mesos on top of spark
and cephfs for some real fast compile times of large codes.
Thanks,
James
On 03/23/2015 10:22 PM, Adam Bordelon wrote:
I know it's over a year old and hasn't been updated, but bmahler already
created a distcc framework example for Mesos.
https://github.com/mesos/mesos-distcc
On Mon, Mar 23, 2015 at 7:56 PM, CCAAT <cc...@tampabay.rr.com
<mailto:cc...@tampabay.rr.com>> wrote:
On 03/23/2015 09:02 PM, Adam Bordelon wrote:
Integration tests are definitely desired/recommended. Some of us
devs
just do make [dist]check, but others test integrations with their
favourite frameworks, or push it to their internal testing clusters.
We're open to any additional testing you would like to propose
and/or
perform.
Thanks,
-Adam-
Distcc is a distributed compiling program that has been a long staple on
Gentoo linux and many other distros. I work on Gentoo and I think that
setting up distcc to run on a mesos cluster is a fabulous idea. Not only
can you compile native binaries for the inherent arch, but cross
compiling should work too. Everyone has to recompile (optimized) kernels
frequently with the release cycle of the linux kernel team. With the
current roll out of all sorts of 64 bit arm systems, there's going to be
a great opportunity to cross compile arm64 bit codes on CISC (X86_64)
bit clusters.
This also starts the process of heterogeneous mesos clusters, surely
inevitable.
https://code.google.com/p/__distcc/ <https://code.google.com/p/distcc/>
https://code.google.com/p/__distcc/downloads/list
<https://code.google.com/p/distcc/downloads/list>
With LLvm, gnu and other projects, compiling and cross compiling on
a mesos cluster is sure to be a very, very popoular idea. Any CI
endeavor
will necessitate lots of compiling too.
hope this helps,
James
