Re: mesos-collectd-plugin

2015-03-12 Thread Dan Dong
nd putting it on every node in my Mesos > cluster. > > Would it be worth polishing up a bit and throwing on github? > > > On Tuesday, March 10, 2015, Dan Dong wrote: > >> Hi, All, >> Does anybody use this mesos-collectd-plugin: >> https://github.com/rayrod2

Re: mesos-collectd-plugin

2015-03-11 Thread Dan Dong
do the trick > (NB: you'll only get metrics from the elected master; the 'standby' > masters still get polled > but collectd will ignore any data from them unless they're the primary) > > On 11 March 2015 at 19:52, Dan Dong wrote: > > Hi, Dick, > > I put t

Re: mesos-collectd-plugin

2015-03-11 Thread Dan Dong
you're not loading the plugin .conf file into > your collectd config? > > The output will depend on what your collectd is set to write to, I use > it with write_graphite. > > On 10 March 2015 at 20:41, Dan Dong wrote: > > Hi, All, > > Does anybody use this mesos-co

mesos-collectd-plugin

2015-03-10 Thread Dan Dong
Hi, All, Does anybody use this mesos-collectd-plugin: https://github.com/rayrod2030/collectd-mesos I have installed collectd and this plugin, then configured it as instructions and restarted the collectd daemon, why seems nothing happens on the mesos:5050 web UI( python plugin has been turned on

Re: spark on mesos.

2015-03-02 Thread Dan Dong
ing a Spark > job. This is because each Spark job actually launches a new Spark framework > that is scheduling for that single job. > > Tim > > On Fri, Feb 27, 2015 at 1:39 PM, Dan Dong wrote: > >> Hi, Dick, >> By Spark daemons I mean Master and Worker proc

Re: spark on mesos.

2015-02-27 Thread Dan Dong
any other spark application) acts as a Mesos framework, > so until that's running spark isn't 'on' Mesos. > > On 27 February 2015 at 16:23, Dan Dong wrote: > > Hi, All, > > When I configured and started spark daemons, why I could not see it in > > &qu

spark on mesos.

2015-02-27 Thread Dan Dong
Hi, All, When I configured and started spark daemons, why I could not see it in "Active Frameworks" on Mesos UI(for Hadoop, it will show up immediately when hadoop daemons started)?. I can see the spark framework on mesos UI only when I run the spark-shell command interactively. Is it normal? ex

Re: libsubversion-1 is required for mesos to build.

2015-01-29 Thread Dan Dong
Thank you all! That works. Cheers, Dan 2015-01-29 15:40 GMT-06:00 Tomas Barton : > apt-get install libapr1-dev libsvn-dev > > should fix that. (for this error just libsvn-dev is enough) > > Tomas > > On 29 January 2015 at 22:35, Dan Dong wrote: > >> Hi, >>

libsubversion-1 is required for mesos to build.

2015-01-29 Thread Dan Dong
Hi, When I tried to build mesos-0.21.0 on Ubuntu-14.04, I get this error: --- libsubversion-1 is required for mesos to build. --- I did quite some google but could not

Re: Unable to follow "Sandbox" links from Mesos UI.

2015-01-27 Thread Dan Dong
copy the output from Firebug or > Chrome dev console and paste it here together with the link corresponding > to the download button? > > Thanks, > Alex > > On Tue, Jan 27, 2015 at 9:19 PM, Dan Dong wrote: > >> Hi, All, >> Checked again that when I hover cursor

Re: Unable to follow "Sandbox" links from Mesos UI.

2015-01-27 Thread Dan Dong
t's correct. The 'static/pailer.html' is a page that lives on the > >>> master and it gets a url to the actual slave as a parameter. The url > >>> is computed in 'controllers.js' based on where the associated executor > >>>

Re: Unable to follow "Sandbox" links from Mesos UI.

2015-01-23 Thread Dan Dong
?)? Cheers, Dan 2015-01-23 11:25 GMT-06:00 Dick Davies : > Start with 'inspect element' in the browser and see if that gives any > clues. > Sounds like your network is a little strict so it may be something > else needs opening up. > > On 23 January 2015 at 16:56, D

Re: Unable to follow "Sandbox" links from Mesos UI.

2015-01-23 Thread Dan Dong
the link. > > On Thu, Jan 22, 2015 at 9:57 PM, Dan Dong wrote: > >> Yes, --hostname solves the problem. Now I can see all files there like >> stdout, stderr etc, but when I click on e.g stdout, it pops a new blank >> window(pailer.html) without the content of the file(

Re: Unable to follow "Sandbox" links from Mesos UI.

2015-01-22 Thread Dan Dong
P instead of the private > one in a cloud environment), you can also set the --ip parameter on > master/slave. > > On Thu, Jan 22, 2015 at 8:43 AM, Dan Dong wrote: > >> Thanks Ryan, yes, from the machine where the browser is on slave >> hostnames could not be resolved, so t

Re: Unable to follow "Sandbox" links from Mesos UI.

2015-01-22 Thread Dan Dong
nstance to the slaves. > > Make sure you can resolve the slaves from the machine you're browsing the > UI on. > > Cheers, > > ryan > > On 22 January 2015 at 15:42, Dan Dong wrote: > >> Thank you all, the master and slaves can resolve each others' hostn

Re: Unable to follow "Sandbox" links from Mesos UI.

2015-01-22 Thread Dan Dong
gt; The UI will attempt to pull that info directly from the slave so you need >> to make sure the host is resolvable and routeable from your browser. >> >> Cheers, >> >> Ryan >> >> From my phone >> >> >> On Wednesday, 21 January 2

Unable to follow "Sandbox" links from Mesos UI.

2015-01-21 Thread Dan Dong
Hi, All, When I try to access sandbox on mesos UI, I see the following info( The same error appears on every slave sandbox.): "Failed to connect to slave '20150115-144719-3205108908-5050-4552-S0' on 'centos-2.local:5051'. Potential reasons: The slave's hostname, 'centos-2.local', is not ac

Re: hadoop job stuck.

2015-01-15 Thread Dan Dong
quot;;* *port 5051 on * *slave centos-2.local could be connected from master by "telnet centos-2.local 5051"* *Confused what's the problem here?* *Cheers,* *Dan* 2015-01-14 15:33 GMT-06:00 Brenden Matthews : > Would need the task logs from the slave which the TaskTracker

Re: hadoop job stuck.

2015-01-14 Thread Dan Dong
set incorrectly and > it cannot resolve the hostname of the worker. > > See here for more: https://wiki.apache.org/hadoop/UnknownHost > > On Wed, Jan 14, 2015 at 12:32 PM, Vinod Kone wrote: > >> What do the master logs say? >> >> On Wed, Jan 14, 2015 at 12:21 PM,

Re: hadoop job stuck.

2015-01-14 Thread Dan Dong
14:47:21.117486 17757 http.cpp:478] HTTP request for '/master/state.json' I0114 14:47:31.129355 17759 http.cpp:478] HTTP request for '/master/state.json' Cheers, Dan 2015-01-14 14:32 GMT-06:00 Vinod Kone : > What do the master logs say? > > On Wed, Jan 14, 2015 at 12:

hadoop job stuck.

2015-01-14 Thread Dan Dong
Hi, When I run hadoop jobs on Mesos(0.21.0), the jobs are stuck for ever: 15/01/14 13:59:30 INFO mapred.FileInputFormat: Total input paths to process : 8 15/01/14 13:59:30 INFO mapred.JobClient: Running job: job_201501141358_0001 15/01/14 13:59:31 INFO mapred.JobClient: map 0% reduce 0% >From j

Re: conf files location of mesos.

2015-01-07 Thread Dan Dong
instead > > From: Dan Dong > Reply-To: "user@mesos.apache.org" > Date: Wednesday, January 7, 2015 at 11:38 AM > To: "user@mesos.apache.org" > Subject: Re: conf files location of mesos. > >Hi, All, >Thanks for your helps, I'm using ve

Re: conf files location of mesos.

2015-01-07 Thread Dan Dong
t; placed in /etc/default/mesos and /etc/mesos-master, /etc/mesos-slave > > > https://github.com/mesosphere/mesos-deb-packaging/blob/master/mesos-init-wrapper > > which distribution do you use? > > Tomas > > On 7 January 2015 at 16:23, Dan Dong wrote: > >>

conf files location of mesos.

2015-01-07 Thread Dan Dong
Hi, After installation of mesos on my cluster, where could I find the location of configuration files? E.g: mesos.conf, masters, slaves etc. I could not find any of them under the prefix dir and subdirs (configure --prefix=/home/dan/mesos-0.21.0/build/). Are there examples for the conf files? Tha

python error when configuring mesos on CentOS6.6.

2015-01-05 Thread Dan Dong
Hi, All, When I configure mesos 0.21.0 on CentOS6.6, I got python lib error as following. python2.7 and python-dev packages have been installed already. Any hints(e.g: ENVs)? (python-devel-2.6.6-52.el6.x86_64 python27-2.7.3-6.2.el6.nux.x86_64) checking for python version... 2.7 checking for pyt