Hadoop on Mesos. HDFS question.

2015-07-03 Thread Kk Bk
I am trying to install Hadoop on Mesos on ubuntu servers, So followed instruction as per link https://open.mesosphere.com/tutorials/run-hadoop-on-mesos/#step-2. Step-2 of link says to install HDFS using as per link http://www.cloudera.com/content/cloudera/en/documentation/cdh4/latest/CDH4-Installa

Re: Hadoop on Mesos. HDFS question.

2015-07-03 Thread haosdent
You just need install HDFS through sudo apt-get install hadoop-hdfs-namenode hadoop-hdfs-secondarynamenode hadoop-hdfs-datanode hadoop-client And then continue to follow the mesosphere link step. Mesosphere link don't contain instructions to install HDFS. On Fri, Jul 3, 2015 at 10:51 PM, Kk Bk wr

Re: Hadoop on Mesos. HDFS question.

2015-07-03 Thread Tom Arnfeld
It might be worth taking a look at the install documentation on the Hadoop on Mesos product here; https://github.com/mesos/hadoop For our installations I don't think we really do much more than installing the apt packages you mentioned and then installing the hadoop-mesos jars.. plus adding t

About Hadoop mr1 on Mesos 0.22.1.

2015-07-03 Thread Wang Chun
Hi, I'm a fresh people of Mesos usage, and recently I tried to follow the instructions in https://github.com/mesos/hadoop/blob/master/README.md to setup the Hadoop running on Mesos. Now I get a problem that the Hadoop is not displayed under list of Mesos Web UI "Active Frameworks". I want to know

Running storm over mesos

2015-07-03 Thread Pradeep Chhetri
Hello all, I am trying to run Storm over Mesos using the tutorial ( http://open.mesosphere.com/tutorials/run-storm-on-mesos) over vagrant. When I am trying to submit a sample topology, it is not spawning any storm supervisors over the mesos-slaves. I didn't find anything interesting in the logs as

Re: Running storm over mesos

2015-07-03 Thread Tim Chen
Hi Pradeep, Without any more information it's quite impossible to know what's going on. What's in the slave logs and storm framework logs? Tim On Fri, Jul 3, 2015 at 10:06 AM, Pradeep Chhetri < pradeep.chhetr...@gmail.com> wrote: > Hello all, > > I am trying to run Storm over Mesos using the t

Re: Running storm over mesos

2015-07-03 Thread CCAAT
On 07/03/2015 12:30 PM, Tim Chen wrote: Hi Pradeep, Without any more information it's quite impossible to know what's going on. What's in the slave logs and storm framework logs? Tim On Fri, Jul 3, 2015 at 10:06 AM, Pradeep Chhetri mailto:pradeep.chhetr...@gmail.com>> wrote: Hello all,

Re: Running storm over mesos

2015-07-03 Thread Pradeep Chhetri
offers buffered 2015-07-03 17:49:18 s.m.MesosNimbus [INFO] Topologies that need assignments: #{"newTopo-3-1435942676" "o-5-1435944054" "againTopo-2-1435942258" "test-4-1435943781" "myTopo-1-1435938251"} 2015-07-03 17:49:18 s.m.MesosNimbus [IN

Re: Running storm over mesos

2015-07-03 Thread Pradeep Chhetri
due to slave going offline. Here are some of the logs: I0703 18:19:39.588933 3177 slave.cpp:1144] Got assigned task node2-31000 for framework 20150703-151956-169978048-5050-12019-0001 I0703 18:19:39.589437 3177 gc.cpp:84] Unscheduling '/tmp/mesos/slaves/20150703-173159-169978048-5050-236

Re: Hadoop on Mesos. HDFS question.

2015-07-03 Thread Kk Bk
Thanks guys for the response. 1) I use trusty. Seems like CDH4 does not have support for Trusty. 2) Followed instructions as per link https://github.com/mesosphere/hdfs. Able to build "hdfs-mesos-*.tgz" Should i copy this file to all nodes (i have multi-node mesos cluster) or just the master nod

[VOTE] Release Apache Mesos 0.23.0 (rc1)

2015-07-03 Thread Adam Bordelon
Hello Mesos community, Please vote on releasing the following candidate as Apache Mesos 0.23.0. 0.23.0 includes the following: - Per-container network isolation - Upgraded minimum required compilers to GCC 4.8+ or cl

Re: Mesos Slave Port Change Fails Recovery

2015-07-03 Thread Vinod Kone
Looks like this is due to a bug in versions < 23.0, where slave recovery didn't check for changes in 'port' when considering compatibility . It has since been fixed in the upcoming 0.23.0 release. On Thu, Jul 2, 2015 at 8:

Re: Mesos Slave Port Change Fails Recovery

2015-07-03 Thread Philippe Laflamme
Awesome! We've reverted to the previous port and all our slaves have recovered nicely. Thanks for looking into this, Philippe On Fri, Jul 3, 2015 at 3:27 PM, Vinod Kone wrote: > Looks like this is due to a bug in versions < 23.0, where slave recovery > didn't check for changes in 'port' when c

Re: [VOTE] Release Apache Mesos 0.23.0 (rc1)

2015-07-03 Thread Marco Massenzio
+1 *Marco Massenzio* *Distributed Systems Engineer* On Fri, Jul 3, 2015 at 12:25 PM, Adam Bordelon wrote: > Hello Mesos community, > > Please vote on releasing the following candidate as Apache Mesos 0.23.0. > > 0.23.0 includes the following: > >

Re: [VOTE] Release Apache Mesos 0.23.0 (rc1)

2015-07-03 Thread 适兕
+1 2015-07-04 9:41 GMT+08:00 Marco Massenzio : > +1 > > *Marco Massenzio* > *Distributed Systems Engineer* > > On Fri, Jul 3, 2015 at 12:25 PM, Adam Bordelon wrote: > >> Hello Mesos community, >> >> Please vote on releasing the following candidate as Apache Mesos 0.23.0. >> >> 0.23.0 includes th

Re: [VOTE] Release Apache Mesos 0.23.0 (rc1)

2015-07-03 Thread Weitao
+1 发自我的 iPhone > 在 2015年7月4日,09:41,Marco Massenzio 写道: > > +1 > > Marco Massenzio > Distributed Systems Engineer > >> On Fri, Jul 3, 2015 at 12:25 PM, Adam Bordelon wrote: >> Hello Mesos community, >> >> Please vote on releasing the following candidate as Apache Mesos 0.23.0. >> >> 0.23.0