Re: Mesos + storm on top of Docker

2014-08-24 Thread Yaron Rosenbaum
Guys, I'm stuck, it would really be great if someone could give me a hand. I really think that a lot of people could benefit from being able to have a complete Mesos+Storm +.. setup run on their laptop, based on Docker. This is the project I'm trying to build. Everything works except for Storm,

Re: Mesos + storm on top of Docker

2014-08-24 Thread Tim Chen
Hi Yaron, Can you elaborate more when you say it doesn't work? Does it not able to launch? And which repo did you end up using? What's the exact configuration/command you tried to run storm on mesos? Tim On Sat, Aug 23, 2014 at 11:36 PM, Yaron Rosenbaum yaron.rosenb...@gmail.com wrote:

Re: Mesos + storm on top of Docker

2014-08-24 Thread Yaron Rosenbaum
Hi It all boots up nicely, storm UI works. Marathon, chronos.. I deploy a topology to storm - wordcount or something that should work. I can see that it's deployed on storm. But nothing gets executed. There are no workers etc. I'm using the 'official' storm-mesos (according to the online

Re: Mesos + storm on top of Docker

2014-08-24 Thread Matt Trifiro
unsubscribe Matthew G Trifiro m...@trifiro.com +1 206 390 3161 twitter.com/mtrifiro linkedin.com/in/mtrifiro On Mon, Aug 18, 2014 at 5:05 AM, Yaron Rosenbaum ya...@whatson-social.com wrote: Hi I have created a Docker based Mesos setup, including chronos, marathon, and storm. Following

Re: Mesos + storm on top of Docker

2014-08-20 Thread Tomas Barton
The later is definitely a better choice. Yet another fork of storm-mesos is here: https://github.com/deric/storm-mesos On 19 August 2014 20:22, Yaron Rosenbaum yaron.rosenb...@gmail.com wrote: I'm not getting it from git, but rather downloading it from:

Re: Mesos + storm on top of Docker

2014-08-19 Thread Yaron Rosenbaum
Ok, thanks for the tip! Made some progress. Now this is what I get : stderr on the slave: WARNING: Logging before InitGoogleLogging() is written to STDERR I0818 19:06:55.03369922 fetcher.cpp:73] Fetching URI 'http://downloads.mesosphere.io/storm/storm-mesos-0.9.tgz' I0818 19:06:55.033994

Re: Mesos + storm on top of Docker

2014-08-19 Thread Brenden Matthews
What version of the storm on mesos code are you running? i.e., what is the git sha? On Mon, Aug 18, 2014 at 11:53 PM, Yaron Rosenbaum yaron.rosenb...@gmail.com wrote: Ok, thanks for the tip! Made some progress. Now this is what I get : stderr on the slave: WARNING: Logging before

Mesos + storm on top of Docker

2014-08-18 Thread Yaron Rosenbaum
Hi I have created a Docker based Mesos setup, including chronos, marathon, and storm. Following advice I saw previously on this mailing list, I have run all frameworks directly on the Mesos master (is this correct? is it guaranteed to have only one master at any given time?) Chronos and

Re: Mesos + storm on top of Docker

2014-08-18 Thread Vinod Kone
Can you paste the slave/executor log related to the executor failure? @vinodkone On Aug 18, 2014, at 5:05 AM, Yaron Rosenbaum ya...@whatson-social.com wrote: Hi I have created a Docker based Mesos setup, including chronos, marathon, and storm. Following advice I saw previously on this

Re: Mesos + storm on top of Docker

2014-08-18 Thread Yaron Rosenbaum
Hi @vinodkone nimbus log: 2014-08-18 15:49:53 b.s.d.nimbus [INFO] Executor wordcount-1-1408376868:[2 2] not alive 2014-08-18 15:49:53 b.s.d.nimbus [INFO] Executor wordcount-1-1408376868:[2 2] not alive 2014-08-18 15:49:53 b.s.d.nimbus [INFO] Executor wordcount-1-1408376868:[3 3] not alive

Re: Mesos + storm on top of Docker

2014-08-18 Thread Yaron Rosenbaum
@vinodkone Finally found some relevant logs.. Let's start with the slave: slave_1 | I0818 16:18:51.700827 9 slave.cpp:1043] Launching task 82071a7b5f41-31000 for framework 20140818-161802-2214597036-5050-10-0002 slave_1 | I0818 16:18:51.703234 9 slave.cpp:1153] Queuing task

Re: Mesos + storm on top of Docker

2014-08-18 Thread Brenden Matthews
Is the hostname set correctly on the machine running nimbus? It looks like that may not be correct. On Mon, Aug 18, 2014 at 9:39 AM, Yaron Rosenbaum yaron.rosenb...@gmail.com wrote: @vinodkone Finally found some relevant logs.. Let's start with the slave: slave_1 | I0818

Re: Mesos + storm on top of Docker

2014-08-18 Thread Michael Babineau
Including --hostname=host in your docker run command should help with the resolution problem (so long as host is resolvable) On Mon, Aug 18, 2014 at 9:42 AM, Brenden Matthews brenden.matth...@airbedandbreakfast.com wrote: Is the hostname set correctly on the machine running nimbus? It looks