Re: [VOTE] Storm Logo Contest - Final Round

2014-06-11 Thread Amit Singh
#9 - 5 points. Thanks, Amit. On Wed, Jun 11, 2014 at 9:36 PM, Abhishek Roy wrote: > #6 - 5pts > > > Thanks and Regards, > Abhishek Roy > > > On Wed, Jun 11, 2014 at 8:46 PM, Eugene wrote: > >> #6 - 5pts >> >> >> On Wed, Jun 11, 2014 at 6:13 AM, prabeesh k wrote: >> >>> #6 - 2pt >>> >>> >>> O

Re: [VOTE] Storm Logo Contest - Final Round

2014-06-11 Thread Abhishek Roy
#6 - 5pts Thanks and Regards, Abhishek Roy On Wed, Jun 11, 2014 at 8:46 PM, Eugene wrote: > #6 - 5pts > > > On Wed, Jun 11, 2014 at 6:13 AM, prabeesh k wrote: > >> #6 - 2pt >> >> >> On Wed, Jun 11, 2014 at 3:34 PM, Vinoth Kumar Kannan >> wrote: >> >>> #9 - 5 pts >>> >>> >>> On Wed, Jun 11,

Re: Client is being closed, and does not take requests any more

2014-06-11 Thread Xing Yong
@Neelesh,thanks,i will make some try on 0.9.2. 2014-06-11 5:41 GMT+08:00 Neelesh : > Sean, Unfortunately, I did not retain the full log and upgraded to the > master branch (0.9.2). That seems to have fixed the issue. Xing Yong, the > setting you mentioned is already at 1ms. Not sure that wou

which partition strategy storm use when groupby without no partition and parallelismHint()

2014-06-11 Thread 최범균
I wrote code following: topology.newStream("log", new LogSpout()) .each(new Fields("shopLog"), new AddGroupingValueFunction(), new Fields("productId:time")) *.groupBy(new Fields("productId:time")) // how partition tuple* *.aggregate(new CountAggregator(), new Fields("count")) // 3 instance* .each(

Re: [VOTE] Storm Logo Contest - Final Round

2014-06-11 Thread Eugene
#6 - 5pts On Wed, Jun 11, 2014 at 6:13 AM, prabeesh k wrote: > #6 - 2pt > > > On Wed, Jun 11, 2014 at 3:34 PM, Vinoth Kumar Kannan > wrote: > >> #9 - 5 pts >> >> >> On Wed, Jun 11, 2014 at 11:43 AM, B Kersbergen >> wrote: >> >>> #6 - 5 pts. >>> >>> 2014-06-11 4:02 GMT+02:00 Corey Nolet : >>>

using CachedMap in a trident state

2014-06-11 Thread Raphael Hsieh
I am imitating the MemCachedState class found here: https://github.com/nathanmarz/trident-memcached/blob/master/src/jvm/trident/memcached/MemcachedState.java . I was wondering what the CachedMap is used for. I see that it creates a cache layer between the final datastore in order to retrieve value

Re: Getting Exception in kafka-storm

2014-06-11 Thread Anis Nasir
Regarding, 0.9.2-incubating-SNAPSHOT, it comes with the interface ILocalCluster. I can not find any example using it. Regards Anis On Wed, Jun 11, 2014 at 11:14 PM, Anis Nasir wrote: > Dear Jonas, > > I am getting the same exception running this build > > https://github.com/wurstmeister/storm-

Re: Getting Exception in kafka-storm

2014-06-11 Thread Anis Nasir
Dear Jonas, I am getting the same exception running this build https://github.com/wurstmeister/storm-kafka-0.8-plus-test Regards Anis On Wed, Jun 11, 2014 at 11:07 PM, János Háber wrote: > Anis: no, you using snapshot version of storm-kafka plugin plus the old > storm kafka plugin with sto

Re: Getting Exception in kafka-storm

2014-06-11 Thread János Háber
Anis: no, you using snapshot version of storm-kafka plugin plus the old storm kafka plugin with storm 0.9.1... I think storm-kafka 0.9.2-incubating-SNAPSHOT only compatible with storm-core 0.9.2-incubating-SNAPSHOT In the 0.9.2-incubating-SNAPSHOT old curator framework (1.0.1) will be changed to m

Re: Getting Exception in kafka-storm

2014-06-11 Thread Anis Nasir
Dear Michael, I am using storm0.9.0.1 with kafka 0.8.1.1 and below mentioned are the dependencies. I tried with both storm-kafka 0.9.2-incubating-SNAPSHOT and storm-kafka-0.8-plus 0.4.0. The zookeeper version is 3.3.6. org.apache.storm storm-core 0.9.1-incubating

Re: Getting Exception in kafka-storm

2014-06-11 Thread Michael G. Noll
Can you share your build depencies, notably the versions of Storm and storm-kafka and their respective artifactId and groupId? That is, the snippets relevant to storm-core and storm-kafka from your pom.xml, build.gradle, build.sbt, or similar build configuration file. Also, please add from which

Re: Getting Exception in kafka-storm

2014-06-11 Thread Haralds Ulmanis
p.s. I launched some mvn target from storm-dist/binary directory to build binary distribution :) On 11 June 2014 21:34, Haralds Ulmanis wrote: > I got something similar, do not remember what exactly i did as it was > quite a simple. > check curator libs you are compiling in your code and libs w

Re: Getting Exception in kafka-storm

2014-06-11 Thread Haralds Ulmanis
I got something similar, do not remember what exactly i did as it was quite a simple. check curator libs you are compiling in your code and libs which is storm installation libs. Probably kafka lib you downloaded was used with different version of curator. Actually I've checked out storm incubation

Re: Getting Exception in kafka-storm

2014-06-11 Thread János Háber
Yeah... this is one of the biggest problem of about kafka <-> storm integration (second is the kafka-storm module scala dependency version, but I explain this in another topic), and this is why I plan move to Spark... ok it's only near real time, but more stable than Storm (and native can run on ha

Re: Getting Exception in kafka-storm

2014-06-11 Thread Derek Dagit
Looks like a curator version mismatch... -- Derek On 6/11/14, 14:52, Anis Nasir wrote: Dear all, I am getting below mentioned exception while running storm-kafka. Does anyone have seen this one before? 7800 [Thread-27-words] ERROR backtype.storm.util - Async loop died! java.lang.NoSuchMetho

Getting Exception in kafka-storm

2014-06-11 Thread Anis Nasir
Dear all, I am getting below mentioned exception while running storm-kafka. Does anyone have seen this one before? 7800 [Thread-27-words] ERROR backtype.storm.util - Async loop died! java.lang.NoSuchMethodError: com.netflix.curator.framework. api.CreateBuilder.creatingParentsIfNeeded()Lcom/ net

Re: Non-DRPC topologies and number of assigned workers

2014-06-11 Thread Michael Rose
A topology can run in as many workers as you assign at launch time, DRPC or not. Michael Rose (@Xorlev ) Senior Platform Engineer, FullContact mich...@fullcontact.com On Wed, Jun 11, 2014 at 1:08 PM, Nima Movafaghrad < nima.movafagh...@or

Python - When spout dies, bolts keep receiving input on STDIN

2014-06-11 Thread Scot Kronenfeld
I am using Storm w/ my bolts and spouts written in Python. When I am running in a test environment locally I have a problem where if the spout dies, the bolts consume 100% CPU and gradually increase their memory. Here are the details: My spout is reading from mongo. Sometimes it loses its curso

Non-DRPC topologies and number of assigned workers

2014-06-11 Thread Nima Movafaghrad
Hi Community, Wondering if a non-drpc topology can run in multiple workers or is it just gonna run within one? Thanks, Nima

Storm-Starter: Intellij IDEA: Cannot resolve symbol 'LocalCluster'; Cannot resolve symbol 'LocalDPRC'

2014-06-11 Thread David Lee
​​ I intend to try out storm-starter. I followed instructions under header "Importing storm-starter as a project in IDEA" at https://github.com/apache/incubator-storm/tree/master/examples/storm-starter .* *With 3 differences (that I don't think resulted in the errors mentioned later in this po

Re: Impossible to create new topic on the google group

2014-06-11 Thread Benjamin SOULAS
Ok, I'll try. Thanks (Please accept my apologies if I don't speak English very well, but i not familiar enough with technical vocabulary, I'm a French Student) 2014-06-11 16:17 GMT+02:00 Jean-Sebastien Vachon < jean-sebastien.vac...@wantedanalytics.com>: > Just send an email to this same mai

RE: Impossible to create new topic on the google group

2014-06-11 Thread Jean-Sebastien Vachon
Just send an email to this same mailing-list, describing your problem the best as you can. From: Benjamin SOULAS [mailto:benjamin.soula...@gmail.com] Sent: June-11-14 9:20 AM To: user Subject: Re: Impossible to create new topic on the google group Okay, because I saw, after sending you that mail

Re: Impossible to create new topic on the google group

2014-06-11 Thread Benjamin SOULAS
Okay, because I saw, after sending you that mail, it was closed because of moving the mailing list somewhere else : user@storm.incubator.apache.org Now how am I suppose to do to explain my problems to the community? Thanks for your reply 2014-06-11 15:16 GMT+02:00 Jean-Sebastien Vachon < jean-s

RE: Impossible to create new topic on the google group

2014-06-11 Thread Jean-Sebastien Vachon
I believed this is due to the integration with Apache. They have to follow a certain standard which implies using a mailing-list… From: Benjamin SOULAS [mailto:benjamin.soula...@gmail.com] Sent: June-11-14 7:25 AM To: user@storm.incubator.apache.org Subject: Impossible to create new topic on the

Impossible to create new topic on the google group

2014-06-11 Thread Benjamin SOULAS
Hello, I just join the google group and the mailing list. I would like to create a topic on the google group, but apparently, I can't, could you tell me why? Thanks. Benjamin.

Strange behaviour during scalability tests.

2014-06-11 Thread Carl Wålinder
Hi, We are running a topology on one machine and limiting the number of cores that can be utilized by storm. The machine consists of 4 cores, and we do tests on 1 core, 2 core, etc.. However, we can not explain this strange behaviour which only occurs when we run the topology with 1 core. The stra

Re: [VOTE] Storm Logo Contest - Final Round

2014-06-11 Thread prabeesh k
#6 - 2pt On Wed, Jun 11, 2014 at 3:34 PM, Vinoth Kumar Kannan wrote: > #9 - 5 pts > > > On Wed, Jun 11, 2014 at 11:43 AM, B Kersbergen > wrote: > >> #6 - 5 pts. >> >> 2014-06-11 4:02 GMT+02:00 Corey Nolet : >> > 6 - 1pt >> > 9 - 4pt >> > >> > >> > On Tue, Jun 10, 2014 at 8:34 PM, Nathan Leung

Re: [VOTE] Storm Logo Contest - Final Round

2014-06-11 Thread Vinoth Kumar Kannan
#9 - 5 pts On Wed, Jun 11, 2014 at 11:43 AM, B Kersbergen wrote: > #6 - 5 pts. > > 2014-06-11 4:02 GMT+02:00 Corey Nolet : > > 6 - 1pt > > 9 - 4pt > > > > > > On Tue, Jun 10, 2014 at 8:34 PM, Nathan Leung wrote: > >> > >> #10 - 5 > >> > >> > >> On Tue, Jun 10, 2014 at 5:56 PM, Osman wrote: >

Re: [VOTE] Storm Logo Contest - Final Round

2014-06-11 Thread B Kersbergen
#6 - 5 pts. 2014-06-11 4:02 GMT+02:00 Corey Nolet : > 6 - 1pt > 9 - 4pt > > > On Tue, Jun 10, 2014 at 8:34 PM, Nathan Leung wrote: >> >> #10 - 5 >> >> >> On Tue, Jun 10, 2014 at 5:56 PM, Osman wrote: >>> >>> 9 5 >>> >>> On Jun 9, 2014 7:39 PM, "P. Taylor Goetz" wrote: This is a call t

Re: Storm initialization on startup

2014-06-11 Thread Michael Rose
We tend to push that kind of initialization logic into the prepare() method of our bolts. Most times, you only need one bolt to do it, so you can push all of your initialization logic into a different class and guard the init with double-check locks. e.g.: @Override public void prepare(Ma

Re: how to deploy storm-0.9.2-incubating to my own maven repos?

2014-06-11 Thread Haralds Ulmanis
Hi, If I remember right - you need to disable this plugin (comment out or delete lines): org.apache.maven.plugins maven-release-plugin true v@{project.version} On 1

RE: Storm initialization on startup

2014-06-11 Thread Aleksandar Stojadinovic
Hi, Thanks for your answer. It sounds like a good idea. I can put the parameters (read from database) in the configuration map in my main function and then read them in the configurator. Not too ideal, but a whole lot cleaner then any other I thought of. I'll try something like that. Yet I'm sti