Re: question about spout emitted tuples

2014-11-06 Thread Yuheng Du
).fromJson(json, MyObj.class); > > If you want to send the MyObj instance from bolt to bolt, then just make > sure it implements Serializable, and you can emit it as part of a tuple. > > Steve > > On Thu, Nov 6, 2014 at 11:11 AM, Yuheng Du > wrote: > >> Hi Stephen, >&

Re: question about spout emitted tuples

2014-11-06 Thread Yuheng Du
< stephen.armstr...@linqia.com> wrote: > I'm currently doing json serialize/deserialize using gson-2.3 on > storm-0.9.2-incubating and it seems to be working fine. > > On Wed, Nov 5, 2014 at 5:18 PM, Yuheng Du wrote: > >> Does anyone implemented a JSON serialization sche

Re: question about spout emitted tuples

2014-11-05 Thread Yuheng Du
Does anyone implemented a JSON serialization scheme for Strom version >= 0.9.0? On Wed, Nov 5, 2014 at 2:24 PM, Yuheng Du wrote: > Hi guys, > > I am using rabbitmq-spout offered by > https://github.com/ppat/storm-rabbitmq to read data from rabbitmq. Here > is what I see in

question about spout emitted tuples

2014-11-05 Thread Yuheng Du
Hi guys, I am using rabbitmq-spout offered by https://github.com/ppat/storm-rabbitmq to read data from rabbitmq. Here is what I see in the console when I run the topology locally: 101703 [Thread-16-storm-obser-spout] INFO backtype.storm.daemon.executor - Acking message 33 113099 [Thread-16-storm

Re: spout for rabbitmq

2014-10-30 Thread Yuheng Du
Where can I find an implementation example of a payloadScheme, for example, the "SimpleJSONScheme"? Do I have to know each field name of my rabbitmq message in order to implement this Scheme class? What if the rabbitmq data is heterogeneous? Thanks. On Thu, Oct 30, 2014 at 12:40 PM,

Re: spout for rabbitmq

2014-10-30 Thread Yuheng Du
nctions in RabbitMQMessageScheme.java? Thanks for help. best, On Thu, Oct 30, 2014 at 11:54 AM, John Connolly wrote: > We use rabbitmq as a source for spouts pretty extensively. Have a look at > https://github.com/ppat/storm-rabbitmq > > On Thu, Oct 30, 2014 at 10:33 AM, Yuheng Du wrote: > >

spout for rabbitmq

2014-10-30 Thread Yuheng Du
Hi, Does anyone use rabbitmq as a spout? I just begin to use storm and I want to integrate it with rabbitmq. Can anyone provide a sample code to implement the backtype.storm.spout.Scheme to deserialize a RabbitMQ message payload? A simple example would be of great help. I am confused about this

Re:

2014-10-26 Thread Yuheng Du
What is your zookeeper configuration? Seems that your server configuration is incorrect. You can attach your storm.yaml for checking. On Sun, Oct 26, 2014 at 8:04 AM, Yu Yang wrote: > Hello all, > > I have just set up my storm cluster in local mode, and when I run my > first wordcount topology

Re: Storm installation

2014-10-24 Thread Yuheng Du
want to look at this spout implementation: > https://github.com/ppat/storm-rabbitmq > > -Taylor > > On Oct 22, 2014, at 12:53 AM, Yuheng Du > wrote: > > Hi Harsha, > > Thank you. The .tar ball I download was corrupted and the > log4j-over-slf4j-1.6.6.jar file was m

Re: running storm-stater in eclipse

2014-10-24 Thread Yuheng Du
arter. It is > now part of the main storm repo under /examples/storm-starter, and the > build is maven not leinengen. > > With eclipse maven support enabled, you should be able to import the > pom.xml file directly into eclipse. > > -Taylor > > > On Oct 24, 2014,

Re: Wordcount topology

2014-10-24 Thread Yuheng Du
at 6:09 AM, jova wrote: > I have not seen the wordcount topology example code. Can you post the > code where the topology is created? > > On Oct 23, 2014 6:25 PM, "Yuheng Du" wrote: > > > > Hi, > > > > I have specified the

Re: running storm-stater in eclipse

2014-10-23 Thread Yuheng Du
lean, to-maven, myeclipse-clean, add-maven-repo, rad, clean, myeclipse -> [Help 1] On Fri, Oct 24, 2014 at 1:03 AM, Yuheng Du wrote: > Hi All, > > I was trying to run the storm-stater project in eclipse with Maven plugin. > When I import the storm-stater project as a Maven project i

running storm-stater in eclipse

2014-10-23 Thread Yuheng Du
Hi All, I was trying to run the storm-stater project in eclipse with Maven plugin. When I import the storm-stater project as a Maven project into eclipse luna, The error I got is: Description Resource Path Location Type Plugin execution not covered by lifecycle configuration: com.theoryinpractise

Re: Wordcount topology

2014-10-23 Thread Yuheng Du
that is displayed by the ui is reversed in > the latest release. I believe this is a known issue. > On Oct 23, 2014 5:22 PM, "jova" wrote: > >> Did you specify the number of workers in your code? >> >> On Thu, Oct 23, 2014 at 4:50 PM, Yuheng Du wrote: >

Re: running nimbus problem

2014-10-23 Thread Yuheng Du
; From line 64: > JAVA_CMD = 'java' if not JAVA_HOME else os.path.join(JAVA_HOME, 'bin', > 'java') > > So if JAVA_HOME is set, it will try to use $JAVA_HOME/bin/java, otherwise > it will use the java found in your path. > > > > >

Re: running nimbus problem

2014-10-23 Thread Yuheng Du
hat > would make any difference, but might be worth trying to remove it. > > On Thu, Oct 23, 2014 at 9:26 AM, Yuheng Du wrote: > >> Hi everyone, >> >> When I run ./storm nimbus, it gives me the following message: >> >> yuheng@yuheng-StormVM:~/software/apach

running nimbus problem

2014-10-23 Thread Yuheng Du
Hi everyone, When I run ./storm nimbus, it gives me the following message: yuheng@yuheng-StormVM:~/software/apache-storm-0.9.2-incubating/bin$ ./storm nimbus Traceback (most recent call last): File "./storm", line 472, in main() File "./storm", line 469, in main (COMMANDS.get(COMMAND

Re: Storm installation

2014-10-21 Thread Yuheng Du
t; do you see these jars under apache-storm-0.9.2-incubating/lib/ > > log4j-over-slf4j-1.6.6.jar, > logback-classic-1.0.6.jar,logback-core-1.0.6.jar > and also send us your storm.yaml file. > -Harsha > > > On Tue, Oct 21, 2014, at 08:49 PM, Yuheng Du wrote: > > The sy

Re: Storm installation

2014-10-21 Thread Yuheng Du
The system I am using is Ubuntu 14. Will that be the problem? On Tue, Oct 21, 2014 at 11:44 PM, Yuheng Du wrote: > When I run ./storm nimbus, It shows: > > root@yuheng-laptop:~/software/apache-storm-0.9.2-incubating/bin# ./storm > nimbus > output > &g

Re: Storm installation

2014-10-21 Thread Yuheng Du
Class(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:425) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:358) ... 20 more Any ideas or suggestions? best, Yuheng On Tue, Oct 21, 2014 at 9:49 PM, Yuheng Du

Re: Storm installation

2014-10-21 Thread Yuheng Du
tty by default >>> but zeromq can be configurable if user prefers. >>> -Harsha >>> >>> >>> On Tue, Oct 21, 2014, at 06:04 PM, Telles Nobrega wrote: >>> >>> It is not necessary to install ZeroMQ and JZMQ anymore? >>> >>> On

Re: Storm installation

2014-10-21 Thread Yuheng Du
x > > https://gist.github.com/saiprasadmishra/a50c730b67334c05f1e1 > > > > On Tue, Oct 21, 2014 at 1:58 PM, Yuheng Du > wrote: > >> Hi everyone, >> >> I am a newbie to Storm. I tried to set up the stand-alone environment on >> my desktop. I have installed the Ho

Storm installation

2014-10-21 Thread Yuheng Du
Hi everyone, I am a newbie to Storm. I tried to set up the stand-alone environment on my desktop. I have installed the Hortonworks sandbox. But it gives me some error on running storm-ui. Does anyone uses the Hortonworks Sandbox? Where can I find a convenient installation guide? Thanks. best,