Re: Apache Storm Graduation to a TLP

2014-09-24 Thread Kang Xiao
Great! 2014 年 9 月 24 日 下午 10:55于 Niels Basjes ni...@basjes.nl写道: What are the expected time line for changes like this: version0.9.3-incubating-SNAPSHOT/version in https://github.com/apache/storm/blob/master/pom.xml ? On Mon, Sep 22, 2014 at 11:16 PM, P. Taylor Goetz ptgo...@gmail.com

Re: FW: How to acknowlege the spout

2014-08-09 Thread Kang Xiao
. Happiest Minds Technologies http://www.happiestminds.com -- Best Regards! Kang Xiao,kxiao.ti...@gmail.com Distributed Software Engineer

回复: Error when trying to use multilang in a project built from scratch (not storm-starter)

2014-03-11 Thread Kang Xiao
Hi Chris The error message “Caused by: java.io.IOException: Cannot run program python”” showed that python is not in PATH env so it can not be invoked. You may try to specify the full path of python interpreter. -- Best Regards! 肖康(Kang Xiao,kxiao.ti...@gmail.com (mailto:kxiao.ti

回复: Unable to connect to storm drpc server

2014-03-11 Thread Kang Xiao
Hi Rohan As the error message indicated, you should use thrift TFramedTransport instead of TBufferedTransport in the client script since storm drpc server use TFramedTransport. -- Best Regards! 肖康(Kang Xiao,kxiao.ti...@gmail.com (mailto:kxiao.ti...@gmail.com)) Distributed Software

回复: swapping topologies

2014-03-09 Thread Kang Xiao
Hi Alexander We implemented a feature “storm update” to achieve topology online update. You can refer to this jira. https://issues.apache.org/jira/browse/STORM-167 -- Best Regards! 肖康(Kang Xiao,kxiao.ti...@gmail.com (mailto:kxiao.ti...@gmail.com)) Distributed Software Engineer 已使用 Sparrow

回复: can I partition streams on multiple fields? and what is the result?

2014-03-09 Thread Kang Xiao
out task out of them. So one tuple from C will be processed by one task of bolt “bolt” and this task will also receive the tuples from A and B with the same “field1”. -- Best Regards! 肖康(Kang Xiao,kxiao.ti...@gmail.com (mailto:kxiao.ti...@gmail.com)) Distributed Software Engineer 在 2014年3月7日

回复: Storm and custom throttling

2014-03-09 Thread Kang Xiao
Hi Neelesh Do you mean that you need a custom throttling logic by dropping some of the large volume messages? Maybe you can implement a spout to do that. -- Best Regards! 肖康(Kang Xiao,kxiao.ti...@gmail.com (mailto:kxiao.ti...@gmail.com)) Distributed Software Engineer 在 2014年3月6日 星期四,15

回复: resource aware task scheduling in Storm cluster

2014-03-09 Thread Kang Xiao
Hi, Alex You can also have a look at storm on yarn: https://github.com/yahoo/storm-yarn. -- Best Regards! 肖康(Kang Xiao,kxiao.ti...@gmail.com (mailto:kxiao.ti...@gmail.com)) Distributed Software Engineer 已使用 Sparrow (http://www.sparrowmailapp.com/?sig) 已使用 Sparrow (http

回复: why some slots can't start up?

2014-03-09 Thread 肖康(Kang Xiao)
is port 6709 already used by another process? -- Best Regards! 肖康(Kang Xiao) 在 2014年2月28日星期五,22:04,Sean Allen 写道: Have you gone to the log for worker-6709 on hadoop4 and looked for error messages? On Thu, Feb 27, 2014 at 8:39 PM, Norlan rchyf0...@gmail.com (mailto:rchyf0

回复: Storm and custom throttling

2014-03-09 Thread 肖康(Kang Xiao)
hi Neelesh, you can implement the feature and contribute to storm. -- Best Regards! 肖康(Kang Xiao) 在 2014年3月10日星期一,1:05,Neelesh 写道: Hi kang, thanks for the response. I don't wan to drop messages, but not emit them as tuples until the throttling rates reach a certain level. But you

回复: how to speed spout.nextTuple method up?

2014-03-09 Thread 肖康(Kang Xiao)
hi Link, Spout will sleep(default 1ms) if nextTuple emit zero tuple or max-spout-pending is reached. You can check jstack of spout to see what it is doing. -- Best Regards! 肖康(Kang Xiao) 在 2014年3月10日星期一,8:37,Link Wang 写道: hi all, I have a trouble about huge message reading in my

回复: CustomStreamGrouping: IndexOutOfBoundsException

2014-03-06 Thread 肖康(Kang Xiao)
It maybe that hashcode and index is less than zero. You can add debug log to print the two vars to verify. -- Best Regards! 肖康(Kang Xiao) 在 2014年3月6日星期四,22:51,James Xu 写道: What is _targetTasks is empty? On 2014年3月6日, at 下午10:28, 李家宏 jh.li...@gmail.com (mailto:jh.li...@gmail.com

回复: Millisecond-level tick generation granularity does not work

2014-02-18 Thread Kang Xiao
Hi Antonio James has created an JIRA issue https://issues.apache.org/jira/browse/STORM-186. And I just opened a PR https://github.com/apache/incubator-storm/pull/37 for it. -- Best Regards! 肖康(Kang Xiao,kxiao.ti...@gmail.com (mailto:kxiao.ti...@gmail.com)) Distributed Software Engineer