Re: Block spout

It depends what you want so accomplish... You can always "sleep" in Spout.nextTuple() to block the spout for a finite time. As an alternative, you can limit the number of pending tuples be setting parameter "topology.max.spout.pending" (be aware that tuples might time out in this case). Sending a

Re: Block spout

No, currently there's no way to leave a message from downstream to upstream. Other tricky way is sharing external storage (like ZK) and setting a flag value manually. Hope this helps. Thanks, Jungtaek Lim (HeartSaVioR) 2015년 6월 29일 월요일, Pradheep s님이 작성한 메시지: > Hi, > > I have a spout which is em

Re: Block spout

Hi, The problem i have is that, i write the tuples received form a spout to a file through a bolt. I also use another thread to read form it. Sometime the writer might overtake reader and override tuple which the reader has to read and lose tuples. So i have to avoid this.. I heard about two things

Re: Block spout

I don't know the "storm signals" project you mentioned. It might work for you. It is not part of storm-core system. However, I do not understand why you write to a file and read from it again. Why not using one more bolt and just process the tuples there? I would also not sleep the spout in your

Re: Block spout

Hi Pradeep, It seems you want to send one tuple from spout to Bolt then bolt will write it to a file and some other cosumer/bolt will read from file. And while consumer reading, other tuple can be received by bolt and may write more content on the same file. is this right? if yes then continue read

[GitHub] storm pull request: STORM-917 : Ability to emit from the spout to ...

Github user harshach commented on the pull request: https://github.com/apache/storm/pull/601#issuecomment-116731268 @anishek can you please add this config to README.md https://github.com/apache/storm/blob/master/external/storm-kafka/README.md few lines about what it does. --- I

[jira] [Commented] (STORM-917) Ability to emit messages from a kafka spout to a specific stream

[ https://issues.apache.org/jira/browse/STORM-917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14605756#comment-14605756 ] ASF GitHub Bot commented on STORM-917: -- Github user harshach commented on the pull req

[GitHub] storm pull request: STORM-817: Support for Kafka Wildcard topics

Github user jfgreen commented on the pull request: https://github.com/apache/storm/pull/561#issuecomment-116736180 This would be super awesome to have merged. Currently having to enumerate a lot of topics into multiple spouts. --- If your project is set up for it, you can reply to th

[jira] [Commented] (STORM-817) Kafka Wildcard Topic Support

[ https://issues.apache.org/jira/browse/STORM-817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14605776#comment-14605776 ] ASF GitHub Bot commented on STORM-817: -- Github user jfgreen commented on the pull requ

[GitHub] storm pull request: STORM-917 : Ability to emit from the spout to ...

Github user anishek commented on the pull request: https://github.com/apache/storm/pull/601#issuecomment-116737782 @harshach I did add the line with the comment in the https://github.com/apache/storm/blob/master/external/storm-kafka/README.md stating what it does under the set of co

[jira] [Commented] (STORM-917) Ability to emit messages from a kafka spout to a specific stream

[ https://issues.apache.org/jira/browse/STORM-917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14605783#comment-14605783 ] ASF GitHub Bot commented on STORM-917: -- Github user anishek commented on the pull requ

[GitHub] storm pull request: STORM-817: Support for Kafka Wildcard topics

Github user harshach commented on the pull request: https://github.com/apache/storm/pull/561#issuecomment-116740320 @sumitchawla can you upmerge this I'll take a look. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as we

[jira] [Commented] (STORM-817) Kafka Wildcard Topic Support

[ https://issues.apache.org/jira/browse/STORM-817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14605799#comment-14605799 ] ASF GitHub Bot commented on STORM-817: -- Github user harshach commented on the pull req

[jira] [Created] (STORM-918) Storm CLI could validate arguments/print usage

Derek Dagit created STORM-918: - Summary: Storm CLI could validate arguments/print usage Key: STORM-918 URL: https://issues.apache.org/jira/browse/STORM-918 Project: Apache Storm Issue Type: Impro

[GitHub] storm pull request: STORM-817: Support for Kafka Wildcard topics

Github user sumitchawla commented on the pull request: https://github.com/apache/storm/pull/561#issuecomment-116774534 @harshach change is merged. Build failed for jdk 8 due to an unrelated error. Please review and provide your comments. --- If your project is set up for it, you c

[jira] [Commented] (STORM-817) Kafka Wildcard Topic Support

[ https://issues.apache.org/jira/browse/STORM-817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14605990#comment-14605990 ] ASF GitHub Bot commented on STORM-817: -- Github user sumitchawla commented on the pull

[jira] [Commented] (STORM-908) AWS workers can't communicate due to Netty-Client hostname resolution

[ https://issues.apache.org/jira/browse/STORM-908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14605992#comment-14605992 ] Brian Fleming commented on STORM-908: - Clarification, this is on amazon EC2 instances,

[GitHub] storm pull request: STORM-912: Support SSL on Logviewer

Github user knusbaum commented on the pull request: https://github.com/apache/storm/pull/604#issuecomment-116782822 Fixed the boolean condition. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[jira] [Commented] (STORM-912) Support SSL on Logviewer

[ https://issues.apache.org/jira/browse/STORM-912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606056#comment-14606056 ] ASF GitHub Bot commented on STORM-912: -- Github user knusbaum commented on the pull req

New Committer/PMC Member: Jungtaek Lim

Please join me in welcoming Jungtaek Lim (AKA “HeartSaVioR") as a new Apache Storm Committer and PMC member. Jungtaek has demonstrated a strong commitment to the Apache Storm community through active participation and mentoring on the Storm mailing lists. Furthermore, he has authored many enhan

Re: New Committer/PMC Member: Jungtaek Lim

Congrats Jungtaek! On 06/29/2015 09:26 PM, P. Taylor Goetz wrote: > Please join me in welcoming Jungtaek Lim (AKA “HeartSaVioR") as a new Apache > Storm Committer and PMC member. > > Jungtaek has demonstrated a strong commitment to the Apache Storm community > through active participation and m

Re: New Committer/PMC Member: Jungtaek Lim

Welcome, Jungtaek! -- Derek - Original Message - From: P. Taylor Goetz To: dev@storm.apache.org Cc: Sent: Monday, June 29, 2015 2:26 PM Subject: New Committer/PMC Member: Jungtaek Lim Please join me in welcoming Jungtaek Lim (AKA “HeartSaVioR") as a new Apache Storm Committer an

Storm meetup in Seattle

Hi Storm users and devs, We have started a meet up for storm and kafka users and devs. http://www.meetup.com/Apache-Storm-Kafka-Users/. I recommend anyone interested in storm or stream processing to join the meet up. Thanks Parth

[GitHub] storm pull request: STORM-859 Add regression test of STORM-856

Github user HeartSaVioR commented on the pull request: https://github.com/apache/storm/pull/588#issuecomment-116858810 Build failure is coming from storm-kafka since my PR is established before excluding storm-kafka from Travis CI. --- If your project is set up for it, you can reply

[jira] [Commented] (STORM-859) Add unit test to prevent regression of STORM-856

[ https://issues.apache.org/jira/browse/STORM-859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606482#comment-14606482 ] ASF GitHub Bot commented on STORM-859: -- Github user HeartSaVioR commented on the pull

Re: New Committer/PMC Member: Jungtaek Lim

Congrats & Welcome Jungtaek -Harsha On Mon, Jun 29, 2015, at 01:30 PM, Derek Dagit wrote: > Welcome, Jungtaek! > > > -- > Derek > > > > - Original Message - > From: P. Taylor Goetz > To: dev@storm.apache.org > Cc: > Sent: Monday, June 29, 2015 2:26 PM > Subject: New Committer/PMC

Re: New Committer/PMC Member: Jungtaek Lim

Yes Congratulations well deserved.  - Bobby On Monday, June 29, 2015 4:58 PM, Harsha wrote: Congrats & Welcome Jungtaek -Harsha On Mon, Jun 29, 2015, at 01:30 PM, Derek Dagit wrote: > Welcome, Jungtaek! > >  > -- > Derek > > > > - Original Message - > From: P. Taylor

[GitHub] storm pull request: STORM-843 Add Javadoc to storm-redis

Github user HeartSaVioR commented on the pull request: https://github.com/apache/storm/pull/594#issuecomment-116862007 I'll merge it into master. Btw, since 0.10.0-beta introduces storm-redis for the first time, I'd like to include this PR to 0.10.x-branch, too. @ptgoetz D

[jira] [Commented] (STORM-843) [storm-redis] Add Javadoc to storm-redis

[ https://issues.apache.org/jira/browse/STORM-843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606528#comment-14606528 ] ASF GitHub Bot commented on STORM-843: -- Github user HeartSaVioR commented on the pull

[GitHub] storm pull request: STORM-843 Add Javadoc to storm-redis

Github user asfgit closed the pull request at: https://github.com/apache/storm/pull/594 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Commented] (STORM-843) [storm-redis] Add Javadoc to storm-redis

[ https://issues.apache.org/jira/browse/STORM-843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606532#comment-14606532 ] ASF GitHub Bot commented on STORM-843: -- Github user asfgit closed the pull request at:

[jira] [Resolved] (STORM-843) [storm-redis] Add Javadoc to storm-redis

[ https://issues.apache.org/jira/browse/STORM-843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved STORM-843. Resolution: Fixed Fix Version/s: 0.11.0 Thanks Bobby for recommendation and Harsha for reviewi

[GitHub] storm pull request: [STORM-763] nimbus reassigned worker A to anot...

Github user eshioji commented on the pull request: https://github.com/apache/storm/pull/568#issuecomment-116872325 @revans2 No worries! Just to clarify, do I create a pull request for 0.10.x AND master? --- If your project is set up for it, you can reply to this email and ha

[jira] [Commented] (STORM-763) nimbus reassigned worker A to another machine, but other worker's netty client can't connect to the new worker A

[ https://issues.apache.org/jira/browse/STORM-763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606579#comment-14606579 ] ASF GitHub Bot commented on STORM-763: -- Github user eshioji commented on the pull requ

[GitHub] storm pull request: STORM-866: Use storm.log.dir instead of storm....

Github user HeartSaVioR commented on the pull request: https://github.com/apache/storm/pull/592#issuecomment-116873544 I'd like to include this into 0.10.x-branch since it's a bug, and we're having a chance to fix it before releasing stable version. --- If your project is set up for

[jira] [Commented] (STORM-866) Use storm.log.dir instead of storm.home in log4j2 config

[ https://issues.apache.org/jira/browse/STORM-866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606589#comment-14606589 ] ASF GitHub Bot commented on STORM-866: -- Github user HeartSaVioR commented on the pull

[GitHub] storm pull request: STORM-917 : Ability to emit from the spout to ...

Github user harshach commented on the pull request: https://github.com/apache/storm/pull/601#issuecomment-116895161 @anishek my bad missed it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[jira] [Commented] (STORM-917) Ability to emit messages from a kafka spout to a specific stream

[ https://issues.apache.org/jira/browse/STORM-917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606770#comment-14606770 ] ASF GitHub Bot commented on STORM-917: -- Github user harshach commented on the pull req

[jira] [Created] (STORM-919) Gathering worker and supervisor process information (CPU/Memory/Bandwidth)

Shyam Rajendran created STORM-919: - Summary: Gathering worker and supervisor process information (CPU/Memory/Bandwidth) Key: STORM-919 URL: https://issues.apache.org/jira/browse/STORM-919 Project: Apa

Re: New Committer/PMC Member: Jungtaek Lim

Thanks everyone! Jungtaek Lim (HeartSaVioR) 2015-06-30 7:00 GMT+09:00 Bobby Evans : > Yes Congratulations well deserved. > - Bobby > > > > On Monday, June 29, 2015 4:58 PM, Harsha wrote: > > > Congrats & Welcome Jungtaek > -Harsha > > On Mon, Jun 29, 2015, at 01:30 PM, Derek Dagit wrote: