[GitHub] storm pull request: STORM-188: Allow user to specifiy full configu...

2015-10-09 Thread clockfly
Github user clockfly closed the pull request at: https://github.com/apache/storm/pull/120 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] storm pull request: STORM-188: Allow user to specifiy full configu...

2015-10-09 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/120#issuecomment-146773478 Sure. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] storm pull request: STORM-188. Allow user to specifiy full configu...

2015-04-01 Thread clockfly
Github user clockfly commented on a diff in the pull request: https://github.com/apache/storm/pull/495#discussion_r27561927 --- Diff: storm-core/src/jvm/backtype/storm/utils/Utils.java --- @@ -135,35 +137,68 @@ public static void sleep(long millis

[GitHub] storm pull request: STORM-188. Allow user to specifiy full configu...

2015-03-31 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/495#issuecomment-88295467 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] storm pull request: STORM-329 : buffer message in client and recon...

2015-03-17 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/268#issuecomment-82196521 I will ask Ted to close this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] storm pull request: Client (Netty): improving logging to help trou...

2015-03-11 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/463#issuecomment-78255547 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] storm pull request: STORM-329: fix cascading Storm failure by impr...

2015-02-12 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/429#issuecomment-74084548 +1 On Thu, Feb 12, 2015 at 6:44 PM, Michael G. Noll notificati...@github.com wrote: Thanks for your feedback, Nathan. As far as I

[GitHub] storm pull request: STORM-329 : buffer message in client and recon...

2015-02-11 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/268#issuecomment-73909944 @miguno, I am sure you are aware that you can still send data to this channel even if channel.isWritable return false. check http://netty.io/4.0/api/io

[GitHub] storm pull request: STORM-329 : buffer message in client and recon...

2015-02-11 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/268#issuecomment-73910187 So, I don't think your TODO comment is a issue, it is actually designed like this, how do you think? --- If your project is set up for it, you can reply to this email

[GitHub] storm pull request: STORM-329: fix cascading Storm failure by impr...

2015-02-11 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/428#issuecomment-73925561 Something like git rebase -i upstream/master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] storm pull request: STORM-329: fix cascading Storm failure by impr...

2015-02-11 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/428#issuecomment-73932513 I see, there are multiple remote-merging, which then make rebase impossible. How about create a patch file against master and then apply the patch with new

[GitHub] storm pull request: STORM-329 : buffer message in client and recon...

2015-02-09 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/268#issuecomment-73651894 +1 on the update, the patch is well written. I made a few comments under reivew panel of https://github.com/miguno/storm/commit

[GitHub] storm pull request: STORM-188: Allow user to specifiy full configu...

2015-01-09 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/120#issuecomment-69435220 @revans, Feel free to do what you want, change it, or replace it.:) --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] storm pull request: STORM-329 : buffer message in client and recon...

2014-12-15 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/268#issuecomment-67047625 @nathanmarz , I'd like to explain why I need to change worker.clj. This was also motivated by a legacy TODO in in zmq.clj. https://github.com

[GitHub] storm pull request: STORM-329 : buffer message in client and recon...

2014-12-11 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/268#issuecomment-66620738 @tedxia Thanks, I think this will work. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] storm pull request: STORM-329 : buffer message in client and recon...

2014-12-11 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/268#issuecomment-66620748 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] storm pull request: STORM-329 : buffer message in client and recon...

2014-12-05 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/268#issuecomment-65763659 Thanks Ted, Yes, we need a fine-grained lock at ”synchronrized connect() “. I see you changed it to use schedule Runnable, it may cause deadlock

[GitHub] storm pull request: STORM-329 : buffer message in client and recon...

2014-11-18 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/268#issuecomment-63443152 It seems common in storm UT to have random failures. We may need to clean Storm UT to make it faster and more robust. --- If your project is set up for it, you

[GitHub] storm pull request: STORM-188: Allow user to specifiy full configu...

2014-11-17 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/120#issuecomment-63431309 The original behavior of findAndReadConfigFile() is to locate config file on classpath. findResources(name) will not be empty when name exists on classpath

[GitHub] storm pull request: STORM-329 : buffer message in client and recon...

2014-11-10 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/268#issuecomment-62509705 @tedxia The thread pool size of clientScheduleService is decided by worker number (also =1 and = 10). For example, if there are 2 worker, the pool size is 1

[GitHub] storm pull request: STORM-550:fix bug get an error when use --conf...

2014-11-10 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/310#issuecomment-62510083 Seems this is duplicate of STORM-188 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] storm pull request: [STORM-537] A worker reconnects infinitely to ...

2014-11-05 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/304#issuecomment-61921292 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] storm pull request: [STORM-537] A worker reconnects infinitely to ...

2014-11-04 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/304#issuecomment-61605751 @Sergeant007, Nice find about the channel = null. I am a little scared by the complexity of the test code, I am +1 if you: 1. add a comment

[GitHub] storm pull request: [STORM-537] A worker reconnects infinitely to ...

2014-11-04 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/304#issuecomment-61605948 Also, can you remove the braket [] around the storm id. github cannot link with apache jira if you have that. --- If your project is set up for it, you can

[GitHub] storm pull request: STORM-456:Storm UI cannot navigate to topology...

2014-11-04 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/303#issuecomment-61631456 @NareshKosgi, Have you considered other special character that may used as topology name? Like the table, #, , (, and etc.. Is it possble

[GitHub] storm pull request: [STORM-442] multilang ShellBolt/ShellSpout die...

2014-11-04 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/305#issuecomment-61631943 @itaifrenkel, ``` When you say the parent process fails do you mean that the worker process is no longer running? ``` No, it means the case

[GitHub] storm pull request: STORM-378,SleepSpoutWaitStrategy.emptyEmit sho...

2014-11-04 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/295#issuecomment-61634029 To make the whole topology responsive, the spout need to stay active to pull data frequently from acker or system tick. When setting

[GitHub] storm pull request: STORM-493: Workers inherit storm.conf.file/sto...

2014-11-04 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/252#issuecomment-61639159 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] storm pull request: STORM-497: don't modify the mapping while the ...

2014-11-03 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/257#issuecomment-61579721 @HeartSaVioR, The performance is not a concern, since taskToQueueId will only be modified for a few times. +1 for the patch --- If your project is set

[GitHub] storm pull request: STORM-188: Allow user to specifiy full configu...

2014-11-03 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/120#issuecomment-61599764 @d2r , sorry it takes so long. Now, the patch is synced with upstream. --- If your project is set up for it, you can reply to this email and have your

[GitHub] storm pull request: Update README.md

2014-11-03 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/292#issuecomment-61600425 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] storm pull request: STORM-253: Allow storm worker to use dynamic p...

2014-11-03 Thread clockfly
GitHub user clockfly reopened a pull request: https://github.com/apache/storm/pull/45 STORM-253: Allow storm worker to use dynamic port instead of pre-configed. Add a ne... PR for [STORM-253](https://issues.apache.org/jira/browse/STORM-253) Allow supervisor to decide

[GitHub] storm pull request: Update README.md

2014-11-03 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/292#issuecomment-61601001 @lukedemi Please add the JIRA number to the title of the pull request? --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] storm pull request: STORM-329 : buffer message in client and recon...

2014-11-02 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/268#issuecomment-61410622 Hi HeartSaVioR, For acked topology, there is at least once delivery gurantee. When a tuple is dropped, the tuple cached at spout side will timeout

[GitHub] storm pull request: STORM-329 : buffer message in client and recon...

2014-11-01 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/268#issuecomment-61373371 I traced back the bug of message loss. I found this issue is introduced by storm-350. (https://github.com/apache/storm/pull/134/files#diff

[GitHub] storm pull request: STORM-329 : buffer message in client and recon...

2014-11-01 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/268#issuecomment-61392411 When I reverted STORM-350, and test it again. There is no more message loss. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] storm pull request: STORM-329 : buffer message in client and recon...

2014-11-01 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/268#issuecomment-61393103 High Availability test === test scenario: 4 machine A,B,C,D, 4 worker, 1 worker on each machine test case1(STORM-404): on machine A, kill

[GitHub] storm pull request: STORM-329 : buffer message in client and recon...

2014-11-01 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/268#issuecomment-61393801 Summary of the test: UT pass STORM-404 pass STORM-510 pass Performacne regression pass --- If your project is set up for it, you

[GitHub] storm pull request: STORM-329 : buffer message in client and recon...

2014-11-01 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/268#issuecomment-61393817 Hi Ted, Can you try this on your live cluster and contribute some real case test result? --- If your project is set up for it, you can reply to this email

[GitHub] storm pull request: STORM-329 : buffer message in client and recon...

2014-10-31 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/268#issuecomment-61286844 About performance test: === I tested the performance of new patch. It has no sigificant difference with storm-0.92

[GitHub] storm pull request: STORM-329 : buffer message in client and recon...

2014-10-31 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/268#issuecomment-61287291 During this test, I found there was message loss, but it was not caused by this new patch. I traced back, seems the fault is introduced with changes between

[GitHub] storm pull request: STORM-329 : buffer message in client and recon...

2014-10-28 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/268#issuecomment-60870953 @tedxia I got a chance to chat with Ted online. In summary, he is descrbing the following case (worker A - worker B): 1. B dies 2. after zk session

[GitHub] storm pull request: STORM-329 : buffer message in client and recon...

2014-10-28 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/268#issuecomment-60871259 ``` If worker doesn't get update of B from zookeeper after 300 reconnection retries, should we exit the worker or let worker continues to work

[GitHub] storm pull request: STORM-329 : buffer message in client and recon...

2014-10-28 Thread clockfly
Github user clockfly commented on a diff in the pull request: https://github.com/apache/storm/pull/268#discussion_r19519682 --- Diff: storm-core/src/clj/backtype/storm/daemon/worker.clj --- @@ -378,9 +392,15 @@ _ (refresh-connections nil) _ (refresh

[GitHub] storm pull request: STORM-329 : buffer message in client and recon...

2014-10-19 Thread clockfly
Github user clockfly commented on a diff in the pull request: https://github.com/apache/storm/pull/268#discussion_r19065812 --- Diff: storm-core/src/clj/backtype/storm/daemon/worker.clj --- @@ -330,6 +330,20 @@ (.send drainer node+port-socket

[GitHub] storm pull request: STORM-329 : buffer message in client and recon...

2014-10-17 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/storm/pull/268#issuecomment-59487520 Support we are sending data from worker A to worker B, to solve STORM-404(Worker on one machine crashes due to a failure of another worker on another machine