Re: ShellSpout hangs on reportError?

2015-02-12 Thread William Oberman
} else { throw e; } } == and now everything starts to work as I expected. Does this patch make any sense? Or is it a bandaid over a deeper issue? will On Thu, Feb 12, 2015 at 2:15 PM, William Oberman wrote: > Ok, I realized that I did NOT check if ShellSpout.d

Re: ShellSpout hangs on reportError?

2015-02-12 Thread William Oberman
QMARK_$fn__3279.invoke(zookeeper.clj:101) ~[storm-core-0.9.3.jar:0.9.4-SNAPSHOT] ... 17 common frames omitted On Wed, Feb 11, 2015 at 4:27 PM, William Oberman wrote: > I'm not sure what I've learned adds up to yet > > I tried setting up a local storm development environment.

Re: ShellSpout hangs on reportError?

2015-02-11 Thread William Oberman
(based on name alone) for something that is blocking things up :-) Though, once again, not understanding the big picture of storm, I have no idea what all of the above adds up to in terms of what's wrong, and how to fix it still will On Wed, Feb 11, 2015 at 1:31 PM, William Oberman

Re: ShellSpout hangs on reportError?

2015-02-11 Thread William Oberman
> Best regards, > > On Tue, Feb 10, 2015 at 8:59 PM, William Oberman > wrote: > >> I'm not sure the best way to share a test case. I'll copy and paste code >> below If you run the below code (and find the worker that was running >> it's log fi

Re: ShellSpout hangs on reportError?

2015-02-10 Thread William Oberman
$this->sync(); } } protected function init($stormConf, $topologyContext) { return; } final protected function emit(array $tuple, $messageId = null, $streamId = null) { return $this->emitTuple($tuple, $messageId, $streamId, null); } final

ShellSpout hangs on reportError?

2015-02-06 Thread William Oberman
Hi, For reference, I'm talking about 0.9.3 ShellSpout, line 234. I'll try to cover the important facts that led to this issue: -I was on 0.9.2 using multilang to bridge to PHP to get to some existing business logic -I'm testing the 0.9.3 upgrade (yes, I see the new heartbeat addition to the She

Re: logviewer access without public ips

2014-12-01 Thread William Oberman
I asked a similar question in October without response. I'm not sure what other people do to work around this but I've mostly just started skipping the UI and using (parallel) SSH if I need to peek at worker logs. will On Sun, Nov 30, 2014 at 4:07 PM, Luke Rohde wrote: > Hi - I have a storm cl

Re: STORM-513

2014-11-27 Thread William Oberman
#x27;s better than current, but it would be not easy because of > "multilang", and AFAIK PHP doesn't have real thread so PHP is an example. > > Hope this helps. > > Regards. > Jungtaek Lim (HeartSaVioR) > > On 2014년 11월 27일 (목) at 오전 12:35 William Oberman

STORM-513

2014-11-26 Thread William Oberman
I was reading the release notes for 0.9.3, and STORM-513 concerns me. I'm using php, which being single threaded will have challenges to respond in a timely manner to a sync command. I just checked, and supervisor.worker.timeout.secs defaults to 30 seconds, which I'll have to sadly increase (glob

Re: Topology periodically stalls until manually restarted

2014-11-19 Thread William Oberman
I don't know about what caused your initial failure (for me it's an bolt that wraps PHP, and the PHP OOMs periodically), but I also had Netty get jammed up trying to recover from the failure in 0.9.3-rc1 with similar logging. For me, patching with https://github.com/apache/storm/pull/268 (STORM-32

Re: "graceful" multilang failures

2014-11-13 Thread William Oberman
------------- > *From:* William Oberman > *Sent:* Thursday, November 13, 2014 8:39 PM > *To:* user@storm.apache.org > *Subject:* Re: "graceful" multilang failures > > STORM-513 is really interesting. Unless I'm totally misunderstanding, > heartbeat was

Re: "graceful" multilang failures

2014-11-13 Thread William Oberman
ent process died - like so > http://stackoverflow.com/questions/24930670/execute-function-in-php-before-sigterm > . And in the handler self destruct the php process. This ensures that there > are no zombie PHP processes running wild. > > > Regards, > > Itai > > >

"graceful" multilang failures

2014-11-13 Thread William Oberman
I was wondering if there is a way to force a graceful failure for a multilang Bolt. Basically, I have a web app written in PHP (that's never going to change unfortunately). It has highly parallelizable backend processing (also written in PHP of course to reuse the biz logic) I used to self manage

Re: ack and fail

2014-11-13 Thread William Oberman
Thanks for settling the bet! will On Wed, Nov 12, 2014 at 4:53 PM, Vladi Feigin wrote: > Hi > It doesn't make sense to call both on the same tuple > Vladi > > On Wed, Nov 12, 2014 at 11:19 PM, William Oberman < > ober...@civicscience.com> wrote: > >>

ack and fail

2014-11-12 Thread William Oberman
A coworker & I are debating this code: -- try { ... } catch(Exception e) { collector.fail(tuple); } collector.ack(tuple); --- His claim is ack() is acknowledgement of end of processing. E.g. you ALWAYS have to call ack() (to stop the implicit timeout you're working against),

Re: multilang + failure modes

2014-10-23 Thread William Oberman
I'm thinking I'm getting hit with: https://issues.apache.org/jira/browse/STORM-442 On Thu, Oct 23, 2014 at 3:10 PM, William Oberman wrote: > Before I really dig into things, I want to see if this makes any sense. > I'm running 0.92, and still fairly a novice. > > Usi

multilang + failure modes

2014-10-23 Thread William Oberman
Before I really dig into things, I want to see if this makes any sense. I'm running 0.92, and still fairly a novice. Using multilang to bridge into existing BL code (in php, don't ask). I'm seeing part of my topology grind to a halt in the wild. My theory is it has something with php failure mod

Storm UI best practices

2014-10-21 Thread William Oberman
Hello, Right now I'm viewing the Storm UI via a SSH tunnel. I tried to add in the log viewer UI, but this uses names/IPs of the internal cluster in the links (which obviously doesn't work). What is the best practice here? For Hadoop, I just use lynx local to the machine. But, Storm's UI doesn'