Re: [zeromq-dev] ZMQ 2-x PUBSUB when router dies

2012-06-01 Thread Pieter Hintjens
On Fri, Jun 1, 2012 at 11:59 PM, Alex Sergeyev wrote: > Yeah, I'll probably go this way. The thing is that publisher did not > die, it's the router in-between them that gone away suddenly (crashed > in a way similar to unplugging it or separating network physically > without letting the endpoints

Re: [zeromq-dev] ZMQ 2-x PUBSUB when router dies

2012-06-01 Thread Alex Sergeyev
Yeah, I'll probably go this way. The thing is that publisher did not die, it's the router in-between them that gone away suddenly (crashed in a way similar to unplugging it or separating network physically without letting the endpoints know about it). IMO tcp keepalive that you have in 3.1 could b

Re: [zeromq-dev] ZMQ 2-x PUBSUB when router dies

2012-06-01 Thread Pieter Hintjens
On Fri, Jun 1, 2012 at 9:37 PM, Alex Sergeyev wrote: > One router core-dumped today. Subscriber behind it never realized that > it's time to reconnect and kept waiting for messages until I realized > that data is not there... Do you know what is the scenario of events > for such situation? How lo

Re: [zeromq-dev] new zeromq plugins for rsyslog

2012-06-01 Thread Pieter Hintjens
On Fri, Jun 1, 2012 at 7:36 PM, Brian Knox wrote: > I just wanted to give everyone a heads up that our new zeromq input and > output plugins for rsyslog are now in the official rsyslog repo... Nice! -Pieter ___ zeromq-dev mailing list zeromq-dev@lists

[zeromq-dev] ZMQ 2-x PUBSUB when router dies

2012-06-01 Thread Alex Sergeyev
Hi, I have interesting observation which is probably could not be addressed in ZMQ, just to confirm I'm not crazy and things should be this way. One router core-dumped today. Subscriber behind it never realized that it's time to reconnect and kept waiting for messages until I realized that data i

Re: [zeromq-dev] new zeromq plugins for rsyslog

2012-06-01 Thread Paul Colomiets
Hi Brian, On Fri, Jun 1, 2012 at 8:36 PM, Brian Knox wrote: > I just wanted to give everyone a heads up that our new zeromq input and > output plugins for rsyslog are now in the official rsyslog repo, on head in > the master branch ( http://www.rsyslog.com/doc/build_from_repo.html). > There's a l

Re: [zeromq-dev] zmq_poll and fully asynchronous client-server

2012-06-01 Thread Paul Colomiets
Hi Jigar, On Fri, Jun 1, 2012 at 3:55 PM, Jigar Gosar wrote: > *  Java's "selector" has a wakeup method, which immediately returns > the "selector.select(10ms)"  blocking call. I need something similar > so as to be able to achieve the above goal. > The exact equivalent to wakeup method is creat

[zeromq-dev] new zeromq plugins for rsyslog

2012-06-01 Thread Brian Knox
I just wanted to give everyone a heads up that our new zeromq input and output plugins for rsyslog are now in the official rsyslog repo, on head in the master branch ( http://www.rsyslog.com/doc/build_from_repo.html). There's a little info on our company blog about them ( http://www.talksum.com/blo

Re: [zeromq-dev] Round robin problems with offline servers

2012-06-01 Thread Ian Barber
OK, I've knocked up a patch that demonstrates this functionality with the use of a sockopt ZMQ_DELAY_ATTACH_ON_CONNECT - I would really appreciate a review on it, to make sure I haven't borked anything, or done something horrible with session_base_t: https://github.com/zeromq/libzmq/pull/357 The

Re: [zeromq-dev] Statistics protocol v0.1

2012-06-01 Thread Gregg Irwin
How tightly do you want to couple sources and sinks? e.g., do you need type1 and type2 as part of the protocol? I haven't used RRD, but that's the model, correct? Starting from a minimum spec, I sometimes write a statement answering the WHY question for things included beyond the minimum. For exam

Re: [zeromq-dev] Round robin problems with offline servers

2012-06-01 Thread Ian Barber
On Fri, Jun 1, 2012 at 12:33 PM, Pieter Hintjens wrote: > > > > b) patch the code to provide a socket option that treats connecting as > > though the pipe is full. > > Best. > Agreed - this is definitely the nice way to go. > Actually I don't see the benefit of a round robin using connecting >

Re: [zeromq-dev] Statistics protocol v0.1

2012-06-01 Thread Marten Feldtmann
Just short answers to your questions: -> symbolic name of the statistic producer (0MQ node) -> sub-symbolic name of the statistic producer (0MQ node) > why not just a name? why is a two level hierarchy exposed at this level? Just for aggregation purposes - the stuff may be written into

[zeromq-dev] zmq_poll and fully asynchronous client-server

2012-06-01 Thread Jigar Gosar
* How can one interrupt a zmq_poll call. * The reason I need this is to reduce the latency of data that has to be sent out. * Here is an example scenario: * I need to be able to read and write to a zmq socket, concurrently as and when events in the system are generated. * If I do zmq_poll with

Re: [zeromq-dev] Statistics protocol v0.1

2012-06-01 Thread Andrew Hume
comments interpolated below. On Jun 1, 2012, at 1:40 AM, Marten Feldtmann wrote: > Ah, > > I was not precise enough ... > >> Why you don't use pub/sub? > > We use pub/sub via multicast in our system ... sorry, that I did > not make that clear. > >> >> What it consists of? >> >>> -> l

Re: [zeromq-dev] Message delivery and DoS

2012-06-01 Thread Pieter Hintjens
On Fri, Jun 1, 2012 at 11:53 AM, Ian Barber wrote: > Wasn't there a discussion about a max message size option happening at some > point? So at least you could bound what was sent at a single point? That's > more of a fix for an accidental DoS than a malicious one, but still helpful. It's a good

Re: [zeromq-dev] Round robin problems with offline servers

2012-06-01 Thread Andrew Hume
time for my periodic soliloquy: message distribution is NOT the same as job scheduling. zeromq tempts you into thinking the former can be used to do the latter, and indeed, provided you don't care about edge conditions and do lots of things, zeromq can do a good approximation. but its no

Re: [zeromq-dev] Round robin problems with offline servers

2012-06-01 Thread Pieter Hintjens
On Fri, Jun 1, 2012 at 11:43 AM, Ben Gray wrote: > Short of setting all the send high water marks to 0 messages is there > a good work around to stop buffering for none connected pipes? You cannot use HWM effectively for flow control. The simple and effective way to solve your problem without m

Re: [zeromq-dev] 3.1 stability status

2012-06-01 Thread Ian Barber
On Fri, Jun 1, 2012 at 11:23 AM, Pierre Ynard wrote: > > That's not really a source snapshot as you can't just ./configure && make > it; and unfortunately my sysadmin's distribution lacks recent enough > autotools to bootstrap it. I had found http://snapshot.zero.mq/ but the > so-called "daily" p

Re: [zeromq-dev] 3.1 stability status

2012-06-01 Thread Pierre Ynard
> > That's great news! It would be helpful to have recent source > > snapshots. > > All GitHub-hosted projects have source snapshots: > https://github.com/zeromq/libzmq/tarball/master That's not really a source snapshot as you can't just ./configure && make it; and unfortunately my sysadmin's dis

Re: [zeromq-dev] Message delivery and DoS

2012-06-01 Thread Ian Barber
On Thu, May 31, 2012 at 5:50 PM, Pieter Hintjens wrote: > On Thu, May 31, 2012 at 5:52 PM, Garrett Smith wrote: > > > Is it possible with 0MQ to ever prevent DoS from attackers flooding a > > socket with message parts? > > One could add black/white listing to the TCP transport. It can be done >

[zeromq-dev] Round robin problems with offline servers

2012-06-01 Thread Ben Gray
I have a number of clients talking to a number of servers which may or may not be accessible at any given time. The server that processes the client message doesn't matter but only one should do it and so a pretty basic round robin push / pull system seemed to make sense. As only the server locatio

[zeromq-dev] Bay area meetup - 9th June

2012-06-01 Thread Pieter Hintjens
Hi all, FYI, we're holding a meetup on the 9th of June in San Francisco, with a drinkup the evening before for anyone who likes that kind of thing. Sign up here: http://www.zeromq.org/event:san-francisco-2012-06 -Pieter ___ zeromq-dev mailing list zero

Re: [zeromq-dev] Statistics protocol v0.1

2012-06-01 Thread Marten Feldtmann
Ah, I was not precise enough ... > Why you don't use pub/sub? We use pub/sub via multicast in our system ... sorry, that I did not make that clear. > > What it consists of? > >> -> location (computer) of the process sending this information >> (ip-number - no name) > > Why do you use IP

Re: [zeromq-dev] Statistics protocol v0.1

2012-06-01 Thread Paul Colomiets
Hi Marten, On Fri, Jun 1, 2012 at 9:04 AM, Marten Feldtmann wrote: > we are actually in the process of implementing a statistic system for > our C#/Smalltalk application system using ZeroMQ and we have included > the following information in our telegrams. > Thanks for sharing info. My questions