Re: [zeromq-dev] How to define a global queue

2015-12-22 Thread Gerry Steele
I think the question you must ask yourself is how have you compared a practical implementation of your business requirements with different products. Your question makes it seem like you may well have a dull naive understanding of complex software systems. No one here can answer your questions un

Re: [zeromq-dev] Reliable pub sub on c++ linux

2015-04-29 Thread Gerry Steele
That doesn't make sense. Did you set hwm on both sides of the connection? On 28 Apr 2015 17:26, "Peter Krey" wrote: > this fixed it so that the pub can hold up to a few seconds of throughput > in memory > > int hwm = 900; > publisher.setsockopt( ZMQ_SNDHWM, &hwm, sizeof (hwm)); > > th

Re: [zeromq-dev] Reliable pub sub on c++ linux

2015-04-27 Thread Gerry Steele
Do you have the code where you set the hwms? On 27 Apr 2015 21:08, "Peter Krey" wrote: > I have HWM set to zero on recv and pub. I am keeping track of sequence > numbers recved on the sub socket which are sent out by the pub socket. Here > is an example output. > > The pub socket is publishing a

Re: [zeromq-dev] SOLUTION-- Encryption failure problem and wireless connectivity

2014-12-19 Thread Gerry Steele
Do you see the same for any other tcp traffic? On 15 Dec 2014 19:40, "Steve Murphy" wrote: > Pieter-- > > I'm sorry if I gave the wrong impression. I didn't make it clear > that my app was running on over a dozen different hosts, > all spread across the internet. I was also trying to > run it on

Re: [zeromq-dev] Process eating 100 % of one core

2014-11-07 Thread Gerry Steele
How long does the cpu use last for when it does happen? Or does it stay at 100pct till restart? On 7 Nov 2014 10:21, "Emmanuel TAUREL" wrote: > Hello all, > > We are using ZMQ (still release 3.2.4) mainly on Linux boxes. We are > using the PUB/SUB model. > Our system runs 24/7. From time to time,

Re: [zeromq-dev] zeromq, abort(), and high reliability environments

2014-08-10 Thread Gerry Steele
How about not sending an ack to your users until the unit of work they input has cleared the pipeline? That way the input application can decide what to do. Obviously depends on your application... On 9 Aug 2014 03:12, "Dylan Cali" wrote: > Hey guys, > > What is the right way to use zeromq in hig

Re: [zeromq-dev] question about sub/pub speed and capability

2014-07-14 Thread gerry . steele
Given the specificity of your requirement would it not be easier to ‎implement a pub/sub on your own hardware and network and measure how long it takes with payloads which are realistically sized to match what you are sending? You can't escape testing it yourself anyway. Benchmark apps are included

Re: [zeromq-dev] PUB/SUB unreliabiliity

2014-06-16 Thread Gerry Steele
t;, rc); > > -Pieter > > On Mon, Jun 16, 2014 at 8:03 PM, Pieter Hintjens wrote: > > Hmm, it does check the size of the passed argument, and if that's > > wrong, returns an error (which you do check for). > > > > On Mon, Jun 16, 2014 at 7:36 PM, Gerry Steele

Re: [zeromq-dev] PUB/SUB unreliabiliity

2014-06-16 Thread Gerry Steele
significant. > > On Mon, Jun 16, 2014 at 6:20 PM, Gerry Steele > wrote: > > In the patent email I have links to the minimal examples on > gist.github.com > > > > Happy to open an issue and commit them later on if that's what you need. > > > > Thanks

Re: [zeromq-dev] PUB/SUB unreliabiliity

2014-06-16 Thread Gerry Steele
Thanks. > > On Mon, Jun 16, 2014 at 12:49 PM, Gerry Steele > wrote: > > Thanks Peter. I can't try this out till I get home but it is looking like > > hwm overflows. > > > > If you run the utilities you notice the drops start happening after > > precise

Re: [zeromq-dev] PUB/SUB unreliabiliity

2014-06-16 Thread Gerry Steele
ently mentioning the same problem. I also tried setting the hwm values to a number greater than the number of events and it seemed to have no effect either. g On 16 Jun 2014 09:32, "Pieter Hintjens" wrote: > On Mon, Jun 16, 2014 at 9:10 AM, Gerry Steele > wrote: > > > Big chu

Re: [zeromq-dev] PUB/SUB unreliabiliity

2014-06-16 Thread Gerry Steele
#x27;s best to just assume > that pubsub isn't reliable. Build reliability around it. > > Some philosophy: > http://zguide.zeromq.org/page:all#Pros-and-Cons-of-Pub-Sub > > On 06/15/2014 04:43 AM, Gerry Steele wrote: > > Thanks Charles, that's pretty much my understand

Re: [zeromq-dev] PUB/SUB unreliabiliity

2014-06-15 Thread Gerry Steele
ill start paging & > swapping and you’ll wish the process had just died. > > cr > > > On Jun 13, 2014, at 5:34 PM, Gerry Steele wrote: > > Hi Brian > > I noticed your comment on another thread about this and I think you got it > a bit wrong: > > > The high

Re: [zeromq-dev] PUB/SUB unreliabiliity

2014-06-15 Thread Gerry Steele
are you setting the HWM both at publisher and at subscriber, or > at one side only? > > -Pieter > > On Fri, Jun 13, 2014 at 8:33 PM, Gerry Steele > wrote: > > I've read everything I can find including the Printed book, but I am at a > > loss as to the definitive

Re: [zeromq-dev] Universal Fast Sockets and ZeroMQ

2014-06-13 Thread Gerry Steele
>From What I can tell it is preloaded so which intercepts socket calls and if the calls are destined to go over loopback they use their own protocol and ipc mechanism. http://grokbase.com/t/zeromq/zeromq-dev/13apd39pg8/jeromq-zeromq-transparent-acceleration-with-fast-sockets On 2 Jun 2014 20:31,

Re: [zeromq-dev] PUB/SUB unreliabiliity

2014-06-13 Thread Gerry Steele
an already connected consumer." > > > Your understanding of pub-sub behavior and how it interacts with the HWM > is incorrect. Please see: http://zguide.zeromq.org/php:chapter5 > > Brian > > > > > On Fri, Jun 13, 2014 at 2:33 PM, Gerry Steele > wrote: > &g

[zeromq-dev] PUB/SUB unreliabiliity

2014-06-13 Thread Gerry Steele
https://gist.github.com/easytiger/2c4f806594ccfbc74f54 zmq_pull: https://gist.github.com/easytiger/268a630fd22f959fde93 Is there an issue/bug in my implementation that would cause this? Using zeromq 4.0.3 Many Thanks Gerry -- Gerry Steele ___

Re: [zeromq-dev] 10 seconds delay on a PUB/SUB

2014-03-14 Thread Gerry Steele
On a tangent... Does high watermark=0 really make pub/ sub fully reliable? Wasn't my understanding. Could be wrong. How big are the messages you are sending? Can you reproduce on same hardware with a hello world pub sub for messages of the same size? On 14 Mar 2014 15:06, "Giacomo Tesio" wrote:

Re: [zeromq-dev] PUB/SUB cached queue list

2013-09-26 Thread Gerry Steele
vidual, individuals or entities that it is addressed to and may >> include private and confidential information that may not be disclosed, made >> public nor used in any way at all. Unauthorized use of the information in >> this electronic mail message may be subject to the penalties set for

Re: [zeromq-dev] "Resource temporarily unavailable" with pub socket

2013-08-14 Thread Gerry Steele
Worth mentioning that there is a connected consumer and some messages are being send accross ok On Wednesday, August 14, 2013 11:30:36 AM UTC+1, Gerry Steele wrote: > > As part of a larger program i ran into a "Resource temporarily > unavailable" error when trying to send

[zeromq-dev] "Resource temporarily unavailable" with pub socket

2013-08-14 Thread Gerry Steele
As part of a larger program i ran into a "Resource temporarily unavailable" error when trying to send a message via a pub socket. The program listens on multiple ipc transports to another process via SUB (works well). i then do something to the data (removed from the example) and then send it o