Re: [zeromq-dev] Extremely strange PUB/SUB behavior
I actually do use high water marks already, I don't use identities on purpose because I don't want the client to be durable. If the client socket is closed and reopened, it's bad behavior if messages are replayed (in my case). On Wed, Feb 22, 2012 at 4:04 PM, Justin Cook wrote: > On Wed, Feb 22, 2012 at 8:47 PM, Calvin de Vries > wrote: > > I'm not using ZMQ_IDENTITY on either the server or the client. > > If either of you are able to reproduce this, I would recommend setting > a high water mark and using identities (durable sockets) to see if > that alleviates the issue. Just a wild guess... > ___ > zeromq-dev mailing list > zeromq-dev@lists.zeromq.org > http://lists.zeromq.org/mailman/listinfo/zeromq-dev > ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev
Re: [zeromq-dev] Extremely strange PUB/SUB behavior
On Feb 22, 2012, at 3:04 PM, Justin Cook wrote: > On Wed, Feb 22, 2012 at 8:47 PM, Calvin de Vries > wrote: >> I'm not using ZMQ_IDENTITY on either the server or the client. > > If either of you are able to reproduce this, I would recommend setting > a high water mark and using identities (durable sockets) to see if > that alleviates the issue. Just a wild guess... I am not using an identity and durable sockets. Once upon a time, I *did* use durable sockets for this particular program but the durable sockets were essentially a giant memory leak. I can't re-enable them. cr ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev
Re: [zeromq-dev] Extremely strange PUB/SUB behavior
On Wed, Feb 22, 2012 at 8:47 PM, Calvin de Vries wrote: > I'm not using ZMQ_IDENTITY on either the server or the client. If either of you are able to reproduce this, I would recommend setting a high water mark and using identities (durable sockets) to see if that alleviates the issue. Just a wild guess... ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev
Re: [zeromq-dev] Extremely strange PUB/SUB behavior
I'm not using ZMQ_IDENTITY on either the server or the client. On Wed, Feb 22, 2012 at 3:45 PM, Justin Cook wrote: > Are either of you using ZMQ_IDENTITY to establish durable subscribers? > > On Wed, Feb 22, 2012 at 7:40 PM, Chuck Remes > wrote: > > On Feb 22, 2012, at 1:14 PM, Calvin de Vries wrote: > > > >> More color - > >> > >> I was actually able to "cause" this issue now by taking down a client > that had a similar subscription list. The same subscription that had > stopped receiving messages earlier has stopped receiving messages again. > I'm thinking there's some issue with sending to the wrong pipe in the trie > after a connection has been closed? > >> > >> I'll try my best to create a test case. > > > > I have a similar setup and have noticed that my subscribers sometimes > stop getting data. I have been unable to reproduce the problem. It happens > intermittently. > > > > If you have a repro, that is wonderful news! > ___ > zeromq-dev mailing list > zeromq-dev@lists.zeromq.org > http://lists.zeromq.org/mailman/listinfo/zeromq-dev > ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev
Re: [zeromq-dev] Extremely strange PUB/SUB behavior
Are either of you using ZMQ_IDENTITY to establish durable subscribers? On Wed, Feb 22, 2012 at 7:40 PM, Chuck Remes wrote: > On Feb 22, 2012, at 1:14 PM, Calvin de Vries wrote: > >> More color - >> >> I was actually able to "cause" this issue now by taking down a client that >> had a similar subscription list. The same subscription that had stopped >> receiving messages earlier has stopped receiving messages again. I'm >> thinking there's some issue with sending to the wrong pipe in the trie after >> a connection has been closed? >> >> I'll try my best to create a test case. > > I have a similar setup and have noticed that my subscribers sometimes stop > getting data. I have been unable to reproduce the problem. It happens > intermittently. > > If you have a repro, that is wonderful news! ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev
Re: [zeromq-dev] ZeroMQ conference, this Saturday in Portland, OR!
I doubt there's time, but perhaps ZeroMQ should become a YouTube partner to store webcasts and eventually get Live streaming privileges: [1] http://www.youtube.com/partners [2] http://www.youtube.com/live -- Wolf On Wed, Feb 22, 2012 at 2:05 PM, Michel Pelletier wrote: > I'll have a webcam set up and use whichever one of the many > videocasting services I can get to work. Can't make any guarantees of > the quality though. > > Speaking of rain, if you didn't know, Portland is a pretty wet town in > the winter. Probably not entirely unlike Scotland in that regard. > Bring some rain gear! > > -Michel > > On Wed, Feb 22, 2012 at 10:51 AM, Pieter Hintjens wrote: >> On Wed, Feb 22, 2012 at 3:24 AM, Mark Marsella >> wrote: >> >>> Not being able to make it from deepest darkest Scotland, I would love to see >>> some videos posted even after the event if possible. >> >> How's the rain? :) >> >> We'll post what we can. >> >> -Pieter >> ___ >> zeromq-dev mailing list >> zeromq-dev@lists.zeromq.org >> http://lists.zeromq.org/mailman/listinfo/zeromq-dev > ___ > zeromq-dev mailing list > zeromq-dev@lists.zeromq.org > http://lists.zeromq.org/mailman/listinfo/zeromq-dev ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev
Re: [zeromq-dev] Extremely strange PUB/SUB behavior
On Feb 22, 2012, at 1:14 PM, Calvin de Vries wrote: > More color - > > I was actually able to "cause" this issue now by taking down a client that > had a similar subscription list. The same subscription that had stopped > receiving messages earlier has stopped receiving messages again. I'm thinking > there's some issue with sending to the wrong pipe in the trie after a > connection has been closed? > > I'll try my best to create a test case. I have a similar setup and have noticed that my subscribers sometimes stop getting data. I have been unable to reproduce the problem. It happens intermittently. If you have a repro, that is wonderful news! cr ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev
Re: [zeromq-dev] Extremely strange PUB/SUB behavior
More color - I was actually able to "cause" this issue now by taking down a client that had a similar subscription list. The same subscription that had stopped receiving messages earlier has stopped receiving messages again. I'm thinking there's some issue with sending to the wrong pipe in the trie after a connection has been closed? I'll try my best to create a test case. On Wed, Feb 22, 2012 at 2:01 PM, Calvin de Vries wrote: > Hi, > > I'm seeing some extremely strange behavior in production with ZeroMQ. It > seems as if I stop receiving messages for a certain subscription and am not > sure why. I've been using my current pattern in production for months and > this has occurred twice in that time frame (once today and once last week) > and any time I try to reproduce it, I cannot. > > Basically, I have a Linux C++ server using a PUB socket to send out > messages for many different subscriptions (about 3000 different > subscriptions each is a char* 1-5 letters long) once every 5 seconds to > Windows C++ clients using a SUB socket. It sends out a message for every > single subscription in that time frame. Any given client may be subscribed > for anywhere between 10-100 unique subscriptions. One of my clients (the > same one actually out of around 30-35) stopped receiving messages for just > one of the subscriptions. Another client that has the same subscription > list does not stop receiving any messages for any subscription. The first > time, this behavior had eventually somehow "fixed" itself, the client > started receiving messages for all subscriptions once again. Today when it > happened, the client was restarted and received all subscriptions again as > well. > > Since both times another client with the same subscription had still been > receiving messages, I know that the publisher is still sending out the > message. It's not a socket becoming "closed" because it is only one socket > and still receiving messages for other subscriptions. It seems that this > is extremely rare, though so every time I try to document with a test case, > I cannot do it. My best guesses to the cause of this problem sound > ridiculous - the subscription somehow becoming "cleaned up" or > "unsubscribed" for no reason. I just can't justify it and don't see how > that could possibly be happening. > > I'm curious if anyone has ever noticed anything like this, or if there's > perhaps some sort of flaw in my system. It seems very straightforward to me > and am still baffled how this is occurring. > > Any help, insight or suggestions would be greatly appreciated. > > Thank you, > Calvin de Vries > > > ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev
Re: [zeromq-dev] ZeroMQ conference, this Saturday in Portland, OR!
I'll have a webcam set up and use whichever one of the many videocasting services I can get to work. Can't make any guarantees of the quality though. Speaking of rain, if you didn't know, Portland is a pretty wet town in the winter. Probably not entirely unlike Scotland in that regard. Bring some rain gear! -Michel On Wed, Feb 22, 2012 at 10:51 AM, Pieter Hintjens wrote: > On Wed, Feb 22, 2012 at 3:24 AM, Mark Marsella > wrote: > >> Not being able to make it from deepest darkest Scotland, I would love to see >> some videos posted even after the event if possible. > > How's the rain? :) > > We'll post what we can. > > -Pieter > ___ > zeromq-dev mailing list > zeromq-dev@lists.zeromq.org > http://lists.zeromq.org/mailman/listinfo/zeromq-dev ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev
[zeromq-dev] Extremely strange PUB/SUB behavior
Hi, I'm seeing some extremely strange behavior in production with ZeroMQ. It seems as if I stop receiving messages for a certain subscription and am not sure why. I've been using my current pattern in production for months and this has occurred twice in that time frame (once today and once last week) and any time I try to reproduce it, I cannot. Basically, I have a Linux C++ server using a PUB socket to send out messages for many different subscriptions (about 3000 different subscriptions each is a char* 1-5 letters long) once every 5 seconds to Windows C++ clients using a SUB socket. It sends out a message for every single subscription in that time frame. Any given client may be subscribed for anywhere between 10-100 unique subscriptions. One of my clients (the same one actually out of around 30-35) stopped receiving messages for just one of the subscriptions. Another client that has the same subscription list does not stop receiving any messages for any subscription. The first time, this behavior had eventually somehow "fixed" itself, the client started receiving messages for all subscriptions once again. Today when it happened, the client was restarted and received all subscriptions again as well. Since both times another client with the same subscription had still been receiving messages, I know that the publisher is still sending out the message. It's not a socket becoming "closed" because it is only one socket and still receiving messages for other subscriptions. It seems that this is extremely rare, though so every time I try to document with a test case, I cannot do it. My best guesses to the cause of this problem sound ridiculous - the subscription somehow becoming "cleaned up" or "unsubscribed" for no reason. I just can't justify it and don't see how that could possibly be happening. I'm curious if anyone has ever noticed anything like this, or if there's perhaps some sort of flaw in my system. It seems very straightforward to me and am still baffled how this is occurring. Any help, insight or suggestions would be greatly appreciated. Thank you, Calvin de Vries ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev
Re: [zeromq-dev] ZeroMQ conference, this Saturday in Portland, OR!
On Wed, Feb 22, 2012 at 3:24 AM, Mark Marsella wrote: > Not being able to make it from deepest darkest Scotland, I would love to see > some videos posted even after the event if possible. How's the rain? :) We'll post what we can. -Pieter ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev
Re: [zeromq-dev] why zmq_send didn't block in ZMQ_REQ&ZMQ_REP model?
On Wed, Feb 22, 2012 at 12:51 AM, Chenglong Chen wrote: > When a ZMQ_REQ socket enters an exceptional state due to having reached the > high water mark for all services, or if there are no services at all, then > any zmq_send(3) operations on the socket shall block until the exceptional > state ends or at least one service becomes available for sending; messages > are not discarded. IMO it's a bug in the man page. -Pieter ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev
Re: [zeromq-dev] ZeroMQ conference, this Saturday in Portland, OR!
Not being able to make it from deepest darkest Scotland, I would love to see some videos posted even after the event if possible. Mark On 22 February 2012 08:29, Mikko Koppanen wrote: > hi, > > pieter will have video camera with him and has promised to take video. > > > On Wednesday, February 22, 2012, Mark Wotton wrote: > > don't suppose there's going to be a video feed for those of us not in > the Staes? > > mark > > > > On Tue, Feb 21, 2012 at 10:41 AM, Michel Pelletier < > pelletier.mic...@gmail.com> wrote: > >> > >> Well, in case you haven't heard, this saturday is the day for the > >> Portland, OR, ZeroMQ Conference. A whole day dedicated to discussing > >> our favorite messaging technology with fantastic presentations given > >> by some seriously smart people. > >> > >> For those of you who haven't heard and would like to go, please sign > >> up on our wiki page here: > >> > >> http://www.zeromq.org/event:pdxconf2012 > >> > >> Due to some logistical issues, not the least of which is what looks to > >> be an excellent turnout, we have moved the conference venue about 10 > >> blocks. Here is the new location: > >> > >> collective agency, portland, or > > >> > >> I have updated the wiki page with the new location and hopefully will > >> be able to have a sign at the old location door directing anyone to > >> the new venue. Again I'd like to thank our sponsors Twilio and iMatix > >> for their financial support! > >> > >> As usual, any questions please contact me. > >> > >> See you saturday! > >> > >> -Michel > >> ___ > >> zeromq-dev mailing list > >> zeromq-dev@lists.zeromq.org > >> http://lists.zeromq.org/mailman/listinfo/zeromq-dev > > > > > > -- > Mikko Koppanen > > ___ > zeromq-dev mailing list > zeromq-dev@lists.zeromq.org > http://lists.zeromq.org/mailman/listinfo/zeromq-dev > > ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev
Re: [zeromq-dev] Issues installing ZeroMQ and PyZMQ on RHEL 6
What's more likely that the whole "unix way" is broken or you and the op don't really understand their environment and how it is setup re building. I have built whole Linux distributions, desktop environments, browsers, libraries (including zmq) without an issue as have many others. Also many of the world's important software is written in C and continues to be, in my opinion C++ is a badly designed language and would advise people who need their hand held by the compiler use Java. On 22 February 2012 03:46, john skaller wrote: > > On 22/02/2012, at 1:54 PM, Kushal Dalmia wrote: > > > Hi, > > > > I finally got it to work. The problem was the location where RHEL > > creates the libstdc++.so. It was in /usr/lib (and /usr/lib64). On > > adding these to the LD_LIBRARY_PATH, the issue got resolved. > > > > Thanks a lot to everybody for their support. > > > I'm confused. You shouldn't need to do this. /usr/lib is a *builtin* > resolution path, you do not need to add it to LD_LIBRARY_PATH, > that path is only for *extra* libraries not installed in a standard > place. > > For example on my Mac: > > >echo $DYLD_LIBRARY_PATH > /opt/local/lib: > > As to /usr/lib64 > > you *should not* add that to your LD_LIBRARY_PATH. > This will only confuse the linker. The linker can choose > between 32 and 64 bit libraries automatically. > > If you set a 64 bit only directory in the path you're > interfering with the linkers resolution algorithm. > > IMHO: you have not resolved your issue just because it now works. > You have only resolved the issue when you fully understand why > it did not work before. > > It *should* have worked. Linking C code to C++ is problematic: > you're running gcc not g++. You should always write C++ programs > and use g++ anyhow, even if your code is meant to be C, since > C++ provides much better type safety, even for C programs. > > You might try compiling your example with g++ explicitly, and then > also try renaming it to hello.cpp and compiling and linking with that, > to see if the problem is in the way gcc/g++ is calling the linker. > > I'd also try forcing both dynamic and static linkage. > You may need -fPIC to make dynamic work; it is required > on an x86_64 machine for library code. > Standard *.o files cannot be linked into shared dynamic libraries: > the actual machine instructions required to call out are different. > > BTW: it took me a year to figure out a half decent linkage model. > People need to understand that the old school unix way is finished. > It doesn't work on modern systems. Pretty much all libraries > (including 0MQ) are installed incorrectly, and most package managers > (especially Debian) are also using the wrong model. > For example Python is installed properly on OSX, but incorrectly > on all Debian based Linux boxes. The model chosen there is suitable > for basic usage but doesn't work properly with embedding. > > It's pretty serious really. I have applications which work on OSX and > fail on Linux, because the Linux is so confused it messes up > standard I/O. Standard I/O is very hard to do right unless you use > a workable linkage model (global variables trash linkage > on Unix unless you take special care). > > -- > john skaller > skal...@users.sourceforge.net > > > > > ___ > zeromq-dev mailing list > zeromq-dev@lists.zeromq.org > http://lists.zeromq.org/mailman/listinfo/zeromq-dev > ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev
Re: [zeromq-dev] ZeroMQ conference, this Saturday in Portland, OR!
hi, pieter will have video camera with him and has promised to take video. On Wednesday, February 22, 2012, Mark Wotton wrote: > don't suppose there's going to be a video feed for those of us not in the Staes? > mark > > On Tue, Feb 21, 2012 at 10:41 AM, Michel Pelletier < pelletier.mic...@gmail.com> wrote: >> >> Well, in case you haven't heard, this saturday is the day for the >> Portland, OR, ZeroMQ Conference. A whole day dedicated to discussing >> our favorite messaging technology with fantastic presentations given >> by some seriously smart people. >> >> For those of you who haven't heard and would like to go, please sign >> up on our wiki page here: >> >> http://www.zeromq.org/event:pdxconf2012 >> >> Due to some logistical issues, not the least of which is what looks to >> be an excellent turnout, we have moved the conference venue about 10 >> blocks. Here is the new location: >> >> collective agency, portland, or >> >> I have updated the wiki page with the new location and hopefully will >> be able to have a sign at the old location door directing anyone to >> the new venue. Again I'd like to thank our sponsors Twilio and iMatix >> for their financial support! >> >> As usual, any questions please contact me. >> >> See you saturday! >> >> -Michel >> ___ >> zeromq-dev mailing list >> zeromq-dev@lists.zeromq.org >> http://lists.zeromq.org/mailman/listinfo/zeromq-dev > > -- Mikko Koppanen ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev
Re: [zeromq-dev] ZeroMQ conference, this Saturday in Portland, OR!
don't suppose there's going to be a video feed for those of us not in the Staes? mark On Tue, Feb 21, 2012 at 10:41 AM, Michel Pelletier < pelletier.mic...@gmail.com> wrote: > Well, in case you haven't heard, this saturday is the day for the > Portland, OR, ZeroMQ Conference. A whole day dedicated to discussing > our favorite messaging technology with fantastic presentations given > by some seriously smart people. > > For those of you who haven't heard and would like to go, please sign > up on our wiki page here: > > http://www.zeromq.org/event:pdxconf2012 > > Due to some logistical issues, not the least of which is what looks to > be an excellent turnout, we have moved the conference venue about 10 > blocks. Here is the new location: > > > http://maps.google.com/maps?q=collective+agency,+portland,+or&hl=en&sll=37.0625,-95.677068&sspn=45.553578,92.8125&t=v&hq=collective+agency,&hnear=Portland,+Multnomah,+Oregon&z=16 > > I have updated the wiki page with the new location and hopefully will > be able to have a sign at the old location door directing anyone to > the new venue. Again I'd like to thank our sponsors Twilio and iMatix > for their financial support! > > As usual, any questions please contact me. > > See you saturday! > > -Michel > ___ > zeromq-dev mailing list > zeromq-dev@lists.zeromq.org > http://lists.zeromq.org/mailman/listinfo/zeromq-dev > ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev
