Hi Everyone, I was able to demonstrate full zyre reliability in Java using the simplistic JNI zyre wrapper we created by hand this week. It is here if anyone is interested: https://github.com/awynne/jyre-standalone-benchmark
Best regards Adam Wynne CR/RTC3.1-NA Tel. +1(412)390-3211 -----Original Message----- From: zeromq-dev-boun...@lists.zeromq.org [mailto:zeromq-dev-boun...@lists.zeromq.org] On Behalf Of Wynne Adam (CR/RTC3.1-NA) Sent: Friday, September 04, 2015 9:49 AM To: ZeroMQ development list <zeromq-dev@lists.zeromq.org> Subject: Re: [zeromq-dev] message loss at high send rate in Jyre Hi Trev, Thanks much for the help. I am currently writing a jni wrapper for libzyre b/c Pieter thought that was the fastest way to take advantage of improvements in libzyre. But I'm also really interested to try the performance testing with jyre/jzmq as well. Let me know if you get such a test running. Adam -----Original Message----- From: zeromq-dev-boun...@lists.zeromq.org [mailto:zeromq-dev-boun...@lists.zeromq.org] On Behalf Of Trevor Bernard Sent: Thursday, September 03, 2015 11:10 AM To: ZeroMQ development list <zeromq-dev@lists.zeromq.org> Subject: Re: [zeromq-dev] message loss at high send rate in Jyre Adam, I was able to reliably recreate your error using JeroMQ on my MBP though I have yet to try on a Linux. When I did use JZMQ with libzmq-4.1.3, I would get: Resource temporarily unavailable (src/signaler.cpp:301) after a certain point in time. I'm wondering if this is mac specific? I'll set up a VM and retry the tests. -Trev On Thu, Sep 3, 2015 at 11:59 AM, Trevor Bernard <trevor.bern...@gmail.com> wrote: > Hi Adam, > > Building JZMQ is pretty straight forward: > > $ ./autogen.sh && ./configure && make && sudo ldconfig && mvn install > -Dgpg.skip=true > > I submitted a few patches to jyre this morning that made jeromq the > default. Also, if you want to test with JZMQ, you can just use the > follow branch in my fork: > https://github.com/trevorbernard/jyre/tree/jzmq > > You will need to mvn install jyre as well. > > I made some changes to your test here: > https://github.com/trevorbernard/jyre-standalone-benchmark > > I made the counters thread safe and I changed the gradle build to look > for artifacts in ~/.m2/repository > > Let me know how your testing goes. > > -Trev > > On Thu, Sep 3, 2015 at 9:19 AM, Wynne Adam (CR/RTC3.1-NA) > <adam.wy...@us.bosch.com> wrote: >> Hi All, >> >> After talking with Pieter, I'm going to first do the test with a JNI >> wrapper for the zre lib. If anyone has built such a wrapper and is >> willing to share, please let me know :) >> >> Thanks >> Adam >> >> >> -----Original Message----- >> From: zeromq-dev-boun...@lists.zeromq.org >> [mailto:zeromq-dev-boun...@lists.zeromq.org] On Behalf Of Utsav >> Drolia >> Sent: Wednesday, September 02, 2015 10:17 AM >> To: ZeroMQ development list <zeromq-dev@lists.zeromq.org> >> Subject: Re: [zeromq-dev] message loss at high send rate in Jyre >> >> Could you check where the messages do get dropped? >> Specifically, is there a buffer overflow at the pipe between the >> ZreInterface and the Agent? >> >>> On Sep 2, 2015, at 9:46 AM, Wynne Adam (CR/RTC3.1-NA) >>> <adam.wy...@us.bosch.com> wrote: >>> >>> I simplified a bit and now explicitly wait for all responders to JOIN but >>> I'm getting the same results. I can't see any real difference between your >>> test and mine. I think my test is correct unless I'm doing something >>> really dumb that I can't see. >>> >>> Incidentally, if I lower the pause to 0, the ZreInterface.send() starts >>> blocking, which I think is the behavior we'd expect. >>> >>> We prefer to use the pure java version of Zyre so that we can use it in >>> Android. We'll use the C library for other platforms. >>> >>> >>> Best regards >>> >>> Adam Wynne >>> CR/RTC3.1-NA >>> >>> Tel. +1(412)390-3211 >>> >>> >>> -----Original Message----- >>> From: zeromq-dev-boun...@lists.zeromq.org >>> [mailto:zeromq-dev-boun...@lists.zeromq.org] On Behalf Of Pieter >>> Hintjens >>> Sent: Wednesday, September 02, 2015 3:30 AM >>> To: ZeroMQ development list <zeromq-dev@lists.zeromq.org> >>> Subject: Re: [zeromq-dev] message loss at high send rate in Jyre >>> >>> It might be a Jyre issue yet the most likely seems an issue in your test >>> case (the loss is so dramatic). What I'd do is simplify it, and see when it >>> starts happening. >>> >>> If you are able to write a JNI layer then we could eventually wrap the Zyre >>> C API in Java. >>> >>> On Tue, Sep 1, 2015 at 11:10 PM, Wynne Adam (CR/RTC3.1-NA) >>> <adam.wy...@us.bosch.com> wrote: >>>> OK. Do you think it's a problem in Jyre or JeroMQ? >>>> >>>> >>>> Best regards >>>> >>>> Adam Wynne >>>> CR/RTC3.1-NA >>>> >>>> Tel. +1(412)390-3211 >>>> >>>> >>>> -----Original Message----- >>>> From: zeromq-dev-boun...@lists.zeromq.org >>>> [mailto:zeromq-dev-boun...@lists.zeromq.org] On Behalf Of Pieter >>>> Hintjens >>>> Sent: Tuesday, September 01, 2015 2:19 PM >>>> To: ZeroMQ development list <zeromq-dev@lists.zeromq.org> >>>> Subject: Re: [zeromq-dev] message loss at high send rate in Jyre >>>> >>>> So here's a C test case that does this: >>>> https://gist.github.com/hintjens/d54d25c30e0339fb0a87 >>>> >>>> I do get message loss if I (a) start broadcasting before all nodes are >>>> ready or (b) don't wait for all messages to return. Otherwise it works >>>> even with no pause between message sends. >>>> >>>> -Pieter >>>> >>>> On Tue, Sep 1, 2015 at 11:25 AM, Pieter Hintjens <p...@imatix.com> wrote: >>>>> Hi Adam, >>>>> >>>>> I'm recreating this test case in C/Zyre to see how it performs. >>>>> >>>>> -Pieter >>>>> >>>>> On Mon, Aug 31, 2015 at 4:39 PM, Wynne Adam (CR/RTC3.1-NA) >>>>> <adam.wy...@us.bosch.com> wrote: >>>>>> Hi Everyone, >>>>>> >>>>>> >>>>>> >>>>>> We are evaluating Jyre for use in a project and are doing some >>>>>> benchmark testing. We found that at higher send rates, some >>>>>> messages appear to get lost. I have created a github project >>>>>> with multiple “nodes” running in their own threads to demonstrate >>>>>> the issue. I included a README in the project that describes the >>>>>> test scenario and how to run it so it’s easy to run the test. >>>>>> >>>>>> >>>>>> >>>>>> https://github.com/awynne/jyre-standalone-benchmark >>>>>> >>>>>> >>>>>> >>>>>> Please let me know if you have any ideas and/or are able to look into it. >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> Best regards >>>>>> >>>>>> Adam Wynne >>>>>> >>>>>> Bosch Research and Technology Ctr. >>>>>> >>>>>> >>>>>> >>>>>> _______________________________________________ >>>>>> zeromq-dev mailing list >>>>>> zeromq-dev@lists.zeromq.org >>>>>> http://lists.zeromq.org/mailman/listinfo/zeromq-dev >>>>>> >>>> _______________________________________________ >>>> zeromq-dev mailing list >>>> zeromq-dev@lists.zeromq.org >>>> http://lists.zeromq.org/mailman/listinfo/zeromq-dev >>>> _______________________________________________ >>>> zeromq-dev mailing list >>>> zeromq-dev@lists.zeromq.org >>>> http://lists.zeromq.org/mailman/listinfo/zeromq-dev >>> _______________________________________________ >>> zeromq-dev mailing list >>> zeromq-dev@lists.zeromq.org >>> http://lists.zeromq.org/mailman/listinfo/zeromq-dev >>> _______________________________________________ >>> zeromq-dev mailing list >>> zeromq-dev@lists.zeromq.org >>> http://lists.zeromq.org/mailman/listinfo/zeromq-dev >> >> _______________________________________________ >> zeromq-dev mailing list >> zeromq-dev@lists.zeromq.org >> http://lists.zeromq.org/mailman/listinfo/zeromq-dev >> _______________________________________________ >> zeromq-dev mailing list >> zeromq-dev@lists.zeromq.org >> http://lists.zeromq.org/mailman/listinfo/zeromq-dev _______________________________________________ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev _______________________________________________ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev _______________________________________________ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev
