On Wed, 2019-08-07 at 14:50 +0200, Francesco wrote: > Hi Luca, > > > Il giorno mer 7 ago 2019 alle ore 11:48 Luca Boccassi < > luca.bocca...@gmail.com> ha scritto: > > Thank you, that's great! > > > > I may be able to repeat also the same tests, still on 10Gb optical > link, using 2 Mellanox CX5 NICs... I will post here new results if I > can. > > > Getting anywhere close to 10gig line rate without bypassing the > > kernel TCP stack is not really likely - as you correctly pointed > > out, the way to do that would be to use a different stack based on > > DPDK (or XDP) like VPP or F-stack. I have briefly looked into this > > in the past, but didn't have time to do anything. It's a lot of > > integration work. > > > > I agree - I wonder if things could be different if ZMQ had a sponsor > to support it... > > > Another improvement that can help is using the new zero-copy kernel > > TCP read/write APIs - I had started something a couple of years > > back, but again didn't have time to complete it. > > > > This looks very interesting as well.. do you have any pointer to > these new zero-copy kernel APIs? > > Thanks, > Francesco
Kernel docs: https://www.kernel.org/doc/html/v5.2/networking/msg_zerocopy.html This is the initial experiment, very much incomplete: https://github.com/bluca/libzmq/commit/d021ea5f2c7526b388cb8f8005298e30b4cadd62 > > On Wed, 2019-08-07 at 00:34 +0200, Francesco wrote: > > > Hi Luca, Hi all, > > > > > > I generated the results graph and put all of them here: > > > > > > http://zeromq.org/results:10gbe-tests-v432 > > > > > > I would say the results are ok but perhaps there's room for > > > improvements. > > > For example: the local_thr/remote_thr benchmarks show that ZeroMQ > > > is able to fill the 10Gbps link only using message sizes of about > > > 10kB. > > > The CPUs of the test spiked at about 3.5 Mpps @ 16B message-size > > > which is a bit far from the theoretical max of Ethernet that for > > > 84B frames (on the wire) is 14.8Mpps (see > > > https://kb.juniper.net/InfoCenter/index?page=content&id=KB14737). > > > > > > I wonder how ZeroMQ message batching mechanism works for small > > > messages (<1kB) on TCP... anybody can shed some light on this? > > > Thanks! > > > > > > Francesco > > > > > > > > > PS: any project to use something like F-stack ( > > > http://www.f-stack.org/) on top of DPDK as backend for ZeroMQ :) > > > ? > > > > > > > > > > > > > > > Il giorno dom 4 ago 2019 alle ore 20:41 Luca Boccassi < > > > luca.bocca...@gmail.com> ha scritto: > > > > Looks great, thank you! > > > > > > > > On Sun, 4 Aug 2019, 18:28 Francesco, < > > > > francesco.monto...@gmail.com> wrote: > > > > > Hi, > > > > > > > > > > > There's nothing that I know of for that purpose > > > > > > > > > > I wrote a 70lines bash script to automate the collection of > > > > > performance results using > > > > > "{local/remote/inproc/proxy}_{thr/lat}" ZMQ performance > > > > > utils... > > > > > I created a PR for that: > > > > > https://github.com/zeromq/libzmq/pull/3607 > > > > > > > > > > Let me know if that works for you. > > > > > > > > > > As soon as I have the HW available I will use them to > > > > > generate the new graphs... > > > > > > > > > > Thanks > > > > > > > > > > Francesco > > > > > > > > > > Il giorno sab 3 ago 2019 alle ore 11:39 Luca Boccassi < > > > > > luca.bocca...@gmail.com> ha scritto: > > > > > > There's nothing that I know of for that purpose > > > > > > > > > > > > On Sat, 3 Aug 2019, 10:24 Francesco, < > > > > > > francesco.monto...@gmail.com> wrote: > > > > > > > Hi Luca, > > > > > > > I don't have a wikidot account... however I have a basic > > > > > > > question before getting there: > > > > > > > local_thr / remote_thr > > > > > > > utilities are just producing a text output... is there > > > > > > > any script to: > > > > > > > 1) run them automatically to generate all points of the > > > > > > > per-message-size graphs ( > > > > > > > http://zeromq.org/results:10gbe-tests-v031) ? > > > > > > > 2) produce the actual graph from the collected text > > > > > > > outputs ? > > > > > > > > > > > > > > Thanks, > > > > > > > Francesco > > > > > > > > > > > > > > > > > > > > > > > > > > > > Il giorno sab 3 ago 2019 alle ore 00:40 Luca Boccassi < > > > > > > > luca.bocca...@gmail.com> ha scritto: > > > > > > > > Yes please! > > > > > > > > > > > > > > > > Do you have an account on wikidot to edit the page? > > > > > > > > > > > > > > > > On Fri, 2 Aug 2019, 21:54 Francesco, < > > > > > > > > francesco.monto...@gmail.com> wrote: > > > > > > > > > Hi all, > > > > > > > > > I noticed that all performance results reported at > > > > > > > > > this page: > > > > > > > > > http://zeromq.org/area:results > > > > > > > > > seem a bit outdated (most updated version looks > > > > > > > > > like ØMQ/2.0.6 !)... has anybody updated results? > > > > > > > > > Alternatively I may be able to generate measurements > > > > > > > > > on latest libzmq on 10G NICs... would you be > > > > > > > > > interested in putting on that page updated results? > > > > > > > > > > > > > > > > > > > > > > > > > > > Thanks, > > > > > > > > > Francesco > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > _______________________________________________ > > > > > > > > > zeromq-dev mailing list > > > > > > > > > zeromq-dev@lists.zeromq.org > > > > > > > > > https://lists.zeromq.org/mailman/listinfo/zeromq-dev > > > > > > > > > > > > > > > > _______________________________________________ > > > > > > > > zeromq-dev mailing list > > > > > > > > zeromq-dev@lists.zeromq.org > > > > > > > > https://lists.zeromq.org/mailman/listinfo/zeromq-dev > > > > > > > > > > > > > > _______________________________________________ > > > > > > > zeromq-dev mailing list > > > > > > > zeromq-dev@lists.zeromq.org > > > > > > > https://lists.zeromq.org/mailman/listinfo/zeromq-dev > > > > > > > > > > > > _______________________________________________ > > > > > > zeromq-dev mailing list > > > > > > zeromq-dev@lists.zeromq.org > > > > > > https://lists.zeromq.org/mailman/listinfo/zeromq-dev > > > > > > > > > > _______________________________________________ > > > > > zeromq-dev mailing list > > > > > zeromq-dev@lists.zeromq.org > > > > > https://lists.zeromq.org/mailman/listinfo/zeromq-dev > > > > > > > > _______________________________________________ > > > > zeromq-dev mailing list > > > > zeromq-dev@lists.zeromq.org > > > > https://lists.zeromq.org/mailman/listinfo/zeromq-dev > > > > > > _______________________________________________ > > > zeromq-dev mailing list > > > zeromq-dev@lists.zeromq.org > > > > > > https://lists.zeromq.org/mailman/listinfo/zeromq-dev > > > > > > > -- > > > > Kind regards, > > Luca Boccassi > > _______________________________________________ > > zeromq-dev mailing list > > zeromq-dev@lists.zeromq.org > > https://lists.zeromq.org/mailman/listinfo/zeromq-dev > > _______________________________________________ > zeromq-dev mailing list > zeromq-dev@lists.zeromq.org > > https://lists.zeromq.org/mailman/listinfo/zeromq-dev > > -- Kind regards, Luca Boccassi
signature.asc
Description: This is a digitally signed message part
_______________________________________________ zeromq-dev mailing list zeromq-dev@lists.zeromq.org https://lists.zeromq.org/mailman/listinfo/zeromq-dev
