[zeromq-dev] License of zmq 3.x c++ binding
Hi, The initial zmq 2.x C++ binding was part of zmq itself under the LGPL. The binding for 3.x has been moved to a separate project. Is the binding for 3.x still under LGPL? This message and attachment(s) are intended solely for use by the addressee and may contain information that is privileged, confidential or otherwise exempt from disclosure under applicable law. If you are not the intended recipient or agent thereof responsible for delivering this message to the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this communication in error, please notify the sender immediately by telephone and with a 'reply' message. Thank you for your co-operation. ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev
Re: [zeromq-dev] License of zmq 3.x c++ binding
Good question. The repository wasn't well set up, no license file and no notes for contributors. The zmq.hpp license was and still is MIT/X11, you can see this in the sources. LGPL won't work since it's not a library. -Pieter On Tue, Mar 5, 2013 at 10:34 AM, Beyer, Marcel marcel.be...@oce.com wrote: Hi, The initial zmq 2.x C++ binding was part of zmq itself under the LGPL. The binding for 3.x has been moved to a separate project. Is the binding for 3.x still under LGPL? This message and attachment(s) are intended solely for use by the addressee and may contain information that is privileged, confidential or otherwise exempt from disclosure under applicable law. If you are not the intended recipient or agent thereof responsible for delivering this message to the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this communication in error, please notify the sender immediately by telephone and with a 'reply' message. Thank you for your co-operation. ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev
[zeromq-dev] Data integrity and security using ZeroMQ over a WAN
Is there a standard approach to ensuring data integrity and security using ZeroMQ? I'm new to this community and don't see an obvious approach. By 'data integrity' I mean that the message recieved is the same as the one sent. We'll mostly be messaging over TCP, which has problems with jumbo packets. But I want to ensure end-to-end data integrity, including encryption and message packaging. I'm thinking along the lines of embedding a checksum in the message or something like that. Not a big deal to roll my own solution, but I would rather not reinvent the wheel.. If ZeroMQ doesn't offer this, are there any transfer protocol technologies that may help? I was planning on just using JSON or BSON, but am open to alternatives. By 'security' I mean to make it reasonably difficult for my message to be interpreted by sniffing the network traffic. I was originally thinking about tunneling the ZeroMQ connection over SSH, but was told that this would degrade performance considerably. Any thoughts are welcome! ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev
[zeromq-dev] zmq::mtrie_t::rm_helper(..)
Hi, they have found today 2 servers publishing using xsub crashed in mtrie.cpp[line 293] in function zmq::mtrie_t::rm_helper(..) line apparently tryng to acces if (pipes-empty ()). I guess pipes was rubish but I could not debug and I have been unable to reproduce at the moment. The function was called from xpub_t when publishing a message. It happened at the same time in 2 apps in the same machine but unrelated. We work with 3.2.2 in Windows XP in an environment where there are like 5 o 6 different sockets per application and arounf 5 or 6 normally on. I am trying to provoque it back to make a test case but at the moment I couldn't. Rings a bell to anybody?, thanks, Pau Ceano ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev
Re: [zeromq-dev] zmq::mtrie_t::rm_helper(..)
Doesn't ring a bell for me. A few questions… Are all endpoints using 3.2.2 or is it a mix of 3.2.2 and 2.2? What transports are you using (inproc, tcp, ipc)? Are you using XPUB and XSUB directly or are the endpoints actually PUB/SUB but you are seeing a crash in the parent? How many subscriptions do you have on each endpoint? Are there any intermediate devices between the edge endpoints (e.g. a FORWARDER device)? Any chance you can use a Windows OS that is not EOL? :) cr On Mar 5, 2013, at 8:55 AM, Pau p...@teleopsia.com wrote: Hi, they have found today 2 servers publishing using xsub crashed in mtrie.cpp[line 293] in function zmq::mtrie_t::rm_helper(..) line apparently tryng to acces if (pipes-empty ()). I guess pipes was rubish but I could not debug and I have been unable to reproduce at the moment. The function was called from xpub_t when publishing a message. It happened at the same time in 2 apps in the same machine but unrelated. We work with 3.2.2 in Windows XP in an environment where there are like 5 o 6 different sockets per application and arounf 5 or 6 normally on. I am trying to provoque it back to make a test case but at the moment I couldn't. Rings a bell to anybody?, thanks, Pau Ceano ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev
Re: [zeromq-dev] zmq::mtrie_t::rm_helper(..)
Thanks for the rapid answer: -Are all endpoints using 3.2.2 or is it a mix of 3.2.2 and 2.2? Everything is 3.2.2 - What transports are you using (inproc, tcp, ipc)? TCP for publishing - Are you using XPUB and XSUB directly or are the endpoints actually PUB/SUB but you are seeing a crash in the parent? PUB/SUB - How many subscriptions do you have on each endpoint? Is difficult to say but there should be no more than 5 or 6. - Are there any intermediate devices between the edge endpoints (e.g. a FORWARDER device)? No - Any chance you can use a Windows OS that is not EOL? :) I am afraid Windows itself has been EOL for long but we keep on using. NOTE: It has crashed again, I may get, if not a test-cas, at least a pattern. best, Pau El 05/03/2013 16:00, Charles Remes escribió: Doesn't ring a bell for me. A few questions… Are all endpoints using 3.2.2 or is it a mix of 3.2.2 and 2.2? What transports are you using (inproc, tcp, ipc)? Are you using XPUB and XSUB directly or are the endpoints actually PUB/SUB but you are seeing a crash in the parent? How many subscriptions do you have on each endpoint? Are there any intermediate devices between the edge endpoints (e.g. a FORWARDER device)? Any chance you can use a Windows OS that is not EOL? :) cr On Mar 5, 2013, at 8:55 AM, Pau p...@teleopsia.com wrote: Hi, they have found today 2 servers publishing using xsub crashed in mtrie.cpp[line 293] in function zmq::mtrie_t::rm_helper(..) line apparently tryng to acces if (pipes-empty ()). I guess pipes was rubish but I could not debug and I have been unable to reproduce at the moment. The function was called from xpub_t when publishing a message. It happened at the same time in 2 apps in the same machine but unrelated. We work with 3.2.2 in Windows XP in an environment where there are like 5 o 6 different sockets per application and arounf 5 or 6 normally on. I am trying to provoque it back to make a test case but at the moment I couldn't. Rings a bell to anybody?, thanks, Pau Ceano ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev
Re: [zeromq-dev] zmq::mtrie_t::rm_helper(..)
I have found that this happens after subscribing from a pub many (4)
times to the same string. I have changed the subscriber and now I do not
see the crash in the publisher.
I am trying to narrow the problem better.
I leave the stack in case it gives any clue.
libzmq.dll!zmq::mtrie_t::rm_helper(unsigned char *
prefix_=0x0372e1d8, unsigned int size_=0, zmq::pipe_t *
pipe_=0x10023fb4) Línea 293C++
libzmq.dll!zmq::mtrie_t::rm_helper(unsigned char *
prefix_=0x3072e1d7, unsigned int size_=1, zmq::pipe_t *
pipe_=0x038e9780) Línea 311 + 0x16 bytesC++
libzmq.dll!zmq::mtrie_t::rm_helper(unsigned char *
prefix_=0x3072e1d6, unsigned int size_=2, zmq::pipe_t *
pipe_=0x038e9780) Línea 311 + 0x16 bytesC++
libzmq.dll!zmq::mtrie_t::rm_helper(unsigned char *
prefix_=0x3172e1d5, unsigned int size_=3, zmq::pipe_t *
pipe_=0x038e9780) Línea 311 + 0x16 bytesC++
libzmq.dll!zmq::xpub_t::xread_activated(zmq::pipe_t *
pipe_=0x038e9780) Línea 69C++
libzmq.dll!zmq::xpub_t::xattach_pipe(zmq::pipe_t *
pipe_=0x038e9780, bool icanhasall_=false) Línea 53 + 0xa bytes C++
libzmq.dll!zmq::socket_base_t::attach_pipe(zmq::pipe_t *
pipe_=0x038e9780, bool icanhasall_=false) Línea 233C++
libzmq.dll!zmq::socket_base_t::process_bind(zmq::pipe_t *
pipe_=0x038e9780) Línea 854 + 0xe bytesC++
libzmq.dll!zmq::object_t::process_command(zmq::command_t
cmd_={...}) Línea 92C++
libzmq.dll!zmq::socket_base_t::process_commands(int timeout_=0,
bool throttle_=true) Línea 826C++
libzmq.dll!zmq::socket_base_t::send(zmq::msg_t * msg_=0x0372e518,
int flags_=3) Línea 614C++
libzmq.dll!zmq_sendmsg(void * s_=0x02b5e068, zmq_msg_t *
msg_=0x0372e518, int flags_=3) Línea 346 + 0x2b bytesC++
BoxDu.exe!zmq::socket_t::send(zmq::message_t msg_={...}, int
flags_=3) Línea 376 + 0x16 bytesC++
BoxDu.exe!zmsg::send(zmq::socket_t socket={...}) Línea 148 +
0x32 bytesC++
BoxDu.exe!zmqMajordomo::mdbroker::actor_process(std::basic_stringchar,std::char_traitschar,std::allocatorchar
sender=101410101, zmsg * msg=0x0496d068) Línea 810C++
BoxDu.exe!zmqMajordomo::mdbroker::brokering() Línea 124 + 0x16
bytesC++
BoxDu.exe!V3ActorBroker::poll() Línea 164C++
BoxDu.exe!V3ActorThread::Run() Línea 95 + 0x17 bytesC++
BoxDu.exe!V3_Thread::Wrapper(void * pv=0x0333e718) Línea 32 + 0xf
bytesC++
kernel32.dll!7c80b729()
El 05/03/2013 16:00, Charles Remes escribió:
Doesn't ring a bell for me.
A few questions…
Are all endpoints using 3.2.2 or is it a mix of 3.2.2 and 2.2?
What transports are you using (inproc, tcp, ipc)?
Are you using XPUB and XSUB directly or are the endpoints actually PUB/SUB
but you are seeing a crash in the parent?
How many subscriptions do you have on each endpoint?
Are there any intermediate devices between the edge endpoints (e.g. a
FORWARDER device)?
Any chance you can use a Windows OS that is not EOL? :)
cr
On Mar 5, 2013, at 8:55 AM, Pau p...@teleopsia.com wrote:
Hi, they have found today 2 servers publishing using xsub crashed in
mtrie.cpp[line 293] in function zmq::mtrie_t::rm_helper(..) line
apparently tryng to acces if (pipes-empty ()). I guess pipes was rubish
but I could not debug and I have been unable to reproduce at the moment.
The function was called from xpub_t when publishing a message. It
happened at the same time in 2 apps in the same machine but unrelated.
We work with 3.2.2 in Windows XP in an environment where there are like
5 o 6 different sockets per application and arounf 5 or 6 normally on. I
am trying to provoque it back to make a test case but at the moment I
couldn't.
Rings a bell to anybody?,
thanks,
Pau Ceano
___
zeromq-dev mailing list
zeromq-dev@lists.zeromq.org
http://lists.zeromq.org/mailman/listinfo/zeromq-dev
___
zeromq-dev mailing list
zeromq-dev@lists.zeromq.org
http://lists.zeromq.org/mailman/listinfo/zeromq-dev
___
zeromq-dev mailing list
zeromq-dev@lists.zeromq.org
http://lists.zeromq.org/mailman/listinfo/zeromq-dev
[zeromq-dev] Frequent error messages
Hi there! Upon stressing a Java / ZMQ based piece of software, I'm getting TWO repeated errors every now and then, they are: Bad file descriptor (kqueue.cpp:76) Resource busy (./mutex.hpp:90) I'm using a request/reply schema from the client point of view (Mac OSX Darwin Kernel Version 12.2.0:xnu-2050.18.24~1/RELEASE_X86_64 x86_64, jdk 1.6.0), and a ROUTER/DEALER/WORKERS schema in the server side (CentOS Linux 6.2 kernel 2.6.32-220.el6.x86_64, Sun Java build 1.6.0_39-b04). ZMQ Java bindings where built last week. What additional details should I provide? Gonzalo Vásquez Sáez Gerente Investigación y Desarrollo (RD) Altiuz Soluciones Tecnológicas de Negocios Ltda. Av. Nueva Tajamar 555 Of. 802, Las Condes - CP 7550099 +56 2 335 2461 gvasq...@altiuz.cl http://www.altiuz.cl http://www.altiuzreports.com ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev
Re: [zeromq-dev] Data integrity and security using ZeroMQ over a WAN
Adam, There are by my count five separate projects working on this; the most promising is Lourens Naudé's TLS transport inside the library; the most usable today is Salt Stack's distributed security model, which should be quite easy to reimplement. I'd suggest reading this: http://www.zeromq.org/topics:pubsub-security, which is basically Salt's model. This approach has various weaknesses such as replay attacks, but is already fairly good. -Pieter On Tue, Mar 5, 2013 at 2:02 PM, Adam Covitch adam.covi...@gmail.com wrote: Is there a standard approach to ensuring data integrity and security using ZeroMQ? I'm new to this community and don't see an obvious approach. By 'data integrity' I mean that the message recieved is the same as the one sent. We'll mostly be messaging over TCP, which has problems with jumbo packets. But I want to ensure end-to-end data integrity, including encryption and message packaging. I'm thinking along the lines of embedding a checksum in the message or something like that. Not a big deal to roll my own solution, but I would rather not reinvent the wheel.. If ZeroMQ doesn't offer this, are there any transfer protocol technologies that may help? I was planning on just using JSON or BSON, but am open to alternatives. By 'security' I mean to make it reasonably difficult for my message to be interpreted by sniffing the network traffic. I was originally thinking about tunneling the ZeroMQ connection over SSH, but was told that this would degrade performance considerably. Any thoughts are welcome! ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev
Re: [zeromq-dev] zmq::mtrie_t::rm_helper(..)
On Tue, Mar 5, 2013 at 4:42 PM, Pau p...@teleopsia.com wrote: I have found that this happens after subscribing from a pub many (4) times to the same string. I have changed the subscriber and now I do not see the crash in the publisher. I am trying to narrow the problem better. This is great. If you would like any help in making a reproducible test case, give a yell. -Pieter ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev
Re: [zeromq-dev] Frequent error messages
On Tue, Mar 5, 2013 at 9:57 PM, Gonzalo Vasquez gvasq...@altiuz.cl wrote: Hi there! Upon stressing a Java / ZMQ based piece of software, I'm getting TWO repeated errors every now and then, they are: Hi Gonzalo, As with any error you're trying to report (to any project, I guess), the best tool is a minimal (I can't emphasize that enough) test case that provokes the crash. If you can make this in Java we can recreate it in C, and see where the problem is. The test case is essential to fixing the problem since after we fix it we have to run the same test case to be 100% the problem is gone. -Pieter ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev
Re: [zeromq-dev] Frequent error messages
Ok, minimal might be a problem, but I'll try to achieve that Enviado desde mi iPhone El 05-03-2013, a las 18:19, Pieter Hintjens p...@imatix.com escribió: On Tue, Mar 5, 2013 at 9:57 PM, Gonzalo Vasquez gvasq...@altiuz.cl wrote: Hi there! Upon stressing a Java / ZMQ based piece of software, I'm getting TWO repeated errors every now and then, they are: Hi Gonzalo, As with any error you're trying to report (to any project, I guess), the best tool is a minimal (I can't emphasize that enough) test case that provokes the crash. If you can make this in Java we can recreate it in C, and see where the problem is. The test case is essential to fixing the problem since after we fix it we have to run the same test case to be 100% the problem is gone. -Pieter ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev
