Re: [zeromq-dev] Question on connecting a C++ model to a Java model via Python uzing ZeroMQ

[Sara Rimer]

Hi everyone,

I am finally getting back to this part of my project. So I think the issue
is that I just can't get ZeroMQ to work with Java on my machine. I have
tried JeroMQ as well. I have been following this guide:
http://zeromq.org/bindings:java and when I try

$ java -cp /usr/local/share/java/zmq.jar:. local_lat tcp://127.0.0.1:5000 1 100

I get this error

Error: Could not find or load main class local_lat

I think I have just not found a good guide for how to set up ZeroMQ for
Java on Linux 12.04. Any suggestions?

Thank you.

Sincerely,
Sara

On Mon, Mar 28, 2016 at 8:30 PM, Stephen Riesenberg <
stephen.riesenb...@gmail.com> wrote:

> Sara,
>
> How far have you gotten in your effort? Do you have an example class? What
> issues did you run into? What requirements do you have for your API? Is it
> files, or just data you are sending back and forth between these two
> environments?
>
> Sorry for so many questions, but I bet with a few details we can get you
> pointed in the right direction. Sounds like an interesting project!
>
> On Friday, March 25, 2016, Sara Rimer  wrote:
>
>> Hello,
>>
>> This is most likely a very basic usage of ZeroMQ, but I am a
>> computational engineer and I am trying to connect a hydraulic model written
>> in C++ to a decision tree model written in Java. I would like to send data
>> files back and forth between the two programs. I am using ZeroMQ for this.
>> And I have gotten ZeroMQ to work via Python no problem (which I am planning
>> on using for my C++ model which I run via a bash script). However, I am
>> having difficulty interfacing it with Java. I was planning on just creating
>> a class in Java that is solely used to interface with ZeroMQ. Does anyone
>> have any suggestions?
>>
>> Thanks,
>> Sara
>>
>>
>>
>>
> ___
> zeromq-dev mailing list
> zeromq-dev@lists.zeromq.org
> http://lists.zeromq.org/mailman/listinfo/zeromq-dev
>
>


-- 
Sara Rimer
University of Michigan Graduate Student
Department of Civil and Environmental Engineering
sri...@umich.edu
sara.p.ri...@gmail.com
269.483.6334
___
zeromq-dev mailing list
zeromq-dev@lists.zeromq.org
http://lists.zeromq.org/mailman/listinfo/zeromq-dev

Re: [zeromq-dev] Malamute selftest crashes on exit in Windows

[Osiris Pedroso]

It is actually a LIBZMQ issue: https://github.com/zeromq/libzmq/issues/1708

I was able to workaround it by adding fcloseall() prior to return from
main(), but don't know if that is the fix.

On Tue, Apr 26, 2016 at 7:00 PM Pieter Hintjens  wrote:

> Sounds like a free() being used somewhere instead of a zstr_free().
>
> On Tue, Apr 26, 2016 at 10:17 PM, Osiris Pedroso 
> wrote:
> > Got latest zeromq (as of yesterday), built all in Windows using Dev2013.
> >
> > https://github.com/zeromq/malamute/issues/169
> >
> > Seems to only happen in those versions that use the LIBZMQ dll, not if
> > linked statically.
> >
> > ___
> > zeromq-dev mailing list
> > zeromq-dev@lists.zeromq.org
> > http://lists.zeromq.org/mailman/listinfo/zeromq-dev
> ___
> zeromq-dev mailing list
> zeromq-dev@lists.zeromq.org
> http://lists.zeromq.org/mailman/listinfo/zeromq-dev
>
___
zeromq-dev mailing list
zeromq-dev@lists.zeromq.org
http://lists.zeromq.org/mailman/listinfo/zeromq-dev

Re: [zeromq-dev] Stable release downloads (was Re: CZMQ "stable" release versioning)

[Ewen McNeill]

On 28/04/16 2:23, Doron Somech wrote:

Regarding the existing files, I think we have two options:
* Upload all to github, I can make a script that will make it simpler
* Use Amazon S3, I think it will very cheap, maybe even for free, I can
take care for that as well.


AFAICT, uploading the binary release artefacts to GitHub, results in 
GitHub storing them on S3 (at GitHub's expense).  Given the source 
repositories are on GitHub, I think that'd be my default choice for the 
existing files.


Thanks for the offer to help with scripting uploads of the existing 
files.  I think the main "hard" bit (ie, require a human) left would be 
figuring out which commits to put the release tags on, so that they 
match up with what is in the tarballs.  Maybe someone else can help with 
identifying those commits?


Directly using S3 is worth considering, but I think at best it would be 
free for 1 year:


https://aws.amazon.com/free/faqs/

"5 GB of Amazon S3 standard storage, 20,000 Get Requests, and 2,000 Put 
Requests*"


has the little star that means "available for 12 months following your 
AWS sign-up date'.  So going the S3 route would mean finding some way to 
fund it on an on-going basis.  It's relatively cheap 
(https://aws.amazon.com/s3/pricing/), but not free ($0.03/GB for 
storage/month, plus $0.09/GB for transfers to the Internet; at a guess 
less than a few dollars a month, but having to be paid every month).


Ewen

PS: Re http://www.zoobab.com/github-sucks-wget-unfriendly, the issue 
seems to be the URL structure doesn't have the filename at the end. 
Annoying, undesirable, but IMHO, not a fatal reason not to use it.  It'd 
perhaps be better to lobby GitHub to change their URL structure to end 
in the original filename and/or a simulated final filename; it should be 
a relatively simple change for them.


___
zeromq-dev mailing list
zeromq-dev@lists.zeromq.org
http://lists.zeromq.org/mailman/listinfo/zeromq-dev

Re: [zeromq-dev] Stable release downloads (was Re: CZMQ "stable" release versioning)

[Benjamin Henrion]

On Wed, Apr 27, 2016 at 4:23 PM, Doron Somech  wrote:
> For NetMQ we have automated release process using github releases. Once you
> make the release on github the CI (appvayor) compile the library and upload
> the artifacts to github.
>
> We can do the same with libzmq and czmq, a little bit of work though. I have
> less experience with travis, so I would need help with that.
>
> Regarding the existing files, I think we have two options:
> * Upload all to github, I can make a script that will make it simpler
> * Use Amazon S3, I think it will very cheap, maybe even for free, I can take
> care for that as well.

Github is still a pain, and it does not replaces the simplicity of a
static http/ftp server:

http://www.zoobab.com/github-sucks-wget-unfriendly

For example, if you want to make a mirror of all tarball releases, it
is a nightmare.

--
Benjamin Henrion 
FFII Brussels - +32-484-566109 - +32-2-3500762
"In July 2005, after several failed attempts to legalise software
patents in Europe, the patent establishment changed its strategy.
Instead of explicitly seeking to sanction the patentability of
software, they are now seeking to create a central European patent
court, which would establish and enforce patentability rules in their
favor, without any possibility of correction by competing courts or
democratically elected legislators."
___
zeromq-dev mailing list
zeromq-dev@lists.zeromq.org
http://lists.zeromq.org/mailman/listinfo/zeromq-dev

Re: [zeromq-dev] Stable release downloads (was Re: CZMQ "stable" release versioning)

[Doron Somech]

For NetMQ we have automated release process using github releases. Once you
make the release on github the CI (appvayor) compile the library and upload
the artifacts to github.

We can do the same with libzmq and czmq, a little bit of work though. I
have less experience with travis, so I would need help with that.

Regarding the existing files, I think we have two options:
* Upload all to github, I can make a script that will make it simpler
* Use Amazon S3, I think it will very cheap, maybe even for free, I can
take care for that as well.

Doron





On Wed, Apr 27, 2016 at 11:52 AM, Ewen McNeill 
wrote:

> On 25/04/16 21:51, Pieter Hintjens wrote:
>
>> Yes, retiring the deprecated APIs and bumping the major version should
>> go together.
>>
>
> It also seems timely to raise where these stable release downloads come
> from when a user downloads them.
>
> http://zeromq.org/intro:get-the-software
>
> links to download URLs like:
>
> http://download.zeromq.org/zeromq-4.1.4.tar.gz
>
> and download.zeromq.org is:
>
> ewen@ashram:~$ host download.zeromq.org
> download.zeromq.org is an alias for virtual.imatix.com.
> virtual.imatix.com has address 95.142.169.98
> virtual.imatix.com mail is handled by 10 mail-in.imatix.com.
> ewen@ashram:~$
>
> and virtual.imatix.com is an alternative name for a VM... that is paid
> for by iMatix (ie, by Pieter).
>
> So we'll need to find another place to host these downloads.  Personally
> I'd like it if _all_ the existing downloads were moved to that new place,
> rather than just being abandoned (I've spent too much time last year/this
> year trying to track down old code that didn't get carried along with moves
> to want to cause that to happen again).  That would also let us potentially
> make download.zeromq.org point at that new location, and thus keep
> existing URLs working.
>
> Currently there are 160 downloadable files on download.zeromq.org, taking
> up 194MB of files; so an average around 1.2MB each.  With presumably some
> of them being downloaded more than a trivial number of times.
>
> Pieter and I briefly discussed using GitHub Releases:
>
> https://help.github.com/articles/creating-releases/
>
> along with a custom binary which was whatever tarball, binary, etc, had
> been built.  From what I could tell from a quick look this is plausible
> without cost (for an open source project), at least under 1GB total (
> https://help.github.com/articles/what-is-my-disk-quota/) and maybe larger
> if they're explicitly attached to releases (
> https://help.github.com/articles/distributing-large-binaries/) which then
> seem to get stored outside the git archive itself.
>
> But (a) there's a "technical debt" of uploading 160 files (with 1-2 files
> per release), and (b) there aren't even any tags on the zeromq/libzmq
> repository AFAICT, so there's also the technical debt of figuring out where
> all these files should "attach" (ie, what's the matching source).
>
> I'm explicitly _not_ volunteering to spend the time figuring out where all
> these tags belong, and releases should be created/uploaded.[0]  But I can,
> eg, provide someone with a list of URLs to download all the files from
> download.zeromq.org if they were to volunteer to do this.
>
> There's an API to automate some of it:
>
> https://developer.github.com/v3/repos/releases/#create-a-release
>
> but that also requires a git commit ID to attach each release/set of files
> to... which I suspect is the hard part to figure out.
>
> Alternatively, other ideas for where to store the downloads that don't
> rely on iMatix/Pieter would be a good idea.  Before the next release is
> "cut".
>
> Ewen
>
> [0] My "software archaeology" time has been going into:
>
> https://github.com/imatix-legacy/
> https://imatix-legacy.github.io/
>
> (there's still a couple of pieces to convert over to GitHub, but the
> imatix-legacy.github.io one is now close to replicating the early 2000
> iMatix website, with the source for everything at
> github.com/imatix-legacy/ in at least a "human reviewable" form.)
> ___
> zeromq-dev mailing list
> zeromq-dev@lists.zeromq.org
> http://lists.zeromq.org/mailman/listinfo/zeromq-dev
>
___
zeromq-dev mailing list
zeromq-dev@lists.zeromq.org
http://lists.zeromq.org/mailman/listinfo/zeromq-dev

[zeromq-dev] Stable release downloads (was Re: CZMQ "stable" release versioning)

[Ewen McNeill]

On 25/04/16 21:51, Pieter Hintjens wrote:

Yes, retiring the deprecated APIs and bumping the major version should
go together.


It also seems timely to raise where these stable release downloads come 
from when a user downloads them.


http://zeromq.org/intro:get-the-software

links to download URLs like:

http://download.zeromq.org/zeromq-4.1.4.tar.gz

and download.zeromq.org is:

ewen@ashram:~$ host download.zeromq.org
download.zeromq.org is an alias for virtual.imatix.com.
virtual.imatix.com has address 95.142.169.98
virtual.imatix.com mail is handled by 10 mail-in.imatix.com.
ewen@ashram:~$

and virtual.imatix.com is an alternative name for a VM... that is paid 
for by iMatix (ie, by Pieter).


So we'll need to find another place to host these downloads.  Personally 
I'd like it if _all_ the existing downloads were moved to that new 
place, rather than just being abandoned (I've spent too much time last 
year/this year trying to track down old code that didn't get carried 
along with moves to want to cause that to happen again).  That would 
also let us potentially make download.zeromq.org point at that new 
location, and thus keep existing URLs working.


Currently there are 160 downloadable files on download.zeromq.org, 
taking up 194MB of files; so an average around 1.2MB each.  With 
presumably some of them being downloaded more than a trivial number of 
times.


Pieter and I briefly discussed using GitHub Releases:

https://help.github.com/articles/creating-releases/

along with a custom binary which was whatever tarball, binary, etc, had 
been built.  From what I could tell from a quick look this is plausible 
without cost (for an open source project), at least under 1GB total 
(https://help.github.com/articles/what-is-my-disk-quota/) and maybe 
larger if they're explicitly attached to releases 
(https://help.github.com/articles/distributing-large-binaries/) which 
then seem to get stored outside the git archive itself.


But (a) there's a "technical debt" of uploading 160 files (with 1-2 
files per release), and (b) there aren't even any tags on the 
zeromq/libzmq repository AFAICT, so there's also the technical debt of 
figuring out where all these files should "attach" (ie, what's the 
matching source).


I'm explicitly _not_ volunteering to spend the time figuring out where 
all these tags belong, and releases should be created/uploaded.[0]  But 
I can, eg, provide someone with a list of URLs to download all the files 
from download.zeromq.org if they were to volunteer to do this.


There's an API to automate some of it:

https://developer.github.com/v3/repos/releases/#create-a-release

but that also requires a git commit ID to attach each release/set of 
files to... which I suspect is the hard part to figure out.


Alternatively, other ideas for where to store the downloads that don't 
rely on iMatix/Pieter would be a good idea.  Before the next release is 
"cut".


Ewen

[0] My "software archaeology" time has been going into:

https://github.com/imatix-legacy/
https://imatix-legacy.github.io/

(there's still a couple of pieces to convert over to GitHub, but the 
imatix-legacy.github.io one is now close to replicating the early 2000 
iMatix website, with the source for everything at 
github.com/imatix-legacy/ in at least a "human reviewable" form.)

___
zeromq-dev mailing list
zeromq-dev@lists.zeromq.org
http://lists.zeromq.org/mailman/listinfo/zeromq-dev

Re: [zeromq-dev] UDP without PGM

[Doron Somech]

And port, bind/connect are the same
On Apr 27, 2016 11:12, "Doron Somech"  wrote:

> Both unicast and multicast, just specify multicast address.
> On Apr 27, 2016 11:00, "Ben Kloosterman"  wrote:
>
>> Unicast only right.. ( else id love to know how)
>>
>> On Wed, Apr 27, 2016 at 12:45 AM, Brian Adamson <
>> brian.adam...@nrl.navy.mil> wrote:
>>
>>> The NORM transport engine can also provide a UDP-like delivery service
>>> and on top of that will do segmentation/reassembly of larger messages and
>>> can have proactive packet erasure FEC added to the stream for additional
>>> quasi-reliable robustness.  _But_, those features are not yet exposed as
>>> options through through the ZeroMQ API.   If someone is interested in that,
>>> I would be happy to discuss it further.
>>>
>>> best regards,
>>>
>>> Brian
>>>
>>>
>> ___
>> zeromq-dev mailing list
>> zeromq-dev@lists.zeromq.org
>> http://lists.zeromq.org/mailman/listinfo/zeromq-dev
>>
>
___
zeromq-dev mailing list
zeromq-dev@lists.zeromq.org
http://lists.zeromq.org/mailman/listinfo/zeromq-dev

Re: [zeromq-dev] UDP without PGM

[Doron Somech]

Both unicast and multicast, just specify multicast address.
On Apr 27, 2016 11:00, "Ben Kloosterman"  wrote:

> Unicast only right.. ( else id love to know how)
>
> On Wed, Apr 27, 2016 at 12:45 AM, Brian Adamson <
> brian.adam...@nrl.navy.mil> wrote:
>
>> The NORM transport engine can also provide a UDP-like delivery service
>> and on top of that will do segmentation/reassembly of larger messages and
>> can have proactive packet erasure FEC added to the stream for additional
>> quasi-reliable robustness.  _But_, those features are not yet exposed as
>> options through through the ZeroMQ API.   If someone is interested in that,
>> I would be happy to discuss it further.
>>
>> best regards,
>>
>> Brian
>>
>>
> ___
> zeromq-dev mailing list
> zeromq-dev@lists.zeromq.org
> http://lists.zeromq.org/mailman/listinfo/zeromq-dev
>
___
zeromq-dev mailing list
zeromq-dev@lists.zeromq.org
http://lists.zeromq.org/mailman/listinfo/zeromq-dev

Re: [zeromq-dev] UDP without PGM

[Ben Kloosterman]

Unicast only right.. ( else id love to know how)

On Wed, Apr 27, 2016 at 12:45 AM, Brian Adamson 
wrote:

> The NORM transport engine can also provide a UDP-like delivery service and
> on top of that will do segmentation/reassembly of larger messages and can
> have proactive packet erasure FEC added to the stream for additional
> quasi-reliable robustness.  _But_, those features are not yet exposed as
> options through through the ZeroMQ API.   If someone is interested in that,
> I would be happy to discuss it further.
>
> best regards,
>
> Brian
>
>
___
zeromq-dev mailing list
zeromq-dev@lists.zeromq.org
http://lists.zeromq.org/mailman/listinfo/zeromq-dev

Re: [zeromq-dev] UDP without PGM

[Doron Somech]

It is not reliable (and currently doesn't support PGM).

It is pretty new and not yet documented, you can take a look at the test:

https://github.com/zeromq/libzmq/blob/master/tests/test_radio_dish.cpp

Few differences from pubsub:
* Exact matching (vs prefix matching of pubsub)
* Group (Topic) is null terminated string
* Group is currently limited to 16 chars (including terminating null),
should be extended in the future
* To join/leave a group you call zmq_join/zmq_leave (vs zmq_setsockopt of
pubsub)
* To set the group of a message you need to set msg group property using
zmq_msg_set_group
* It doesn't support multipart (the group is part of the message)

Hopefully will document it soon.

Doron


On Tue, Apr 26, 2016 at 5:52 PM, Utsav Drolia  wrote:

> Is there a document/note describing the internals for the Radio/Dish
> pattern?
> Also, when you say multicast, I am assuming it is not reliable?
>
> Thanks!
>
> On Apr 26, 2016, at 3:54 AM, Doron Somech  wrote:
>
> Zeromq now have UDP transport, which you can use with the radio-dish
> socket types.
>
> No docs yet so take a look at the following test:
>
> https://github.com/zeromq/libzmq/blob/master/tests/test_udp.cpp
>
> Both multicast and unicast should work.
>
> On Tue, Apr 26, 2016 at 6:26 AM, Ben Kloosterman 
> wrote:
>
>> Just leave the UDP ..  I use UDP  as a separate channel and its so
>> different that it should always be considered different eg no guarantee ,
>> no packet > 64K / MTU  etc etc Forcing it to the sane structure is likely
>> to be a bad idea.
>>
>> Ben
>>
>> On Tue, Apr 26, 2016 at 8:10 AM, TL;DR  wrote:
>>
>>> Hi, I just wanted to kick this conversation again.
>>>
>>> Does anyone have any pointers to patches or experimental versions that
>>> provide UDP datagram transport without PGM?  Just plain UDP for
>>> unicast/multicast.
>>>
>>> I have migrated pretty much all services in a system over to ZeroMQ.
>>> But there is a use case where I use UDP today, and haven't been able to do
>>> so.  I'm thinking there must be others (esp in finance) who are in the same
>>> boat.
>>>
>>> PGM is a non-starter because auto-magical but late delivery is worse for
>>> us than no delivery in this use case.  These particular applications have
>>> more complex behavior when they have missed something, and there is a
>>> favored application level mechanism for detection of missed messages and
>>> recovery.
>>>
>>> Thanks for any advice,
>>>
>>> ___
>>> zeromq-dev mailing list
>>> zeromq-dev@lists.zeromq.org
>>> http://lists.zeromq.org/mailman/listinfo/zeromq-dev
>>>
>>
>>
>> ___
>> zeromq-dev mailing list
>> zeromq-dev@lists.zeromq.org
>> http://lists.zeromq.org/mailman/listinfo/zeromq-dev
>>
>
> ___
> zeromq-dev mailing list
> zeromq-dev@lists.zeromq.org
> http://lists.zeromq.org/mailman/listinfo/zeromq-dev
>
>
>
> ___
> zeromq-dev mailing list
> zeromq-dev@lists.zeromq.org
> http://lists.zeromq.org/mailman/listinfo/zeromq-dev
>
___
zeromq-dev mailing list
zeromq-dev@lists.zeromq.org
http://lists.zeromq.org/mailman/listinfo/zeromq-dev