I think it should be a good add-on to Beam IO collection. I created a JIra for that, feel free to contribute if you want. I’l be happy to help/review. https://issues.apache.org/jira/browse/BEAM-10325 <https://issues.apache.org/jira/browse/BEAM-10325>
> On 25 Jun 2020, at 13:06, Niel Markwick <[email protected]> wrote: > > I had a customer recently ask me for something similar... > > My response was that there is nothing in Beam directly, but an existing > message queue source (such as rabbitmq) could be copied and adapted to use > ZeroMQ. The actual amount of code that would need to be modified is very > little: the majority of the code is for configuration of the connector. > > A non-serious over-engineered alternative would be ZMQ->Kafka->Beam... > > > > On Wed, 24 Jun 2020, 22:50 Luke Cwik, <[email protected] > <mailto:[email protected]>> wrote: > I'm not aware of any ZeroMQ connector implementations that are part of Apache > Beam. > > On Wed, Jun 24, 2020 at 11:44 AM Sherif A. Kozman > <[email protected] > <mailto:[email protected]>> wrote: > Hello, > > We were in the process of planning a deployment of exporting stream data from > Aruba Networks Analytics engine through Apache beam and it turns out that it > utilizes ZeroMQ for messaging. > We couldn't find any ZeroMQ connectors and were wondering if it does exist or > it would be compatible with other connectors for Apache Beam. > > Thanks > Sherif Kozman > <http://www.extremesolution.com/> > Sherif Kozman > Extreme Solution > A: 17875 Von Karman Ave suite 150, Irvine, CA, 92614 > P: +1 714 719 2237 <tel:+1-714-719-2237> M: +20 122 2426241 > <tel:+20-122-2426241> > E: [email protected] <mailto:[email protected]> W: > www.extremesolution.com <http://www.extremesolution.com/> > <https://twitter.com/extremesolution> > <https://www.facebook.com/extremesolution/> > <https://www.instagram.com/extremesolutionllc/> > <https://www.linkedin.com/company/extreme-solution/> > This email and any files transmitted with it are confidential and intended > solely for the use of the individual or entity to whom they are addressed. If > you have received this email in error please notify the system manager. This > message contains confidential information and is intended only for the > individual named. If you are not the named addressee you should not > disseminate, distribute or copy this e-mail. Please notify the sender > immediately by e-mail if you have received this e-mail by mistake and delete > this e-mail from your system. If you are not the intended recipient you are > notified that disclosing, copying, distributing or taking any action in > reliance on the contents of this information is strictly prohibited. > ↪ Schedule A Meeting With Me! > <https://calendar.google.com/calendar/embed?src=sherif%40extremesolution.com&ctz=Africa%2FCairo> > <https://www.credential.net/r99bzgde> >
