Re: Apache Pulsar connector for Beam

2019-10-28 Thread Yijie Shen 
I've written pulsar-flink and pulsar-spark connectors before.

Please feel free to ping me if you need some help.

Best,
Yijie

On Mon, Oct 28, 2019 at 1:21 AM Sijie Guo  wrote:

> Add Yijie in the loop. He can help from Pulsar side.
>
> - Sijie
>
> On Sat, Oct 26, 2019 at 7:23 PM Taher Koitawala 
> wrote:
>
>> Awesome. Thanks Max. Will definitely keep the community posted on this.
>>
>> On Sat, Oct 26, 2019, 4:21 PM Maximilian Michels  wrote:
>>
>>> Awesome. I've made you a contributor, so you can also create issues and
>>> assign yourself now.
>>>
>>> Please let us know about the progress once you start writing the
>>> connector.
>>>
>>> Thanks,
>>> Max
>>>
>>> On 26.10.19 12:36, Taher Koitawala wrote:
>>> > Thank you Alex and Max,
>>> >  My jira id is taherk77. Please add me.
>>> >
>>> > Regards,
>>> > Taher Koitawala
>>> >
>>> > On Sat, Oct 26, 2019, 3:53 PM Maximilian Michels >> > > wrote:
>>> >
>>> > That sounds great. How about you start looking into this Taher? If
>>> > necessary, Sijie could provide additional insight into Pulsar.
>>> >
>>> > Please create a JIRA account so we can assign you to
>>> > https://issues.apache.org/jira/browse/BEAM-8218
>>> >
>>> > Thanks,
>>> > Max
>>> >
>>> > On 26.10.19 12:08, Alex Van Boxel wrote:
>>> >  > Hey Taher, do you have a Jira account? Then I will assign the
>>> > ticket to
>>> >  > you. I made the ticket because we should have one, feel free to
>>> > take the
>>> >  > lead on this one.
>>> >  >
>>> >  >   _/
>>> >  > _/ Alex Van Boxel
>>> >  >
>>> >  >
>>> >  > On Fri, Oct 25, 2019 at 9:35 PM Taher Koitawala
>>> > mailto:taher...@gmail.com>
>>> >  > >> wrote:
>>> >  >
>>> >  > I would be interested in contributing to the Pulsar Beam
>>> > connector.
>>> >  > That's one of the reasons i started the email thread.
>>> >  >
>>> >  >
>>> >  > Regards,
>>> >  > Taher Koitawala
>>> >  >
>>> >  > On Sat, Oct 26, 2019, 9:41 AM Sijie Guo >> > 
>>> >  > >>
>>> wrote:
>>> >  >
>>> >  > This is Sijie Guo from StreamNative and Pulsar PMC.
>>> >  >
>>> >  > Maximilian - thank you for adding us in the email
>>> thread!
>>> >  >
>>> >  > We do have one roadmap item for adding a Beam connector
>>> for
>>> >  > Pulsar. It was planned for this quarter, but we haven’t
>>> > started
>>> >  > the implementation yet. If the Beam community is
>>> > interested in
>>> >  > it, we are happy to collaborate with Beam community.
>>> >  >
>>> >  > Thanks,
>>> >  > Sijie
>>> >  >
>>> >  > On Sat, Oct 26, 2019 at 12:36 AM Maximilian Michels
>>> >  > mailto:m...@apache.org>
>>> > >> wrote:
>>> >  >
>>> >  > It would be great to have a Pulsar connector. We
>>> > might want
>>> >  > to ask the
>>> >  > folks from StreamNative (in CC). Any plans? :)
>>> >  >
>>> >  > Cheers,
>>> >  > Max
>>> >  >
>>> >  > On 24.10.19 18:31, Pablo Estrada wrote:
>>> >  >  > There's a JIRA issue to track this:
>>> >  >  > https://issues.apache.org/jira/browse/BEAM-8218
>>> >  >  >
>>> >  >  > Alex was kind enough to file it. +Alex Van Boxel
>>> >  >  > > a...@vanboxel.be>
>>> > >> : )
>>> >  >  > Best
>>> >  >  > -P
>>> >  >  >
>>> >  >  > On Thu, Oct 24, 2019 at 12:01 AM Taher Koitawala
>>> >  > mailto:taher...@gmail.com>
>>> > >
>>> >  >  > >> >  >> > >> >  > wrote:
>>> >  >  >
>>> >  >  > Hi Reza,
>>> >  >  >   Thanks for your reply. However
>>> i
>>> > do not
>>> >  > see Pulsar
>>> >  >  > listed in there. Should we file a jira?
>>> >  >  >
>>> >  >  > On Thu, Oct 24, 2019, 12:16 PM Reza Rokni
>>> >  > mailto:r...@google.com>
>>> > >
>>> >  >  > > r...@google.com>
>>> > >> >  >  >
>>> >  >

Re: Apache Pulsar connector for Beam

2019-10-27 Thread Sijie Guo 
Add Yijie in the loop. He can help from Pulsar side.

- Sijie

On Sat, Oct 26, 2019 at 7:23 PM Taher Koitawala  wrote:

> Awesome. Thanks Max. Will definitely keep the community posted on this.
>
> On Sat, Oct 26, 2019, 4:21 PM Maximilian Michels  wrote:
>
>> Awesome. I've made you a contributor, so you can also create issues and
>> assign yourself now.
>>
>> Please let us know about the progress once you start writing the
>> connector.
>>
>> Thanks,
>> Max
>>
>> On 26.10.19 12:36, Taher Koitawala wrote:
>> > Thank you Alex and Max,
>> >  My jira id is taherk77. Please add me.
>> >
>> > Regards,
>> > Taher Koitawala
>> >
>> > On Sat, Oct 26, 2019, 3:53 PM Maximilian Michels > > > wrote:
>> >
>> > That sounds great. How about you start looking into this Taher? If
>> > necessary, Sijie could provide additional insight into Pulsar.
>> >
>> > Please create a JIRA account so we can assign you to
>> > https://issues.apache.org/jira/browse/BEAM-8218
>> >
>> > Thanks,
>> > Max
>> >
>> > On 26.10.19 12:08, Alex Van Boxel wrote:
>> >  > Hey Taher, do you have a Jira account? Then I will assign the
>> > ticket to
>> >  > you. I made the ticket because we should have one, feel free to
>> > take the
>> >  > lead on this one.
>> >  >
>> >  >   _/
>> >  > _/ Alex Van Boxel
>> >  >
>> >  >
>> >  > On Fri, Oct 25, 2019 at 9:35 PM Taher Koitawala
>> > mailto:taher...@gmail.com>
>> >  > >> wrote:
>> >  >
>> >  > I would be interested in contributing to the Pulsar Beam
>> > connector.
>> >  > That's one of the reasons i started the email thread.
>> >  >
>> >  >
>> >  > Regards,
>> >  > Taher Koitawala
>> >  >
>> >  > On Sat, Oct 26, 2019, 9:41 AM Sijie Guo > > 
>> >  > >>
>> wrote:
>> >  >
>> >  > This is Sijie Guo from StreamNative and Pulsar PMC.
>> >  >
>> >  > Maximilian - thank you for adding us in the email thread!
>> >  >
>> >  > We do have one roadmap item for adding a Beam connector
>> for
>> >  > Pulsar. It was planned for this quarter, but we haven’t
>> > started
>> >  > the implementation yet. If the Beam community is
>> > interested in
>> >  > it, we are happy to collaborate with Beam community.
>> >  >
>> >  > Thanks,
>> >  > Sijie
>> >  >
>> >  > On Sat, Oct 26, 2019 at 12:36 AM Maximilian Michels
>> >  > mailto:m...@apache.org>
>> > >> wrote:
>> >  >
>> >  > It would be great to have a Pulsar connector. We
>> > might want
>> >  > to ask the
>> >  > folks from StreamNative (in CC). Any plans? :)
>> >  >
>> >  > Cheers,
>> >  > Max
>> >  >
>> >  > On 24.10.19 18:31, Pablo Estrada wrote:
>> >  >  > There's a JIRA issue to track this:
>> >  >  > https://issues.apache.org/jira/browse/BEAM-8218
>> >  >  >
>> >  >  > Alex was kind enough to file it. +Alex Van Boxel
>> >  >  > > >
>> > >> : )
>> >  >  > Best
>> >  >  > -P
>> >  >  >
>> >  >  > On Thu, Oct 24, 2019 at 12:01 AM Taher Koitawala
>> >  > mailto:taher...@gmail.com>
>> > >
>> >  >  > > >  > > > >  > wrote:
>> >  >  >
>> >  >  > Hi Reza,
>> >  >  >   Thanks for your reply. However i
>> > do not
>> >  > see Pulsar
>> >  >  > listed in there. Should we file a jira?
>> >  >  >
>> >  >  > On Thu, Oct 24, 2019, 12:16 PM Reza Rokni
>> >  > mailto:r...@google.com>
>> > >
>> >  >  > > >
>> > > >  >  >
>> >  >  > Hi Taher,
>> >  >  >
>> >  >  > You can see the list of current and
>> > wip IO's here:
>> >  >  >
>> >  >  >
>> https://beam.apache.org/documentation/io/built-in/
>> >  >  >
>> >  >

Re: Apache Pulsar connector for Beam

2019-10-26 Thread Taher Koitawala 
Awesome. Thanks Max. Will definitely keep the community posted on this.

On Sat, Oct 26, 2019, 4:21 PM Maximilian Michels  wrote:

> Awesome. I've made you a contributor, so you can also create issues and
> assign yourself now.
>
> Please let us know about the progress once you start writing the connector.
>
> Thanks,
> Max
>
> On 26.10.19 12:36, Taher Koitawala wrote:
> > Thank you Alex and Max,
> >  My jira id is taherk77. Please add me.
> >
> > Regards,
> > Taher Koitawala
> >
> > On Sat, Oct 26, 2019, 3:53 PM Maximilian Michels  > > wrote:
> >
> > That sounds great. How about you start looking into this Taher? If
> > necessary, Sijie could provide additional insight into Pulsar.
> >
> > Please create a JIRA account so we can assign you to
> > https://issues.apache.org/jira/browse/BEAM-8218
> >
> > Thanks,
> > Max
> >
> > On 26.10.19 12:08, Alex Van Boxel wrote:
> >  > Hey Taher, do you have a Jira account? Then I will assign the
> > ticket to
> >  > you. I made the ticket because we should have one, feel free to
> > take the
> >  > lead on this one.
> >  >
> >  >   _/
> >  > _/ Alex Van Boxel
> >  >
> >  >
> >  > On Fri, Oct 25, 2019 at 9:35 PM Taher Koitawala
> > mailto:taher...@gmail.com>
> >  > >> wrote:
> >  >
> >  > I would be interested in contributing to the Pulsar Beam
> > connector.
> >  > That's one of the reasons i started the email thread.
> >  >
> >  >
> >  > Regards,
> >  > Taher Koitawala
> >  >
> >  > On Sat, Oct 26, 2019, 9:41 AM Sijie Guo  > 
> >  > >>
> wrote:
> >  >
> >  > This is Sijie Guo from StreamNative and Pulsar PMC.
> >  >
> >  > Maximilian - thank you for adding us in the email thread!
> >  >
> >  > We do have one roadmap item for adding a Beam connector
> for
> >  > Pulsar. It was planned for this quarter, but we haven’t
> > started
> >  > the implementation yet. If the Beam community is
> > interested in
> >  > it, we are happy to collaborate with Beam community.
> >  >
> >  > Thanks,
> >  > Sijie
> >  >
> >  > On Sat, Oct 26, 2019 at 12:36 AM Maximilian Michels
> >  > mailto:m...@apache.org>
> > >> wrote:
> >  >
> >  > It would be great to have a Pulsar connector. We
> > might want
> >  > to ask the
> >  > folks from StreamNative (in CC). Any plans? :)
> >  >
> >  > Cheers,
> >  > Max
> >  >
> >  > On 24.10.19 18:31, Pablo Estrada wrote:
> >  >  > There's a JIRA issue to track this:
> >  >  > https://issues.apache.org/jira/browse/BEAM-8218
> >  >  >
> >  >  > Alex was kind enough to file it. +Alex Van Boxel
> >  >  > 
> > >> : )
> >  >  > Best
> >  >  > -P
> >  >  >
> >  >  > On Thu, Oct 24, 2019 at 12:01 AM Taher Koitawala
> >  > mailto:taher...@gmail.com>
> > >
> >  >  >  >   >  >  > wrote:
> >  >  >
> >  >  > Hi Reza,
> >  >  >   Thanks for your reply. However i
> > do not
> >  > see Pulsar
> >  >  > listed in there. Should we file a jira?
> >  >  >
> >  >  > On Thu, Oct 24, 2019, 12:16 PM Reza Rokni
> >  > mailto:r...@google.com>
> > >
> >  >  > 
> >  >  >  >
> >  >  > Hi Taher,
> >  >  >
> >  >  > You can see the list of current and
> > wip IO's here:
> >  >  >
> >  >  > https://beam.apache.org/documentation/io/built-in/
> >  >  >
> >  >  > Cheers
> >  >  >
> >  >  > Reza
> >  >  >
> >  >  > On Thu, 24 Oct 2019 at 13:56, Taher
> Koitawala
> >  >  >  >

Re: Apache Pulsar connector for Beam

2019-10-26 Thread Maximilian Michels 
Awesome. I've made you a contributor, so you can also create issues and 
assign yourself now.


Please let us know about the progress once you start writing the connector.

Thanks,
Max

On 26.10.19 12:36, Taher Koitawala wrote:

Thank you Alex and Max,
         My jira id is taherk77. Please add me.

Regards,
Taher Koitawala

On Sat, Oct 26, 2019, 3:53 PM Maximilian Michels > wrote:


That sounds great. How about you start looking into this Taher? If
necessary, Sijie could provide additional insight into Pulsar.

Please create a JIRA account so we can assign you to
https://issues.apache.org/jira/browse/BEAM-8218

Thanks,
Max

On 26.10.19 12:08, Alex Van Boxel wrote:
 > Hey Taher, do you have a Jira account? Then I will assign the
ticket to
 > you. I made the ticket because we should have one, feel free to
take the
 > lead on this one.
 >
 >   _/
 > _/ Alex Van Boxel
 >
 >
 > On Fri, Oct 25, 2019 at 9:35 PM Taher Koitawala
mailto:taher...@gmail.com>
 > >> wrote:
 >
 >     I would be interested in contributing to the Pulsar Beam
connector.
 >     That's one of the reasons i started the email thread.
 >
 >
 >     Regards,
 >     Taher Koitawala
 >
 >     On Sat, Oct 26, 2019, 9:41 AM Sijie Guo mailto:s...@streamnative.io>
 >     >> wrote:
 >
 >         This is Sijie Guo from StreamNative and Pulsar PMC.
 >
 >         Maximilian - thank you for adding us in the email thread!
 >
 >         We do have one roadmap item for adding a Beam connector for
 >         Pulsar. It was planned for this quarter, but we haven’t
started
 >         the implementation yet. If the Beam community is
interested in
 >         it, we are happy to collaborate with Beam community.
 >
 >         Thanks,
 >         Sijie
 >
 >         On Sat, Oct 26, 2019 at 12:36 AM Maximilian Michels
 >         mailto:m...@apache.org>
>> wrote:
 >
 >             It would be great to have a Pulsar connector. We
might want
 >             to ask the
 >             folks from StreamNative (in CC). Any plans? :)
 >
 >             Cheers,
 >             Max
 >
 >             On 24.10.19 18:31, Pablo Estrada wrote:
 >              > There's a JIRA issue to track this:
 >              > https://issues.apache.org/jira/browse/BEAM-8218
 >              >
 >              > Alex was kind enough to file it. +Alex Van Boxel
 >              > 
>> : )
 >              > Best
 >              > -P
 >              >
 >              > On Thu, Oct 24, 2019 at 12:01 AM Taher Koitawala
 >             mailto:taher...@gmail.com>
>
 >              >               wrote:
 >              >
 >              >     Hi Reza,
 >              >                   Thanks for your reply. However i
do not
 >             see Pulsar
 >              >     listed in there. Should we file a jira?
 >              >
 >              >     On Thu, Oct 24, 2019, 12:16 PM Reza Rokni
 >             mailto:r...@google.com>
>
 >              >     
              >
 >              >         Hi Taher,
 >              >
 >              >         You can see the list of current and
wip IO's here:
 >              >
 >              > https://beam.apache.org/documentation/io/built-in/
 >              >
 >              >         Cheers
 >              >
 >              >         Reza
 >              >
 >              >         On Thu, 24 Oct 2019 at 13:56, Taher Koitawala
 >              >         mailto:taher...@gmail.com> >
 >                            >
 >              >             Hi All,
 >              >                       Been wanting to know if we
have a
 >             Pulsar connector
 >              >             for Beam. Pulsar is another messaging
queue
 >             like Kafka and I
 >              >             would like to build a streaming
pipeline with
 >         

Re: Apache Pulsar connector for Beam

2019-10-26 Thread Taher Koitawala 
Thank you Alex and Max,
My jira id is taherk77. Please add me.

Regards,
Taher Koitawala

On Sat, Oct 26, 2019, 3:53 PM Maximilian Michels  wrote:

> That sounds great. How about you start looking into this Taher? If
> necessary, Sijie could provide additional insight into Pulsar.
>
> Please create a JIRA account so we can assign you to
> https://issues.apache.org/jira/browse/BEAM-8218
>
> Thanks,
> Max
>
> On 26.10.19 12:08, Alex Van Boxel wrote:
> > Hey Taher, do you have a Jira account? Then I will assign the ticket to
> > you. I made the ticket because we should have one, feel free to take the
> > lead on this one.
> >
> >   _/
> > _/ Alex Van Boxel
> >
> >
> > On Fri, Oct 25, 2019 at 9:35 PM Taher Koitawala  > > wrote:
> >
> > I would be interested in contributing to the Pulsar Beam connector.
> > That's one of the reasons i started the email thread.
> >
> >
> > Regards,
> > Taher Koitawala
> >
> > On Sat, Oct 26, 2019, 9:41 AM Sijie Guo  > > wrote:
> >
> > This is Sijie Guo from StreamNative and Pulsar PMC.
> >
> > Maximilian - thank you for adding us in the email thread!
> >
> > We do have one roadmap item for adding a Beam connector for
> > Pulsar. It was planned for this quarter, but we haven’t started
> > the implementation yet. If the Beam community is interested in
> > it, we are happy to collaborate with Beam community.
> >
> > Thanks,
> > Sijie
> >
> > On Sat, Oct 26, 2019 at 12:36 AM Maximilian Michels
> > mailto:m...@apache.org>> wrote:
> >
> > It would be great to have a Pulsar connector. We might want
> > to ask the
> > folks from StreamNative (in CC). Any plans? :)
> >
> > Cheers,
> > Max
> >
> > On 24.10.19 18:31, Pablo Estrada wrote:
> >  > There's a JIRA issue to track this:
> >  > https://issues.apache.org/jira/browse/BEAM-8218
> >  >
> >  > Alex was kind enough to file it. +Alex Van Boxel
> >  > > : )
> >  > Best
> >  > -P
> >  >
> >  > On Thu, Oct 24, 2019 at 12:01 AM Taher Koitawala
> > mailto:taher...@gmail.com>
> >  > >>
> > wrote:
> >  >
> >  > Hi Reza,
> >  >   Thanks for your reply. However i do not
> > see Pulsar
> >  > listed in there. Should we file a jira?
> >  >
> >  > On Thu, Oct 24, 2019, 12:16 PM Reza Rokni
> > mailto:r...@google.com>
> >  > >>
> wrote:
> >  >
> >  > Hi Taher,
> >  >
> >  > You can see the list of current and wip IO's here:
> >  >
> >  > https://beam.apache.org/documentation/io/built-in/
> >  >
> >  > Cheers
> >  >
> >  > Reza
> >  >
> >  > On Thu, 24 Oct 2019 at 13:56, Taher Koitawala
> >  > mailto:taher...@gmail.com>
> > >>
> wrote:
> >  >
> >  > Hi All,
> >  >   Been wanting to know if we have a
> > Pulsar connector
> >  > for Beam. Pulsar is another messaging queue
> > like Kafka and I
> >  > would like to build a streaming pipeline with
> > Pulsar. Any
> >  > help would be appreciated..
> >  >
> >  >
> >  > Regards,
> >  > Taher Koitawala
> >  >
> >  >
> >  >
> >  > --
> >  >
> >  > This email may be confidential and privileged. If
> > you received
> >  > this communication by mistake, please don't
> > forward it to anyone
> >  > else, please erase all copies and attachments,
> > and please let me
> >  > know that it has gone to the wrong person.
> >  >
> >  > The above terms reflect a potential business
> > arrangement, are
> >  > provided solely as a basis for further
> > discussion, and are not
> >  > intended to be and do not constitute a legally
> > binding
> >  > obligation. No legally binding obligations will
> > be created,
> >  >

Re: Apache Pulsar connector for Beam

2019-10-26 Thread Maximilian Michels 
That sounds great. How about you start looking into this Taher? If 
necessary, Sijie could provide additional insight into Pulsar.


Please create a JIRA account so we can assign you to 
https://issues.apache.org/jira/browse/BEAM-8218


Thanks,
Max

On 26.10.19 12:08, Alex Van Boxel wrote:
Hey Taher, do you have a Jira account? Then I will assign the ticket to 
you. I made the ticket because we should have one, feel free to take the 
lead on this one.


  _/
_/ Alex Van Boxel


On Fri, Oct 25, 2019 at 9:35 PM Taher Koitawala > wrote:


I would be interested in contributing to the Pulsar Beam connector.
That's one of the reasons i started the email thread.


Regards,
Taher Koitawala

On Sat, Oct 26, 2019, 9:41 AM Sijie Guo mailto:s...@streamnative.io>> wrote:

This is Sijie Guo from StreamNative and Pulsar PMC.

Maximilian - thank you for adding us in the email thread!

We do have one roadmap item for adding a Beam connector for
Pulsar. It was planned for this quarter, but we haven’t started
the implementation yet. If the Beam community is interested in
it, we are happy to collaborate with Beam community.

Thanks,
Sijie

On Sat, Oct 26, 2019 at 12:36 AM Maximilian Michels
mailto:m...@apache.org>> wrote:

It would be great to have a Pulsar connector. We might want
to ask the
folks from StreamNative (in CC). Any plans? :)

Cheers,
Max

On 24.10.19 18:31, Pablo Estrada wrote:
 > There's a JIRA issue to track this:
 > https://issues.apache.org/jira/browse/BEAM-8218
 >
 > Alex was kind enough to file it. +Alex Van Boxel
 > > : )
 > Best
 > -P
 >
 > On Thu, Oct 24, 2019 at 12:01 AM Taher Koitawala
mailto:taher...@gmail.com>
 > >>
wrote:
 >
 >     Hi Reza,
 >                   Thanks for your reply. However i do not
see Pulsar
 >     listed in there. Should we file a jira?
 >
 >     On Thu, Oct 24, 2019, 12:16 PM Reza Rokni
mailto:r...@google.com>
 >     >> wrote:
 >
 >         Hi Taher,
 >
 >         You can see the list of current and wip IO's here:
 >
 > https://beam.apache.org/documentation/io/built-in/
 >
 >         Cheers
 >
 >         Reza
 >
 >         On Thu, 24 Oct 2019 at 13:56, Taher Koitawala
 >         mailto:taher...@gmail.com>
>> wrote:
 >
 >             Hi All,
 >                       Been wanting to know if we have a
Pulsar connector
 >             for Beam. Pulsar is another messaging queue
like Kafka and I
 >             would like to build a streaming pipeline with
Pulsar. Any
 >             help would be appreciated..
 >
 >
 >             Regards,
 >             Taher Koitawala
 >
 >
 >
 >         --
 >
 >         This email may be confidential and privileged. If
you received
 >         this communication by mistake, please don't
forward it to anyone
 >         else, please erase all copies and attachments,
and please let me
 >         know that it has gone to the wrong person.
 >
 >         The above terms reflect a potential business
arrangement, are
 >         provided solely as a basis for further
discussion, and are not
 >         intended to be and do not constitute a legally
binding
 >         obligation. No legally binding obligations will
be created,
 >         implied, or inferred until an agreement in final
form is
 >         executed in writing by all parties involved.
 >

Re: Apache Pulsar connector for Beam

2019-10-26 Thread Alex Van Boxel 
Hey Taher, do you have a Jira account? Then I will assign the ticket to
you. I made the ticket because we should have one, feel free to take the
lead on this one.

 _/
_/ Alex Van Boxel


On Fri, Oct 25, 2019 at 9:35 PM Taher Koitawala  wrote:

> I would be interested in contributing to the Pulsar Beam connector. That's
> one of the reasons i started the email thread.
>
>
> Regards,
> Taher Koitawala
>
> On Sat, Oct 26, 2019, 9:41 AM Sijie Guo  wrote:
>
>> This is Sijie Guo from StreamNative and Pulsar PMC.
>>
>> Maximilian - thank you for adding us in the email thread!
>>
>> We do have one roadmap item for adding a Beam connector for Pulsar. It
>> was planned for this quarter, but we haven’t started the implementation
>> yet. If the Beam community is interested in it, we are happy to collaborate
>> with Beam community.
>>
>> Thanks,
>> Sijie
>>
>> On Sat, Oct 26, 2019 at 12:36 AM Maximilian Michels 
>> wrote:
>>
>>> It would be great to have a Pulsar connector. We might want to ask the
>>> folks from StreamNative (in CC). Any plans? :)
>>>
>>> Cheers,
>>> Max
>>>
>>> On 24.10.19 18:31, Pablo Estrada wrote:
>>> > There's a JIRA issue to track this:
>>> > https://issues.apache.org/jira/browse/BEAM-8218
>>> >
>>> > Alex was kind enough to file it. +Alex Van Boxel
>>> >  : )
>>> > Best
>>> > -P
>>> >
>>> > On Thu, Oct 24, 2019 at 12:01 AM Taher Koitawala >> > > wrote:
>>> >
>>> > Hi Reza,
>>> >   Thanks for your reply. However i do not see Pulsar
>>> > listed in there. Should we file a jira?
>>> >
>>> > On Thu, Oct 24, 2019, 12:16 PM Reza Rokni >> > > wrote:
>>> >
>>> > Hi Taher,
>>> >
>>> > You can see the list of current and wip IO's here:
>>> >
>>> > https://beam.apache.org/documentation/io/built-in/
>>> >
>>> > Cheers
>>> >
>>> > Reza
>>> >
>>> > On Thu, 24 Oct 2019 at 13:56, Taher Koitawala
>>> > mailto:taher...@gmail.com>> wrote:
>>> >
>>> > Hi All,
>>> >   Been wanting to know if we have a Pulsar
>>> connector
>>> > for Beam. Pulsar is another messaging queue like Kafka and
>>> I
>>> > would like to build a streaming pipeline with Pulsar. Any
>>> > help would be appreciated..
>>> >
>>> >
>>> > Regards,
>>> > Taher Koitawala
>>> >
>>> >
>>> >
>>> > --
>>> >
>>> > This email may be confidential and privileged. If you received
>>> > this communication by mistake, please don't forward it to
>>> anyone
>>> > else, please erase all copies and attachments, and please let
>>> me
>>> > know that it has gone to the wrong person.
>>> >
>>> > The above terms reflect a potential business arrangement, are
>>> > provided solely as a basis for further discussion, and are not
>>> > intended to be and do not constitute a legally binding
>>> > obligation. No legally binding obligations will be created,
>>> > implied, or inferred until an agreement in final form is
>>> > executed in writing by all parties involved.
>>> >
>>>
>>

Re: Apache Pulsar connector for Beam

2019-10-25 Thread Taher Koitawala 
I would be interested in contributing to the Pulsar Beam connector. That's
one of the reasons i started the email thread.


Regards,
Taher Koitawala

On Sat, Oct 26, 2019, 9:41 AM Sijie Guo  wrote:

> This is Sijie Guo from StreamNative and Pulsar PMC.
>
> Maximilian - thank you for adding us in the email thread!
>
> We do have one roadmap item for adding a Beam connector for Pulsar. It was
> planned for this quarter, but we haven’t started the implementation yet. If
> the Beam community is interested in it, we are happy to collaborate with
> Beam community.
>
> Thanks,
> Sijie
>
> On Sat, Oct 26, 2019 at 12:36 AM Maximilian Michels 
> wrote:
>
>> It would be great to have a Pulsar connector. We might want to ask the
>> folks from StreamNative (in CC). Any plans? :)
>>
>> Cheers,
>> Max
>>
>> On 24.10.19 18:31, Pablo Estrada wrote:
>> > There's a JIRA issue to track this:
>> > https://issues.apache.org/jira/browse/BEAM-8218
>> >
>> > Alex was kind enough to file it. +Alex Van Boxel
>> >  : )
>> > Best
>> > -P
>> >
>> > On Thu, Oct 24, 2019 at 12:01 AM Taher Koitawala > > > wrote:
>> >
>> > Hi Reza,
>> >   Thanks for your reply. However i do not see Pulsar
>> > listed in there. Should we file a jira?
>> >
>> > On Thu, Oct 24, 2019, 12:16 PM Reza Rokni > > > wrote:
>> >
>> > Hi Taher,
>> >
>> > You can see the list of current and wip IO's here:
>> >
>> > https://beam.apache.org/documentation/io/built-in/
>> >
>> > Cheers
>> >
>> > Reza
>> >
>> > On Thu, 24 Oct 2019 at 13:56, Taher Koitawala
>> > mailto:taher...@gmail.com>> wrote:
>> >
>> > Hi All,
>> >   Been wanting to know if we have a Pulsar connector
>> > for Beam. Pulsar is another messaging queue like Kafka and I
>> > would like to build a streaming pipeline with Pulsar. Any
>> > help would be appreciated..
>> >
>> >
>> > Regards,
>> > Taher Koitawala
>> >
>> >
>> >
>> > --
>> >
>> > This email may be confidential and privileged. If you received
>> > this communication by mistake, please don't forward it to anyone
>> > else, please erase all copies and attachments, and please let me
>> > know that it has gone to the wrong person.
>> >
>> > The above terms reflect a potential business arrangement, are
>> > provided solely as a basis for further discussion, and are not
>> > intended to be and do not constitute a legally binding
>> > obligation. No legally binding obligations will be created,
>> > implied, or inferred until an agreement in final form is
>> > executed in writing by all parties involved.
>> >
>>
>

Re: Apache Pulsar connector for Beam

2019-10-25 Thread Sijie Guo 
This is Sijie Guo from StreamNative and Pulsar PMC.

Maximilian - thank you for adding us in the email thread!

We do have one roadmap item for adding a Beam connector for Pulsar. It was
planned for this quarter, but we haven’t started the implementation yet. If
the Beam community is interested in it, we are happy to collaborate with
Beam community.

Thanks,
Sijie

On Sat, Oct 26, 2019 at 12:36 AM Maximilian Michels  wrote:

> It would be great to have a Pulsar connector. We might want to ask the
> folks from StreamNative (in CC). Any plans? :)
>
> Cheers,
> Max
>
> On 24.10.19 18:31, Pablo Estrada wrote:
> > There's a JIRA issue to track this:
> > https://issues.apache.org/jira/browse/BEAM-8218
> >
> > Alex was kind enough to file it. +Alex Van Boxel
> >  : )
> > Best
> > -P
> >
> > On Thu, Oct 24, 2019 at 12:01 AM Taher Koitawala  > > wrote:
> >
> > Hi Reza,
> >   Thanks for your reply. However i do not see Pulsar
> > listed in there. Should we file a jira?
> >
> > On Thu, Oct 24, 2019, 12:16 PM Reza Rokni  > > wrote:
> >
> > Hi Taher,
> >
> > You can see the list of current and wip IO's here:
> >
> > https://beam.apache.org/documentation/io/built-in/
> >
> > Cheers
> >
> > Reza
> >
> > On Thu, 24 Oct 2019 at 13:56, Taher Koitawala
> > mailto:taher...@gmail.com>> wrote:
> >
> > Hi All,
> >   Been wanting to know if we have a Pulsar connector
> > for Beam. Pulsar is another messaging queue like Kafka and I
> > would like to build a streaming pipeline with Pulsar. Any
> > help would be appreciated..
> >
> >
> > Regards,
> > Taher Koitawala
> >
> >
> >
> > --
> >
> > This email may be confidential and privileged. If you received
> > this communication by mistake, please don't forward it to anyone
> > else, please erase all copies and attachments, and please let me
> > know that it has gone to the wrong person.
> >
> > The above terms reflect a potential business arrangement, are
> > provided solely as a basis for further discussion, and are not
> > intended to be and do not constitute a legally binding
> > obligation. No legally binding obligations will be created,
> > implied, or inferred until an agreement in final form is
> > executed in writing by all parties involved.
> >
>

Re: Apache Pulsar connector for Beam

2019-10-25 Thread Maximilian Michels 
It would be great to have a Pulsar connector. We might want to ask the 
folks from StreamNative (in CC). Any plans? :)


Cheers,
Max

On 24.10.19 18:31, Pablo Estrada wrote:
There's a JIRA issue to track this: 
https://issues.apache.org/jira/browse/BEAM-8218


Alex was kind enough to file it. +Alex Van Boxel 
 : )

Best
-P

On Thu, Oct 24, 2019 at 12:01 AM Taher Koitawala > wrote:


Hi Reza,
              Thanks for your reply. However i do not see Pulsar
listed in there. Should we file a jira?

On Thu, Oct 24, 2019, 12:16 PM Reza Rokni mailto:r...@google.com>> wrote:

Hi Taher,

You can see the list of current and wip IO's here:

https://beam.apache.org/documentation/io/built-in/

Cheers

Reza

On Thu, 24 Oct 2019 at 13:56, Taher Koitawala
mailto:taher...@gmail.com>> wrote:

Hi All,
          Been wanting to know if we have a Pulsar connector
for Beam. Pulsar is another messaging queue like Kafka and I
would like to build a streaming pipeline with Pulsar. Any
help would be appreciated..


Regards,
Taher Koitawala



-- 


This email may be confidential and privileged. If you received
this communication by mistake, please don't forward it to anyone
else, please erase all copies and attachments, and please let me
know that it has gone to the wrong person.

The above terms reflect a potential business arrangement, are
provided solely as a basis for further discussion, and are not
intended to be and do not constitute a legally binding
obligation. No legally binding obligations will be created,
implied, or inferred until an agreement in final form is
executed in writing by all parties involved.

Re: Apache Pulsar connector for Beam

2019-10-24 Thread Pablo Estrada 
There's a JIRA issue to track this:
https://issues.apache.org/jira/browse/BEAM-8218

Alex was kind enough to file it. +Alex Van Boxel  : )
Best
-P

On Thu, Oct 24, 2019 at 12:01 AM Taher Koitawala  wrote:

> Hi Reza,
>  Thanks for your reply. However i do not see Pulsar listed in
> there. Should we file a jira?
>
> On Thu, Oct 24, 2019, 12:16 PM Reza Rokni  wrote:
>
>> Hi Taher,
>>
>> You can see the list of current and wip IO's here:
>>
>> https://beam.apache.org/documentation/io/built-in/
>>
>> Cheers
>>
>> Reza
>>
>> On Thu, 24 Oct 2019 at 13:56, Taher Koitawala  wrote:
>>
>>> Hi All,
>>>  Been wanting to know if we have a Pulsar connector for Beam.
>>> Pulsar is another messaging queue like Kafka and I would like to build a
>>> streaming pipeline with Pulsar. Any help would be appreciated..
>>>
>>>
>>> Regards,
>>> Taher Koitawala
>>>
>>
>>
>> --
>>
>> This email may be confidential and privileged. If you received this
>> communication by mistake, please don't forward it to anyone else, please
>> erase all copies and attachments, and please let me know that it has gone
>> to the wrong person.
>>
>> The above terms reflect a potential business arrangement, are provided
>> solely as a basis for further discussion, and are not intended to be and do
>> not constitute a legally binding obligation. No legally binding obligations
>> will be created, implied, or inferred until an agreement in final form is
>> executed in writing by all parties involved.
>>
>

Re: Apache Pulsar connector for Beam

2019-10-24 Thread Taher Koitawala 
Hi Reza,
 Thanks for your reply. However i do not see Pulsar listed in
there. Should we file a jira?

On Thu, Oct 24, 2019, 12:16 PM Reza Rokni  wrote:

> Hi Taher,
>
> You can see the list of current and wip IO's here:
>
> https://beam.apache.org/documentation/io/built-in/
>
> Cheers
>
> Reza
>
> On Thu, 24 Oct 2019 at 13:56, Taher Koitawala  wrote:
>
>> Hi All,
>>  Been wanting to know if we have a Pulsar connector for Beam.
>> Pulsar is another messaging queue like Kafka and I would like to build a
>> streaming pipeline with Pulsar. Any help would be appreciated..
>>
>>
>> Regards,
>> Taher Koitawala
>>
>
>
> --
>
> This email may be confidential and privileged. If you received this
> communication by mistake, please don't forward it to anyone else, please
> erase all copies and attachments, and please let me know that it has gone
> to the wrong person.
>
> The above terms reflect a potential business arrangement, are provided
> solely as a basis for further discussion, and are not intended to be and do
> not constitute a legally binding obligation. No legally binding obligations
> will be created, implied, or inferred until an agreement in final form is
> executed in writing by all parties involved.
>

Re: Apache Pulsar connector for Beam

2019-10-24 Thread Reza Rokni 
Hi Taher,

You can see the list of current and wip IO's here:

https://beam.apache.org/documentation/io/built-in/

Cheers

Reza

On Thu, 24 Oct 2019 at 13:56, Taher Koitawala  wrote:

> Hi All,
>  Been wanting to know if we have a Pulsar connector for Beam.
> Pulsar is another messaging queue like Kafka and I would like to build a
> streaming pipeline with Pulsar. Any help would be appreciated..
>
>
> Regards,
> Taher Koitawala
>


-- 

This email may be confidential and privileged. If you received this
communication by mistake, please don't forward it to anyone else, please
erase all copies and attachments, and please let me know that it has gone
to the wrong person.

The above terms reflect a potential business arrangement, are provided
solely as a basis for further discussion, and are not intended to be and do
not constitute a legally binding obligation. No legally binding obligations
will be created, implied, or inferred until an agreement in final form is
executed in writing by all parties involved.

Apache Pulsar connector for Beam

2019-10-23 Thread Taher Koitawala 
Hi All,
 Been wanting to know if we have a Pulsar connector for Beam.
Pulsar is another messaging queue like Kafka and I would like to build a
streaming pipeline with Pulsar. Any help would be appreciated..


Regards,
Taher Koitawala