Re: Is Pulsar IO Connector Officially Supported?

2024-04-10 Thread XQ Hu via user
Sounds like a good idea to add a new section. Let me chat with the team
about that. Thanks.

On Wed, Apr 10, 2024 at 12:09 PM Ahmet Altay  wrote:

> Pulsar IO did not change much since it was originally added in 2022. You
> can find about the gaps in this presentation (
> https://2022.beamsummit.org/slides/Developing%20PulsarIO%20Connector.pdf)
> starting slide 52 (next steps). That might give you the background
> information to make an informed decision on whether it will be suitable for
> your use case or not.
>
> XQ -- For the connectors page, would it make sense to add a section for IO
> connectors that are in progress (not completely ready, but something is
> available) for visibility purposes?
>
> On Wed, Apr 10, 2024 at 8:58 AM Vince Castello via user <
> user@beam.apache.org> wrote:
>
>> I see that the Beam 2.38.0 added support for reading and writing topics.
>> Based on your response, does this mean that we should not use the Pulsar IO
>> connector for production use? Let me know.
>>
>> Thanks
>>
>> --Vince
>>
>>
>> On Wed, Apr 10, 2024 at 9:58 AM XQ Hu  wrote:
>>
>>> I think PulsarIO needs more work to be polished.
>>>
>>> On Tue, Apr 9, 2024 at 2:48 PM Vince Castello via user <
>>> user@beam.apache.org> wrote:
>>>
 I see that a Pulsar connector was made available as of BEAM 2.38.0
 release but I don't see Pulsar as an official connector on the page below.
 Is the Pulsar IO connector official or not? If official then can someone
 please update the page since it gives the idea that a Pulsar IO connector
 is not available.


 https://beam.apache.org/documentation/io/connectors/


 Thanks


 --Vince






Re: Is Pulsar IO Connector Officially Supported?

2024-04-10 Thread Ahmet Altay via user
Pulsar IO did not change much since it was originally added in 2022. You
can find about the gaps in this presentation (
https://2022.beamsummit.org/slides/Developing%20PulsarIO%20Connector.pdf)
starting slide 52 (next steps). That might give you the background
information to make an informed decision on whether it will be suitable for
your use case or not.

XQ -- For the connectors page, would it make sense to add a section for IO
connectors that are in progress (not completely ready, but something is
available) for visibility purposes?

On Wed, Apr 10, 2024 at 8:58 AM Vince Castello via user <
user@beam.apache.org> wrote:

> I see that the Beam 2.38.0 added support for reading and writing topics.
> Based on your response, does this mean that we should not use the Pulsar IO
> connector for production use? Let me know.
>
> Thanks
>
> --Vince
>
>
> On Wed, Apr 10, 2024 at 9:58 AM XQ Hu  wrote:
>
>> I think PulsarIO needs more work to be polished.
>>
>> On Tue, Apr 9, 2024 at 2:48 PM Vince Castello via user <
>> user@beam.apache.org> wrote:
>>
>>> I see that a Pulsar connector was made available as of BEAM 2.38.0
>>> release but I don't see Pulsar as an official connector on the page below.
>>> Is the Pulsar IO connector official or not? If official then can someone
>>> please update the page since it gives the idea that a Pulsar IO connector
>>> is not available.
>>>
>>>
>>> https://beam.apache.org/documentation/io/connectors/
>>>
>>>
>>> Thanks
>>>
>>>
>>> --Vince
>>>
>>>
>>>
>>>


Re: Is Pulsar IO Connector Officially Supported?

2024-04-10 Thread Vince Castello via user
I see that the Beam 2.38.0 added support for reading and writing topics.
Based on your response, does this mean that we should not use the Pulsar IO
connector for production use? Let me know.

Thanks

--Vince


On Wed, Apr 10, 2024 at 9:58 AM XQ Hu  wrote:

> I think PulsarIO needs more work to be polished.
>
> On Tue, Apr 9, 2024 at 2:48 PM Vince Castello via user <
> user@beam.apache.org> wrote:
>
>> I see that a Pulsar connector was made available as of BEAM 2.38.0
>> release but I don't see Pulsar as an official connector on the page below.
>> Is the Pulsar IO connector official or not? If official then can someone
>> please update the page since it gives the idea that a Pulsar IO connector
>> is not available.
>>
>>
>> https://beam.apache.org/documentation/io/connectors/
>>
>>
>> Thanks
>>
>>
>> --Vince
>>
>>
>>
>>


Re: Is Pulsar IO Connector Officially Supported?

2024-04-10 Thread XQ Hu via user
I think PulsarIO needs more work to be polished.

On Tue, Apr 9, 2024 at 2:48 PM Vince Castello via user 
wrote:

> I see that a Pulsar connector was made available as of BEAM 2.38.0 release
> but I don't see Pulsar as an official connector on the page below. Is the
> Pulsar IO connector official or not? If official then can someone please
> update the page since it gives the idea that a Pulsar IO connector is not
> available.
>
>
> https://beam.apache.org/documentation/io/connectors/
>
>
> Thanks
>
>
> --Vince
>
>
>
>


Is Pulsar IO Connector Officially Supported?

2024-04-09 Thread Vince Castello via user
I see that a Pulsar connector was made available as of BEAM 2.38.0 release
but I don't see Pulsar as an official connector on the page below. Is the
Pulsar IO connector official or not? If official then can someone please
update the page since it gives the idea that a Pulsar IO connector is not
available.


https://beam.apache.org/documentation/io/connectors/


Thanks


--Vince