Re: [SURVEY] Drop Share and Key_Shared subscription support in Pulsar connector

2022-12-18 Thread Yufan Sheng
Hi Neng, Thanks for reminding me of the need to explain the lack of functionality. I have checked the missing functions with the customer and teammates. And we found that the only function we can't support after removing the Shared and Key_Shared subscription support is delayed message delivery

Re: [SURVEY] Drop Share and Key_Shared subscription support in Pulsar connector

2022-12-15 Thread Neng Lu
Hi Yufan, In general, I think it's okay to remove these features. But could you elaborate If there will be missing functionality after we remove these two subscriptions support? On 2022/12/14 13:01:53 盛宇帆 wrote: > Hi Zili, > > Thanks for picking up this discussion. Here is my answer: > > I

Re: [SURVEY] Drop Share and Key_Shared subscription support in Pulsar connector

2022-12-15 Thread Martijn Visser
Hi Yufan, I'm also looping in the Dev mailing list for awareness. >From my perspective, it sounds like it makes more sense to drop the Shared and Key_Shared subscription. If it's currently unstable/not usable and there are alternatives that you can leverage with Flink (like the increased

Re: [SURVEY] Drop Share and Key_Shared subscription support in Pulsar connector

2022-12-14 Thread 盛宇帆
Hi Zili, Thanks for picking up this discussion. Here is my answer: I agreed with your first question. If the problems are related to Pulsar, it should be redelivered to the Pulsar repo. But these flaky tests only occur on the Shared or Key_Shared subscription with the transaction and I can’t

Re: [SURVEY] Drop Share and Key_Shared subscription support in Pulsar connector

2022-12-14 Thread Zili Chen
Hi Yufan, Thanks for starting this discussion. My two coins: 1. It can help the upstream to fix the transaction issues by submitting the instability and performance issues to the pulsar repo also. 2. Could you elaborate on whether and (if so) why we should drop the Shared and Key_Share

[SURVEY] Drop Share and Key_Shared subscription support in Pulsar connector

2022-12-14 Thread 盛宇帆
Hi, I'm the maintainer of flink-connector-pulsar. I would like to start a survey on a function change proposal in flink-connector-pulsar. I have created a ticket on JIRA and paste its description here: A lot of Pulsar connector test unstable