Re: [SURVEY] Drop Share and Key_Shared subscription support in Pulsar connector

2022-12-18 Thread Yufan Sheng
Hi Neng, Thanks for reminding me of the need to explain the lack of functionality. I have checked the missing functions with the customer and teammates. And we found that the only function we can't support after removing the Shared and Key_Shared subscription support is delayed message delivery ht

Re: Getting S3 client metrics from the flink-s3-fs-presto library

2022-12-18 Thread Hangxiang Yu
Hi, I think it's reasonable to support it. I am thinking to take it one step further: Client-side metrics, or job level metrics for filesystem could help us to monitor filesystem more precisely. Some metrics (like request rate , throughput, latency, retry count, etc) are useful to monitor the ne

Deploy Flink on YARN or Kubernetes.

2022-12-18 Thread Ruibin Xing
Hi all, We are currently setting up a new Flink cluster and are trying to decide on the best deployment method. As far as we know, Flink supports two resource providers: YARN and Kubernetes. We are having difficulty evaluating the pros and cons of each provider, particularly in terms of stability,