Re: Zero downtime in Flink Stateful funciton

2021-11-23 Thread Mingmin Xu
Igal. > > [1] > https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/deployment/ha/overview/ > > > On Tue, Nov 23, 2021 at 12:58 AM Mingmin Xu wrote: > >> Hello team, >> >> We're looking into the approach to migrate a databases-centralized >> mi

Zero downtime in Flink Stateful funciton

2021-11-22 Thread Mingmin Xu
Hello team, We're looking into the approach to migrate a databases-centralized microservice to Flink Stateful function, and want to understand more about downtime behaviors. Briefly, the service consumes multiple Kafka topics, applies varied processors on each event. With the Flink Stateful

Re: Flink on YARN

2018-01-21 Thread Mingmin Xu
In the Flink client node, you also need to have YARN configuration files which tells where's YARN. > Flink doc: the Client requires the YARN_CONF_DIR or HADOOP_CONF_DIR environment variable to be set to read the YARN and HDFS configuration. On Sat, Jan 20, 2018 at 3:54 AM, Kien Truong

Re: register metrics reporter on application level

2017-03-17 Thread Mingmin Xu
Thanks @Chesnay, do you know any plan to add it in future version? Mingmin On Fri, Mar 17, 2017 at 1:05 PM, Chesnay Schepler <ches...@apache.org> wrote: > Hello, > > there is currently no way to specify a reporter for a specific job. > > Regards, > Chesnay > > >

register metrics reporter on application level

2017-03-17 Thread Mingmin Xu
Hello all, I'm following https://ci.apache.org/projects/flink/flink-docs-release-1.2/monitoring/metrics.html to collect metrics. It seems the reporter is set on cluster level. Is there an option to specify different reporter on application level? Thanks! Mingmin