Submit job to a session cluster on Kubernetes via REST API

Hi, We deploy a Flink session cluster on Kubernetes. We want to submit jobs via java application using the REST API https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/ops/rest_api/. I'm trying to use the RestClusterClient which comes with the flink-clients module but I couldn't

Re: Question about Flink counters

Hi Shane, Could you share more information on what you would like to use the counter for? The counter discussed here is primarily designed for exposing counts to external metric systems. Usually, each task would count on its own, and it is left for the external metric system (usu. a time

退订

退订

退订

退订

Re:flink1.14.0 temporal join hive

退订 在 2022-03-05 09:46:46，"guanyq" 写道： >kafka实时流关联hive的最新分区表数据时，关于缓存刷新的问题 > > >'streaming-source.monitor-interval'='12 h' >这个参数我理解是：按照启动开始时间算起，每12小时读取一下最新分区的数据是吧？ >还有个问题是读取最新分区的时间间隔之间，实时流里面进入了预关联新分区的数据，那么是不是就相当于关联的还是上一次的最新分区数据吧？ > >

Re: PyFlink : submission via rest

Thanks Zhilong for taking a look! Primarily I am looking for ways to start it through a REST api [1] . For Java, I pass along entry-class pointing to a main class in the jar which constructs the job graph and triggers the execute(). How do we accomplish this for pyflink jobs? The closest I

Re: PyFlink : submission via rest

Hi, Aryan: You could refer to the official docs [1] for how to submit PyFlink jobs. $ ./bin/flink run \ --target yarn-per-job --python examples/python/table/word_count.py With this command you can submit a per-job application to YARN. The docs [2] and [3] describe how to submit jobs

PyFlink : submission via rest

Hi ! In a session cluster, what is the recommended way to submit a pyFlink job via REST ? I am on Flink 1.13 and my job code is available at web.upload.dir . Appreciate the help!

Re: Question about Flink counters

If I used a thread-safe counter implementation, would that be enough to make the count correct for a Flink cluster with multiple machines? Best, Shane From: Zhanghao Chen Sent: March 4, 2022 11:08 PM To: Shane Bishop ; user@flink.apache.org Subject: Re: