OutputTag alternative with pyflink 1.15.0

2022-05-22 Thread Lakshya Garg
Hi Everyone, I see that in pyflink 1.15.0 there isnt support for Output tag to redirect the messages to other output streams. Is this understanding right? If yes, What can be the alternative for this? any example or reference link would be helpful. Lakshya

Re: Application mode deployment through API call

2022-05-22 Thread Xiao Ma
Also, is there any plan to open restful api call on the flink operator side, to support the application / session cluster creation, instead of the kubectl apply command? Thank you very much. Best, *Xiao Ma* On Sun, May 22, 2022 at 7:27 PM Leon Xu wrote: > Additional question, is there any pl

Re: Application mode deployment through API call

2022-05-22 Thread Leon Xu
Additional question, is there any plan in the Flink community to provide an easier way of deploying Flink with application mode on YARN? Overall I feel application mode would be most widely used when it comes to running multiple long-running flink jobs. Thanks Leon On Sun, May 22, 2022 at 3:49 PM

Re: Application mode deployment through API call

2022-05-22 Thread Leon Xu
Thanks Geng, I will take a look at the YARNApplicationITCase implementation. And yeah I am switching from session mode to application mode, as application mode can offer better resource isolation. Besides that with application mode we don't need to worry about the issue of Metaspace not getting GCe

Flink UI in Application Mode

2022-05-22 Thread Zain Haider Nemati
Hi, Which port does flink UI run on in application mode? If I am running 5 yarn jobs in application mode would the UI be same for each or different ports for each?

Application mode -yarn dependancy error

2022-05-22 Thread Zain Haider Nemati
Hi, I'm getting this error in yarn application mode when submitting my job. Caused by: java.lang.ClassCastException: cannot assign instance of org.apache.commons.collections.map.LinkedMap to field org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase.pendingOffsetsToCommit of type org