Re: PyFlink - java code packaging

2022-05-08 Thread aryan m
_lib is a python library which internally contains a folder *lib* under which exists my java jar. Best Arya On Sat, May 7, 2022 at 7:55 PM aryan m wrote: > Hi Users ! > >What is the recommended way to package custom java code(which has > boilerplate source setup code, custom

PyFlink - java code packaging

2022-05-07 Thread aryan m
Hi Users ! What is the recommended way to package custom java code(which has boilerplate source setup code, custom sql format code) and make it available in python classpath for local pipeline tests ? For staging and production, I have the java libraries in the FLINK_HOME/lib directory and

Re: Reactive mode and checkpointing

2022-04-13 Thread aryan m
flink-docs-release-1.14/docs/deployment/config/#execution-checkpointing-tolerable-failed-checkpoints >> ). >> >> Best regards, >> Alexander >> >> >> >> On Tue, Apr 12, 2022 at 6:43 AM aryan m wrote: >> >>> Hello ! >>

Reactive mode and checkpointing

2022-04-11 Thread aryan m
Hello ! Are there options in reactive mode to prevent a job from restarting if the last checkpoint failed or timed out due to any reason ? Thanks, AR

Re: PyFlink : submission via rest

2022-03-08 Thread aryan m
Thanks Dian! That worked ! On Sun, Mar 6, 2022 at 10:47 PM Dian Fu wrote: > The dedicated REST API is still not supported. However, you could try to > use PythonDriver just like you said and just submit it like a Java Flink > job. > > Regards, > Dian > > On Sun, Mar 6,

Re: PyFlink : submission via rest

2022-03-05 Thread aryan m
ightlies.apache.org/flink/flink-docs-master/zh/docs/deployment/resource-providers/yarn/#session-mode > [3] > https://nightlies.apache.org/flink/flink-docs-master/zh/docs/deployment/resource-providers/native_kubernetes/#session-mode > > On Sun, Mar 6, 2022 at 2:08 AM aryan m wrote: >

PyFlink : submission via rest

2022-03-05 Thread aryan m
Hi ! In a session cluster, what is the recommended way to submit a pyFlink job via REST ? I am on Flink 1.13 and my job code is available at web.upload.dir . Appreciate the help!