Re: Easiest way to do a batch outer join

2023-08-09 Thread Flavio Pompermaier
Hi Liu, indeed my current experience migrating old Dataset code to new DataStream is really frutrating. It's very complicated to write a Source (unless you use the deprecated SourceFunction or TableSource that is easier) and some operations are really complicated because there should not be any win

Re: Easiest way to do a batch outer join

2023-08-09 Thread liu ron
Hi, Flavio I agree with you, but DataStream was originally designed for streaming scenarios, and it needs to take some time for the community to improve its capabilities for batch scenarios. Best, Ron Flavio Pompermaier 于2023年8月9日周三 16:37写道: > Hi Liu, > indeed my current experience migrating o

Re: Integarting Apache Flink with Apache Ranger

2023-08-09 Thread liu ron
Hi, Unfortunately, The open-source community doesn't integrate Apache Ranger with Flink, now it is only available in the Cloudera Flink solution[1]. Maybe you can drive this proposal. [1] https://docs.cloudera.com/csa/1.6.1/security/topics/csa-flink-ranger-policies.html Best, Ron arjun s 于202

Flink operator job restart

2023-08-09 Thread Ethan T Yang
Hi Flink users, When using Flink operator, how to restart jobs from a checkpoint. I am used to the Flink Kubernetes native deployment, where I can run flink run -s How to achieve that in Flink operator Thanks Ivan

Re: Flink operator job restart

2023-08-09 Thread liu ron
Hi, lvan You can refer to the five-part that restore the job in [1]. [1] https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-release-1.6/docs/operations/upgrade/#2-upgrading-with-existing-flinkdeployments Best, Ron Ethan T Yang 于2023年8月10日周四 12:28写道: > Hi Flink users, > > When u