Persisting state in RocksDB

2021-06-08 Thread Paul K Moore
Hi all, First post here, so please be kind :) Firstly some context; I have the following high-level job topology: (1) FlinkPulsarSource -> (2) RichAsyncFunction -> (3) SinkFunction 1. The FlinkPulsarSource reads event notifications about article updates from a Pulsar topic 2. The RichAsyncFunc

Re: Persisting state in RocksDB

2021-06-10 Thread Paul K Moore
-1.13/docs/ops/state/state_backends/ > > <https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/ops/state/state_backends/> > On Wed, Jun 9, 2021 at 12:13 AM Paul K Moore <mailto:paulkmo...@gmail.com>> wrote: > Hi all, > > First post here, so please be k

Re: Recommendation for dealing with Job Graph incompatibility across varying Flink versions

2021-06-18 Thread Paul K Moore
Hi Sonam, I am not a long-standing Flink user (3 months only) so perhaps others will have a more authoritative view. I would say that I am using Flink in k8s, and have had some good success with the Google Flink operator (https://github.com/GoogleCloudPlatform/flink-on-k8s-operator). This inc