Re: How to list operators and see UID

2024-04-03 Thread Asimansu Bera
Hello Oscar, You can use Rest API to fetch the Vertices Id which I felt is mapped to operator ID( I guess so). http://localhost:8081/jobs/55770be021a8887278234d97684b9518/ You need to provide the jobid which will provide you list of vertices for the job graph: "vertices": [ { "id": "b

How to list operators and see UID

2024-04-03 Thread Oscar Perez via user
Hei, We are facing an issue with one of the jobs in production where fails to map state from one deployment to another. I guess the problem is that we failed to set a UID and relies on the default of providing one based on hash Is it possible to see all operators / UIDs at a glance? What is the b

Participate in the ASF 25th Anniversary Campaign

2024-04-03 Thread Brian Proffitt
Hi everyone, As part of The ASF’s 25th anniversary campaign[1], we will be celebrating projects and communities in multiple ways. We invite all projects and contributors to participate in the following ways: * Individuals - submit your first contribution: https://news.apache.org/foundation/entry

Data duplicated with s3 file sink

2024-04-03 Thread Vararu, Vadim
Hi all, I’ve got a Flink job that uses Kinesis as source and S3 files as Sink. The sink rolls at checkpoints and the checkpointing itself is configured as EXACTLY_ONCE. While running, everything looks good and a new bunch of files appear on s3 each minute (checkpoint is each 60s). The problem