Example Flink SQL fromDataStream watermark code not showing *rowtime*

Hi. I copied the Flink code from this page. My printSchema() does not contain **ROWTIME** in the output. I'm running Flink v1.14.4. https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/dev/table/data_stream_api/ public static class User {...} DataStream dataStream = env.f

[ANNOUNCE] Apache Flink 1.15.3 released

The Apache Flink community is very happy to announce the release of Apache Flink 1.15.3, which is the third bugfix release for the Apache Flink 1.15 series. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streaming a

Several job in kubernetes restarts because Scheduler is being stopped.

Hello! In our k8s application cluster (served by flink-operator) several jobs restart at the same time with the same error. What is the reason for this restart and how can it be prevented? 2022-11-25T07:50:47.253459360Z INFO org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl

Re: How can I deploy a flink cluster with 4 TaskManagers?

Hello Taskmanager count = job.parallelism / taskmanager.numberOfTaskSlots От: Mark Lee Отправлено: 25 ноября 2022 г. 18:30:31 Кому: user@flink.apache.org Тема: How can I deploy a flink cluster with 4 TaskManagers? Hi all, How can I deploy a flink cluster with 1

How can I deploy a flink cluster with 4 TaskManagers?

Hi all, How can I deploy a flink cluster with 1 Job Manager and 4 Task Managers using FlinkDeployment CR? Such sample in Flink Operator can only create 1 Task Manager. apiVersion: flink.apache.org/v1beta1 kind: FlinkDeployment metadata: name: basic-session-deployment-only-example spec: im

Re: Safe way to clear old checkpoint data

Thanks for the answer We can't update flink to version 1.15 yet. I'm interested in restoring from a checkpoint, theoretically, only those sst files that are mentioned in _metadata or something else are enough? Can I just delete files that are not referenced in _metadata?

Re: Safe way to clear old checkpoint data

Hi, I would recommend upgrading to Flink 1.15, given the changes that were made in 1.15 make ownership more understandable. See https://flink.apache.org/2022/05/06/restore-modes.html Best regards, Martijn On Fri, Nov 25, 2022 at 9:33 AM Evgeniy Lyutikov wrote: > Hello > We use Flink 1.14.4 i

Safe way to clear old checkpoint data

Hello We use Flink 1.14.4 in kubernetes operator (version 1.2.0), all chepoint data store in s3 bucket. If parse _metadata file of checkpoint it contains links to objects in the shared directory and their number is much less than the total number of objects in the directory. For example, the n

Re: Support for higher-than-millisecond resolution event-time timestamps

When it comes to event time processing and watermarks, I believe that if you stick to the lower level APIs, then the milliseconds assumption is indeed arbitrary, but at higher levels that assumption is baked in. In other words, that rules out using Flink SQL, or things like TumblingEventTimeWindow

Re: Support for higher-than-millisecond resolution event-time timestamps

Hi Salva, I'm unaware of any plans to support those. Contributions are always welcome of course :) Best regards, Martijn On Fri, Nov 25, 2022 at 5:32 AM Salva Alcántara wrote: > As mentioned in the docs >