Hi all,
We’ve got time-stamped directories containing text files, stored in HDFS.
We can regularly get new files added, so we’re using a FileSource with a
monitoring duration, so that it continuously picks up any new files.
The challenge is that we need to include the parent directory’s
这个是符合预期的，你可以调整 flink
的故障恢复策略来控制这个行为：https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/ops/state/task_failure_recovery/。
Best,
Zhanghao Chen
From: casel.chen
Sent: Tuesday, August 16, 2022 8:33
To: user-zh@flink.apache.org
Subject: Re:Re: flink on
native模式，发现作业失败后会自动重试几次，最后部署和pod消失
在 2022-08-14 16:55:48，"yu'an huang" 写道：
>你的部署模式是native还是standalone，正常作业失败是会释放资源的，可以提供更多信息吗？
>
>
>
>> On 14 Aug 2022, at 9:55 AM, casel.chen wrote:
>>
>> flink on k8s作业失败后现在默认是会一直占用资源，请问要如何配置使其自动释放资源？
>
Yan, I've created https://issues.apache.org/jira/browse/FLINK-28975 to
track this.
Regards,
David
On Sun, Aug 14, 2022 at 6:38 PM Yan Shen wrote:
> Thanks David,
>
> I am working on a flink datastream job that does a temporal join of two
> kafka topics based on watermarks. The problem was
Hi,
现在好像没有count相关的下沉逻辑，目前应该只实现了关于filter、limit、partition、projection等的source下沉。具体可以参考下[1]等等
[1]
https://github.com/apache/flink/blob/master/flink-table/flink-table-planner/src/main/java/org/apache/flink/table/planner/plan/abilities/source/FilterPushDownSpec.java
--
Best！
Hi，
是的，scala和Java表示的是容器中 scala 和 java 的版本。
Best，
Lijie
hjw <1010445...@qq.com.invalid> 于2022年8月15日周一 15:00写道：
> 我注意到Flink docker 镜像在同一版本有不同的Tag。
> 以1.15.1为例。Tag有scala_2.12-java8、scala_2.12-java11、java8等等。
> scala和Java表示的是容器启动Flink进程的时候用的java版本是吗？
> 另外，我用jdk11构建Flink源码放到Tag为java8的镜像会出现不兼容的情况。
>
Flink docker ??Tag??
??1.15.1??Tag??scala_2.12-java8??scala_2.12-java11??java8??
scala??JavaFlink??java??
??jdk11FlinkTag??java8??
thx
The granularity setting isn't relevant because it only matters when you
enable latency metrics, but they are opt-in and the default config is used.
You can only enable/disable specific metrics in the upcoming 1.16.0.
@Yuriy: You said you had 270k Strings in the StreamConfig; is that
accurate?
Flink docker ??Tag??
??1.15.1??Tag??scala_2.12-java8??scala_2.12-java11??java8??
scala??JavaFlink??java??
??jdk11FlinkTag??java8??
thx
