Re: Task manager shutting down.

2022-04-30 Thread John Smith
Plus in a way isn't the flink-jdbc connector kinda generic? At least the older one didn't seem to be server specific. On Sat, Apr 30, 2022 at 10:04 PM John Smith wrote: > Hi Martin, is there anything I need to check for? > > On Tue, Apr 26, 2022 at 9:50 PM John Smith wrote: > >> Yeah based off

Re: Task manager shutting down.

2022-04-30 Thread John Smith
Hi Martin, is there anything I need to check for? On Tue, Apr 26, 2022 at 9:50 PM John Smith wrote: > Yeah based off the flink JDBC output format... > > > On Tue, Apr 26, 2022 at 10:05 AM Martijn Visser > wrote: > >> Hi John, >> >> Have you built your own JDBC MSSQL source or sink or perhaps a

Flink 1.14.4 HybridSource consumes lots of CPU resources

2022-04-30 Thread Arthur Li
Hi all, the Hybrid Source | Apache Flink is one of new features of Flink 1.14.x, but one problem is it takes over 700% CPU which is almost 5 times than these two splits. My

Table API filter scala表达方式提示类型不匹配

2022-04-30 Thread Arthur Li
Hi all, 我在使用filter scala表达方式时,提示需要Expression类型,但是实际是String类型,但是这种写法在源码文档里是推荐的。 我的代码: sensorTab // 使用Expression方式,例如 tab.select($"key", $"value".avg + " The average" as "average") .select($"id", $"temperature") // 使用Expression方式 // .filter($("id").isEqual("sensor_1")) //

Re: Flink - 1.11.6 - FsStateBackend没有存储checkpoint

2022-04-30 Thread Arthur Li
打扰了,解决了,原因是因为启动时没有配置savepoint路径。 > 2022年4月30日 12:09,Arthur Li 写道: > > 大家好, > > > 我在学习Flink checkpoint时,做了一个示例没有得到期望结果,麻烦帮忙看看是哪里设置有问题。谢谢 > 1. 启动checkpoint > 2. 设置statebackend为FsStateBackend > 3. 从socketTextStream读取数据,统计单词个数 >(“hello”, 5), (“world”, 1) > 4. 通过触发异常,来模拟终止程序 > 5.