退订

2022-08-24 Thread xuxuewe...@163.com
退订 xuxuewe...@163.com

Re: flink自动重启出错

2022-08-24 Thread yue ma
你好 ~可以贴下更详细的报错 Hangxiang Yu 于2022年8月24日周三 13:10写道: > 是DS作业吗?可以share下使用state的部分吗? > > On Sat, Aug 20, 2022 at 3:35 PM Jason_H wrote: > > > 您好,改过任务,但是 是以新的任务启动的,改动很大,并不依赖之前老的任务 > > > > > > | | > > Jason_H > > | > > | > > hyb_he...@163.com > > | > > 回复的原邮件 > > | 发件人 | Michael Ran | > > |

[ANNOUNCE] Apache Flink 1.15.2 released

2022-08-24 Thread Danny Cranmer
The Apache Flink community is very happy to announce the release of Apache Flink 1.15.2, which is the second bugfix release for the Apache Flink 1.15 series. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streaming

Re: [ANNOUNCE] Apache Flink 1.15.2 released

2022-08-24 Thread Jing Ge
Thanks Danny for your effort! Best regards, Jing On Wed, Aug 24, 2022 at 11:43 PM Danny Cranmer wrote: > The Apache Flink community is very happy to announce the release of Apache > Flink 1.15.2, which is the second bugfix release for the Apache Flink 1.15 > series. > > Apache Flink® is an open

Re: pyflink内存管理

2022-08-24 Thread yu'an huang
你好, python部分的内存算flink taskmanager 配置的内存,你应该可以用参数 *'taskmanager.memory.task.off-heap.size* 来配置,可以参考这个问题: https://stackoverflow.com/questions/64323031/pyflink-1-11-2-couldn-t-configure-taskmanager-memory-task-off-heap-size-proper On Wed, 24 Aug 2022 at 1:05 PM, yidan zhao wrote: > 如题,pyflink场景的任

回复: flink自动重启出错

2022-08-24 Thread Jason_H
您好,具体设置如下: public static final MapStateDescriptor quantityJudgeStateDescriptor = new MapStateDescriptor<>( "quantityJudgeMapState", String.class, Integer.class); mistakeUpgradeRuleState = getRuntimeContext().getMapState(Descriptors.quantityJudgeStateDescriptor); // 设置状态TTL为

回复: flink自动重启出错

2022-08-24 Thread Jason_H
您好,报错如下: cause by: java.lang.RuntimeException: Error while getting state org.apache.flink.util.StateMigrationException: For heap backends, the new state serializer must not be incompatible with the old state serializer | | Jason_H | | hyb_he...@163.com | 回复的原邮件 | 发件人 | yue ma | | 发送日期

Re: pyflink内存管理

2022-08-24 Thread yidan zhao
感谢。我是standalone集群,配置到 flink-conf.yaml 就可行吧。 https://stackoverflow.com/questions/64323031/pyflink-1-11-2-couldn-t-configure-taskmanager-memory-task-off-heap-size-proper 该文章说到的必须通过 tableEnv 配置是因为使用 pyflink-shell ? 我提交是用 flink run 提交的。 yu'an huang 于2022年8月25日周四 09:25写道: > > 你好, > python部分的内存算flink

Re: [ANNOUNCE] Apache Flink 1.15.2 released

2022-08-24 Thread Xingbo Huang
Thanks Danny for driving this release Best, Xingbo Jing Ge 于2022年8月25日周四 05:50写道: > Thanks Danny for your effort! > > Best regards, > Jing > > On Wed, Aug 24, 2022 at 11:43 PM Danny Cranmer > wrote: > >> The Apache Flink community is very happy to announce the release of >> Apache Flink 1.15.2

Re: flink自动重启出错

2022-08-24 Thread yue ma
你好,可以贴下完整的 JM/TM 日志嘛。 感觉不是很符合预期 , 如果是自动failover 的话应该不会发生 StateMig rationException Jason_H 于2022年8月25日周四 09:36写道: > 您好,报错如下: > cause by: java.lang.RuntimeException: Error while getting state > org.apache.flink.util.StateMigrationException: For heap backends, the new > state serializer must not be

回复: flink自动重启出错

2022-08-24 Thread Jason_H
您好,详细报错如下: Caused by: java.lang.RuntimeException: Error while getting state at org.apache.flink.runtime.state.DefaultKeyedStateStore.getMapState(DefaultKeyedStateStore.java:109) at org.apache.flink.streaming.api.operators.StreamingRuntimeContext.getMapState(StreamingRuntimeContext.java:232) at c

Re: flink自动重启出错

2022-08-24 Thread 谢振爵
退订 谢振爵 我们的使命/愿景:玩出梦想 我们的价值观:用户第一、团队合作、积极探索 我们的人才观:正直、自驱力、同理心、终身学习 地址:上海市徐汇区漕河泾开发区古美路1582号总部园2期C幢2F、6F、7F、12F、艾默生B5F 联系电话:021-64819981 == 本邮件载有保密信息,请您恪守保密义务,勿向第三人透露,谢谢合作!       -- Original -- From:  "Jason_H"