????????????????????1.9.1?????????????????????????????????????????????????????????????????????????????? Caused by: org.apache.flink.util.StateMigrationException: The new state serializer cannot be incompatible. ????????????????????????????????????????????????
------------------ ???????? ------------------ ??????: "shuwen zhou"<jaco...@gmail.com>; ????????: 2019??11??20??(??????) ????11:18 ??????: "user-zh"<user-zh@flink.apache.org>; ????: Re: ??????savepoint???????????? migration for MapState currently isn't supported. ?????????? ?????????????????????????? org.apache.flink.util.StateMigrationException: The new state serializer cannot be incompatible ??????????????fink 1.9.0 ???????????? trigger savepoint????savepoint???????????????? ????????MapState[String,Void] ??scala???? ... 25 more Caused by: java.io.IOException: Failed to open user defined function at org.apache.flink.state.api.input.KeyedStateInputFormat.getKeyIterator(KeyedStateInputFormat.java:210) at org.apache.flink.state.api.input.KeyedStateInputFormat.open(KeyedStateInputFormat.java:185) at org.apache.flink.state.api.input.KeyedStateInputFormat.open(KeyedStateInputFormat.java:79) at org.apache.flink.runtime.operators.DataSourceTask.invoke(DataSourceTask.java:173) at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:705) at org.apache.flink.runtime.taskmanager.Task.run(Task.java:530) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.RuntimeException: Error while getting state at org.apache.flink.runtime.state.DefaultKeyedStateStore.getMapState(DefaultKeyedStateStore.java:119) at org.apache.flink.state.api.runtime.SavepointRuntimeContext.getMapState(SavepointRuntimeContext.java:243) at tv.freewheel.reporting.dip.ReaderFunction.open(SinkerReadState.scala:49) at org.apache.flink.api.common.functions.util.FunctionUtils.openFunction(FunctionUtils.java:36) at org.apache.flink.state.api.input.KeyedStateInputFormat.getKeyIterator(KeyedStateInputFormat.java:206) ... 6 more Caused by: org.apache.flink.util.StateMigrationException: The new state serializer cannot be incompatible. at org.apache.flink.contrib.streaming.state.RocksDBKeyedStateBackend.updateRestoredStateMetaInfo(RocksDBKeyedStateBackend.java:534) at org.apache.flink.contrib.streaming.state.RocksDBKeyedStateBackend.tryRegisterKvStateInformation(RocksDBKeyedStateBackend.java:482) at org.apache.flink.contrib.streaming.state.RocksDBKeyedStateBackend.createInternalState(RocksDBKeyedStateBackend.java:643) at org.apache.flink.runtime.state.KeyedStateFactory.createInternalState(KeyedStateFactory.java:47) at org.apache.flink.runtime.state.ttl.TtlStateFactory.createStateAndWrapWithTtlIfEnabled(TtlStateFactory.java:72) at org.apache.flink.runtime.state.AbstractKeyedStateBackend.getOrCreateKeyedState(AbstractKeyedStateBackend.java:279) at org.apache.flink.runtime.state.AbstractKeyedStateBackend.getPartitionedState(AbstractKeyedStateBackend.java:328) at org.apache.flink.runtime.state.DefaultKeyedStateStore.getPartitionedState(DefaultKeyedStateStore.java:124) at org.apache.flink.runtime.state.DefaultKeyedStateStore.getMapState(DefaultKeyedStateStore.java:116) On Fri, 15 Nov 2019 at 10:10, claylin <1012539...@qq.com> wrote: > ????????????????????????????schema?????????????? > > > > > ------------------&nbsp;????????&nbsp;------------------ > ??????:&nbsp;"Congxian Qiu"<qcx978132...@gmail.com&gt;; > ????????:&nbsp;2019??11??15??(??????) ????10:07 > ??????:&nbsp;"user-zh"<user-zh@flink.apache.org&gt;; > > ????:&nbsp;Re: ??????savepoint???????????? migration for MapState currently isn't > supported. > > > > Hi > ???????? MapState ?? migration ???????????????????????? 1.9??1.9 ?????? MapState ?? value schema > evolution[1] > > [1] https://issues.apache.org/jira/browse/FLINK-11947 > Best, > Congxian > > > claylin <1012539...@qq.com&gt; ??2019??11??14?????? ????9:35?????? > > &gt; ??savepoint??????????????????????????????1.8.1?????????????????????????????? > &gt; java.lang.RuntimeException: Error while getting state&nbsp;&nbsp; at > &gt; > org.apache.flink.runtime.state.DefaultKeyedStateStore.getMapState(DefaultKeyedStateStore.java:119) > &gt;&nbsp; at > &gt; > org.apache.flink.streaming.api.operators.StreamingRuntimeContext.getMapState(StreamingRuntimeContext.java:179) > &gt;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; at > &gt; > com.yy.kafka.template.job.PushServerRspStatisticsVer3$DistinctProcessFunction.open(PushServerRspStatisticsVer3.java:243) > &gt;&nbsp;&nbsp;&nbsp; at > &gt; > org.apache.flink.api.common.functions.util.FunctionUtils.openFunction(FunctionUtils.java:36) > &gt;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; at > &gt; > org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.open(AbstractUdfStreamOperator.java:102) > &gt; at > &gt; > org.apache.flink.streaming.api.operators.KeyedProcessOperator.open(KeyedProcessOperator.java:57) > &gt;&nbsp;&nbsp;&nbsp; at > &gt; > org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:424) > &gt;&nbsp;&nbsp; at > &gt; > org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:290) > &gt;&nbsp;&nbsp;&nbsp;&nbsp; at > org.apache.flink.runtime.taskmanager.Task.run(Task.java:711) > &gt;&nbsp; at java.lang.Thread.run(Thread.java:748) Caused by: > &gt; org.apache.flink.util.StateMigrationException: The new serializer for > a > &gt; MapState requires state migration in order for the job to proceed. > However, > &gt; migration for MapState currently isn't > supported.&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; at > &gt; > org.apache.flink.contrib.streaming.state.RocksDBKeyedStateBackend.migrateStateValues(RocksDBKeyedStateBackend.java:543) > &gt;&nbsp;&nbsp;&nbsp;&nbsp; at > &gt; > org.apache.flink.contrib.streaming.state.RocksDBKeyedStateBackend.updateRestoredStateMetaInfo(RocksDBKeyedStateBackend.java:525) > &gt;&nbsp;&nbsp;&nbsp; at > &gt; > org.apache.flink.contrib.streaming.state.RocksDBKeyedStateBackend.tryRegisterKvStateInformation(RocksDBKeyedStateBackend.java:475) > &gt;&nbsp; at > &gt; > org.apache.flink.contrib.streaming.state.RocksDBKeyedStateBackend.createInternalState(RocksDBKeyedStateBackend.java:613) > &gt;&nbsp;&nbsp;&nbsp; at > &gt; > org.apache.flink.runtime.state.ttl.TtlStateFactory.createTtlStateContext(TtlStateFactory.java:197) > &gt;&nbsp; at > &gt; > org.apache.flink.runtime.state.ttl.TtlStateFactory.createMapState(TtlStateFactory.java:155) > &gt; at > &gt; > org.apache.flink.runtime.state.ttl.TtlStateFactory.createState(TtlStateFactory.java:126) > &gt;&nbsp;&nbsp;&nbsp; at > &gt; > org.apache.flink.runtime.state.ttl.TtlStateFactory.createStateAndWrapWithTtlIfEnabled(TtlStateFactory.java:71) > &gt;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; at > &gt; > org.apache.flink.runtime.state.AbstractKeyedStateBackend.getOrCreateKeyedState(AbstractKeyedStateBackend.java:286) > &gt;&nbsp; at > &gt; > org.apache.flink.runtime.state.AbstractKeyedStateBackend.getPartitionedState(AbstractKeyedStateBackend.java:335) > &gt;&nbsp;&nbsp;&nbsp; at > &gt; > org.apache.flink.runtime.state.DefaultKeyedStateStore.getPartitionedState(DefaultKeyedStateStore.java:124) > &gt;&nbsp; at > &gt; > org.apache.flink.runtime.state.DefaultKeyedStateStore.getMapState(DefaultKeyedStateStore.java:116) > &gt;&nbsp; ... 9 more -- Best Wishes, Shuwen Zhou <http://www.linkedin.com/pub/shuwen-zhou/57/55b/599/>
