Hi Marlo,

One of the scenarios that we're trying to improve is to add or remove one field 
in state serializer.
Users might add or remove one field during their schema evolution, state 
processor could help it with another offline job while state migration could 
help it once we restart the new job.

Best
Yun Tang
________________________________
From: Marlo Ploemen <marlo.ploe...@icloud.com.INVALID>
Sent: Wednesday, June 9, 2021 15:57
To: dev@flink.apache.org <dev@flink.apache.org>
Subject: State migration scenario's

Hi community,

I am looking into the data migration and schema evolution process for stateful 
streaming jobs. Currently, there is no orchestration support for performing 
these job evolutions and no in-job state migration or schema evolution syntax 
(as this is part of the separate state processor API). I am looking for 
examples (e.g. Github repositories) or scenarios of stateful streaming jobs 
where the orchestration of their state evolution process can improve 
development quality.

Best, Marlo

Reply via email to