I've got an apache beam pipeline running on flink (1.9.1).
I've been attempting to read a RocksDB savepoint taken from this
beam-on-flink pipeline, using the state processor api, however it seems to
have some incompatibilities around namespaces. Beam for instance uses a
String namespace, while th
Hi Stephen,
You will need to implement a custom operator and user the `transform`
method. It's not just that you need to specify the namespace type but you
will also need to look into the beam internals to see how it stores data in
flink state, how it translates between beam serializers and flink
Thanks Seth, I'll look into rolling my own KeyedStateInputFormat.
On Mon, Apr 6, 2020 at 2:50 PM Seth Wiesman wrote:
> Hi Stephen,
>
> You will need to implement a custom operator and user the `transform`
> method. It's not just that you need to specify the namespace type but you
> will also nee
