RE: Loading broadcast state on BroadcastProcessFunction instantiation or open method

2022-09-28 Thread alfredo.vasquez.spglobal.com via user
BroadcastProcessFunction instantiation or open method EXTERNAL MESSAGE Hi Alfredo, Did you consider implementing org.apache.flink.streaming.api.checkpoint.CheckpointedFunction interface in your broadcast function … the initializeState(…) function should give you access to the state backend. Kind regards

RE: Loading broadcast state on BroadcastProcessFunction instantiation or open method

2022-09-27 Thread Schwalbe Matthias
, 2022 12:26 PM To: alfredo.vasq...@spglobal.com Cc: user@flink.apache.org Subject: Re: Loading broadcast state on BroadcastProcessFunction instantiation or open method ⚠EXTERNAL MESSAGE – CAUTION: Think Before You Click ⚠ Logically it would make sense to be able to initialize BroadcastState in

Re: Loading broadcast state on BroadcastProcessFunction instantiation or open method

2022-09-27 Thread David Anderson
Logically it would make sense to be able to initialize BroadcastState in the open method of a BroadcastProcessFunction, but in practice I don't believe it can be done -- because the necessary Context isn't made available. Perhaps you could use the State Processor API to bootstrap some state into t

Loading broadcast state on BroadcastProcessFunction instantiation or open method

2022-09-26 Thread alfredo.vasquez.spglobal.com via user
Hello community. Currently we have a BroadcastProcessFunction implementation that is storing the broadcast state using a MapStateDescriptor. I have a use case that needs to load the BroadcastState to perform some operation before receiving any processElement or processBroadcastElement message.