Hi All - I have a DoFn which generates data (KV pair) for each element that it is processing. It also has to read from that KV for other elements based on a key which means, the KV has to retain all the data that's getting added to it while processing every element. I was thinking about the "slow-caching side input pattern" but it is more of caching outside the DoFn and then using it inside. It doesn't update the cache inside a DoFn. Please share if anyone has thoughts on how to approach this case.
Element 1 > Add a record to a KV > ..... Element 5 > Used the value from KV if there is a match in the key -- Thanks, Praveen K Viswanathan
