Hi there, Hope everyone is doing well. I am stuck at a problem where I have to merge two pcollections one of it is pretty huge. While merging both using CoGroupByKey the workers run out of memory. I have tried to do that using batches or use a local fixed window but nothing is working well for me. Can someone suggest what's the better way to merge such huge pcollections with running OOM.
I appreciate your help.
