Hi, I'm having some trouble figuring out how receivers tie into spark driver-executor structure. Do all executors have a receiver that is blocked as soon as it receives some stream data? Or can multiple streams of data be taken as input into a single executor?
I have stream data coming in at every second coming from 5 different sources. I want to aggregate data from each of them. Does this mean I need 5 executors or does it have to do with threads on the executor? I might be mixing in a few concepts here. Any help would be appreciated. Thank you.
