Since one input dstream creates one receiver and one receiver uses one
executor / node.
What happens if you create more Dstreams than nodes in the cluster?
Say I have 30 Dstreams on a 15 node cluster.
Will ~10 streams get assigned to ~10 executors / nodes then the other ~20
streams will be
@Brandon Each node can host multiple executors. For example, In a 15 node
cluster, if your NodeManager ( In YARN) or equivalent ( MESOS or
Standalone), runs on each of this node and if the node has enough resources
to host say 5 executors, then in total you can have 15*5 executors and each
of this