I am trying to understand how to load balance the incoming data to multiple spark streaming workers. Could somebody help me understand how I can distribute my incoming data from various sources such that incoming data is going to multiple spark streaming nodes? Is it done by spark client with help of spark master similar to hadoop client asking namenodes for the list of datanodes?
- Load balancing Mohit Anchlia
- Re: Load balancing Akhil Das
- Re: Load balancing Jeffrey Jedele
- Re: Load balancing Jeffrey Jedele
- Re: Load balancing Mohit Anchlia