GitHub user Ethanlm opened a pull request:
https://github.com/apache/storm/pull/2366
[STORM-2686] Add locality awareness to LoadAwareShuffleGrouping
A redesign of https://github.com/apache/storm/pull/2270 . This adds the
locality awareness to LoadAwareShuffleGrouping. It applies the concept of
Bangâbang control (credit to @revans2 ).
I didn't change the critical function like chooseTasks(). So the
performance should be good.
I am doing some performance testing. Hope to get some feedback first.
Thanks.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/Ethanlm/storm STORM-2686-redesign
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/storm/pull/2366.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2366
----
commit 379ea4cf872160ad29744c5729476e860d40fc14
Author: Ethan Li <[email protected]>
Date: 2017-10-09T23:41:39Z
[STORM-2686] Add locality awareness to LoadAwareShuffleGrouping
----
---
