Re: Configure scheduler for host affinity

2015-06-04 Thread Spico Florin
Hi! I had a same case that you have mentioned. What I have done: 1. Create a scheduler class (see the attached file) 2. On the Nimbus node, in the $STORM_HOME/conf/storm.yaml add the following lines storm.scheduler: NetworkScheduler supervisor.scheduler.meta: name: special-supervisor 3. On the

Configure scheduler for host affinity

2015-06-02 Thread B. Candler
I am investigating how to configure a Storm topology so that certain tasks execute on specific hosts or classes of hosts: for example, a particular task needs access to a database which is stored on a locally-connected SSD on a particular machine. In the talk from 2012 at

Re: Configure scheduler for host affinity

2015-06-02 Thread Andrew Xor
No, the link is correct but storm documentation is quite lackluster and has only common uses and highlights. Even the code is commented poorly so you have to dig in the actual code quite a lot when you are trying to find answers. On Tue, Jun 2, 2015 at 7:27 PM B. Candler b.cand...@pobox.com wrote:

Re: Configure scheduler for host affinity

2015-06-02 Thread B. Candler
On 02/06/2015 17:26, B. Candler wrote: However I couldn't find any authoritative documentation on the scheduler API by browsing https://storm.apache.org/doc-index.html (but I might have missed the right link) BTW after further digging I did find a couple of lines here: