Using TwillApplication (instead of TwillRunnable), it's possible to run
TwillRunnables with multiple instances and also multiple groups of
TwillRunnables. Unfortunately, there isn't actually an example of this in
the twill-examples module (sorry).
Anyway, running this TwillApplication would run 4 containers for
HelloWorldRunnable and 2 containers for HelloWorld2Runnable:
public class HelloWorldApplication implements TwillApplication {
@Override
public TwillSpecification configure() {
return TwillSpecification.Builder.with()
.setName("HelloWorld")
.withRunnable()
.add("hello1", new HelloWorldRunnable(),
ResourceSpecification.Builder.with()
.setVirtualCores(2)
.setMemory(2, ResourceSpecification.SizeUnit.MEGA)
.setInstances(4).build())
.noLocalFiles()
.add("hello2", new HelloWorld2Runnable(),
ResourceSpecification.Builder.with()
.setVirtualCores(2)
.setMemory(2, ResourceSpecification.SizeUnit.MEGA)
.setInstances(2).build())
.noLocalFiles()
.anyOrder()
.build();
}
}
On Thu, Jul 17, 2014 at 5:01 AM, Egor Pahomov <[email protected]>
wrote:
> Hi, I'm looking for library, which will allow me using gang scheduling in
> yarn. I've read Twill code, but I couldn't find even creation of multiple
> containers(not just one). Is this framework is right choice for my needs?
>
> --
>
>
>
> *Sincerely yoursEgor PakhomovScala Developer, Yandex*
>
