Re: fair scheduler

2014-08-12 Thread fireflyc
@Crystal You can use spark on yarn. Yarn have fair scheduler,modified yarn-site.xml. 发自我的 iPad 在 2014年8月11日,6:49,Matei Zaharia matei.zaha...@gmail.com 写道: Hi Crystal, The fair scheduler is only for jobs running concurrently within the same SparkContext (i.e. within an application), not

Re: acquire and give back resources dynamically

2014-08-16 Thread fireflyc
http://spark.apache.org/docs/latest/running-on-yarn.html Spark just a Yarn application 在 2014年8月14日,11:12,牛兆捷 nzjem...@gmail.com 写道: Dear all: Does spark can acquire resources from and give back resources to YARN dynamically ? -- *Regards,* *Zhaojie*