@Crystal
You can use spark on yarn. Yarn have fair scheduler,modified yarn-site.xml.
发自我的 iPad
在 2014年8月11日,6:49,Matei Zaharia matei.zaha...@gmail.com 写道:
Hi Crystal,
The fair scheduler is only for jobs running concurrently within the same
SparkContext (i.e. within an application), not
http://spark.apache.org/docs/latest/running-on-yarn.html
Spark just a Yarn application
在 2014年8月14日,11:12,牛兆捷 nzjem...@gmail.com 写道:
Dear all:
Does spark can acquire resources from and give back resources to
YARN dynamically ?
--
*Regards,*
*Zhaojie*