http://spark.apache.org/docs/latest/running-on-yarn.html
Spark just a Yarn application
在 2014年8月14日，11:12，牛兆捷 nzjem...@gmail.com 写道：
Dear all:
Does spark can acquire resources from and give back resources to
YARN dynamically ?
--
*Regards,*
*Zhaojie*
@Crystal
You can use spark on yarn. Yarn have fair scheduler,modified yarn-site.xml.
发自我的 iPad
在 2014年8月11日，6:49，Matei Zaharia matei.zaha...@gmail.com 写道：
Hi Crystal,
The fair scheduler is only for jobs running concurrently within the same
SparkContext (i.e. within an application), not
Github user fireflyc commented on the pull request:
https://github.com/apache/spark/pull/1372#issuecomment-50223879
My account is fireflyc, please assign the issue to me.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well
Github user fireflyc commented on the pull request:
https://github.com/apache/spark/pull/1485#issuecomment-49501533
My program is spark streaming over Hadoop yarn.It work for user click
stream.
I read code,number of worker threads and block?
---
If your project is set up
GitHub user fireflyc opened a pull request:
https://github.com/apache/spark/pull/1485
Fixed the number of worker thread
There are a lot of input Block cause too many Worker threads and will
load all data.So it should be to control the number of Worker threads
You can merge
Github user fireflyc commented on the pull request:
https://github.com/apache/spark/pull/1485#issuecomment-49495043
My application have 1000+ Worker Threads.
