http://spark.apache.org/docs/latest/running-on-yarn.html
Spark just a Yarn application
在 2014年8月14日,11:12,牛兆捷 nzjem...@gmail.com 写道:
Dear all:
Does spark can acquire resources from and give back resources to
YARN dynamically ?
--
*Regards,*
*Zhaojie*
@Crystal
You can use spark on yarn. Yarn have fair scheduler,modified yarn-site.xml.
发自我的 iPad
在 2014年8月11日,6:49,Matei Zaharia matei.zaha...@gmail.com 写道:
Hi Crystal,
The fair scheduler is only for jobs running concurrently within the same
SparkContext (i.e. within an application), not
Github user fireflyc commented on the pull request:
https://github.com/apache/spark/pull/1372#issuecomment-50223879
My account is fireflyc, please assign the issue to me.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well
Github user fireflyc commented on the pull request:
https://github.com/apache/spark/pull/1485#issuecomment-49501533
My program is spark streaming over Hadoop yarn.It work for user click
stream.
I read code,number of worker threads and block?
---
If your project is set up
GitHub user fireflyc opened a pull request:
https://github.com/apache/spark/pull/1485
Fixed the number of worker thread
There are a lot of input Block cause too many Worker threads and will
load all data.So it should be to control the number of Worker threads
You can merge
Github user fireflyc commented on the pull request:
https://github.com/apache/spark/pull/1485#issuecomment-49495043
My application have 1000+ Worker Threads.
![0e75b115d7a1b2dba97284cf6443b6f0](https://cloud.githubusercontent.com/assets/183107/3633383/d939413c-0edf-11e4-91d0
Github user fireflyc commented on the pull request:
https://github.com/apache/spark/pull/1372#issuecomment-49125597
I modified 'info' into the 'debug' level.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
GitHub user fireflyc opened a pull request:
https://github.com/apache/spark/pull/1372
replace println to log4j
Our program needs to receive a large amount of data and run for a long
time.
We set the log level to WARN but Storing iterator received single
as such message
Github user fireflyc commented on the pull request:
https://github.com/apache/spark/pull/1372#issuecomment-48739929
I have verified, the log level is set to Info right?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well
jboss portlet container can run on weblogic or webshpereï¼
View the original post :
http://www.jboss.com/index.html?module=bbop=viewtopicp=4196453#4196453
Reply to the post :
http://www.jboss.com/index.html?module=bbop=postingmode=replyp=4196453
10 matches
Mail list logo