Re: Unsubscribe

2015-09-21 Thread EUGEO 2015
some replay On Monday, September 21, 2015, Olivier Brun wrote: > Unsubscribe > Le 21 sept. 2015 02:33, "Jiang Xiaodong" > a écrit : > >> unsubscribe >> >> -- >> Thanks >> -Xiaodong >> >>

Re: unsubscribe

2015-09-21 Thread EUGEO 2015
i dont understand what i need to do in order to test this On Friday, September 18, 2015, Brahma Reddy Battula < brahmareddy.batt...@huawei.com> wrote: > > Kindly Drop a mail to user-unsubscr...@hadoop.apache.org > > > > Thanks

Re: unsubscribe

2015-09-21 Thread Tsuyoshi Ozawa
Please sent an email to user-unsubscr...@hadoop.apache.org to unsubscribe hadoop-user mailing list instead of sending msg to user@hadoop.apache.org. Thanks, - Tsuyoshi On Mon, Sep 21, 2015 at 4:48 PM, EUGEO 2015 wrote: > i dont understand what i need to do in order to

Re: Yarn ResourceManager web UI does not show job

2015-09-21 Thread Boyu Zhang
Thanks a lot for the answer! If you don't mind help more on this, here is what I am seeing. - The NameNode/DataNode and ResourceManager/NodeManager were running for 6 months before I discovered that the job history server was not running. After bringing up the job history server, I saw like 2k+

Re: issue about enable UseNUMA flag in hadoop framework

2015-09-21 Thread Grant Overby (groverby)
UseNUMA isn't supported by all garbage collectors. CMS is not supported G1 is supported Not sure about others [http://www.cisco.com/web/europe/images/email/signature/est2014/logo_06.png?ct=1398192119726] Grant Overby Software Engineer Cisco.com

Re: Yarn ResourceManager web UI does not show job

2015-09-21 Thread Varun Saxena
Hi Boyu, RM stores apps in state store if recovery is enabled. Only then they will be available on restart. Otherwise they are kept in memory and hence lost on restart. You may not have it enabled. Check config value for below config. By default its false. yarn.resourcemanager.recovery.enabled

Re: Yarn ResourceManager web UI does not show job

2015-09-21 Thread Boyu Zhang
Thanks for the answer Varun. It is the case that yarn.resourcemanager.recovery.enabled is set to be false. Is there a way to show the jobs that are submitted before the restart? We don't want to lose that data. Thanks, Boyu On Mon, Sep 21, 2015 at 12:53 PM, Varun Saxena

Re: Yarn ResourceManager web UI does not show job

2015-09-21 Thread Varun Saxena
No, you cant show them in RM UI then. However if you can start another daemon, you can consider using YARN Application History/Timeline Server or MR Job History Server(only for MR jobs) to see information about completed jobs. You can look up Hadoop documentation to learn more about them and how

Yarn ResourceManager web UI does not show job

2015-09-21 Thread Boyu Zhang
Hello Everyone, I have a strange error regarding the ResourceManager web UI ( http://xx.xx:8088). Someone before me set up the hadoop + yarn cluster using Pivotal HD, it was running fine. Then today, the resource manager and node manager disappeared, the logs did not record this. I restarted

Hetergeneous Hadoop Cluster

2015-09-21 Thread Ashish Kumar9
Hi : Has anyone tried a heterogeneous hadoop cluster with management nodes and data nodes running on multiple linux distros. and on multiple h/w architecture . If so , what is the performance of such cluster . Thanks Ashish

Re: Yarn ResourceManager web UI does not show job

2015-09-21 Thread Boyu Zhang
Thanks a lot for the clarification! I tried to find the log and history information about finished jobs. But they are not in hfs://xxx/user/myusername/output/_SUCCESS (0B). Can you please give some pointers on where the statistical/job history files are located? The hfs:///history/done only

Re: Yarn ResourceManager web UI does not show job

2015-09-21 Thread Varun Saxena
MR jobs will write history files to path given by config mapreduce.jobhistory.intermediate-done-dir History server will then move them to done dir which is given by config m apreduce.jobhistory.done-dir. By default these config values are

Re: Hetergeneous Hadoop Cluster

2015-09-21 Thread Tushar Kapila
Would only matter if OS specific communication was being used between nodes. I assume they do not do that. If that is true -> It would depend on the network and each nodes config for the work it is doing. Cluster performance would not suffer just because it is heterogeneous. On Mon, Sep 21, 2015