Looking for some advice

2013-09-14 Thread java8964 java8964
Hi, I currently have a project to process the data using MR. I have some thoughts about it, and am looking for some advices if anyone had any feedback. Currently in this project, I have lot of events data related to email tracking coming into the HDFC. So the events are the data for email

Re: Hadoop Metrics Issue in ganglia.

2013-09-14 Thread orahad bigdata
Hi Yusaku, I tried your suggestion, but it still not working. Please guide me. Thanks On 9/13/13, Yusaku Sako yus...@hortonworks.com wrote: I've had similar issues in the past and what I had to do was to list out the FQDNs first before the shortnames in /etc/hosts. Like so:

Re: Hadoop Metrics Issue in ganglia.

2013-09-14 Thread Leonid Fedotov
Yusaku, You are absolutely right. This is the only correct format for /etc/hosts: x.x.x.x Full_Nameshort_name(alias) Any other forms of it is incorrect and may lead to unpredictable results. Leonid *Thank you!* ** *Sincerely,* *Leonid Fedotov* Systems Architect - Professional

Re: 'supergroup' in Hadoop

2013-09-14 Thread orahad bigdata
Hi, Well in my case I can see the files in hdfs with supergroup ownership but this group is not exist at OS level. I think if we are not providing below parameter value in XML file, the default group will be supergroup though it will exist at OS level. dfs.permissions.supergroup Thanks On

Re: Yarn log directory perms

2013-09-14 Thread Prashant Kommireddi
Thanks Harsh. It makes sense that 710 is the default. But admins should be able to configure it differently if required? In our case , we have a separate process (running as a different user) that forwards logs to another system. We are unable to do so now due to the default perms. On Friday,

Re: Yarn log directory perms

2013-09-14 Thread Shahab Yunus
Just a thought, I don't know how much it makes sense, why not run that program as the user who is allowed to read that directory and you can then allow that user to write to whichever directory you want to forward your logs? Regards, Shahab On Sat, Sep 14, 2013 at 6:47 PM, Prashant Kommireddi