Hue installation on Apache hadoop

2016-08-09 Thread Prachi Sharma
Hi All, Has anyone installed hue webserver on Apache hadoop 2.6.0. Is it possible . If yes please provide references to download and install hue . Thanks & Regards Prachi

Re: All nodes are not used

2016-08-09 Thread Madhav Sharan
Thanks Mahesh Till now I am not able to run the whole job in a limited time period. So I am looking for optimizations and resource utilization. May be I can try tweaking input split size if it helps. Thanks for your help, It explains the behaviour -- Madhav Sharan On Tue, Aug 9, 2016 at 1:28 P

Re: All nodes are not used

2016-08-09 Thread Mahesh Balija
Hi Madhav, The behaviour to me sounds normal. If the Block Size is 128 MB there could possibly be ~24 Mappers (i.e., containers used). You cannot use entire cluster as the blocks could be only in the nodes being used. You should not try using the entire cluster resources for following reason The

Re: All nodes are not used

2016-08-09 Thread Madhav Sharan
Hi Sunil - Thanks a lot for replying For one job run yes some nodes don't take load at all. But if I rerun no these are not same nodes always. One map job takes ~3 seconds to run and till now I am not able to run my whole job on a bigger data set so I can't say that container are short lived. I

Re: All nodes are not used

2016-08-09 Thread Sunil Govind
HI Madhav Could you help to share some more information here. When u say few nodes are not utilized, is it always same nodes which are not utilized? also how long each of these container are running on an average, pls make sure you have provided enough split size to ensure the containers are not

Re: Connecting JConsole to ResourceManager

2016-08-09 Thread Rakesh Radhakrishnan
Hi Atri, Do you meant, something like, jconsole [processID]. afaik, the local jmx uses the local filesystem. I hope your processes are running under same user to ensure there is no permission issues. Also, could you please check %TEMP% and %TMP% environment variables and make sure YOUR_USER_NAME

Instrumenting Client with JMXBeans

2016-08-09 Thread Atri Sharma
Hey folks, Wanted to check on your advice on how to instrument some functionality in the Client class. I tried adding a JMXBean but I am not sure if it is being registered. While debugging that, I have the thought if it makes sense to go the regular way and create a Metrics tracker for the Client

Re: Connecting JConsole to ResourceManager

2016-08-09 Thread Atri Sharma
Thanks Rohith. I am running JConsole locally on the same machine as I have my single node cluster.Do I still need to enable remote access? On 9 Aug 2016 12:44 p.m., "Rohith Sharma K S" wrote: > Hi > > Have you enabled JMX remote connections parameters for RM start up? If you > are trying to rem

Re: Connecting JConsole to ResourceManager

2016-08-09 Thread Rohith Sharma K S
Hi Have you enabled JMX remote connections parameters for RM start up? If you are trying to remote connection, these parameter supposed to passed in hadoop opts You need to enable remote by configuring these parameter in RM jam start up. -Dcom.sun.management.jmxremote.port= \ -Dcom.sun.m

Connecting JConsole to ResourceManager

2016-08-09 Thread Atri Sharma
Hi All, I am trying to connect to a running ResourceManager process on Windows. I ran jconsole and it shows the ResourceManager process. When I try connecting, it immediately fails saying that it cannot connect. I verified that the cluster is running fine by running the wordcount example. Please

Re: Cannot run Hadoop on Windows

2016-08-09 Thread Atri Sharma
Thanks guys, that worked nicely. Regards, Atri On Mon, Aug 8, 2016 at 9:56 PM, Chris Nauroth wrote: > I agree with Rakesh that spaces in JAVA_HOME is likely to be a problem. > This is a known problem tracked in JIRA issue HADOOP-9600. > > > > --Chris Nauroth > > > > *From: *Rakesh Radhakrishna