Re: YARN creates only 1 container

2014-06-26 Thread Wangda Tan
It should be yarn-site.xml not yarn.xml. yarn.xml will not be added to $CLASSPATH Thanks, Wangda On Wed, May 28, 2014 at 8:56 AM, hari wrote: > The issue was not related the configuration related to containers. Due to > misconfiguration, the Application master was not able to contact > resource

Re: How to make hdfs data rack aware

2014-06-26 Thread Kilaru, Sambaiah
My topology script is working fine for data I am writing to hdfs. My question is how to make the Existing data topoloy compaliant? Thanks, sam From: karthikeyan S mailto:karthispe...@gmail.com>> Reply-To: "user@hadoop.apache.org" mailto:user@hadoop.apache.org>> Da

Configuring Hadoop Client: Where is fail-over configured.

2014-06-26 Thread Charley Newtonne
I have hadoop 2.4 installed in HA mode using QJM. I have verified the cluster failover works as expected. The java clients are configured to connect to the active NN by specifying the hdf://nn1.company.com:8020. If this nn1 is down, how's the client know the location of the standby nn. Where is the

Determining the number of buckets in hive

2014-06-26 Thread KayVajj
Hi, I know this question might have been beaten to death, but I could not find an answer to a particular question. I'm using hive 0.10.x I have a table partitioned on day and I would like to bucket the table on a different column to avail of the SMB join optimization. I have seen an earlier threa

Re: add to example programs

2014-06-26 Thread Vinod Kumar Vavilapalli
You cannot dynamically add jobs. You will have to implement a new example and modify ExampleDriver.java to also include the new example and recompile. +Vinod On Jun 26, 2014, at 3:23 AM, John Hancock wrote: > I would like to re-use the framework for example programs in > hadoop-2.2.0-src/hado

Re: How to make hdfs data rack aware

2014-06-26 Thread karthikeyan S
Hi Did you try supplying the script name in hdfs-site.xml as the value for the parameter topology.script.file.name? Thanks Karthik On Jun 26, 2014 6:02 AM, "Kilaru, Sambaiah" wrote: > Hi All, > > We setup a cluster with out rackawareness, now that we got right > rackawreness script, we wante

How to make hdfs data rack aware

2014-06-26 Thread Kilaru, Sambaiah
Hi All, We setup a cluster with out rackawareness, now that we got right rackawreness script, we wanted to Make sure data is rack aware. How we make sure existing data is rack aware and NN should move copies if all of them are in the Same rack? Thanks, Sam

Submit Hadoop Job Remotely (without creating a jar)

2014-06-26 Thread Ramil Malikov
Is it possible submit Job to Hadoop cluster (2.2.0) from remote machine without creating a jar? Like PigServer.submit(pigScript). Thank you.

add to example programs

2014-06-26 Thread John Hancock
I would like to re-use the framework for example programs in hadoop-2.2.0-src/hadoop-mapreduce-project/hadoop-mapreduce-examples. I can use yarn jar hadoop-mapreduce-examples/target/hadoop-mapreduce-examples-2.2.0.jar and get a list of map/reduce programs I can run - is there a document that descr