Re: Distibuted Shell example in capacity Scheduler

Any Ideas? On Tue, Mar 27, 2012 at 2:52 PM, raghavendhra rahul < raghavendhrara...@gmail.com> wrote: > Hi, > When i tried to run randomwriter example in capacity scheduler > it works fine.But when i run the distributed shell example under capacity > sche

Re: Hadoop 0.23.1 installation

lib is not on your > classpath. > > Thanks, > Wellington. > > 2012/2/29 Marcos Ortiz : > > On 03/01/2012 04:48 AM, raghavendhra rahul wrote: > >> > >> Hi, > >> I tried to configure hadoop 0.23.1.I added all libs from share > >> folde

Re: Hbase compatible for Hadoop Yarn

s HDFS, as > HBase is merely a HDFS client. > > Qs: > - Are you facing issues using HBase with 0.23? > - Which component throws up the issue? MR libs of HBase or the daemons > itself? > - Are you instead looking for > https://issues.apache.org/jira/browse/HBASE-4329? >

Re: Container size

, Jan 18, 2012 at 1:01 PM, Arun C Murthy wrote: > Removing common-user@, please do not cross-post. > > On Jan 17, 2012, at 11:24 PM, raghavendhra rahul wrote: > > > Hi, > > > > What is the minimum size of the container in hadoop yarn. > >capab

Container size

Hi, What is the minimum size of the container in hadoop yarn. capability.setmemory(xx);

Re: Yarn Container Memory

FIFO On Thu, Jan 12, 2012 at 1:45 PM, Arun C Murthy wrote: > What scheduler are you using? > > On Jan 11, 2012, at 11:48 PM, raghavendhra rahul wrote: > > min container size 100mb > AM size is 1000mb > > On Thu, Jan 12, 2012 at 1:06 PM, Arun C Murthy wrote: > >>

Re: Yarn Container Memory

min container size 100mb AM size is 1000mb On Thu, Jan 12, 2012 at 1:06 PM, Arun C Murthy wrote: > What is your min container size? > > How much did you allocate to AM itself? > > On Jan 11, 2012, at 9:51 PM, raghavendhra rahul wrote: > > Any suggestions.. > > O

Re: Yarn Container Memory

Any suggestions.. On Wed, Jan 11, 2012 at 2:09 PM, raghavendhra rahul < raghavendhrara...@gmail.com> wrote: > Hi, > I formed a hadoop cluster with 3 nodes of 3500mb alloted for > containers in each node. > > In the appmaster i set resourcecapability as 1000 an

Application start stop

Hi Is there a specific way to stop the application master other than timeout option in the client. Is there a command like ./hadoop -job kill jobid for application masters

Re: Container launch from appmaster

ame > besides "*" > But it should contains "rackname" + "hostname" . > > 在 2012年1月11日 下午4:47，raghavendhra rahul 写道： > > When i provide hostname for "*" then the containers are not alloted for >> the application till its end. >>

Re: Container launch from appmaster

count against the entry for "*". >> >> HTH, >> +Vinod >> >> On Mon, Jan 9, 2012 at 10:12 PM, raghavendhra rahul >> wrote: >> > Hi all, >> > I am trying to write an application master.Is there a way to specify >> > node1: 10 conatiners &g

Yarn Container Memory

Hi, I formed a hadoop cluster with 3 nodes of 3500mb alloted for containers in each node. In the appmaster i set resourcecapability as 1000 and total containers as 20 Now in each node only 2 container is running. Second time i reduced the resourcecapability as 100 and total containers as

Yarn Container Memory

Hi,

Yarn Container Limit

Hi, How to set the maximum number of containers to be executed in each node. So that at a time only that much of containers will be running in that node..

Container launch from appmaster

Hi all, I am trying to write an application master.Is there a way to specify node1: 10 conatiners node2: 10 containers Can we specify this kind of list using the application master

Re: Container Launching

nConfiguration.DEFAULT_NM_ > LOCAL_DIRS); > for (String sLocalDir : sLocalDirs) { > Path usersdir = new Path(sLocalDir, ContainerLocalizer.USERCACHE); > Path userdir = new Path(usersdir, userName); > Path appCacheDir = new Path(userdir, ContainerLocalizer.APPCACHE); &g

Re: Container Launching

Any solutions. On Fri, Jan 6, 2012 at 5:15 PM, raghavendhra rahul < raghavendhrara...@gmail.com> wrote: > Hi all, > I am trying to write an application master.Is there a way to specify > node1: 10 conatiners > node2: 10 containers > Can we specify this kind of list

Cannot start yarn daemons

Hi, I am trying to install hadoop 0.23.1 SNAPSHOT. while starting yarn daemons.sh it shows the following error Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/conf/Configuration Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.conf.Configuration at j

Hadoop 0.23 build error

Hi, I tried to build the hadoop 0.23.1 version .But it throws the followung error during the build Failed to execute goal org.apache.maven.plugins:maven-antrun-plugin:1.6:run (tar) on project hadoop-mapreduce: An Ant BuildException has occured: exec returned: 2 Any help..

Container Launching

Hi all, I am trying to write an application master.Is there a way to specify node1: 10 conatiners node2: 10 containers Can we specify this kind of list using the application master Also i set request.setHostName("client"); where client is the hostname of a node I checked the log to find the fo

Re: Exception from Yarn Launch Container

Hi, Can i know where to get the release hadoop 0.23.1 2012/1/5 Bing Jiang > Arun, > > In order to figure out the fact, I trace back to source code. I find that > *org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor*: > > @Override > public int launchContainer(Container container

Re: Yarn related questions:

R with rack and also a mandatory RR with * as the > resource-name. > > Arun > > On Jan 4, 2012, at 8:04 PM, raghavendhra rahul wrote: > > Hi, > > I tried to set the client node for launching the container within the > application master. > I have set the parameter as &g

Container launch failure

Hi, I tired to launch a container from application master.But it throws the following error. java.io.FileNotFoundException: File /local1/yarn/.yarn/local/usercache/rahul_2011/appcache/application_1325760852770_0001 does not exist at org.apache.hadoop.fs.RawLocalFileSystem.getFil

Appmaster error

Hi, I am trying to start an server within the application master's container alone.But when i tried using Runtime.getRuntime.exec("command").But it throws the following execption. Application application_1325738010393_0003 failed 1 times due to AM Container for appattempt_13257380103

Appmasgter error

Hi, I am trying to start an server within the application master's container alone.But when i tried using Runtime.getRuntime.exec("command").But it throws the following execption. Application application_1325738010393_0003 failed 1 times due to AM Container for appattempt_13257380103

Launching containers in specific host

Hi, I tried to set the client node for launching the container within the application master. I have set the parameter as request.setHostName("client"); but the containers are not launched in the destined host.Instead the loop goes on continuously. 2012-01-04 15:11:48,535 INFO appmaster.Applicatio

Re: Yarn related questions:

Hi, I tried to set the client node for launching the container within the application master. I have set the parameter as request.setHostName("client"); but the containers are not launched in the destined host.Instead the loop goes on continuously. 2012-01-04 15:11:48,535 INFO appmaster.Applicatio

Re: Running Distributed shell in hadoop0.23

gt; captured in the container logs. The stdout/stderr logs generated by your > script should be available wherever you have configured the node-manager's > log dirs to point to. > > -- Hitesh > > On Dec 14, 2011, at 10:52 PM, raghavendhra rahul wrote: > > > When we cr

Re: Running Distributed shell in hadoop0.23

When we create a directory using distributed shell,any idea where it is created On Thu, Dec 15, 2011 at 11:57 AM, raghavendhra rahul < raghavendhrara...@gmail.com> wrote: > How to run any script using this.When i tried it shows final status as > failed. > > > On Thu, Dec

Re: Running Distributed shell in hadoop0.23

How to run any script using this.When i tried it shows final status as failed. On Thu, Dec 15, 2011 at 11:48 AM, raghavendhra rahul < raghavendhrara...@gmail.com> wrote: > Thanks for the help i made a mistake of creating symlinks within > modules.Now everythng is fine. > >

Re: Running Distributed shell in hadoop0.23

Thanks for the help i made a mistake of creating symlinks within modules.Now everythng is fine. On Thu, Dec 15, 2011 at 11:18 AM, raghavendhra rahul < raghavendhrara...@gmail.com> wrote: > should i link the hadoop-yarn-applications-distributedshell-0.23.0.jar > also. > Without l

Re: Running Distributed shell in hadoop0.23

should i link the hadoop-yarn-applications-distributedshell-0.23.0.jar also. Without linking this jar it throws the same error. If linked it shows at org.apache.hadoop.util.RunJar.main(RunJar.java:130) Caused by: java.util.zip.ZipException: error in opening zip file at java.util.zip.ZipFile

Re: Running Distributed shell in hadoop0.23

I get the following erroer by the given command to run distributed shell hadoop1@master:~/hadoop/bin$ ./hadoop jar ../modules/hadoop-yarn-applications-distributedshell-0.23.0.jar org.apache.hadoop.yarn.applications.distributedshell.Client --jar ../modules/hadoop-yarn-applications-distributedshell-0