Re: Getting Permission denied to run shell action

2016-10-21 Thread rammohan ganapavarapu
on /data type ext4 (rw,relatime,stripe=128,data=ordered) Do you guys know any disk/mount best practices? Ram On Fri, Oct 21, 2016 at 8:31 AM, rammohan ganapavarapu < rammohanga...@gmail.com> wrote: > I have rwx, I actually have 777 on that dir. > > On Oct 21, 2016 2:21 AM, wrot

RE: Getting Permission denied to run shell action

2016-10-21 Thread rammohan ganapavarapu
I have rwx, I actually have 777 on that dir. On Oct 21, 2016 2:21 AM, wrote: > Depends if /data is an directory or an mountpoint. Note, you need rwx for > directories > > > > --alex > > > > -- > B: mapredit.blogspot.com > > > > *From: *rammohan ganap

Re: Getting Permission denied to run shell action

2016-10-20 Thread rammohan ganapavarapu
p > > > On Fri, Oct 21, 2016 at 1:32 AM, rammohan ganapavarapu < > rammohanga...@gmail.com> wrote: > > > Hi, > > > > I have changed the yarn.nodemanager.local-dirs from default /tmp/ to > > /data/tmp dir and from then i am getting this error > >

Getting Permission denied to run shell action

2016-10-20 Thread rammohan ganapavarapu
Hi, I have changed the yarn.nodemanager.local-dirs from default /tmp/ to /data/tmp dir and from then i am getting this error Cannot run program "test.sh" (in directory "/data/tmp/nm-local-dir/usercache/hadoop/appcache/application_1476931300239_0003/container_1476931300239_0003_01_02"): erro

swap usage for hadoop cluster

2016-10-05 Thread rammohan ganapavarapu
Hi, What is the recommendation on using sawp space for hadoop? can you please point me to the related docs? Ram

Re: ACCEPTED: waiting for AM container to be allocated, launched and register with RM

2016-08-23 Thread rammohan ganapavarapu
. Available:[TOKEN] Thanks a lot for all your help, Ram On Mon, Aug 22, 2016 at 10:27 AM, rammohan ganapavarapu < rammohanga...@gmail.com> wrote: > Thank you all, I have updated my oozie job.properties to use 8030 and now > i am getting below error > > > > > >

Re: ACCEPTED: waiting for AM container to be allocated, launched and register with RM

2016-08-22 Thread rammohan ganapavarapu
n Mon, Aug 22, 2016 at 8:57 PM rammohan ganapavarapu < > rammohanga...@gmail.com> wrote: > >> any thoughts from the logs and config I have shared? >> >> On Aug 21, 2016 8:32 AM, "rammohan ganapavarapu" >> wrote: >> >>> so in job.properties wha

Re: ACCEPTED: waiting for AM container to be allocated, launched and register with RM

2016-08-22 Thread rammohan ganapavarapu
any thoughts from the logs and config I have shared? On Aug 21, 2016 8:32 AM, "rammohan ganapavarapu" wrote: > so in job.properties what is the jobtracker property, is it RM ip: port or > scheduler port which is 8030, if I use 8030 I am getting unknown protocol > proto buffe

Re: ACCEPTED: waiting for AM container to be allocated, launched and register with RM

2016-08-21 Thread rammohan ganapavarapu
-a-MapReduce-jar-using-Oozie-workflow > > Thanks > Sunil > > > On Sun, Aug 21, 2016 at 8:41 AM rammohan ganapavarapu < > rammohanga...@gmail.com> wrote: > >> Please find the attached config that i got from yarn ui and AM,RM logs. >> I only see that connectin

Re: ACCEPTED: waiting for AM container to be allocated, launched and register with RM

2016-08-19 Thread rammohan ganapavarapu
nnect to 0.0.0.0:8030. > > I have verified the config and i removed traces of 0.0.0.0 still no luck. > > org.apache.hadoop.yarn.client.RMProxy: Connecting to ResourceManager at > /0.0.0.0:8030 > > If an one has any clue please share. > > Thanks, > > Ram > > &g

Re: ACCEPTED: waiting for AM container to be allocated, launched and register with RM

2016-08-19 Thread rammohan ganapavarapu
Connecting to ResourceManager at /0.0.0.0:8030 If an one has any clue please share. Thanks, Ram On Fri, Aug 19, 2016 at 2:32 PM, rammohan ganapavarapu < rammohanga...@gmail.com> wrote: > When i submit a job using yarn its seems working only with oozie its > failing i guess, no

Re: ACCEPTED: waiting for AM container to be allocated, launched and register with RM

2016-08-19 Thread rammohan ganapavarapu
value of Pi is 3.1428 Ram On Fri, Aug 19, 2016 at 11:46 AM, rammohan ganapavarapu < rammohanga...@gmail.com> wrote: > Ok, i have used yarn-utils.py to get the correct values for my cluster and > update those properties and restarted RM and NM but still no luck not sure

Re: ACCEPTED: waiting for AM container to be allocated, launched and register with RM

2016-08-18 Thread rammohan ganapavarapu
Do you know what properties to tune? Thanks, Ram On Thu, Aug 18, 2016 at 9:11 PM, tkg_cangkul wrote: > i think that's because you don't have enough resource. u can tune your > cluster config to maximize your resource. > > > On 19/08/16 11:03, rammohan ganapavarapu

ACCEPTED: waiting for AM container to be allocated, launched and register with RM

2016-08-18 Thread rammohan ganapavarapu
Hi, When i submit a MR job, i am getting this from AM UI but it never get finished, what am i missing ? Thanks, Ram

jobTracker port

2016-08-18 Thread rammohan ganapavarapu
What is the value of jobTracker port 8031 or 8032? Ram

metrics api

2016-08-11 Thread rammohan ganapavarapu
Hi, Is metrics api available in hadoop 2.7.1? i am trying " curl -i http://localhost:50070/metrics"; but its giving empty 200 response. Ram

telegraf plugin

2016-08-11 Thread rammohan ganapavarapu
Hi, Any one have telegraf (influxdb) plugin for hadoop components to collect metrics? Thanks, Ram

Re: Datanode: DataXceiver error processing unknown operation

2016-06-13 Thread rammohan ganapavarapu
> <https://issues.apache.org/jira/browse/HDFS-9572> > https://issues.apache.org/jira/browse/HDFS-9572 > > --Chris Nauroth > > From: rammohan ganapavarapu > Date: Monday, June 13, 2016 at 2:02 PM > To: "user@hadoop.apache.org" > Subject: Datanode: DataXceive

Datanode: DataXceiver error processing unknown operation

2016-06-13 Thread rammohan ganapavarapu
Hi, I am getting this error in datanode, not sure what it means and how to fix it, any one have any suggestions? 2016-06-13 20:59:40,148 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: localhost:50010:DataXceiver error processing unknown operation src: / 1.2.3.4:57308 dst: /1.2.3.4:50010

How to include hadoop jars in oozie package

2016-05-18 Thread rammohan ganapavarapu
Hi, I am trying to build a oozie-4.2.0 with hadop-2.7.1 version, i am using makedistro.sh script to build it but when i extract oozie.war file i don't see hadoop jars, what is the right way to build oozie to include hadoop jar in the oozie-distro? ./mkdistro.sh assembly:single -P hadoop-2 -D jav