set default queue for user

2015-02-01 Thread Vikas Parashar
Hello folks, Could any body please let us know how can i assign a particular queue to my user. My scenario is Scheduler -> Capacity scheduler Having 3 queue:-> A, B and C Users -> user1, user2 and user3 Now, what i am looking from above scenario. - if user1 submit any job that should aut

Re: set default queue for user

2015-02-02 Thread Vikas Parashar
> by the user? This can be used by administrators to place jobs in > queues > that are different than the one specified by the user. > The default is false. > > > > Regards, > Naga > -- > *From:* Vikas

Re: Adding datanodes to Hadoop cluster - Will data redistribute?

2015-02-08 Thread Vikas Parashar
Hi Manoj, Pls try http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/HdfsUserGuide.html#Balancer Rg: Vikas Parashar (Vicky) On Sat, Feb 7, 2015 at 1:04 AM, Manoj Venkatesh wrote: > Dear Hadoop experts, > > I have a Hadoop cluster of 8 nodes, 6 were added durin

Re: changing log verbosity

2015-02-24 Thread Vikas Parashar
Please look into log4j.properties Rg:- Vicky On Tue, Feb 24, 2015 at 2:36 PM, Jonathan Aquilina wrote: > How does one go about changing the log verbosity in hadoop? What > configuration file should I be looking at? > > > > -- > Regards, > Jonathan Aquilina > Founder Eagle Eye T > >

Re: how to check hdfs

2015-03-02 Thread Vikas Parashar
Hi, Kindly install hadoop-hdfs rpm in your machine.. Rg: Vicky On Mon, Mar 2, 2015 at 11:19 PM, Shengdi Jin wrote: > Hi all, > I just start to learn hadoop, I have a naive question > > I used > hdfs dfs -ls /home/cluster > to check the content inside. > But I get error > ls: No FileSys

Re: how to check hdfs

2015-03-03 Thread Vikas Parashar
ystem of master? > > On Tue, Mar 3, 2015 at 8:06 AM, 杨浩 wrote: > >> I don't think it nessary to run the command with daemon in that client, >> and hdfs is not a daemon for hadoop。 >> >> 2015-03-03 20:57 GMT+08:00 Somnath Pandeya : >> >>>

Re: how to check hdfs

2015-03-03 Thread Vikas Parashar
hink that's why the command ./hdfs dfs-ls hdfs://master:9000/ can > work. > > Please correct me, if i was wrong. > > On Tue, Mar 3, 2015 at 1:59 PM, Vikas Parashar > wrote: > >> Hello, >> >> hdfs dfs -ls /home/cluster >> to check the content inside. &

Re: Unable to start Hive

2015-05-14 Thread Vikas Parashar
Hi Anand, Your namenode is in safe mode. Could you please share the namenode logs. On Fri, May 15, 2015 at 12:22 PM, Anand Murali wrote: > Dear All: > > I am running Hadoop-2.6 (pseudo mode) on Ubuntu 15.04, and trying to > connect Hive to it after installation. I run . .hadoop as start-up scri

Re: Unable to start Hive

2015-05-15 Thread Vikas Parashar
Hi Anand, It seems your namenode is working fine. I can't see any "safemode" related logs in your namenode file. Kindly check it hive logs as well. On Fri, May 15, 2015 at 12:40 PM, Anand Murali wrote: > Vikas: > > Please find attached. At this time I would like to tell you that with the > curr

Re: Unable to start Hive

2015-05-15 Thread Vikas Parashar
please send me o/p of below command # hadoop dfsadmin -report On Fri, May 15, 2015 at 2:43 PM, Anand Murali wrote: > Vikas > > Can you be more specific. What to check for in Hive logs. > > Thanks > > Regards > > Anand > > Sent from my iPhone > > On

Re: Unable to start Hive

2015-05-15 Thread Vikas Parashar
apacity: 0 (0 B) > Cache Used: 0 (0 B) > Cache Remaining: 0 (0 B) > Cache Used%: 100.00% > Cache Remaining%: 0.00% > Xceivers: 1 > Last contact: Fri May 15 15:07:53 IST 2015 > > > Anand Murali > 11/7, 'Anand Vihar', Kandasamy St, Mylapore > Chennai - 600 004, I

Re: Unable to start Hive

2015-05-15 Thread Vikas Parashar
t; Chennai - 600 004, India > Ph: (044)- 28474593/ 43526162 (voicemail) > > > > On Friday, May 15, 2015 4:05 PM, Vikas Parashar > wrote: > > > Give me o/p of below command > > #hadoop fs -mkdir /tmp/abc > > #hadoop fs -ls /tmp/abc > > On Fri, May 15, 20

Re: Unable to start Hive

2015-05-15 Thread Vikas Parashar
8474593/ 43526162 (voicemail) > > > > On Friday, May 15, 2015 5:23 PM, Vikas Parashar > wrote: > > > Kindly let me know hadoop, hdfs and hive version. > > On Fri, May 15, 2015 at 5:17 PM, Anand Murali > wrote: > > HDFS has always been running. I have been codi

Re: How to find execution time of a MapReduce job?

2015-05-15 Thread Vikas Parashar
Hi, You can get it from yarn api. You have to find out difference beteen accpted and finish state of Job. Sent from my really tiny device :) On Friday, May 15, 2015, Answer Agrawal wrote: > Hi, > > > Date date; long start, end; // for recording start and end time of job > date = new Date(); st