Re: Rack Aware Hadoop cluster

2013-05-08 Thread Leonid Fedotov
You can put this parameter to core-site.xml or hdfs-site.xml It both parsed during the HDFS startup. Leonid On Wed, May 8, 2013 at 6:43 AM, Mohammad Mustaqeem <3m.mustaq...@gmail.com>wrote: > Hello everyone, > I was searching for how to make the hadoop cluster rack-aware and I > find out fr

Re: Rack Aware Hadoop cluster

2013-05-08 Thread Leonid Fedotov
er$1.run(Server.java:1731) >> at java.security.AccessController.doPrivileged(Native Method) >> at javax.security.auth.Subject.doAs(Subject.java:415) >> at >> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1441) >> at org.apache.hadoop.ipc.Ser

Re: About configuring cluster setup

2013-05-14 Thread Leonid Fedotov
No, it is not called "pseudo distributed" mode. It called "as you wish" mode... It is absolutely normal configuration. You can distribute your nodes as you like, no one limit you on it. Just make sure you have enough memory on your nodes. If you have more questions, feel free to s=ask it directly.

Re: Read namenode data from primary memory

2013-05-14 Thread Leonid Fedotov
What is the reason? Could you explain in more details, what do you want to accomplish? Leonid. On Tue, May 14, 2013 at 12:27 AM, Sandeep Nemuri wrote: > Done Lets say 8hrs !! > now every 8hrs do we need to go into safemode ? > > > On Tue, May 14, 2013 at 12:53 PM, Nitin Pawar wrote: > >> every

Re: Read namenode data from primary memory

2013-05-14 Thread Leonid Fedotov
Nitin, You have the whole bunch of problems to answer/resolve Let me have some research first, then we can discuss the problem... Thank you ! Leonid On Tue, May 14, 2013 at 12:43 AM, Nitin Pawar wrote: > if you want to use savenamespace then yes. > > Normally to have a backup copy of the F

Re: Hadoop Rack awareness on virtual system

2013-05-23 Thread Leonid Fedotov
You definitely can. Just set rack script on your VMs. Leonid On Thu, May 23, 2013 at 2:50 AM, Jitendra Yadav wrote: > Hi, > > Can we create and test hadoop rack awareness functionality in virtual box > system(like on laptop .etc)?. > > > Thanks~ >

Re: Issues Running Hadoop 1.1.2 on multi-node cluster

2013-07-10 Thread Leonid Fedotov
Make sure your mapred.local.dir (check it in mapred-site.xml) is actually exists and writable by your mapreduce usewr. Thank you! Sincerely, Leonid Fedotov On Jul 9, 2013, at 6:09 PM, Kiran Dangeti wrote: > Hi Siddharth, > > While running the multi-node we need to take care of

Re: Hadoop Metrics Issue in ganglia.

2013-09-14 Thread Leonid Fedotov
Yusaku, You are absolutely right. This is the only correct format for /etc/hosts: x.x.x.x Full_Nameshort_name(alias) Any other forms of it is incorrect and may lead to unpredictable results. Leonid *Thank you!* ** *Sincerely,* *Leonid Fedotov* Systems Architect - Professional

Re: Newbie: How to set up HDFS file system

2014-01-07 Thread Leonid Fedotov
Go to www.hortonworks.com and follow documentation to install HDP. Thank you! Leonid Fedotov Systems Architect - Professional Services lfedo...@hortonworks.com office: +1 855 846 7866 ext 292 mobile: +1 650 430 1673 On Jan 6, 2014, at 23:03, Ashish Jain wrote: > Hello, > > Ca

Re: problems with Hadoop instalation

2014-10-29 Thread Leonid Fedotov
David, download Sandbox from hortonworks.com and you will have everything ready to play with. *Thank you!* *Sincerely,* *Leonid Fedotov* Systems Architect - Professional Services lfedo...@hortonworks.com office: +1 855 846 7866 ext 292 mobile: +1 650 430 1673 On Wed, Oct 29, 2014 at 3:59

Re: Hadoop Learning Environment

2014-11-04 Thread Leonid Fedotov
Tim, download Sandbox from http://hortonworks/com You will have everything needed in a small VM instance which will run on your home desktop. *Thank you!* *Sincerely,* *Leonid Fedotov* Systems Architect - Professional Services lfedo...@hortonworks.com office: +1 855 846 7866 ext 292

Re: High Availability hadoop cluster.

2014-11-06 Thread Leonid Fedotov
Oleg, why don’t you talk to me? Put 1 ZK and 1 JN on NN boxes, third one on one of the data nodes. HA wizard will automatically remove SNN from your cluster and put second NN in it’s place instead. If something does not work as you expected, give me a call. Thank you! Leonid Fedotov Systems

Re: Datanode disk configuration

2014-11-12 Thread Leonid Fedotov
Create 1 Tb partitions for 2 and 3 TB drives and you will have 5 mount points same size. *Thank you!* *Sincerely,* *Leonid Fedotov* Systems Architect - Professional Services lfedo...@hortonworks.com office: +1 855 846 7866 ext 292 mobile: +1 650 430 1673 On Wed, Nov 12, 2014 at 8:36 AM

Re: building Apache Hadoop (main, Tez)

2014-11-22 Thread Leonid Fedotov
Alexey, just download copy of HDP Sandbox and have fun. Do not spend time for building from scratch, does not worth it. Thank you! Leonid Fedotov Systems Architect - Professional Services lfedo...@hortonworks.com mobile: +1 650 430 1673 On Nov 22, 2014 10:47 AM, "Yakubovich, A