Re: Question on Secondary Namenode

2012-01-08 Thread Harsh J
Praveenesh, On Mon, Jan 9, 2012 at 11:38 AM, praveenesh kumar wrote: > Hi, > Masters file in $HADOOP_HOME/conf tells you about where exactly the > SecondaryNamenode deamon should run. Correct me please if I am wrong. Correct. But do not run > 1 SNN. Depending on the version of HDFS you use, you

Question on Secondary Namenode

2012-01-08 Thread praveenesh kumar
Hi, Masters file in $HADOOP_HOME/conf tells you about where exactly the SecondaryNamenode deamon should run. Correct me please if I am wrong. My doubt is Do all Datanodes should know where secondary namenode is running or Only namenode should be knowing where secondary namenode is running ? The re

Re: Does tunning requires re-formatting Namenode ?

2012-01-08 Thread Srinivas Surasani
Hi Praveenesh, You just need to restart the hadoop services. Reformatting the namenode causes the lose of metadata and there by loss of data residing in datanodes. Regards, Srinivas, Cloudwick Technologies. On Mon, Jan 9, 2012 at 12:26 AM, praveenesh kumar wrote: > Hey Guys, > > Do I need to fo

Re: Does tunning requires re-formatting Namenode ?

2012-01-08 Thread Harsh J
Praveenesh, *Never* reformat your namenode unless you want to blow all your files away and start afresh. No configuration change will ever demand that you reformat your NameNode. * Block size is per-file, so you can change this config to affect the default of all new files, but to change older

Does tunning requires re-formatting Namenode ?

2012-01-08 Thread praveenesh kumar
Hey Guys, Do I need to format the namenode again if I am changing some HDFS configurations like blocksize, checksum, compression codec etc or is there any other way to enforce these new changes in the present cluster setup ? Thanks, Praveenesh

Re: Expected file://// error

2012-01-08 Thread Mark question
It's already in there ... don't worry about it, I'm submitting the first job then the second job manually for now. export CLASSPATH=/home/mark/hadoop-0.20.2/conf:$CLASSPATH export CLASSPATH=/home/mark/hadoop-0.20.2/lib:$CLASSPATH export CLASSPATH=/home/mark/hadoop-0.20.2/hadoop-0.20.2-core.jar:/ho

Re: Expected file://// error

2012-01-08 Thread Joey Echeverria
What's the classpath of the java program submitting the job? It has to have the configuration directory (e.g. /opt/hadoop/conf) in there or it won't pick up the correct configs. -Joey On Sun, Jan 8, 2012 at 12:59 PM, Mark question wrote: > mapred-site.xml: > >   >    mapred.job.tracker >    loc

Re: Expected file://// error

2012-01-08 Thread Mark question
mapred-site.xml: mapred.job.tracker localhost:10001 mapred.child.java.opts -Xmx1024m mapred.tasktracker.map.tasks.maximum 10 Command is running a script which runs a java program that submit two jobs consecutively insuring waiting for the first job

Invitation to connect on LinkedIn

2012-01-08 Thread sangroya
LinkedIn Hailong, I'd like to add you to my professional network on LinkedIn. - Amit Amit Sangroya PhD Student at INRIA Lyon Area, France Confirm that you know Amit Sangroya: https://www.linkedin.com/e/7jf1zj-gx6d2jri-5i/isd/5441531746/oGgka5tN/?hs=false&tok=0WqBpXjPUheR41 -- Y