RE: Managing space in Master Node

2013-02-15 Thread Charles Baker
Hey Arko. It should be safe to delete then. -Chuck -Original Message- From: Arko Provo Mukherjee [mailto:arkoprovomukher...@gmail.com] Sent: Friday, February 15, 2013 11:56 AM To: hdfs-user@hadoop.apache.org Subject: Re: Managing space in Master Node Hello Charles, Thanks a lot for

Re: Managing space in Master Node

2013-02-15 Thread Arko Provo Mukherjee
commend getting a separate machine for those two services as well. > > -Chuck > > > -Original Message- > From: Arko Provo Mukherjee [mailto:arkoprovomukher...@gmail.com] > Sent: Thursday, February 14, 2013 4:21 PM > To: hdfs-user@hadoop.apache.org > Sub

RE: Managing space in Master Node

2013-02-14 Thread Charles Baker
doop.apache.org Subject: Re: Managing space in Master Node Hello Everyone - I have decommissioned my NN so that only the JobTracker, NameNode and SecondaryNameNodes are running on it now. I would like to thank everyone who helped me to perform this task! I have just one more issue: The data files create

Re: Managing space in Master Node

2013-02-14 Thread Arko Provo Mukherjee
> From: Arko Provo Mukherjee [mailto:arkoprovomukher...@gmail.com] >> Sent: miƩrcoles, 13 de febrero de 2013 20:32 >> To: hdfs-user@hadoop.apache.org >> Subject: Managing space in Master Node >> >> Hello Gurus, >> >> I am managing a Hadoop Cluster to ru

Re: Managing space in Master Node

2013-02-13 Thread Mohammad Tariq
> >>>> > > >> >> >>> >>>> > On Thu, Feb 14, 2013 at 1:31 AM, Arko Provo Mukherjee > >> >> >>> >>>> > wrote: > >> >> >>> >>>> >> > >> >> >>> >>

Re: Managing space in Master Node

2013-02-13 Thread Arko Provo Mukherjee
gt; >> >> >> >>> >>>> >> However, I am still unsure about how to "turn off" the >> >> >>> >>>> >> datanode >> >> >>> >>>> >> feature on the NN. >> >>

Re: Managing space in Master Node

2013-02-13 Thread Mohammad Tariq
t;>> >>>> >> > >> >>> >>>> >> I checked the "hdfs-site.xml" file and the dfs.data.dir is > >> >>> >>>> >> pointed > >> >>> >>>> >> to > >> >>

Re: Managing space in Master Node

2013-02-13 Thread Arko Provo Mukherjee
gt;> >>>> >> Should I just comment out that property? What would happen to >> >>> >>>> >> the >> >>> >>>> >> current data that there is in the Master? Will it get removed >> >>> >>>> &

Re: Managing space in Master Node

2013-02-13 Thread Mohammad Tariq
;>> >>>> >> > >>> >>>> >> On Wed, Feb 13, 2013 at 1:55 PM, Mohammad Tariq > >>> >>>> >> > >>> >>>> >> wrote: > >>> >>>> >> > You can specify the loggi

Re: Managing space in Master Node

2013-02-13 Thread Arko Provo Mukherjee
>>> >> >>> >>>> >> wrote: >>> >>>> >> > You can specify the logging level as specified by Charles. But >>> >>>> >> > turning >>> >>>> >> > logs >>> >>>> >> > off

Re: Managing space in Master Node

2013-02-13 Thread Arko Provo Mukherjee
> > which are eventual. >> >>>> >> > >> >>>> >> > Warm Regards, >> >>>> >> > Tariq >> >>>> >> > https://mtariq.jux.com/ >> >>>> >> > cloudfront.blogspot.com

Re: Managing space in Master Node

2013-02-13 Thread Mohammad Tariq
gt;>>> >> > > >>>> >> > On Thu, Feb 14, 2013 at 1:22 AM, Arko Provo Mukherjee > >>>> >> > wrote: > >>>> >> >> > >>>> >> >> Hi, > >>>> >> >> > >>>> >&g

Re: Managing space in Master Node

2013-02-13 Thread Arko Provo Mukherjee
>>>> >> >> >>>> >> >> Yeah, my NameNode is also seconding as a DataNode. >>>> >> >> >>>> >> >> I would like to "turn off" this feature. >>>> >> >> >>>> >> >> R

Re: Managing space in Master Node

2013-02-13 Thread Arko Provo Mukherjee
t; Hi, >>> >> >> >>> >> >> Yeah, my NameNode is also seconding as a DataNode. >>> >> >> >>> >> >> I would like to "turn off" this feature. >>> >> >> >>> >> >> Request help regarding the same.

Re: Managing space in Master Node

2013-02-13 Thread Arko Provo Mukherjee
off" this feature. >> >> >> >> >> >> Request help regarding the same. >> >> >> >> >> >> Thanks & regards >> >> >> Arko >> >> >> >> >> >> On Wed, Feb 13, 2013 at 1:38 PM, Charles

RE: Managing space in Master Node

2013-02-13 Thread Charles Baker
._How_can_this_be_done.3F -Original Message- From: Arko Provo Mukherjee [mailto:arkoprovomukher...@gmail.com] Sent: Wednesday, February 13, 2013 12:13 PM To: hdfs-user@hadoop.apache.org Subject: Re: Managing space in Master Node Thanks! However, in that case, how do I handle the current

Re: Managing space in Master Node

2013-02-13 Thread Mohammad Tariq
gt; >> > Hi Arko. Sounds like you may be running a DataNode on the NameNode > >> >> > which > >> >> > is > >> >> > not recommended practice. Normally, the only files the NN stores > are > >> >> > the >

Re: Managing space in Master Node

2013-02-13 Thread Arko Provo Mukherjee
nd edits files. It does not store any actual HDFS data. If you >> >> > must >> >> > run a DN on the NN, try turning down the logging in >> >> > /conf/log4j.properties: >> >> > >> >> > #hadoop.root.logger=INFO,console >>

Re: Managing space in Master Node

2013-02-13 Thread Mohammad Tariq
>> > /conf/log4j.properties: > >> > > >> > #hadoop.root.logger=INFO,console > >> > #hadoop.root.logger=WARN,console > >> > hadoop.root.logger=ERROR,console > >> > > >> > Depending on the logging information you re

Re: Managing space in Master Node

2013-02-13 Thread Arko Provo Mukherjee
ging in >> > /conf/log4j.properties: >> > >> > #hadoop.root.logger=INFO,console >> > #hadoop.root.logger=WARN,console >> > hadoop.root.logger=ERROR,console >> > >> > Depending on the logging information you require, of course. >> &g