Provo Mukherjee [mailto:arkoprovomukher...@gmail.com]
Sent: Thursday, February 14, 2013 4:21 PM
To: hdfs-user@hadoop.apache.org
Subject: Re: Managing space in Master Node
Hello Everyone - I have decommissioned my NN so that only the JobTracker,
NameNode and SecondaryNameNodes are running
Hey Arko. It should be safe to delete then.
-Chuck
-Original Message-
From: Arko Provo Mukherjee [mailto:arkoprovomukher...@gmail.com]
Sent: Friday, February 15, 2013 11:56 AM
To: hdfs-user@hadoop.apache.org
Subject: Re: Managing space in Master Node
Hello Charles,
Thanks a lot
Hello Everyone - I have decommissioned my NN so that only the
JobTracker, NameNode and SecondaryNameNodes are running on it now.
I would like to thank everyone who helped me to perform this task!
I have just one more issue: The data files created in the Master Node
seem to be still there. in
Subject: Re: Managing space in Master Node
Hello Everyone - I have decommissioned my NN so that only the JobTracker,
NameNode and SecondaryNameNodes are running on it now.
I would like to thank everyone who helped me to perform this task!
I have just one more issue: The data files created in the Master
Hi Arko.
Only thing you need to do is not running the TaskTracker and DataNode demons
on your master machine. Ensure you do not have this on your slaves file con
hadoop's config directory when you start the system. I'm supposing you are on
Open Source release. For other distributions look at
Thanks! I have already requested for downtime. Will do the changes soon!
Warm regards
Arko
On Thu, Feb 14, 2013 at 3:31 AM, ramon@accenture.com wrote:
Hi Arko.
Only thing you need to do is not running the TaskTracker and DataNode
demons on your master machine. Ensure you do not have
Hi,
Thanks for the help!
However, I am still unsure about how to turn off the datanode
feature on the NN.
I checked the hdfs-site.xml file and the dfs.data.dir is pointed to
a directory.
Should I just comment out that property? What would happen to the
current data that there is in the Master?
Just don't run the DN daemon on that machine. Dedicate that machine to NN.
Remove the hostname of the NN machine from the 'slaves' file.
Warm Regards,
Tariq
https://mtariq.jux.com/
cloudfront.blogspot.com
On Thu, Feb 14, 2013 at 1:31 AM, Arko Provo Mukherjee
arkoprovomukher...@gmail.com wrote:
Thanks!
However, in that case, how do I handle the current data that is already in NN?
Do I have to reformat HDFS?
Thanks regards
Arko
On Wed, Feb 13, 2013 at 2:06 PM, Mohammad Tariq donta...@gmail.com wrote:
Just don't run the DN daemon on that machine. Dedicate that machine to NN.
Remove the
No, copy this directory to the new location of your choice.
Warm Regards,
Tariq
https://mtariq.jux.com/
cloudfront.blogspot.com
On Thu, Feb 14, 2013 at 1:42 AM, Arko Provo Mukherjee
arkoprovomukher...@gmail.com wrote:
Thanks!
However, in that case, how do I handle the current data that is
._How_can_this_be_done.3F
-Original Message-
From: Arko Provo Mukherjee [mailto:arkoprovomukher...@gmail.com]
Sent: Wednesday, February 13, 2013 12:13 PM
To: hdfs-user@hadoop.apache.org
Subject: Re: Managing space in Master Node
Thanks!
However, in that case, how do I handle the current
Hi,
I am not sure the provided link matches my situation.
That is because, I am not trying to exclude any node but just trying
to stop the NN act as a DataNode.
Thanks regards
Arko
On Wed, Feb 13, 2013 at 2:31 PM, Arko Provo Mukherjee
arkoprovomukher...@gmail.com wrote:
Thanks! Let me study
Hi,
I have 10 nodes. 1 Master Node (running all deamons) and 9 Slave Nodes
(running DN and Task Tracker).
My issue is that the my NN is getting filled up pretty fast as the NN
acts as a DN.
I want my NN not to function as the DN.
Does including the IP for the NN in the dfs.hosts.exclude and
Hi,
I was just wondering if it is okay to exclude the NN IP.
I hope it won't create any side effects.
This is because I don't want to actually decommission the NN node, but
just make it stop working as a DataNode.
However, if you are sure there are no problems, I will go ahead and
make the
Decommissioning is for removing DNs and not the NN.
Warm Regards,
Tariq
https://mtariq.jux.com/
cloudfront.blogspot.com
On Thu, Feb 14, 2013 at 5:18 AM, Arko Provo Mukherjee
arkoprovomukher...@gmail.com wrote:
Hi,
I was just wondering if it is okay to exclude the NN IP.
I hope it won't
Sure, thanks!
One last question before I go ahead and make the changes.
My hdfs-site.xml doesn't have an entry for dfs.replication.
So can I just assume that the system is using the default of 3?
I ask this because if it is 1, then I will first have to increase it
so as to not loose data when I
Hi Arko. Sounds like you may be running a DataNode on the NameNode which is
not recommended practice. Normally, the only files the NN stores are the
image and edits files. It does not store any actual HDFS data. If you must
run a DN on the NN, try turning down the logging in
Hi,
Yeah, my NameNode is also seconding as a DataNode.
I would like to turn off this feature.
Request help regarding the same.
Thanks regards
Arko
On Wed, Feb 13, 2013 at 1:38 PM, Charles Baker cba...@sdl.com wrote:
Hi Arko. Sounds like you may be running a DataNode on the NameNode which is
You can specify the logging level as specified by Charles. But turning logs
off is never a good idea. Logs are really helpful in problem diagnosis,
which are eventual.
Warm Regards,
Tariq
https://mtariq.jux.com/
cloudfront.blogspot.com
On Thu, Feb 14, 2013 at 1:22 AM, Arko Provo Mukherjee
19 matches
Mail list logo
