Hey Arko. It should be safe to delete then.
-Chuck
-Original Message-
From: Arko Provo Mukherjee [mailto:arkoprovomukher...@gmail.com]
Sent: Friday, February 15, 2013 11:56 AM
To: hdfs-user@hadoop.apache.org
Subject: Re: Managing space in Master Node
Hello Charles,
Thanks a lot for
commend getting a separate machine for those two services as well.
>
> -Chuck
>
>
> -Original Message-
> From: Arko Provo Mukherjee [mailto:arkoprovomukher...@gmail.com]
> Sent: Thursday, February 14, 2013 4:21 PM
> To: hdfs-user@hadoop.apache.org
> Sub
doop.apache.org
Subject: Re: Managing space in Master Node
Hello Everyone - I have decommissioned my NN so that only the JobTracker,
NameNode and SecondaryNameNodes are running on it now.
I would like to thank everyone who helped me to perform this task!
I have just one more issue: The data files create
Hello Everyone - I have decommissioned my NN so that only the
JobTracker, NameNode and SecondaryNameNodes are running on it now.
I would like to thank everyone who helped me to perform this task!
I have just one more issue: The data files created in the Master Node
seem to be still there. in /hdfs
Yes.
Warm Regards,
Tariq
https://mtariq.jux.com/
cloudfront.blogspot.com
On Thu, Feb 14, 2013 at 5:24 AM, Arko Provo Mukherjee <
arkoprovomukher...@gmail.com> wrote:
> Sure, thanks!
> One last question before I go ahead and make the changes.
> My hdfs-site.xml doesn't have an entry for dfs.repl
Sure, thanks!
One last question before I go ahead and make the changes.
My hdfs-site.xml doesn't have an entry for dfs.replication.
So can I just assume that the system is using the default of 3?
I ask this because if it is 1, then I will first have to increase it
so as to not loose data when I sto
Decommissioning is for removing DNs and not the NN.
Warm Regards,
Tariq
https://mtariq.jux.com/
cloudfront.blogspot.com
On Thu, Feb 14, 2013 at 5:18 AM, Arko Provo Mukherjee <
arkoprovomukher...@gmail.com> wrote:
> Hi,
>
> I was just wondering if it is okay to exclude the NN IP.
>
> I hope it w
Hi,
I was just wondering if it is okay to exclude the NN IP.
I hope it won't create any "side effects".
This is because I don't want to actually decommission the NN node, but
just make it stop working as a DataNode.
However, if you are sure there are no problems, I will go ahead and
make the ch
It should.
BTW what's the problem with decommissioning?It's the correct way of
removing the DN, as said by Charles earlier. Create the exclude file and
add the property in the hdfs-site.xml file.
Warm Regards,
Tariq
https://mtariq.jux.com/
cloudfront.blogspot.com
On Thu, Feb 14, 2013 at 5:05 AM
Hi,
I see that the NameNode IP is present in conf/slaves file.
Will removing the IP of the NN from the conf/slaves file and
restarting hadoop help?
Thanks & regards
Arko
On Wed, Feb 13, 2013 at 5:32 PM, Arko Provo Mukherjee
wrote:
> Hi,
>
> I have 10 nodes. 1 Master Node (running all deamons)
Hi,
I have 10 nodes. 1 Master Node (running all deamons) and 9 Slave Nodes
(running DN and Task Tracker).
My issue is that the my NN is getting filled up pretty fast as the NN
acts as a DN.
I want my NN not to function as the DN.
Does including the IP for the NN in the "dfs.hosts.exclude" and
r
Stopping DN on one machine means excluding it. What exactly is the
requirement? How many nodes do you have right now?
Warm Regards,
Tariq
https://mtariq.jux.com/
cloudfront.blogspot.com
On Thu, Feb 14, 2013 at 4:36 AM, Arko Provo Mukherjee <
arkoprovomukher...@gmail.com> wrote:
> Hi,
>
> I am n
Hi,
I am not sure the provided link matches my situation.
That is because, I am not trying to exclude any node but just trying
to stop the NN act as a DataNode.
Thanks & regards
Arko
On Wed, Feb 13, 2013 at 2:31 PM, Arko Provo Mukherjee
wrote:
> Thanks! Let me study and find out if it works fo
Thanks! Let me study and find out if it works for me.
Thanks & regards
Arko
On Wed, Feb 13, 2013 at 2:28 PM, Arko Provo Mukherjee
wrote:
> Hi,
>
> But the new location will also be the same NN physical server.
> So how does that help?
>
> I would like to clear up the space in the master by removi
Hi,
But the new location will also be the same NN physical server.
So how does that help?
I would like to clear up the space in the master by removing all the
HDFS data to the slave nodes.
Thanks & regards
Arko
On Wed, Feb 13, 2013 at 2:14 PM, Mohammad Tariq wrote:
> No, copy this directory to
._How_can_this_be_done.3F
-Original Message-
From: Arko Provo Mukherjee [mailto:arkoprovomukher...@gmail.com]
Sent: Wednesday, February 13, 2013 12:13 PM
To: hdfs-user@hadoop.apache.org
Subject: Re: Managing space in Master Node
Thanks!
However, in that case, how do I handle the current
No, copy this directory to the new location of your choice.
Warm Regards,
Tariq
https://mtariq.jux.com/
cloudfront.blogspot.com
On Thu, Feb 14, 2013 at 1:42 AM, Arko Provo Mukherjee <
arkoprovomukher...@gmail.com> wrote:
> Thanks!
> However, in that case, how do I handle the current data that i
Thanks!
However, in that case, how do I handle the current data that is already in NN?
Do I have to reformat HDFS?
Thanks & regards
Arko
On Wed, Feb 13, 2013 at 2:06 PM, Mohammad Tariq wrote:
> Just don't run the DN daemon on that machine. Dedicate that machine to NN.
> Remove the hostname of the
Just don't run the DN daemon on that machine. Dedicate that machine to NN.
Remove the hostname of the NN machine from the 'slaves' file.
Warm Regards,
Tariq
https://mtariq.jux.com/
cloudfront.blogspot.com
On Thu, Feb 14, 2013 at 1:31 AM, Arko Provo Mukherjee <
arkoprovomukher...@gmail.com> wrote
Hi,
Thanks for the help!
However, I am still unsure about how to "turn off" the datanode
feature on the NN.
I checked the "hdfs-site.xml" file and the dfs.data.dir is pointed to
a directory.
Should I just comment out that property? What would happen to the
current data that there is in the Mast
20 matches
Mail list logo
