Re: Backup NameNode metadata in HA configuration

2014-02-04 Thread Ivan Tretyakov
Great! That is what I need to know. I was expecting that fsimage can be in inconsistent state while applying changes and it can be wrong to just copy it in such moments. On Tue, Feb 4, 2014 at 11:42 AM, Harsh J ha...@cloudera.com wrote: Nothing wrong in copying it - except it would come with a

Re: Backup NameNode metadata in HA configuration

2014-02-03 Thread Ivan Tretyakov
Does anybody can comment 'copying NN metadata directory' vs 'hdfs dfsadmin -fetch', using NN HA configuration? On Fri, Jan 31, 2014 at 8:26 PM, Ivan Tretyakov itretya...@griddynamics.com wrote: Hi! We are using following version of Hadoop software: 2.0.0-cdh4.1.1. HDFS HA configuration is

Re: Backup NameNode metadata in HA configuration

2014-02-03 Thread Harsh J
Hi, You'll ideally just need the latest fsimage file, which includes the whole check pointed namespace, so hdfs dfsadmin -fetch is appropriate. On Tue, Feb 4, 2014 at 3:02 AM, Ivan Tretyakov itretya...@griddynamics.com wrote: Does anybody can comment 'copying NN metadata directory' vs 'hdfs

Re: Backup NameNode metadata in HA configuration

2014-02-03 Thread Ivan Tretyakov
Thank you Harsh! But I would like to know if just copying NN data directory (dfs.name.dir, dfs.namenode.name.dir) is appropriate or not? On Tue, Feb 4, 2014 at 6:00 AM, Harsh J ha...@cloudera.com wrote: Hi, You'll ideally just need the latest fsimage file, which includes the whole check

Re: Backup NameNode metadata in HA configuration

2014-02-03 Thread Harsh J
Nothing wrong in copying it - except it would come with a bunch of redundant information (extra retained edit logs already merged into one of the recent fsimages). On Tue, Feb 4, 2014 at 12:07 PM, Ivan Tretyakov itretya...@griddynamics.com wrote: Thank you Harsh! But I would like to know if

Backup NameNode metadata in HA configuration

2014-01-31 Thread Ivan Tretyakov
Hi! We are using following version of Hadoop software: 2.0.0-cdh4.1.1. HDFS HA configuration is applied. I would like to ask if there are any difference or possible side effects of backing up namenode data directory. It is ok to just copy NN data directory from active NN to another host, what