Standby node from HADOOP-4539

2014-09-08 Thread Dmitry Salychev
Hi, guys. I am looking for "warm replacement" of NN. I know that "StreamEditsToBN" desing document planned "Warm standby provision" section, but has it been implemented? If it's not, what is the best place to start implementing the issue?

Re: Standby node from HADOOP-4539

2014-09-10 Thread Dmitry Salychev
:47 PM, Dmitry Salychev wrote: Hi, guys. I am looking for "warm replacement" of NN. I know that "StreamEditsToBN" desing document planned "Warm standby provision" section, but has it been implemented? If it's not, what is the best place to start implementing the issue?

NameNode as a single point of failure

2015-07-01 Thread Dmitry Salychev
Hello, HDFS Developers. I know that NN is a single point of failure of an entire HDFS cluster. If it fails, the cluster will be unavailable no matter how many DN there. I know that there is an initiative whic

Re: NameNode as a single point of failure

2015-07-02 Thread Dmitry Salychev
Jul 2, 2015 11:50 AM, "Dmitry Salychev" wrote: Hello, HDFS Developers. I know that NN is a single point of failure of an entire HDFS cluster. If it fails, the cluster will be unavailable no matter how many DN there. I know that there is an initiative < http://www.wandisco.com/syste

Re: NameNode as a single point of failure

2015-07-02 Thread Dmitry Salychev
work that will be in Hadoop 3 that will allow to have more than 1 stand-by NNs: https://issues.apache.org/jira/browse/HDFS-6440 cheers, esteban. -- Cloudera, Inc. On Thu, Jul 2, 2015 at 7:42 AM, Dmitry Salychev wrote: Sure, I did. It's actually not what I'm looking for. I don'

Re: NameNode as a single point of failure

2015-07-06 Thread Dmitry Salychev
designed to have both data and metadata distributed and replicated: https://github.com/GiraffaFS/giraffa Thanks, --Konstantin On Thu, Jul 2, 2015 at 8:25 AM, Dmitry Salychev wrote: Hi, Esteban. Thanks for your reply. Thus, QJM automatic failover option is a cut-edge thing. Am I right? I think that

Re: Questions on Namespace/namenode

2015-07-21 Thread Dmitry Salychev
Hi, Shani. NameNode is a HDFS bottleneck, so running multiple namespaces within only one NN is a risky. What do you want to achieve? It might help you a bit - HDFS Federation . On 07/21/2015 06:01 AM, Sha