Re: HDFS Federation with HA

2018-10-10 Thread Rams Venkatesh
Please email to user-unsubscr...@hadoop.apache.org to get yourself removed from the distribution list > On 10 Oct 2018, at 3:14 pm, Pankaj Kumar > wrote: > > Remove Me. > > --- > Thanks & Regards > Pankaj Kumar > IDC Technologies Inc. > Work: 408-457-9381- Ext-4102 > Mailto: pankaj.ku...@id

RE: HDFS Federation with HA

2018-10-10 Thread Pankaj Kumar
Remove Me. --- Thanks & Regards Pankaj Kumar IDC Technologies Inc. Work: 408-457-9381- Ext-4102 Mailto: pankaj.ku...@idctechnologies.com - Empowering Technologies Services Remote Services | IT Services | BPO | IT Consulting | Staff

Re: HDFS Federation with HA

2018-10-10 Thread Takanobu Asanuma
Hi Rahul, Actually, you can use the same journal nodes for other nameservices if you specify the different directories. === dfs.namenode.shared.edits.dir.ns1=qjournal://ns1jn1:8485;ns1jn2:8485;ns1jn3:8485/ns1 dfs.namenode.shared.edits.dir.ns2=qjournal://ns

Re: HDFS Federation with HA

2018-10-10 Thread rahul patwari
Hi Takanobu, Thanks for the reply. So, does that mean that 3 dedicated journal nodes are required for each nameservice? or can we have the same journal nodes for all the nameservices? Thanks, Rahul On Wed, Oct 10, 2018 at 1:00 PM Takanobu Asanuma wrote: > Hi Rahul, > > Yes, it is possible. Her

Re: HDFS Federation with HA

2018-10-10 Thread Takanobu Asanuma
Hi Rahul, Yes, it is possible. Here are the sample configurations. === dfs.nameservices=ns1,ns2 dfs.ha.namenodes.ns1=nn1,nn2 dfs.ha.namenodes.ns2=nn1,nn2 dfs.namenode.rpc-address.ns1.nn1=ns1nn1:8020 dfs.namenode.rpc-address.ns1.nn2=ns1nn2:8020 dfs.namenode