Hi Shani, As discussed, please thoroughly evaluate the extension points available to implement this in a much cleaner way as well as the challenges, etc that exist while doing this with the latest versions, and update the thread so those information will be visible for a wider audience.
Cheers, Prabath On Wed, Feb 5, 2014 at 8:46 AM, Shani Ranasinghe <sh...@wso2.com> wrote: > Hi, > > I have made a mistake on the hadoop versions. It is hadoop version 2.2.0. > https://hadoop.apache.org/releases.html#15+October%2C+2013%3A+Release+2.2.0+available, > this is the latest recommended release. > > > > > On Mon, Feb 3, 2014 at 6:23 PM, Shani Ranasinghe <sh...@wso2.com> wrote: > >> Hi, >> >> Hadoop 2.1.0 release [1] is mentioned to be stable. I suggest we use this >> feature for SS future release. >> >> In hadoop 2, a main feature that is introduced is federation. This is >> where there can be multiple namenodes/namespaces per cluster. A namenode >> here means a active namenode, a passive namenode and a secondary namenode. >> So with this approach, if we dedicate one namenode/namespace per tenant we >> can get the tenant isolation. >> >> As per the discussion I had with Prabath A, and Dhanuka on friday, we had >> 2 questions, >> >> 1) Can there be multiple namespaces in a single namenode? is it >> recommended? >> >> 2) Let's say I have a federated namespace/namenodes. There are two >> namenodes A /namespace A1 and namenode B/namespace B1, and have 3 >> datanodes. Can someone from namespace A1, access the datanode's data in >> anyway belonging to namespace B1. If not how is it handled? >> >> IMO this could be handled to some extend with the usage of kerberos in >> HDFS. The delegation tokens could be of use in this case. However will need >> to look into this more. >> >> I have raised these questions on the HDFS mailing lists, but have not yet >> got any response. >> >> I am yet to try the Hadoop 2 aforementioned release. Will do a POC and >> update. >> >> [1] Hadoop >> 2.1.0-beta<http://hadoop.apache.org/releases.html#23+September%2C+2013%3A+Release+2.1.1-beta+available> >> >> >> Thanks and Regards >> *,Shani Ranasinghe* >> Software Engineer >> WSO2 Inc.; http://wso2.com >> lean.enterprise.middleware >> >> mobile: +94 77 2273555 >> linked in: lk.linkedin.com/pub/shani-ranasinghe/34/111/ab >> > > > > -- > Thanks and Regards > *, Shani Ranasinghe* > Software Engineer > WSO2 Inc.; http://wso2.com > lean.enterprise.middleware > > mobile: +94 77 2273555 > linked in: lk.linkedin.com/pub/shani-ranasinghe/34/111/ab > -- Prabath Abeysekara Associate Technical Lead, Data TG. WSO2 Inc. Email: praba...@wso2.com Mobile: +94774171471
_______________________________________________ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
