Hi Qianbo , We're definitely aware of the need for ViewFS, and looking at supporting Federated Namespace Services for multiple HDFS clusters in the future.
It won't be apart of the initial Sentry HA effort, but its definitely something we can start working towards as a community after we get the foundation laid. Mat Crocker On Wed, May 3, 2017 at 2:00 PM, Qianbo Huai <qia...@uber.com> wrote: > Hi Sentry Dev, > > A couple of month ago, we created a viewfs feature request (SENTRY-1627). > Viewfs > <https://hadoop.apache.org/docs/r2.7.0/hadoop-project- > dist/hadoop-hdfs/ViewFs.html> > is critical in supporting the rapid growth / expansion of our HDFS > clusters. Since then, we have implemented viewfs support on top of Sentry > cdh5-1.5.1_5.7.2. The implementation is currently in the process of being > rolled out to our production. At the high level, the change involves > patching the Sentry service thrift API so that NN plugin of each HDFS > clusters can identify itself to the service. In turn, the sentry service > converts viewfs paths to HDFS paths that the requesting NN plugin can > understand. > > As you are redesigning HA for sentry and moving in-memory states to > database, it would be great that you support viewfs to begin with, or be > aware of the need for viewfs support at a later stage. > > Thanks > Qianbo Huai > > Uber Data Infra Engineering > -- Mat Crocker Engineering Manager, Cloudera Inc.
