Hello Qianbo, The SENTRY-1627 doesn’t contain any details of the suggested integration between Sentry and Viewfs. Can you explain in more details what changes do you make in the Sentry code to support it?
Sentry HA changes do affect some of the HDFS sync code path, but it is difficult to tell whether this is an issue for Viewfs or not. Can you check the sentry-ha-redesign branch and see whether there are any red flags for you? Thanks, - Alex Kolbasov > On May 3, 2017, at 12:00 PM, Qianbo Huai <qia...@uber.com> wrote: > > Hi Sentry Dev, > > A couple of month ago, we created a viewfs feature request (SENTRY-1627). > Viewfs > <https://hadoop.apache.org/docs/r2.7.0/hadoop-project-dist/hadoop-hdfs/ViewFs.html> > is critical in supporting the rapid growth / expansion of our HDFS > clusters. Since then, we have implemented viewfs support on top of Sentry > cdh5-1.5.1_5.7.2. The implementation is currently in the process of being > rolled out to our production. At the high level, the change involves > patching the Sentry service thrift API so that NN plugin of each HDFS > clusters can identify itself to the service. In turn, the sentry service > converts viewfs paths to HDFS paths that the requesting NN plugin can > understand. > > As you are redesigning HA for sentry and moving in-memory states to > database, it would be great that you support viewfs to begin with, or be > aware of the need for viewfs support at a later stage. > > Thanks > Qianbo Huai > > Uber Data Infra Engineering
