I think my earlier message was dropped. Question for Sergio and Kalyan - Does Hive 1 have all the support for HMS notifications, required for the new Sentry functionality that is based on HMS notifications?
- Alex On Fri, Oct 6, 2017 at 7:31 AM, Kalyan Kumar Kalvagadda < kkal...@cloudera.com> wrote: > Sasha, > > You got me wrong. I'm proposed to go with Hive 2.0 using authv1 for sentry > 1.9.0 release. > > -Kalyan > > -Kalyan > > On Thu, Oct 5, 2017 at 5:52 PM, Alexander Kolbasov <ak...@cloudera.com> > wrote: > > > Sergio - what is the state of HMS notifications in Hive1? Do they even > > exist there? > > > > Kalyan - I am not sure that the new Sentry architecture which is based on > > HMS notifications can work with Hive 1 at all. > > > > On Thu, Oct 5, 2017 at 2:52 PM, Kalyan Kumar Kalvagadda < > > kkal...@cloudera.com> wrote: > > > > > Sasha, > > > > > > Proposal was to release sentry 1.9.0 which will be branched out of > > current > > > master which works with Hive 2.0 using authv1. > > > Hive 2.0 has a lot fixes for HMS notification as well. > > > > > > I agree, i think it would miss one commit in Hive which is needed for > > > sentryHa which is support for "SentryHMSSyncPostEventListener". This > fix > > > is > > > used to synchronize the requests when the object creation and privilege > > > addition are automated and are executed back to back. Can't we can have > > it > > > documented as a known issue. > > > > > > > > > -Kalyan > > > > > > > > > > > > > > > -Kalyan > > > > > > On Thu, Oct 5, 2017 at 3:02 PM, Alexander Kolbasov <ak...@cloudera.com > > > > > wrote: > > > > > > > The major reason why we wanted to move to Sentry 2.0 was the > dependency > > > on > > > > Hive version. Sentry HA completely relies on HMS notifications which > > are > > > > not available in Hive 1, more over it relies on fixes that are only > > > > available in Hive 2.4. Sentry 1 should work with Hive 1, so we can't > > make > > > > Sentry HA work with Hive 1. > > > > > > > > - Sasha > > > > > > > > On Thu, Oct 5, 2017 at 7:15 AM, Kalyan Kumar Kalvagadda < > > > > kkal...@cloudera.com> wrote: > > > > > > > > > Colm, > > > > > > > > > > If we have consensus on releasing sentry 1.9.0, I can work on > release > > > > > process which takes couple of weeks from now. > > > > > > > > > > -Kalyan > > > > > > > > > > On Thu, Oct 5, 2017 at 3:50 AM, Colm O hEigeartaigh < > > > cohei...@apache.org > > > > > > > > > > wrote: > > > > > > > > > > > Fine with me, it makes sense to get the HA work out there if it > is > > > > ready > > > > > to > > > > > > be used. What kind of time-line are you thinking of for 1.9.0? > > > > > > > > > > > > Colm. > > > > > > > > > > > > On Thu, Oct 5, 2017 at 4:37 AM, Sergio Pena < > > > sergio.p...@cloudera.com> > > > > > > wrote: > > > > > > > > > > > > > It sounds good to do. One of the reasons to do sentry 2.0 was > the > > > > > > > integration with hive-authz2, but this is taking time for > quality > > > > > > concerns. > > > > > > > Perhaps is good to cut the branch for 1.9 now before starting > to > > > add > > > > > > other > > > > > > > incompatible changes to the master branch. > > > > > > > > > > > > > > +1 to release 1.9 + ha work. > > > > > > > > > > > > > > On Wed, Oct 4, 2017 at 5:19 PM, Kalyan Kumar Kalvagadda < > > > > > > > kkal...@cloudera.com> wrote: > > > > > > > > > > > > > > > Hi all, > > > > > > > > > > > > > > > > I understand that the major areas that still needs > significant > > > > amount > > > > > > > work > > > > > > > > on sentry 2.0 are > > > > > > > > > > > > > > > > 1. Integrating with Hive 2.0 > > > > > > > > 2. Updating the java version > > > > > > > > 3. Integrating with Solr-7 > > > > > > > > > > > > > > > > > > > > > > > > *Integrating with Hive 2.0: *While testing stuff with Hive > > > locally, > > > > > we > > > > > > > > found couple of issues with Hive-2 and sentry 2.0 integration > > > using > > > > > > > auth-v2 > > > > > > > > interface. There were couple of fixes that are needed from > Hive > > > > side, > > > > > > > some > > > > > > > > of them are already fixed in Hive 3.0 and some are yet to be > > > fixed. > > > > > > > Bottom > > > > > > > > line is that we need some help from Hive community in fixing > > some > > > > > > issues > > > > > > > > and back-porting them to some Hive-2.x release before we > > actually > > > > try > > > > > > to > > > > > > > > continue testing it with new Hive-2.x release. This could > take > > > > quite > > > > > > some > > > > > > > > time > > > > > > > > > > > > > > > > *Integrating with Solr-7: *We happened to talk to > contributors > > of > > > > > this > > > > > > > > feature. They might some time to actually get it ready. > > > > > > > > > > > > > > > > These outstanding work need not delay the release of > sentry-HA > > > > which > > > > > is > > > > > > > > well tested locally at cloudera. This feature is something > that > > > the > > > > > > > > community is waiting for quite some time. Why don't we > release > > > > > current > > > > > > > > master as sentry 1.9 release? > > > > > > > > > > > > > > > > Sentry 1.9.0 if released, would below features. > > > > > > > > > > > > > > > > 1. Sentry-HA > > > > > > > > 2. Integration with Hive 2.0 using auth-V1. > > > > > > > > > > > > > > > > Seeking inputs from every one in this regard. > > > > > > > > > > > > > > > > > > > > > > > > -Kalyan > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > Colm O hEigeartaigh > > > > > > > > > > > > Talend Community Coder > > > > > > http://coders.talend.com > > > > > > > > > > > > > > > > > > > > >