There is support for hms notifications in Hive 1.1. DbNotificationListener exists on this version, but there are several fixes on Hive 2.0 that would allow us to have a better functionality of HA.
There are known issues that are solved on Hive 2.3, though, such as: - Sentry/HMS sync event listener - Transactional listeners But, we have an issue with Hive 2.3 that makes complicated to use in Sentry right now. Also, Hive 1.1 is an old version, and final sentry users who use hive should have patches from higher versions to fix several issues that came with 1.1. I think that if we release a Sentry version with Hive 2.0 will allow other users to start testing HA and decide whether is in good shape or need fixes and probably contribute to those bugs. Without a release, HA will be in development until Hive releases something usable, and that could take months. - Sergio On Tue, Oct 10, 2017 at 12:25 AM, Alexander Kolbasov <[email protected]> wrote: > I think my earlier message was dropped. > > Question for Sergio and Kalyan - Does Hive 1 have all the support for HMS > notifications, required for the new Sentry functionality that is based on > HMS notifications? > > - Alex > > On Fri, Oct 6, 2017 at 7:31 AM, Kalyan Kumar Kalvagadda < > [email protected]> wrote: > > > Sasha, > > > > You got me wrong. I'm proposed to go with Hive 2.0 using authv1 for > sentry > > 1.9.0 release. > > > > -Kalyan > > > > -Kalyan > > > > On Thu, Oct 5, 2017 at 5:52 PM, Alexander Kolbasov <[email protected]> > > wrote: > > > > > Sergio - what is the state of HMS notifications in Hive1? Do they even > > > exist there? > > > > > > Kalyan - I am not sure that the new Sentry architecture which is based > on > > > HMS notifications can work with Hive 1 at all. > > > > > > On Thu, Oct 5, 2017 at 2:52 PM, Kalyan Kumar Kalvagadda < > > > [email protected]> wrote: > > > > > > > Sasha, > > > > > > > > Proposal was to release sentry 1.9.0 which will be branched out of > > > current > > > > master which works with Hive 2.0 using authv1. > > > > Hive 2.0 has a lot fixes for HMS notification as well. > > > > > > > > I agree, i think it would miss one commit in Hive which is needed for > > > > sentryHa which is support for "SentryHMSSyncPostEventListener". This > > fix > > > > is > > > > used to synchronize the requests when the object creation and > privilege > > > > addition are automated and are executed back to back. Can't we can > have > > > it > > > > documented as a known issue. > > > > > > > > > > > > -Kalyan > > > > > > > > > > > > > > > > > > > > -Kalyan > > > > > > > > On Thu, Oct 5, 2017 at 3:02 PM, Alexander Kolbasov < > [email protected] > > > > > > > wrote: > > > > > > > > > The major reason why we wanted to move to Sentry 2.0 was the > > dependency > > > > on > > > > > Hive version. Sentry HA completely relies on HMS notifications > which > > > are > > > > > not available in Hive 1, more over it relies on fixes that are only > > > > > available in Hive 2.4. Sentry 1 should work with Hive 1, so we > can't > > > make > > > > > Sentry HA work with Hive 1. > > > > > > > > > > - Sasha > > > > > > > > > > On Thu, Oct 5, 2017 at 7:15 AM, Kalyan Kumar Kalvagadda < > > > > > [email protected]> wrote: > > > > > > > > > > > Colm, > > > > > > > > > > > > If we have consensus on releasing sentry 1.9.0, I can work on > > release > > > > > > process which takes couple of weeks from now. > > > > > > > > > > > > -Kalyan > > > > > > > > > > > > On Thu, Oct 5, 2017 at 3:50 AM, Colm O hEigeartaigh < > > > > [email protected] > > > > > > > > > > > > wrote: > > > > > > > > > > > > > Fine with me, it makes sense to get the HA work out there if it > > is > > > > > ready > > > > > > to > > > > > > > be used. What kind of time-line are you thinking of for 1.9.0? > > > > > > > > > > > > > > Colm. > > > > > > > > > > > > > > On Thu, Oct 5, 2017 at 4:37 AM, Sergio Pena < > > > > [email protected]> > > > > > > > wrote: > > > > > > > > > > > > > > > It sounds good to do. One of the reasons to do sentry 2.0 was > > the > > > > > > > > integration with hive-authz2, but this is taking time for > > quality > > > > > > > concerns. > > > > > > > > Perhaps is good to cut the branch for 1.9 now before starting > > to > > > > add > > > > > > > other > > > > > > > > incompatible changes to the master branch. > > > > > > > > > > > > > > > > +1 to release 1.9 + ha work. > > > > > > > > > > > > > > > > On Wed, Oct 4, 2017 at 5:19 PM, Kalyan Kumar Kalvagadda < > > > > > > > > [email protected]> wrote: > > > > > > > > > > > > > > > > > Hi all, > > > > > > > > > > > > > > > > > > I understand that the major areas that still needs > > significant > > > > > amount > > > > > > > > work > > > > > > > > > on sentry 2.0 are > > > > > > > > > > > > > > > > > > 1. Integrating with Hive 2.0 > > > > > > > > > 2. Updating the java version > > > > > > > > > 3. Integrating with Solr-7 > > > > > > > > > > > > > > > > > > > > > > > > > > > *Integrating with Hive 2.0: *While testing stuff with Hive > > > > locally, > > > > > > we > > > > > > > > > found couple of issues with Hive-2 and sentry 2.0 > integration > > > > using > > > > > > > > auth-v2 > > > > > > > > > interface. There were couple of fixes that are needed from > > Hive > > > > > side, > > > > > > > > some > > > > > > > > > of them are already fixed in Hive 3.0 and some are yet to > be > > > > fixed. > > > > > > > > Bottom > > > > > > > > > line is that we need some help from Hive community in > fixing > > > some > > > > > > > issues > > > > > > > > > and back-porting them to some Hive-2.x release before we > > > actually > > > > > try > > > > > > > to > > > > > > > > > continue testing it with new Hive-2.x release. This could > > take > > > > > quite > > > > > > > some > > > > > > > > > time > > > > > > > > > > > > > > > > > > *Integrating with Solr-7: *We happened to talk to > > contributors > > > of > > > > > > this > > > > > > > > > feature. They might some time to actually get it ready. > > > > > > > > > > > > > > > > > > These outstanding work need not delay the release of > > sentry-HA > > > > > which > > > > > > is > > > > > > > > > well tested locally at cloudera. This feature is something > > that > > > > the > > > > > > > > > community is waiting for quite some time. Why don't we > > release > > > > > > current > > > > > > > > > master as sentry 1.9 release? > > > > > > > > > > > > > > > > > > Sentry 1.9.0 if released, would below features. > > > > > > > > > > > > > > > > > > 1. Sentry-HA > > > > > > > > > 2. Integration with Hive 2.0 using auth-V1. > > > > > > > > > > > > > > > > > > Seeking inputs from every one in this regard. > > > > > > > > > > > > > > > > > > > > > > > > > > > -Kalyan > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > > Colm O hEigeartaigh > > > > > > > > > > > > > > Talend Community Coder > > > > > > > http://coders.talend.com > > > > > > > > > > > > > > > > > > > > > > > > > > > >
