Re: Planning for Apache Ranger 2.3.0 release

2022-05-09 Thread Ricardo Martinelli de Oliveira
How long until 2.3.0 release? Sounds like it's just pushing the button for
the build.

On Mon, May 9, 2022 at 1:33 AM Ramesh Mani  wrote:

> Dear Ranger Community members,
>
> Thanks for all the +1s for Apache Release 2.3 release work. Here is the
> revised list of JIRAs that are to be in Apache Release 2.3.
>
> Apache Ranger 2.3 branch is now closed for further commits to start the
> artifacts build. Thank you all for the support.
>
> Regards,
> Ramesh
>
> Apache Release 2.3 JIRAs.
>
> Improvements:
>
> RANGER-2846 Add support for resource[volume, bucket, key] look up in ozone
> plugin
> RANGER-2967 Add support for Amazon CloudWatch Logs as an Audit Store
> RANGER-3023 Permission tab takes longer time to load with large number of
> users and group_users data
> RANGER-3030 Replace Findbugs with Spotbugs maven plugin
> RANGER-3182 Prestosql is renamed to Trino
> RANGER-3221 Improve logging in Presto plugin
> RANGER-3276 Remove duplicate code from buildks.java
> RANGER-3290 ArrayIndexOutOfBoundsException if solr is down
> RANGER-3299 Upgrading the bouncycastle version for bcprov-jdk15on
> RANGER-3298 Add coarse URI check for Hive Agent
> RANGER-3389 Swagger UI Support for Ranger REST API
> RANGER-3435 Add unique index on guid, service and zone_id column of
> x_policy table
> RANGER-3439 Add rest api to get or delete ranger policy based on guid
> RANGER-3455 [Logout-Ranger] Should either be disabled/ should redirect to
> knox logout page
> RANGER-3459 Upgrade Ranger's Kafka dependency to 2.8
> RANGER-3475 Promote TagRest endpoints to /public/v2
> RANGER-3487 Update underscore js with latest version.
> RANGER-3493 Add unique index on service and resource_signature column of
> x_policy table
> RANGER-3498 RANGER : Remove log4j1 dependencies.
> RANGER-3504 Create framework to execute DB patch dependent on Java patch.
> RANGER-3510 Ranger upgrade spring framework version to 5.3.12
> RANGER-3511 Create Java patch to update policy resource-signature to unique
> value.
> RANGER-3512 Create Java patch to update policy guid to unique value.
> RANGER-3515 Enhance Ranger Java client SSL config to be configured using
> serviceType and AppId
> RANGER-3518 Limit the query size stored in Audit logs
> RANGER-3521 Ranger KMS IS NOT ENFORCING HSTS ON SSL PORT DEFINED BY RFC
> 6797
> RANGER-3526 policy evaluation ordering to use name as secondary sorting key
> RANGER-3533 Provide sorting on columns throughout the audits result set and
> policy listing page.
> RANGER-3538 Reduce the granularity of locking when building/retrieving a
> policy-engine within Ranger admin service
> RANGER-3539 Add jacoco-maven-plugin for code coverage
> RANGER-3540 Add support to read audit logs from Amazon CloudWatch
> RANGER-3545 Remove Logger Checks for Info Enabled
> RANGER-3548 Update performance engine test scripts
> RANGER-3550 support for using user/tag attributes in row-filter expressions
> and conditions
> RANGER-3551 Analyze & optimize module permissions related API
> RANGER-3553 Unit test coverage for XUserMgr and UserMgr class
> RANGER-3556 Ranger tagsync logs unnecessary messages
> RANGER-3561 Upgrade Storm version to 1.2.4
> RANGER-3562 Redesign post commit tasks for updating ref-tables when
> policy/role is updated
> RANGER-3565 RangerRESTClient to support retry
> RANGER-3566 Update version in ranger-2.3 to 2.3.0-SNAPSHOT
> RANGER-3567 support for use of user attributes in policy resources
> RANGER-3569 Support Ranger KMS integration with Google cloud HSM
> RANGER-3573 Add vim in docker base image
> RANGER-3577 RANGER : Upgrade POI version to 5.1.0
> RANGER-3578 Simplify code for policy label creation
> RANGER-3580 Support Ranger KMS integration with TencentKMS
> RANGER-3585 Docker setup to run Ranger usersync and tagsync
> RANGER-3586 Script condition expression to support csv of group/tag
> attributes
> RANGER-3595 Tar of KMS contains rubbish files
> RANGER-3597 User role should not be able to modify the Policy
> RANGER-3600 Ranger service tags import request failure
> RANGER-3603 HDFS audit files rollover improvement to trigger rollover in
> monitoring thread
> RANGER-3605 Support macros in row-filter/condition expressions
> RANGER-3606 remove unnecessary static members from plugin class loaders
> RANGER-3609 option to add user group enricher automatically based on
> references in policies
> RANGER-3620 Ranger - Upgrade tomcat to 8.5.75
> RANGER-3621 Optimise Tag/Policy iterator
> RANGER-3624 Update Ranger services Password Policy
> RANGER-3628 Support fine grain authorization for different solr objects
> RANGER-3629 RANGER -  Handle solr permissions during upgrade
> RANGER-3630 Support wildcards, group short names, and list of memberof
> attribute DNs for computing user search filter
> RANGER-3632 Improve ranger logs,  RENAME_ON_ROTATE and others
> RANGER-3634 Remove duplicate entries from usersync distribution file
> RANGER-3646 LOG.debug print content error
> RANGER-3647 Connection to DB fails for MySQL version above 8.0
> 

Re: Planning for Apache Ranger 2.3.0 release

2022-05-02 Thread Velmurugan Periasamy

+1 

Thanks Ramesh. 

On Mon, May 2, 2022 at 12:54 PM Nixon Rodrigues  wrote:
Thanks Ramesh for volunteering for release.
  +1 for Ranger 2.3 release. Thanks for the initiative.


On Fri, 29 Apr 2022 at 22:25, Sailaja Polavarapu 
 wrote:
Hi Ramesh,
 +1 for Ranger 2.3 release. Thanks for the initiative.
- Sailaja

On Thu, Apr 28, 2022 at 7:21 AM Ramesh Mani mailto:rm...@apache.org>> wrote:

> zhoutianling,
>
> Thanks for the review. These Jiras are part of the Apache Ranger 2.3 apache
> release, it's not pulled in this published list as this may not have
> correct fixed version maintained or it is part of KMS as a component. I
> shall add it to the list in the release note.
>
> Thanks,
> Ramesh
>
> On Thu, Apr 28, 2022 at 2:19 AM KirbY ZhoU  >
> wrote:
>
> > Missed some commit
> > For example:
> >
> > RANGER-3299
> > RANGER-3580
> > RANGER-3600
> > RANGER-3619
> > RANGER-3669
> >
> > 在 2022/4/27 14:49,“Ramesh Mani” > > 写入:
> >
> > Dear Ranger Community members,
> >
> > There are various features and critical bug fixes done in the Apache
> > Ranger
> > project since the release of Apache Ranger 2.2.0.
> > Around 55 improvements, 45 bug fixes and a total of 527 commits were
> > made
> > from the last release.
> > Now with that Ranger community is expecting a release to adapt those
> > changes and hence planning this release.
> >
> > Please review and provide your opinion.
> >
> > Thanks,
> > Ramesh
> >
> > *Improvements:*
> >
> > RANGER-3687 Password Policy Best Practices for Strong Security
> > RANGER-3667 Improve feedback in policy creation UI when resource
> > does
> > not exist
> > RANGER-3659 Ranger Admin goes to OOM when usersync is trying to
> > delete
> > existing group mappings from ranger DB
> > RANGER-3459 Upgrade Ranger's Kafka dependency to 2.8
> > RANGER-3551 Analyze & optimize module permissions related API
> > RANGER-3539 Add jacoco-maven-plugin for code coverage
> > RANGER-3562 Redesign post commit tasks for updating ref-tables
> when
> > policy/role is updated
> > RANGER-3540 Add support to read audit logs from Amazon CloudWatch
> > RANGER-3030 Replace Findbugs with Spotbugs maven plugin
> > RANGER-3538 Reduce the granularity of locking when
> > building/retrieving
> > a policy-engine within Ranger admin service
> > RANGER-3518 Limit the query size stored in Audit logs
> > RANGER-3276 Remove duplicate code from buildks.java
> > RANGER-3515 Enhance Ranger Java client SSL config to be
> configured
> > using serviceType and AppId
> > RANGER-3504 Create framework to execute DB patch dependent on
> Java
> > patch.
> > RANGER-3023 Permission tab takes longer time to load with large
> > number
> > of users and group_users data
> > RANGER-3487 Update underscore js with latest version.
> > RANGER-3548 Update performance engine test scripts
> > RANGER-3556 Ranger tagsync logs unnecessary messages
> > RANGER-3573 Add vim in docker base image
> > RANGER-3578 Simplify code for policy label creation
> > RANGER-3675 Upgrade tomcat due to intermittent READ TIMEOUT
> > RANGER-3686 Docker setup to run Ranger with MySQL database
> > RANGER-3628 Support fine grain authorization for different solr
> > objects
> > RANGER-3629 RANGER -  Handle solr permissions during upgrade
> > RANGER-3665 "No Data Found !!" messages in Ranger admin UI alarm
> > users
> > RANGER-3662 There should be pause button for error popup
> > RANGER-3660 [Ranger Admin UI] Improvements in tooltip hints for
> > better
> > user experience
> > RANGER-3649 Represent the Solr admin object types on the Ranger
> UI
> > RANGER-3658 Docker: Ranger containers to run as user=ranger
> > RANGER-3603 HDFS audit files rollover improvement to trigger
> > rollover
> > in monitoring thread
> > RANGER-3651 Remove jersey 1.x version dependency for knox plugin
> > RANGER-3621 Optimise Tag/Policy iterator
> > RANGER-3521 Ranger KMS IS NOT ENFORCING HSTS ON SSL PORT DEFINED
> > BY RFC
> > 6797
> > RANGER-3455 [Logout-Ranger] Should either be disabled/ should
> > redirect
> > to knox logout page
> > RANGER-3630 Support wildcards, group short names, and list of
> > memberof
> > attribute DNs for computing user search filter
> > RANGER-3597 User role should not be able to modify the Policy
> > RANGER-3512 Create Java patch to update policy guid to unique
> > value.
> > RANGER-3511 Create Java patch to update policy resource-signature
> > to
> > unique value.
> > RANGER-3493 Add unique index on service and resource_signature
> > column
> > of x_policy table
> > RANGER-3435 Add unique index on 

Re: Planning for Apache Ranger 2.3.0 release

2022-05-02 Thread Nixon Rodrigues
Thanks Ramesh for volunteering for release.
  +1 for Ranger 2.3 release. Thanks for the initiative.


On Fri, 29 Apr 2022 at 22:25, Sailaja Polavarapu
 wrote:

> Hi Ramesh,
>  +1 for Ranger 2.3 release. Thanks for the initiative.
> - Sailaja
>
> On Thu, Apr 28, 2022 at 7:21 AM Ramesh Mani  wrote:
>
> > zhoutianling,
> >
> > Thanks for the review. These Jiras are part of the Apache Ranger 2.3
> apache
> > release, it's not pulled in this published list as this may not have
> > correct fixed version maintained or it is part of KMS as a component. I
> > shall add it to the list in the release note.
> >
> > Thanks,
> > Ramesh
> >
> > On Thu, Apr 28, 2022 at 2:19 AM KirbY ZhoU 
> > wrote:
> >
> > > Missed some commit
> > > For example:
> > >
> > > RANGER-3299
> > > RANGER-3580
> > > RANGER-3600
> > > RANGER-3619
> > > RANGER-3669
> > >
> > > 在 2022/4/27 14:49,“Ramesh Mani” 写入:
> > >
> > > Dear Ranger Community members,
> > >
> > > There are various features and critical bug fixes done in the
> Apache
> > > Ranger
> > > project since the release of Apache Ranger 2.2.0.
> > > Around 55 improvements, 45 bug fixes and a total of 527 commits
> were
> > > made
> > > from the last release.
> > > Now with that Ranger community is expecting a release to adapt
> those
> > > changes and hence planning this release.
> > >
> > > Please review and provide your opinion.
> > >
> > > Thanks,
> > > Ramesh
> > >
> > > *Improvements:*
> > >
> > > RANGER-3687 Password Policy Best Practices for Strong Security
> > > RANGER-3667 Improve feedback in policy creation UI when
> resource
> > > does
> > > not exist
> > > RANGER-3659 Ranger Admin goes to OOM when usersync is trying to
> > > delete
> > > existing group mappings from ranger DB
> > > RANGER-3459 Upgrade Ranger's Kafka dependency to 2.8
> > > RANGER-3551 Analyze & optimize module permissions related API
> > > RANGER-3539 Add jacoco-maven-plugin for code coverage
> > > RANGER-3562 Redesign post commit tasks for updating ref-tables
> > when
> > > policy/role is updated
> > > RANGER-3540 Add support to read audit logs from Amazon
> CloudWatch
> > > RANGER-3030 Replace Findbugs with Spotbugs maven plugin
> > > RANGER-3538 Reduce the granularity of locking when
> > > building/retrieving
> > > a policy-engine within Ranger admin service
> > > RANGER-3518 Limit the query size stored in Audit logs
> > > RANGER-3276 Remove duplicate code from buildks.java
> > > RANGER-3515 Enhance Ranger Java client SSL config to be
> > configured
> > > using serviceType and AppId
> > > RANGER-3504 Create framework to execute DB patch dependent on
> > Java
> > > patch.
> > > RANGER-3023 Permission tab takes longer time to load with large
> > > number
> > > of users and group_users data
> > > RANGER-3487 Update underscore js with latest version.
> > > RANGER-3548 Update performance engine test scripts
> > > RANGER-3556 Ranger tagsync logs unnecessary messages
> > > RANGER-3573 Add vim in docker base image
> > > RANGER-3578 Simplify code for policy label creation
> > > RANGER-3675 Upgrade tomcat due to intermittent READ TIMEOUT
> > > RANGER-3686 Docker setup to run Ranger with MySQL database
> > > RANGER-3628 Support fine grain authorization for different solr
> > > objects
> > > RANGER-3629 RANGER -  Handle solr permissions during upgrade
> > > RANGER-3665 "No Data Found !!" messages in Ranger admin UI
> alarm
> > > users
> > > RANGER-3662 There should be pause button for error popup
> > > RANGER-3660 [Ranger Admin UI] Improvements in tooltip hints for
> > > better
> > > user experience
> > > RANGER-3649 Represent the Solr admin object types on the Ranger
> > UI
> > > RANGER-3658 Docker: Ranger containers to run as user=ranger
> > > RANGER-3603 HDFS audit files rollover improvement to trigger
> > > rollover
> > > in monitoring thread
> > > RANGER-3651 Remove jersey 1.x version dependency for knox
> plugin
> > > RANGER-3621 Optimise Tag/Policy iterator
> > > RANGER-3521 Ranger KMS IS NOT ENFORCING HSTS ON SSL PORT
> DEFINED
> > > BY RFC
> > > 6797
> > > RANGER-3455 [Logout-Ranger] Should either be disabled/ should
> > > redirect
> > > to knox logout page
> > > RANGER-3630 Support wildcards, group short names, and list of
> > > memberof
> > > attribute DNs for computing user search filter
> > > RANGER-3597 User role should not be able to modify the Policy
> > > RANGER-3512 Create Java patch to update policy guid to unique
> > > value.
> > > RANGER-3511 Create Java patch to update policy
> resource-signature
> > > to
> > > unique value.
> > > RANGER-3493 Add unique index on service and resource_signature

Re: Planning for Apache Ranger 2.3.0 release

2022-04-29 Thread Sailaja Polavarapu
Hi Ramesh,
 +1 for Ranger 2.3 release. Thanks for the initiative.
- Sailaja

On Thu, Apr 28, 2022 at 7:21 AM Ramesh Mani  wrote:

> zhoutianling,
>
> Thanks for the review. These Jiras are part of the Apache Ranger 2.3 apache
> release, it's not pulled in this published list as this may not have
> correct fixed version maintained or it is part of KMS as a component. I
> shall add it to the list in the release note.
>
> Thanks,
> Ramesh
>
> On Thu, Apr 28, 2022 at 2:19 AM KirbY ZhoU 
> wrote:
>
> > Missed some commit
> > For example:
> >
> > RANGER-3299
> > RANGER-3580
> > RANGER-3600
> > RANGER-3619
> > RANGER-3669
> >
> > 在 2022/4/27 14:49,“Ramesh Mani” 写入:
> >
> > Dear Ranger Community members,
> >
> > There are various features and critical bug fixes done in the Apache
> > Ranger
> > project since the release of Apache Ranger 2.2.0.
> > Around 55 improvements, 45 bug fixes and a total of 527 commits were
> > made
> > from the last release.
> > Now with that Ranger community is expecting a release to adapt those
> > changes and hence planning this release.
> >
> > Please review and provide your opinion.
> >
> > Thanks,
> > Ramesh
> >
> > *Improvements:*
> >
> > RANGER-3687 Password Policy Best Practices for Strong Security
> > RANGER-3667 Improve feedback in policy creation UI when resource
> > does
> > not exist
> > RANGER-3659 Ranger Admin goes to OOM when usersync is trying to
> > delete
> > existing group mappings from ranger DB
> > RANGER-3459 Upgrade Ranger's Kafka dependency to 2.8
> > RANGER-3551 Analyze & optimize module permissions related API
> > RANGER-3539 Add jacoco-maven-plugin for code coverage
> > RANGER-3562 Redesign post commit tasks for updating ref-tables
> when
> > policy/role is updated
> > RANGER-3540 Add support to read audit logs from Amazon CloudWatch
> > RANGER-3030 Replace Findbugs with Spotbugs maven plugin
> > RANGER-3538 Reduce the granularity of locking when
> > building/retrieving
> > a policy-engine within Ranger admin service
> > RANGER-3518 Limit the query size stored in Audit logs
> > RANGER-3276 Remove duplicate code from buildks.java
> > RANGER-3515 Enhance Ranger Java client SSL config to be
> configured
> > using serviceType and AppId
> > RANGER-3504 Create framework to execute DB patch dependent on
> Java
> > patch.
> > RANGER-3023 Permission tab takes longer time to load with large
> > number
> > of users and group_users data
> > RANGER-3487 Update underscore js with latest version.
> > RANGER-3548 Update performance engine test scripts
> > RANGER-3556 Ranger tagsync logs unnecessary messages
> > RANGER-3573 Add vim in docker base image
> > RANGER-3578 Simplify code for policy label creation
> > RANGER-3675 Upgrade tomcat due to intermittent READ TIMEOUT
> > RANGER-3686 Docker setup to run Ranger with MySQL database
> > RANGER-3628 Support fine grain authorization for different solr
> > objects
> > RANGER-3629 RANGER -  Handle solr permissions during upgrade
> > RANGER-3665 "No Data Found !!" messages in Ranger admin UI alarm
> > users
> > RANGER-3662 There should be pause button for error popup
> > RANGER-3660 [Ranger Admin UI] Improvements in tooltip hints for
> > better
> > user experience
> > RANGER-3649 Represent the Solr admin object types on the Ranger
> UI
> > RANGER-3658 Docker: Ranger containers to run as user=ranger
> > RANGER-3603 HDFS audit files rollover improvement to trigger
> > rollover
> > in monitoring thread
> > RANGER-3651 Remove jersey 1.x version dependency for knox plugin
> > RANGER-3621 Optimise Tag/Policy iterator
> > RANGER-3521 Ranger KMS IS NOT ENFORCING HSTS ON SSL PORT DEFINED
> > BY RFC
> > 6797
> > RANGER-3455 [Logout-Ranger] Should either be disabled/ should
> > redirect
> > to knox logout page
> > RANGER-3630 Support wildcards, group short names, and list of
> > memberof
> > attribute DNs for computing user search filter
> > RANGER-3597 User role should not be able to modify the Policy
> > RANGER-3512 Create Java patch to update policy guid to unique
> > value.
> > RANGER-3511 Create Java patch to update policy resource-signature
> > to
> > unique value.
> > RANGER-3493 Add unique index on service and resource_signature
> > column
> > of x_policy table
> > RANGER-3435 Add unique index on guid, service and zone_id column
> of
> > x_policy table
> > RANGER-3439 Add rest api to get or delete ranger policy based on
> > guid
> > RANGER-3498 RANGER : Remove log4j1 dependencies.
> > RANGER-3475 Promote TagRest endpoints to /public/v2
> > RANGER-3698 Ranger - Upgrade kylin to 3.1.3
> > 

Re: Planning for Apache Ranger 2.3.0 release

2022-04-28 Thread Ramesh Mani
zhoutianling,

Thanks for the review. These Jiras are part of the Apache Ranger 2.3 apache
release, it's not pulled in this published list as this may not have
correct fixed version maintained or it is part of KMS as a component. I
shall add it to the list in the release note.

Thanks,
Ramesh

On Thu, Apr 28, 2022 at 2:19 AM KirbY ZhoU 
wrote:

> Missed some commit
> For example:
>
> RANGER-3299
> RANGER-3580
> RANGER-3600
> RANGER-3619
> RANGER-3669
>
> 在 2022/4/27 14:49,“Ramesh Mani” 写入:
>
> Dear Ranger Community members,
>
> There are various features and critical bug fixes done in the Apache
> Ranger
> project since the release of Apache Ranger 2.2.0.
> Around 55 improvements, 45 bug fixes and a total of 527 commits were
> made
> from the last release.
> Now with that Ranger community is expecting a release to adapt those
> changes and hence planning this release.
>
> Please review and provide your opinion.
>
> Thanks,
> Ramesh
>
> *Improvements:*
>
> RANGER-3687 Password Policy Best Practices for Strong Security
> RANGER-3667 Improve feedback in policy creation UI when resource
> does
> not exist
> RANGER-3659 Ranger Admin goes to OOM when usersync is trying to
> delete
> existing group mappings from ranger DB
> RANGER-3459 Upgrade Ranger's Kafka dependency to 2.8
> RANGER-3551 Analyze & optimize module permissions related API
> RANGER-3539 Add jacoco-maven-plugin for code coverage
> RANGER-3562 Redesign post commit tasks for updating ref-tables when
> policy/role is updated
> RANGER-3540 Add support to read audit logs from Amazon CloudWatch
> RANGER-3030 Replace Findbugs with Spotbugs maven plugin
> RANGER-3538 Reduce the granularity of locking when
> building/retrieving
> a policy-engine within Ranger admin service
> RANGER-3518 Limit the query size stored in Audit logs
> RANGER-3276 Remove duplicate code from buildks.java
> RANGER-3515 Enhance Ranger Java client SSL config to be configured
> using serviceType and AppId
> RANGER-3504 Create framework to execute DB patch dependent on Java
> patch.
> RANGER-3023 Permission tab takes longer time to load with large
> number
> of users and group_users data
> RANGER-3487 Update underscore js with latest version.
> RANGER-3548 Update performance engine test scripts
> RANGER-3556 Ranger tagsync logs unnecessary messages
> RANGER-3573 Add vim in docker base image
> RANGER-3578 Simplify code for policy label creation
> RANGER-3675 Upgrade tomcat due to intermittent READ TIMEOUT
> RANGER-3686 Docker setup to run Ranger with MySQL database
> RANGER-3628 Support fine grain authorization for different solr
> objects
> RANGER-3629 RANGER -  Handle solr permissions during upgrade
> RANGER-3665 "No Data Found !!" messages in Ranger admin UI alarm
> users
> RANGER-3662 There should be pause button for error popup
> RANGER-3660 [Ranger Admin UI] Improvements in tooltip hints for
> better
> user experience
> RANGER-3649 Represent the Solr admin object types on the Ranger UI
> RANGER-3658 Docker: Ranger containers to run as user=ranger
> RANGER-3603 HDFS audit files rollover improvement to trigger
> rollover
> in monitoring thread
> RANGER-3651 Remove jersey 1.x version dependency for knox plugin
> RANGER-3621 Optimise Tag/Policy iterator
> RANGER-3521 Ranger KMS IS NOT ENFORCING HSTS ON SSL PORT DEFINED
> BY RFC
> 6797
> RANGER-3455 [Logout-Ranger] Should either be disabled/ should
> redirect
> to knox logout page
> RANGER-3630 Support wildcards, group short names, and list of
> memberof
> attribute DNs for computing user search filter
> RANGER-3597 User role should not be able to modify the Policy
> RANGER-3512 Create Java patch to update policy guid to unique
> value.
> RANGER-3511 Create Java patch to update policy resource-signature
> to
> unique value.
> RANGER-3493 Add unique index on service and resource_signature
> column
> of x_policy table
> RANGER-3435 Add unique index on guid, service and zone_id column of
> x_policy table
> RANGER-3439 Add rest api to get or delete ranger policy based on
> guid
> RANGER-3498 RANGER : Remove log4j1 dependencies.
> RANGER-3475 Promote TagRest endpoints to /public/v2
> RANGER-3698 Ranger - Upgrade kylin to 3.1.3
> RANGER-3699 Ranger - Upgrade poi to 5.2.1+
> RANGER-3533 Provide sorting on columns throughout the audits
> result set
> and policy listing page.
> RANGER-3693 Ranger - Upgrade tomcat to 8.5.78
> RANGER-3689 Ranger : ranger-2.3 Port missing commits.
> RANGER-3620 Ranger - Upgrade tomcat to 8.5.75
> RANGER-3577 

Re: Planning for Apache Ranger 2.3.0 release

2022-04-27 Thread Madhan Neethiraj
+1 for Ranger 2.3 release. It has been ~6 months since 2.2 release, and a 
number of good enhancements were added since then.

Ramesh - thanks for the initiative.

Madhan





On 4/26/22, 11:49 PM, "Ramesh Mani"  wrote:

Dear Ranger Community members,

There are various features and critical bug fixes done in the Apache Ranger
project since the release of Apache Ranger 2.2.0.
Around 55 improvements, 45 bug fixes and a total of 527 commits were made
from the last release.
Now with that Ranger community is expecting a release to adapt those
changes and hence planning this release.

Please review and provide your opinion.

Thanks,
Ramesh

*Improvements:*

RANGER-3687 Password Policy Best Practices for Strong Security
RANGER-3667 Improve feedback in policy creation UI when resource does
not exist
RANGER-3659 Ranger Admin goes to OOM when usersync is trying to delete
existing group mappings from ranger DB
RANGER-3459 Upgrade Ranger's Kafka dependency to 2.8
RANGER-3551 Analyze & optimize module permissions related API
RANGER-3539 Add jacoco-maven-plugin for code coverage
RANGER-3562 Redesign post commit tasks for updating ref-tables when
policy/role is updated
RANGER-3540 Add support to read audit logs from Amazon CloudWatch
RANGER-3030 Replace Findbugs with Spotbugs maven plugin
RANGER-3538 Reduce the granularity of locking when building/retrieving
a policy-engine within Ranger admin service
RANGER-3518 Limit the query size stored in Audit logs
RANGER-3276 Remove duplicate code from buildks.java
RANGER-3515 Enhance Ranger Java client SSL config to be configured
using serviceType and AppId
RANGER-3504 Create framework to execute DB patch dependent on Java
patch.
RANGER-3023 Permission tab takes longer time to load with large number
of users and group_users data
RANGER-3487 Update underscore js with latest version.
RANGER-3548 Update performance engine test scripts
RANGER-3556 Ranger tagsync logs unnecessary messages
RANGER-3573 Add vim in docker base image
RANGER-3578 Simplify code for policy label creation
RANGER-3675 Upgrade tomcat due to intermittent READ TIMEOUT
RANGER-3686 Docker setup to run Ranger with MySQL database
RANGER-3628 Support fine grain authorization for different solr objects
RANGER-3629 RANGER -  Handle solr permissions during upgrade
RANGER-3665 "No Data Found !!" messages in Ranger admin UI alarm users
RANGER-3662 There should be pause button for error popup
RANGER-3660 [Ranger Admin UI] Improvements in tooltip hints for better
user experience
RANGER-3649 Represent the Solr admin object types on the Ranger UI
RANGER-3658 Docker: Ranger containers to run as user=ranger
RANGER-3603 HDFS audit files rollover improvement to trigger rollover
in monitoring thread
RANGER-3651 Remove jersey 1.x version dependency for knox plugin
RANGER-3621 Optimise Tag/Policy iterator
RANGER-3521 Ranger KMS IS NOT ENFORCING HSTS ON SSL PORT DEFINED BY RFC
6797
RANGER-3455 [Logout-Ranger] Should either be disabled/ should redirect
to knox logout page
RANGER-3630 Support wildcards, group short names, and list of memberof
attribute DNs for computing user search filter
RANGER-3597 User role should not be able to modify the Policy
RANGER-3512 Create Java patch to update policy guid to unique value.
RANGER-3511 Create Java patch to update policy resource-signature to
unique value.
RANGER-3493 Add unique index on service and resource_signature column
of x_policy table
RANGER-3435 Add unique index on guid, service and zone_id column of
x_policy table
RANGER-3439 Add rest api to get or delete ranger policy based on guid
RANGER-3498 RANGER : Remove log4j1 dependencies.
RANGER-3475 Promote TagRest endpoints to /public/v2
RANGER-3698 Ranger - Upgrade kylin to 3.1.3
RANGER-3699 Ranger - Upgrade poi to 5.2.1+
RANGER-3533 Provide sorting on columns throughout the audits result set
and policy listing page.
RANGER-3693 Ranger - Upgrade tomcat to 8.5.78
RANGER-3689 Ranger : ranger-2.3 Port missing commits.
RANGER-3620 Ranger - Upgrade tomcat to 8.5.75
RANGER-3577 RANGER : Upgrade POI version to 5.1.0
RANGER-3566 Update version in ranger-2.3 to 2.3.0-SNAPSHOT
RANGER-3553 Unit test coverage for XUserMgr and UserMgr class
RANGER-3653 Replace aws java sdk bom dependencies with bundled
dependencies
RANGER-3561 Upgrade Storm version to 1.2.4
RANGER-3704 remove semicolon from c3P0 preferredTestQuery

*Bug Fixes:*

RANGER-3544 Security zones listing will be in alphabetical order.

Re: Planning for Apache Ranger 2.3.0 release

2022-04-27 Thread Ramesh Mani
Hello Aakash,

RANGER-3182  We shall
include in Apache 2.3.0 release. Let's complete the review and mark it for
2.3 and it should be there.

Thanks,
Ramesh

On Wed, Apr 27, 2022 at 12:22 AM Aakash Nand  wrote:

> Hello Ramesh,
>
> Thank you for the summary of pre-release notes for Ranger-2.3.0.
>
> However, In the previous email, I found out that
>
> RANGER-3182: Prestosql is renamed to Trino
> 
>
> is not included in improvements. Although we are in the process of
> reviewing that issue, will we include it in this release?
>
> Thanks
> Aakash
>
> On Wed, Apr 27, 2022 at 3:49 PM Ramesh Mani  wrote:
>
>> Dear Ranger Community members,
>>
>> There are various features and critical bug fixes done in the Apache
>> Ranger project since the release of Apache Ranger 2.2.0.
>> Around 55 improvements, 45 bug fixes and a total of 527 commits were made
>> from the last release.
>> Now with that Ranger community is expecting a release to adapt those
>> changes and hence planning this release.
>>
>> Please review and provide your opinion.
>>
>> Thanks,
>> Ramesh
>>
>> *Improvements:*
>>
>> RANGER-3687 Password Policy Best Practices for Strong Security
>> RANGER-3667 Improve feedback in policy creation UI when resource does
>> not exist
>> RANGER-3659 Ranger Admin goes to OOM when usersync is trying to
>> delete existing group mappings from ranger DB
>> RANGER-3459 Upgrade Ranger's Kafka dependency to 2.8
>> RANGER-3551 Analyze & optimize module permissions related API
>> RANGER-3539 Add jacoco-maven-plugin for code coverage
>> RANGER-3562 Redesign post commit tasks for updating ref-tables when
>> policy/role is updated
>> RANGER-3540 Add support to read audit logs from Amazon CloudWatch
>> RANGER-3030 Replace Findbugs with Spotbugs maven plugin
>> RANGER-3538 Reduce the granularity of locking when
>> building/retrieving a policy-engine within Ranger admin service
>> RANGER-3518 Limit the query size stored in Audit logs
>> RANGER-3276 Remove duplicate code from buildks.java
>> RANGER-3515 Enhance Ranger Java client SSL config to be configured
>> using serviceType and AppId
>> RANGER-3504 Create framework to execute DB patch dependent on Java
>> patch.
>> RANGER-3023 Permission tab takes longer time to load with large
>> number of users and group_users data
>> RANGER-3487 Update underscore js with latest version.
>> RANGER-3548 Update performance engine test scripts
>> RANGER-3556 Ranger tagsync logs unnecessary messages
>> RANGER-3573 Add vim in docker base image
>> RANGER-3578 Simplify code for policy label creation
>> RANGER-3675 Upgrade tomcat due to intermittent READ TIMEOUT
>> RANGER-3686 Docker setup to run Ranger with MySQL database
>> RANGER-3628 Support fine grain authorization for different solr
>> objects
>> RANGER-3629 RANGER -  Handle solr permissions during upgrade
>> RANGER-3665 "No Data Found !!" messages in Ranger admin UI alarm users
>> RANGER-3662 There should be pause button for error popup
>> RANGER-3660 [Ranger Admin UI] Improvements in tooltip hints for
>> better user experience
>> RANGER-3649 Represent the Solr admin object types on the Ranger UI
>> RANGER-3658 Docker: Ranger containers to run as user=ranger
>> RANGER-3603 HDFS audit files rollover improvement to trigger rollover
>> in monitoring thread
>> RANGER-3651 Remove jersey 1.x version dependency for knox plugin
>> RANGER-3621 Optimise Tag/Policy iterator
>> RANGER-3521 Ranger KMS IS NOT ENFORCING HSTS ON SSL PORT DEFINED BY
>> RFC 6797
>> RANGER-3455 [Logout-Ranger] Should either be disabled/ should
>> redirect to knox logout page
>> RANGER-3630 Support wildcards, group short names, and list of
>> memberof attribute DNs for computing user search filter
>> RANGER-3597 User role should not be able to modify the Policy
>> RANGER-3512 Create Java patch to update policy guid to unique value.
>> RANGER-3511 Create Java patch to update policy resource-signature to
>> unique value.
>> RANGER-3493 Add unique index on service and resource_signature column
>> of x_policy table
>> RANGER-3435 Add unique index on guid, service and zone_id column of
>> x_policy table
>> RANGER-3439 Add rest api to get or delete ranger policy based on guid
>> RANGER-3498 RANGER : Remove log4j1 dependencies.
>> RANGER-3475 Promote TagRest endpoints to /public/v2
>> RANGER-3698 Ranger - Upgrade kylin to 3.1.3
>> RANGER-3699 Ranger - Upgrade poi to 5.2.1+
>> RANGER-3533 Provide sorting on columns throughout the audits result
>> set and policy listing page.
>> RANGER-3693 Ranger - Upgrade tomcat to 8.5.78
>> RANGER-3689 Ranger : ranger-2.3 Port missing commits.
>> RANGER-3620 Ranger - Upgrade tomcat to 8.5.75
>> RANGER-3577 RANGER : Upgrade POI version to 5.1.0
>> RANGER-3566 

Re: Planning for Apache Ranger 2.3.0 release

2022-04-27 Thread Aakash Nand
Hello Ramesh,

Thank you for the summary of pre-release notes for Ranger-2.3.0.

However, In the previous email, I found out that

RANGER-3182: Prestosql is renamed to Trino


is not included in improvements. Although we are in the process of
reviewing that issue, will we include it in this release?

Thanks
Aakash

On Wed, Apr 27, 2022 at 3:49 PM Ramesh Mani  wrote:

> Dear Ranger Community members,
>
> There are various features and critical bug fixes done in the Apache
> Ranger project since the release of Apache Ranger 2.2.0.
> Around 55 improvements, 45 bug fixes and a total of 527 commits were made
> from the last release.
> Now with that Ranger community is expecting a release to adapt those
> changes and hence planning this release.
>
> Please review and provide your opinion.
>
> Thanks,
> Ramesh
>
> *Improvements:*
>
> RANGER-3687 Password Policy Best Practices for Strong Security
> RANGER-3667 Improve feedback in policy creation UI when resource does
> not exist
> RANGER-3659 Ranger Admin goes to OOM when usersync is trying to delete
> existing group mappings from ranger DB
> RANGER-3459 Upgrade Ranger's Kafka dependency to 2.8
> RANGER-3551 Analyze & optimize module permissions related API
> RANGER-3539 Add jacoco-maven-plugin for code coverage
> RANGER-3562 Redesign post commit tasks for updating ref-tables when
> policy/role is updated
> RANGER-3540 Add support to read audit logs from Amazon CloudWatch
> RANGER-3030 Replace Findbugs with Spotbugs maven plugin
> RANGER-3538 Reduce the granularity of locking when building/retrieving
> a policy-engine within Ranger admin service
> RANGER-3518 Limit the query size stored in Audit logs
> RANGER-3276 Remove duplicate code from buildks.java
> RANGER-3515 Enhance Ranger Java client SSL config to be configured
> using serviceType and AppId
> RANGER-3504 Create framework to execute DB patch dependent on Java
> patch.
> RANGER-3023 Permission tab takes longer time to load with large number
> of users and group_users data
> RANGER-3487 Update underscore js with latest version.
> RANGER-3548 Update performance engine test scripts
> RANGER-3556 Ranger tagsync logs unnecessary messages
> RANGER-3573 Add vim in docker base image
> RANGER-3578 Simplify code for policy label creation
> RANGER-3675 Upgrade tomcat due to intermittent READ TIMEOUT
> RANGER-3686 Docker setup to run Ranger with MySQL database
> RANGER-3628 Support fine grain authorization for different solr objects
> RANGER-3629 RANGER -  Handle solr permissions during upgrade
> RANGER-3665 "No Data Found !!" messages in Ranger admin UI alarm users
> RANGER-3662 There should be pause button for error popup
> RANGER-3660 [Ranger Admin UI] Improvements in tooltip hints for better
> user experience
> RANGER-3649 Represent the Solr admin object types on the Ranger UI
> RANGER-3658 Docker: Ranger containers to run as user=ranger
> RANGER-3603 HDFS audit files rollover improvement to trigger rollover
> in monitoring thread
> RANGER-3651 Remove jersey 1.x version dependency for knox plugin
> RANGER-3621 Optimise Tag/Policy iterator
> RANGER-3521 Ranger KMS IS NOT ENFORCING HSTS ON SSL PORT DEFINED BY
> RFC 6797
> RANGER-3455 [Logout-Ranger] Should either be disabled/ should redirect
> to knox logout page
> RANGER-3630 Support wildcards, group short names, and list of memberof
> attribute DNs for computing user search filter
> RANGER-3597 User role should not be able to modify the Policy
> RANGER-3512 Create Java patch to update policy guid to unique value.
> RANGER-3511 Create Java patch to update policy resource-signature to
> unique value.
> RANGER-3493 Add unique index on service and resource_signature column
> of x_policy table
> RANGER-3435 Add unique index on guid, service and zone_id column of
> x_policy table
> RANGER-3439 Add rest api to get or delete ranger policy based on guid
> RANGER-3498 RANGER : Remove log4j1 dependencies.
> RANGER-3475 Promote TagRest endpoints to /public/v2
> RANGER-3698 Ranger - Upgrade kylin to 3.1.3
> RANGER-3699 Ranger - Upgrade poi to 5.2.1+
> RANGER-3533 Provide sorting on columns throughout the audits result
> set and policy listing page.
> RANGER-3693 Ranger - Upgrade tomcat to 8.5.78
> RANGER-3689 Ranger : ranger-2.3 Port missing commits.
> RANGER-3620 Ranger - Upgrade tomcat to 8.5.75
> RANGER-3577 RANGER : Upgrade POI version to 5.1.0
> RANGER-3566 Update version in ranger-2.3 to 2.3.0-SNAPSHOT
> RANGER-3553 Unit test coverage for XUserMgr and UserMgr class
> RANGER-3653 Replace aws java sdk bom dependencies with bundled
> dependencies
> RANGER-3561 Upgrade Storm version to 1.2.4
> RANGER-3704 remove semicolon from c3P0 preferredTestQuery
>
> *Bug Fixes:*
>
> RANGER-3544 Security zones