Re: Planning for Apache Ranger 2.4.0 release

2023-03-07 Thread sneet...@apache.org
Rangers:

As we are planning to get this release out, please have all of your fixes (for 
2.4.0 release) checked-in by Mar-15 and will do the first release candidate by 
March-15.

Thanks,
Selva-

> On Jan 31, 2023, at 10:55 AM, Selvamohan Neethiraj  
> wrote:
> 
> 
> Dear Ranger Community members,  There are various features and critical bug 
> fixes done in the Apache Ranger project since the release of Apache Ranger 
> 2.3.0. Around 3 New Features, 34 improvements and 60 bug fixes were made from 
> the last release. Now with that Ranger community is expecting a release to 
> adapt those changes and hence planning this release.  Please review and 
> provide your opinion.
> 
> Thanks, Selva- 
> 
> Improvements & New Features addressed in 2.4.0 
> 
> Improvement,RANGER-2928,[Ranger Zone REST API] Resources data is missing in 
> XML format Improvement,RANGER-3165,Upgrade Elasticsearch version in Ranger to 
> Elasticsearch 7.10.2 Improvement,RANGER-3534,Review of RangerHiveAuditHandler 
> Improvement,RANGER-3623,Add ability to enable anonymous download of 
> policy/role/tag Improvement,RANGER-3633,Remove eclipse .project file from git 
> Improvement,RANGER-3664,Ranger KMS : Add refresh functionality on kms key 
> listing page. Improvement,RANGER-3763,The max limit of the requested entities 
> is not configurable in tagsync Improvement,RANGER-3767,Add text message in 
> HDFS and YARN policy pages to highlight the fallback ACL option 
> Improvement,RANGER-3787,Non-daemon threads started by 
> ElasticSearchAuditDestination cause Spark application hanging 
> Improvement,RANGER-3794,Improve performance of delete users/groups utility 
> Improvement,RANGER-3796,Enhancement to support multiple resource sets in a 
> policy Improvement,RANGER-3818,Upgrade Solr to 8.11.2 
> Improvement,RANGER-3822,RangerService outputs password information in 
> plaintext Improvement,RANGER-3837,"Allow Ranger non-admins to get, create, 
> edit and delete roles" Improvement,RANGER-3856,Ranger admin client option to 
> work with non-kerberized server Improvement,RANGER-3865,support for using 
> user attributes in masking expressions Improvement,RANGER-3900,"Roles 
> deletion Takes time in Apache Ranger when there are more users,groups,roles" 
> Improvement,RANGER-3902,dbLoadTime is not added correctly in 
> RangerServicePoliciesCache Improvement,RANGER-3910,API Documentation is 
> broken for knox sso Improvement,RANGER-3934,improve tag cache handling to 
> reduce resource usage Improvement,RANGER-3940,"Add javascript includes(), 
> intersects() polyfills for array prototype to RangerCommonConstants" 
> Improvement,RANGER-3948,update serialization to skip empty values 
> Improvement,RANGER-3951,optimize memory used for tags in plugins and server 
> Improvement,RANGER-3955,optimization to reduce duplicate strings 
> Improvement,RANGER-3973,LDAP incremental search not always available 
> Improvement,RANGER-3978,Docker setup to run Ranger KMS  
> Improvement,RANGER-3982,Python client for Ranger KMS REST APIs 
> Improvement,RANGER-3983,Support getColumnMasks and getRowFilters in Trino SPI 
> 376+ Improvement,RANGER-3985,Trino plugin: Check table name when creating 
> tables Improvement,RANGER-3986,Upgrade trino guice dependency to 5.1.0 
> Improvement,RANGER-3988,Trino plugin should differntiate between views and 
> tables Improvement,RANGER-3997,option to use default value when 
> user/group/tag does not have the attribute Improvement,RANGER-4004,"During 
> the service deletion also, we can clear the in-memory cache for that service 
> which got deleted on the ranger side" Improvement,RANGER-4011,option to 
> disable creation of default policies per hierarchy New 
> Feature,RANGER-3852,Performance and scalability analyzer tool for Ranger New 
> Feature,RANGER-3855,RangerExternalUserStoreRetriever class New 
> Feature,RANGER-4028,Ranger - Upgrade bootbox.js.
> 
> BUGS addressed in 2.4.0 
> 
> Bug,RANGER-2737,Ranger REST API returns different infomation when GET user by 
> id and by name Bug,RANGER-3080,"A service administrator should be allowed to 
> set ""excludes"" flag for a policy resource" Bug,RANGER-3108,NPE in 
> RangerPolicyRepository.init Bug,RANGER-3387,Ranger Admin Header Validation. 
> Bug,RANGER-3394,Too much `varchar(4000)` causes table to exceed ROW SIZE 
> limit in MySQL Bug,RANGER-3500,Ranger policy list doesn't support sorting by 
> field Bug,RANGER-3670,Policy update creates unnecessary entries in 
> transaction log table Bug,RANGER-3680,mysql ErrorCode:1118 when Importing DB 
> schema to database Bug,RANGER-3719,Can not create mysql table with charset 
> utf8mb4. Bug,RANGER-3775,Logback.xml has been incorrectly modified by 
> RANGER-3704. Bug,RANGER-3789,Upgrade Handlebars version to 4.7.7 
> Bug,RANGER-3790,Ranger tagsync module should not depend on kafka server 
> Bug,RANGER-3798,"Ranger API Resource Metrics REST ""Up time of JVM"" does not 
> update." Bug,RANGER-3806,Group's users mapping entry failing whenever 

Re: Planning for Apache Ranger 2.4.0 release

2023-02-12 Thread rajeshb...@apache.org
Thanks Ramesh.

Thanks,
Rajeshbabu.

On Mon, Feb 13, 2023, 11:16 AM Ramesh Mani  wrote:

> Hi Rajesh,
>
> Thanks for reaching out on
> https://issues.apache.org/jira/browse/RANGER-4029
> Currently we are reviewing / testing  this patch and should update on this.
>
> Thanks,
> Ramesh
>
> On Sun, Feb 12, 2023 at 9:16 PM rajeshb...@apache.org <
> chrajeshbab...@gmail.com> wrote:
>
> > Hi Team,
> >
> >
> > I would like to include
> https://issues.apache.org/jira/browse/RANGER-4029
> > as part of 2.4.0 release. I have uploaded patch at review board as well
> > after testing the changes in cluster.
> >
> > https://reviews.apache.org/r/74299/
> >
> > Without the changes the HBase plugin with 2.5.x versions cannot be used.
> > Which is a blocker.
> >
> > Thanks,
> > Rajeshbabu.
> >
> > On Wed, Feb 8, 2023, 12:46 PM Nixon Rodrigues 
> > wrote:
> >
> > > +1 for Ranger 2.4.0 release.
> > > Thanks Selva for initiating release process
> > >
> > > Regards
> > > Nixon
> > >
> > > On Wed, 8 Feb 2023 at 07:09, Sailaja Polavarapu
> > >  wrote:
> > >
> > > > +1 for Apache Ranger 2.4.0 release.
> > > > Thanks Selva for initiating this.
> > > >
> > > > - Sailaja
> > > >
> > > > On Sat, Feb 4, 2023 at 2:42 PM Ramesh Mani  wrote:
> > > >
> > > > > +1 for Apache Ranger 2.4.0 release activities.
> > > > >
> > > > > Thanks
> > > > > Ramesh
> > > > >
> > > > > On Tue, Jan 31, 2023 at 7:56 AM Selvamohan Neethiraj <
> > > > sneet...@apache.org>
> > > > > wrote:
> > > > >
> > > > > > Dear Ranger Community members, There are various features and
> > > critical
> > > > > > bug fixes done in the Apache Ranger project since the release of
> > > Apache
> > > > > > Ranger 2.3.0. Around 3 New Features, 34 improvements and 60 bug
> > fixes
> > > > > > were made from the last release. Now with that Ranger community
> is
> > > > > > expecting a release to adapt those changes and hence planning
> this
> > > > > > release. Please review and provide your opinion.
> > > > > >
> > > > > > Thanks, Selva-
> > > > > >
> > > > > > _*Improvements & New Features addressed in 2.4.0*_
> > > > > >
> > > > > > Improvement,RANGER-2928,[Ranger Zone REST API] Resources data is
> > > > missing
> > > > > > in XML format Improvement,RANGER-3165,Upgrade Elasticsearch
> version
> > > in
> > > > > > Ranger to Elasticsearch 7.10.2 Improvement,RANGER-3534,Review of
> > > > > > RangerHiveAuditHandler Improvement,RANGER-3623,Add ability to
> > enable
> > > > > > anonymous download of policy/role/tag
> > Improvement,RANGER-3633,Remove
> > > > > > eclipse .project file from git Improvement,RANGER-3664,Ranger
> KMS :
> > > Add
> > > > > > refresh functionality on kms key listing page.
> > > > > > Improvement,RANGER-3763,The max limit of the requested entities
> is
> > > not
> > > > > > configurable in tagsync Improvement,RANGER-3767,Add text message
> in
> > > > HDFS
> > > > > > and YARN policy pages to highlight the fallback ACL option
> > > > > > Improvement,RANGER-3787,Non-daemon threads started by
> > > > > > ElasticSearchAuditDestination cause Spark application hanging
> > > > > > Improvement,RANGER-3794,Improve performance of delete
> users/groups
> > > > > > utility Improvement,RANGER-3796,Enhancement to support multiple
> > > > resource
> > > > > > sets in a policy Improvement,RANGER-3818,Upgrade Solr to 8.11.2
> > > > > > Improvement,RANGER-3822,RangerService outputs password
> information
> > in
> > > > > > plaintext Improvement,RANGER-3837,"Allow Ranger non-admins to
> get,
> > > > > > create, edit and delete roles" Improvement,RANGER-3856,Ranger
> admin
> > > > > > client option to work with non-kerberized server
> > > > > > Improvement,RANGER-3865,support for using user attributes in
> > masking
> > > > > > expressions Improvement,RANGER-3900,"Roles deletion Takes time in
> > > > Apache
> > > > > > Ranger when there are more users,groups,roles"
> > > > > > Improvement,RANGER-3902,dbLoadTime is not added correctly in
> > > > > > RangerServicePoliciesCache Improvement,RANGER-3910,API
> > Documentation
> > > is
> > > > > > broken for knox sso Improvement,RANGER-3934,improve tag cache
> > > handling
> > > > > > to reduce resource usage Improvement,RANGER-3940,"Add javascript
> > > > > > includes(), intersects() polyfills for array prototype to
> > > > > > RangerCommonConstants" Improvement,RANGER-3948,update
> serialization
> > > to
> > > > > > skip empty values Improvement,RANGER-3951,optimize memory used
> for
> > > tags
> > > > > > in plugins and server Improvement,RANGER-3955,optimization to
> > reduce
> > > > > > duplicate strings Improvement,RANGER-3973,LDAP incremental search
> > not
> > > > > > always available Improvement,RANGER-3978,Docker setup to run
> Ranger
> > > KMS
> > > > > > Improvement,RANGER-3982,Python client for Ranger KMS REST APIs
> > > > > > Improvement,RANGER-3983,Support getColumnMasks and getRowFilters
> in
> > > > > > Trino SPI 376+ Improvement,RANGER-3985,Trino plugin: Check table
> > name
> > > > > > when creating tables 

Re: Planning for Apache Ranger 2.4.0 release

2023-02-12 Thread Ramesh Mani
Hi Rajesh,

Thanks for reaching out on https://issues.apache.org/jira/browse/RANGER-4029
Currently we are reviewing / testing  this patch and should update on this.

Thanks,
Ramesh

On Sun, Feb 12, 2023 at 9:16 PM rajeshb...@apache.org <
chrajeshbab...@gmail.com> wrote:

> Hi Team,
>
>
> I would like to include https://issues.apache.org/jira/browse/RANGER-4029
> as part of 2.4.0 release. I have uploaded patch at review board as well
> after testing the changes in cluster.
>
> https://reviews.apache.org/r/74299/
>
> Without the changes the HBase plugin with 2.5.x versions cannot be used.
> Which is a blocker.
>
> Thanks,
> Rajeshbabu.
>
> On Wed, Feb 8, 2023, 12:46 PM Nixon Rodrigues 
> wrote:
>
> > +1 for Ranger 2.4.0 release.
> > Thanks Selva for initiating release process
> >
> > Regards
> > Nixon
> >
> > On Wed, 8 Feb 2023 at 07:09, Sailaja Polavarapu
> >  wrote:
> >
> > > +1 for Apache Ranger 2.4.0 release.
> > > Thanks Selva for initiating this.
> > >
> > > - Sailaja
> > >
> > > On Sat, Feb 4, 2023 at 2:42 PM Ramesh Mani  wrote:
> > >
> > > > +1 for Apache Ranger 2.4.0 release activities.
> > > >
> > > > Thanks
> > > > Ramesh
> > > >
> > > > On Tue, Jan 31, 2023 at 7:56 AM Selvamohan Neethiraj <
> > > sneet...@apache.org>
> > > > wrote:
> > > >
> > > > > Dear Ranger Community members, There are various features and
> > critical
> > > > > bug fixes done in the Apache Ranger project since the release of
> > Apache
> > > > > Ranger 2.3.0. Around 3 New Features, 34 improvements and 60 bug
> fixes
> > > > > were made from the last release. Now with that Ranger community is
> > > > > expecting a release to adapt those changes and hence planning this
> > > > > release. Please review and provide your opinion.
> > > > >
> > > > > Thanks, Selva-
> > > > >
> > > > > _*Improvements & New Features addressed in 2.4.0*_
> > > > >
> > > > > Improvement,RANGER-2928,[Ranger Zone REST API] Resources data is
> > > missing
> > > > > in XML format Improvement,RANGER-3165,Upgrade Elasticsearch version
> > in
> > > > > Ranger to Elasticsearch 7.10.2 Improvement,RANGER-3534,Review of
> > > > > RangerHiveAuditHandler Improvement,RANGER-3623,Add ability to
> enable
> > > > > anonymous download of policy/role/tag
> Improvement,RANGER-3633,Remove
> > > > > eclipse .project file from git Improvement,RANGER-3664,Ranger KMS :
> > Add
> > > > > refresh functionality on kms key listing page.
> > > > > Improvement,RANGER-3763,The max limit of the requested entities is
> > not
> > > > > configurable in tagsync Improvement,RANGER-3767,Add text message in
> > > HDFS
> > > > > and YARN policy pages to highlight the fallback ACL option
> > > > > Improvement,RANGER-3787,Non-daemon threads started by
> > > > > ElasticSearchAuditDestination cause Spark application hanging
> > > > > Improvement,RANGER-3794,Improve performance of delete users/groups
> > > > > utility Improvement,RANGER-3796,Enhancement to support multiple
> > > resource
> > > > > sets in a policy Improvement,RANGER-3818,Upgrade Solr to 8.11.2
> > > > > Improvement,RANGER-3822,RangerService outputs password information
> in
> > > > > plaintext Improvement,RANGER-3837,"Allow Ranger non-admins to get,
> > > > > create, edit and delete roles" Improvement,RANGER-3856,Ranger admin
> > > > > client option to work with non-kerberized server
> > > > > Improvement,RANGER-3865,support for using user attributes in
> masking
> > > > > expressions Improvement,RANGER-3900,"Roles deletion Takes time in
> > > Apache
> > > > > Ranger when there are more users,groups,roles"
> > > > > Improvement,RANGER-3902,dbLoadTime is not added correctly in
> > > > > RangerServicePoliciesCache Improvement,RANGER-3910,API
> Documentation
> > is
> > > > > broken for knox sso Improvement,RANGER-3934,improve tag cache
> > handling
> > > > > to reduce resource usage Improvement,RANGER-3940,"Add javascript
> > > > > includes(), intersects() polyfills for array prototype to
> > > > > RangerCommonConstants" Improvement,RANGER-3948,update serialization
> > to
> > > > > skip empty values Improvement,RANGER-3951,optimize memory used for
> > tags
> > > > > in plugins and server Improvement,RANGER-3955,optimization to
> reduce
> > > > > duplicate strings Improvement,RANGER-3973,LDAP incremental search
> not
> > > > > always available Improvement,RANGER-3978,Docker setup to run Ranger
> > KMS
> > > > > Improvement,RANGER-3982,Python client for Ranger KMS REST APIs
> > > > > Improvement,RANGER-3983,Support getColumnMasks and getRowFilters in
> > > > > Trino SPI 376+ Improvement,RANGER-3985,Trino plugin: Check table
> name
> > > > > when creating tables Improvement,RANGER-3986,Upgrade trino guice
> > > > > dependency to 5.1.0 Improvement,RANGER-3988,Trino plugin should
> > > > > differntiate between views and tables
> Improvement,RANGER-3997,option
> > to
> > > > > use default value when user/group/tag does not have the attribute
> > > > > Improvement,RANGER-4004,"During the service deletion also, we can
> > clear
> > > > > 

Re: Planning for Apache Ranger 2.4.0 release

2023-02-12 Thread rajeshb...@apache.org
Hi Team,


I would like to include https://issues.apache.org/jira/browse/RANGER-4029
as part of 2.4.0 release. I have uploaded patch at review board as well
after testing the changes in cluster.

https://reviews.apache.org/r/74299/

Without the changes the HBase plugin with 2.5.x versions cannot be used.
Which is a blocker.

Thanks,
Rajeshbabu.

On Wed, Feb 8, 2023, 12:46 PM Nixon Rodrigues 
wrote:

> +1 for Ranger 2.4.0 release.
> Thanks Selva for initiating release process
>
> Regards
> Nixon
>
> On Wed, 8 Feb 2023 at 07:09, Sailaja Polavarapu
>  wrote:
>
> > +1 for Apache Ranger 2.4.0 release.
> > Thanks Selva for initiating this.
> >
> > - Sailaja
> >
> > On Sat, Feb 4, 2023 at 2:42 PM Ramesh Mani  wrote:
> >
> > > +1 for Apache Ranger 2.4.0 release activities.
> > >
> > > Thanks
> > > Ramesh
> > >
> > > On Tue, Jan 31, 2023 at 7:56 AM Selvamohan Neethiraj <
> > sneet...@apache.org>
> > > wrote:
> > >
> > > > Dear Ranger Community members, There are various features and
> critical
> > > > bug fixes done in the Apache Ranger project since the release of
> Apache
> > > > Ranger 2.3.0. Around 3 New Features, 34 improvements and 60 bug fixes
> > > > were made from the last release. Now with that Ranger community is
> > > > expecting a release to adapt those changes and hence planning this
> > > > release. Please review and provide your opinion.
> > > >
> > > > Thanks, Selva-
> > > >
> > > > _*Improvements & New Features addressed in 2.4.0*_
> > > >
> > > > Improvement,RANGER-2928,[Ranger Zone REST API] Resources data is
> > missing
> > > > in XML format Improvement,RANGER-3165,Upgrade Elasticsearch version
> in
> > > > Ranger to Elasticsearch 7.10.2 Improvement,RANGER-3534,Review of
> > > > RangerHiveAuditHandler Improvement,RANGER-3623,Add ability to enable
> > > > anonymous download of policy/role/tag Improvement,RANGER-3633,Remove
> > > > eclipse .project file from git Improvement,RANGER-3664,Ranger KMS :
> Add
> > > > refresh functionality on kms key listing page.
> > > > Improvement,RANGER-3763,The max limit of the requested entities is
> not
> > > > configurable in tagsync Improvement,RANGER-3767,Add text message in
> > HDFS
> > > > and YARN policy pages to highlight the fallback ACL option
> > > > Improvement,RANGER-3787,Non-daemon threads started by
> > > > ElasticSearchAuditDestination cause Spark application hanging
> > > > Improvement,RANGER-3794,Improve performance of delete users/groups
> > > > utility Improvement,RANGER-3796,Enhancement to support multiple
> > resource
> > > > sets in a policy Improvement,RANGER-3818,Upgrade Solr to 8.11.2
> > > > Improvement,RANGER-3822,RangerService outputs password information in
> > > > plaintext Improvement,RANGER-3837,"Allow Ranger non-admins to get,
> > > > create, edit and delete roles" Improvement,RANGER-3856,Ranger admin
> > > > client option to work with non-kerberized server
> > > > Improvement,RANGER-3865,support for using user attributes in masking
> > > > expressions Improvement,RANGER-3900,"Roles deletion Takes time in
> > Apache
> > > > Ranger when there are more users,groups,roles"
> > > > Improvement,RANGER-3902,dbLoadTime is not added correctly in
> > > > RangerServicePoliciesCache Improvement,RANGER-3910,API Documentation
> is
> > > > broken for knox sso Improvement,RANGER-3934,improve tag cache
> handling
> > > > to reduce resource usage Improvement,RANGER-3940,"Add javascript
> > > > includes(), intersects() polyfills for array prototype to
> > > > RangerCommonConstants" Improvement,RANGER-3948,update serialization
> to
> > > > skip empty values Improvement,RANGER-3951,optimize memory used for
> tags
> > > > in plugins and server Improvement,RANGER-3955,optimization to reduce
> > > > duplicate strings Improvement,RANGER-3973,LDAP incremental search not
> > > > always available Improvement,RANGER-3978,Docker setup to run Ranger
> KMS
> > > > Improvement,RANGER-3982,Python client for Ranger KMS REST APIs
> > > > Improvement,RANGER-3983,Support getColumnMasks and getRowFilters in
> > > > Trino SPI 376+ Improvement,RANGER-3985,Trino plugin: Check table name
> > > > when creating tables Improvement,RANGER-3986,Upgrade trino guice
> > > > dependency to 5.1.0 Improvement,RANGER-3988,Trino plugin should
> > > > differntiate between views and tables Improvement,RANGER-3997,option
> to
> > > > use default value when user/group/tag does not have the attribute
> > > > Improvement,RANGER-4004,"During the service deletion also, we can
> clear
> > > > the in-memory cache for that service which got deleted on the ranger
> > > > side" Improvement,RANGER-4011,option to disable creation of default
> > > > policies per hierarchy New Feature,RANGER-3852,Performance and
> > > > scalability analyzer tool for Ranger New
> > > > Feature,RANGER-3855,RangerExternalUserStoreRetriever class New
> > > > Feature,RANGER-4028,Ranger - Upgrade bootbox.js.
> > > >
> > > > _*BUGS addressed in 2.4.0*_
> > > >
> > > > Bug,RANGER-2737,Ranger REST API returns different 

Re: Planning for Apache Ranger 2.4.0 release

2023-02-07 Thread Nixon Rodrigues
+1 for Ranger 2.4.0 release.
Thanks Selva for initiating release process

Regards
Nixon

On Wed, 8 Feb 2023 at 07:09, Sailaja Polavarapu
 wrote:

> +1 for Apache Ranger 2.4.0 release.
> Thanks Selva for initiating this.
>
> - Sailaja
>
> On Sat, Feb 4, 2023 at 2:42 PM Ramesh Mani  wrote:
>
> > +1 for Apache Ranger 2.4.0 release activities.
> >
> > Thanks
> > Ramesh
> >
> > On Tue, Jan 31, 2023 at 7:56 AM Selvamohan Neethiraj <
> sneet...@apache.org>
> > wrote:
> >
> > > Dear Ranger Community members, There are various features and critical
> > > bug fixes done in the Apache Ranger project since the release of Apache
> > > Ranger 2.3.0. Around 3 New Features, 34 improvements and 60 bug fixes
> > > were made from the last release. Now with that Ranger community is
> > > expecting a release to adapt those changes and hence planning this
> > > release. Please review and provide your opinion.
> > >
> > > Thanks, Selva-
> > >
> > > _*Improvements & New Features addressed in 2.4.0*_
> > >
> > > Improvement,RANGER-2928,[Ranger Zone REST API] Resources data is
> missing
> > > in XML format Improvement,RANGER-3165,Upgrade Elasticsearch version in
> > > Ranger to Elasticsearch 7.10.2 Improvement,RANGER-3534,Review of
> > > RangerHiveAuditHandler Improvement,RANGER-3623,Add ability to enable
> > > anonymous download of policy/role/tag Improvement,RANGER-3633,Remove
> > > eclipse .project file from git Improvement,RANGER-3664,Ranger KMS : Add
> > > refresh functionality on kms key listing page.
> > > Improvement,RANGER-3763,The max limit of the requested entities is not
> > > configurable in tagsync Improvement,RANGER-3767,Add text message in
> HDFS
> > > and YARN policy pages to highlight the fallback ACL option
> > > Improvement,RANGER-3787,Non-daemon threads started by
> > > ElasticSearchAuditDestination cause Spark application hanging
> > > Improvement,RANGER-3794,Improve performance of delete users/groups
> > > utility Improvement,RANGER-3796,Enhancement to support multiple
> resource
> > > sets in a policy Improvement,RANGER-3818,Upgrade Solr to 8.11.2
> > > Improvement,RANGER-3822,RangerService outputs password information in
> > > plaintext Improvement,RANGER-3837,"Allow Ranger non-admins to get,
> > > create, edit and delete roles" Improvement,RANGER-3856,Ranger admin
> > > client option to work with non-kerberized server
> > > Improvement,RANGER-3865,support for using user attributes in masking
> > > expressions Improvement,RANGER-3900,"Roles deletion Takes time in
> Apache
> > > Ranger when there are more users,groups,roles"
> > > Improvement,RANGER-3902,dbLoadTime is not added correctly in
> > > RangerServicePoliciesCache Improvement,RANGER-3910,API Documentation is
> > > broken for knox sso Improvement,RANGER-3934,improve tag cache handling
> > > to reduce resource usage Improvement,RANGER-3940,"Add javascript
> > > includes(), intersects() polyfills for array prototype to
> > > RangerCommonConstants" Improvement,RANGER-3948,update serialization to
> > > skip empty values Improvement,RANGER-3951,optimize memory used for tags
> > > in plugins and server Improvement,RANGER-3955,optimization to reduce
> > > duplicate strings Improvement,RANGER-3973,LDAP incremental search not
> > > always available Improvement,RANGER-3978,Docker setup to run Ranger KMS
> > > Improvement,RANGER-3982,Python client for Ranger KMS REST APIs
> > > Improvement,RANGER-3983,Support getColumnMasks and getRowFilters in
> > > Trino SPI 376+ Improvement,RANGER-3985,Trino plugin: Check table name
> > > when creating tables Improvement,RANGER-3986,Upgrade trino guice
> > > dependency to 5.1.0 Improvement,RANGER-3988,Trino plugin should
> > > differntiate between views and tables Improvement,RANGER-3997,option to
> > > use default value when user/group/tag does not have the attribute
> > > Improvement,RANGER-4004,"During the service deletion also, we can clear
> > > the in-memory cache for that service which got deleted on the ranger
> > > side" Improvement,RANGER-4011,option to disable creation of default
> > > policies per hierarchy New Feature,RANGER-3852,Performance and
> > > scalability analyzer tool for Ranger New
> > > Feature,RANGER-3855,RangerExternalUserStoreRetriever class New
> > > Feature,RANGER-4028,Ranger - Upgrade bootbox.js.
> > >
> > > _*BUGS addressed in 2.4.0*_
> > >
> > > Bug,RANGER-2737,Ranger REST API returns different infomation when GET
> > > user by id and by name Bug,RANGER-3080,"A service administrator should
> > > be allowed to set ""excludes"" flag for a policy resource"
> > > Bug,RANGER-3108,NPE in RangerPolicyRepository.init
> > > Bug,RANGER-3387,Ranger Admin Header Validation. Bug,RANGER-3394,Too
> much
> > > `varchar(4000)` causes table to exceed ROW SIZE limit in MySQL
> > > Bug,RANGER-3500,Ranger policy list doesn't support sorting by field
> > > Bug,RANGER-3670,Policy update creates unnecessary entries in
> transaction
> > > log table Bug,RANGER-3680,mysql ErrorCode:1118 when Importing DB schema
> > > 

Re: Planning for Apache Ranger 2.4.0 release

2023-02-07 Thread Sailaja Polavarapu
+1 for Apache Ranger 2.4.0 release.
Thanks Selva for initiating this.

- Sailaja

On Sat, Feb 4, 2023 at 2:42 PM Ramesh Mani  wrote:

> +1 for Apache Ranger 2.4.0 release activities.
>
> Thanks
> Ramesh
>
> On Tue, Jan 31, 2023 at 7:56 AM Selvamohan Neethiraj 
> wrote:
>
> > Dear Ranger Community members, There are various features and critical
> > bug fixes done in the Apache Ranger project since the release of Apache
> > Ranger 2.3.0. Around 3 New Features, 34 improvements and 60 bug fixes
> > were made from the last release. Now with that Ranger community is
> > expecting a release to adapt those changes and hence planning this
> > release. Please review and provide your opinion.
> >
> > Thanks, Selva-
> >
> > _*Improvements & New Features addressed in 2.4.0*_
> >
> > Improvement,RANGER-2928,[Ranger Zone REST API] Resources data is missing
> > in XML format Improvement,RANGER-3165,Upgrade Elasticsearch version in
> > Ranger to Elasticsearch 7.10.2 Improvement,RANGER-3534,Review of
> > RangerHiveAuditHandler Improvement,RANGER-3623,Add ability to enable
> > anonymous download of policy/role/tag Improvement,RANGER-3633,Remove
> > eclipse .project file from git Improvement,RANGER-3664,Ranger KMS : Add
> > refresh functionality on kms key listing page.
> > Improvement,RANGER-3763,The max limit of the requested entities is not
> > configurable in tagsync Improvement,RANGER-3767,Add text message in HDFS
> > and YARN policy pages to highlight the fallback ACL option
> > Improvement,RANGER-3787,Non-daemon threads started by
> > ElasticSearchAuditDestination cause Spark application hanging
> > Improvement,RANGER-3794,Improve performance of delete users/groups
> > utility Improvement,RANGER-3796,Enhancement to support multiple resource
> > sets in a policy Improvement,RANGER-3818,Upgrade Solr to 8.11.2
> > Improvement,RANGER-3822,RangerService outputs password information in
> > plaintext Improvement,RANGER-3837,"Allow Ranger non-admins to get,
> > create, edit and delete roles" Improvement,RANGER-3856,Ranger admin
> > client option to work with non-kerberized server
> > Improvement,RANGER-3865,support for using user attributes in masking
> > expressions Improvement,RANGER-3900,"Roles deletion Takes time in Apache
> > Ranger when there are more users,groups,roles"
> > Improvement,RANGER-3902,dbLoadTime is not added correctly in
> > RangerServicePoliciesCache Improvement,RANGER-3910,API Documentation is
> > broken for knox sso Improvement,RANGER-3934,improve tag cache handling
> > to reduce resource usage Improvement,RANGER-3940,"Add javascript
> > includes(), intersects() polyfills for array prototype to
> > RangerCommonConstants" Improvement,RANGER-3948,update serialization to
> > skip empty values Improvement,RANGER-3951,optimize memory used for tags
> > in plugins and server Improvement,RANGER-3955,optimization to reduce
> > duplicate strings Improvement,RANGER-3973,LDAP incremental search not
> > always available Improvement,RANGER-3978,Docker setup to run Ranger KMS
> > Improvement,RANGER-3982,Python client for Ranger KMS REST APIs
> > Improvement,RANGER-3983,Support getColumnMasks and getRowFilters in
> > Trino SPI 376+ Improvement,RANGER-3985,Trino plugin: Check table name
> > when creating tables Improvement,RANGER-3986,Upgrade trino guice
> > dependency to 5.1.0 Improvement,RANGER-3988,Trino plugin should
> > differntiate between views and tables Improvement,RANGER-3997,option to
> > use default value when user/group/tag does not have the attribute
> > Improvement,RANGER-4004,"During the service deletion also, we can clear
> > the in-memory cache for that service which got deleted on the ranger
> > side" Improvement,RANGER-4011,option to disable creation of default
> > policies per hierarchy New Feature,RANGER-3852,Performance and
> > scalability analyzer tool for Ranger New
> > Feature,RANGER-3855,RangerExternalUserStoreRetriever class New
> > Feature,RANGER-4028,Ranger - Upgrade bootbox.js.
> >
> > _*BUGS addressed in 2.4.0*_
> >
> > Bug,RANGER-2737,Ranger REST API returns different infomation when GET
> > user by id and by name Bug,RANGER-3080,"A service administrator should
> > be allowed to set ""excludes"" flag for a policy resource"
> > Bug,RANGER-3108,NPE in RangerPolicyRepository.init
> > Bug,RANGER-3387,Ranger Admin Header Validation. Bug,RANGER-3394,Too much
> > `varchar(4000)` causes table to exceed ROW SIZE limit in MySQL
> > Bug,RANGER-3500,Ranger policy list doesn't support sorting by field
> > Bug,RANGER-3670,Policy update creates unnecessary entries in transaction
> > log table Bug,RANGER-3680,mysql ErrorCode:1118 when Importing DB schema
> > to database Bug,RANGER-3719,Can not create mysql table with charset
> > utf8mb4. Bug,RANGER-3775,Logback.xml has been incorrectly modified by
> > RANGER-3704. Bug,RANGER-3789,Upgrade Handlebars version to 4.7.7
> > Bug,RANGER-3790,Ranger tagsync module should not depend on kafka server
> > Bug,RANGER-3798,"Ranger API Resource Metrics REST ""Up time 

Re: Planning for Apache Ranger 2.4.0 release

2023-02-04 Thread Ramesh Mani
+1 for Apache Ranger 2.4.0 release activities.

Thanks
Ramesh

On Tue, Jan 31, 2023 at 7:56 AM Selvamohan Neethiraj 
wrote:

> Dear Ranger Community members, There are various features and critical
> bug fixes done in the Apache Ranger project since the release of Apache
> Ranger 2.3.0. Around 3 New Features, 34 improvements and 60 bug fixes
> were made from the last release. Now with that Ranger community is
> expecting a release to adapt those changes and hence planning this
> release. Please review and provide your opinion.
>
> Thanks, Selva-
>
> _*Improvements & New Features addressed in 2.4.0*_
>
> Improvement,RANGER-2928,[Ranger Zone REST API] Resources data is missing
> in XML format Improvement,RANGER-3165,Upgrade Elasticsearch version in
> Ranger to Elasticsearch 7.10.2 Improvement,RANGER-3534,Review of
> RangerHiveAuditHandler Improvement,RANGER-3623,Add ability to enable
> anonymous download of policy/role/tag Improvement,RANGER-3633,Remove
> eclipse .project file from git Improvement,RANGER-3664,Ranger KMS : Add
> refresh functionality on kms key listing page.
> Improvement,RANGER-3763,The max limit of the requested entities is not
> configurable in tagsync Improvement,RANGER-3767,Add text message in HDFS
> and YARN policy pages to highlight the fallback ACL option
> Improvement,RANGER-3787,Non-daemon threads started by
> ElasticSearchAuditDestination cause Spark application hanging
> Improvement,RANGER-3794,Improve performance of delete users/groups
> utility Improvement,RANGER-3796,Enhancement to support multiple resource
> sets in a policy Improvement,RANGER-3818,Upgrade Solr to 8.11.2
> Improvement,RANGER-3822,RangerService outputs password information in
> plaintext Improvement,RANGER-3837,"Allow Ranger non-admins to get,
> create, edit and delete roles" Improvement,RANGER-3856,Ranger admin
> client option to work with non-kerberized server
> Improvement,RANGER-3865,support for using user attributes in masking
> expressions Improvement,RANGER-3900,"Roles deletion Takes time in Apache
> Ranger when there are more users,groups,roles"
> Improvement,RANGER-3902,dbLoadTime is not added correctly in
> RangerServicePoliciesCache Improvement,RANGER-3910,API Documentation is
> broken for knox sso Improvement,RANGER-3934,improve tag cache handling
> to reduce resource usage Improvement,RANGER-3940,"Add javascript
> includes(), intersects() polyfills for array prototype to
> RangerCommonConstants" Improvement,RANGER-3948,update serialization to
> skip empty values Improvement,RANGER-3951,optimize memory used for tags
> in plugins and server Improvement,RANGER-3955,optimization to reduce
> duplicate strings Improvement,RANGER-3973,LDAP incremental search not
> always available Improvement,RANGER-3978,Docker setup to run Ranger KMS
> Improvement,RANGER-3982,Python client for Ranger KMS REST APIs
> Improvement,RANGER-3983,Support getColumnMasks and getRowFilters in
> Trino SPI 376+ Improvement,RANGER-3985,Trino plugin: Check table name
> when creating tables Improvement,RANGER-3986,Upgrade trino guice
> dependency to 5.1.0 Improvement,RANGER-3988,Trino plugin should
> differntiate between views and tables Improvement,RANGER-3997,option to
> use default value when user/group/tag does not have the attribute
> Improvement,RANGER-4004,"During the service deletion also, we can clear
> the in-memory cache for that service which got deleted on the ranger
> side" Improvement,RANGER-4011,option to disable creation of default
> policies per hierarchy New Feature,RANGER-3852,Performance and
> scalability analyzer tool for Ranger New
> Feature,RANGER-3855,RangerExternalUserStoreRetriever class New
> Feature,RANGER-4028,Ranger - Upgrade bootbox.js.
>
> _*BUGS addressed in 2.4.0*_
>
> Bug,RANGER-2737,Ranger REST API returns different infomation when GET
> user by id and by name Bug,RANGER-3080,"A service administrator should
> be allowed to set ""excludes"" flag for a policy resource"
> Bug,RANGER-3108,NPE in RangerPolicyRepository.init
> Bug,RANGER-3387,Ranger Admin Header Validation. Bug,RANGER-3394,Too much
> `varchar(4000)` causes table to exceed ROW SIZE limit in MySQL
> Bug,RANGER-3500,Ranger policy list doesn't support sorting by field
> Bug,RANGER-3670,Policy update creates unnecessary entries in transaction
> log table Bug,RANGER-3680,mysql ErrorCode:1118 when Importing DB schema
> to database Bug,RANGER-3719,Can not create mysql table with charset
> utf8mb4. Bug,RANGER-3775,Logback.xml has been incorrectly modified by
> RANGER-3704. Bug,RANGER-3789,Upgrade Handlebars version to 4.7.7
> Bug,RANGER-3790,Ranger tagsync module should not depend on kafka server
> Bug,RANGER-3798,"Ranger API Resource Metrics REST ""Up time of JVM""
> does not update." Bug,RANGER-3806,Group's users mapping entry failing
> whenever primary key auto-increment is not set to 1 in db
> Bug,RANGER-3807,getUserRoles API gives 200 for non existing user passed
> to this API Bug,RANGER-3813,Fix ConcurrentModificationException in
> 

Re: Planning for Apache Ranger 2.4.0 release

2023-01-31 Thread Madhan Neethiraj
+1 to get started on Apache Ranger 2.4.0 release.

Selva - thanks for initiating this thread. The list of JIRAs doesn't render 
well in the email (see below). Perhaps this can be added in a wiki and include 
the link in email?

Thanks,
Madhan




On 1/31/23, 7:56 AM, "Selvamohan Neethiraj" mailto:sneet...@apache.org>> wrote:


Dear Ranger Community members, There are various features and critical 
bug fixes done in the Apache Ranger project since the release of Apache 
Ranger 2.3.0. Around 3 New Features, 34 improvements and 60 bug fixes 
were made from the last release. Now with that Ranger community is 
expecting a release to adapt those changes and hence planning this 
release. Please review and provide your opinion.


Thanks, Selva-


_*Improvements & New Features addressed in 2.4.0*_


Improvement,RANGER-2928,[Ranger Zone REST API] Resources data is missing 
in XML format Improvement,RANGER-3165,Upgrade Elasticsearch version in 
Ranger to Elasticsearch 7.10.2 Improvement,RANGER-3534,Review of 
RangerHiveAuditHandler Improvement,RANGER-3623,Add ability to enable 
anonymous download of policy/role/tag Improvement,RANGER-3633,Remove 
eclipse .project file from git Improvement,RANGER-3664,Ranger KMS : Add 
refresh functionality on kms key listing page. 
Improvement,RANGER-3763,The max limit of the requested entities is not 
configurable in tagsync Improvement,RANGER-3767,Add text message in HDFS 
and YARN policy pages to highlight the fallback ACL option 
Improvement,RANGER-3787,Non-daemon threads started by 
ElasticSearchAuditDestination cause Spark application hanging 
Improvement,RANGER-3794,Improve performance of delete users/groups 
utility Improvement,RANGER-3796,Enhancement to support multiple resource 
sets in a policy Improvement,RANGER-3818,Upgrade Solr to 8.11.2 
Improvement,RANGER-3822,RangerService outputs password information in 
plaintext Improvement,RANGER-3837,"Allow Ranger non-admins to get, 
create, edit and delete roles" Improvement,RANGER-3856,Ranger admin 
client option to work with non-kerberized server 
Improvement,RANGER-3865,support for using user attributes in masking 
expressions Improvement,RANGER-3900,"Roles deletion Takes time in Apache 
Ranger when there are more users,groups,roles" 
Improvement,RANGER-3902,dbLoadTime is not added correctly in 
RangerServicePoliciesCache Improvement,RANGER-3910,API Documentation is 
broken for knox sso Improvement,RANGER-3934,improve tag cache handling 
to reduce resource usage Improvement,RANGER-3940,"Add javascript 
includes(), intersects() polyfills for array prototype to 
RangerCommonConstants" Improvement,RANGER-3948,update serialization to 
skip empty values Improvement,RANGER-3951,optimize memory used for tags 
in plugins and server Improvement,RANGER-3955,optimization to reduce 
duplicate strings Improvement,RANGER-3973,LDAP incremental search not 
always available Improvement,RANGER-3978,Docker setup to run Ranger KMS 
Improvement,RANGER-3982,Python client for Ranger KMS REST APIs 
Improvement,RANGER-3983,Support getColumnMasks and getRowFilters in 
Trino SPI 376+ Improvement,RANGER-3985,Trino plugin: Check table name 
when creating tables Improvement,RANGER-3986,Upgrade trino guice 
dependency to 5.1.0 Improvement,RANGER-3988,Trino plugin should 
differntiate between views and tables Improvement,RANGER-3997,option to 
use default value when user/group/tag does not have the attribute 
Improvement,RANGER-4004,"During the service deletion also, we can clear 
the in-memory cache for that service which got deleted on the ranger 
side" Improvement,RANGER-4011,option to disable creation of default 
policies per hierarchy New Feature,RANGER-3852,Performance and 
scalability analyzer tool for Ranger New 
Feature,RANGER-3855,RangerExternalUserStoreRetriever class New 
Feature,RANGER-4028,Ranger - Upgrade bootbox.js.


_*BUGS addressed in 2.4.0*_


Bug,RANGER-2737,Ranger REST API returns different infomation when GET 
user by id and by name Bug,RANGER-3080,"A service administrator should 
be allowed to set ""excludes"" flag for a policy resource" 
Bug,RANGER-3108,NPE in RangerPolicyRepository.init 
Bug,RANGER-3387,Ranger Admin Header Validation. Bug,RANGER-3394,Too much 
`varchar(4000)` causes table to exceed ROW SIZE limit in MySQL 
Bug,RANGER-3500,Ranger policy list doesn't support sorting by field 
Bug,RANGER-3670,Policy update creates unnecessary entries in transaction 
log table Bug,RANGER-3680,mysql ErrorCode:1118 when Importing DB schema 
to database Bug,RANGER-3719,Can not create mysql table with charset 
utf8mb4. Bug,RANGER-3775,Logback.xml has been incorrectly modified by 
RANGER-3704. Bug,RANGER-3789,Upgrade Handlebars version to 4.7.7 
Bug,RANGER-3790,Ranger tagsync module should not depend on kafka server 
Bug,RANGER-3798,"Ranger API Resource Metrics REST ""Up time of JVM"" 
does not update." Bug,RANGER-3806,Group's users mapping entry failing 
whenever primary key auto-increment is not set to 1 in db 

Planning for Apache Ranger 2.4.0 release

2023-01-31 Thread Selvamohan Neethiraj
Dear Ranger Community members, There are various features and critical 
bug fixes done in the Apache Ranger project since the release of Apache 
Ranger 2.3.0. Around 3 New Features, 34 improvements and 60 bug fixes 
were made from the last release. Now with that Ranger community is 
expecting a release to adapt those changes and hence planning this 
release. Please review and provide your opinion.


Thanks, Selva-

_*Improvements & New Features addressed in 2.4.0*_

Improvement,RANGER-2928,[Ranger Zone REST API] Resources data is missing 
in XML format Improvement,RANGER-3165,Upgrade Elasticsearch version in 
Ranger to Elasticsearch 7.10.2 Improvement,RANGER-3534,Review of 
RangerHiveAuditHandler Improvement,RANGER-3623,Add ability to enable 
anonymous download of policy/role/tag Improvement,RANGER-3633,Remove 
eclipse .project file from git Improvement,RANGER-3664,Ranger KMS : Add 
refresh functionality on kms key listing page. 
Improvement,RANGER-3763,The max limit of the requested entities is not 
configurable in tagsync Improvement,RANGER-3767,Add text message in HDFS 
and YARN policy pages to highlight the fallback ACL option 
Improvement,RANGER-3787,Non-daemon threads started by 
ElasticSearchAuditDestination cause Spark application hanging 
Improvement,RANGER-3794,Improve performance of delete users/groups 
utility Improvement,RANGER-3796,Enhancement to support multiple resource 
sets in a policy Improvement,RANGER-3818,Upgrade Solr to 8.11.2 
Improvement,RANGER-3822,RangerService outputs password information in 
plaintext Improvement,RANGER-3837,"Allow Ranger non-admins to get, 
create, edit and delete roles" Improvement,RANGER-3856,Ranger admin 
client option to work with non-kerberized server 
Improvement,RANGER-3865,support for using user attributes in masking 
expressions Improvement,RANGER-3900,"Roles deletion Takes time in Apache 
Ranger when there are more users,groups,roles" 
Improvement,RANGER-3902,dbLoadTime is not added correctly in 
RangerServicePoliciesCache Improvement,RANGER-3910,API Documentation is 
broken for knox sso Improvement,RANGER-3934,improve tag cache handling 
to reduce resource usage Improvement,RANGER-3940,"Add javascript 
includes(), intersects() polyfills for array prototype to 
RangerCommonConstants" Improvement,RANGER-3948,update serialization to 
skip empty values Improvement,RANGER-3951,optimize memory used for tags 
in plugins and server Improvement,RANGER-3955,optimization to reduce 
duplicate strings Improvement,RANGER-3973,LDAP incremental search not 
always available Improvement,RANGER-3978,Docker setup to run Ranger KMS 
Improvement,RANGER-3982,Python client for Ranger KMS REST APIs 
Improvement,RANGER-3983,Support getColumnMasks and getRowFilters in 
Trino SPI 376+ Improvement,RANGER-3985,Trino plugin: Check table name 
when creating tables Improvement,RANGER-3986,Upgrade trino guice 
dependency to 5.1.0 Improvement,RANGER-3988,Trino plugin should 
differntiate between views and tables Improvement,RANGER-3997,option to 
use default value when user/group/tag does not have the attribute 
Improvement,RANGER-4004,"During the service deletion also, we can clear 
the in-memory cache for that service which got deleted on the ranger 
side" Improvement,RANGER-4011,option to disable creation of default 
policies per hierarchy New Feature,RANGER-3852,Performance and 
scalability analyzer tool for Ranger New 
Feature,RANGER-3855,RangerExternalUserStoreRetriever class New 
Feature,RANGER-4028,Ranger - Upgrade bootbox.js.


_*BUGS addressed in 2.4.0*_

Bug,RANGER-2737,Ranger REST API returns different infomation when GET 
user by id and by name Bug,RANGER-3080,"A service administrator should 
be allowed to set ""excludes"" flag for a policy resource" 
Bug,RANGER-3108,NPE in RangerPolicyRepository.init 
Bug,RANGER-3387,Ranger Admin Header Validation. Bug,RANGER-3394,Too much 
`varchar(4000)` causes table to exceed ROW SIZE limit in MySQL 
Bug,RANGER-3500,Ranger policy list doesn't support sorting by field 
Bug,RANGER-3670,Policy update creates unnecessary entries in transaction 
log table Bug,RANGER-3680,mysql ErrorCode:1118 when Importing DB schema 
to database Bug,RANGER-3719,Can not create mysql table with charset 
utf8mb4. Bug,RANGER-3775,Logback.xml has been incorrectly modified by 
RANGER-3704. Bug,RANGER-3789,Upgrade Handlebars version to 4.7.7 
Bug,RANGER-3790,Ranger tagsync module should not depend on kafka server 
Bug,RANGER-3798,"Ranger API Resource Metrics REST ""Up time of JVM"" 
does not update." Bug,RANGER-3806,Group's users mapping entry failing 
whenever primary key auto-increment is not set to 1 in db 
Bug,RANGER-3807,getUserRoles API gives 200 for non existing user passed 
to this API Bug,RANGER-3813,Fix ConcurrentModificationException in 
UnixUserGroupBuilder Bug,RANGER-3814,IS_IN_ROLE(roleName) condition 
always returns false Bug,RANGER-3816,update getResourceACLs() API to 
handle macros in resource names Bug,RANGER-3819,Upgrade springframework