Re: Planning for Apache Ranger 2.4.0 release
Rangers: As we are planning to get this release out, please have all of your fixes (for 2.4.0 release) checked-in by Mar-15 and will do the first release candidate by March-15. Thanks, Selva- > On Jan 31, 2023, at 10:55 AM, Selvamohan Neethiraj > wrote: > > > Dear Ranger Community members, There are various features and critical bug > fixes done in the Apache Ranger project since the release of Apache Ranger > 2.3.0. Around 3 New Features, 34 improvements and 60 bug fixes were made from > the last release. Now with that Ranger community is expecting a release to > adapt those changes and hence planning this release. Please review and > provide your opinion. > > Thanks, Selva- > > Improvements & New Features addressed in 2.4.0 > > Improvement,RANGER-2928,[Ranger Zone REST API] Resources data is missing in > XML format Improvement,RANGER-3165,Upgrade Elasticsearch version in Ranger to > Elasticsearch 7.10.2 Improvement,RANGER-3534,Review of RangerHiveAuditHandler > Improvement,RANGER-3623,Add ability to enable anonymous download of > policy/role/tag Improvement,RANGER-3633,Remove eclipse .project file from git > Improvement,RANGER-3664,Ranger KMS : Add refresh functionality on kms key > listing page. Improvement,RANGER-3763,The max limit of the requested entities > is not configurable in tagsync Improvement,RANGER-3767,Add text message in > HDFS and YARN policy pages to highlight the fallback ACL option > Improvement,RANGER-3787,Non-daemon threads started by > ElasticSearchAuditDestination cause Spark application hanging > Improvement,RANGER-3794,Improve performance of delete users/groups utility > Improvement,RANGER-3796,Enhancement to support multiple resource sets in a > policy Improvement,RANGER-3818,Upgrade Solr to 8.11.2 > Improvement,RANGER-3822,RangerService outputs password information in > plaintext Improvement,RANGER-3837,"Allow Ranger non-admins to get, create, > edit and delete roles" Improvement,RANGER-3856,Ranger admin client option to > work with non-kerberized server Improvement,RANGER-3865,support for using > user attributes in masking expressions Improvement,RANGER-3900,"Roles > deletion Takes time in Apache Ranger when there are more users,groups,roles" > Improvement,RANGER-3902,dbLoadTime is not added correctly in > RangerServicePoliciesCache Improvement,RANGER-3910,API Documentation is > broken for knox sso Improvement,RANGER-3934,improve tag cache handling to > reduce resource usage Improvement,RANGER-3940,"Add javascript includes(), > intersects() polyfills for array prototype to RangerCommonConstants" > Improvement,RANGER-3948,update serialization to skip empty values > Improvement,RANGER-3951,optimize memory used for tags in plugins and server > Improvement,RANGER-3955,optimization to reduce duplicate strings > Improvement,RANGER-3973,LDAP incremental search not always available > Improvement,RANGER-3978,Docker setup to run Ranger KMS > Improvement,RANGER-3982,Python client for Ranger KMS REST APIs > Improvement,RANGER-3983,Support getColumnMasks and getRowFilters in Trino SPI > 376+ Improvement,RANGER-3985,Trino plugin: Check table name when creating > tables Improvement,RANGER-3986,Upgrade trino guice dependency to 5.1.0 > Improvement,RANGER-3988,Trino plugin should differntiate between views and > tables Improvement,RANGER-3997,option to use default value when > user/group/tag does not have the attribute Improvement,RANGER-4004,"During > the service deletion also, we can clear the in-memory cache for that service > which got deleted on the ranger side" Improvement,RANGER-4011,option to > disable creation of default policies per hierarchy New > Feature,RANGER-3852,Performance and scalability analyzer tool for Ranger New > Feature,RANGER-3855,RangerExternalUserStoreRetriever class New > Feature,RANGER-4028,Ranger - Upgrade bootbox.js. > > BUGS addressed in 2.4.0 > > Bug,RANGER-2737,Ranger REST API returns different infomation when GET user by > id and by name Bug,RANGER-3080,"A service administrator should be allowed to > set ""excludes"" flag for a policy resource" Bug,RANGER-3108,NPE in > RangerPolicyRepository.init Bug,RANGER-3387,Ranger Admin Header Validation. > Bug,RANGER-3394,Too much `varchar(4000)` causes table to exceed ROW SIZE > limit in MySQL Bug,RANGER-3500,Ranger policy list doesn't support sorting by > field Bug,RANGER-3670,Policy update creates unnecessary entries in > transaction log table Bug,RANGER-3680,mysql ErrorCode:1118 when Importing DB > schema to database Bug,RANGER-3719,Can not create mysql table with charset > utf8mb4. Bug,RANGER-3775,Logback.xml has been incorrectly modified by > RANGER-3704. Bug,RANGER-3789,Upgrade Handlebars version to 4.7.7 > Bug,RANGER-3790,Ranger tagsync module should not depend on kafka server > Bug,RANGER-3798,"Ranger API Resource Metrics REST ""Up time of JVM"" does not > update." Bug,RANGER-3806,Group's users mapping entry failing whenever
Re: Planning for Apache Ranger 2.4.0 release
Thanks Ramesh. Thanks, Rajeshbabu. On Mon, Feb 13, 2023, 11:16 AM Ramesh Mani wrote: > Hi Rajesh, > > Thanks for reaching out on > https://issues.apache.org/jira/browse/RANGER-4029 > Currently we are reviewing / testing this patch and should update on this. > > Thanks, > Ramesh > > On Sun, Feb 12, 2023 at 9:16 PM rajeshb...@apache.org < > chrajeshbab...@gmail.com> wrote: > > > Hi Team, > > > > > > I would like to include > https://issues.apache.org/jira/browse/RANGER-4029 > > as part of 2.4.0 release. I have uploaded patch at review board as well > > after testing the changes in cluster. > > > > https://reviews.apache.org/r/74299/ > > > > Without the changes the HBase plugin with 2.5.x versions cannot be used. > > Which is a blocker. > > > > Thanks, > > Rajeshbabu. > > > > On Wed, Feb 8, 2023, 12:46 PM Nixon Rodrigues > > wrote: > > > > > +1 for Ranger 2.4.0 release. > > > Thanks Selva for initiating release process > > > > > > Regards > > > Nixon > > > > > > On Wed, 8 Feb 2023 at 07:09, Sailaja Polavarapu > > > wrote: > > > > > > > +1 for Apache Ranger 2.4.0 release. > > > > Thanks Selva for initiating this. > > > > > > > > - Sailaja > > > > > > > > On Sat, Feb 4, 2023 at 2:42 PM Ramesh Mani wrote: > > > > > > > > > +1 for Apache Ranger 2.4.0 release activities. > > > > > > > > > > Thanks > > > > > Ramesh > > > > > > > > > > On Tue, Jan 31, 2023 at 7:56 AM Selvamohan Neethiraj < > > > > sneet...@apache.org> > > > > > wrote: > > > > > > > > > > > Dear Ranger Community members, There are various features and > > > critical > > > > > > bug fixes done in the Apache Ranger project since the release of > > > Apache > > > > > > Ranger 2.3.0. Around 3 New Features, 34 improvements and 60 bug > > fixes > > > > > > were made from the last release. Now with that Ranger community > is > > > > > > expecting a release to adapt those changes and hence planning > this > > > > > > release. Please review and provide your opinion. > > > > > > > > > > > > Thanks, Selva- > > > > > > > > > > > > _*Improvements & New Features addressed in 2.4.0*_ > > > > > > > > > > > > Improvement,RANGER-2928,[Ranger Zone REST API] Resources data is > > > > missing > > > > > > in XML format Improvement,RANGER-3165,Upgrade Elasticsearch > version > > > in > > > > > > Ranger to Elasticsearch 7.10.2 Improvement,RANGER-3534,Review of > > > > > > RangerHiveAuditHandler Improvement,RANGER-3623,Add ability to > > enable > > > > > > anonymous download of policy/role/tag > > Improvement,RANGER-3633,Remove > > > > > > eclipse .project file from git Improvement,RANGER-3664,Ranger > KMS : > > > Add > > > > > > refresh functionality on kms key listing page. > > > > > > Improvement,RANGER-3763,The max limit of the requested entities > is > > > not > > > > > > configurable in tagsync Improvement,RANGER-3767,Add text message > in > > > > HDFS > > > > > > and YARN policy pages to highlight the fallback ACL option > > > > > > Improvement,RANGER-3787,Non-daemon threads started by > > > > > > ElasticSearchAuditDestination cause Spark application hanging > > > > > > Improvement,RANGER-3794,Improve performance of delete > users/groups > > > > > > utility Improvement,RANGER-3796,Enhancement to support multiple > > > > resource > > > > > > sets in a policy Improvement,RANGER-3818,Upgrade Solr to 8.11.2 > > > > > > Improvement,RANGER-3822,RangerService outputs password > information > > in > > > > > > plaintext Improvement,RANGER-3837,"Allow Ranger non-admins to > get, > > > > > > create, edit and delete roles" Improvement,RANGER-3856,Ranger > admin > > > > > > client option to work with non-kerberized server > > > > > > Improvement,RANGER-3865,support for using user attributes in > > masking > > > > > > expressions Improvement,RANGER-3900,"Roles deletion Takes time in > > > > Apache > > > > > > Ranger when there are more users,groups,roles" > > > > > > Improvement,RANGER-3902,dbLoadTime is not added correctly in > > > > > > RangerServicePoliciesCache Improvement,RANGER-3910,API > > Documentation > > > is > > > > > > broken for knox sso Improvement,RANGER-3934,improve tag cache > > > handling > > > > > > to reduce resource usage Improvement,RANGER-3940,"Add javascript > > > > > > includes(), intersects() polyfills for array prototype to > > > > > > RangerCommonConstants" Improvement,RANGER-3948,update > serialization > > > to > > > > > > skip empty values Improvement,RANGER-3951,optimize memory used > for > > > tags > > > > > > in plugins and server Improvement,RANGER-3955,optimization to > > reduce > > > > > > duplicate strings Improvement,RANGER-3973,LDAP incremental search > > not > > > > > > always available Improvement,RANGER-3978,Docker setup to run > Ranger > > > KMS > > > > > > Improvement,RANGER-3982,Python client for Ranger KMS REST APIs > > > > > > Improvement,RANGER-3983,Support getColumnMasks and getRowFilters > in > > > > > > Trino SPI 376+ Improvement,RANGER-3985,Trino plugin: Check table > > name > > > > > > when creating tables
Re: Planning for Apache Ranger 2.4.0 release
Hi Rajesh, Thanks for reaching out on https://issues.apache.org/jira/browse/RANGER-4029 Currently we are reviewing / testing this patch and should update on this. Thanks, Ramesh On Sun, Feb 12, 2023 at 9:16 PM rajeshb...@apache.org < chrajeshbab...@gmail.com> wrote: > Hi Team, > > > I would like to include https://issues.apache.org/jira/browse/RANGER-4029 > as part of 2.4.0 release. I have uploaded patch at review board as well > after testing the changes in cluster. > > https://reviews.apache.org/r/74299/ > > Without the changes the HBase plugin with 2.5.x versions cannot be used. > Which is a blocker. > > Thanks, > Rajeshbabu. > > On Wed, Feb 8, 2023, 12:46 PM Nixon Rodrigues > wrote: > > > +1 for Ranger 2.4.0 release. > > Thanks Selva for initiating release process > > > > Regards > > Nixon > > > > On Wed, 8 Feb 2023 at 07:09, Sailaja Polavarapu > > wrote: > > > > > +1 for Apache Ranger 2.4.0 release. > > > Thanks Selva for initiating this. > > > > > > - Sailaja > > > > > > On Sat, Feb 4, 2023 at 2:42 PM Ramesh Mani wrote: > > > > > > > +1 for Apache Ranger 2.4.0 release activities. > > > > > > > > Thanks > > > > Ramesh > > > > > > > > On Tue, Jan 31, 2023 at 7:56 AM Selvamohan Neethiraj < > > > sneet...@apache.org> > > > > wrote: > > > > > > > > > Dear Ranger Community members, There are various features and > > critical > > > > > bug fixes done in the Apache Ranger project since the release of > > Apache > > > > > Ranger 2.3.0. Around 3 New Features, 34 improvements and 60 bug > fixes > > > > > were made from the last release. Now with that Ranger community is > > > > > expecting a release to adapt those changes and hence planning this > > > > > release. Please review and provide your opinion. > > > > > > > > > > Thanks, Selva- > > > > > > > > > > _*Improvements & New Features addressed in 2.4.0*_ > > > > > > > > > > Improvement,RANGER-2928,[Ranger Zone REST API] Resources data is > > > missing > > > > > in XML format Improvement,RANGER-3165,Upgrade Elasticsearch version > > in > > > > > Ranger to Elasticsearch 7.10.2 Improvement,RANGER-3534,Review of > > > > > RangerHiveAuditHandler Improvement,RANGER-3623,Add ability to > enable > > > > > anonymous download of policy/role/tag > Improvement,RANGER-3633,Remove > > > > > eclipse .project file from git Improvement,RANGER-3664,Ranger KMS : > > Add > > > > > refresh functionality on kms key listing page. > > > > > Improvement,RANGER-3763,The max limit of the requested entities is > > not > > > > > configurable in tagsync Improvement,RANGER-3767,Add text message in > > > HDFS > > > > > and YARN policy pages to highlight the fallback ACL option > > > > > Improvement,RANGER-3787,Non-daemon threads started by > > > > > ElasticSearchAuditDestination cause Spark application hanging > > > > > Improvement,RANGER-3794,Improve performance of delete users/groups > > > > > utility Improvement,RANGER-3796,Enhancement to support multiple > > > resource > > > > > sets in a policy Improvement,RANGER-3818,Upgrade Solr to 8.11.2 > > > > > Improvement,RANGER-3822,RangerService outputs password information > in > > > > > plaintext Improvement,RANGER-3837,"Allow Ranger non-admins to get, > > > > > create, edit and delete roles" Improvement,RANGER-3856,Ranger admin > > > > > client option to work with non-kerberized server > > > > > Improvement,RANGER-3865,support for using user attributes in > masking > > > > > expressions Improvement,RANGER-3900,"Roles deletion Takes time in > > > Apache > > > > > Ranger when there are more users,groups,roles" > > > > > Improvement,RANGER-3902,dbLoadTime is not added correctly in > > > > > RangerServicePoliciesCache Improvement,RANGER-3910,API > Documentation > > is > > > > > broken for knox sso Improvement,RANGER-3934,improve tag cache > > handling > > > > > to reduce resource usage Improvement,RANGER-3940,"Add javascript > > > > > includes(), intersects() polyfills for array prototype to > > > > > RangerCommonConstants" Improvement,RANGER-3948,update serialization > > to > > > > > skip empty values Improvement,RANGER-3951,optimize memory used for > > tags > > > > > in plugins and server Improvement,RANGER-3955,optimization to > reduce > > > > > duplicate strings Improvement,RANGER-3973,LDAP incremental search > not > > > > > always available Improvement,RANGER-3978,Docker setup to run Ranger > > KMS > > > > > Improvement,RANGER-3982,Python client for Ranger KMS REST APIs > > > > > Improvement,RANGER-3983,Support getColumnMasks and getRowFilters in > > > > > Trino SPI 376+ Improvement,RANGER-3985,Trino plugin: Check table > name > > > > > when creating tables Improvement,RANGER-3986,Upgrade trino guice > > > > > dependency to 5.1.0 Improvement,RANGER-3988,Trino plugin should > > > > > differntiate between views and tables > Improvement,RANGER-3997,option > > to > > > > > use default value when user/group/tag does not have the attribute > > > > > Improvement,RANGER-4004,"During the service deletion also, we can > > clear > > > > >
Re: Planning for Apache Ranger 2.4.0 release
Hi Team, I would like to include https://issues.apache.org/jira/browse/RANGER-4029 as part of 2.4.0 release. I have uploaded patch at review board as well after testing the changes in cluster. https://reviews.apache.org/r/74299/ Without the changes the HBase plugin with 2.5.x versions cannot be used. Which is a blocker. Thanks, Rajeshbabu. On Wed, Feb 8, 2023, 12:46 PM Nixon Rodrigues wrote: > +1 for Ranger 2.4.0 release. > Thanks Selva for initiating release process > > Regards > Nixon > > On Wed, 8 Feb 2023 at 07:09, Sailaja Polavarapu > wrote: > > > +1 for Apache Ranger 2.4.0 release. > > Thanks Selva for initiating this. > > > > - Sailaja > > > > On Sat, Feb 4, 2023 at 2:42 PM Ramesh Mani wrote: > > > > > +1 for Apache Ranger 2.4.0 release activities. > > > > > > Thanks > > > Ramesh > > > > > > On Tue, Jan 31, 2023 at 7:56 AM Selvamohan Neethiraj < > > sneet...@apache.org> > > > wrote: > > > > > > > Dear Ranger Community members, There are various features and > critical > > > > bug fixes done in the Apache Ranger project since the release of > Apache > > > > Ranger 2.3.0. Around 3 New Features, 34 improvements and 60 bug fixes > > > > were made from the last release. Now with that Ranger community is > > > > expecting a release to adapt those changes and hence planning this > > > > release. Please review and provide your opinion. > > > > > > > > Thanks, Selva- > > > > > > > > _*Improvements & New Features addressed in 2.4.0*_ > > > > > > > > Improvement,RANGER-2928,[Ranger Zone REST API] Resources data is > > missing > > > > in XML format Improvement,RANGER-3165,Upgrade Elasticsearch version > in > > > > Ranger to Elasticsearch 7.10.2 Improvement,RANGER-3534,Review of > > > > RangerHiveAuditHandler Improvement,RANGER-3623,Add ability to enable > > > > anonymous download of policy/role/tag Improvement,RANGER-3633,Remove > > > > eclipse .project file from git Improvement,RANGER-3664,Ranger KMS : > Add > > > > refresh functionality on kms key listing page. > > > > Improvement,RANGER-3763,The max limit of the requested entities is > not > > > > configurable in tagsync Improvement,RANGER-3767,Add text message in > > HDFS > > > > and YARN policy pages to highlight the fallback ACL option > > > > Improvement,RANGER-3787,Non-daemon threads started by > > > > ElasticSearchAuditDestination cause Spark application hanging > > > > Improvement,RANGER-3794,Improve performance of delete users/groups > > > > utility Improvement,RANGER-3796,Enhancement to support multiple > > resource > > > > sets in a policy Improvement,RANGER-3818,Upgrade Solr to 8.11.2 > > > > Improvement,RANGER-3822,RangerService outputs password information in > > > > plaintext Improvement,RANGER-3837,"Allow Ranger non-admins to get, > > > > create, edit and delete roles" Improvement,RANGER-3856,Ranger admin > > > > client option to work with non-kerberized server > > > > Improvement,RANGER-3865,support for using user attributes in masking > > > > expressions Improvement,RANGER-3900,"Roles deletion Takes time in > > Apache > > > > Ranger when there are more users,groups,roles" > > > > Improvement,RANGER-3902,dbLoadTime is not added correctly in > > > > RangerServicePoliciesCache Improvement,RANGER-3910,API Documentation > is > > > > broken for knox sso Improvement,RANGER-3934,improve tag cache > handling > > > > to reduce resource usage Improvement,RANGER-3940,"Add javascript > > > > includes(), intersects() polyfills for array prototype to > > > > RangerCommonConstants" Improvement,RANGER-3948,update serialization > to > > > > skip empty values Improvement,RANGER-3951,optimize memory used for > tags > > > > in plugins and server Improvement,RANGER-3955,optimization to reduce > > > > duplicate strings Improvement,RANGER-3973,LDAP incremental search not > > > > always available Improvement,RANGER-3978,Docker setup to run Ranger > KMS > > > > Improvement,RANGER-3982,Python client for Ranger KMS REST APIs > > > > Improvement,RANGER-3983,Support getColumnMasks and getRowFilters in > > > > Trino SPI 376+ Improvement,RANGER-3985,Trino plugin: Check table name > > > > when creating tables Improvement,RANGER-3986,Upgrade trino guice > > > > dependency to 5.1.0 Improvement,RANGER-3988,Trino plugin should > > > > differntiate between views and tables Improvement,RANGER-3997,option > to > > > > use default value when user/group/tag does not have the attribute > > > > Improvement,RANGER-4004,"During the service deletion also, we can > clear > > > > the in-memory cache for that service which got deleted on the ranger > > > > side" Improvement,RANGER-4011,option to disable creation of default > > > > policies per hierarchy New Feature,RANGER-3852,Performance and > > > > scalability analyzer tool for Ranger New > > > > Feature,RANGER-3855,RangerExternalUserStoreRetriever class New > > > > Feature,RANGER-4028,Ranger - Upgrade bootbox.js. > > > > > > > > _*BUGS addressed in 2.4.0*_ > > > > > > > > Bug,RANGER-2737,Ranger REST API returns different
Re: Planning for Apache Ranger 2.4.0 release
+1 for Ranger 2.4.0 release. Thanks Selva for initiating release process Regards Nixon On Wed, 8 Feb 2023 at 07:09, Sailaja Polavarapu wrote: > +1 for Apache Ranger 2.4.0 release. > Thanks Selva for initiating this. > > - Sailaja > > On Sat, Feb 4, 2023 at 2:42 PM Ramesh Mani wrote: > > > +1 for Apache Ranger 2.4.0 release activities. > > > > Thanks > > Ramesh > > > > On Tue, Jan 31, 2023 at 7:56 AM Selvamohan Neethiraj < > sneet...@apache.org> > > wrote: > > > > > Dear Ranger Community members, There are various features and critical > > > bug fixes done in the Apache Ranger project since the release of Apache > > > Ranger 2.3.0. Around 3 New Features, 34 improvements and 60 bug fixes > > > were made from the last release. Now with that Ranger community is > > > expecting a release to adapt those changes and hence planning this > > > release. Please review and provide your opinion. > > > > > > Thanks, Selva- > > > > > > _*Improvements & New Features addressed in 2.4.0*_ > > > > > > Improvement,RANGER-2928,[Ranger Zone REST API] Resources data is > missing > > > in XML format Improvement,RANGER-3165,Upgrade Elasticsearch version in > > > Ranger to Elasticsearch 7.10.2 Improvement,RANGER-3534,Review of > > > RangerHiveAuditHandler Improvement,RANGER-3623,Add ability to enable > > > anonymous download of policy/role/tag Improvement,RANGER-3633,Remove > > > eclipse .project file from git Improvement,RANGER-3664,Ranger KMS : Add > > > refresh functionality on kms key listing page. > > > Improvement,RANGER-3763,The max limit of the requested entities is not > > > configurable in tagsync Improvement,RANGER-3767,Add text message in > HDFS > > > and YARN policy pages to highlight the fallback ACL option > > > Improvement,RANGER-3787,Non-daemon threads started by > > > ElasticSearchAuditDestination cause Spark application hanging > > > Improvement,RANGER-3794,Improve performance of delete users/groups > > > utility Improvement,RANGER-3796,Enhancement to support multiple > resource > > > sets in a policy Improvement,RANGER-3818,Upgrade Solr to 8.11.2 > > > Improvement,RANGER-3822,RangerService outputs password information in > > > plaintext Improvement,RANGER-3837,"Allow Ranger non-admins to get, > > > create, edit and delete roles" Improvement,RANGER-3856,Ranger admin > > > client option to work with non-kerberized server > > > Improvement,RANGER-3865,support for using user attributes in masking > > > expressions Improvement,RANGER-3900,"Roles deletion Takes time in > Apache > > > Ranger when there are more users,groups,roles" > > > Improvement,RANGER-3902,dbLoadTime is not added correctly in > > > RangerServicePoliciesCache Improvement,RANGER-3910,API Documentation is > > > broken for knox sso Improvement,RANGER-3934,improve tag cache handling > > > to reduce resource usage Improvement,RANGER-3940,"Add javascript > > > includes(), intersects() polyfills for array prototype to > > > RangerCommonConstants" Improvement,RANGER-3948,update serialization to > > > skip empty values Improvement,RANGER-3951,optimize memory used for tags > > > in plugins and server Improvement,RANGER-3955,optimization to reduce > > > duplicate strings Improvement,RANGER-3973,LDAP incremental search not > > > always available Improvement,RANGER-3978,Docker setup to run Ranger KMS > > > Improvement,RANGER-3982,Python client for Ranger KMS REST APIs > > > Improvement,RANGER-3983,Support getColumnMasks and getRowFilters in > > > Trino SPI 376+ Improvement,RANGER-3985,Trino plugin: Check table name > > > when creating tables Improvement,RANGER-3986,Upgrade trino guice > > > dependency to 5.1.0 Improvement,RANGER-3988,Trino plugin should > > > differntiate between views and tables Improvement,RANGER-3997,option to > > > use default value when user/group/tag does not have the attribute > > > Improvement,RANGER-4004,"During the service deletion also, we can clear > > > the in-memory cache for that service which got deleted on the ranger > > > side" Improvement,RANGER-4011,option to disable creation of default > > > policies per hierarchy New Feature,RANGER-3852,Performance and > > > scalability analyzer tool for Ranger New > > > Feature,RANGER-3855,RangerExternalUserStoreRetriever class New > > > Feature,RANGER-4028,Ranger - Upgrade bootbox.js. > > > > > > _*BUGS addressed in 2.4.0*_ > > > > > > Bug,RANGER-2737,Ranger REST API returns different infomation when GET > > > user by id and by name Bug,RANGER-3080,"A service administrator should > > > be allowed to set ""excludes"" flag for a policy resource" > > > Bug,RANGER-3108,NPE in RangerPolicyRepository.init > > > Bug,RANGER-3387,Ranger Admin Header Validation. Bug,RANGER-3394,Too > much > > > `varchar(4000)` causes table to exceed ROW SIZE limit in MySQL > > > Bug,RANGER-3500,Ranger policy list doesn't support sorting by field > > > Bug,RANGER-3670,Policy update creates unnecessary entries in > transaction > > > log table Bug,RANGER-3680,mysql ErrorCode:1118 when Importing DB schema > > >
Re: Planning for Apache Ranger 2.4.0 release
+1 for Apache Ranger 2.4.0 release. Thanks Selva for initiating this. - Sailaja On Sat, Feb 4, 2023 at 2:42 PM Ramesh Mani wrote: > +1 for Apache Ranger 2.4.0 release activities. > > Thanks > Ramesh > > On Tue, Jan 31, 2023 at 7:56 AM Selvamohan Neethiraj > wrote: > > > Dear Ranger Community members, There are various features and critical > > bug fixes done in the Apache Ranger project since the release of Apache > > Ranger 2.3.0. Around 3 New Features, 34 improvements and 60 bug fixes > > were made from the last release. Now with that Ranger community is > > expecting a release to adapt those changes and hence planning this > > release. Please review and provide your opinion. > > > > Thanks, Selva- > > > > _*Improvements & New Features addressed in 2.4.0*_ > > > > Improvement,RANGER-2928,[Ranger Zone REST API] Resources data is missing > > in XML format Improvement,RANGER-3165,Upgrade Elasticsearch version in > > Ranger to Elasticsearch 7.10.2 Improvement,RANGER-3534,Review of > > RangerHiveAuditHandler Improvement,RANGER-3623,Add ability to enable > > anonymous download of policy/role/tag Improvement,RANGER-3633,Remove > > eclipse .project file from git Improvement,RANGER-3664,Ranger KMS : Add > > refresh functionality on kms key listing page. > > Improvement,RANGER-3763,The max limit of the requested entities is not > > configurable in tagsync Improvement,RANGER-3767,Add text message in HDFS > > and YARN policy pages to highlight the fallback ACL option > > Improvement,RANGER-3787,Non-daemon threads started by > > ElasticSearchAuditDestination cause Spark application hanging > > Improvement,RANGER-3794,Improve performance of delete users/groups > > utility Improvement,RANGER-3796,Enhancement to support multiple resource > > sets in a policy Improvement,RANGER-3818,Upgrade Solr to 8.11.2 > > Improvement,RANGER-3822,RangerService outputs password information in > > plaintext Improvement,RANGER-3837,"Allow Ranger non-admins to get, > > create, edit and delete roles" Improvement,RANGER-3856,Ranger admin > > client option to work with non-kerberized server > > Improvement,RANGER-3865,support for using user attributes in masking > > expressions Improvement,RANGER-3900,"Roles deletion Takes time in Apache > > Ranger when there are more users,groups,roles" > > Improvement,RANGER-3902,dbLoadTime is not added correctly in > > RangerServicePoliciesCache Improvement,RANGER-3910,API Documentation is > > broken for knox sso Improvement,RANGER-3934,improve tag cache handling > > to reduce resource usage Improvement,RANGER-3940,"Add javascript > > includes(), intersects() polyfills for array prototype to > > RangerCommonConstants" Improvement,RANGER-3948,update serialization to > > skip empty values Improvement,RANGER-3951,optimize memory used for tags > > in plugins and server Improvement,RANGER-3955,optimization to reduce > > duplicate strings Improvement,RANGER-3973,LDAP incremental search not > > always available Improvement,RANGER-3978,Docker setup to run Ranger KMS > > Improvement,RANGER-3982,Python client for Ranger KMS REST APIs > > Improvement,RANGER-3983,Support getColumnMasks and getRowFilters in > > Trino SPI 376+ Improvement,RANGER-3985,Trino plugin: Check table name > > when creating tables Improvement,RANGER-3986,Upgrade trino guice > > dependency to 5.1.0 Improvement,RANGER-3988,Trino plugin should > > differntiate between views and tables Improvement,RANGER-3997,option to > > use default value when user/group/tag does not have the attribute > > Improvement,RANGER-4004,"During the service deletion also, we can clear > > the in-memory cache for that service which got deleted on the ranger > > side" Improvement,RANGER-4011,option to disable creation of default > > policies per hierarchy New Feature,RANGER-3852,Performance and > > scalability analyzer tool for Ranger New > > Feature,RANGER-3855,RangerExternalUserStoreRetriever class New > > Feature,RANGER-4028,Ranger - Upgrade bootbox.js. > > > > _*BUGS addressed in 2.4.0*_ > > > > Bug,RANGER-2737,Ranger REST API returns different infomation when GET > > user by id and by name Bug,RANGER-3080,"A service administrator should > > be allowed to set ""excludes"" flag for a policy resource" > > Bug,RANGER-3108,NPE in RangerPolicyRepository.init > > Bug,RANGER-3387,Ranger Admin Header Validation. Bug,RANGER-3394,Too much > > `varchar(4000)` causes table to exceed ROW SIZE limit in MySQL > > Bug,RANGER-3500,Ranger policy list doesn't support sorting by field > > Bug,RANGER-3670,Policy update creates unnecessary entries in transaction > > log table Bug,RANGER-3680,mysql ErrorCode:1118 when Importing DB schema > > to database Bug,RANGER-3719,Can not create mysql table with charset > > utf8mb4. Bug,RANGER-3775,Logback.xml has been incorrectly modified by > > RANGER-3704. Bug,RANGER-3789,Upgrade Handlebars version to 4.7.7 > > Bug,RANGER-3790,Ranger tagsync module should not depend on kafka server > > Bug,RANGER-3798,"Ranger API Resource Metrics REST ""Up time
Re: Planning for Apache Ranger 2.4.0 release
+1 for Apache Ranger 2.4.0 release activities. Thanks Ramesh On Tue, Jan 31, 2023 at 7:56 AM Selvamohan Neethiraj wrote: > Dear Ranger Community members, There are various features and critical > bug fixes done in the Apache Ranger project since the release of Apache > Ranger 2.3.0. Around 3 New Features, 34 improvements and 60 bug fixes > were made from the last release. Now with that Ranger community is > expecting a release to adapt those changes and hence planning this > release. Please review and provide your opinion. > > Thanks, Selva- > > _*Improvements & New Features addressed in 2.4.0*_ > > Improvement,RANGER-2928,[Ranger Zone REST API] Resources data is missing > in XML format Improvement,RANGER-3165,Upgrade Elasticsearch version in > Ranger to Elasticsearch 7.10.2 Improvement,RANGER-3534,Review of > RangerHiveAuditHandler Improvement,RANGER-3623,Add ability to enable > anonymous download of policy/role/tag Improvement,RANGER-3633,Remove > eclipse .project file from git Improvement,RANGER-3664,Ranger KMS : Add > refresh functionality on kms key listing page. > Improvement,RANGER-3763,The max limit of the requested entities is not > configurable in tagsync Improvement,RANGER-3767,Add text message in HDFS > and YARN policy pages to highlight the fallback ACL option > Improvement,RANGER-3787,Non-daemon threads started by > ElasticSearchAuditDestination cause Spark application hanging > Improvement,RANGER-3794,Improve performance of delete users/groups > utility Improvement,RANGER-3796,Enhancement to support multiple resource > sets in a policy Improvement,RANGER-3818,Upgrade Solr to 8.11.2 > Improvement,RANGER-3822,RangerService outputs password information in > plaintext Improvement,RANGER-3837,"Allow Ranger non-admins to get, > create, edit and delete roles" Improvement,RANGER-3856,Ranger admin > client option to work with non-kerberized server > Improvement,RANGER-3865,support for using user attributes in masking > expressions Improvement,RANGER-3900,"Roles deletion Takes time in Apache > Ranger when there are more users,groups,roles" > Improvement,RANGER-3902,dbLoadTime is not added correctly in > RangerServicePoliciesCache Improvement,RANGER-3910,API Documentation is > broken for knox sso Improvement,RANGER-3934,improve tag cache handling > to reduce resource usage Improvement,RANGER-3940,"Add javascript > includes(), intersects() polyfills for array prototype to > RangerCommonConstants" Improvement,RANGER-3948,update serialization to > skip empty values Improvement,RANGER-3951,optimize memory used for tags > in plugins and server Improvement,RANGER-3955,optimization to reduce > duplicate strings Improvement,RANGER-3973,LDAP incremental search not > always available Improvement,RANGER-3978,Docker setup to run Ranger KMS > Improvement,RANGER-3982,Python client for Ranger KMS REST APIs > Improvement,RANGER-3983,Support getColumnMasks and getRowFilters in > Trino SPI 376+ Improvement,RANGER-3985,Trino plugin: Check table name > when creating tables Improvement,RANGER-3986,Upgrade trino guice > dependency to 5.1.0 Improvement,RANGER-3988,Trino plugin should > differntiate between views and tables Improvement,RANGER-3997,option to > use default value when user/group/tag does not have the attribute > Improvement,RANGER-4004,"During the service deletion also, we can clear > the in-memory cache for that service which got deleted on the ranger > side" Improvement,RANGER-4011,option to disable creation of default > policies per hierarchy New Feature,RANGER-3852,Performance and > scalability analyzer tool for Ranger New > Feature,RANGER-3855,RangerExternalUserStoreRetriever class New > Feature,RANGER-4028,Ranger - Upgrade bootbox.js. > > _*BUGS addressed in 2.4.0*_ > > Bug,RANGER-2737,Ranger REST API returns different infomation when GET > user by id and by name Bug,RANGER-3080,"A service administrator should > be allowed to set ""excludes"" flag for a policy resource" > Bug,RANGER-3108,NPE in RangerPolicyRepository.init > Bug,RANGER-3387,Ranger Admin Header Validation. Bug,RANGER-3394,Too much > `varchar(4000)` causes table to exceed ROW SIZE limit in MySQL > Bug,RANGER-3500,Ranger policy list doesn't support sorting by field > Bug,RANGER-3670,Policy update creates unnecessary entries in transaction > log table Bug,RANGER-3680,mysql ErrorCode:1118 when Importing DB schema > to database Bug,RANGER-3719,Can not create mysql table with charset > utf8mb4. Bug,RANGER-3775,Logback.xml has been incorrectly modified by > RANGER-3704. Bug,RANGER-3789,Upgrade Handlebars version to 4.7.7 > Bug,RANGER-3790,Ranger tagsync module should not depend on kafka server > Bug,RANGER-3798,"Ranger API Resource Metrics REST ""Up time of JVM"" > does not update." Bug,RANGER-3806,Group's users mapping entry failing > whenever primary key auto-increment is not set to 1 in db > Bug,RANGER-3807,getUserRoles API gives 200 for non existing user passed > to this API Bug,RANGER-3813,Fix ConcurrentModificationException in >
Re: Planning for Apache Ranger 2.4.0 release
+1 to get started on Apache Ranger 2.4.0 release. Selva - thanks for initiating this thread. The list of JIRAs doesn't render well in the email (see below). Perhaps this can be added in a wiki and include the link in email? Thanks, Madhan On 1/31/23, 7:56 AM, "Selvamohan Neethiraj" mailto:sneet...@apache.org>> wrote: Dear Ranger Community members, There are various features and critical bug fixes done in the Apache Ranger project since the release of Apache Ranger 2.3.0. Around 3 New Features, 34 improvements and 60 bug fixes were made from the last release. Now with that Ranger community is expecting a release to adapt those changes and hence planning this release. Please review and provide your opinion. Thanks, Selva- _*Improvements & New Features addressed in 2.4.0*_ Improvement,RANGER-2928,[Ranger Zone REST API] Resources data is missing in XML format Improvement,RANGER-3165,Upgrade Elasticsearch version in Ranger to Elasticsearch 7.10.2 Improvement,RANGER-3534,Review of RangerHiveAuditHandler Improvement,RANGER-3623,Add ability to enable anonymous download of policy/role/tag Improvement,RANGER-3633,Remove eclipse .project file from git Improvement,RANGER-3664,Ranger KMS : Add refresh functionality on kms key listing page. Improvement,RANGER-3763,The max limit of the requested entities is not configurable in tagsync Improvement,RANGER-3767,Add text message in HDFS and YARN policy pages to highlight the fallback ACL option Improvement,RANGER-3787,Non-daemon threads started by ElasticSearchAuditDestination cause Spark application hanging Improvement,RANGER-3794,Improve performance of delete users/groups utility Improvement,RANGER-3796,Enhancement to support multiple resource sets in a policy Improvement,RANGER-3818,Upgrade Solr to 8.11.2 Improvement,RANGER-3822,RangerService outputs password information in plaintext Improvement,RANGER-3837,"Allow Ranger non-admins to get, create, edit and delete roles" Improvement,RANGER-3856,Ranger admin client option to work with non-kerberized server Improvement,RANGER-3865,support for using user attributes in masking expressions Improvement,RANGER-3900,"Roles deletion Takes time in Apache Ranger when there are more users,groups,roles" Improvement,RANGER-3902,dbLoadTime is not added correctly in RangerServicePoliciesCache Improvement,RANGER-3910,API Documentation is broken for knox sso Improvement,RANGER-3934,improve tag cache handling to reduce resource usage Improvement,RANGER-3940,"Add javascript includes(), intersects() polyfills for array prototype to RangerCommonConstants" Improvement,RANGER-3948,update serialization to skip empty values Improvement,RANGER-3951,optimize memory used for tags in plugins and server Improvement,RANGER-3955,optimization to reduce duplicate strings Improvement,RANGER-3973,LDAP incremental search not always available Improvement,RANGER-3978,Docker setup to run Ranger KMS Improvement,RANGER-3982,Python client for Ranger KMS REST APIs Improvement,RANGER-3983,Support getColumnMasks and getRowFilters in Trino SPI 376+ Improvement,RANGER-3985,Trino plugin: Check table name when creating tables Improvement,RANGER-3986,Upgrade trino guice dependency to 5.1.0 Improvement,RANGER-3988,Trino plugin should differntiate between views and tables Improvement,RANGER-3997,option to use default value when user/group/tag does not have the attribute Improvement,RANGER-4004,"During the service deletion also, we can clear the in-memory cache for that service which got deleted on the ranger side" Improvement,RANGER-4011,option to disable creation of default policies per hierarchy New Feature,RANGER-3852,Performance and scalability analyzer tool for Ranger New Feature,RANGER-3855,RangerExternalUserStoreRetriever class New Feature,RANGER-4028,Ranger - Upgrade bootbox.js. _*BUGS addressed in 2.4.0*_ Bug,RANGER-2737,Ranger REST API returns different infomation when GET user by id and by name Bug,RANGER-3080,"A service administrator should be allowed to set ""excludes"" flag for a policy resource" Bug,RANGER-3108,NPE in RangerPolicyRepository.init Bug,RANGER-3387,Ranger Admin Header Validation. Bug,RANGER-3394,Too much `varchar(4000)` causes table to exceed ROW SIZE limit in MySQL Bug,RANGER-3500,Ranger policy list doesn't support sorting by field Bug,RANGER-3670,Policy update creates unnecessary entries in transaction log table Bug,RANGER-3680,mysql ErrorCode:1118 when Importing DB schema to database Bug,RANGER-3719,Can not create mysql table with charset utf8mb4. Bug,RANGER-3775,Logback.xml has been incorrectly modified by RANGER-3704. Bug,RANGER-3789,Upgrade Handlebars version to 4.7.7 Bug,RANGER-3790,Ranger tagsync module should not depend on kafka server Bug,RANGER-3798,"Ranger API Resource Metrics REST ""Up time of JVM"" does not update." Bug,RANGER-3806,Group's users mapping entry failing whenever primary key auto-increment is not set to 1 in db
Planning for Apache Ranger 2.4.0 release
Dear Ranger Community members, There are various features and critical bug fixes done in the Apache Ranger project since the release of Apache Ranger 2.3.0. Around 3 New Features, 34 improvements and 60 bug fixes were made from the last release. Now with that Ranger community is expecting a release to adapt those changes and hence planning this release. Please review and provide your opinion. Thanks, Selva- _*Improvements & New Features addressed in 2.4.0*_ Improvement,RANGER-2928,[Ranger Zone REST API] Resources data is missing in XML format Improvement,RANGER-3165,Upgrade Elasticsearch version in Ranger to Elasticsearch 7.10.2 Improvement,RANGER-3534,Review of RangerHiveAuditHandler Improvement,RANGER-3623,Add ability to enable anonymous download of policy/role/tag Improvement,RANGER-3633,Remove eclipse .project file from git Improvement,RANGER-3664,Ranger KMS : Add refresh functionality on kms key listing page. Improvement,RANGER-3763,The max limit of the requested entities is not configurable in tagsync Improvement,RANGER-3767,Add text message in HDFS and YARN policy pages to highlight the fallback ACL option Improvement,RANGER-3787,Non-daemon threads started by ElasticSearchAuditDestination cause Spark application hanging Improvement,RANGER-3794,Improve performance of delete users/groups utility Improvement,RANGER-3796,Enhancement to support multiple resource sets in a policy Improvement,RANGER-3818,Upgrade Solr to 8.11.2 Improvement,RANGER-3822,RangerService outputs password information in plaintext Improvement,RANGER-3837,"Allow Ranger non-admins to get, create, edit and delete roles" Improvement,RANGER-3856,Ranger admin client option to work with non-kerberized server Improvement,RANGER-3865,support for using user attributes in masking expressions Improvement,RANGER-3900,"Roles deletion Takes time in Apache Ranger when there are more users,groups,roles" Improvement,RANGER-3902,dbLoadTime is not added correctly in RangerServicePoliciesCache Improvement,RANGER-3910,API Documentation is broken for knox sso Improvement,RANGER-3934,improve tag cache handling to reduce resource usage Improvement,RANGER-3940,"Add javascript includes(), intersects() polyfills for array prototype to RangerCommonConstants" Improvement,RANGER-3948,update serialization to skip empty values Improvement,RANGER-3951,optimize memory used for tags in plugins and server Improvement,RANGER-3955,optimization to reduce duplicate strings Improvement,RANGER-3973,LDAP incremental search not always available Improvement,RANGER-3978,Docker setup to run Ranger KMS Improvement,RANGER-3982,Python client for Ranger KMS REST APIs Improvement,RANGER-3983,Support getColumnMasks and getRowFilters in Trino SPI 376+ Improvement,RANGER-3985,Trino plugin: Check table name when creating tables Improvement,RANGER-3986,Upgrade trino guice dependency to 5.1.0 Improvement,RANGER-3988,Trino plugin should differntiate between views and tables Improvement,RANGER-3997,option to use default value when user/group/tag does not have the attribute Improvement,RANGER-4004,"During the service deletion also, we can clear the in-memory cache for that service which got deleted on the ranger side" Improvement,RANGER-4011,option to disable creation of default policies per hierarchy New Feature,RANGER-3852,Performance and scalability analyzer tool for Ranger New Feature,RANGER-3855,RangerExternalUserStoreRetriever class New Feature,RANGER-4028,Ranger - Upgrade bootbox.js. _*BUGS addressed in 2.4.0*_ Bug,RANGER-2737,Ranger REST API returns different infomation when GET user by id and by name Bug,RANGER-3080,"A service administrator should be allowed to set ""excludes"" flag for a policy resource" Bug,RANGER-3108,NPE in RangerPolicyRepository.init Bug,RANGER-3387,Ranger Admin Header Validation. Bug,RANGER-3394,Too much `varchar(4000)` causes table to exceed ROW SIZE limit in MySQL Bug,RANGER-3500,Ranger policy list doesn't support sorting by field Bug,RANGER-3670,Policy update creates unnecessary entries in transaction log table Bug,RANGER-3680,mysql ErrorCode:1118 when Importing DB schema to database Bug,RANGER-3719,Can not create mysql table with charset utf8mb4. Bug,RANGER-3775,Logback.xml has been incorrectly modified by RANGER-3704. Bug,RANGER-3789,Upgrade Handlebars version to 4.7.7 Bug,RANGER-3790,Ranger tagsync module should not depend on kafka server Bug,RANGER-3798,"Ranger API Resource Metrics REST ""Up time of JVM"" does not update." Bug,RANGER-3806,Group's users mapping entry failing whenever primary key auto-increment is not set to 1 in db Bug,RANGER-3807,getUserRoles API gives 200 for non existing user passed to this API Bug,RANGER-3813,Fix ConcurrentModificationException in UnixUserGroupBuilder Bug,RANGER-3814,IS_IN_ROLE(roleName) condition always returns false Bug,RANGER-3816,update getResourceACLs() API to handle macros in resource names Bug,RANGER-3819,Upgrade springframework