Re: [VOTE] Release Apache Atlas version 2.1.0 - rc3

2020-07-13 Thread Pinal Shah
+1 for Apache Atlas 2.1.0 rc3 release

Validated below:
- Build successfully with embedded-hbase-solr.
- Creating entities and classification.
- Basic/Quick search
- Creating Labels and search for them.
- Creating custom attributes and search for them.

Thanks,
Pinal Shah


On Mon, Jul 13, 2020 at 11:00 AM Chaitali Borole <
chaitali.bor...@freestoneinfotech.com> wrote:

> Hello,
>
> +1 for Apache Atlas 2.1.0 - rc3 release
>
> 1. Successful build with -Pdist,embedded-hbase-solr.
> 2. Started Atlas server successfully and quick_Start works too..
> 3. Verified all entities getting tagged successfully also tags are created.
> 4. Successfully created entities, relationships.
> 5. Validated Basic and advanced search.
>
> Thanks,
> Chaitali Borole.
>
> On Fri, Jul 10, 2020 at 10:29 AM Madhan Neethiraj 
> wrote:
>
> > Atlas team,
> >
> > Apache Atlas 2.1.0 rc3, with following fixes since rc2, is now available
> > for vote within dev community.
> >   ATLAS-3877: Purged entity audit throws 404 Entity not found error
> >   ATLAS-3882: Classic UI: Loader not disappearing while assigning
> category
> > to term
> >
> > Links to the release artifacts are given below. Please review and vote.
> >
> > The vote will be open for at least 72 hours or until necessary votes are
> > reached.
> >   [ ] +1 Approve
> >   [ ] +0 No opinion
> >   [ ] -1 Disapprove (and reason why)
> >
> > Thanks,
> > Madhan
> >
> >
> > List of all issues addressed in this release:
> > https://issues.apache.org/jira/issues/?jql=project=ATLAS AND
> > status=Resolved AND fixVersion=2.1.0 ORDER BY key DESC
> >
> > Git tag for the release:
> > https://github.com/apache/atlas/tree/release-2.1.0-rc3
> > Sources for the release:
> >
> https://dist.apache.org/repos/dist/dev/atlas/2.1.0-rc3/apache-atlas-2.1.0-sources.tar.gz
> >
> > Source release verification:
> >   PGP Signature:
> >
> https://dist.apache.org/repos/dist/dev/atlas/2.1.0-rc3/apache-atlas-2.1.0-sources.tar.gz.asc
> >   SHA512 Hash:
> >
> https://dist.apache.org/repos/dist/dev/atlas/2.1.0-rc3/apache-atlas-2.1.0-sources.tar.gz.sha512
> >   MD5 Hash:
> >
> https://dist.apache.org/repos/dist/dev/atlas/2.1.0-rc3/apache-atlas-2.1.0-sources.tar.gz.md5
> >
> > Keys to verify the signature of the release artifacts are available at:
> > https://dist.apache.org/repos/dist/release/atlas/KEYS
> >
> > New features/enhancements:
> >   - Quick Search: provides a simpler search experience with type-ahead
> > suggestions
> >   - Business Metadata: enables augmenting entity-types with additional
> > attributes, search entities using these attributes
> >   - Labels: ability to add/remove labels on entities, and search entities
> > using labels
> >   - Custom Attributes: ability to add entity instance specific custom
> > attributes i.e. attributes not defined in entity-def or business metadata
> >   - Entity Purge: added REST APIs to purge deleted entities
> >
> > Enhancements:
> >   - Search: ability to find entities by more than one classification
> >   - Performance: improvements in lineage retrieval and
> > classification-propagation
> >   - Notification: ability to process notifications from multiple Kafka
> > topics
> >   - Hive Hook: tracks process-executions via hive_process_execution
> > entities
> >   - Hive Hook: captures DDL operations via hive_db_ddl and hive_table_ddl
> > entities
> >   - Notification: introduced shell entities to record references to
> > non-existing entities in notifications
> >   - Spark: added model to capture Spark entities, processes and
> > relationships
> >   - AWS S3: introduced updated model to capture AWS S3 entities and
> > relationships
> >   - ADLS-Gen2: introduced model to capture Azure Data Lake Storage Gen2
> > entities and relationships
> >   - Dependencies: JanusGraph 0.5.1, Tinkerpop 3.4.6, Spring Framework
> > 4.3.20
> >   - Authorization: updated to cover new features, like: business
> metadata,
> > labels, purge
> >   - UI: multiple UI improvements, including a beta UI
> >
> >
> >
>


Re: [VOTE] Release Apache Atlas version 2.1.0 - rc3

2020-07-13 Thread Jayendra Parab
+1 for Apache Atlas 2.1.0 RC3 release

Validated the following:
1. Verified the source SHA512 and MD5 checksum
2. Verified the build with -Pdist,embedded-hbase-solr
3. Started Atlas server successfully
4. Verified quick_start.py, all entities and tag get created successfully
5. Created entities, applied tags from UI
6. Checked Basic and advanced search

Regards,
Jayendra.

On Mon, Jul 13, 2020 at 12:17 PM Sarath Subramanian 
wrote:

> +1 for Apache Atlas 2.1 rc3
>
> Validated the following:
> - Validated MD5 checksum
> - Validated sha512 hash
> - Verified PGP signature
> - No binaries in extracted source
> - Built successfully using embedded-hbase and solr profile
> - Ran quick start and tested basic sanity - saved search, basic/advanced
> search, Glossary, tag propagation, Admin purge, system attribute search
>
>
>
> On Thu, Jul 9, 2020 at 9:59 PM Madhan Neethiraj  wrote:
>
> > Atlas team,
> >
> > Apache Atlas 2.1.0 rc3, with following fixes since rc2, is now available
> > for vote within dev community.
> >   ATLAS-3877: Purged entity audit throws 404 Entity not found error
> >   ATLAS-3882: Classic UI: Loader not disappearing while assigning
> category
> > to term
> >
> > Links to the release artifacts are given below. Please review and vote.
> >
> > The vote will be open for at least 72 hours or until necessary votes are
> > reached.
> >   [ ] +1 Approve
> >   [ ] +0 No opinion
> >   [ ] -1 Disapprove (and reason why)
> >
> > Thanks,
> > Madhan
> >
> >
> > List of all issues addressed in this release:
> > https://issues.apache.org/jira/issues/?jql=project=ATLAS AND
> > status=Resolved AND fixVersion=2.1.0 ORDER BY key DESC
> >
> > Git tag for the release:
> > https://github.com/apache/atlas/tree/release-2.1.0-rc3
> > Sources for the release:
> >
> https://dist.apache.org/repos/dist/dev/atlas/2.1.0-rc3/apache-atlas-2.1.0-sources.tar.gz
> >
> > Source release verification:
> >   PGP Signature:
> >
> https://dist.apache.org/repos/dist/dev/atlas/2.1.0-rc3/apache-atlas-2.1.0-sources.tar.gz.asc
> >   SHA512 Hash:
> >
> https://dist.apache.org/repos/dist/dev/atlas/2.1.0-rc3/apache-atlas-2.1.0-sources.tar.gz.sha512
> >   MD5 Hash:
> >
> https://dist.apache.org/repos/dist/dev/atlas/2.1.0-rc3/apache-atlas-2.1.0-sources.tar.gz.md5
> >
> > Keys to verify the signature of the release artifacts are available at:
> > https://dist.apache.org/repos/dist/release/atlas/KEYS
> >
> > New features/enhancements:
> >   - Quick Search: provides a simpler search experience with type-ahead
> > suggestions
> >   - Business Metadata: enables augmenting entity-types with additional
> > attributes, search entities using these attributes
> >   - Labels: ability to add/remove labels on entities, and search entities
> > using labels
> >   - Custom Attributes: ability to add entity instance specific custom
> > attributes i.e. attributes not defined in entity-def or business metadata
> >   - Entity Purge: added REST APIs to purge deleted entities
> >
> > Enhancements:
> >   - Search: ability to find entities by more than one classification
> >   - Performance: improvements in lineage retrieval and
> > classification-propagation
> >   - Notification: ability to process notifications from multiple Kafka
> > topics
> >   - Hive Hook: tracks process-executions via hive_process_execution
> > entities
> >   - Hive Hook: captures DDL operations via hive_db_ddl and hive_table_ddl
> > entities
> >   - Notification: introduced shell entities to record references to
> > non-existing entities in notifications
> >   - Spark: added model to capture Spark entities, processes and
> > relationships
> >   - AWS S3: introduced updated model to capture AWS S3 entities and
> > relationships
> >   - ADLS-Gen2: introduced model to capture Azure Data Lake Storage Gen2
> > entities and relationships
> >   - Dependencies: JanusGraph 0.5.1, Tinkerpop 3.4.6, Spring Framework
> > 4.3.20
> >   - Authorization: updated to cover new features, like: business
> metadata,
> > labels, purge
> >   - UI: multiple UI improvements, including a beta UI
> >
> >
> >
>


Re: [VOTE] Release Apache Atlas version 2.1.0 - rc3

2020-07-13 Thread Mandar Ambawane
+1 for Apache Atlas 2.1.0 RC3 release

Validated the following:
1. Verified the source SHA512 and MD5 checksum
2. Verified the build with -Pdist,embedded-hbase-solr
3. Started Atlas server successfully
4. Verified quick_start.py, all entities and tag get created successfully
5. Created Business metadata and associated with an entity.
6. Checked Basic and advanced search

Thanks,
Mandar

On Mon, Jul 13, 2020 at 12:39 PM Jayendra Parab 
wrote:

> +1 for Apache Atlas 2.1.0 RC3 release
>
> Validated the following:
> 1. Verified the source SHA512 and MD5 checksum
> 2. Verified the build with -Pdist,embedded-hbase-solr
> 3. Started Atlas server successfully
> 4. Verified quick_start.py, all entities and tag get created successfully
> 5. Created entities, applied tags from UI
> 6. Checked Basic and advanced search
>
> Regards,
> Jayendra.
>
> On Mon, Jul 13, 2020 at 12:17 PM Sarath Subramanian 
> wrote:
>
> > +1 for Apache Atlas 2.1 rc3
> >
> > Validated the following:
> > - Validated MD5 checksum
> > - Validated sha512 hash
> > - Verified PGP signature
> > - No binaries in extracted source
> > - Built successfully using embedded-hbase and solr profile
> > - Ran quick start and tested basic sanity - saved search, basic/advanced
> > search, Glossary, tag propagation, Admin purge, system attribute search
> >
> >
> >
> > On Thu, Jul 9, 2020 at 9:59 PM Madhan Neethiraj 
> wrote:
> >
> > > Atlas team,
> > >
> > > Apache Atlas 2.1.0 rc3, with following fixes since rc2, is now
> available
> > > for vote within dev community.
> > >   ATLAS-3877: Purged entity audit throws 404 Entity not found error
> > >   ATLAS-3882: Classic UI: Loader not disappearing while assigning
> > category
> > > to term
> > >
> > > Links to the release artifacts are given below. Please review and vote.
> > >
> > > The vote will be open for at least 72 hours or until necessary votes
> are
> > > reached.
> > >   [ ] +1 Approve
> > >   [ ] +0 No opinion
> > >   [ ] -1 Disapprove (and reason why)
> > >
> > > Thanks,
> > > Madhan
> > >
> > >
> > > List of all issues addressed in this release:
> > > https://issues.apache.org/jira/issues/?jql=project=ATLAS AND
> > > status=Resolved AND fixVersion=2.1.0 ORDER BY key DESC
> > >
> > > Git tag for the release:
> > > https://github.com/apache/atlas/tree/release-2.1.0-rc3
> > > Sources for the release:
> > >
> >
> https://dist.apache.org/repos/dist/dev/atlas/2.1.0-rc3/apache-atlas-2.1.0-sources.tar.gz
> > >
> > > Source release verification:
> > >   PGP Signature:
> > >
> >
> https://dist.apache.org/repos/dist/dev/atlas/2.1.0-rc3/apache-atlas-2.1.0-sources.tar.gz.asc
> > >   SHA512 Hash:
> > >
> >
> https://dist.apache.org/repos/dist/dev/atlas/2.1.0-rc3/apache-atlas-2.1.0-sources.tar.gz.sha512
> > >   MD5 Hash:
> > >
> >
> https://dist.apache.org/repos/dist/dev/atlas/2.1.0-rc3/apache-atlas-2.1.0-sources.tar.gz.md5
> > >
> > > Keys to verify the signature of the release artifacts are available at:
> > > https://dist.apache.org/repos/dist/release/atlas/KEYS
> > >
> > > New features/enhancements:
> > >   - Quick Search: provides a simpler search experience with type-ahead
> > > suggestions
> > >   - Business Metadata: enables augmenting entity-types with additional
> > > attributes, search entities using these attributes
> > >   - Labels: ability to add/remove labels on entities, and search
> entities
> > > using labels
> > >   - Custom Attributes: ability to add entity instance specific custom
> > > attributes i.e. attributes not defined in entity-def or business
> metadata
> > >   - Entity Purge: added REST APIs to purge deleted entities
> > >
> > > Enhancements:
> > >   - Search: ability to find entities by more than one classification
> > >   - Performance: improvements in lineage retrieval and
> > > classification-propagation
> > >   - Notification: ability to process notifications from multiple Kafka
> > > topics
> > >   - Hive Hook: tracks process-executions via hive_process_execution
> > > entities
> > >   - Hive Hook: captures DDL operations via hive_db_ddl and
> hive_table_ddl
> > > entities
> > >   - Notification: introduced shell entities to record references to
> > > non-existing entities in notifications
> > >   - Spark: added model to capture Spark entities, processes and
> > > relationships
> > >   - AWS S3: introduced updated model to capture AWS S3 entities and
> > > relationships
> > >   - ADLS-Gen2: introduced model to capture Azure Data Lake Storage Gen2
> > > entities and relationships
> > >   - Dependencies: JanusGraph 0.5.1, Tinkerpop 3.4.6, Spring Framework
> > > 4.3.20
> > >   - Authorization: updated to cover new features, like: business
> > metadata,
> > > labels, purge
> > >   - UI: multiple UI improvements, including a beta UI
> > >
> > >
> > >
> >
>


-- 
Thanks and Regards,
Mandar V. Ambawane.


[jira] [Created] (ATLAS-3890) Bulk entity tag association and bulk api enhancement

2020-07-13 Thread chaitali borole (Jira)
chaitali borole created ATLAS-3890:
--

 Summary: Bulk entity tag association and bulk api enhancement
 Key: ATLAS-3890
 URL: https://issues.apache.org/jira/browse/ATLAS-3890
 Project: Atlas
  Issue Type: Improvement
Affects Versions: 3.0.0
Reporter: chaitali borole
Assignee: chaitali borole


DELETE /bulk - EntityREST.deleteByGuids()

GET /bulk/uniqueAttribute/type/\{typeName} - 
EntityREST.getEntitiesByUniqueAttributes()



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-3890) Enhancement for all BulkAPIs.

2020-07-13 Thread chaitali borole (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

chaitali borole updated ATLAS-3890:
---
Summary: Enhancement for all BulkAPIs.  (was: Bulk entity tag association 
and bulk api enhancement)

> Enhancement for all BulkAPIs.
> -
>
> Key: ATLAS-3890
> URL: https://issues.apache.org/jira/browse/ATLAS-3890
> Project: Atlas
>  Issue Type: Improvement
>Affects Versions: 3.0.0
>Reporter: chaitali borole
>Assignee: chaitali borole
>Priority: Major
>
> DELETE /bulk - EntityREST.deleteByGuids()
> GET /bulk/uniqueAttribute/type/\{typeName} - 
> EntityREST.getEntitiesByUniqueAttributes()



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-3890) Enhancement for all BulkAPIs.

2020-07-13 Thread chaitali borole (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

chaitali borole updated ATLAS-3890:
---
Description: 
According to below linked Atlas Jira two Bulk Apis are enhanced to return 
authorised entities or modify them when some of then entity types are blocked 
by policies in Ranger for access to user.Hence we are improving the other bulk 
Apis too.

Previously user only used to get 403 error if he tries to access or modify 
entities which comprised of both authorised as well as unauthorised typenames.

DELETE /bulk - EntityREST.deleteByGuids()

GET /bulk/uniqueAttribute/type/\{typeName} - 
EntityREST.getEntitiesByUniqueAttributes()

  was:
DELETE /bulk - EntityREST.deleteByGuids()

GET /bulk/uniqueAttribute/type/\{typeName} - 
EntityREST.getEntitiesByUniqueAttributes()


> Enhancement for all BulkAPIs.
> -
>
> Key: ATLAS-3890
> URL: https://issues.apache.org/jira/browse/ATLAS-3890
> Project: Atlas
>  Issue Type: Improvement
>Affects Versions: 3.0.0
>Reporter: chaitali borole
>Assignee: chaitali borole
>Priority: Major
>
> According to below linked Atlas Jira two Bulk Apis are enhanced to return 
> authorised entities or modify them when some of then entity types are blocked 
> by policies in Ranger for access to user.Hence we are improving the other 
> bulk Apis too.
> Previously user only used to get 403 error if he tries to access or modify 
> entities which comprised of both authorised as well as unauthorised typenames.
> DELETE /bulk - EntityREST.deleteByGuids()
> GET /bulk/uniqueAttribute/type/\{typeName} - 
> EntityREST.getEntitiesByUniqueAttributes()



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


Re: [VOTE] Release Apache Atlas version 2.1.0 - rc3

2020-07-13 Thread Umesh Padashetty
+1 for Apache Atlas 2.1 rc3. Validated the following

   1. Verified the build with embedded solr, hbase
   2. Ran quick start, verified the entities created in atlas
   3. Verified atlas start/stop
   4. Soft delete entities
   5. Classification and Sub classification:
  1. Create
  2. Delete (non-referenced)
  3. Assignment
   6. Business Metadata:
  1. Definition:
 1. Create
 2. Update
  2. Assignment:
 1. Add
 2. Remove
  7. Glossary/Term:
  1. Create
  2. Delete (non-referenced)
  3. Assignment
   8. Search:
  1. Basic
  2. Advanced
  3. Quick Search
  4. Suggestions
   9. Admin:
  1. Purge:
 1. Soft deleted entites
 2. Active entites (error thrown as expected)
  2. Audits:
   10. Enum:
  1. Create
  2. Update


On Mon, Jul 13, 2020 at 12:44 PM Mandar Ambawane <
mandar.ambaw...@freestoneinfotech.com> wrote:

> +1 for Apache Atlas 2.1.0 RC3 release
>
> Validated the following:
> 1. Verified the source SHA512 and MD5 checksum
> 2. Verified the build with -Pdist,embedded-hbase-solr
> 3. Started Atlas server successfully
> 4. Verified quick_start.py, all entities and tag get created successfully
> 5. Created Business metadata and associated with an entity.
> 6. Checked Basic and advanced search
>
> Thanks,
> Mandar
>
> On Mon, Jul 13, 2020 at 12:39 PM Jayendra Parab 
> wrote:
>
> > +1 for Apache Atlas 2.1.0 RC3 release
> >
> > Validated the following:
> > 1. Verified the source SHA512 and MD5 checksum
> > 2. Verified the build with -Pdist,embedded-hbase-solr
> > 3. Started Atlas server successfully
> > 4. Verified quick_start.py, all entities and tag get created successfully
> > 5. Created entities, applied tags from UI
> > 6. Checked Basic and advanced search
> >
> > Regards,
> > Jayendra.
> >
> > On Mon, Jul 13, 2020 at 12:17 PM Sarath Subramanian 
> > wrote:
> >
> > > +1 for Apache Atlas 2.1 rc3
> > >
> > > Validated the following:
> > > - Validated MD5 checksum
> > > - Validated sha512 hash
> > > - Verified PGP signature
> > > - No binaries in extracted source
> > > - Built successfully using embedded-hbase and solr profile
> > > - Ran quick start and tested basic sanity - saved search,
> basic/advanced
> > > search, Glossary, tag propagation, Admin purge, system attribute search
> > >
> > >
> > >
> > > On Thu, Jul 9, 2020 at 9:59 PM Madhan Neethiraj 
> > wrote:
> > >
> > > > Atlas team,
> > > >
> > > > Apache Atlas 2.1.0 rc3, with following fixes since rc2, is now
> > available
> > > > for vote within dev community.
> > > >   ATLAS-3877: Purged entity audit throws 404 Entity not found error
> > > >   ATLAS-3882: Classic UI: Loader not disappearing while assigning
> > > category
> > > > to term
> > > >
> > > > Links to the release artifacts are given below. Please review and
> vote.
> > > >
> > > > The vote will be open for at least 72 hours or until necessary votes
> > are
> > > > reached.
> > > >   [ ] +1 Approve
> > > >   [ ] +0 No opinion
> > > >   [ ] -1 Disapprove (and reason why)
> > > >
> > > > Thanks,
> > > > Madhan
> > > >
> > > >
> > > > List of all issues addressed in this release:
> > > > https://issues.apache.org/jira/issues/?jql=project=ATLAS AND
> > > > status=Resolved AND fixVersion=2.1.0 ORDER BY key DESC
> > > >
> > > > Git tag for the release:
> > > > https://github.com/apache/atlas/tree/release-2.1.0-rc3
> > > > Sources for the release:
> > > >
> > >
> >
> https://dist.apache.org/repos/dist/dev/atlas/2.1.0-rc3/apache-atlas-2.1.0-sources.tar.gz
> > > >
> > > > Source release verification:
> > > >   PGP Signature:
> > > >
> > >
> >
> https://dist.apache.org/repos/dist/dev/atlas/2.1.0-rc3/apache-atlas-2.1.0-sources.tar.gz.asc
> > > >   SHA512 Hash:
> > > >
> > >
> >
> https://dist.apache.org/repos/dist/dev/atlas/2.1.0-rc3/apache-atlas-2.1.0-sources.tar.gz.sha512
> > > >   MD5 Hash:
> > > >
> > >
> >
> https://dist.apache.org/repos/dist/dev/atlas/2.1.0-rc3/apache-atlas-2.1.0-sources.tar.gz.md5
> > > >
> > > > Keys to verify the signature of the release artifacts are available
> at:
> > > > https://dist.apache.org/repos/dist/release/atlas/KEYS
> > > >
> > > > New features/enhancements:
> > > >   - Quick Search: provides a simpler search experience with
> type-ahead
> > > > suggestions
> > > >   - Business Metadata: enables augmenting entity-types with
> additional
> > > > attributes, search entities using these attributes
> > > >   - Labels: ability to add/remove labels on entities, and search
> > entities
> > > > using labels
> > > >   - Custom Attributes: ability to add entity instance specific custom
> > > > attributes i.e. attributes not defined in entity-def or business
> > metadata
> > > >   - Entity Purge: added REST APIs to purge deleted entities
> > > >
> > > > Enhancements:
> > > >   - Search: ability to find entities by more than one classification
> > > >   - Performance: improvements in lineage retrieval and
> > > > classification-propagation
> > > >   - Noti

Re: [VOTE] Release Apache Atlas version 2.1.0 - rc3

2020-07-13 Thread Nixon Rodrigues
+1 for Atlas 2.1.0 rc3 release.

Verified signature and MD5/SHA keys.
Verified release tag on git repo.
Verified build with rc3 bits.
Verified UI with Quick Start data.

Thanks  & Regards
Nixon



On Mon, Jul 13, 2020 at 12:44 PM Mandar Ambawane <
mandar.ambaw...@freestoneinfotech.com> wrote:

> +1 for Apache Atlas 2.1.0 RC3 release
>
> Validated the following:
> 1. Verified the source SHA512 and MD5 checksum
> 2. Verified the build with -Pdist,embedded-hbase-solr
> 3. Started Atlas server successfully
> 4. Verified quick_start.py, all entities and tag get created successfully
> 5. Created Business metadata and associated with an entity.
> 6. Checked Basic and advanced search
>
> Thanks,
> Mandar
>
> On Mon, Jul 13, 2020 at 12:39 PM Jayendra Parab 
> wrote:
>
> > +1 for Apache Atlas 2.1.0 RC3 release
> >
> > Validated the following:
> > 1. Verified the source SHA512 and MD5 checksum
> > 2. Verified the build with -Pdist,embedded-hbase-solr
> > 3. Started Atlas server successfully
> > 4. Verified quick_start.py, all entities and tag get created successfully
> > 5. Created entities, applied tags from UI
> > 6. Checked Basic and advanced search
> >
> > Regards,
> > Jayendra.
> >
> > On Mon, Jul 13, 2020 at 12:17 PM Sarath Subramanian 
> > wrote:
> >
> > > +1 for Apache Atlas 2.1 rc3
> > >
> > > Validated the following:
> > > - Validated MD5 checksum
> > > - Validated sha512 hash
> > > - Verified PGP signature
> > > - No binaries in extracted source
> > > - Built successfully using embedded-hbase and solr profile
> > > - Ran quick start and tested basic sanity - saved search,
> basic/advanced
> > > search, Glossary, tag propagation, Admin purge, system attribute search
> > >
> > >
> > >
> > > On Thu, Jul 9, 2020 at 9:59 PM Madhan Neethiraj 
> > wrote:
> > >
> > > > Atlas team,
> > > >
> > > > Apache Atlas 2.1.0 rc3, with following fixes since rc2, is now
> > available
> > > > for vote within dev community.
> > > >   ATLAS-3877: Purged entity audit throws 404 Entity not found error
> > > >   ATLAS-3882: Classic UI: Loader not disappearing while assigning
> > > category
> > > > to term
> > > >
> > > > Links to the release artifacts are given below. Please review and
> vote.
> > > >
> > > > The vote will be open for at least 72 hours or until necessary votes
> > are
> > > > reached.
> > > >   [ ] +1 Approve
> > > >   [ ] +0 No opinion
> > > >   [ ] -1 Disapprove (and reason why)
> > > >
> > > > Thanks,
> > > > Madhan
> > > >
> > > >
> > > > List of all issues addressed in this release:
> > > > https://issues.apache.org/jira/issues/?jql=project=ATLAS AND
> > > > status=Resolved AND fixVersion=2.1.0 ORDER BY key DESC
> > > >
> > > > Git tag for the release:
> > > > https://github.com/apache/atlas/tree/release-2.1.0-rc3
> > > > Sources for the release:
> > > >
> > >
> >
> https://dist.apache.org/repos/dist/dev/atlas/2.1.0-rc3/apache-atlas-2.1.0-sources.tar.gz
> > > >
> > > > Source release verification:
> > > >   PGP Signature:
> > > >
> > >
> >
> https://dist.apache.org/repos/dist/dev/atlas/2.1.0-rc3/apache-atlas-2.1.0-sources.tar.gz.asc
> > > >   SHA512 Hash:
> > > >
> > >
> >
> https://dist.apache.org/repos/dist/dev/atlas/2.1.0-rc3/apache-atlas-2.1.0-sources.tar.gz.sha512
> > > >   MD5 Hash:
> > > >
> > >
> >
> https://dist.apache.org/repos/dist/dev/atlas/2.1.0-rc3/apache-atlas-2.1.0-sources.tar.gz.md5
> > > >
> > > > Keys to verify the signature of the release artifacts are available
> at:
> > > > https://dist.apache.org/repos/dist/release/atlas/KEYS
> > > >
> > > > New features/enhancements:
> > > >   - Quick Search: provides a simpler search experience with
> type-ahead
> > > > suggestions
> > > >   - Business Metadata: enables augmenting entity-types with
> additional
> > > > attributes, search entities using these attributes
> > > >   - Labels: ability to add/remove labels on entities, and search
> > entities
> > > > using labels
> > > >   - Custom Attributes: ability to add entity instance specific custom
> > > > attributes i.e. attributes not defined in entity-def or business
> > metadata
> > > >   - Entity Purge: added REST APIs to purge deleted entities
> > > >
> > > > Enhancements:
> > > >   - Search: ability to find entities by more than one classification
> > > >   - Performance: improvements in lineage retrieval and
> > > > classification-propagation
> > > >   - Notification: ability to process notifications from multiple
> Kafka
> > > > topics
> > > >   - Hive Hook: tracks process-executions via hive_process_execution
> > > > entities
> > > >   - Hive Hook: captures DDL operations via hive_db_ddl and
> > hive_table_ddl
> > > > entities
> > > >   - Notification: introduced shell entities to record references to
> > > > non-existing entities in notifications
> > > >   - Spark: added model to capture Spark entities, processes and
> > > > relationships
> > > >   - AWS S3: introduced updated model to capture AWS S3 entities and
> > > > relationships
> > > >   - ADLS-Gen2: introduced model to capture Azur

Re: [VOTE] Release Apache Atlas version 2.1.0 - rc3

2020-07-13 Thread Sharmadha Sainath
+1 for Apache Atlas 2.1.0-rc3 release.

   - Validated MD5 and SHA512 checksum of source.
   - Verified PGP Signature
   - Brought up Atlas using embedded HBase and Solr.
   - Verified DSL , Basic Search , Quick search and Suggestions
   - Validated CRUD on labels, custom attributes , business metadata
   - Verified Basic search using system attributes filters (multiple
   classifications , labels , custom attributes , business metadata search)
   - Added labels , user defined properties (custom attributes) , business
   metadata to entities and verified the entity properties and audits.
   - Purged Soft Deleted entity  and verified the audits of purged entity.
   Deleted tag associated to the purged entity and verified there are no
   references.
   - Saved the Favorite searches and executed them.
   - Tested Atlas UI against XSS strings

Thanks,
Sharmadha Sainath

On Mon, Jul 13, 2020 at 7:15 PM Nixon Rodrigues <
nixon.rodrig...@freestoneinfotech.com> wrote:

> +1 for Atlas 2.1.0 rc3 release.
>
> Verified signature and MD5/SHA keys.
> Verified release tag on git repo.
> Verified build with rc3 bits.
> Verified UI with Quick Start data.
>
> Thanks  & Regards
> Nixon
>
>
>
> On Mon, Jul 13, 2020 at 12:44 PM Mandar Ambawane <
> mandar.ambaw...@freestoneinfotech.com> wrote:
>
> > +1 for Apache Atlas 2.1.0 RC3 release
> >
> > Validated the following:
> > 1. Verified the source SHA512 and MD5 checksum
> > 2. Verified the build with -Pdist,embedded-hbase-solr
> > 3. Started Atlas server successfully
> > 4. Verified quick_start.py, all entities and tag get created successfully
> > 5. Created Business metadata and associated with an entity.
> > 6. Checked Basic and advanced search
> >
> > Thanks,
> > Mandar
> >
> > On Mon, Jul 13, 2020 at 12:39 PM Jayendra Parab <
> jayendra.pa...@gmail.com>
> > wrote:
> >
> > > +1 for Apache Atlas 2.1.0 RC3 release
> > >
> > > Validated the following:
> > > 1. Verified the source SHA512 and MD5 checksum
> > > 2. Verified the build with -Pdist,embedded-hbase-solr
> > > 3. Started Atlas server successfully
> > > 4. Verified quick_start.py, all entities and tag get created
> successfully
> > > 5. Created entities, applied tags from UI
> > > 6. Checked Basic and advanced search
> > >
> > > Regards,
> > > Jayendra.
> > >
> > > On Mon, Jul 13, 2020 at 12:17 PM Sarath Subramanian  >
> > > wrote:
> > >
> > > > +1 for Apache Atlas 2.1 rc3
> > > >
> > > > Validated the following:
> > > > - Validated MD5 checksum
> > > > - Validated sha512 hash
> > > > - Verified PGP signature
> > > > - No binaries in extracted source
> > > > - Built successfully using embedded-hbase and solr profile
> > > > - Ran quick start and tested basic sanity - saved search,
> > basic/advanced
> > > > search, Glossary, tag propagation, Admin purge, system attribute
> search
> > > >
> > > >
> > > >
> > > > On Thu, Jul 9, 2020 at 9:59 PM Madhan Neethiraj 
> > > wrote:
> > > >
> > > > > Atlas team,
> > > > >
> > > > > Apache Atlas 2.1.0 rc3, with following fixes since rc2, is now
> > > available
> > > > > for vote within dev community.
> > > > >   ATLAS-3877: Purged entity audit throws 404 Entity not found error
> > > > >   ATLAS-3882: Classic UI: Loader not disappearing while assigning
> > > > category
> > > > > to term
> > > > >
> > > > > Links to the release artifacts are given below. Please review and
> > vote.
> > > > >
> > > > > The vote will be open for at least 72 hours or until necessary
> votes
> > > are
> > > > > reached.
> > > > >   [ ] +1 Approve
> > > > >   [ ] +0 No opinion
> > > > >   [ ] -1 Disapprove (and reason why)
> > > > >
> > > > > Thanks,
> > > > > Madhan
> > > > >
> > > > >
> > > > > List of all issues addressed in this release:
> > > > > https://issues.apache.org/jira/issues/?jql=project=ATLAS AND
> > > > > status=Resolved AND fixVersion=2.1.0 ORDER BY key DESC
> > > > >
> > > > > Git tag for the release:
> > > > > https://github.com/apache/atlas/tree/release-2.1.0-rc3
> > > > > Sources for the release:
> > > > >
> > > >
> > >
> >
> https://dist.apache.org/repos/dist/dev/atlas/2.1.0-rc3/apache-atlas-2.1.0-sources.tar.gz
> > > > >
> > > > > Source release verification:
> > > > >   PGP Signature:
> > > > >
> > > >
> > >
> >
> https://dist.apache.org/repos/dist/dev/atlas/2.1.0-rc3/apache-atlas-2.1.0-sources.tar.gz.asc
> > > > >   SHA512 Hash:
> > > > >
> > > >
> > >
> >
> https://dist.apache.org/repos/dist/dev/atlas/2.1.0-rc3/apache-atlas-2.1.0-sources.tar.gz.sha512
> > > > >   MD5 Hash:
> > > > >
> > > >
> > >
> >
> https://dist.apache.org/repos/dist/dev/atlas/2.1.0-rc3/apache-atlas-2.1.0-sources.tar.gz.md5
> > > > >
> > > > > Keys to verify the signature of the release artifacts are available
> > at:
> > > > > https://dist.apache.org/repos/dist/release/atlas/KEYS
> > > > >
> > > > > New features/enhancements:
> > > > >   - Quick Search: provides a simpler search experience with
> > type-ahead
> > > > > suggestions
> > > > >   - Business Metadata: enables augmenting entity-types with
> > additio

[jira] [Commented] (ATLAS-3885) import-hive.sh: Hive entities with Ozone location created by import-hive.sh creates hdfs_path entity instead of ozone in Atlas

2020-07-13 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/ATLAS-3885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17156928#comment-17156928
 ] 

ASF subversion and git services commented on ATLAS-3885:


Commit cec7aa851e6befa6d32f3dfd80cc79cc8c3c799a in atlas's branch 
refs/heads/master from Nikhil Bonte
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=cec7aa8 ]

ATLAS-3885: import-hive.sh: Hive entities with Ozone location created by 
import-hive.sh creates hdfs_path entity instead of ozone in Atlas

Signed-off-by: Sarath Subramanian 


> import-hive.sh: Hive entities with Ozone location created by import-hive.sh 
> creates hdfs_path entity instead of ozone in Atlas
> --
>
> Key: ATLAS-3885
> URL: https://issues.apache.org/jira/browse/ATLAS-3885
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 2.0.0
>Reporter: Nikhil Bonte
>Assignee: Nikhil Bonte
>Priority: Major
>  Labels: ozone
> Attachments: ATLAS-3885-import-hive-Hive-entities-with-Ozone-v0.patch
>
>
> import-hive.sh when attempts to import hive entities with Ozone location 
> expected is that ozone_key should get created as path entity, but script 
> creates hdfs_path entity instead of ozone_key in Atlas.
>  
> Steps to reproduce
>  # Disable HMS Hook and Hive Hook
>  # Create external table with ozone location
>  # Run import-hive.sh
> The location entity is created as an hdfs_path entity instead of ozone_key.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (ATLAS-3885) import-hive.sh: Hive entities with Ozone location created by import-hive.sh creates hdfs_path entity instead of ozone in Atlas

2020-07-13 Thread ASF subversion and git services (Jira)


[ 
https://issues.apache.org/jira/browse/ATLAS-3885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17156929#comment-17156929
 ] 

ASF subversion and git services commented on ATLAS-3885:


Commit 87602b693951f76d2af836cd74db4b1b2a3f2be6 in atlas's branch 
refs/heads/branch-2.0 from Nikhil Bonte
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=87602b6 ]

ATLAS-3885: import-hive.sh: Hive entities with Ozone location created by 
import-hive.sh creates hdfs_path entity instead of ozone in Atlas

Signed-off-by: Sarath Subramanian 
(cherry picked from commit cec7aa851e6befa6d32f3dfd80cc79cc8c3c799a)


> import-hive.sh: Hive entities with Ozone location created by import-hive.sh 
> creates hdfs_path entity instead of ozone in Atlas
> --
>
> Key: ATLAS-3885
> URL: https://issues.apache.org/jira/browse/ATLAS-3885
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 2.0.0
>Reporter: Nikhil Bonte
>Assignee: Nikhil Bonte
>Priority: Major
>  Labels: ozone
> Attachments: ATLAS-3885-import-hive-Hive-entities-with-Ozone-v0.patch
>
>
> import-hive.sh when attempts to import hive entities with Ozone location 
> expected is that ozone_key should get created as path entity, but script 
> creates hdfs_path entity instead of ozone_key in Atlas.
>  
> Steps to reproduce
>  # Disable HMS Hook and Hive Hook
>  # Create external table with ozone location
>  # Run import-hive.sh
> The location entity is created as an hdfs_path entity instead of ozone_key.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-3885) import-hive.sh: Hive entities with Ozone location created by import-hive.sh creates hdfs_path entity instead of ozone in Atlas

2020-07-13 Thread Sarath Subramanian (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sarath Subramanian updated ATLAS-3885:
--
Fix Version/s: 2.1.0
   trunk

> import-hive.sh: Hive entities with Ozone location created by import-hive.sh 
> creates hdfs_path entity instead of ozone in Atlas
> --
>
> Key: ATLAS-3885
> URL: https://issues.apache.org/jira/browse/ATLAS-3885
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 2.0.0
>Reporter: Nikhil Bonte
>Assignee: Nikhil Bonte
>Priority: Major
>  Labels: ozone
> Fix For: trunk, 2.1.0
>
> Attachments: ATLAS-3885-import-hive-Hive-entities-with-Ozone-v0.patch
>
>
> import-hive.sh when attempts to import hive entities with Ozone location 
> expected is that ozone_key should get created as path entity, but script 
> creates hdfs_path entity instead of ozone_key in Atlas.
>  
> Steps to reproduce
>  # Disable HMS Hook and Hive Hook
>  # Create external table with ozone location
>  # Run import-hive.sh
> The location entity is created as an hdfs_path entity instead of ozone_key.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (ATLAS-3885) import-hive.sh: Hive entities with Ozone location created by import-hive.sh creates hdfs_path entity instead of ozone in Atlas

2020-07-13 Thread Sarath Subramanian (Jira)


 [ 
https://issues.apache.org/jira/browse/ATLAS-3885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sarath Subramanian updated ATLAS-3885:
--
Labels: import ozone  (was: ozone)

> import-hive.sh: Hive entities with Ozone location created by import-hive.sh 
> creates hdfs_path entity instead of ozone in Atlas
> --
>
> Key: ATLAS-3885
> URL: https://issues.apache.org/jira/browse/ATLAS-3885
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 2.0.0
>Reporter: Nikhil Bonte
>Assignee: Nikhil Bonte
>Priority: Major
>  Labels: import, ozone
> Fix For: trunk, 2.1.0
>
> Attachments: ATLAS-3885-import-hive-Hive-entities-with-Ozone-v0.patch
>
>
> import-hive.sh when attempts to import hive entities with Ozone location 
> expected is that ozone_key should get created as path entity, but script 
> creates hdfs_path entity instead of ozone_key in Atlas.
>  
> Steps to reproduce
>  # Disable HMS Hook and Hive Hook
>  # Create external table with ozone location
>  # Run import-hive.sh
> The location entity is created as an hdfs_path entity instead of ozone_key.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


Re: Review Request 72666: Notification: Solution to Memory Build-up

2020-07-13 Thread Ashutosh Mestry via Review Board

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/72666/
---

(Updated July 13, 2020, 7:45 p.m.)


Review request for atlas, Madhan Neethiraj, Nikhil Bonte, Nixon Rodrigues, and 
Sarath Subramanian.


Changes
---

Updates include: Addressed review comments.


Bugs: ATLAS-3878
https://issues.apache.org/jira/browse/ATLAS-3878


Repository: atlas


Description
---

**Background**
See JIRA for details.

*Analysis* Using memory profiling tools, it was observed that large number of 
notification objects were created. These stayed in memory and later were 
promoted to higher generation, thereby taking even longer to be collected.

**Approach**
Using the fixed-buffer approach to address the problem of creating large number 
of small objects.

New *FixedBufferList* This is an encapsulation over *ArrayList*. During initial 
allocation, list is populated with default values. Features:
- Setting of values to these pre-allocated objects is achieved by first doing a 
*get* on the element and then assigning values to it.
- *toList* fetches the sub-list from the encapsulating list. This uses the 
state within the class to fetch the right length for the returning array.

New *NamedFixedBufferList* Maintains a per-thread *FixedBufferList*. This is 
necessary since the list is now part class's state.
Modified *EntityAuditListenerV2* Uses the new classes.
Modifed *EntityNotificationListener* Uses the new classes.

**Verification**
- Using the test setup, the memory usage was observed over a period of 24 hrs. 
- Memory usage and object allocation was obvserved using memory profiler.


Diffs (updated)
-

  intg/src/main/java/org/apache/atlas/AtlasConfiguration.java 2c007ca01 
  intg/src/main/java/org/apache/atlas/utils/FixedBufferList.java PRE-CREATION 
  intg/src/main/java/org/apache/atlas/utils/FixedBufferListAccessor.java 
PRE-CREATION 
  intg/src/test/java/org/apache/atlas/utils/FixedBufferListAccessorTest.java 
PRE-CREATION 
  intg/src/test/java/org/apache/atlas/utils/FixedBufferListTest.java 
PRE-CREATION 
  
repository/src/main/java/org/apache/atlas/repository/audit/EntityAuditListenerV2.java
 79527acfa 
  
webapp/src/main/java/org/apache/atlas/notification/EntityNotificationListenerV2.java
 a677b315c 


Diff: https://reviews.apache.org/r/72666/diff/4/

Changes: https://reviews.apache.org/r/72666/diff/3-4/


Testing
---

**Unit testing**
Unit tests added for the new classes.

**Volume testing**
Setup:
- Node: Threads 40, Core: 40, Allocated Memory: 12 GB
- Multiple Kafka queues ingesting data.
- Bulk entity creation using custom script ingesting 100M entities.

Memory usage stayed between 0 and 5% during the 24 hr period.

With:
- Workers: 64
- Batch size: 50 (fewer elements in batch improve commit time and audit write 
time).
- Throughput: ~1.2 M entities per hour.

**Pre-commit**
https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/2035/


Thanks,

Ashutosh Mestry



Re: Review Request 72666: Notification: Solution to Memory Build-up

2020-07-13 Thread Ashutosh Mestry via Review Board


> On July 10, 2020, 8:11 p.m., Madhan Neethiraj wrote:
> > intg/src/main/java/org/apache/atlas/utils/FixedBufferList.java
> > Lines 38 (patched)
> > 
> >
> > 'bufferElementClass' can be derived from the generic, as below. With 
> > this, bufferElementClass argument can be eliminated.
> > 
> >   ParameterizedType genericSuperclass = (ParameterizedType) 
> > getClass().getGenericSuperclass();
> >   Type  type  = 
> > genericSuperclass.getActualTypeArguments()[0];
> > 
> >   if (type instanceof ParameterizedType) {
> > this.bufferElementClass = (Class) ((ParameterizedType) 
> > type).getRawType();
> >   } else {
> > this.bufferElementClass = (Class) type;
> >   }

This inference mechanism works only when a concreate class is derived from the 
gerneric. I have done that. This leads to 2 additional classes but makes the 
implementation cleaner.


> On July 10, 2020, 8:11 p.m., Madhan Neethiraj wrote:
> > intg/src/main/java/org/apache/atlas/utils/FixedBufferList.java
> > Lines 56 (patched)
> > 
> >
> > - set() => add() - to be consistent with ArrayList
> > - better yet, consider collapsing both get() and set() with the 
> > following:
> > public T getForUpdate(int idx) {
> >   if (this.length <= idx) {
> > this.length = (idx + 1);
> > 
> > request(this.length);
> >   }
> > 
> >   return buffer.get(idx);
> > }

I hve implemented getForUpdate that makes add or set unnecessary.


> On July 10, 2020, 8:11 p.m., Madhan Neethiraj wrote:
> > intg/src/main/java/org/apache/atlas/utils/FixedBufferList.java
> > Lines 62 (patched)
> > 
> >
> > Calling toList() effectively clears the buffer (since the 
> > currentIndex/length is reset). This is not intutive. Consider adding a 
> > separate method, reset(), for this.

Adding reset will lead to additional call in the usage.


> On July 10, 2020, 8:11 p.m., Madhan Neethiraj wrote:
> > intg/src/main/java/org/apache/atlas/utils/FixedBufferList.java
> > Lines 77 (patched)
> > 
> >
> > It might help to defer instantiation until an entry is accessed. 
> > Consider handling this in get(idx):
> >   public T get(int i) {
> > request(i + 1);
> > 
> > T ret = buffer.get(i);
> > 
> > if (ret == null) {
> >   ret = elementClass.newInstance();
> >   
> >   buffer.set(i, ret);
> > }
> > 
> > return ret;
> >   }
> > 
> > With this change, instantiateElements() will not be needed.

I prefer keeping the list ready when accessed.


> On July 10, 2020, 8:11 p.m., Madhan Neethiraj wrote:
> > intg/src/main/java/org/apache/atlas/utils/FixedBufferList.java
> > Lines 83 (patched)
> > 
> >
> > The intrepretation of 'incrementByFactor' doesn't look right. Shouldn't 
> > it be something like:
> > 
> >   // incrementByFactor should be a float, with value > 0
> >   // incrCapacity can be initialized in constructor as well
> >   int incrCapacity = (int) (this.capacity * incrementByFactor) + 1.0F;
> > 
> >   int newCapacity = this.capacity; 
> > 
> >   for (; newCapacity < requestedSize; newCapacity += incrCapacity);
> >   
> >   this.buffer.ensureCapacity(newCapacity);
> >   
> >   return newCapacity;

incrementByFactor increments the current capacity.


- Ashutosh


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/72666/#review221193
---


On July 13, 2020, 7:45 p.m., Ashutosh Mestry wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/72666/
> ---
> 
> (Updated July 13, 2020, 7:45 p.m.)
> 
> 
> Review request for atlas, Madhan Neethiraj, Nikhil Bonte, Nixon Rodrigues, 
> and Sarath Subramanian.
> 
> 
> Bugs: ATLAS-3878
> https://issues.apache.org/jira/browse/ATLAS-3878
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> **Background**
> See JIRA for details.
> 
> *Analysis* Using memory profiling tools, it was observed that large number of 
> notification objects were created. These stayed in memory and later were 
> promoted to higher generation, thereby taking even longer to be collected.
> 
> **Approach**
> Using the fixed-buffer approach to address the problem of creating large 
> nu

Re: [VOTE] Release Apache Atlas version 2.1.0 - rc3

2020-07-13 Thread vishal suvagia
+1 for Apache Atlas 2.1.0 RC#3.
Verified clean compilation and rat-checks.Validated the source checksums and 
hash.Verified quick-start data and UI to be working


RegardsVishal Suvagia.
   On Monday, 13 July, 2020, 9:20:54 pm IST, Sharmadha Sainath 
 wrote:  
 
 +1 for Apache Atlas 2.1.0-rc3 release.

  - Validated MD5 and SHA512 checksum of source.
  - Verified PGP Signature
  - Brought up Atlas using embedded HBase and Solr.
  - Verified DSL , Basic Search , Quick search and Suggestions
  - Validated CRUD on labels, custom attributes , business metadata
  - Verified Basic search using system attributes filters (multiple
  classifications , labels , custom attributes , business metadata search)
  - Added labels , user defined properties (custom attributes) , business
  metadata to entities and verified the entity properties and audits.
  - Purged Soft Deleted entity  and verified the audits of purged entity.
  Deleted tag associated to the purged entity and verified there are no
  references.
  - Saved the Favorite searches and executed them.
  - Tested Atlas UI against XSS strings

Thanks,
Sharmadha Sainath

On Mon, Jul 13, 2020 at 7:15 PM Nixon Rodrigues <
nixon.rodrig...@freestoneinfotech.com> wrote:

> +1 for Atlas 2.1.0 rc3 release.
>
> Verified signature and MD5/SHA keys.
> Verified release tag on git repo.
> Verified build with rc3 bits.
> Verified UI with Quick Start data.
>
> Thanks  & Regards
> Nixon
>
>
>
> On Mon, Jul 13, 2020 at 12:44 PM Mandar Ambawane <
> mandar.ambaw...@freestoneinfotech.com> wrote:
>
> > +1 for Apache Atlas 2.1.0 RC3 release
> >
> > Validated the following:
> > 1. Verified the source SHA512 and MD5 checksum
> > 2. Verified the build with -Pdist,embedded-hbase-solr
> > 3. Started Atlas server successfully
> > 4. Verified quick_start.py, all entities and tag get created successfully
> > 5. Created Business metadata and associated with an entity.
> > 6. Checked Basic and advanced search
> >
> > Thanks,
> > Mandar
> >
> > On Mon, Jul 13, 2020 at 12:39 PM Jayendra Parab <
> jayendra.pa...@gmail.com>
> > wrote:
> >
> > > +1 for Apache Atlas 2.1.0 RC3 release
> > >
> > > Validated the following:
> > > 1. Verified the source SHA512 and MD5 checksum
> > > 2. Verified the build with -Pdist,embedded-hbase-solr
> > > 3. Started Atlas server successfully
> > > 4. Verified quick_start.py, all entities and tag get created
> successfully
> > > 5. Created entities, applied tags from UI
> > > 6. Checked Basic and advanced search
> > >
> > > Regards,
> > > Jayendra.
> > >
> > > On Mon, Jul 13, 2020 at 12:17 PM Sarath Subramanian  >
> > > wrote:
> > >
> > > > +1 for Apache Atlas 2.1 rc3
> > > >
> > > > Validated the following:
> > > > - Validated MD5 checksum
> > > > - Validated sha512 hash
> > > > - Verified PGP signature
> > > > - No binaries in extracted source
> > > > - Built successfully using embedded-hbase and solr profile
> > > > - Ran quick start and tested basic sanity - saved search,
> > basic/advanced
> > > > search, Glossary, tag propagation, Admin purge, system attribute
> search
> > > >
> > > >
> > > >
> > > > On Thu, Jul 9, 2020 at 9:59 PM Madhan Neethiraj 
> > > wrote:
> > > >
> > > > > Atlas team,
> > > > >
> > > > > Apache Atlas 2.1.0 rc3, with following fixes since rc2, is now
> > > available
> > > > > for vote within dev community.
> > > > >  ATLAS-3877: Purged entity audit throws 404 Entity not found error
> > > > >  ATLAS-3882: Classic UI: Loader not disappearing while assigning
> > > > category
> > > > > to term
> > > > >
> > > > > Links to the release artifacts are given below. Please review and
> > vote.
> > > > >
> > > > > The vote will be open for at least 72 hours or until necessary
> votes
> > > are
> > > > > reached.
> > > > >  [ ] +1 Approve
> > > > >  [ ] +0 No opinion
> > > > >  [ ] -1 Disapprove (and reason why)
> > > > >
> > > > > Thanks,
> > > > > Madhan
> > > > >
> > > > >
> > > > > List of all issues addressed in this release:
> > > > > https://issues.apache.org/jira/issues/?jql=project=ATLAS AND
> > > > > status=Resolved AND fixVersion=2.1.0 ORDER BY key DESC
> > > > >
> > > > > Git tag for the release:
> > > > > https://github.com/apache/atlas/tree/release-2.1.0-rc3
> > > > > Sources for the release:
> > > > >
> > > >
> > >
> >
> https://dist.apache.org/repos/dist/dev/atlas/2.1.0-rc3/apache-atlas-2.1.0-sources.tar.gz
> > > > >
> > > > > Source release verification:
> > > > >  PGP Signature:
> > > > >
> > > >
> > >
> >
> https://dist.apache.org/repos/dist/dev/atlas/2.1.0-rc3/apache-atlas-2.1.0-sources.tar.gz.asc
> > > > >  SHA512 Hash:
> > > > >
> > > >
> > >
> >
> https://dist.apache.org/repos/dist/dev/atlas/2.1.0-rc3/apache-atlas-2.1.0-sources.tar.gz.sha512
> > > > >  MD5 Hash:
> > > > >
> > > >
> > >
> >
> https://dist.apache.org/repos/dist/dev/atlas/2.1.0-rc3/apache-atlas-2.1.0-sources.tar.gz.md5
> > > > >
> > > > > Keys to verify the signature of the release artifacts are available
> > at:
> > > > > https://dist.apache.org/repos/dist/release/atla