[jira] [Updated] (ATLAS-2635) added REST APIs to add/update/remove classifications for an entity given its type and unique attributes

[Ruchi Solani (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-2635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ruchi Solani updated ATLAS-2635:

Summary: added REST APIs to add/update/remove classifications for an entity 
given its type and unique attributes  (was: Add method to refer entity by 
unique Attributes)

> added REST APIs to add/update/remove classifications for an entity given its 
> type and unique attributes
> ---
>
> Key: ATLAS-2635
> URL: https://issues.apache.org/jira/browse/ATLAS-2635
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Reporter: Ruchi Solani
>Assignee: Ruchi Solani
>Priority: Major
>
> Many of the APIs in EntityREST require entity-guid to be provided. It will be 
> useful to operate on entities given its typeName and uniqueAttributes.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (ATLAS-2635) Added REST APIs to add/update/remove classifications for an entity given its type and unique attributes

[Ruchi Solani (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-2635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ruchi Solani updated ATLAS-2635:

Summary: Added REST APIs to add/update/remove classifications for an entity 
given its type and unique attributes  (was: added REST APIs to 
add/update/remove classifications for an entity given its type and unique 
attributes)

> Added REST APIs to add/update/remove classifications for an entity given its 
> type and unique attributes
> ---
>
> Key: ATLAS-2635
> URL: https://issues.apache.org/jira/browse/ATLAS-2635
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Reporter: Ruchi Solani
>Assignee: Ruchi Solani
>Priority: Major
>
> Many of the APIs in EntityREST require entity-guid to be provided. It will be 
> useful to operate on entities given its typeName and uniqueAttributes.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: Review Request 66929: Add method to refer entity by unique Attributes

[Ruchi Solani]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/66929/
---

(Updated May 3, 2018, 6:39 a.m.)


Review request for atlas and Madhan Neethiraj.


Changes
---

added REST APIs to add/update/remove classifications for an entity given its 
type and unique attributes


Bugs: ATLAS-2635
https://issues.apache.org/jira/browse/ATLAS-2635


Repository: atlas


Description
---

Many of the APIs in EntityREST require entity-guid to be provided. It will be 
useful to operate on entities given its typeName and uniqueAttributes.


Diffs (updated)
-

  
repository/src/main/java/org/apache/atlas/repository/store/graph/AtlasEntityStore.java
 eb825c4d3 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v1/AtlasEntityStoreV1.java
 316d78c64 
  webapp/src/main/java/org/apache/atlas/web/rest/EntityREST.java 17a6eced3 
  webapp/src/test/java/org/apache/atlas/web/adapters/TestEntityREST.java 
f0bc9628c 


Diff: https://reviews.apache.org/r/66929/diff/2/

Changes: https://reviews.apache.org/r/66929/diff/1-2/


Testing
---

Done with sanity testing


Thanks,

Ruchi Solani

Build failed in Jenkins: Atlas-master-IntegrationTests #1226

[Apache Jenkins Server]

See 


Changes:

[amestry] ATLAS-2624: (2): Fixed the case where same classifications are

--
[...truncated 574.07 KB...]
127.0.0.1 - - [03/May/2018:05:44:12 +] "GET 
//localhost:31000/api/atlas/v2/types/typedef/name/hive_table_v1 HTTP/1.1" 200 
1854 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:05:44:12 +] "GET 
//localhost:31000/api/atlas/v2/types/typedef/name/hive_process_v1 HTTP/1.1" 200 
1401 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:05:44:12 +] "POST 
//localhost:31000/api/atlas/types HTTP/1.1" 201 192 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:05:44:13 +] "GET 
//localhost:31000/api/atlas/discovery/search/dsl?query=hive_db+where+qualifiedName%3D'dbz4laQ7FlxH'&limit=10&offset=0
 HTTP/1.1" 200 643 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:05:44:14 +] "GET 
//localhost:31000/api/atlas/entities?type=hive_db&property=qualifiedName&value=dbz4laQ7FlxH
 HTTP/1.1" 200 723 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:05:44:14 +] "GET 
//localhost:31000/api/atlas/entities/158ce238-4de9-4036-8ceb-c5c544538b9b/audit?count=1
 HTTP/1.1" 200 1008 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:05:44:14 +] "POST 
//localhost:31000/api/atlas/entities HTTP/1.1" 201 881 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:05:44:15 +] "GET 
//localhost:31000/api/atlas/entities/768bf5e5-eb88-4f65-bb94-6469f79fe601 
HTTP/1.1" 200 721 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:05:44:17 +] "GET 
//localhost:31000/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'dbjqGC3XxH0W'&limit=10&offset=0
 HTTP/1.1" 200 634 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:05:44:17 +] "POST 
//localhost:31000/api/atlas/entities HTTP/1.1" 201 881 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:05:44:19 +] "GET 
//localhost:31000/api/atlas/discovery/search/dsl?query=hive_db+where+qualifiedName%3D'dbcSWzaJxCOo'&limit=10&offset=0
 HTTP/1.1" 200 646 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:05:44:19 +] "GET 
//localhost:31000/api/atlas/entities?type=hive_db&property=qualifiedName&value=dbcSWzaJxCOo
 HTTP/1.1" 200 726 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:05:44:19 +] "POST 
//localhost:31000/api/atlas/entities HTTP/1.1" 201 881 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:05:44:20 +] "GET 
//localhost:31000/api/atlas/entities?type=hive_db&property=qualifiedName&value=dbRTMVzBCqwC
 HTTP/1.1" 200 728 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:05:44:20 +] "GET 
//localhost:31000/api/atlas/entities?type=hive_db&property=qualifiedName&value=dbRTMVzBCqwC
 HTTP/1.1" 200 728 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:05:44:20 +] "POST 
//localhost:31000/api/atlas/entities HTTP/1.1" 201 881 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:05:44:21 +] "GET 
//localhost:31000/api/atlas/discovery/search/dsl?query=hive_db+where+qualifiedName%3D'dbtQe4XYW6Xz'&limit=10&offset=0
 HTTP/1.1" 200 640 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:05:44:22 +] "GET 
//localhost:31000/api/atlas/discovery/search/dsl?query=hive_db+where+qualifiedName%3D'dboU9Pk3LsSp'&limit=10&offset=0
 HTTP/1.1" 200 184 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:05:44:22 +] "GET 
//localhost:31000/api/atlas/v2/types/typedef/name/PII_TraitJS9AFNk8hF HTTP/1.1" 
404 96 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:05:44:22 +] "POST 
//localhost:31000/api/atlas/v2/types/typedefs/ HTTP/1.1" 200 425 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:05:44:22 +] "POST 
//localhost:31000/api/atlas/v2/entity/guid/ec1c6893-f75d-4b10-b8b1-ce3e6f84dff4/classifications
 HTTP/1.1" 204 0 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:05:44:23 +] "GET 
//localhost:31000/api/atlas/entities/ec1c6893-f75d-4b10-b8b1-ce3e6f84dff4/audit?count=100
 HTTP/1.1" 200 21392 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:05:44:23 +] "GET 
//localhost:31000/api/atlas/v2/types/typedef/name/PII_TraitsFiCLhDsjv HTTP/1.1" 
404 96 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:05:44:23 +] "POST 
//localhost:31000/api/atlas/v2/types/typedefs/ HTTP/1.1" 200 576 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:05:44:23 +] "POST 
//localhost:31000/api/atlas/v2/entity/guid/ec1c6893-f75d-4b10-b8b1-ce3e6f84dff4/classifications
 HTTP/1.1" 204 0 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:05:44:23 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/ec1c6893-f75d-4b10-b8b1-ce3e6f84dff4 
HTTP/1.1" 200 2166 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:05:44:23 +] "GET 
//localhost:31000/api/atlas/v2/types/typedef/name/PII_TraitrVXs8aycw6 HTTP/1.1" 
404 96 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:05:44:23 +] "POST 
//localhost:31000/api/atlas/v2/types/typedefs/ HTTP/1.1" 200 425 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:05:44:23 +] "POST 
//localhost:31000/api/atlas/v2/entity/guid/ec1c6893-f75d-4b

Re: Review Request 66928: Data Migration: Import: Infer Types that Store Edge Ids

[Ashutosh Mestry]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/66928/
---

(Updated May 3, 2018, 5:39 a.m.)


Review request for atlas, Madhan Neethiraj and Ruchi Solani.


Changes
---

Updates include:
- Refactored _AtlasGraphSONReader.Builder.setDefaults_.


Bugs: ATLAS-2637
https://issues.apache.org/jira/browse/ATLAS-2637


Repository: atlas


Description
---

**Approach**
New class: _TypesStoringEdgeIds_: Navigates through all the types in the 
_typeRegistry_, returns map of entity type and properties that store edge ids.
Modified: _DataMigrationService_: Uses output from class above and passes it 
down to migration.
Modified: _PostProcessManager_: Uses the map generated above and uses it for 
post processing.
Modified: _GraphSONUtility_: Improvement to check for vertex of type. This 
avoids potential exeception when a non-existent property is checked for 
presence.


Diffs (updated)
-

  graphdb/api/src/main/java/org/apache/atlas/repository/graphdb/AtlasGraph.java 
607baf664 
  
graphdb/janus/src/main/java/org/apache/atlas/repository/graphdb/janus/AtlasJanusGraph.java
 c0b9c1741 
  
graphdb/janus/src/main/java/org/apache/atlas/repository/graphdb/janus/AtlasJanusGraphDatabase.java
 86cd29900 
  
graphdb/janus/src/main/java/org/apache/atlas/repository/graphdb/janus/migration/AtlasGraphSONReader.java
 aa0b6375d 
  
graphdb/janus/src/main/java/org/apache/atlas/repository/graphdb/janus/migration/GraphSONUtility.java
 ec320b03e 
  
graphdb/janus/src/main/java/org/apache/atlas/repository/graphdb/janus/migration/PostProcessManager.java
 d0a65f7b1 
  
graphdb/janus/src/test/java/org/apache/atlas/repository/graphdb/janus/migration/GraphSONUtilityPostProcessTest.java
 4d73c78ef 
  
graphdb/titan0/src/main/java/org/apache/atlas/repository/graphdb/titan0/Titan0Graph.java
 d191b5549 
  intg/src/main/java/org/apache/atlas/store/AtlasTypeDefStore.java b05754f4b 
  
repository/src/main/java/org/apache/atlas/repository/migration/DataMigrationService.java
 22cd55217 
  
repository/src/main/java/org/apache/atlas/repository/migration/TypesStoringEdgeIds.java
 PRE-CREATION 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v1/AtlasTypeDefGraphStoreV1.java
 3c84e3c22 
  
repository/src/test/java/org/apache/atlas/repository/migration/MigrationBaseAsserts.java
 ec6e64a25 
  
repository/src/test/java/org/apache/atlas/repository/migration/TypesStoringEdgeIdsTest.java
 PRE-CREATION 


Diff: https://reviews.apache.org/r/66928/diff/2/

Changes: https://reviews.apache.org/r/66928/diff/1-2/


Testing
---

**Unit tests**

Additional tests added.

**Functional tests**

Regular flow verified.


Thanks,

Ashutosh Mestry

Build failed in Jenkins: Atlas-master-IntegrationTests #1225

[Apache Jenkins Server]

See 


--
[...truncated 595.72 KB...]
127.0.0.1 - - [03/May/2018:04:12:42 +] "GET 
//localhost:31000/api/atlas/discovery/search?query=DB_v1+as+db1+Table+where+(db1.name+%3D+%22Reporting%22)&limit=10&offset=0
 HTTP/1.1" 200 192 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:04:12:43 +] "GET 
//localhost:31000/api/atlas/discovery/search?query=DB_v1+where+(name+%3D+%22Reporting%22)+select+name+as+_col_0,+(createTime+%2B+1)+as+_col_1+&limit=10&offset=0
 HTTP/1.1" 200 1138 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:04:12:43 +] "GET 
//localhost:31000/api/atlas/discovery/search?query=Dimension_v1&limit=10&offset=0
 HTTP/1.1" 200 15961 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:04:12:43 +] "GET 
//localhost:31000/api/atlas/discovery/search?query=JdbcAccess_v1&limit=10&offset=0
 HTTP/1.1" 200 1551 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:04:12:44 +] "GET 
//localhost:31000/api/atlas/discovery/search?query=ETL_v1&limit=10&offset=0 
HTTP/1.1" 200 11306 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:04:12:44 +] "GET 
//localhost:31000/api/atlas/discovery/search?query=Metric_v1&limit=10&offset=0 
HTTP/1.1" 200 7918 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:04:12:45 +] "GET 
//localhost:31000/api/atlas/discovery/search?query=PII_v1&limit=10&offset=0 
HTTP/1.1" 200 2528 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:04:12:45 +] "GET 
//localhost:31000/api/atlas/discovery/search?query=%60Log+Data_v1%60&limit=10&offset=0
 HTTP/1.1" 200 7149 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:04:12:46 +] "GET 
//localhost:31000/api/atlas/discovery/search?query=Table_v1+where+name%3D%22sales_fact%22,+columns&limit=10&offset=0
 HTTP/1.1" 200 1669 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:04:12:46 +] "GET 
//localhost:31000/api/atlas/discovery/search?query=Table_v1+where+name%3D%22sales_fact%22,+columns+as+column+select+column.name,+column.dataType,+column.comment&limit=10&offset=0
 HTTP/1.1" 200 569 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:04:12:47 +] "GET 
//localhost:31000/api/atlas/discovery/search?query=from+DataSet&limit=10&offset=0
 HTTP/1.1" 200 22759 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:04:12:47 +] "GET 
//localhost:31000/api/atlas/discovery/search?query=from+Process&limit=10&offset=0
 HTTP/1.1" 200 9754 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:04:12:48 +] "GET 
//localhost:31000/api/atlas/entities?type=DB_v1&property=name&value=Sales 
HTTP/1.1" 200 687 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:04:12:48 +] "GET 
//localhost:31000/api/atlas/entities?type=Table_v1&property=qualifiedName&value=sales_fact
 HTTP/1.1" 200 4109 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:04:12:48 +] "GET 
//localhost:31000/api/atlas/entities?type=Table_v1&property=qualifiedName&value=time_dim
 HTTP/1.1" 200  "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:04:12:48 +] "GET 
//localhost:31000/api/atlas/entities?type=Table_v1&property=qualifiedName&value=sales_fact_daily_mv
 HTTP/1.1" 200 4568 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:04:12:48 +] "GET 
//localhost:31000/api/atlas/lineage/8a7c04ca-4cdb-4664-81b1-ec87612f8534/inputs/graph
 HTTP/1.1" 200 1721 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:04:12:48 +] "GET 
//localhost:31000/api/atlas/entities?type=LoadProcess_v1&property=qualifiedName&value=loadSalesDaily
 HTTP/1.1" 200 1778 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:04:12:48 +] "GET 
//localhost:31000/api/atlas/entities?type=Table_v1&property=qualifiedName&value=sales_fact
 HTTP/1.1" 200 4109 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:04:12:48 +] "GET 
//localhost:31000/api/atlas/entities?type=Table_v1&property=qualifiedName&value=time_dim
 HTTP/1.1" 200  "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:04:12:48 +] "GET 
//localhost:31000/api/atlas/entities?type=Table_v1&property=qualifiedName&value=sales_fact_daily_mv
 HTTP/1.1" 200 4568 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:04:12:48 +] "GET 
//localhost:31000/api/atlas/entities?type=Table_v1&property=qualifiedName&value=sales_fact
 HTTP/1.1" 200 4109 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:04:12:48 +] "GET 
//localhost:31000/api/atlas/entities?type=DB_v1&property=name&value=Sales 
HTTP/1.1" 200 687 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:04:12:48 +] "GET 
//localhost:31000/api/atlas/entities?type=View_v1&property=qualifiedName&value=product_dim_view
 HTTP/1.1" 200 1295 "-" "Java/1.8.0_172"
127.0.0.1 - - [03/May/2018:04:12:48 +] "GET 
//localhost:31000/api/atlas/entities?type=Table_v1&property=qualifiedName&value=product_dim
 HTTP/1.1" 200 3359 "-" "Java/1.8.0_172"
May 03, 2018 4:12:49 AM java.io.ObjectInputStream filterCheck
INFO: ObjectInputFilter REJECTED: null, array length: -1, nRefs: 1, depth: 1, 
bytes: 70, ex: n/a
May 03, 2018 4:12:50 AM ja

Build failed in Jenkins: PreCommit-ATLAS-Build-Test #336-master-0001-Revaluate-removal-of-propagated-classifications-duri.patch

[Apache Jenkins Server]

See 


Changes:

[amestry] ATLAS-2624: (2): Fixed the case where same classifications are

--
[...truncated 304.70 KB...]
at 
org.janusgraph.graphdb.transaction.StandardJanusGraphTx.verifyAttribute(StandardJanusGraphTx.java:580)
at 
org.janusgraph.graphdb.relations.AbstractTypedRelation.property(AbstractTypedRelation.java:120)
at 
org.apache.atlas.repository.graphdb.janus.AtlasJanusElement.setProperty(AtlasJanusElement.java:112)
at 
org.apache.atlas.repository.store.graph.v1.AtlasGraphUtilsV1.setProperty(AtlasGraphUtilsV1.java:208)
at 
org.apache.atlas.repository.store.graph.v1.DeleteHandlerV1.removeTagPropagation(DeleteHandlerV1.java:454)
at 
org.apache.atlas.repository.store.graph.v1.SoftDeleteHandlerV1.deleteEdge(SoftDeleteHandlerV1.java:72)
at 
org.apache.atlas.repository.store.graph.v1.DeleteHandlerV1.deleteEdgeReference(DeleteHandlerV1.java:317)
at 
org.apache.atlas.repository.store.graph.v1.EntityGraphMapper.mapToVertexByTypeCategory(EntityGraphMapper.java:457)
at 
org.apache.atlas.repository.store.graph.v1.EntityGraphMapper.mapAttribute(EntityGraphMapper.java:366)
at 
org.apache.atlas.repository.store.graph.v1.EntityGraphMapper.mapAttributes(EntityGraphMapper.java:297)
at 
org.apache.atlas.repository.store.graph.v1.EntityGraphMapper.mapAttributesAndClassifications(EntityGraphMapper.java:205)
at 
org.apache.atlas.repository.store.graph.v1.AtlasEntityStoreV1.createOrUpdate(AtlasEntityStoreV1.java:636)
at 
org.apache.atlas.repository.store.graph.v1.AtlasEntityStoreV1.createOrUpdate(AtlasEntityStoreV1.java:167)
at 
org.apache.atlas.repository.store.graph.v1.AtlasEntityStoreV1Test.testPartialUpdateAttr(AtlasEntityStoreV1Test.java:769)

testSetObjectIdAttrToNull(org.apache.atlas.repository.store.graph.v1.AtlasEntityStoreV1Test)
  Time elapsed: 0.813 sec  <<< FAILURE!
java.lang.IllegalArgumentException: Property value [NONE] is of type class 
org.apache.atlas.model.typedef.AtlasRelationshipDef$PropagateTags is not 
supported
at 
org.apache.tinkerpop.gremlin.structure.Property$Exceptions.dataTypeOfPropertyValueNotSupported(Property.java:163)
at 
org.apache.tinkerpop.gremlin.structure.Property$Exceptions.dataTypeOfPropertyValueNotSupported(Property.java:159)
at 
org.janusgraph.graphdb.transaction.StandardJanusGraphTx.verifyAttribute(StandardJanusGraphTx.java:580)
at 
org.janusgraph.graphdb.relations.AbstractTypedRelation.property(AbstractTypedRelation.java:120)
at 
org.apache.atlas.repository.graphdb.janus.AtlasJanusElement.setProperty(AtlasJanusElement.java:112)
at 
org.apache.atlas.repository.store.graph.v1.AtlasGraphUtilsV1.setProperty(AtlasGraphUtilsV1.java:208)
at 
org.apache.atlas.repository.store.graph.v1.DeleteHandlerV1.removeTagPropagation(DeleteHandlerV1.java:454)
at 
org.apache.atlas.repository.store.graph.v1.SoftDeleteHandlerV1.deleteEdge(SoftDeleteHandlerV1.java:72)
at 
org.apache.atlas.repository.store.graph.v1.DeleteHandlerV1.deleteEdge(DeleteHandlerV1.java:653)
at 
org.apache.atlas.repository.store.graph.v1.DeleteHandlerV1.deleteEdgeReference(DeleteHandlerV1.java:308)
at 
org.apache.atlas.repository.store.graph.v1.EntityGraphMapper.mapToVertexByTypeCategory(EntityGraphMapper.java:457)
at 
org.apache.atlas.repository.store.graph.v1.EntityGraphMapper.mapAttribute(EntityGraphMapper.java:366)
at 
org.apache.atlas.repository.store.graph.v1.EntityGraphMapper.mapAttributes(EntityGraphMapper.java:297)
at 
org.apache.atlas.repository.store.graph.v1.EntityGraphMapper.mapAttributesAndClassifications(EntityGraphMapper.java:205)
at 
org.apache.atlas.repository.store.graph.v1.AtlasEntityStoreV1.createOrUpdate(AtlasEntityStoreV1.java:636)
at 
org.apache.atlas.repository.store.graph.v1.AtlasEntityStoreV1.createOrUpdate(AtlasEntityStoreV1.java:167)
at 
org.apache.atlas.repository.store.graph.v1.AtlasEntityStoreV1Test.testSetObjectIdAttrToNull(AtlasEntityStoreV1Test.java:902)

testArrayOfEntityUpdate(org.apache.atlas.repository.store.graph.v1.AtlasEntityStoreV1Test)
  Time elapsed: 0.105 sec  <<< FAILURE!
java.lang.IllegalArgumentException: Property value [NONE] is of type class 
org.apache.atlas.model.typedef.AtlasRelationshipDef$PropagateTags is not 
supported
at 
org.apache.tinkerpop.gremlin.structure.Property$Exceptions.dataTypeOfPropertyValueNotSupported(Property.java:163)
at 
org.apache.tinkerpop.gremlin.structure.Property$Exceptions.dataTypeOfPropertyValueNotSupported(Property.java:159)
at 
org.janusgraph.graphdb.transaction.StandardJanusGraphTx.verifyAttribute(StandardJanusGraphTx.java:580)
at 
org.janusgraph.graphdb.relations.AbstractTypedRelation.property(AbstractTypedRelation.java:120)

Review Request 66929: Add method to refer entity by unique Attributes

[Ruchi Solani]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/66929/
---

Review request for atlas and Madhan Neethiraj.


Bugs: ATLAS-2635
https://issues.apache.org/jira/browse/ATLAS-2635


Repository: atlas


Description
---

Many of the APIs in EntityREST require entity-guid to be provided. It will be 
useful to operate on entities given its typeName and uniqueAttributes.


Diffs
-

  
repository/src/main/java/org/apache/atlas/repository/store/graph/AtlasEntityStore.java
 eb825c4 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v1/AtlasEntityStoreV1.java
 316d78c 
  webapp/src/main/java/org/apache/atlas/web/rest/EntityREST.java 17a6ece 
  webapp/src/test/java/org/apache/atlas/web/adapters/TestEntityREST.java 
f0bc962 


Diff: https://reviews.apache.org/r/66929/diff/1/


Testing
---

Done with sanity testing


Thanks,

Ruchi Solani

Review Request 66928: Data Migration: Import: Infer Types that Store Edge Ids

[Ashutosh Mestry]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/66928/
---

Review request for atlas, Madhan Neethiraj and Ruchi Solani.


Bugs: ATLAS-2637
https://issues.apache.org/jira/browse/ATLAS-2637


Repository: atlas


Description
---

**Approach**
New class: _TypesStoringEdgeIds_: Navigates through all the types in the 
_typeRegistry_, returns map of entity type and properties that store edge ids.
Modified: _DataMigrationService_: Uses output from class above and passes it 
down to migration.
Modified: _PostProcessManager_: Uses the map generated above and uses it for 
post processing.
Modified: _GraphSONUtility_: Improvement to check for vertex of type. This 
avoids potential exeception when a non-existent property is checked for 
presence.


Diffs
-

  graphdb/api/src/main/java/org/apache/atlas/repository/graphdb/AtlasGraph.java 
607baf664 
  
graphdb/janus/src/main/java/org/apache/atlas/repository/graphdb/janus/AtlasJanusGraph.java
 c0b9c1741 
  
graphdb/janus/src/main/java/org/apache/atlas/repository/graphdb/janus/AtlasJanusGraphDatabase.java
 86cd29900 
  
graphdb/janus/src/main/java/org/apache/atlas/repository/graphdb/janus/migration/AtlasGraphSONReader.java
 aa0b6375d 
  
graphdb/janus/src/main/java/org/apache/atlas/repository/graphdb/janus/migration/GraphSONUtility.java
 ec320b03e 
  
graphdb/janus/src/main/java/org/apache/atlas/repository/graphdb/janus/migration/PostProcessManager.java
 d0a65f7b1 
  
graphdb/janus/src/test/java/org/apache/atlas/repository/graphdb/janus/migration/GraphSONUtilityPostProcessTest.java
 4d73c78ef 
  
graphdb/titan0/src/main/java/org/apache/atlas/repository/graphdb/titan0/Titan0Graph.java
 d191b5549 
  intg/src/main/java/org/apache/atlas/store/AtlasTypeDefStore.java b05754f4b 
  
repository/src/main/java/org/apache/atlas/repository/migration/DataMigrationService.java
 22cd55217 
  
repository/src/main/java/org/apache/atlas/repository/migration/TypesStoringEdgeIds.java
 PRE-CREATION 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v1/AtlasTypeDefGraphStoreV1.java
 3c84e3c22 
  
repository/src/test/java/org/apache/atlas/repository/migration/MigrationBaseAsserts.java
 ec6e64a25 
  
repository/src/test/java/org/apache/atlas/repository/migration/TypesStoringEdgeIdsTest.java
 PRE-CREATION 


Diff: https://reviews.apache.org/r/66928/diff/1/


Testing
---

**Unit tests**

Additional tests added.

**Functional tests**

Regular flow verified.


Thanks,

Ashutosh Mestry

Build failed in Jenkins: PreCommit-ATLAS-Build-Test #335-master-ATLAS-2624-2-Fixed-the-case-where-same-classificatio.patch

[Apache Jenkins Server]

See 


Changes:

[ssubramanian] ATLAS-2588: Regression : Negative tests for tags throw 400 Bad 
Request

--
[...truncated 484.51 KB...]
127.0.0.1 - - [02/May/2018:22:53:26 +] "GET 
//localhost:31000/api/atlas/v2/types/typedef/name/testGU9xOlEZc4 HTTP/1.1" 404 
91 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:22:53:26 +] "POST 
//localhost:31000/api/atlas/types HTTP/1.1" 201 109 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:22:53:26 +] "GET 
//localhost:31000/api/atlas/entities?type=testGU9xOlEZc4 HTTP/1.1" 200 124 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:22:53:26 +] "POST 
//localhost:31000/api/atlas/entities HTTP/1.1" 201 883 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:22:53:26 +] "POST 
//localhost:31000/api/atlas/entities HTTP/1.1" 201 2302 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:22:53:27 +] "GET 
//localhost:31000/api/atlas/entities/585c7513-aa14-474a-88a9-4c0e207d20b8 
HTTP/1.1" 200 2088 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:22:53:27 +] "POST 
//localhost:31000/api/atlas/entities HTTP/1.1" 201 883 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:22:53:27 +] "POST 
//localhost:31000/api/atlas/entities HTTP/1.1" 201 2302 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:22:53:27 +] "POST 
//localhost:31000/api/atlas/entities/51c14d33-60a6-4e08-8e00-c91472d9f160?property=description
 HTTP/1.1" 200 2163 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:22:53:27 +] "GET 
//localhost:31000/api/atlas/entities/51c14d33-60a6-4e08-8e00-c91472d9f160 
HTTP/1.1" 200 2099 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:22:53:27 +] "POST 
//localhost:31000/api/atlas/entities/51c14d33-60a6-4e08-8e00-c91472d9f160?property=invalid_property
 HTTP/1.1" 400 68 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:22:53:27 +] "GET 
//localhost:31000/api/atlas/entities/51c14d33-60a6-4e08-8e00-c91472d9f160 
HTTP/1.1" 200 2099 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:22:53:27 +] "GET 
//localhost:31000/api/atlas/admin/version HTTP/1.1" 200 169 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:22:53:27 +] "POST 
//localhost:31000/api/atlas/admin/import HTTP/1.1" 200 10429 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:22:53:34 +] "GET 
//localhost:31000/api/atlas/v2/types/typedef/name/fooTag HTTP/1.1" 404 83 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:22:53:34 +] "POST 
//localhost:31000/api/atlas/v2/types/typedefs/ HTTP/1.1" 200 401 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:22:53:34 +] "GET 
//localhost:31000/api/atlas/v2/entity/uniqueAttribute/type/hdfs_path?attr:qualifiedName=test%241test%2B%2B-%2B%26%26%2B%7C%7C%2B%21%2B%28%2B%29%2B%7B%2B%7D%2B%5B%2B%5D%2B%5E%2B%3C%2B%3E%2B%3B%2B%3A%2B%22%2B%25%2B*%2B%60%2B%7E
 HTTP/1.1" 404 176 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:22:53:34 +] "POST 
//localhost:31000/api/atlas/v2/entity/ HTTP/1.1" 200 273 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:22:53:40 +] "POST 
//localhost:31000/api/atlas/v2/search/basic HTTP/1.1" 200 1325 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:22:53:40 +] "POST 
//localhost:31000/api/atlas/v2/search/basic HTTP/1.1" 200 984 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:22:53:40 +] "POST 
//localhost:31000/api/atlas/v2/search/basic HTTP/1.1" 200 692 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:22:53:40 +] "POST 
//localhost:31000/api/atlas/v2/search/basic HTTP/1.1" 200 1432 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:22:53:40 +] "POST 
//localhost:31000/api/atlas/v2/search/basic HTTP/1.1" 200 1479 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:22:53:40 +] "POST 
//localhost:31000/api/atlas/v2/search/basic HTTP/1.1" 200 1479 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:22:53:40 +] "POST 
//localhost:31000/api/atlas/v2/search/basic HTTP/1.1" 200 1322 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:22:53:40 +] "POST 
//localhost:31000/api/atlas/v2/search/basic HTTP/1.1" 200 795 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:22:53:40 +] "POST 
//localhost:31000/api/atlas/v2/search/basic HTTP/1.1" 200 5936 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:22:53:40 +] "POST 
//localhost:31000/api/atlas/v2/search/basic HTTP/1.1" 200 1435 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:22:53:40 +] "POST 
//localhost:31000/api/atlas/v2/search/basic HTTP/1.1" 200 1532 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:22:53:40 +] "POST 
//localhost:31000/api/atlas/v2/search/basic HTTP/1.1" 200 1467 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:22:53:40 +] "POST 
//localhost:31000/api/atlas/v2/search/basic HTTP/1.1" 200 692 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:22:53:40 +] "POST 
//localhost:31000/api/atlas/v2/search/basic HTTP/1.1" 200 759 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:22:53:40 +] "POST 
//localhost:3

Re: Review Request 66918: Tags Associated Using Entity GUID and List of Tags Get Incorrect entityGUID

[Sarath Subramanian]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/66918/#review202326
---


Ship it!




Ship It!

- Sarath Subramanian


On May 2, 2018, 3:35 p.m., Ashutosh Mestry wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/66918/
> ---
> 
> (Updated May 2, 2018, 3:35 p.m.)
> 
> 
> Review request for atlas, Madhan Neethiraj and Sarath Subramanian.
> 
> 
> Bugs: ATLAS-2624
> https://issues.apache.org/jira/browse/ATLAS-2624
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> **Background**
> Associating multiple tags to entity causes incorrect entity guid present in 
> the tag.
> 
> E.g.
> ```java
> entityStore.addClassifications(dbEntityGuid, addedClassifications);
> entityStore.addClassifications(tblEntityGuid, addedClassifications);
> ```
> 
> This causes the guid of _dbEntityGuid_ to be present in classifications for 
> entity obtained by _tblEntityGuid_.
> 
> The problem can be circumvented by creating a copy of the 
> _addedClassifications_ and passing it to 2nd call.
> 
> 
> Diffs
> -
> 
>   intg/src/main/java/org/apache/atlas/model/instance/AtlasClassification.java 
> f73f36e2e 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v1/EntityGraphMapper.java
>  dbcf06a36 
>   
> repository/src/test/java/org/apache/atlas/repository/store/graph/v1/AtlasEntityStoreV1Test.java
>  5d0892407 
>   
> repository/src/test/java/org/apache/atlas/repository/tagpropagation/ClassificationPropagationTest.java
>  51e40f0a6 
> 
> 
> Diff: https://reviews.apache.org/r/66918/diff/2/
> 
> 
> Testing
> ---
> 
> **Unit tests**
> - Additional tests added to check this case.
> - Updated _ClassificationPropagationTest_ for this condition.
> 
> 
> Thanks,
> 
> Ashutosh Mestry
> 
>

Re: Review Request 66918: Tags Associated Using Entity GUID and List of Tags Get Incorrect entityGUID

[Ashutosh Mestry]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/66918/
---

(Updated May 2, 2018, 10:35 p.m.)


Review request for atlas, Madhan Neethiraj and Sarath Subramanian.


Changes
---

Updates include:
- Fixed unit tests in _ClassificationPropagationTest_.


Bugs: ATLAS-2624
https://issues.apache.org/jira/browse/ATLAS-2624


Repository: atlas


Description
---

**Background**
Associating multiple tags to entity causes incorrect entity guid present in the 
tag.

E.g.
```java
entityStore.addClassifications(dbEntityGuid, addedClassifications);
entityStore.addClassifications(tblEntityGuid, addedClassifications);
```

This causes the guid of _dbEntityGuid_ to be present in classifications for 
entity obtained by _tblEntityGuid_.

The problem can be circumvented by creating a copy of the 
_addedClassifications_ and passing it to 2nd call.


Diffs (updated)
-

  intg/src/main/java/org/apache/atlas/model/instance/AtlasClassification.java 
f73f36e2e 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v1/EntityGraphMapper.java
 dbcf06a36 
  
repository/src/test/java/org/apache/atlas/repository/store/graph/v1/AtlasEntityStoreV1Test.java
 5d0892407 
  
repository/src/test/java/org/apache/atlas/repository/tagpropagation/ClassificationPropagationTest.java
 51e40f0a6 


Diff: https://reviews.apache.org/r/66918/diff/2/

Changes: https://reviews.apache.org/r/66918/diff/1-2/


Testing
---

**Unit tests**
- Additional tests added to check this case.
- Updated _ClassificationPropagationTest_ for this condition.


Thanks,

Ashutosh Mestry

Review Request 66918: Tags Associated Using Entity GUID and List of Tags Get Incorrect entityGUID

[Ashutosh Mestry]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/66918/
---

Review request for atlas, Madhan Neethiraj and Sarath Subramanian.


Bugs: ATLAS-2624
https://issues.apache.org/jira/browse/ATLAS-2624


Repository: atlas


Description
---

**Background**
Associating multiple tags to entity causes incorrect entity guid present in the 
tag.

E.g.
```java
entityStore.addClassifications(dbEntityGuid, addedClassifications);
entityStore.addClassifications(tblEntityGuid, addedClassifications);
```

This causes the guid of _dbEntityGuid_ to be present in classifications for 
entity obtained by _tblEntityGuid_.

The problem can be circumvented by creating a copy of the 
_addedClassifications_ and passing it to 2nd call.


Diffs
-

  intg/src/main/java/org/apache/atlas/model/instance/AtlasClassification.java 
f73f36e2e 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v1/EntityGraphMapper.java
 dbcf06a36 
  
repository/src/test/java/org/apache/atlas/repository/store/graph/v1/AtlasEntityStoreV1Test.java
 5d0892407 


Diff: https://reviews.apache.org/r/66918/diff/1/


Testing
---

**Unit tests**
- Additional tests added to check this case.
- Updated _ClassificationPropagationTest_ for this condition.


Thanks,

Ashutosh Mestry

Build failed in Jenkins: Atlas-master-IntegrationTests #1223

[Apache Jenkins Server]

See 


--
[...truncated 567.63 KB...]
127.0.0.1 - - [02/May/2018:19:55:22 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/842b0537-2d49-45ac-9487-9a3d465fb700 
HTTP/1.1" 200 1524 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:19:55:22 +] "POST 
//localhost:31000/api/atlas/v2/entity/ HTTP/1.1" 200 195 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:19:55:22 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/842b0537-2d49-45ac-9487-9a3d465fb700 
HTTP/1.1" 200 1536 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:19:55:22 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/842b0537-2d49-45ac-9487-9a3d465fb700 
HTTP/1.1" 200 1536 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:19:55:22 +] "POST 
//localhost:31000/api/atlas/v2/entity/ HTTP/1.1" 200 513 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:19:55:23 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/842b0537-2d49-45ac-9487-9a3d465fb700 
HTTP/1.1" 200 1674 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:19:55:23 +] "GET 
//localhost:31000/api/atlas/v2/types/typedef/name/PII_TraituXKzZQTpEF HTTP/1.1" 
404 96 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:19:55:23 +] "POST 
//localhost:31000/api/atlas/v2/types/typedefs/ HTTP/1.1" 200 576 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:19:55:23 +] "DELETE 
//localhost:31000/api/atlas/v2/entity/guid/842b0537-2d49-45ac-9487-9a3d465fb700/classification/PII_TraituXKzZQTpEF
 HTTP/1.1" 400 114 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:19:55:23 +] "GET 
//localhost:31000/api/atlas/v2/types/typedef/name/PII_TraitQUDTEuprTF HTTP/1.1" 
404 96 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:19:55:23 +] "POST 
//localhost:31000/api/atlas/v2/types/typedefs/ HTTP/1.1" 200 425 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:19:55:23 +] "GET 
//localhost:31000/api/atlas/v2/types/classificationdef/name/PII_TraitQUDTEuprTF 
HTTP/1.1" 200 332 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:19:55:23 +] "POST 
//localhost:31000/api/atlas/v2/entity/guid/842b0537-2d49-45ac-9487-9a3d465fb700/classifications
 HTTP/1.1" 204 0 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:19:55:23 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/842b0537-2d49-45ac-9487-9a3d465fb700/classifications
 HTTP/1.1" 200 868 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:19:55:23 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/842b0537-2d49-45ac-9487-9a3d465fb700/classifications
 HTTP/1.1" 200 868 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:19:55:23 +] "POST 
//localhost:31000/api/atlas/v2/entity/ HTTP/1.1" 200 359 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:19:55:24 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/842b0537-2d49-45ac-9487-9a3d465fb700 
HTTP/1.1" 200 1854 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:19:55:24 +] "PUT 
//localhost:31000/api/atlas/v2/entity/uniqueAttribute/type/hive_table_v2?attr:qualifiedName=tableDcgMY9wycp
 HTTP/1.1" 200 510 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:19:55:24 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/842b0537-2d49-45ac-9487-9a3d465fb700 
HTTP/1.1" 200 1930 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:19:55:57 +] "GET 
//localhost:31000/api/atlas/v2/types/typedef/name/PII_TraitBS5aInC4S3 HTTP/1.1" 
404 96 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:19:55:57 +] "POST 
//localhost:31000/api/atlas/v2/types/typedefs/ HTTP/1.1" 200 425 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:19:55:57 +] "POST 
//localhost:31000/api/atlas/v2/entity/guid/842b0537-2d49-45ac-9487-9a3d465fb700/classifications
 HTTP/1.1" 204 0 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:19:55:57 +] "GET 
//localhost:31000/api/atlas/entities/842b0537-2d49-45ac-9487-9a3d465fb700/audit?count=100
 HTTP/1.1" 200 21392 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:19:55:57 +] "GET 
//localhost:31000/api/atlas/v2/types/typedef/name/PII_TraitPwh6tNDWNm HTTP/1.1" 
404 96 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:19:55:57 +] "POST 
//localhost:31000/api/atlas/v2/types/typedefs/ HTTP/1.1" 200 576 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:19:55:58 +] "POST 
//localhost:31000/api/atlas/v2/entity/guid/842b0537-2d49-45ac-9487-9a3d465fb700/classifications
 HTTP/1.1" 204 0 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:19:55:58 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/842b0537-2d49-45ac-9487-9a3d465fb700 
HTTP/1.1" 200 2166 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:19:55:58 +] "GET 
//localhost:31000/api/atlas/v2/types/typedef/name/PII_TraitgIeRc0cyQE HTTP/1.1" 
404 96 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:19:55:58 +] "POST 
//localhost:31000/api/atlas/v2/types/typedefs/ HTTP/1.1" 200 425 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:19:55:58 +] "POST 
//localhost:31000/api/atlas/v2/entity/guid/842b0537-2d49-45ac-9

Build failed in Jenkins: PreCommit-ATLAS-Build-Test #334-master-ATLAS-2624-2-Fixed-the-case-where-same-classificatio.patch

[Apache Jenkins Server]

See 


Changes:

[ssubramanian] Summary:ATLAS-2579 : UI : Block Propagation at classification 
level in

--
[...truncated 258.13 KB...]
[INFO] Exclude: **/public/js/libs/**
[INFO] Exclude: **/atlas.data/**
[INFO] Exclude: **/${sys:atlas.data}/**
[INFO] Exclude: **/policy-store.txt
[INFO] Exclude: **/*rebel*.xml
[INFO] Exclude: **/*rebel*.xml.bak
[INFO] Exclude: **/test/resources/**
[INFO] 172 resources included (use -debug for more details)
[INFO] Rat check: Summary over all files. Unapproved: 0, unknown: 0, generated: 
0, approved: 172 licenses.
[INFO] 
[INFO] --- maven-resources-plugin:2.7:copy-resources (copy-resources-solr) @ 
atlas-repository ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 9 resources
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ 
atlas-repository ---
[INFO] 
[INFO] --- maven-resources-plugin:2.7:resources (default-resources) @ 
atlas-repository ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 2 resources to META-INF
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.7.0:compile (default-compile) @ 
atlas-repository ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 132 source files to 

[INFO] 
:
 Some input files use or override a deprecated API.
[INFO] 
:
 Recompile with -Xlint:deprecation for details.
[INFO] 
:
 Some input files use unchecked or unsafe operations.
[INFO] 
:
 Recompile with -Xlint:unchecked for details.
[INFO] 
[INFO] --- maven-resources-plugin:2.7:testResources (default-testResources) @ 
atlas-repository ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 35 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:3.7.0:testCompile (default-testCompile) @ 
atlas-repository ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 43 source files to 

[INFO] 
:
 

 uses or overrides a deprecated API.
[INFO] 
:
 Recompile with -Xlint:deprecation for details.
[INFO] 
:
 Some input files use unchecked or unsafe operations.
[INFO] 
:
 Recompile with -Xlint:unchecked for details.
[INFO] 
[INFO] --- maven-surefire-plugin:2.18.1:test (default-test) @ atlas-repository 
---
[INFO] Surefire report directory: 

[INFO] Using configured provider org.apache.maven.surefire.testng.TestNGProvider

---
 T E S T S
---
Running org.apache.atlas.repository.store.graph.AtlasTypeDefGraphStoreTest
Running org.apache.atlas.repository.userprofile.UserProfileServiceTest
Running org.apache.atlas.repository.impexp.TypeAttributeDifferenceTest
Running org.apache.atlas.repository.impexp.ImportServiceTest
Running org.apache.atlas.repository.tagpropagation.ClassificationPropagationTest
Running org.apache.atlas.repository.migration.HiveParititionTest
Running 
org.apache.atlas.repository.store.graph.v1.AtlasRelationshipDefStoreV1Test
Running org.apache.atlas.repository.migration.RelationshipMappingTest
Running org.apache.atlas.repository.impexp.UniqueListTest
Running 
org.apache.atlas.repository.store.graph.v1.AtlasEntityStoreV1BulkImportPercentTest
Running org.apache.atl

[jira] [Updated] (ATLAS-2624) Import: Propagated Tags Display Twice

[Ashutosh Mestry (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-2624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Mestry updated ATLAS-2624:
---
Attachment: ATLAS-2624-2-Fixed-the-case-where-same-classificatio.patch

> Import: Propagated Tags Display Twice
> -
>
> Key: ATLAS-2624
> URL: https://issues.apache.org/jira/browse/ATLAS-2624
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 1.0.0
>Reporter: Ashutosh Mestry
>Assignee: Ashutosh Mestry
>Priority: Major
> Fix For: 1.0.0
>
> Attachments: 
> ATLAS-2624-2-Fixed-the-case-where-same-classificatio.patch, 
> ATLAS-2624-Fix-for-propagated-tags-appear-twice-in-w.patch
>
>
> *Pre-requisites*
>  * Create tags, say _tag1_.
>  * Create _hive_db_.
>  * Create 2 _hive_table_ (say _table1_ and _table2_) entities within the DB 
> above, such that they are linked with a process.
>  * Add tag1 to _table1_.
>  * From web ui: Note that _tag1_ is also propagated to _table2_.
> *Steps to duplicate*
>  # Export.
>  # Clear Atlas database.
>  # Import the ZIP file created in step 1.
> _Expected_: For _table2, tag1_ should be associated with the _'propagate 
> from'_ label set.
> _Actual_: For _table2, tag1_ appears twice. Once as propagated and once as 
> owned.  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (ATLAS-2638) Disabling tag propagation at an edge : Switching propagate flag after adding tag to blockedPropagatedClassifications

[Sarath Subramanian (JIRA)]

[ 
https://issues.apache.org/jira/browse/ATLAS-2638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16461566#comment-16461566
 ] 

Sarath Subramanian commented on ATLAS-2638:
---

When updating classifications propagate flag (true/false), finding 
propagated-to entities should look for blocked classification restriction also. 
Fixed it in patch.

> Disabling tag propagation at an edge : Switching propagate flag after adding 
> tag to blockedPropagatedClassifications
> 
>
> Key: ATLAS-2638
> URL: https://issues.apache.org/jira/browse/ATLAS-2638
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 1.0.0
>Reporter: Sarath Subramanian
>Assignee: Sarath Subramanian
>Priority: Major
> Fix For: 1.0.0
>
> Attachments: ATLAS-2638.1.patch
>
>
> 1. Created a database db1 and table db1.table1.
> 2. Updated the relationship between db1 and table1 to TWO_TO_ONE.
> 3.Added tag1 to db1. Tag is propagated to table1.
> 4. Updated relationship between db1 and table1 and added tag1 to 
> blockedPropagatedClassifications.
> 5. now , tag1 is removed from table1.
> 6. Now switched propagate flag value of tag1 at db1 from True to False.
> 7. In relationship definition between db1 and table1 , tag1 is removed from 
> blockedPropagatedClassifications.
> 8. Now switched propagate flag value of tag1 at db1 from False to True.
> 9. In relationship definition between db1 and table1 , tag1 is added back 
> automatically to blockedPropagatedClassifications.
> 10. Now, though tag1 is in blockedPropagatedClassifications , tag1 is still 
> propagated to table1.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (ATLAS-2638) Disabling tag propagation at an edge : Switching propagate flag after adding tag to blockedPropagatedClassifications

[Sarath Subramanian (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-2638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sarath Subramanian updated ATLAS-2638:
--
Attachment: ATLAS-2638.1.patch

> Disabling tag propagation at an edge : Switching propagate flag after adding 
> tag to blockedPropagatedClassifications
> 
>
> Key: ATLAS-2638
> URL: https://issues.apache.org/jira/browse/ATLAS-2638
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Affects Versions: 1.0.0
>Reporter: Sarath Subramanian
>Assignee: Sarath Subramanian
>Priority: Major
> Fix For: 1.0.0
>
> Attachments: ATLAS-2638.1.patch
>
>
> 1. Created a database db1 and table db1.table1.
> 2. Updated the relationship between db1 and table1 to TWO_TO_ONE.
> 3.Added tag1 to db1. Tag is propagated to table1.
> 4. Updated relationship between db1 and table1 and added tag1 to 
> blockedPropagatedClassifications.
> 5. now , tag1 is removed from table1.
> 6. Now switched propagate flag value of tag1 at db1 from True to False.
> 7. In relationship definition between db1 and table1 , tag1 is removed from 
> blockedPropagatedClassifications.
> 8. Now switched propagate flag value of tag1 at db1 from False to True.
> 9. In relationship definition between db1 and table1 , tag1 is added back 
> automatically to blockedPropagatedClassifications.
> 10. Now, though tag1 is in blockedPropagatedClassifications , tag1 is still 
> propagated to table1.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (ATLAS-2638) Disabling tag propagation at an edge : Switching propagate flag after adding tag to blockedPropagatedClassifications

[Sarath Subramanian (JIRA)]

Sarath Subramanian created ATLAS-2638:
-

 Summary: Disabling tag propagation at an edge : Switching 
propagate flag after adding tag to blockedPropagatedClassifications
 Key: ATLAS-2638
 URL: https://issues.apache.org/jira/browse/ATLAS-2638
 Project: Atlas
  Issue Type: Bug
  Components:  atlas-core
Affects Versions: 1.0.0
Reporter: Sarath Subramanian
Assignee: Sarath Subramanian
 Fix For: 1.0.0


1. Created a database db1 and table db1.table1.
2. Updated the relationship between db1 and table1 to TWO_TO_ONE.
3.Added tag1 to db1. Tag is propagated to table1.
4. Updated relationship between db1 and table1 and added tag1 to 
blockedPropagatedClassifications.
5. now , tag1 is removed from table1.
6. Now switched propagate flag value of tag1 at db1 from True to False.
7. In relationship definition between db1 and table1 , tag1 is removed from 
blockedPropagatedClassifications.
8. Now switched propagate flag value of tag1 at db1 from False to True.
9. In relationship definition between db1 and table1 , tag1 is added back 
automatically to blockedPropagatedClassifications.
10. Now, though tag1 is in blockedPropagatedClassifications , tag1 is still 
propagated to table1.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Build failed in Jenkins: Atlas-master-IntegrationTests #1222

[Apache Jenkins Server]

See 


Changes:

[ssubramanian] Summary:ATLAS-2579 : UI : Block Propagation at classification 
level in

--
[...truncated 567.63 KB...]
127.0.0.1 - - [02/May/2018:18:43:39 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/c4e3f530-fc33-4b2b-a278-75d863492895 
HTTP/1.1" 200 1524 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:43:39 +] "POST 
//localhost:31000/api/atlas/v2/entity/ HTTP/1.1" 200 195 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:43:39 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/c4e3f530-fc33-4b2b-a278-75d863492895 
HTTP/1.1" 200 1536 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:43:39 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/c4e3f530-fc33-4b2b-a278-75d863492895 
HTTP/1.1" 200 1536 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:43:39 +] "POST 
//localhost:31000/api/atlas/v2/entity/ HTTP/1.1" 200 513 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:43:39 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/c4e3f530-fc33-4b2b-a278-75d863492895 
HTTP/1.1" 200 1674 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:43:39 +] "GET 
//localhost:31000/api/atlas/v2/types/typedef/name/PII_TraitsxNSel3HKp HTTP/1.1" 
404 96 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:43:39 +] "POST 
//localhost:31000/api/atlas/v2/types/typedefs/ HTTP/1.1" 200 576 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:43:39 +] "DELETE 
//localhost:31000/api/atlas/v2/entity/guid/c4e3f530-fc33-4b2b-a278-75d863492895/classification/PII_TraitsxNSel3HKp
 HTTP/1.1" 400 114 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:43:39 +] "GET 
//localhost:31000/api/atlas/v2/types/typedef/name/PII_TraitSdAonrOgfj HTTP/1.1" 
404 96 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:43:39 +] "POST 
//localhost:31000/api/atlas/v2/types/typedefs/ HTTP/1.1" 200 425 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:43:39 +] "GET 
//localhost:31000/api/atlas/v2/types/classificationdef/name/PII_TraitSdAonrOgfj 
HTTP/1.1" 200 332 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:43:39 +] "POST 
//localhost:31000/api/atlas/v2/entity/guid/c4e3f530-fc33-4b2b-a278-75d863492895/classifications
 HTTP/1.1" 204 0 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:43:40 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/c4e3f530-fc33-4b2b-a278-75d863492895/classifications
 HTTP/1.1" 200 868 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:43:40 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/c4e3f530-fc33-4b2b-a278-75d863492895/classifications
 HTTP/1.1" 200 868 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:43:40 +] "POST 
//localhost:31000/api/atlas/v2/entity/ HTTP/1.1" 200 359 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:43:40 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/c4e3f530-fc33-4b2b-a278-75d863492895 
HTTP/1.1" 200 1854 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:43:40 +] "PUT 
//localhost:31000/api/atlas/v2/entity/uniqueAttribute/type/hive_table_v2?attr:qualifiedName=tablejpxSUDT2az
 HTTP/1.1" 200 510 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:43:40 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/c4e3f530-fc33-4b2b-a278-75d863492895 
HTTP/1.1" 200 1930 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:43:59 +] "GET 
//localhost:31000/api/atlas/v2/types/typedef/name/PII_TraitsRhceYto4a HTTP/1.1" 
404 96 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:43:59 +] "POST 
//localhost:31000/api/atlas/v2/types/typedefs/ HTTP/1.1" 200 425 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:43:59 +] "POST 
//localhost:31000/api/atlas/v2/entity/guid/c4e3f530-fc33-4b2b-a278-75d863492895/classifications
 HTTP/1.1" 204 0 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:43:59 +] "GET 
//localhost:31000/api/atlas/entities/c4e3f530-fc33-4b2b-a278-75d863492895/audit?count=100
 HTTP/1.1" 200 21392 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:43:59 +] "GET 
//localhost:31000/api/atlas/v2/types/typedef/name/PII_TraitNkcjpM0zFS HTTP/1.1" 
404 96 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:43:59 +] "POST 
//localhost:31000/api/atlas/v2/types/typedefs/ HTTP/1.1" 200 576 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:44:00 +] "POST 
//localhost:31000/api/atlas/v2/entity/guid/c4e3f530-fc33-4b2b-a278-75d863492895/classifications
 HTTP/1.1" 204 0 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:44:00 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/c4e3f530-fc33-4b2b-a278-75d863492895 
HTTP/1.1" 200 2166 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:44:00 +] "GET 
//localhost:31000/api/atlas/v2/types/typedef/name/PII_TraiteObdEfFqoX HTTP/1.1" 
404 96 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:44:00 +] "POST 
//localhost:31000/api/atlas/v2/types/typedefs/ HTTP/1.1" 200 425 "-" 
"Java/1.8.0_172"
12

Re: Review Request 66907: ATLAS-2579 : UI : Block Propagation at classification level in edit propagation flow.

[Sarath Subramanian]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/66907/#review202296
---


Ship it!




Ship It!

- Sarath Subramanian


On May 2, 2018, 7:23 a.m., keval bhatt wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/66907/
> ---
> 
> (Updated May 2, 2018, 7:23 a.m.)
> 
> 
> Review request for atlas, Apoorv Naik, Ashutosh Mestry, Madhan Neethiraj, and 
> Sarath Subramanian.
> 
> 
> Bugs: ATLAS-2579
> https://issues.apache.org/jira/browse/ATLAS-2579
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> Show ONE_TO_TWO and NONE option and remove other options in  Block 
> Propagation popup UI
> 
> 
> Diffs
> -
> 
>   
> dashboardv2/public/js/templates/graph/PropagationPropertyModalView_tmpl.html 
> 1d008a944 
>   dashboardv2/public/js/utils/UrlLinks.js 2e5eefe12 
>   dashboardv2/public/js/views/graph/PropagationPropertyModal.js 0791eea92 
> 
> 
> Diff: https://reviews.apache.org/r/66907/diff/1/
> 
> 
> Testing
> ---
> 
> Done one round of sanity test
> 
> 
> Thanks,
> 
> keval bhatt
> 
>

Re: Review Request 66907: ATLAS-2579 : UI : Block Propagation at classification level in edit propagation flow.

[Sarath Subramanian]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/66907/#review202294
---



The changes looks good Keval. I still see the update issue when you select all 
classifications in Block Propagatation Table, but only one blocked propagated 
classification is updated.

- Sarath Subramanian


On May 2, 2018, 7:23 a.m., keval bhatt wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/66907/
> ---
> 
> (Updated May 2, 2018, 7:23 a.m.)
> 
> 
> Review request for atlas, Apoorv Naik, Ashutosh Mestry, Madhan Neethiraj, and 
> Sarath Subramanian.
> 
> 
> Bugs: ATLAS-2579
> https://issues.apache.org/jira/browse/ATLAS-2579
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> Show ONE_TO_TWO and NONE option and remove other options in  Block 
> Propagation popup UI
> 
> 
> Diffs
> -
> 
>   
> dashboardv2/public/js/templates/graph/PropagationPropertyModalView_tmpl.html 
> 1d008a944 
>   dashboardv2/public/js/utils/UrlLinks.js 2e5eefe12 
>   dashboardv2/public/js/views/graph/PropagationPropertyModal.js 0791eea92 
> 
> 
> Diff: https://reviews.apache.org/r/66907/diff/1/
> 
> 
> Testing
> ---
> 
> Done one round of sanity test
> 
> 
> Thanks,
> 
> keval bhatt
> 
>

Build failed in Jenkins: PreCommit-ATLAS-Build-Test #333-master-ATLAS-2637-Data-Migration-Infer-types-that-store-edg.patch

[Apache Jenkins Server]

See 


--
[...truncated 483.27 KB...]
127.0.0.1 - - [02/May/2018:18:04:15 +] "DELETE 
//localhost:31000/api/atlas/v2/entity/guid/random/classification/blah_trait 
HTTP/1.1" 400 105 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:04:15 +] "GET 
//localhost:31000/api/atlas/discovery/search/dsl?query=hive_db_v2+where+name%3D'dbQ32FtGgEZ4'&limit=10&offset=0
 HTTP/1.1" 200 1660 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:04:15 +] "GET 
//localhost:31000/api/atlas/discovery/search/dsl?query=hive_db_v2+where+name%3D'dbQ32FtGgEZ4'&limit=10&offset=0
 HTTP/1.1" 200 1660 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:04:15 +] "POST 
//localhost:31000/api/atlas/v2/entity/ HTTP/1.1" 200 387 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:04:16 +] "GET 
//localhost:31000/api/atlas/discovery/search/dsl?query=hive_db_v2+where+name%3D'dbQ32FtGgEZ4'&limit=10&offset=0
 HTTP/1.1" 200 2728 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:04:16 +] "POST 
//localhost:31000/api/atlas/v2/types/typedefs/ HTTP/1.1" 200 532 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:04:16 +] "POST 
//localhost:31000/api/atlas/v2/entity/ HTTP/1.1" 200 237 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:04:16 +] "PUT 
//localhost:31000/api/atlas/v2/types/typedefs/ HTTP/1.1" 200 691 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:04:17 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/89bbe0dc-f444-43c8-96cf-254796aede6b 
HTTP/1.1" 200 282 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:04:17 +] "POST 
//localhost:31000/api/atlas/v2/entity/ HTTP/1.1" 404 181 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:04:17 +] "POST 
//localhost:31000/api/atlas/v2/entity/ HTTP/1.1" 200 237 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:04:17 +] "POST 
//localhost:31000/api/atlas/v2/entity/ HTTP/1.1" 200 178 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:04:17 +] "GET 
//localhost:31000/api/atlas/v2/entity/uniqueAttribute/type/hive_db_v2?attr:name=dbQ32FtGgEZ4
 HTTP/1.1" 200 3537 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:04:17 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/blah HTTP/1.1" 404 95 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:04:17 +] "POST 
//localhost:31000/api/atlas/v2/entity/ HTTP/1.1" 200 237 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:04:17 +] "GET 
//localhost:31000/api/atlas/entities/cb7f60fd-d751-4021-8084-2ce74fc53e5a/audit?count=10
 HTTP/1.1" 200 954 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:04:17 +] "POST 
//localhost:31000/api/atlas/v2/entity/ HTTP/1.1" 200 239 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:04:17 +] "POST 
//localhost:31000/api/atlas/v2/entity/ HTTP/1.1" 200 392 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:04:17 +] "GET 
//localhost:31000/api/atlas/v2/types/typedef/name/WRKTy3uaVe HTTP/1.1" 404 87 
"-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:04:17 +] "POST 
//localhost:31000/api/atlas/v2/types/typedefs/ HTTP/1.1" 200 558 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:04:18 +] "POST 
//localhost:31000/api/atlas/v2/entity/ HTTP/1.1" 200 282 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:04:18 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/f34879d7-b464-4896-98ac-692116852a85 
HTTP/1.1" 200 308 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:04:18 +] "GET 
//localhost:31000/api/atlas/types/database HTTP/1.1" 200 750 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:04:18 +] "GET 
//localhost:31000/api/atlas/types/table HTTP/1.1" 200 1727 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:04:18 +] "GET 
//localhost:31000/api/atlas/types/fetl HTTP/1.1" 200 541 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:04:18 +] "GET 
//localhost:31000/api/atlas/types HTTP/1.1" 200 2410 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:04:18 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/d2aa0d17-c7a6-4e55-a48e-c967fa1abab5 
HTTP/1.1" 200 1506 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:04:18 +] "POST 
//localhost:31000/api/atlas/v2/entity/ HTTP/1.1" 200 195 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:04:18 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/d2aa0d17-c7a6-4e55-a48e-c967fa1abab5 
HTTP/1.1" 200 1524 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:04:18 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/d2aa0d17-c7a6-4e55-a48e-c967fa1abab5 
HTTP/1.1" 200 1524 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:04:18 +] "POST 
//localhost:31000/api/atlas/v2/entity/ HTTP/1.1" 200 195 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:04:18 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/d2aa0d17-c7a6-4e55-a48e-c967fa1abab5 
HTTP/1.1" 200 1536 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:18:04:18 +] "GET 
//localhost:31000/api/atla

[jira] [Updated] (ATLAS-2637) Data Migration: Import: Infer Types that Store Edge Ids

[Ashutosh Mestry (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-2637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Mestry updated ATLAS-2637:
---
Attachment: ATLAS-2637-Data-Migration-Infer-types-that-store-edg.patch

> Data Migration: Import: Infer Types that Store Edge Ids
> ---
>
> Key: ATLAS-2637
> URL: https://issues.apache.org/jira/browse/ATLAS-2637
> Project: Atlas
>  Issue Type: Improvement
>  Components:  atlas-core
>Affects Versions: trunk
>Reporter: Ashutosh Mestry
>Assignee: Ashutosh Mestry
>Priority: Major
> Fix For: trunk
>
> Attachments: 
> ATLAS-2637-Data-Migration-Infer-types-that-store-edg.patch
>
>
> *Background*
> Existing implementation of _Data Migration_ needs end user to specify 
> properties of types that need post processing.
> Post processing is essentially replacing the stored edge ids with the ones in 
> the newly migrated database.
> This is error prone, where the creator of types may not be aware of this, and 
> hence may forget to specify the type and property during migration. This will 
> result in entities of the type being unusable.
> *Solution*
> Infer the types and the properties in following way:
>  * Navigating through all the types in type registry.
>  * Find attributes that have arrays with array elements as object ids.
> Pass these type-properties map to the migration process.
> This will eliminate the need for letting user specify these properties.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (ATLAS-2637) Data Migration: Import: Infer Types that Store Edge Ids

[Ashutosh Mestry (JIRA)]

Ashutosh Mestry created ATLAS-2637:
--

 Summary: Data Migration: Import: Infer Types that Store Edge Ids
 Key: ATLAS-2637
 URL: https://issues.apache.org/jira/browse/ATLAS-2637
 Project: Atlas
  Issue Type: Improvement
  Components:  atlas-core
Affects Versions: trunk
Reporter: Ashutosh Mestry
Assignee: Ashutosh Mestry
 Fix For: trunk


*Background*

Existing implementation of _Data Migration_ needs end user to specify 
properties of types that need post processing.

Post processing is essentially replacing the stored edge ids with the ones in 
the newly migrated database.

This is error prone, where the creator of types may not be aware of this, and 
hence may forget to specify the type and property during migration. This will 
result in entities of the type being unusable.

*Solution*

Infer the types and the properties in following way:
 * Navigating through all the types in type registry.
 * Find attributes that have arrays with array elements as object ids.

Pass these type-properties map to the migration process.

This will eliminate the need for letting user specify these properties.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Build failed in Jenkins: Atlas-master-IntegrationTests #1221

[Apache Jenkins Server]

See 


--
[...truncated 569.68 KB...]
at 
org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:262)
at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1691)
at 
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
at 
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)
at 
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:226)
at 
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
at 
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
at 
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
at 
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at 
org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:213)
at 
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:119)
at 
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
at org.eclipse.jetty.server.Server.handle(Server.java:534)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
at 
org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
at 
org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
at 
org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
at 
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
at 
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at 
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at 
org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)

127.0.0.1 - - [02/May/2018:15:43:44 +] "GET 
//localhost:31000/api/atlas/lineage/hive/table/blah/schema HTTP/1.1" 500 89 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:15:43:44 +] "GET 
//localhost:31000/api/atlas/entities?type=hive_table_v1&property=qualifiedName&value=sales_fact_monthly_mvdGHRXiADOO
 HTTP/1.1" 200 4015 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:15:43:44 +] "GET 
//localhost:31000/api/atlas/v2/lineage/9ed8efda-28b0-4117-98bd-94f72293ac08?depth=5&direction=INPUT
 HTTP/1.1" 200 3351 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:15:43:44 +] "GET 
//localhost:31000/api/atlas/entities?type=hive_table_v1&property=qualifiedName&value=sales_fact_monthly_mvdGHRXiADOO
 HTTP/1.1" 200 4015 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:15:43:44 +] "GET 
//localhost:31000/api/atlas/v2/lineage/9ed8efda-28b0-4117-98bd-94f72293ac08?depth=5&direction=BOTH
 HTTP/1.1" 200 3350 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:15:43:45 +] "GET 
//localhost:31000/api/atlas/entities?type=hive_table_v1&property=qualifiedName&value=sales_factS2WesGHAWO
 HTTP/1.1" 200 3958 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:15:43:45 +] "GET 
//localhost:31000/api/atlas/v2/lineage/2dde173b-7ba5-4520-b744-1a7668779622?depth=5&direction=OUTPUT
 HTTP/1.1" 200 2801 "-" "Java/1.8.0_172"
Tests run: 123, Failures: 4, Errors: 0, Skipped: 0, Time elapsed: 179.464 sec 
<<< FAILURE! - in TestSuite
testEnterEmptyValues(org.apache.atlas.CredentialProviderUtilityIT)  Time 
elapsed: 1.017 sec  <<< FAILURE!
java.io.IOException: Invalid secret key format
at com.sun.crypto.provider.JceKeyStore.engineLoad(JceKeyStore.java:856)
at java.security.KeyStore.load(KeyStore.java:1445)
at 
org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:106)
at 
org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49)
at 
org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41)
at 
org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100)
at 
org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:58)
at 
org.apache.atlas.CredentialProviderUtilityIT.testEnterEmptyValues(CredentialProviderUtilityIT.java:138)

testEnterMismatchedValues(o

[jira] [Created] (ATLAS-2636) Business catalog: Creating a glossary with incorrect GUID, fails first time. When the same request with the same payload returns "409 conflict" saying "Glossary category

[Ayub Pathan (JIRA)]

Ayub Pathan created ATLAS-2636:
--

 Summary: Business catalog: Creating a glossary with incorrect 
GUID, fails first time. When the same request with the same payload returns 
"409 conflict" saying "Glossary category with qualifiedName category1 already 
exists"
 Key: ATLAS-2636
 URL: https://issues.apache.org/jira/browse/ATLAS-2636
 Project: Atlas
  Issue Type: Bug
  Components:  atlas-core
Affects Versions: 1.0.0
Reporter: Ayub Pathan
 Fix For: 1.0.0


* Create a category with below payload, this will fail with 500 internal error.
{noformat}
{
  "qualifiedName": "category1",
  "displayName": "Bank accounts",
  "anchor": {
"glossaryGuid": "-1"
  }
}
{noformat}
* Repeat the same request again, now atlas throws below error
{noformat}
{
"errorCode": "ATLAS-409-00-00A",
"errorMessage": "Glossary category with qualifiedName category1 already 
exists"
}
{noformat}

Does this mean, the first request succeeded to register the category?




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Review Request 66907: ATLAS-2579 : UI : Block Propagation at classification level in edit propagation flow.

[keval bhatt]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/66907/
---

Review request for atlas, Apoorv Naik, Ashutosh Mestry, Madhan Neethiraj, and 
Sarath Subramanian.


Bugs: ATLAS-2579
https://issues.apache.org/jira/browse/ATLAS-2579


Repository: atlas


Description
---

Show ONE_TO_TWO and NONE option and remove other options.


Diffs
-

  dashboardv2/public/js/templates/graph/PropagationPropertyModalView_tmpl.html 
1d008a944 
  dashboardv2/public/js/utils/UrlLinks.js 2e5eefe12 
  dashboardv2/public/js/views/graph/PropagationPropertyModal.js 0791eea92 


Diff: https://reviews.apache.org/r/66907/diff/1/


Testing
---

Done one round of sanity test


Thanks,

keval bhatt

[jira] [Updated] (ATLAS-2579) UI : Block Propagation at classification level in edit propagation flow.

[Keval Bhatt (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-2579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Keval Bhatt updated ATLAS-2579:
---
Attachment: ATLAS-2579-1.patch

> UI : Block Propagation at classification level in edit propagation flow.
> 
>
> Key: ATLAS-2579
> URL: https://issues.apache.org/jira/browse/ATLAS-2579
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: 1.0.0
>Reporter: pratik pandey
>Assignee: Keval Bhatt
>Priority: Major
> Fix For: 1.0.0
>
> Attachments: ATLAS-2579-1.patch, ATLAS-2579.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Build failed in Jenkins: Atlas-master-IntegrationTests #1220

[Apache Jenkins Server]

See 


--
[...truncated 568.08 KB...]
127.0.0.1 - - [02/May/2018:12:42:34 +] "GET 
//localhost:31000/api/atlas/v2/types/typedef/name/hive_table_v1 HTTP/1.1" 200 
1854 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:12:42:34 +] "GET 
//localhost:31000/api/atlas/v2/types/typedef/name/hive_process_v1 HTTP/1.1" 200 
1401 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:12:42:34 +] "POST 
//localhost:31000/api/atlas/types HTTP/1.1" 201 191 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:12:42:35 +] "GET 
//localhost:31000/api/atlas/discovery/search/dsl?query=hive_db+where+qualifiedName%3D'dbjqcs6ZLGlD'&limit=10&offset=0
 HTTP/1.1" 200 642 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:12:42:36 +] "GET 
//localhost:31000/api/atlas/entities?type=hive_db&property=qualifiedName&value=dbjqcs6ZLGlD
 HTTP/1.1" 200 722 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:12:42:36 +] "GET 
//localhost:31000/api/atlas/entities/90af621c-c6a7-4f20-bcd1-b04942b5b5bf/audit?count=1
 HTTP/1.1" 200 1007 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:12:42:36 +] "POST 
//localhost:31000/api/atlas/entities HTTP/1.1" 201 880 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:12:42:37 +] "GET 
//localhost:31000/api/atlas/entities/90482bd3-bb2b-4c11-83c5-a11efd5c7524 
HTTP/1.1" 200 720 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:12:42:39 +] "GET 
//localhost:31000/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'dbgl8CLgFW7Z'&limit=10&offset=0
 HTTP/1.1" 200 633 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:12:42:40 +] "POST 
//localhost:31000/api/atlas/entities HTTP/1.1" 201 880 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:12:42:41 +] "GET 
//localhost:31000/api/atlas/discovery/search/dsl?query=hive_db+where+qualifiedName%3D'dbbX8tWFcHxj'&limit=10&offset=0
 HTTP/1.1" 200 645 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:12:42:41 +] "GET 
//localhost:31000/api/atlas/entities?type=hive_db&property=qualifiedName&value=dbbX8tWFcHxj
 HTTP/1.1" 200 725 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:12:42:41 +] "POST 
//localhost:31000/api/atlas/entities HTTP/1.1" 201 880 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:12:42:42 +] "GET 
//localhost:31000/api/atlas/entities?type=hive_db&property=qualifiedName&value=dbxelEUgOFtM
 HTTP/1.1" 200 727 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:12:42:42 +] "GET 
//localhost:31000/api/atlas/entities?type=hive_db&property=qualifiedName&value=dbxelEUgOFtM
 HTTP/1.1" 200 727 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:12:42:42 +] "POST 
//localhost:31000/api/atlas/entities HTTP/1.1" 201 880 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:12:42:44 +] "GET 
//localhost:31000/api/atlas/discovery/search/dsl?query=hive_db+where+qualifiedName%3D'dbros2o7lFD4'&limit=10&offset=0
 HTTP/1.1" 200 639 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:12:42:44 +] "GET 
//localhost:31000/api/atlas/discovery/search/dsl?query=hive_db+where+qualifiedName%3D'dbrIokG2NPSU'&limit=10&offset=0
 HTTP/1.1" 200 183 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:12:42:44 +] "GET 
//localhost:31000/api/atlas/v2/types/typedef/name/PII_TraitUciHL4EZo0 HTTP/1.1" 
404 96 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:12:42:44 +] "POST 
//localhost:31000/api/atlas/v2/types/typedefs/ HTTP/1.1" 200 425 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:12:42:44 +] "POST 
//localhost:31000/api/atlas/v2/entity/guid/22db841a-e323-4359-b0a2-63b2d76084d0/classifications
 HTTP/1.1" 204 0 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:12:42:45 +] "GET 
//localhost:31000/api/atlas/entities/22db841a-e323-4359-b0a2-63b2d76084d0/audit?count=100
 HTTP/1.1" 200 21391 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:12:42:45 +] "GET 
//localhost:31000/api/atlas/v2/types/typedef/name/PII_TraitLllT9qGK48 HTTP/1.1" 
404 96 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:12:42:45 +] "POST 
//localhost:31000/api/atlas/v2/types/typedefs/ HTTP/1.1" 200 576 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:12:42:45 +] "POST 
//localhost:31000/api/atlas/v2/entity/guid/22db841a-e323-4359-b0a2-63b2d76084d0/classifications
 HTTP/1.1" 204 0 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:12:42:45 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/22db841a-e323-4359-b0a2-63b2d76084d0 
HTTP/1.1" 200 2166 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:12:42:45 +] "GET 
//localhost:31000/api/atlas/v2/types/typedef/name/PII_TraitwblC9kdZnO HTTP/1.1" 
404 96 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:12:42:45 +] "POST 
//localhost:31000/api/atlas/v2/types/typedefs/ HTTP/1.1" 200 425 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:12:42:45 +] "POST 
//localhost:31000/api/atlas/v2/entity/guid/22db841a-e323-4359-b0a2-63b2d76084d0/classifications
 HTTP/1.1" 204 0 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/

[jira] [Assigned] (ATLAS-2579) UI : Block Propagation at classification level in edit propagation flow.

[Keval Bhatt (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-2579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Keval Bhatt reassigned ATLAS-2579:
--

Assignee: Keval Bhatt  (was: pratik pandey)

> UI : Block Propagation at classification level in edit propagation flow.
> 
>
> Key: ATLAS-2579
> URL: https://issues.apache.org/jira/browse/ATLAS-2579
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: 1.0.0
>Reporter: pratik pandey
>Assignee: Keval Bhatt
>Priority: Major
> Fix For: 1.0.0
>
> Attachments: ATLAS-2579.patch
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Assigned] (ATLAS-2608) UI - Cache is not cleared if user click on cancel button while editing propagation flow

[Keval Bhatt (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-2608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Keval Bhatt reassigned ATLAS-2608:
--

Assignee: Keval Bhatt  (was: pratik pandey)

> UI - Cache is not cleared if user click on cancel button while editing 
> propagation flow
> ---
>
> Key: ATLAS-2608
> URL: https://issues.apache.org/jira/browse/ATLAS-2608
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: 1.0.0
>Reporter: Tejas Rawool
>Assignee: Keval Bhatt
>Priority: Major
> Fix For: 1.0.0
>
>
> Steps to reproduce:-
>  
> 1.Do a Basic Search for Tables
> 2.Now go to Lineage Tab of  sales_fact
> 3.Click on arrow between sales_fact and loadSalesDaily
> 4.Now switch to Block Propagation
> 5.Checked any of the entity and click on cancel button
> 6.Now again click on that arrow and go to block propagation without 
> refreshing the page
> Error:-
> An Duplicate entity is created which is incorrect



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Assigned] (ATLAS-2297) UI : Support to resize columns in Search table

[Keval Bhatt (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-2297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Keval Bhatt reassigned ATLAS-2297:
--

Assignee: Keval Bhatt  (was: pratik pandey)

> UI : Support to resize columns in Search table
> --
>
> Key: ATLAS-2297
> URL: https://issues.apache.org/jira/browse/ATLAS-2297
> Project: Atlas
>  Issue Type: Improvement
>Affects Versions: 1.0.0
>Reporter: pratik pandey
>Assignee: Keval Bhatt
>Priority: Major
> Fix For: 1.0.0
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (ATLAS-2607) Classification lifecycle through metadata properties and relationships

[David Radley (JIRA)]

[ 
https://issues.apache.org/jira/browse/ATLAS-2607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16460928#comment-16460928
 ] 

David Radley commented on ATLAS-2607:
-

[~madhan.neethiraj] . when you say "Asset can only be attached to 
classifications with the status of ACTIVE" -is this the general principle?

I had assumed that the Asset could be classified with a draft classification, 
this would exist in the graph but would not be seen by normal queries. We would 
need new queries that an workflow approver could use to see the draft 
classifications.

You say "Existing entity-classification-update permission will be used to 
enforce change to status". I suggest that the workflow permissions should be 
separate so we can have an approver that can only update the status and 
everyone else can update all but the status.  

In the open Metadata archive model I notice:
- there is a Draft sate in the open metadata TermRelationshipStatus. I wonder 
if you should consider using these enum values for classifications. 
- Open metadata also has the GovernanceClassificationStatus which includes 
states for Governance action classifications. 

It is worth considering enum states that will ease mapping from open metadata.. 




> Classification lifecycle through metadata properties and relationships
> --
>
> Key: ATLAS-2607
> URL: https://issues.apache.org/jira/browse/ATLAS-2607
> Project: Atlas
>  Issue Type: Improvement
>  Components:  atlas-core
>Reporter: Srikanth Venkat
>Assignee: Madhan Neethiraj
>Priority: Critical
>
> Currently tags or classifications in Atlas are considered active once they 
> are defined. For governance and stewardship purposes, it would be important 
> to attach the notion of what state in its lifecycle a particular 
> classification is. This would help with workflows to manage the lifecycle 
> aspects and provide any filtering needed to take appropriate actions. For 
> example only active classifications should be considered for classification 
> based policy enforcement. Additionally lifecycle status would help with 
> filtering and search as well as reporting and compliance/audit scenarios.
> Implementation Proposal:
>  * All tags or classifications have a "Lifecycle Status" property
>  * They can go through the following list of states during their lifecycle: 
> DRAFT -> ACTIVE  -> RETIRED
>  * Lifecycle Status can be set as an enum property that is mandatory or 
> required for all classifications.
>  * All existing classifications already present in Atlas before this change 
> will default to an ACTIVE status so that all pre-existing classifications 
> will continue to work as before.
>  * All new classifications after this change will start out with DRAFT status 
> and a steward or an admin with appropriate permissions can move them into an 
> ACTIVE state (controlled via Metadata security policies)
>  * Policy enforcement for authorization on classifications can ignore any 
> that are not in ACTIVE state. 
>  * Asset can only be attached to classifications with the status of ACTIVE
>  * For a classification in RETIRED state, we might have an optional 
> relationship with another classification called "Replaced By" which is the 
> new classification that the current one was remapped or replaced with. The 
> inverse relationship could be labeled "Replaces" which is on the new 
> classification and points to the removed classification that it replaces. 
>  * The state RETIRED implies this classification is no longer used and policy 
> enforcement will ignore any classifications in such states. 
>  * Additionally UI can filter and show by default only classifications that 
> are not RETIRED and a checkbox to "Show Retired"
>  * Deletion of classifications should work as it currently does with no 
> behavioral changes.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Build failed in Jenkins: Atlas-master-IntegrationTests #1219

[Apache Jenkins Server]

See 


--
[...truncated 580.38 KB...]
at 
org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:262)
at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1691)
at 
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
at 
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)
at 
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:226)
at 
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
at 
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
at 
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
at 
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at 
org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:213)
at 
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:119)
at 
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
at org.eclipse.jetty.server.Server.handle(Server.java:534)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
at 
org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
at 
org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
at 
org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
at 
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
at 
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at 
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at 
org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)

127.0.0.1 - - [02/May/2018:09:45:24 +] "GET 
//localhost:31000/api/atlas/lineage/hive/table/blah/schema HTTP/1.1" 500 89 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:09:45:24 +] "GET 
//localhost:31000/api/atlas/entities?type=hive_table_v1&property=qualifiedName&value=sales_fact_monthly_mvyKdqlKvbA0
 HTTP/1.1" 200 4016 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:09:45:24 +] "GET 
//localhost:31000/api/atlas/v2/lineage/ca49e7b2-2dc9-45be-ae38-333e584fa2fe?depth=5&direction=INPUT
 HTTP/1.1" 200 3351 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:09:45:24 +] "GET 
//localhost:31000/api/atlas/entities?type=hive_table_v1&property=qualifiedName&value=sales_fact_monthly_mvyKdqlKvbA0
 HTTP/1.1" 200 4016 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:09:45:24 +] "GET 
//localhost:31000/api/atlas/v2/lineage/ca49e7b2-2dc9-45be-ae38-333e584fa2fe?depth=5&direction=BOTH
 HTTP/1.1" 200 3350 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:09:45:24 +] "GET 
//localhost:31000/api/atlas/entities?type=hive_table_v1&property=qualifiedName&value=sales_factQMODajcsn9
 HTTP/1.1" 200 3959 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:09:45:24 +] "GET 
//localhost:31000/api/atlas/v2/lineage/1a4eb20d-9c04-4e06-bc40-bc6615df8fae?depth=5&direction=OUTPUT
 HTTP/1.1" 200 2801 "-" "Java/1.8.0_172"
Tests run: 123, Failures: 4, Errors: 0, Skipped: 0, Time elapsed: 200.886 sec 
<<< FAILURE! - in TestSuite
testEnterEmptyValues(org.apache.atlas.CredentialProviderUtilityIT)  Time 
elapsed: 0.908 sec  <<< FAILURE!
java.io.IOException: Invalid secret key format
at com.sun.crypto.provider.JceKeyStore.engineLoad(JceKeyStore.java:856)
at java.security.KeyStore.load(KeyStore.java:1445)
at 
org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:106)
at 
org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49)
at 
org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41)
at 
org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100)
at 
org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:58)
at 
org.apache.atlas.CredentialProviderUtilityIT.testEnterEmptyValues(CredentialProviderUtilityIT.java:138)

testEnterMismatchedValues(o

Build failed in Jenkins: PreCommit-ATLAS-Build-Test #332-master-ATLAS-2635.patch

[Apache Jenkins Server]

See 


--
[...truncated 487.14 KB...]
at 
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at 
org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilterInternal(BasicAuthenticationFilter.java:215)
at 
org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
at 
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at 
org.apache.atlas.web.filters.AtlasKnoxSSOAuthenticationFilter.doFilter(AtlasKnoxSSOAuthenticationFilter.java:146)
at 
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at 
org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:200)
at 
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at 
org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:116)
at 
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at 
org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:105)
at 
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at 
org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:56)
at 
org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
at 
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
at 
org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:214)
at 
org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:177)
at 
org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346)
at 
org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:262)
at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1691)
at 
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
at 
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)
at 
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:226)
at 
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
at 
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
at 
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
at 
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at 
org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:213)
at 
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:119)
at 
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
at org.eclipse.jetty.server.Server.handle(Server.java:534)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
at 
org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
at 
org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
at 
org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
at 
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
at 
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at 
org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at 
org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)

127.0.0.1 - - [02/May/2018:09:58:20 +] "GET 
//localhost:31000/api/atlas/lineage/hive/table/blah/schema HTTP/1.1" 500 89 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:09:58:20 +] "GET 
//localhost:31000/api/atlas/entities?type=hive_t

[jira] [Assigned] (ATLAS-2635) Add method to refer entity by unique Attributes

[Ruchi Solani (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-2635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ruchi Solani reassigned ATLAS-2635:
---

Assignee: Ruchi Solani

> Add method to refer entity by unique Attributes
> ---
>
> Key: ATLAS-2635
> URL: https://issues.apache.org/jira/browse/ATLAS-2635
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Reporter: Ruchi Solani
>Assignee: Ruchi Solani
>Priority: Major
>
> Many of the APIs in EntityREST require entity-guid to be provided. It will be 
> useful to operate on entities given its typeName and uniqueAttributes.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (ATLAS-2635) Add API to refer entity by unique Attributes

[Ruchi Solani (JIRA)]

Ruchi Solani created ATLAS-2635:
---

 Summary: Add API to refer entity by unique Attributes
 Key: ATLAS-2635
 URL: https://issues.apache.org/jira/browse/ATLAS-2635
 Project: Atlas
  Issue Type: Bug
  Components:  atlas-core
Reporter: Ruchi Solani


Many of the APIs in EntityREST require entity-guid to be provided. It will be 
useful to operate on entities given its typeName and uniqueAttributes.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (ATLAS-2635) Add method to refer entity by unique Attributes

[Ruchi Solani (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-2635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ruchi Solani updated ATLAS-2635:

Summary: Add method to refer entity by unique Attributes  (was: Add API to 
refer entity by unique Attributes)

> Add method to refer entity by unique Attributes
> ---
>
> Key: ATLAS-2635
> URL: https://issues.apache.org/jira/browse/ATLAS-2635
> Project: Atlas
>  Issue Type: Bug
>  Components:  atlas-core
>Reporter: Ruchi Solani
>Priority: Major
>
> Many of the APIs in EntityREST require entity-guid to be provided. It will be 
> useful to operate on entities given its typeName and uniqueAttributes.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Jenkins build is back to normal : PreCommit-ATLAS-Build-Test #331-master-0001-Test-case-check-CredentialProviderUtilityIT.patch

[Apache Jenkins Server]

See 

[jira] [Commented] (ATLAS-2523) Import relationship, preserving existing GUID

[Graham Wallis (JIRA)]

[ 
https://issues.apache.org/jira/browse/ATLAS-2523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16460725#comment-16460725
 ] 

Graham Wallis commented on ATLAS-2523:
--

Thanks [~ashutoshm]. I think what I am trying to achieve might be slightly 
different - but maybe not. If there is a better way to achieve it I would be 
keen to use the better way. Let me explain what I think I need to achieve and 
how I am currently doing it - it is not all contained in the currently attached 
patch, which has just one part of it.

I need to be able to save reference copies of entities and/or relationships 
that have been read from another repository. In both cases, the existing object 
will have a GUID that was assigned by the other repository. The GUID may or may 
not conform to the Java UUID formatting that we use and enforce in Atlas. The 
externally assigned GUID could be (almost*) any string (*only 'almost' because 
I preclude strings starting with '-' as explained below).

This is what I am actually doing currently (most of it not yet contained in the 
patch):
 * In the case of an entity to be saved, I use the entity store's import API 
which accepts  an external GUID, provided it is of an acceptable format (see 
below).
 * For a relationship to be saved, the relationship store (currently) always 
assigns a new GUID - which will overwrite the external GUID. So I am changing 
the relationship store to detect if there is a supplied GUID and to use that 
instead of generating a new GUID every time.
 * I have also made a change to AtlasTypeUtil to relax the UUID format checking 
so it will accept any non-empty string as a valid (assigned) GUID provided it 
does not start with '-'. If a GUID starting with '-' is supplied it is still 
treated as an unassigned GUID and is replaced.
 * I have also added a system attribute to AtlasEntity (and will do the same to 
AtlasRelationship) so that we can save the identity of the repository that is 
the home repository for the entity or relationship. This is the identity of the 
repository that the enterprise OMRS uses as the master for the object. I am 
calling this system attribute homeId, and it should sit alongside 'guid' - the 
two attributes together will allow the master object to be located, whilst the 
'guid' (which contains the GUID assigned by the home repository) can be used 
for searches and references to the object. The addition of the homeId system 
attribute is the part that I am least confident about at the moment because I 
there are lots of places in the Atlas code that process all the system 
attributes - so I will need to augment all of them to include the homeId. I can 
do that - but will need to be careful not to miss any.

That should be all the changes I was envisaging - they logically form a set 
that I aim to include in an update to the patch.

Does that look like a sensible and consistent approach? Or it there a better 
way to achieve it?

 

[A little further background which is just for completeness:...]

I experimented with packaging the external repository id and the GUID into a 
structured string field and storing it as the GUID inside Atlas - but it very 
quickly became apparent that this would be a bad idea - as all references to 
the GUIDs by external systems and applications would need to be mapped to the 
structured form. So I decided it was preferable to keep the GUID field as 
containing just the supplied GUID (whether internally or externally generated). 
I thought about adding the external GUID and home repository identity as 
externally defined properties of the instances - but that would really mess up 
the type system, so I also rejected that in favour of using a system attribute.

> Import relationship, preserving existing GUID
> -
>
> Key: ATLAS-2523
> URL: https://issues.apache.org/jira/browse/ATLAS-2523
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: 1.0.0
>Reporter: Graham Wallis
>Priority: Major
> Fix For: 1.0.0
>
> Attachments: ATLAS-2523-2018-04-09.patch
>
>
> To add a relationship defined externally (in another metadata repository), I 
> want to be able to add the relationship and maintain the existing GUID.
> This is possible for an entity by performing an import. It does not seem to 
> be possible for relationships., because the relationship store always 
> generates a new GUID, which overwrites the existing GUID.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Build failed in Jenkins: Atlas-master-IntegrationTests #1218

[Apache Jenkins Server]

See 


--
[...truncated 573.38 KB...]
127.0.0.1 - - [02/May/2018:06:46:27 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/8da39beb-d0ea-4385-a263-9573b4dd1fd5 
HTTP/1.1" 200 1524 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:06:46:28 +] "POST 
//localhost:31000/api/atlas/v2/entity/ HTTP/1.1" 200 195 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:06:46:28 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/8da39beb-d0ea-4385-a263-9573b4dd1fd5 
HTTP/1.1" 200 1536 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:06:46:28 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/8da39beb-d0ea-4385-a263-9573b4dd1fd5 
HTTP/1.1" 200 1536 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:06:46:28 +] "POST 
//localhost:31000/api/atlas/v2/entity/ HTTP/1.1" 200 513 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:06:46:28 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/8da39beb-d0ea-4385-a263-9573b4dd1fd5 
HTTP/1.1" 200 1674 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:06:46:28 +] "GET 
//localhost:31000/api/atlas/v2/types/typedef/name/PII_TraitcmUpQgW8Tf HTTP/1.1" 
404 96 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:06:46:28 +] "POST 
//localhost:31000/api/atlas/v2/types/typedefs/ HTTP/1.1" 200 576 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:06:46:28 +] "DELETE 
//localhost:31000/api/atlas/v2/entity/guid/8da39beb-d0ea-4385-a263-9573b4dd1fd5/classification/PII_TraitcmUpQgW8Tf
 HTTP/1.1" 400 114 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:06:46:28 +] "GET 
//localhost:31000/api/atlas/v2/types/typedef/name/PII_TraitJ4cW7giJ9b HTTP/1.1" 
404 96 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:06:46:28 +] "POST 
//localhost:31000/api/atlas/v2/types/typedefs/ HTTP/1.1" 200 425 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:06:46:28 +] "GET 
//localhost:31000/api/atlas/v2/types/classificationdef/name/PII_TraitJ4cW7giJ9b 
HTTP/1.1" 200 332 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:06:46:28 +] "POST 
//localhost:31000/api/atlas/v2/entity/guid/8da39beb-d0ea-4385-a263-9573b4dd1fd5/classifications
 HTTP/1.1" 204 0 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:06:46:28 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/8da39beb-d0ea-4385-a263-9573b4dd1fd5/classifications
 HTTP/1.1" 200 868 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:06:46:28 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/8da39beb-d0ea-4385-a263-9573b4dd1fd5/classifications
 HTTP/1.1" 200 868 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:06:46:28 +] "POST 
//localhost:31000/api/atlas/v2/entity/ HTTP/1.1" 200 359 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:06:46:29 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/8da39beb-d0ea-4385-a263-9573b4dd1fd5 
HTTP/1.1" 200 1854 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:06:46:29 +] "PUT 
//localhost:31000/api/atlas/v2/entity/uniqueAttribute/type/hive_table_v2?attr:qualifiedName=tableEVwCyZ5TnN
 HTTP/1.1" 200 510 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:06:46:29 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/8da39beb-d0ea-4385-a263-9573b4dd1fd5 
HTTP/1.1" 200 1930 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:06:46:49 +] "GET 
//localhost:31000/api/atlas/v2/types/typedef/name/PII_TraitHYWzF0hHqI HTTP/1.1" 
404 96 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:06:46:49 +] "POST 
//localhost:31000/api/atlas/v2/types/typedefs/ HTTP/1.1" 200 425 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:06:46:49 +] "POST 
//localhost:31000/api/atlas/v2/entity/guid/8da39beb-d0ea-4385-a263-9573b4dd1fd5/classifications
 HTTP/1.1" 204 0 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:06:46:50 +] "GET 
//localhost:31000/api/atlas/entities/8da39beb-d0ea-4385-a263-9573b4dd1fd5/audit?count=100
 HTTP/1.1" 200 21391 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:06:46:50 +] "GET 
//localhost:31000/api/atlas/v2/types/typedef/name/PII_Traitx86nOO9TG4 HTTP/1.1" 
404 96 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:06:46:50 +] "POST 
//localhost:31000/api/atlas/v2/types/typedefs/ HTTP/1.1" 200 576 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:06:46:50 +] "POST 
//localhost:31000/api/atlas/v2/entity/guid/8da39beb-d0ea-4385-a263-9573b4dd1fd5/classifications
 HTTP/1.1" 204 0 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:06:46:50 +] "GET 
//localhost:31000/api/atlas/v2/entity/guid/8da39beb-d0ea-4385-a263-9573b4dd1fd5 
HTTP/1.1" 200 2166 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:06:46:50 +] "GET 
//localhost:31000/api/atlas/v2/types/typedef/name/PII_TraitWAvTTSLxcY HTTP/1.1" 
404 96 "-" "Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:06:46:50 +] "POST 
//localhost:31000/api/atlas/v2/types/typedefs/ HTTP/1.1" 200 425 "-" 
"Java/1.8.0_172"
127.0.0.1 - - [02/May/2018:06:46:51 +] "POST 
//localhost:31000/api/atlas/v2/entity/guid/8da39beb-d0ea-4385-a