[ https://issues.apache.org/jira/browse/ATLAS-1119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Shwetha G S updated ATLAS-1119: ------------------------------- Attachment: ATLAS-1119.2.patch Committed to master. Thanks Suma > Add retries for edge label creation > ----------------------------------- > > Key: ATLAS-1119 > URL: https://issues.apache.org/jira/browse/ATLAS-1119 > Project: Atlas > Issue Type: Bug > Affects Versions: 0.8-incubating > Reporter: Suma Shivaprasad > Assignee: Suma Shivaprasad > Fix For: 0.8-incubating > > Attachments: ATLAS-1119.2.patch, ATLAS-1119.patch > > > Concurrent operations will fail when trying to create edge label which tries > to define a new property key for the edge label if it doesnt exist. > {noformat} > 2016-08-15 04:08:28,475 DEBUG - [pool-8-thread-1:] ~ Adding a new trait=PII > for entity=b1630277-e8dc-4fcf-94af-c0c8b0b51c09 > (GraphBackedMetadataRepository:222) > 2016-08-15 04:08:28,476 DEBUG - [pool-8-thread-2:] ~ Adding a new trait=PII > for entity=5e335fed-4a74-496d-8521-1678caf85813 > (GraphBackedMetadataRepository:222) > 2016-08-15 04:08:28,477 DEBUG - [pool-8-thread-1:] ~ Finding vertex with > __guid = b1630277-e8dc-4fcf-94af-c0c8b0b51c09, (GraphHelper:182) > 2016-08-15 04:08:28,477 DEBUG - [pool-8-thread-2:] ~ Finding vertex with > __guid = 5e335fed-4a74-496d-8521-1678caf85813, (GraphHelper:182) > 2016-08-15 04:08:28,477 DEBUG - [pool-8-thread-3:] ~ Executing dsl > query=hive_table (GraphBackedDiscoveryService:133) > 2016-08-15 04:08:28,483 DEBUG - [pool-8-thread-2:] ~ Found a vertex > vertex[id=8704 type=hive_database guid=5e335fed-4a74-496d-8521-1678caf85813] > with __guid = 5e335fed-4a74-496d-8521-1678caf85813, (GraphHelper:192) > 2016-08-15 04:08:28,484 DEBUG - [pool-8-thread-2:] ~ Creating vertex for type > PII id null (GraphHelper:97) > 2016-08-15 04:08:28,485 DEBUG - [pool-8-thread-2:] ~ Setting property > __typeName = "PII" to vertex[id=8960 type=null guid=null] (GraphHelper:290) > 2016-08-15 04:08:28,487 DEBUG - [pool-8-thread-2:] ~ Set property __typeName > = "PII" to vertex[id=8960 type=null guid=null] (GraphHelper:300) > 2016-08-15 04:08:28,487 DEBUG - [pool-8-thread-2:] ~ Setting property __state > = "ACTIVE" to vertex[id=8960 type=PII guid=null] (GraphHelper:290) > 2016-08-15 04:08:28,488 DEBUG - [pool-8-thread-2:] ~ Set property __state = > "ACTIVE" to vertex[id=8960 type=PII guid=null] (GraphHelper:300) > 2016-08-15 04:08:28,488 DEBUG - [pool-8-thread-1:] ~ Found a vertex > vertex[id=8448 type=hive_database guid=b1630277-e8dc-4fcf-94af-c0c8b0b51c09] > with __guid = b1630277-e8dc-4fcf-94af-c0c8b0b51c09, (GraphHelper:192) > 2016-08-15 04:08:28,488 DEBUG - [pool-8-thread-2:] ~ Setting property > __timestamp = "1471234108488" to vertex[id=8960 type=PII guid=null] > (GraphHelper:290) > 2016-08-15 04:08:28,489 DEBUG - [pool-8-thread-1:] ~ Creating vertex for type > PII id null (GraphHelper:97) > 2016-08-15 04:08:28,490 DEBUG - [pool-8-thread-2:] ~ Set property __timestamp > = "1471234108488" to vertex[id=8960 type=PII guid=null] (GraphHelper:300) > 2016-08-15 04:08:28,490 DEBUG - [pool-8-thread-2:] ~ Setting property > __modificationTimestamp = "1471234108488" to vertex[id=8960 type=PII > guid=null] (GraphHelper:290) > 2016-08-15 04:08:28,490 DEBUG - [pool-8-thread-1:] ~ Setting property > __typeName = "PII" to vertex[id=9216 type=null guid=null] (GraphHelper:290) > 2016-08-15 04:08:28,490 DEBUG - [pool-8-thread-2:] ~ Set property > __modificationTimestamp = "1471234108488" to vertex[id=8960 type=PII > guid=null] (GraphHelper:300) > 2016-08-15 04:08:28,491 DEBUG - [pool-8-thread-2:] ~ created vertex > vertex[id=8960 type=PII guid=null] for trait PII > (TypedInstanceToGraphMapper:665) > 2016-08-15 04:08:28,492 DEBUG - [pool-8-thread-2:] ~ Mapping instance > struct[type=PII] to vertex vertex[id=8960 type=PII guid=null] > (TypedInstanceToGraphMapper:181) > 2016-08-15 04:08:28,492 DEBUG - [pool-8-thread-2:] ~ Setting property > __modificationTimestamp = "1471234108488" to vertex[id=8960 type=PII > guid=null] (GraphHelper:290) > 2016-08-15 04:08:28,492 DEBUG - [pool-8-thread-2:] ~ Finding edges for > vertex[id=8960 type=PII guid=null] with label hive_database.PII > (GraphHelper:201) > 2016-08-15 04:08:28,493 DEBUG - [pool-8-thread-2:] ~ Adding edge for > vertex[id=8704 type=hive_database guid=5e335fed-4a74-496d-8521-1678caf85813] > -> label hive_database.PII -> vertex[id=8960 type=PII guid=null] > (GraphHelper:122) > 2016-08-15 04:08:28,493 DEBUG - [pool-8-thread-1:] ~ Set property __typeName > = "PII" to vertex[id=9216 type=null guid=null] (GraphHelper:300) > 2016-08-15 04:08:28,494 DEBUG - [pool-8-thread-1:] ~ Setting property __state > = "ACTIVE" to vertex[id=9216 type=PII guid=null] (GraphHelper:290) > 2016-08-15 04:08:28,495 DEBUG - [pool-8-thread-3:] ~ Query = hive_table limit > 10 offset 0 (GraphBackedDiscoveryService:158) > 2016-08-15 04:08:28,495 DEBUG - [pool-8-thread-3:] ~ Expression Tree = > LimitExpression 10, 0 > ClassExpression hive_table > (GraphBackedDiscoveryService:159) > 2016-08-15 04:08:28,496 DEBUG - [pool-8-thread-3:] ~ Gremlin Query = > L:{_var_0 = [] as Set;g.V().has("__typeName", > "hive_table").fill(_var_0);g.V().has("__superTypeNames", > "hive_table").fill(_var_0);_var_0._() [0..<10].toList()} > (GraphBackedDiscoveryService:160) > 2016-08-15 04:08:28,495 DEBUG - [pool-8-thread-1:] ~ Set property __state = > "ACTIVE" to vertex[id=9216 type=PII guid=null] (GraphHelper:300) > 2016-08-15 04:08:28,497 DEBUG - [pool-8-thread-1:] ~ Setting property > __timestamp = "1471234108497" to vertex[id=9216 type=PII guid=null] > (GraphHelper:290) > 2016-08-15 04:08:28,499 DEBUG - [pool-8-thread-2:] ~ Setting property __state > = "ACTIVE" to edge[id=1f0g-6ps-5slx-6ww label=hive_database.PII from > vertex[id=8704 type=hive_database guid=5e335fed-4a74-496d-8521-1678caf85813] > -> to vertex[id=8960 type=PII guid=null]] (GraphHelper:290) > 2016-08-15 04:08:28,500 DEBUG - [pool-8-thread-2:] ~ Set property __state = > "ACTIVE" to edge[id=1f0g-6ps-5slx-6ww label=hive_database.PII from > vertex[id=8704 type=hive_database guid=5e335fed-4a74-496d-8521-1678caf85813] > -> to vertex[id=8960 type=PII guid=null]] (GraphHelper:300) > 2016-08-15 04:08:28,500 DEBUG - [pool-8-thread-1:] ~ Set property __timestamp > = "1471234108497" to vertex[id=9216 type=PII guid=null] (GraphHelper:300) > 2016-08-15 04:08:28,500 DEBUG - [pool-8-thread-2:] ~ Setting property > __timestamp = "1471234108488" to edge[id=1f0g-6ps-5slx-6ww > label=hive_database.PII from vertex[id=8704 type=hive_database > guid=5e335fed-4a74-496d-8521-1678caf85813] -> to vertex[id=8960 type=PII > guid=null]] (GraphHelper:290) > 2016-08-15 04:08:28,501 DEBUG - [pool-8-thread-2:] ~ Set property __timestamp > = "1471234108488" to edge[id=1f0g-6ps-5slx-6ww label=hive_database.PII from > vertex[id=8704 type=hive_database guid=5e335fed-4a74-496d-8521-1678caf85813] > -> to vertex[id=8960 type=PII guid=null]] (GraphHelper:300) > 2016-08-15 04:08:28,501 DEBUG - [pool-8-thread-1:] ~ Setting property > __modificationTimestamp = "1471234108497" to vertex[id=9216 type=PII > guid=null] (GraphHelper:290) > 2016-08-15 04:08:28,501 DEBUG - [pool-8-thread-2:] ~ Setting property > __modificationTimestamp = "1471234108488" to edge[id=1f0g-6ps-5slx-6ww > label=hive_database.PII from vertex[id=8704 type=hive_database > guid=5e335fed-4a74-496d-8521-1678caf85813] -> to vertex[id=8960 type=PII > guid=null]] (GraphHelper:290) > 2016-08-15 04:08:28,501 DEBUG - [pool-8-thread-2:] ~ Set property > __modificationTimestamp = "1471234108488" to edge[id=1f0g-6ps-5slx-6ww > label=hive_database.PII from vertex[id=8704 type=hive_database > guid=5e335fed-4a74-496d-8521-1678caf85813] -> to vertex[id=8960 type=PII > guid=null]] (GraphHelper:300) > 2016-08-15 04:08:28,502 DEBUG - [pool-8-thread-1:] ~ Set property > __modificationTimestamp = "1471234108497" to vertex[id=9216 type=PII > guid=null] (GraphHelper:300) > 2016-08-15 04:08:28,502 DEBUG - [pool-8-thread-2:] ~ Added > edge[id=1f0g-6ps-5slx-6ww label=hive_database.PII from vertex[id=8704 > type=hive_database guid=5e335fed-4a74-496d-8521-1678caf85813] -> to > vertex[id=8960 type=PII guid=null]] (GraphHelper:129) > 2016-08-15 04:08:28,502 DEBUG - [pool-8-thread-1:] ~ created vertex > vertex[id=9216 type=PII guid=null] for trait PII > (TypedInstanceToGraphMapper:665) > 2016-08-15 04:08:28,503 DEBUG - [pool-8-thread-2:] ~ Adding property > __traitNames = "PII" to vertex vertex[id=8704 type=hive_database > guid=5e335fed-4a74-496d-8521-1678caf85813] (GraphHelper:329) > 2016-08-15 04:08:28,503 DEBUG - [pool-8-thread-1:] ~ Mapping instance > struct[type=PII] to vertex vertex[id=9216 type=PII guid=null] > (TypedInstanceToGraphMapper:181) > 2016-08-15 04:08:28,504 DEBUG - [pool-8-thread-2:] ~ Setting property > __modificationTimestamp = "1471234108488" to vertex[id=8704 > type=hive_database guid=5e335fed-4a74-496d-8521-1678caf85813] > (GraphHelper:290) > 2016-08-15 04:08:28,504 DEBUG - [pool-8-thread-1:] ~ Setting property > __modificationTimestamp = "1471234108497" to vertex[id=9216 type=PII > guid=null] (GraphHelper:290) > 2016-08-15 04:08:28,505 DEBUG - [pool-8-thread-2:] ~ Set property > __modificationTimestamp = "1471234108488" to vertex[id=8704 > type=hive_database guid=5e335fed-4a74-496d-8521-1678caf85813] > (GraphHelper:300) > 2016-08-15 04:08:28,505 DEBUG - [pool-8-thread-1:] ~ Finding edges for > vertex[id=9216 type=PII guid=null] with label hive_database.PII > (GraphHelper:201) > 2016-08-15 04:08:28,506 DEBUG - [pool-8-thread-1:] ~ Adding edge for > vertex[id=8448 type=hive_database guid=b1630277-e8dc-4fcf-94af-c0c8b0b51c09] > -> label hive_database.PII -> vertex[id=9216 type=PII guid=null] > (GraphHelper:122) > 2016-08-15 04:08:28,532 ERROR - [pool-8-thread-1:] ~ graph rollback due to > exception (GraphTransactionInterceptor:48) > org.apache.atlas.repository.RepositoryException: > com.thinkaurelius.titan.core.SchemaViolationException: Adding this property > for key [system%&%SchemaName] and value [rt%hive_database.PII] violates a > uniqueness constraint [SystemIndex#system%&%SchemaName] > at > org.apache.atlas.repository.graph.GraphBackedMetadataRepository.addTrait(GraphBackedMetadataRepository.java:243) > at > org.apache.atlas.GraphTransactionInterceptor.invoke(GraphTransactionInterceptor.java:42) > at > org.apache.atlas.repository.graph.GraphBackedMetadataRepositoryTest$1.call(GraphBackedMetadataRepositoryTest.java:155) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) > at java.util.concurrent.FutureTask.run(FutureTask.java:166) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:722) > Caused by: com.thinkaurelius.titan.core.SchemaViolationException: Adding this > property for key [system%&%SchemaName] and value [rt%hive_database.PII] > violates a uniqueness constraint [SystemIndex#system%&%SchemaName] > at > com.thinkaurelius.titan.graphdb.transaction.StandardTitanTx.addPropertyInternal(StandardTitanTx.java:740) > at > com.thinkaurelius.titan.graphdb.transaction.StandardTitanTx.setProperty(StandardTitanTx.java:778) > at > com.thinkaurelius.titan.graphdb.transaction.StandardTitanTx.addProperty(StandardTitanTx.java:696) > at > com.thinkaurelius.titan.graphdb.transaction.StandardTitanTx.makeSchemaVertex(StandardTitanTx.java:815) > at > com.thinkaurelius.titan.graphdb.transaction.StandardTitanTx.makeEdgeLabel(StandardTitanTx.java:839) > at > com.thinkaurelius.titan.graphdb.types.StandardEdgeLabelMaker.make(StandardEdgeLabelMaker.java:88) > at > com.thinkaurelius.titan.graphdb.blueprints.BlueprintsDefaultSchemaMaker.makeEdgeLabel(BlueprintsDefaultSchemaMaker.java:23) > at > com.thinkaurelius.titan.graphdb.transaction.StandardTitanTx.getOrCreateEdgeLabel(StandardTitanTx.java:920) > at > com.thinkaurelius.titan.graphdb.blueprints.TitanBlueprintsTransaction.addEdge(TitanBlueprintsTransaction.java:132) > at > com.thinkaurelius.titan.graphdb.blueprints.TitanBlueprintsTransaction.addEdge(TitanBlueprintsTransaction.java:124) > at > com.thinkaurelius.titan.graphdb.blueprints.TitanBlueprintsGraph.addEdge(TitanBlueprintsGraph.java:250) > at > com.thinkaurelius.titan.graphdb.blueprints.TitanBlueprintsGraph.addEdge(TitanBlueprintsGraph.java:27) > at > org.apache.atlas.repository.graph.GraphHelper.addEdge(GraphHelper.java:123) > at > org.apache.atlas.repository.graph.GraphHelper.getOrCreateEdge(GraphHelper.java:145) > at > org.apache.atlas.repository.graph.TypedInstanceToGraphMapper.mapTraitInstanceToVertex(TypedInstanceToGraphMapper.java:672) > at > org.apache.atlas.repository.graph.GraphBackedMetadataRepository.addTrait(GraphBackedMetadataRepository.java:231) > ... 7 more > 2016-08-15 04:08:28,536 INFO - [pool-8-thread-2:] ~ graph commit > (GraphTransactionInterceptor:44) > {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)