[jira] [Commented] (ATLAS-1279) Remove QueryPlan attribute from Hive Process entity

[Vimal Sharma (JIRA)]

[ 
https://issues.apache.org/jira/browse/ATLAS-1279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15666434#comment-15666434
 ] 

Vimal Sharma commented on ATLAS-1279:
-

Committed to master. Thanks Shwetha for the review

> Remove QueryPlan attribute from Hive Process entity
> ---
>
> Key: ATLAS-1279
> URL: https://issues.apache.org/jira/browse/ATLAS-1279
> Project: Atlas
>  Issue Type: Bug
>Reporter: Vimal Sharma
>Assignee: Vimal Sharma
> Fix For: 0.8-incubating
>
> Attachments: ATLAS-1279-v2.patch, ATLAS-1279.patch
>
>
> The attribute QueryPlan is a required attribute of a Hive Process entity. 
> This attribute is not used anywhere. Further due to API changes in Hive LLAP 
> version, there is conflict in function call to get JSON Plan of query. The 
> function calls in Hive 1.2 and Hive 2 have different method signature.
> Since, QueryPlan is not used, it should be removed so that Atlas code is 
> consistent for Hive 1.x and Hive 2.x



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ATLAS-1081) Atlas jetty server configuration

[Vimal Sharma (JIRA)]

[ 
https://issues.apache.org/jira/browse/ATLAS-1081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15666252#comment-15666252
 ] 

Vimal Sharma commented on ATLAS-1081:
-

+1

> Atlas jetty server configuration
> 
>
> Key: ATLAS-1081
> URL: https://issues.apache.org/jira/browse/ATLAS-1081
> Project: Atlas
>  Issue Type: Bug
>Reporter: Shwetha G S
>Assignee: Shwetha G S
> Fix For: 0.8-incubating
>
> Attachments: ATLAS-1081-v2.patch, ATLAS-1081.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (ATLAS-1279) Remove QueryPlan attribute from Hive Process entity

[Vimal Sharma (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-1279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vimal Sharma updated ATLAS-1279:

Fix Version/s: 0.8-incubating

> Remove QueryPlan attribute from Hive Process entity
> ---
>
> Key: ATLAS-1279
> URL: https://issues.apache.org/jira/browse/ATLAS-1279
> Project: Atlas
>  Issue Type: Bug
>Reporter: Vimal Sharma
>Assignee: Vimal Sharma
> Fix For: 0.8-incubating
>
> Attachments: ATLAS-1279-v2.patch, ATLAS-1279.patch
>
>
> The attribute QueryPlan is a required attribute of a Hive Process entity. 
> This attribute is not used anywhere. Further due to API changes in Hive LLAP 
> version, there is conflict in function call to get JSON Plan of query. The 
> function calls in Hive 1.2 and Hive 2 have different method signature.
> Since, QueryPlan is not used, it should be removed so that Atlas code is 
> consistent for Hive 1.x and Hive 2.x



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Review Request 53653: ATLAS-1284 Fixed issues with order by clause while sorting with alias and on super type attributes

[Shwetha GS]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/53653/#review155887
---



Will query 'hive_table select owner as o orderby o' work as well?

- Shwetha GS


On Nov. 11, 2016, 2:34 p.m., Neeru Gupta wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/53653/
> ---
> 
> (Updated Nov. 11, 2016, 2:34 p.m.)
> 
> 
> Review request for atlas and Jeff Hagelberg.
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> Merge branch 'master' into oms-750
> 
> 
> Diffs
> -
> 
>   
> repository/src/main/java/org/apache/atlas/gremlin/Gremlin2ExpressionFactory.java
>  a901b5127b3dcd2939fec2c642475d7aad869d8e 
>   
> repository/src/main/java/org/apache/atlas/gremlin/Gremlin3ExpressionFactory.java
>  32189bc6dab4cc25748e7b6136dc0a89476012c7 
>   repository/src/main/scala/org/apache/atlas/query/GremlinQuery.scala 
> ee58eee7b4b2c41cc8f6dc1e4952b83ed0c833df 
>   repository/src/main/scala/org/apache/atlas/query/Resolver.scala 
> cff92afe98a6215499a70a9ef00a937804abe73e 
>   repository/src/test/java/org/apache/atlas/BaseRepositoryTest.java 
> 8851b793b0ca032efb57bd76ec9198822e1520c2 
>   
> repository/src/test/java/org/apache/atlas/discovery/GraphBackedDiscoveryServiceTest.java
>  645fef1fb3abf8cd2d4abf4429b00c32837ef0c0 
> 
> Diff: https://reviews.apache.org/r/53653/diff/
> 
> 
> Testing
> ---
> 
> Executed all existing order by tests successfully. Added new tests to order 
> by with alias
> 
> 
> Thanks,
> 
> Neeru Gupta
> 
>

Re: Review Request 53749: [ATLAS-1293] Add query text information for hive_process entities in lineage

[Shwetha GS]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/53749/#review155886
---




repository/src/main/java/org/apache/atlas/discovery/EntityLineageService.java 
(line 199)


For hdfs path, qualified name contains the full path including namenode 
endpoint which is not relevant while viewing the lineage(Only part of the value 
is shown in UI and only the namenode endpoint is visible, which is not a good 
user experience). 

Instead of hardcoding these attributes on server side, we should make this 
part of model(type definition), just like attributes marked for search results 
display


- Shwetha GS


On Nov. 15, 2016, 1:44 a.m., Sarath Subramanian wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/53749/
> ---
> 
> (Updated Nov. 15, 2016, 1:44 a.m.)
> 
> 
> Review request for atlas, Apoorv Naik, keval bhatt, Madhan Neethiraj, Shwetha 
> GS, and Suma Shivaprasad.
> 
> 
> Bugs: ATLAS-1293
> https://issues.apache.org/jira/browse/ATLAS-1293
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> When UI renders lineage for an entity using v2 lineage APIs, query text needs 
> to be displayed for hive_process types.
> 
> 
> Diffs
> -
> 
>   
> repository/src/main/java/org/apache/atlas/discovery/EntityLineageService.java 
> 14bf143 
> 
> Diff: https://reviews.apache.org/r/53749/diff/
> 
> 
> Testing
> ---
> 
> verified using POST man rest client and ran all unit tests.
> 
> 
> Thanks,
> 
> Sarath Subramanian
> 
>

[jira] [Commented] (ATLAS-1081) Atlas jetty server configuration

[Shwetha G S (JIRA)]

[ 
https://issues.apache.org/jira/browse/ATLAS-1081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15666216#comment-15666216
 ] 

Shwetha G S commented on ATLAS-1081:


If we don't have separate methods for getInt(), getLong(), the calling context 
has to type cast the return value and calling generic getProperty() that 
returns Object on underlying Configuration was causing some format exceptions

> Atlas jetty server configuration
> 
>
> Key: ATLAS-1081
> URL: https://issues.apache.org/jira/browse/ATLAS-1081
> Project: Atlas
>  Issue Type: Bug
>Reporter: Shwetha G S
>Assignee: Shwetha G S
> Fix For: 0.8-incubating
>
> Attachments: ATLAS-1081-v2.patch, ATLAS-1081.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Resolved] (ATLAS-1290) webapp: Integration test failures while trying to create hive_table without creating a reference to hive_db

[Shwetha G S (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-1290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shwetha G S resolved ATLAS-1290.

Resolution: Duplicate

> webapp: Integration test failures while trying to create hive_table without 
> creating a reference to hive_db
> ---
>
> Key: ATLAS-1290
> URL: https://issues.apache.org/jira/browse/ATLAS-1290
> Project: Atlas
>  Issue Type: Bug
>Reporter: Ayub Khan
>Assignee: Ayub Khan
>Priority: Blocker
>
> {noformat}
> Failed tests: 
> EntityNotificationIT.testCreateEntity:85->BaseResourceIT.createInstance:114 » 
> AtlasService
> EntityNotificationIT.testDeleteEntity:111->BaseResourceIT.createInstance:114 
> » AtlasService
> NotificationHookConsumerIT.testCreateEntity:89->BaseResourceIT.waitFor:287 » 
> ...
> NotificationHookConsumerIT.testDeleteByQualifiedName:164 » AtlasService 
> Metada...
> NotificationHookConsumerIT.testMessageHandleFailureConsumerContinues:72->BaseResourceIT.waitFor:287
>  » 
> NotificationHookConsumerIT.testUpdateEntityFullUpdate:183 » AtlasService 
> Metad...
> NotificationHookConsumerIT.testUpdateEntityPartial:111 » AtlasService 
> Metadata...
> NotificationHookConsumerIT.testUpdatePartialUpdatingQualifiedName:136 » 
> AtlasService
> DataSetLineageJerseyResourceIT.setUp:58->setupInstances:224->database:272->BaseResourceIT.createInstance:114
>  » AtlasService
> EntityJerseyResourceIT.testDeleteEntitiesViaClientApi:874->BaseResourceIT.createInstance:114
>  » AtlasService
> EntityJerseyResourceIT.testDeleteEntitiesViaRestApi:844->BaseResourceIT.createInstance:114
>  » AtlasService
> EntityJerseyResourceIT.testDeleteEntityByUniqAttribute:903->BaseResourceIT.createInstance:114
>  » AtlasService
> EntityJerseyResourceIT.testEntityDeduping:176 » AtlasService Metadata service 
> ...
> EntityJerseyResourceIT.testGetEntityByAttribute:283->BaseResourceIT.createInstance:114
>  » AtlasService
> EntityJerseyResourceIT.testRequestUser:138 » AtlasService Metadata service 
> API...
> EntityJerseyResourceIT.testSubmitEntity:115->BaseResourceIT.createInstance:114
>  » AtlasService
> EntityJerseyResourceIT.testSubmitEntityWithBadDateFormat:299 expected: 
> but was:
> EntityJerseyResourceIT.testSubmitSingleEntity:156 expected:<201> but was:<400>
> Tests run: 82, Failures: 18, Errors: 0, Skipped: 27
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (ATLAS-1292) Atlas webapp Integration Tests failing

[Shwetha G S (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-1292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shwetha G S updated ATLAS-1292:
---
Assignee: Ayub Khan

> Atlas webapp Integration Tests failing 
> ---
>
> Key: ATLAS-1292
> URL: https://issues.apache.org/jira/browse/ATLAS-1292
> Project: Atlas
>  Issue Type: Bug
>Reporter: Suma Shivaprasad
>Assignee: Ayub Khan
>Priority: Blocker
>
> {noformat}
> Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.103 sec - 
> in org.apache.atlas.web.resources.TypesJerseyResourceIT
> Results :
> Failed tests:
>   EntityNotificationIT.testCreateEntity:85->BaseResourceIT.createInstance:114 
> » AtlasService
>   
> EntityNotificationIT.testDeleteEntity:111->BaseResourceIT.createInstance:114 
> » AtlasService
>   NotificationHookConsumerIT.testCreateEntity:89->BaseResourceIT.waitFor:287 
> »  ...
>   NotificationHookConsumerIT.testDeleteByQualifiedName:164 » AtlasService 
> Metada...
>   
> NotificationHookConsumerIT.testMessageHandleFailureConsumerContinues:72->BaseResourceIT.waitFor:287
>  »
>   NotificationHookConsumerIT.testUpdateEntityFullUpdate:183 » AtlasService 
> Metad...
>   NotificationHookConsumerIT.testUpdateEntityPartial:111 » AtlasService 
> Metadata...
>   NotificationHookConsumerIT.testUpdatePartialUpdatingQualifiedName:136 » 
> AtlasService
>   
> DataSetLineageJerseyResourceIT.setUp:58->setupInstances:224->database:272->BaseResourceIT.createInstance:114
>  » AtlasService
>   
> EntityJerseyResourceIT.testDeleteEntitiesViaClientApi:874->BaseResourceIT.createInstance:114
>  » AtlasService
>   
> EntityJerseyResourceIT.testDeleteEntitiesViaRestApi:844->BaseResourceIT.createInstance:114
>  » AtlasService
>   
> EntityJerseyResourceIT.testDeleteEntityByUniqAttribute:903->BaseResourceIT.createInstance:114
>  » AtlasService
>   EntityJerseyResourceIT.testEntityDeduping:176 » AtlasService Metadata 
> service ...
>   
> EntityJerseyResourceIT.testGetEntityByAttribute:283->BaseResourceIT.createInstance:114
>  » AtlasService
>   EntityJerseyResourceIT.testRequestUser:138 » AtlasService Metadata service 
> API...
>   
> EntityJerseyResourceIT.testSubmitEntity:115->BaseResourceIT.createInstance:114
>  » AtlasService
>   EntityJerseyResourceIT.testSubmitEntityWithBadDateFormat:299 
> expected: but was:
>   EntityJerseyResourceIT.testSubmitSingleEntity:156 expected:<201> but 
> was:<400>
>   
> EntityLineageJerseyResourceIT.setUp:62->setupInstances:157->database:204->BaseResourceIT.createInstance:114
>  » AtlasService
>   TypedefsJerseyResourceIT.testCreate:86 » AtlasService Metadata service API 
> org...
>   TypedefsJerseyResourceIT.testDuplicateCreate:98 » AtlasService Metadata 
> servic...
>   TypedefsJerseyResourceIT.testListTypesByFilter:254 » AtlasService Metadata 
> ser...
>   TypedefsJerseyResourceIT.testUpdate:118 » AtlasService Metadata service API 
> or...
> Tests run: 92, Failures: 23, Errors: 0, Skipped: 31
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Review Request 53748: Updated equals and hashCode signatures

[Apoorv Naik]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/53748/
---

Review request for atlas, Madhan Neethiraj, Sarath Subramanian, Shwetha GS, and 
Suma Shivaprasad.


Repository: atlas


Description
---

Updated equals and hashCode signatures

Using JDK7's built-in classes to simplify the code and make it more 
readable/understandable.


Diffs
-

  catalog/src/main/java/org/apache/atlas/catalog/BaseRequest.java b0e428f 
  client/src/main/java/org/apache/atlas/EntityAuditEvent.java 29a04ab 
  common/src/main/java/org/apache/atlas/ha/HAConfiguration.java aefaef5 
  intg/src/main/java/org/apache/atlas/model/instance/AtlasEntity.java 6727f27 
  intg/src/main/java/org/apache/atlas/model/instance/AtlasEntityHeader.java 
d9c74ae 
  
intg/src/main/java/org/apache/atlas/model/instance/AtlasEntityWithAssociations.java
 4ddd585 
  intg/src/main/java/org/apache/atlas/model/instance/AtlasObjectId.java 5921fea 
  intg/src/main/java/org/apache/atlas/model/instance/AtlasStruct.java 695f1bb 
  
intg/src/main/java/org/apache/atlas/model/instance/EntityMutationResponse.java 
a6c75ed 
  intg/src/main/java/org/apache/atlas/model/instance/EntityMutations.java 
e489f33 
  intg/src/main/java/org/apache/atlas/model/lineage/AtlasLineageInfo.java 
61b7f91 
  intg/src/main/java/org/apache/atlas/model/typedef/AtlasBaseTypeDef.java 
d953633 
  intg/src/main/java/org/apache/atlas/model/typedef/AtlasClassificationDef.java 
2e34127 
  intg/src/main/java/org/apache/atlas/model/typedef/AtlasEntityDef.java 86e2388 
  intg/src/main/java/org/apache/atlas/model/typedef/AtlasEnumDef.java e4c5e1b 
  intg/src/main/java/org/apache/atlas/model/typedef/AtlasStructDef.java 582b095 
  intg/src/main/java/org/apache/atlas/model/typedef/AtlasTypeDefHeader.java 
a3929b3 
  notification/src/main/java/org/apache/atlas/notification/MessageVersion.java 
6ef407a 
  
notification/src/main/java/org/apache/atlas/notification/entity/EntityNotificationImpl.java
 fda588e 
  
notification/src/test/java/org/apache/atlas/notification/AbstractNotificationConsumerTest.java
 ed5b9fc 
  repository/src/main/java/org/apache/atlas/repository/graph/GraphHelper.java 
7e47d30 
  typesystem/src/main/java/org/apache/atlas/typesystem/Referenceable.java 
5b8e157 
  typesystem/src/main/java/org/apache/atlas/typesystem/persistence/Id.java 
42280d0 
  
typesystem/src/main/java/org/apache/atlas/typesystem/types/AttributeDefinition.java
 f556223 
  typesystem/src/main/java/org/apache/atlas/typesystem/types/AttributeInfo.java 
9cb0d0d 
  
typesystem/src/main/java/org/apache/atlas/typesystem/types/EnumTypeDefinition.java
 ac3b5a3 
  
typesystem/src/main/java/org/apache/atlas/typesystem/types/HierarchicalTypeDefinition.java
 8069422 
  typesystem/src/main/java/org/apache/atlas/typesystem/types/Multiplicity.java 
18ef2ee 
  
typesystem/src/main/java/org/apache/atlas/typesystem/types/StructTypeDefinition.java
 c9316cc 
  webapp/src/main/java/org/apache/atlas/web/params/AbstractParam.java 9cfdb76 

Diff: https://reviews.apache.org/r/53748/diff/


Testing
---

Working on executing all tests


Thanks,

Apoorv Naik

Re: Review Request 52908: build failure in windows SyntaxError: invalid syntax

[Qiang Zhang]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/52908/#review155878
---


Ship it!




Ship It!

- Qiang Zhang


On 十月 15, 2016, 9:52 a.m., Qiang Zhang wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/52908/
> ---
> 
> (Updated 十月 15, 2016, 9:52 a.m.)
> 
> 
> Review request for atlas.
> 
> 
> Bugs: https://issues.apache.org/jira/browse/ATLAS-1221
> 
> https://issues.apache.org/jira/browse/https://issues.apache.org/jira/browse/ATLAS-1221
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> build failure in windows SyntaxError: invalid syntax The solution:
> then i find in incubator-atlas-eclipse\distro\bin\src\bin directoty
> i Modify atlas_config.py
> line135 Modify except OSError , e: to except OSError as e:
> You can look at the test code here 
> https://github.com/zhangqiang2/incubator-atlas/blob/master/distro/src/bin/atlas_config.py
> 
> 
> Diffs
> -
> 
>   distro/src/bin/atlas_config.py 91c7756a0d9e0331a5d0c4054a4e08a93d5a5043 
> 
> Diff: https://reviews.apache.org/r/52908/diff/
> 
> 
> Testing
> ---
> 
> after modify i build test sucess
> 
> 
> Thanks,
> 
> Qiang Zhang
> 
>

[jira] [Updated] (ATLAS-1293) Add query text information for hive_process entities in lineage

[Sarath Subramanian (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-1293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sarath Subramanian updated ATLAS-1293:
--
Attachment: ATLAS-1293.1.patch

> Add query text information for hive_process entities in lineage
> ---
>
> Key: ATLAS-1293
> URL: https://issues.apache.org/jira/browse/ATLAS-1293
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: 0.8-incubating
>Reporter: Sarath Subramanian
>Assignee: Sarath Subramanian
> Fix For: 0.8-incubating
>
> Attachments: ATLAS-1293.1.patch
>
>
> When UI renders lineage for an entity using v2 lineage APIs, query text needs 
> to be displayed for hive_process types.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Review Request 53749: [ATLAS-1293] Add query text information for hive_process entities in lineage

[Sarath Subramanian]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/53749/
---

Review request for atlas, Apoorv Naik, keval bhatt, Madhan Neethiraj, Shwetha 
GS, and Suma Shivaprasad.


Bugs: ATLAS-1293
https://issues.apache.org/jira/browse/ATLAS-1293


Repository: atlas


Description
---

When UI renders lineage for an entity using v2 lineage APIs, query text needs 
to be displayed for hive_process types.


Diffs
-

  repository/src/main/java/org/apache/atlas/discovery/EntityLineageService.java 
14bf143 

Diff: https://reviews.apache.org/r/53749/diff/


Testing
---

verified using POST man rest client and ran all unit tests.


Thanks,

Sarath Subramanian

[jira] [Updated] (ATLAS-1293) Add query text information for hive_process entities in lineage

[Sarath Subramanian (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-1293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sarath Subramanian updated ATLAS-1293:
--
Summary: Add query text information for hive_process entities in lineage  
(was: Add query text information fir hive_process entities)

> Add query text information for hive_process entities in lineage
> ---
>
> Key: ATLAS-1293
> URL: https://issues.apache.org/jira/browse/ATLAS-1293
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: 0.8-incubating
>Reporter: Sarath Subramanian
>Assignee: Sarath Subramanian
>
> When UI renders lineage for an entity using v2 lineage APIs, query text needs 
> to be displayed for hive_process types.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (ATLAS-1293) Add query text information fir hive_process entities

[Sarath Subramanian (JIRA)]

Sarath Subramanian created ATLAS-1293:
-

 Summary: Add query text information fir hive_process entities
 Key: ATLAS-1293
 URL: https://issues.apache.org/jira/browse/ATLAS-1293
 Project: Atlas
  Issue Type: Bug
Affects Versions: 0.8-incubating
Reporter: Sarath Subramanian
Assignee: Sarath Subramanian


When UI renders lineage for an entity using v2 lineage APIs, query text needs 
to be displayed for hive_process types.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (ATLAS-1242) TypesResource API needs to use the new TypesREST API

[Sarath Subramanian (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-1242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sarath Subramanian updated ATLAS-1242:
--
Attachment: ATLAS-1242.8.patch

> TypesResource API needs to use the new TypesREST API
> 
>
> Key: ATLAS-1242
> URL: https://issues.apache.org/jira/browse/ATLAS-1242
> Project: Atlas
>  Issue Type: New Feature
>Affects Versions: 0.8-incubating
>Reporter: Sarath Subramanian
>Assignee: Sarath Subramanian
> Attachments: ATLAS-1242.8.patch
>
>
> The current Types API (TypesResource) needs to route to the new Types API 
> (TypesREST). 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Review Request 53157: TypesResource API needs to use the new TypesREST API

[Sarath Subramanian]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/53157/
---

(Updated Nov. 14, 2016, 4:37 p.m.)


Review request for atlas, Apoorv Naik, Madhan Neethiraj, Shwetha GS, and Suma 
Shivaprasad.


Bugs: ATLAS-1242
https://issues.apache.org/jira/browse/ATLAS-1242


Repository: atlas


Description (updated)
---

The current Types API (TypesResource) needs to map to the new v2 Types API 
(TypesREST).


Diffs
-

  intg/src/main/java/org/apache/atlas/AtlasErrorCode.java 6a35d2b 
  intg/src/main/java/org/apache/atlas/model/SearchFilter.java 64800a5 
  repository/src/main/java/org/apache/atlas/RepositoryMetadataModule.java 
d3903fb 
  
typesystem/src/main/java/org/apache/atlas/typesystem/types/utils/TypesUtil.java 
77cbd39 
  webapp/src/main/java/org/apache/atlas/util/RestUtils.java PRE-CREATION 
  webapp/src/main/java/org/apache/atlas/web/resources/TypesResource.java 
1eafc7d 
  
webapp/src/test/java/org/apache/atlas/web/resources/TypesJerseyResourceIT.java 
7d03689 

Diff: https://reviews.apache.org/r/53157/diff/


Testing (updated)
---

Integration tests for typesResource is successfull - TypesJerseyResourceIT


Thanks,

Sarath Subramanian

[jira] [Commented] (ATLAS-1292) Atlas webapp Integration Tests failing

[Suma Shivaprasad (JIRA)]

[ 
https://issues.apache.org/jira/browse/ATLAS-1292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15665537#comment-15665537
 ] 

Suma Shivaprasad commented on ATLAS-1292:
-

Sample failures

Tests run: 6, Failures: 6, Errors: 0, Skipped: 0, Time elapsed: 123.545 sec <<< 
FAILURE! - in org.apache.atlas.notification.NotificationHookConsumerIT
testCreateEntity(org.apache.atlas.notification.NotificationHookConsumerIT)  
Time elapsed: 61.272 sec  <<< FAILURE!
java.lang.Exception: Waiting timed out after 6 msec
at 
org.apache.atlas.notification.NotificationHookConsumerIT.testCreateEntity(NotificationHookConsumerIT.java:89)

testDeleteByQualifiedName(org.apache.atlas.notification.NotificationHookConsumerIT)
  Time elapsed: 0.012 sec  <<< FAILURE!
org.apache.atlas.AtlasServiceException: Metadata service API 
org.apache.atlas.AtlasBaseClient$APIInfo@74307de3 failed with status 400 (Bad 
Request) Response Body ({"error":"For field 
'clusterName'","stackTrace":"org.apache.atlas.typesystem.types.ValueConversionException$NullConversionException:
 For field 'clusterName'\n\tat 
org.apache.atlas.typesystem.persistence.StructInstance.set(StructInstance.java:123)\n\tat
 org.apache.atlas.typesystem.types.ClassType.convert(ClassType.java:153)\n\tat 
org.apache.atlas.repository.graph.GraphHelper.getTypedReferenceableInstance(GraphHelper.java:714)\n\tat
 
org.apache.atlas.repository.graph.GraphHelper.deserializeClassInstances(GraphHelper.java:691)\n\tat
 
org.apache.atlas.services.DefaultMetadataService.deserializeClassInstances(DefaultMetadataService.java:280)\n\tat
 
org.apache.atlas.services.DefaultMetadataService.createEntities(DefaultMetadataService.java:268)\n\tat
 
org.apache.atlas.web.resources.EntityResource.submit(EntityResource.java:134)\n\tat
 sun.reflect.GeneratedMethodAccessor96.invoke(Unknown Source)\n\tat 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat
 java.lang.reflect.Method.invoke(Method.java:606)\n\tat 
com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)\n\tat
 
com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$ResponseOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:205)\n\tat
 
com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)\n\tat
 
com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302)\n\tat
 
com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)\n\tat
 
com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)\n\tat
 
com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)\n\tat
 
com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1542)\n\tat
 
com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1473)\n\tat
 
com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1419)\n\tat
 
com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1409)\n\tat
 
com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:409)\n\tat
 
com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:558)\n\tat
 
com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:733)\n\tat
 javax.servlet.http.HttpServlet.service(HttpServlet.java:790)\n\tat 
com.google.inject.servlet.ServletDefinition.doServiceImpl(ServletDefinition.java:287)\n\tat
 
com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.java:277)\n\tat
 
com.google.inject.servlet.ServletDefinition.service(ServletDefinition.java:182)\n\tat
 
com.google.inject.servlet.ManagedServletPipeline.service(ManagedServletPipeline.java:91)\n\tat
 
com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:85)\n\tat
 org.apache.atlas.web.filters.AuditFilter.doFilter(AuditFilter.java:71)\n\tat 
com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:82)\n\tat
 
com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFilterPipeline.java:119)\n\tat
 com.google.inject.servlet.GuiceFilter$1.call(GuiceFilter.java:133)\n\tat 
com.google.inject.servlet.GuiceFilter$1.call(GuiceFilter.java:130)\n\tat 
com.google.inject.servlet.GuiceFilter$Context.call(GuiceFilter.java:203)\n\tat 
com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:130)\n\tat 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)\n\tat
 
org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330)\n\tat
 
org.apache.atlas.web.filters.AtlasAuthorizationFilter.doFilter(AtlasAut

Re: Review Request 53157: TypesResource API needs to use the new TypesREST API

[Sarath Subramanian]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/53157/
---

(Updated Nov. 14, 2016, 4:36 p.m.)


Review request for atlas, Apoorv Naik, Madhan Neethiraj, Shwetha GS, and Suma 
Shivaprasad.


Changes
---

* Added changes to include reverseAttributeName and isComposite attribute 
changes
* Some code refactoring


Bugs: ATLAS-1242
https://issues.apache.org/jira/browse/ATLAS-1242


Repository: atlas


Description
---

The current Types API (TypesResource) needs to route to the new v2 Types API 
(TypesREST).


Diffs (updated)
-

  intg/src/main/java/org/apache/atlas/AtlasErrorCode.java 6a35d2b 
  intg/src/main/java/org/apache/atlas/model/SearchFilter.java 64800a5 
  repository/src/main/java/org/apache/atlas/RepositoryMetadataModule.java 
d3903fb 
  
typesystem/src/main/java/org/apache/atlas/typesystem/types/utils/TypesUtil.java 
77cbd39 
  webapp/src/main/java/org/apache/atlas/util/RestUtils.java PRE-CREATION 
  webapp/src/main/java/org/apache/atlas/web/resources/TypesResource.java 
1eafc7d 
  
webapp/src/test/java/org/apache/atlas/web/resources/TypesJerseyResourceIT.java 
7d03689 

Diff: https://reviews.apache.org/r/53157/diff/


Testing
---

all integration tests for typesResource is successfull - TypesJerseyResourceIT


Thanks,

Sarath Subramanian

[jira] [Created] (ATLAS-1292) Atlas webapp Integration Tests failing

[Suma Shivaprasad (JIRA)]

Suma Shivaprasad created ATLAS-1292:
---

 Summary: Atlas webapp Integration Tests failing 
 Key: ATLAS-1292
 URL: https://issues.apache.org/jira/browse/ATLAS-1292
 Project: Atlas
  Issue Type: Bug
Reporter: Suma Shivaprasad
Priority: Blocker


{noformat}
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.103 sec - in 
org.apache.atlas.web.resources.TypesJerseyResourceIT

Results :

Failed tests:
  EntityNotificationIT.testCreateEntity:85->BaseResourceIT.createInstance:114 » 
AtlasService
  EntityNotificationIT.testDeleteEntity:111->BaseResourceIT.createInstance:114 
» AtlasService
  NotificationHookConsumerIT.testCreateEntity:89->BaseResourceIT.waitFor:287 »  
...
  NotificationHookConsumerIT.testDeleteByQualifiedName:164 » AtlasService 
Metada...
  
NotificationHookConsumerIT.testMessageHandleFailureConsumerContinues:72->BaseResourceIT.waitFor:287
 »
  NotificationHookConsumerIT.testUpdateEntityFullUpdate:183 » AtlasService 
Metad...
  NotificationHookConsumerIT.testUpdateEntityPartial:111 » AtlasService 
Metadata...
  NotificationHookConsumerIT.testUpdatePartialUpdatingQualifiedName:136 » 
AtlasService
  
DataSetLineageJerseyResourceIT.setUp:58->setupInstances:224->database:272->BaseResourceIT.createInstance:114
 » AtlasService
  
EntityJerseyResourceIT.testDeleteEntitiesViaClientApi:874->BaseResourceIT.createInstance:114
 » AtlasService
  
EntityJerseyResourceIT.testDeleteEntitiesViaRestApi:844->BaseResourceIT.createInstance:114
 » AtlasService
  
EntityJerseyResourceIT.testDeleteEntityByUniqAttribute:903->BaseResourceIT.createInstance:114
 » AtlasService
  EntityJerseyResourceIT.testEntityDeduping:176 » AtlasService Metadata service 
...
  
EntityJerseyResourceIT.testGetEntityByAttribute:283->BaseResourceIT.createInstance:114
 » AtlasService
  EntityJerseyResourceIT.testRequestUser:138 » AtlasService Metadata service 
API...
  
EntityJerseyResourceIT.testSubmitEntity:115->BaseResourceIT.createInstance:114 
» AtlasService
  EntityJerseyResourceIT.testSubmitEntityWithBadDateFormat:299 expected: 
but was:
  EntityJerseyResourceIT.testSubmitSingleEntity:156 expected:<201> but was:<400>
  
EntityLineageJerseyResourceIT.setUp:62->setupInstances:157->database:204->BaseResourceIT.createInstance:114
 » AtlasService
  TypedefsJerseyResourceIT.testCreate:86 » AtlasService Metadata service API 
org...
  TypedefsJerseyResourceIT.testDuplicateCreate:98 » AtlasService Metadata 
servic...
  TypedefsJerseyResourceIT.testListTypesByFilter:254 » AtlasService Metadata 
ser...
  TypedefsJerseyResourceIT.testUpdate:118 » AtlasService Metadata service API 
or...

Tests run: 92, Failures: 23, Errors: 0, Skipped: 31

{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ATLAS-1257) Map Entity REST APIs to ATLAS v1 backend

[Suma Shivaprasad (JIRA)]

[ 
https://issues.apache.org/jira/browse/ATLAS-1257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15665311#comment-15665311
 ] 

Suma Shivaprasad commented on ATLAS-1257:
-

Committed. Thanks for reviewing Madhan

> Map Entity REST APIs to ATLAS v1 backend
> 
>
> Key: ATLAS-1257
> URL: https://issues.apache.org/jira/browse/ATLAS-1257
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: 0.8-incubating
>Reporter: Suma Shivaprasad
>Assignee: Suma Shivaprasad
> Fix For: 0.8-incubating
>
> Attachments: ATLAS-1257.4.patch
>
>
> EntitiesREST will talk to the ATLAS v1 backend by converting from 
> a. AtlasEntity to Referenceable and vice versa
> b. AtlasStruct to Struct and vice versa
> c. Map of complex types
> d. Array of complex types
> and call the V1 backend directly as a workaround before v2 implementation is 
> completely ready.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Resolved] (ATLAS-1257) Map Entity REST APIs to ATLAS v1 backend

[Suma Shivaprasad (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-1257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suma Shivaprasad resolved ATLAS-1257.
-
Resolution: Fixed

> Map Entity REST APIs to ATLAS v1 backend
> 
>
> Key: ATLAS-1257
> URL: https://issues.apache.org/jira/browse/ATLAS-1257
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: 0.8-incubating
>Reporter: Suma Shivaprasad
>Assignee: Suma Shivaprasad
> Fix For: 0.8-incubating
>
> Attachments: ATLAS-1257.4.patch
>
>
> EntitiesREST will talk to the ATLAS v1 backend by converting from 
> a. AtlasEntity to Referenceable and vice versa
> b. AtlasStruct to Struct and vice versa
> c. Map of complex types
> d. Array of complex types
> and call the V1 backend directly as a workaround before v2 implementation is 
> completely ready.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (ATLAS-1257) Map Entity REST APIs to ATLAS v1 backend

[Suma Shivaprasad (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-1257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suma Shivaprasad updated ATLAS-1257:

Issue Type: Improvement  (was: Bug)

> Map Entity REST APIs to ATLAS v1 backend
> 
>
> Key: ATLAS-1257
> URL: https://issues.apache.org/jira/browse/ATLAS-1257
> Project: Atlas
>  Issue Type: Improvement
>Affects Versions: 0.8-incubating
>Reporter: Suma Shivaprasad
>Assignee: Suma Shivaprasad
> Fix For: 0.8-incubating
>
> Attachments: ATLAS-1257.4.patch
>
>
> EntitiesREST will talk to the ATLAS v1 backend by converting from 
> a. AtlasEntity to Referenceable and vice versa
> b. AtlasStruct to Struct and vice versa
> c. Map of complex types
> d. Array of complex types
> and call the V1 backend directly as a workaround before v2 implementation is 
> completely ready.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Build failed in Jenkins: apache-atlas-nightly #475

[Apache Jenkins Server]

See 

Changes:

[sumasai.shivaprasad] ATLAS-1257 Map Entity REST APIs to ATLAS v1 backend 
(sumasai)

[sumasai.shivaprasad] ATLAS-1257 Map Entity REST APIs to ATLAS v1 backend 
(sumasai)

--
[...truncated 7736 lines...]
127.0.0.1 - - [14/Nov/2016:22:36:58 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'dbwRRymWYbx2'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:22:36:59 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'dbwRRymWYbx2'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:22:37:00 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'dbwRRymWYbx2'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:22:37:01 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'dbwRRymWYbx2'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:22:37:02 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'dbwRRymWYbx2'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:22:37:02 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'dbwRRymWYbx2'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:22:37:03 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'dbwRRymWYbx2'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:22:37:04 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'dbwRRymWYbx2'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:22:37:05 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'dbwRRymWYbx2'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:22:37:06 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'dbwRRymWYbx2'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:22:37:06 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'dbwRRymWYbx2'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:22:37:07 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'dbwRRymWYbx2'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:22:37:08 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'dbwRRymWYbx2'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:22:37:09 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'dbwRRymWYbx2'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:22:37:10 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'dbwRRymWYbx2'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:22:37:10 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'dbwRRymWYbx2'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:22:37:11 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'dbwRRymWYbx2'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:22:37:12 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'dbwRRymWYbx2'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:22:37:13 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'dbwRRymWYbx2'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:22:37:14 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'dbwRRymWYbx2'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:22:37:15 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'dbwRRymWYbx2'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:22:37:15 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'dbwRRymWYbx2'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:22:37:16 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'dbwRRymWYbx2'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:22:37:17 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'dbwRRymWYbx2'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:22:37:18 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'dbwRRymWYbx2'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:22:37:19 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'dbwRRymWYbx2'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:22:37:19 +] "GET

[jira] [Updated] (ATLAS-1257) Map EntitiesREST to ATLAS v1 backend

[Suma Shivaprasad (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-1257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suma Shivaprasad updated ATLAS-1257:

Description: 
EntitiesREST will talk to the ATLAS v1 backend by converting from 
a. AtlasEntity to Referenceable and vice versa
b. AtlasStruct to Struct and vice versa
c. Map of complex types
d. Array of complex types

and call the V1 backend directly as a workaround before v2 implementation is 
completely ready.

  was:
EntitiesREST will talk to the ATLAS v1 backend by converting from 
a. AtlasEntity to Referenceable 
b. AtlasStruct to Struct
c. Map of complex types
d. Array of complex types

and call the V1 backend directly as a workaround before v2 implementation is 
completely ready.


> Map EntitiesREST to ATLAS v1 backend
> 
>
> Key: ATLAS-1257
> URL: https://issues.apache.org/jira/browse/ATLAS-1257
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: 0.8-incubating
>Reporter: Suma Shivaprasad
>Assignee: Suma Shivaprasad
> Fix For: 0.8-incubating
>
> Attachments: ATLAS-1257.4.patch
>
>
> EntitiesREST will talk to the ATLAS v1 backend by converting from 
> a. AtlasEntity to Referenceable and vice versa
> b. AtlasStruct to Struct and vice versa
> c. Map of complex types
> d. Array of complex types
> and call the V1 backend directly as a workaround before v2 implementation is 
> completely ready.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (ATLAS-1257) Map Entity REST APIs to ATLAS v1 backend

[Suma Shivaprasad (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-1257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suma Shivaprasad updated ATLAS-1257:

Summary: Map Entity REST APIs to ATLAS v1 backend  (was: Map EntitiesREST 
to ATLAS v1 backend)

> Map Entity REST APIs to ATLAS v1 backend
> 
>
> Key: ATLAS-1257
> URL: https://issues.apache.org/jira/browse/ATLAS-1257
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: 0.8-incubating
>Reporter: Suma Shivaprasad
>Assignee: Suma Shivaprasad
> Fix For: 0.8-incubating
>
> Attachments: ATLAS-1257.4.patch
>
>
> EntitiesREST will talk to the ATLAS v1 backend by converting from 
> a. AtlasEntity to Referenceable and vice versa
> b. AtlasStruct to Struct and vice versa
> c. Map of complex types
> d. Array of complex types
> and call the V1 backend directly as a workaround before v2 implementation is 
> completely ready.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (ATLAS-1257) Map EntitiesREST to ATLAS v1 backend

[Suma Shivaprasad (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-1257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suma Shivaprasad updated ATLAS-1257:

Attachment: ATLAS-1257.4.patch

> Map EntitiesREST to ATLAS v1 backend
> 
>
> Key: ATLAS-1257
> URL: https://issues.apache.org/jira/browse/ATLAS-1257
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: 0.8-incubating
>Reporter: Suma Shivaprasad
>Assignee: Suma Shivaprasad
> Fix For: 0.8-incubating
>
> Attachments: ATLAS-1257.4.patch
>
>
> EntitiesREST will talk to the ATLAS v1 backend by converting from 
> a. AtlasEntity to Referenceable 
> b. AtlasStruct to Struct
> c. Map of complex types
> d. Array of complex types
> and call the V1 backend directly as a workaround before v2 implementation is 
> completely ready.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ATLAS-1257) Map EntitiesREST to ATLAS v1 backend

[Suma Shivaprasad (JIRA)]

[ 
https://issues.apache.org/jira/browse/ATLAS-1257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15664997#comment-15664997
 ] 

Suma Shivaprasad commented on ATLAS-1257:
-

https://reviews.apache.org/r/53316

> Map EntitiesREST to ATLAS v1 backend
> 
>
> Key: ATLAS-1257
> URL: https://issues.apache.org/jira/browse/ATLAS-1257
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: 0.8-incubating
>Reporter: Suma Shivaprasad
>Assignee: Suma Shivaprasad
> Fix For: 0.8-incubating
>
> Attachments: ATLAS-1257.4.patch
>
>
> EntitiesREST will talk to the ATLAS v1 backend by converting from 
> a. AtlasEntity to Referenceable 
> b. AtlasStruct to Struct
> c. Map of complex types
> d. Array of complex types
> and call the V1 backend directly as a workaround before v2 implementation is 
> completely ready.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Review Request 53316: Initial draft of changes for ATLAS Entities REST to talk to v1 backend

[Suma Shivaprasad]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/53316/
---

(Updated Nov. 14, 2016, 8:54 p.m.)


Review request for atlas.


Changes
---

Fixed review comments


Bugs: ATLAS-1257
https://issues.apache.org/jira/browse/ATLAS-1257


Repository: atlas


Description
---

EntitiesREST will talk to the ATLAS v1 backend by converting from 
a. AtlasEntity to Referenceable 
b. AtlasStruct to Struct
c. Map of complex types
d. Array of complex types
and call the V1 backend directly as a workaround before v2 implementation is 
completely ready.


Diffs (updated)
-

  distro/src/bin/atlas_stop.py a2b1c31 
  intg/src/main/java/org/apache/atlas/AtlasErrorCode.java 8e0d164 
  intg/src/main/java/org/apache/atlas/exception/AtlasBaseException.java b88d4e8 
  intg/src/main/java/org/apache/atlas/model/instance/AtlasEntity.java 6727f27 
  intg/src/main/java/org/apache/atlas/model/instance/AtlasObjectId.java 5921fea 
  
intg/src/main/java/org/apache/atlas/model/instance/EntityMutationResponse.java 
a6c75ed 
  intg/src/main/java/org/apache/atlas/type/AtlasTypeUtil.java a53b11d 
  intg/src/test/java/org/apache/atlas/TestUtilsV2.java bae9d3b 
  
repository/src/main/java/org/apache/atlas/services/DefaultMetadataService.java 
69e8d12 
  
repository/src/test/java/org/apache/atlas/service/DefaultMetadataServiceTest.java
 37c2374 
  server-api/src/main/java/org/apache/atlas/services/MetadataService.java 
2351891 
  
webapp/src/main/java/org/apache/atlas/web/adapters/AtlasArrayFormatConverter.java
 PRE-CREATION 
  
webapp/src/main/java/org/apache/atlas/web/adapters/AtlasEnumFormatConverter.java
 PRE-CREATION 
  webapp/src/main/java/org/apache/atlas/web/adapters/AtlasFormatAdapter.java 
PRE-CREATION 
  webapp/src/main/java/org/apache/atlas/web/adapters/AtlasFormatConverters.java 
PRE-CREATION 
  
webapp/src/main/java/org/apache/atlas/web/adapters/AtlasFormatConvertersModule.java
 PRE-CREATION 
  
webapp/src/main/java/org/apache/atlas/web/adapters/AtlasInstanceRestAdapters.java
 PRE-CREATION 
  
webapp/src/main/java/org/apache/atlas/web/adapters/AtlasMapFormatConverter.java 
PRE-CREATION 
  
webapp/src/main/java/org/apache/atlas/web/adapters/AtlasPrimitiveFormatConverter.java
 PRE-CREATION 
  
webapp/src/main/java/org/apache/atlas/web/adapters/v1/ReferenceableToAtlasEntityConverter.java
 PRE-CREATION 
  
webapp/src/main/java/org/apache/atlas/web/adapters/v1/StructToAtlasStructConverter.java
 PRE-CREATION 
  
webapp/src/main/java/org/apache/atlas/web/adapters/v1/TraitToAtlasClassificationConverter.java
 PRE-CREATION 
  
webapp/src/main/java/org/apache/atlas/web/adapters/v2/AtlasClassificationToTraitConverter.java
 PRE-CREATION 
  
webapp/src/main/java/org/apache/atlas/web/adapters/v2/AtlasEntityToReferenceableConverter.java
 PRE-CREATION 
  
webapp/src/main/java/org/apache/atlas/web/adapters/v2/AtlasStructToStructConverter.java
 PRE-CREATION 
  webapp/src/main/java/org/apache/atlas/web/listeners/GuiceServletConfig.java 
0c2e0ec 
  webapp/src/main/java/org/apache/atlas/web/resources/EntityResource.java 
bbf01a6 
  webapp/src/main/java/org/apache/atlas/web/rest/EntitiesREST.java 543cbe2 
  webapp/src/main/java/org/apache/atlas/web/rest/EntityRest.java df5138e 
  webapp/src/test/java/org/apache/atlas/web/adapters/TestEntitiesREST.java 
PRE-CREATION 
  webapp/src/test/java/org/apache/atlas/web/adapters/TestEntityREST.java 
PRE-CREATION 

Diff: https://reviews.apache.org/r/53316/diff/


Testing
---

Added valid case UTs
REST layer - tested create and update through the new APIs
Have to add invalid case UTs


Thanks,

Suma Shivaprasad

Re: Review Request 52257: Return system attributes in get entity definition

[Suma Shivaprasad]

> On Nov. 14, 2016, 7:49 p.m., Suma Shivaprasad wrote:
> > repository/src/main/java/org/apache/atlas/repository/graph/GraphBackedSearchIndexer.java,
> >  line 161
> > 
> >
> > do we need composite for modification timestamp? It will help in equals 
> > match only and I dont see how that would be useful.

I see a use for Mixed index though


- Suma


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/52257/#review155836
---


On Nov. 14, 2016, 4:50 a.m., Vimal Sharma wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/52257/
> ---
> 
> (Updated Nov. 14, 2016, 4:50 a.m.)
> 
> 
> Review request for atlas.
> 
> 
> Bugs: ATLAS-916
> https://issues.apache.org/jira/browse/ATLAS-916
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> Atlas should maintain system attributes created time, last modified time, 
> created by user and last modified by user for every entity. This information 
> should be returned in get entity definition
> 
> 
> Diffs
> -
> 
>   catalog/src/main/java/org/apache/atlas/catalog/DefaultPropertyMapper.java 
> 2f52b3b 
>   common/src/main/java/org/apache/atlas/repository/Constants.java cc184a5 
>   
> repository/src/main/java/org/apache/atlas/repository/graph/DeleteHandler.java 
> fb014f2 
>   
> repository/src/main/java/org/apache/atlas/repository/graph/GraphBackedMetadataRepository.java
>  691a12c 
>   
> repository/src/main/java/org/apache/atlas/repository/graph/GraphBackedSearchIndexer.java
>  aea54fa 
>   repository/src/main/java/org/apache/atlas/repository/graph/GraphHelper.java 
> 7e47d30 
>   
> repository/src/main/java/org/apache/atlas/repository/graph/GraphToTypedInstanceMapper.java
>  ceb6011 
>   
> repository/src/main/java/org/apache/atlas/repository/graph/SoftDeleteHandler.java
>  92e43cb 
>   
> repository/src/main/java/org/apache/atlas/repository/graph/TypedInstanceToGraphMapper.java
>  47ae5e1 
>   
> repository/src/test/java/org/apache/atlas/discovery/GraphBackedDiscoveryServiceTest.java
>  645fef1 
>   
> repository/src/test/java/org/apache/atlas/repository/graph/GraphBackedMetadataRepositoryTest.java
>  725b9a6 
>   
> typesystem/src/main/java/org/apache/atlas/typesystem/IReferenceableInstance.java
>  9285014 
>   typesystem/src/main/java/org/apache/atlas/typesystem/Referenceable.java 
> 5b8e157 
>   
> typesystem/src/main/java/org/apache/atlas/typesystem/persistence/AtlasSystemAttributes.java
>  PRE-CREATION 
>   typesystem/src/main/java/org/apache/atlas/typesystem/persistence/Id.java 
> 42280d0 
>   
> typesystem/src/main/java/org/apache/atlas/typesystem/persistence/ReferenceableInstance.java
>  561cb62 
>   typesystem/src/main/java/org/apache/atlas/typesystem/types/ClassType.java 
> 6b530a8 
>   
> typesystem/src/main/scala/org/apache/atlas/typesystem/json/InstanceSerialization.scala
>  73b3526 
>   
> typesystem/src/main/scala/org/apache/atlas/typesystem/json/Serialization.scala
>  68c47ec 
> 
> Diff: https://reviews.apache.org/r/52257/diff/
> 
> 
> Testing
> ---
> 
> Testing done with Hive table creation and updation
> 
> 
> Thanks,
> 
> Vimal Sharma
> 
>

Re: Review Request 52257: Return system attributes in get entity definition

[Suma Shivaprasad]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/52257/#review155836
---




repository/src/main/java/org/apache/atlas/repository/graph/GraphBackedSearchIndexer.java
 (line 161)


do we need composite for modification timestamp? It will help in equals 
match only and I dont see how that would be useful.


- Suma Shivaprasad


On Nov. 14, 2016, 4:50 a.m., Vimal Sharma wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/52257/
> ---
> 
> (Updated Nov. 14, 2016, 4:50 a.m.)
> 
> 
> Review request for atlas.
> 
> 
> Bugs: ATLAS-916
> https://issues.apache.org/jira/browse/ATLAS-916
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> Atlas should maintain system attributes created time, last modified time, 
> created by user and last modified by user for every entity. This information 
> should be returned in get entity definition
> 
> 
> Diffs
> -
> 
>   catalog/src/main/java/org/apache/atlas/catalog/DefaultPropertyMapper.java 
> 2f52b3b 
>   common/src/main/java/org/apache/atlas/repository/Constants.java cc184a5 
>   
> repository/src/main/java/org/apache/atlas/repository/graph/DeleteHandler.java 
> fb014f2 
>   
> repository/src/main/java/org/apache/atlas/repository/graph/GraphBackedMetadataRepository.java
>  691a12c 
>   
> repository/src/main/java/org/apache/atlas/repository/graph/GraphBackedSearchIndexer.java
>  aea54fa 
>   repository/src/main/java/org/apache/atlas/repository/graph/GraphHelper.java 
> 7e47d30 
>   
> repository/src/main/java/org/apache/atlas/repository/graph/GraphToTypedInstanceMapper.java
>  ceb6011 
>   
> repository/src/main/java/org/apache/atlas/repository/graph/SoftDeleteHandler.java
>  92e43cb 
>   
> repository/src/main/java/org/apache/atlas/repository/graph/TypedInstanceToGraphMapper.java
>  47ae5e1 
>   
> repository/src/test/java/org/apache/atlas/discovery/GraphBackedDiscoveryServiceTest.java
>  645fef1 
>   
> repository/src/test/java/org/apache/atlas/repository/graph/GraphBackedMetadataRepositoryTest.java
>  725b9a6 
>   
> typesystem/src/main/java/org/apache/atlas/typesystem/IReferenceableInstance.java
>  9285014 
>   typesystem/src/main/java/org/apache/atlas/typesystem/Referenceable.java 
> 5b8e157 
>   
> typesystem/src/main/java/org/apache/atlas/typesystem/persistence/AtlasSystemAttributes.java
>  PRE-CREATION 
>   typesystem/src/main/java/org/apache/atlas/typesystem/persistence/Id.java 
> 42280d0 
>   
> typesystem/src/main/java/org/apache/atlas/typesystem/persistence/ReferenceableInstance.java
>  561cb62 
>   typesystem/src/main/java/org/apache/atlas/typesystem/types/ClassType.java 
> 6b530a8 
>   
> typesystem/src/main/scala/org/apache/atlas/typesystem/json/InstanceSerialization.scala
>  73b3526 
>   
> typesystem/src/main/scala/org/apache/atlas/typesystem/json/Serialization.scala
>  68c47ec 
> 
> Diff: https://reviews.apache.org/r/52257/diff/
> 
> 
> Testing
> ---
> 
> Testing done with Hive table creation and updation
> 
> 
> Thanks,
> 
> Vimal Sharma
> 
>

Re: Review Request 53525: ATLAS-1246 Upgrade versions of dependencies

[Suma Shivaprasad]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/53525/#review155835
---




shaded/hbase-client-shaded/pom.xml (line 64)


pls add a comment for the reasons for shading which was mentioned aboev 

Changed guava version to 18.0. hbase and titan doesn't work with guava 18. 
In general, when hbase and titan versions are changed using properties, the 
guava versions that hbase, titan and atlas require may be incompatible and will 
fail at runtime. So, shaded the guava dependencies in hbase and titan


- Suma Shivaprasad


On Nov. 14, 2016, 9:01 a.m., Shwetha GS wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/53525/
> ---
> 
> (Updated Nov. 14, 2016, 9:01 a.m.)
> 
> 
> Review request for atlas.
> 
> 
> Bugs: ATLAS-1246
> https://issues.apache.org/jira/browse/ATLAS-1246
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> 1. Changed scala version to 2.11
> 2. Changed guava version to 18.0. hbase and titan doesn't work with guava 18. 
> In general, when hbase and titan versions are changed using properties, the 
> guava versions that hbase, titan and atlas require may be incompatible and 
> will fail at runtime. So, shaded the guava dependencies in hbase and titan
> 
> 
> Diffs
> -
> 
>   addons/falcon-bridge/pom.xml 96743e7 
>   addons/hive-bridge/pom.xml 7ab47f1 
>   addons/sqoop-bridge/pom.xml e71d64a 
>   addons/storm-bridge/pom.xml 6be55b4 
>   
> authorization/src/main/java/org/apache/atlas/authorize/simple/PolicyParser.java
>  fe81598 
>   common/pom.xml e3b6465 
>   graphdb/common/pom.xml 43d51f6 
>   graphdb/titan0/pom.xml ca8c0fb 
>   intg/pom.xml b29a0c2 
>   notification/pom.xml 90d84ec 
>   pom.xml 2044bfd 
>   repository/pom.xml af5d4a1 
>   
> repository/src/main/java/org/apache/atlas/discovery/DataSetLineageService.java
>  c3fd72b 
>   shaded/hbase-client-shaded/pom.xml PRE-CREATION 
>   shaded/hbase-server-shaded/pom.xml PRE-CREATION 
>   typesystem/pom.xml 28c077d 
>   webapp/pom.xml b9e 
> 
> Diff: https://reviews.apache.org/r/53525/diff/
> 
> 
> Testing
> ---
> 
> UTs and end to end test external hbase and solr
> 
> 
> Thanks,
> 
> Shwetha GS
> 
>

[jira] [Created] (ATLAS-1291) Type "hive_column_lineage" not present in hive_model.json

[Vimal Sharma (JIRA)]

Vimal Sharma created ATLAS-1291:
---

 Summary: Type "hive_column_lineage" not present in hive_model.json
 Key: ATLAS-1291
 URL: https://issues.apache.org/jira/browse/ATLAS-1291
 Project: Atlas
  Issue Type: Bug
Reporter: Vimal Sharma


Type "hive_column_lineage" was generated in HiveDataModelGenerator.java.
The above file has been deprecated and the types are now registered from 
hive_model.json inside models directory.

This file does not contain the type definition JSON for type 
"hive_column_lineage". Due to this, column level lineage hook messages are 
failing to be registered with Atlas.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Assigned] (ATLAS-1290) webapp: Integration test failures while trying to create hive_table without creating a reference to hive_db

[Ayub Khan (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-1290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ayub Khan reassigned ATLAS-1290:


Assignee: Ayub Khan

> webapp: Integration test failures while trying to create hive_table without 
> creating a reference to hive_db
> ---
>
> Key: ATLAS-1290
> URL: https://issues.apache.org/jira/browse/ATLAS-1290
> Project: Atlas
>  Issue Type: Bug
>Reporter: Ayub Khan
>Assignee: Ayub Khan
>Priority: Blocker
>
> {noformat}
> Failed tests: 
> EntityNotificationIT.testCreateEntity:85->BaseResourceIT.createInstance:114 » 
> AtlasService
> EntityNotificationIT.testDeleteEntity:111->BaseResourceIT.createInstance:114 
> » AtlasService
> NotificationHookConsumerIT.testCreateEntity:89->BaseResourceIT.waitFor:287 » 
> ...
> NotificationHookConsumerIT.testDeleteByQualifiedName:164 » AtlasService 
> Metada...
> NotificationHookConsumerIT.testMessageHandleFailureConsumerContinues:72->BaseResourceIT.waitFor:287
>  » 
> NotificationHookConsumerIT.testUpdateEntityFullUpdate:183 » AtlasService 
> Metad...
> NotificationHookConsumerIT.testUpdateEntityPartial:111 » AtlasService 
> Metadata...
> NotificationHookConsumerIT.testUpdatePartialUpdatingQualifiedName:136 » 
> AtlasService
> DataSetLineageJerseyResourceIT.setUp:58->setupInstances:224->database:272->BaseResourceIT.createInstance:114
>  » AtlasService
> EntityJerseyResourceIT.testDeleteEntitiesViaClientApi:874->BaseResourceIT.createInstance:114
>  » AtlasService
> EntityJerseyResourceIT.testDeleteEntitiesViaRestApi:844->BaseResourceIT.createInstance:114
>  » AtlasService
> EntityJerseyResourceIT.testDeleteEntityByUniqAttribute:903->BaseResourceIT.createInstance:114
>  » AtlasService
> EntityJerseyResourceIT.testEntityDeduping:176 » AtlasService Metadata service 
> ...
> EntityJerseyResourceIT.testGetEntityByAttribute:283->BaseResourceIT.createInstance:114
>  » AtlasService
> EntityJerseyResourceIT.testRequestUser:138 » AtlasService Metadata service 
> API...
> EntityJerseyResourceIT.testSubmitEntity:115->BaseResourceIT.createInstance:114
>  » AtlasService
> EntityJerseyResourceIT.testSubmitEntityWithBadDateFormat:299 expected: 
> but was:
> EntityJerseyResourceIT.testSubmitSingleEntity:156 expected:<201> but was:<400>
> Tests run: 82, Failures: 18, Errors: 0, Skipped: 27
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (ATLAS-1290) webapp: Integration test failures while trying to create hive_table without creating a reference to hive_db

[Ayub Khan (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-1290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ayub Khan updated ATLAS-1290:
-
Priority: Blocker  (was: Major)

> webapp: Integration test failures while trying to create hive_table without 
> creating a reference to hive_db
> ---
>
> Key: ATLAS-1290
> URL: https://issues.apache.org/jira/browse/ATLAS-1290
> Project: Atlas
>  Issue Type: Bug
>Reporter: Ayub Khan
>Priority: Blocker
>
> {noformat}
> Failed tests: 
> EntityNotificationIT.testCreateEntity:85->BaseResourceIT.createInstance:114 » 
> AtlasService
> EntityNotificationIT.testDeleteEntity:111->BaseResourceIT.createInstance:114 
> » AtlasService
> NotificationHookConsumerIT.testCreateEntity:89->BaseResourceIT.waitFor:287 » 
> ...
> NotificationHookConsumerIT.testDeleteByQualifiedName:164 » AtlasService 
> Metada...
> NotificationHookConsumerIT.testMessageHandleFailureConsumerContinues:72->BaseResourceIT.waitFor:287
>  » 
> NotificationHookConsumerIT.testUpdateEntityFullUpdate:183 » AtlasService 
> Metad...
> NotificationHookConsumerIT.testUpdateEntityPartial:111 » AtlasService 
> Metadata...
> NotificationHookConsumerIT.testUpdatePartialUpdatingQualifiedName:136 » 
> AtlasService
> DataSetLineageJerseyResourceIT.setUp:58->setupInstances:224->database:272->BaseResourceIT.createInstance:114
>  » AtlasService
> EntityJerseyResourceIT.testDeleteEntitiesViaClientApi:874->BaseResourceIT.createInstance:114
>  » AtlasService
> EntityJerseyResourceIT.testDeleteEntitiesViaRestApi:844->BaseResourceIT.createInstance:114
>  » AtlasService
> EntityJerseyResourceIT.testDeleteEntityByUniqAttribute:903->BaseResourceIT.createInstance:114
>  » AtlasService
> EntityJerseyResourceIT.testEntityDeduping:176 » AtlasService Metadata service 
> ...
> EntityJerseyResourceIT.testGetEntityByAttribute:283->BaseResourceIT.createInstance:114
>  » AtlasService
> EntityJerseyResourceIT.testRequestUser:138 » AtlasService Metadata service 
> API...
> EntityJerseyResourceIT.testSubmitEntity:115->BaseResourceIT.createInstance:114
>  » AtlasService
> EntityJerseyResourceIT.testSubmitEntityWithBadDateFormat:299 expected: 
> but was:
> EntityJerseyResourceIT.testSubmitSingleEntity:156 expected:<201> but was:<400>
> Tests run: 82, Failures: 18, Errors: 0, Skipped: 27
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Resolved] (ATLAS-1276) webapp test failures

[Ayub Khan (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-1276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ayub Khan resolved ATLAS-1276.
--
Resolution: Fixed

> webapp test failures
> 
>
> Key: ATLAS-1276
> URL: https://issues.apache.org/jira/browse/ATLAS-1276
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: trunk
>Reporter: Shwetha G S
>Assignee: Ayub Khan
>Priority: Blocker
> Fix For: 0.8-incubating
>
> Attachments: ATLAS-1276.patch
>
>
> Failed tests:
>   QuickStartIT.runQuickStart:45 » AtlasService Metadata service API 
> CREATE_TYPE ...
>   
> EntityNotificationIT.setUp:73->BaseResourceIT.createTypeDefinitions:191->BaseResourceIT.createType:100->BaseResourceIT.createType:105
>  » AtlasService
>   
> NotificationHookConsumerIT.setUp:48->BaseResourceIT.createTypeDefinitions:191->BaseResourceIT.createType:100->BaseResourceIT.createType:105
>  » AtlasService
>   
> DataSetLineageJerseyResourceIT.setUp:57->BaseResourceIT.createTypeDefinitions:191->BaseResourceIT.createType:100->BaseResourceIT.createType:105
>  » AtlasService
>   
> EntityJerseyResourceIT.setUp:104->BaseResourceIT.createTypeDefinitions:191->BaseResourceIT.createType:100->BaseResourceIT.createType:105
>  » AtlasService
> Tests run: 86, Failures: 5, Errors: 0, Skipped: 58
> Tests run: 34, Failures: 1, Errors: 0, Skipped: 33, Time elapsed: 1.593 sec 
> <<< FAILURE! - in org.apache.atlas.web.resources.EntityJerseyResourceIT
> setUp(org.apache.atlas.web.resources.EntityJerseyResourceIT)  Time elapsed: 
> 1.446 sec  <<< FAILURE!
> org.apache.atlas.AtlasServiceException: Metadata service API CREATE_TYPE 
> failed with status 400 (Bad Request) Response Body ({"error":"Unknown 
> datatype: 
> DataSet","stackTrace":"org.apache.atlas.typesystem.exception.TypeNotFoundException:
>  Unknown datatype: DataSet\n\tat 
> org.apache.atlas.typesystem.types.TypeSystem.getDataType(TypeSystem.java:192)\n\tat
>  
> org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.dataType(TypeSystem.java:398)\n\tat
>  
> org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.validateSuperTypes(TypeSystem.java:460)\n\tat
>  
> org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.validateAndSetupSuperTypes(TypeSystem.java:489)\n\tat
>  
> org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.verifyTypes(TypeSystem.java:708)\n\tat
>  
> org.apache.atlas.typesystem.types.TypeSystem.createTransientTypeSystem(TypeSystem.java:346)\n\tat
>  
> org.apache.atlas.services.DefaultMetadataService.createOrUpdateTypes(DefaultMetadataService.java:189)\n\tat
>  
> org.apache.atlas.services.DefaultMetadataService.createType(DefaultMetadataService.java:180)\n\tat
>  
> org.apache.atlas.web.resources.TypesResource.submit(TypesResource.java:94)\n\tat
>  sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)\n\tat
>  
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat
>  java.lang.reflect.Method.invoke(Method.java:497)\n\tat 
> com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)\n\tat
>  
> com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$ResponseOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:205)\n\tat
>  
> com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)\n\tat
>  
> com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302)\n\tat
>  
> com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)\n\tat
>  
> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)\n\tat
>  
> com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)\n\tat
>  
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1542)\n\tat
>  
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1473)\n\tat
>  
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1419)\n\tat
>  
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1409)\n\tat
>  
> com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:409)\n\tat
>  
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:558)\n\tat
>  
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:733)\n\tat
>  javax.servlet.http.HttpServlet.service(HttpServlet.java:790)\n\tat 
> com.google.inject.servlet.ServletDefinition.doServiceImpl(ServletDefinition.java:2

[jira] [Created] (ATLAS-1290) webapp: Integration test failures while trying to create hive_table without creating a reference to hive_db

[Ayub Khan (JIRA)]

Ayub Khan created ATLAS-1290:


 Summary: webapp: Integration test failures while trying to create 
hive_table without creating a reference to hive_db
 Key: ATLAS-1290
 URL: https://issues.apache.org/jira/browse/ATLAS-1290
 Project: Atlas
  Issue Type: Bug
Reporter: Ayub Khan


{noformat}
Failed tests: 
EntityNotificationIT.testCreateEntity:85->BaseResourceIT.createInstance:114 » 
AtlasService
EntityNotificationIT.testDeleteEntity:111->BaseResourceIT.createInstance:114 » 
AtlasService
NotificationHookConsumerIT.testCreateEntity:89->BaseResourceIT.waitFor:287 » ...
NotificationHookConsumerIT.testDeleteByQualifiedName:164 » AtlasService 
Metada...
NotificationHookConsumerIT.testMessageHandleFailureConsumerContinues:72->BaseResourceIT.waitFor:287
 » 
NotificationHookConsumerIT.testUpdateEntityFullUpdate:183 » AtlasService 
Metad...
NotificationHookConsumerIT.testUpdateEntityPartial:111 » AtlasService 
Metadata...
NotificationHookConsumerIT.testUpdatePartialUpdatingQualifiedName:136 » 
AtlasService
DataSetLineageJerseyResourceIT.setUp:58->setupInstances:224->database:272->BaseResourceIT.createInstance:114
 » AtlasService
EntityJerseyResourceIT.testDeleteEntitiesViaClientApi:874->BaseResourceIT.createInstance:114
 » AtlasService
EntityJerseyResourceIT.testDeleteEntitiesViaRestApi:844->BaseResourceIT.createInstance:114
 » AtlasService
EntityJerseyResourceIT.testDeleteEntityByUniqAttribute:903->BaseResourceIT.createInstance:114
 » AtlasService
EntityJerseyResourceIT.testEntityDeduping:176 » AtlasService Metadata service 
...
EntityJerseyResourceIT.testGetEntityByAttribute:283->BaseResourceIT.createInstance:114
 » AtlasService
EntityJerseyResourceIT.testRequestUser:138 » AtlasService Metadata service 
API...
EntityJerseyResourceIT.testSubmitEntity:115->BaseResourceIT.createInstance:114 
» AtlasService
EntityJerseyResourceIT.testSubmitEntityWithBadDateFormat:299 expected: 
but was:
EntityJerseyResourceIT.testSubmitSingleEntity:156 expected:<201> but was:<400>
Tests run: 82, Failures: 18, Errors: 0, Skipped: 27
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ATLAS-1276) webapp test failures

[Ayub Khan (JIRA)]

[ 
https://issues.apache.org/jira/browse/ATLAS-1276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15664172#comment-15664172
 ] 

Ayub Khan commented on ATLAS-1276:
--

[~svimal2106] The test failures mentioned in this jira description are fixed 
with the commit submitted.
I have opened another jira to track the failures you mentioned[ATLAS-1290]. 
Thanks.

> webapp test failures
> 
>
> Key: ATLAS-1276
> URL: https://issues.apache.org/jira/browse/ATLAS-1276
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: trunk
>Reporter: Shwetha G S
>Assignee: Ayub Khan
>Priority: Blocker
> Fix For: 0.8-incubating
>
> Attachments: ATLAS-1276.patch
>
>
> Failed tests:
>   QuickStartIT.runQuickStart:45 » AtlasService Metadata service API 
> CREATE_TYPE ...
>   
> EntityNotificationIT.setUp:73->BaseResourceIT.createTypeDefinitions:191->BaseResourceIT.createType:100->BaseResourceIT.createType:105
>  » AtlasService
>   
> NotificationHookConsumerIT.setUp:48->BaseResourceIT.createTypeDefinitions:191->BaseResourceIT.createType:100->BaseResourceIT.createType:105
>  » AtlasService
>   
> DataSetLineageJerseyResourceIT.setUp:57->BaseResourceIT.createTypeDefinitions:191->BaseResourceIT.createType:100->BaseResourceIT.createType:105
>  » AtlasService
>   
> EntityJerseyResourceIT.setUp:104->BaseResourceIT.createTypeDefinitions:191->BaseResourceIT.createType:100->BaseResourceIT.createType:105
>  » AtlasService
> Tests run: 86, Failures: 5, Errors: 0, Skipped: 58
> Tests run: 34, Failures: 1, Errors: 0, Skipped: 33, Time elapsed: 1.593 sec 
> <<< FAILURE! - in org.apache.atlas.web.resources.EntityJerseyResourceIT
> setUp(org.apache.atlas.web.resources.EntityJerseyResourceIT)  Time elapsed: 
> 1.446 sec  <<< FAILURE!
> org.apache.atlas.AtlasServiceException: Metadata service API CREATE_TYPE 
> failed with status 400 (Bad Request) Response Body ({"error":"Unknown 
> datatype: 
> DataSet","stackTrace":"org.apache.atlas.typesystem.exception.TypeNotFoundException:
>  Unknown datatype: DataSet\n\tat 
> org.apache.atlas.typesystem.types.TypeSystem.getDataType(TypeSystem.java:192)\n\tat
>  
> org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.dataType(TypeSystem.java:398)\n\tat
>  
> org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.validateSuperTypes(TypeSystem.java:460)\n\tat
>  
> org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.validateAndSetupSuperTypes(TypeSystem.java:489)\n\tat
>  
> org.apache.atlas.typesystem.types.TypeSystem$TransientTypeSystem.verifyTypes(TypeSystem.java:708)\n\tat
>  
> org.apache.atlas.typesystem.types.TypeSystem.createTransientTypeSystem(TypeSystem.java:346)\n\tat
>  
> org.apache.atlas.services.DefaultMetadataService.createOrUpdateTypes(DefaultMetadataService.java:189)\n\tat
>  
> org.apache.atlas.services.DefaultMetadataService.createType(DefaultMetadataService.java:180)\n\tat
>  
> org.apache.atlas.web.resources.TypesResource.submit(TypesResource.java:94)\n\tat
>  sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)\n\tat
>  
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat
>  java.lang.reflect.Method.invoke(Method.java:497)\n\tat 
> com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)\n\tat
>  
> com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$ResponseOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:205)\n\tat
>  
> com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)\n\tat
>  
> com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302)\n\tat
>  
> com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)\n\tat
>  
> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)\n\tat
>  
> com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)\n\tat
>  
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1542)\n\tat
>  
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1473)\n\tat
>  
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1419)\n\tat
>  
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1409)\n\tat
>  
> com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:409)\n\tat
>  
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:558)\n\tat
>  
> com.sun.jersey.spi.contain

[jira] [Commented] (ATLAS-1081) Atlas jetty server configuration

[Vimal Sharma (JIRA)]

[ 
https://issues.apache.org/jira/browse/ATLAS-1081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15663697#comment-15663697
 ] 

Vimal Sharma commented on ATLAS-1081:
-

Why are there separate methods to get Integer, Long and String configuration 
values.

Rest looks good to me. 

> Atlas jetty server configuration
> 
>
> Key: ATLAS-1081
> URL: https://issues.apache.org/jira/browse/ATLAS-1081
> Project: Atlas
>  Issue Type: Bug
>Reporter: Shwetha G S
>Assignee: Shwetha G S
> Fix For: 0.8-incubating
>
> Attachments: ATLAS-1081-v2.patch, ATLAS-1081.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ATLAS-1116) Performance monitoring of backend methods in API requests

[Shwetha G S (JIRA)]

[ 
https://issues.apache.org/jira/browse/ATLAS-1116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15663483#comment-15663483
 ] 

Shwetha G S commented on ATLAS-1116:


Exposes annotations @Monitored and @Loggable on methods. 

@Monitored records how many times that method is called and total execution 
time in that method. These metrics are aggregated at API level and are recorded 
in metric.log(one log line per API call)
@Loggable logs at the beginning of the method and ending of the method with 
arguments and return values

These annotations are injected using aspectj plugin at compile time, there is 
no runtime overhead except for the method invocation

Example metrics collected:
entity submit - 2016-11-14 16:34:06,079  {GraphHelper.findVertex=[count=3, 
totalTimeMSec=60], GraphHelper.setProperty=[count=15, totalTimeMSec=16], 
GraphHelper.createVertexWithoutIdentity=[count=1, totalTimeMSec=2], 
TypedInstanceToGraphMapper.createVerticesAndDiscoverInstances=[count=1, 
totalTimeMSec=62],
TypedInstanceToGraphMapper.addOrUpdateAttributesAndTraits=[count=1, 
totalTimeMSec=10], GraphHelper.getSingleValuedProperty=[count=33, 
totalTimeMSec=3], GraphHelper.getProperty=[count=3, totalTimeMSec=0], 
GraphToTypedInstanceMapper.mapVertexToInstance=[count=3, totalTimeMSec=2], 
GraphToTyped
InstanceMapper.mapVertexToInstanceTraits=[count=3, totalTimeMSec=0], 
GraphToTypedInstanceMapper.mapGraphToTypedInstance=[count=3, totalTimeMSec=6], 
FullTextMapper.mapRecursive=[count=1, totalTimeMSec=3], 
TypedInstanceToGraphMapper.mapTypedInstanceToGraph=[count=1, totalTimeMSec=81], 
EntityR
esource.submit=[count=1, totalTimeMSec=892]}

search - 2016-11-14 16:34:18,817  
{GraphHelper.getSingleValuedProperty=[count=544, totalTimeMSec=20], 
GraphHelper.getProperty=[count=47, totalTimeMSec=0], 
GraphHelper.getAdjacentEdgesByLabel=[count=18, totalTimeMSec=3], 
GraphHelper.getEdgeForLabel=[count=18, totalTimeMSec=3], 
GraphToTypedInstanceMapper.mapVertexToInstance=[count=70, totalTimeMSec=33], 
GraphToTypedInstanceMapper.mapVertexToInstanceTraits=[count=47, 
totalTimeMSec=5], GraphToTypedInstanceMapper.mapGraphToTypedInstance=[count=47, 
totalTimeMSec=39], GraphHelper.getArrayElementsProperty=[count=10, 
totalTimeMSec=0], MetadataDiscoveryResource.searchUsingQueryDSL=[count=1, 
totalTimeMSec=249], MetadataDiscoveryResource.search=[count=1, 
totalTimeMSec=249]}

> Performance monitoring of backend methods in API requests
> -
>
> Key: ATLAS-1116
> URL: https://issues.apache.org/jira/browse/ATLAS-1116
> Project: Atlas
>  Issue Type: Bug
>Reporter: Vimal Sharma
>Assignee: Shwetha G S
> Fix For: 0.8-incubating
>
> Attachments: ATLAS-1116-v2.patch, ATLAS-1116.patch
>
>
> Time taken by methods used in API calls for add/update/delete entities and 
> traits need to be monitored for performance



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Review Request 53724: ATLAS-1116 Performance monitoring of backend methods in API requests

[Shwetha GS]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/53724/
---

Review request for atlas.


Bugs: ATLAS-1116
https://issues.apache.org/jira/browse/ATLAS-1116


Repository: atlas


Description
---

Exposes annotations @Monitored and @Loggable on methods. 

@Monitored records how many times that method is called and total execution 
time in that method. These metrics are aggregated at API level and are recorded 
in metric.log(one log line per API call)
@Loggable logs at the beginning of the method and ending of the method with 
arguments and return values

These annotations are injected using aspectj plugin at compile time, there is 
no runtime overhead except for the method invocation

Example metrics collected:
entity submit - 2016-11-14 16:34:06,079  {GraphHelper.findVertex=[count=3, 
totalTimeMSec=60], GraphHelper.setProperty=[count=15, totalTimeMSec=16], 
GraphHelper.createVertexWithoutIdentity=[count=1, totalTimeMSec=2], 
TypedInstanceToGraphMapper.createVerticesAndDiscoverInstances=[count=1, 
totalTimeMSec=62],
TypedInstanceToGraphMapper.addOrUpdateAttributesAndTraits=[count=1, 
totalTimeMSec=10], GraphHelper.getSingleValuedProperty=[count=33, 
totalTimeMSec=3], GraphHelper.getProperty=[count=3, totalTimeMSec=0], 
GraphToTypedInstanceMapper.mapVertexToInstance=[count=3, totalTimeMSec=2], 
GraphToTyped
InstanceMapper.mapVertexToInstanceTraits=[count=3, totalTimeMSec=0], 
GraphToTypedInstanceMapper.mapGraphToTypedInstance=[count=3, totalTimeMSec=6], 
FullTextMapper.mapRecursive=[count=1, totalTimeMSec=3], 
TypedInstanceToGraphMapper.mapTypedInstanceToGraph=[count=1, totalTimeMSec=81], 
EntityR
esource.submit=[count=1, totalTimeMSec=892]}

search - 2016-11-14 16:34:18,817  
{GraphHelper.getSingleValuedProperty=[count=544, totalTimeMSec=20], 
GraphHelper.getProperty=[count=47, totalTimeMSec=0], 
GraphHelper.getAdjacentEdgesByLabel=[count=18, totalTimeMSec=3], 
GraphHelper.getEdgeForLabel=[count=18, totalTimeMSec=3], 
GraphToTypedInstanceMapper.mapVertexToInstance=[count=70, totalTimeMSec=33], 
GraphToTypedInstanceMapper.mapVertexToInstanceTraits=[count=47, 
totalTimeMSec=5], GraphToTypedInstanceMapper.mapGraphToTypedInstance=[count=47, 
totalTimeMSec=39], GraphHelper.getArrayElementsProperty=[count=10, 
totalTimeMSec=0], MetadataDiscoveryResource.searchUsingQueryDSL=[count=1, 
totalTimeMSec=249], MetadataDiscoveryResource.search=[count=1, 
totalTimeMSec=249]}


Diffs
-

  distro/src/conf/atlas-log4j.xml 400cd3a 
  pom.xml 1b3975f 
  repository/pom.xml 949118b 
  
repository/src/main/java/org/apache/atlas/repository/graph/FullTextMapper.java 
053e8ac 
  repository/src/main/java/org/apache/atlas/repository/graph/GraphHelper.java 
7e47d30 
  
repository/src/main/java/org/apache/atlas/repository/graph/GraphToTypedInstanceMapper.java
 ceb6011 
  
repository/src/main/java/org/apache/atlas/repository/graph/TypedInstanceToGraphMapper.java
 47ae5e1 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v1/AtlasGraphUtilsV1.java
 cb389a9 
  server-api/pom.xml c183468 
  server-api/src/main/aspect/org/apache/atlas/AtlasAspect.java PRE-CREATION 
  server-api/src/main/aspect/org/apache/atlas/Loggable.java PRE-CREATION 
  server-api/src/main/aspect/org/apache/atlas/Monitored.java PRE-CREATION 
  server-api/src/main/java/org/apache/atlas/RequestContext.java ec38c11 
  server-api/src/main/java/org/apache/atlas/metrics/Metrics.java PRE-CREATION 
  server-api/src/test/aspect/org/apache/atlas/MonitoredAspectTest.java 
PRE-CREATION 
  typesystem/src/main/resources/atlas-log4j.xml 8312657 
  webapp/pom.xml 6d83cc0 
  webapp/src/main/java/org/apache/atlas/web/filters/AuditFilter.java 79b5be4 
  webapp/src/main/java/org/apache/atlas/web/resources/AdminResource.java 
4b45927 
  
webapp/src/main/java/org/apache/atlas/web/resources/DataSetLineageResource.java 
a11c0cf 
  webapp/src/main/java/org/apache/atlas/web/resources/EntityResource.java 
bbf01a6 
  webapp/src/main/java/org/apache/atlas/web/resources/LineageResource.java 
811c486 
  
webapp/src/main/java/org/apache/atlas/web/resources/MetadataDiscoveryResource.java
 64344da 
  webapp/src/main/java/org/apache/atlas/web/resources/TypesResource.java 
ace0d14 

Diff: https://reviews.apache.org/r/53724/diff/


Testing
---

UT added and tested with atlas deployment


Thanks,

Shwetha GS

[jira] [Updated] (ATLAS-1116) Performance monitoring of backend methods in API requests

[Shwetha G S (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-1116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shwetha G S updated ATLAS-1116:
---
Attachment: ATLAS-1116-v2.patch

> Performance monitoring of backend methods in API requests
> -
>
> Key: ATLAS-1116
> URL: https://issues.apache.org/jira/browse/ATLAS-1116
> Project: Atlas
>  Issue Type: Bug
>Reporter: Vimal Sharma
>Assignee: Shwetha G S
> Fix For: 0.8-incubating
>
> Attachments: ATLAS-1116-v2.patch, ATLAS-1116.patch
>
>
> Time taken by methods used in API calls for add/update/delete entities and 
> traits need to be monitored for performance



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Build failed in Jenkins: apache-atlas-nightly #474

[Apache Jenkins Server]

See 

Changes:

[visharma] Remove QueryPlan attribute from Hive Process entity

[madhan] ATLAS-1267: Client for V2 APIs and TypesREST integration tests

--
[...truncated 7767 lines...]
127.0.0.1 - - [14/Nov/2016:10:24:01 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'db6pQmufiifC'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:10:24:02 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'db6pQmufiifC'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:10:24:03 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'db6pQmufiifC'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:10:24:04 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'db6pQmufiifC'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:10:24:04 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'db6pQmufiifC'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:10:24:05 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'db6pQmufiifC'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:10:24:06 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'db6pQmufiifC'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:10:24:07 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'db6pQmufiifC'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:10:24:08 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'db6pQmufiifC'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:10:24:08 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'db6pQmufiifC'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:10:24:09 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'db6pQmufiifC'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:10:24:10 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'db6pQmufiifC'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:10:24:11 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'db6pQmufiifC'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:10:24:12 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'db6pQmufiifC'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:10:24:13 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'db6pQmufiifC'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:10:24:13 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'db6pQmufiifC'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:10:24:14 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'db6pQmufiifC'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:10:24:15 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'db6pQmufiifC'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:10:24:16 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'db6pQmufiifC'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:10:24:17 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'db6pQmufiifC'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:10:24:17 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'db6pQmufiifC'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:10:24:18 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'db6pQmufiifC'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:10:24:19 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'db6pQmufiifC'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:10:24:20 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'db6pQmufiifC'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:10:24:21 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'db6pQmufiifC'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:10:24:22 +] "GET 
/api/atlas/discovery/search/dsl?query=hive_db+where+name%3D'db6pQmufiifC'&limit=10&offset=0
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [14/Nov/2016:10:24:22 +] "GET 
/api/atlas/discovery/search/dsl?q

[jira] [Updated] (ATLAS-1287) Integrate V2 API in Atlas UI

[Keval Bhatt (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-1287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Keval Bhatt updated ATLAS-1287:
---
Fix Version/s: 0.8-incubating

> Integrate V2 API in Atlas UI
> 
>
> Key: ATLAS-1287
> URL: https://issues.apache.org/jira/browse/ATLAS-1287
> Project: Atlas
>  Issue Type: Improvement
>Affects Versions: 0.8-incubating
>Reporter: Keval Bhatt
>Assignee: Keval Bhatt
> Fix For: 0.8-incubating
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (ATLAS-1288) Integrate typeRest API in Atlas UI

[Keval Bhatt (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-1288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Keval Bhatt updated ATLAS-1288:
---
Fix Version/s: 0.8-incubating

> Integrate typeRest API in Atlas UI
> --
>
> Key: ATLAS-1288
> URL: https://issues.apache.org/jira/browse/ATLAS-1288
> Project: Atlas
>  Issue Type: Sub-task
>Affects Versions: 0.8-incubating
>Reporter: Keval Bhatt
>Assignee: Keval Bhatt
> Fix For: 0.8-incubating
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (ATLAS-1288) Integrate typeRest API in Atlas UI

[Keval Bhatt (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-1288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Keval Bhatt updated ATLAS-1288:
---
Affects Version/s: 0.8-incubating

> Integrate typeRest API in Atlas UI
> --
>
> Key: ATLAS-1288
> URL: https://issues.apache.org/jira/browse/ATLAS-1288
> Project: Atlas
>  Issue Type: Sub-task
>Affects Versions: 0.8-incubating
>Reporter: Keval Bhatt
>Assignee: Keval Bhatt
> Fix For: 0.8-incubating
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (ATLAS-1289) Integrate lineageRest API in Atlas UI

[Keval Bhatt (JIRA)]

Keval Bhatt created ATLAS-1289:
--

 Summary: Integrate lineageRest API in Atlas UI
 Key: ATLAS-1289
 URL: https://issues.apache.org/jira/browse/ATLAS-1289
 Project: Atlas
  Issue Type: Sub-task
Affects Versions: 0.8-incubating
Reporter: Keval Bhatt
Assignee: Keval Bhatt
 Fix For: 0.8-incubating






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (ATLAS-1288) Integrate typeRest API in Atlas UI

[Keval Bhatt (JIRA)]

Keval Bhatt created ATLAS-1288:
--

 Summary: Integrate typeRest API in Atlas UI
 Key: ATLAS-1288
 URL: https://issues.apache.org/jira/browse/ATLAS-1288
 Project: Atlas
  Issue Type: Sub-task
Reporter: Keval Bhatt
Assignee: Keval Bhatt






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (ATLAS-1287) Integrate V2 API in Atlas UI

[Keval Bhatt (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-1287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Keval Bhatt updated ATLAS-1287:
---
Issue Type: Improvement  (was: Bug)

> Integrate V2 API in Atlas UI
> 
>
> Key: ATLAS-1287
> URL: https://issues.apache.org/jira/browse/ATLAS-1287
> Project: Atlas
>  Issue Type: Improvement
>Affects Versions: 0.8-incubating
>Reporter: Keval Bhatt
>Assignee: Keval Bhatt
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (ATLAS-1287) Integrate V2 API in Atlas UI

[Keval Bhatt (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-1287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Keval Bhatt updated ATLAS-1287:
---
Summary: Integrate V2 API in Atlas UI  (was: Integrate v2 API in Atlas UI)

> Integrate V2 API in Atlas UI
> 
>
> Key: ATLAS-1287
> URL: https://issues.apache.org/jira/browse/ATLAS-1287
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: 0.8-incubating
>Reporter: Keval Bhatt
>Assignee: Keval Bhatt
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (ATLAS-1287) Integrate v2 API in Atlas UI

[Keval Bhatt (JIRA)]

Keval Bhatt created ATLAS-1287:
--

 Summary: Integrate v2 API in Atlas UI
 Key: ATLAS-1287
 URL: https://issues.apache.org/jira/browse/ATLAS-1287
 Project: Atlas
  Issue Type: Bug
Affects Versions: 0.8-incubating
Reporter: Keval Bhatt
Assignee: Keval Bhatt






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Review Request 53525: ATLAS-1246 Upgrade versions of dependencies

[Shwetha GS]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/53525/
---

(Updated Nov. 14, 2016, 9:01 a.m.)


Review request for atlas.


Changes
---

mvn 3.3.x includes hbase and titan jars even though they are shaded and used as 
uber jar. So, excluding them explicitly in maven war plugin. I have verified 
this on the stack


Bugs: ATLAS-1246
https://issues.apache.org/jira/browse/ATLAS-1246


Repository: atlas


Description
---

1. Changed scala version to 2.11
2. Changed guava version to 18.0. hbase and titan doesn't work with guava 18. 
In general, when hbase and titan versions are changed using properties, the 
guava versions that hbase, titan and atlas require may be incompatible and will 
fail at runtime. So, shaded the guava dependencies in hbase and titan


Diffs (updated)
-

  addons/falcon-bridge/pom.xml 96743e7 
  addons/hive-bridge/pom.xml 7ab47f1 
  addons/sqoop-bridge/pom.xml e71d64a 
  addons/storm-bridge/pom.xml 6be55b4 
  
authorization/src/main/java/org/apache/atlas/authorize/simple/PolicyParser.java 
fe81598 
  common/pom.xml e3b6465 
  graphdb/common/pom.xml 43d51f6 
  graphdb/titan0/pom.xml ca8c0fb 
  intg/pom.xml b29a0c2 
  notification/pom.xml 90d84ec 
  pom.xml 2044bfd 
  repository/pom.xml af5d4a1 
  
repository/src/main/java/org/apache/atlas/discovery/DataSetLineageService.java 
c3fd72b 
  shaded/hbase-client-shaded/pom.xml PRE-CREATION 
  shaded/hbase-server-shaded/pom.xml PRE-CREATION 
  typesystem/pom.xml 28c077d 
  webapp/pom.xml b9e 

Diff: https://reviews.apache.org/r/53525/diff/


Testing
---

UTs and end to end test external hbase and solr


Thanks,

Shwetha GS

[jira] [Updated] (ATLAS-1246) Upgrade versions of dependencies

[Shwetha G S (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-1246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shwetha G S updated ATLAS-1246:
---
Attachment: ATLAS-1246-v3.patch

mvn 3.3.x includes hbase and titan jars even though they are shaded and used as 
uber jar. So, excluding them explicitly in maven war plugin. I have verified 
this on the stack

> Upgrade versions of dependencies
> 
>
> Key: ATLAS-1246
> URL: https://issues.apache.org/jira/browse/ATLAS-1246
> Project: Atlas
>  Issue Type: Bug
>Reporter: Shwetha G S
>Assignee: Shwetha G S
> Fix For: 0.8-incubating
>
> Attachments: ATLAS-1246-v2.patch, ATLAS-1246-v3.patch, 
> ATLAS-1246.patch
>
>
> 1. Expose variables for setting zookeeper version
> 2. Upgrade the versions of libraries



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ATLAS-1286) Visa Checkout Cordova Plugin

[Shwetha G S (JIRA)]

[ 
https://issues.apache.org/jira/browse/ATLAS-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15663150#comment-15663150
 ] 

Shwetha G S commented on ATLAS-1286:


Moving to Cordova project

> Visa Checkout Cordova Plugin
> 
>
> Key: ATLAS-1286
> URL: https://issues.apache.org/jira/browse/ATLAS-1286
> Project: Atlas
>  Issue Type: Improvement
>Reporter: Biranchi
>
> I am developing hybrid mobile app using html5 in cordova. 
> The Visa Checkout SDK is only available for native apps (iOS & Android).
> I have tried using the sdk.js javascript library in the mobile app for visa 
> checkout process, but its not working. 
> I also found a note in the integration document which says “Note: –You must 
> host this page on a web server; otherwise, the lightbox and JavaScript 
> library may not perform as expected."



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (ATLAS-1286) Visa Checkout Cordova Plugin

[Biranchi (JIRA)]

Biranchi created ATLAS-1286:
---

 Summary: Visa Checkout Cordova Plugin
 Key: ATLAS-1286
 URL: https://issues.apache.org/jira/browse/ATLAS-1286
 Project: Atlas
  Issue Type: Improvement
Reporter: Biranchi


I am developing hybrid mobile app using html5 in cordova. 
The Visa Checkout SDK is only available for native apps (iOS & Android).

I have tried using the sdk.js javascript library in the mobile app for visa 
checkout process, but its not working. 

I also found a note in the integration document which says “Note: –You must 
host this page on a web server; otherwise, the lightbox and JavaScript library 
may not perform as expected."




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ATLAS-1279) Remove QueryPlan attribute from Hive Process entity

[Shwetha G S (JIRA)]

[ 
https://issues.apache.org/jira/browse/ATLAS-1279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15663125#comment-15663125
 ] 

Shwetha G S commented on ATLAS-1279:


+1

> Remove QueryPlan attribute from Hive Process entity
> ---
>
> Key: ATLAS-1279
> URL: https://issues.apache.org/jira/browse/ATLAS-1279
> Project: Atlas
>  Issue Type: Bug
>Reporter: Vimal Sharma
>Assignee: Vimal Sharma
> Attachments: ATLAS-1279-v2.patch, ATLAS-1279.patch
>
>
> The attribute QueryPlan is a required attribute of a Hive Process entity. 
> This attribute is not used anywhere. Further due to API changes in Hive LLAP 
> version, there is conflict in function call to get JSON Plan of query. The 
> function calls in Hive 1.2 and Hive 2 have different method signature.
> Since, QueryPlan is not used, it should be removed so that Atlas code is 
> consistent for Hive 1.x and Hive 2.x



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (ATLAS-1081) Atlas jetty server configuration

[Shwetha G S (JIRA)]

 [ 
https://issues.apache.org/jira/browse/ATLAS-1081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shwetha G S updated ATLAS-1081:
---
Priority: Major  (was: Critical)

> Atlas jetty server configuration
> 
>
> Key: ATLAS-1081
> URL: https://issues.apache.org/jira/browse/ATLAS-1081
> Project: Atlas
>  Issue Type: Bug
>Reporter: Shwetha G S
>Assignee: Shwetha G S
> Fix For: 0.8-incubating
>
> Attachments: ATLAS-1081-v2.patch, ATLAS-1081.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)