[jira] [Updated] (ATLAS-639) Exception for lineage request

2016-07-19 Thread Suma Shivaprasad (JIRA) 

 [ 
https://issues.apache.org/jira/browse/ATLAS-639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suma Shivaprasad updated ATLAS-639:
---
Attachment: ATLAS-639.1.patch

Fixed failing tests

> Exception for lineage request
> -
>
> Key: ATLAS-639
> URL: https://issues.apache.org/jira/browse/ATLAS-639
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: trunk
>Reporter: Ayub Khan
>Assignee: Vimal Sharma
>Priority: Critical
> Fix For: trunk
>
> Attachments: ATLAS-639.1.patch, ATLAS-639.patch
>
>
> Exception in log for lineage request
> Steps to reproduce:
>   create table j13 (col4 String);
>   create table j14 (col5 String);
>   insert into table j13 select * from j14;
>   insert into table j14 select * from j13;
> Lineage API call i.e 
> http://localhost:21000/api/atlas/lineage/"guid"/inputs/graph is 
> non-responsive. The following exception is observed in log file:
> 2016-07-18 14:46:20,841 WARN  - [ZkClient-EventThread-99-localhost:9026:] ~ 
> [atlas_hw-f45c89ac3a11.local-1468832155097-fb78fddf], no brokers found when 
> trying to rebalance. (Logging$class:83)
> 2016-07-18 14:46:20,848 WARN  - [ZkClient-EventThread-99-localhost:9026:] ~ 
> [atlas_hw-f45c89ac3a11.local-1468832155097-fb78fddf], Topic for path 
> /brokers/topics/ATLAS_HOOK gets deleted, which should not happen at this time 
> (Logging$class:83)
> 2016-07-18 14:48:27,697 WARN  - 
> [NIOServerCxn.Factory:localhost/127.0.0.1:9026:] ~ caught end of stream 
> exception (NIOServerCnxn:357)
> EndOfStreamException: Unable to read additional data from client sessionid 
> 0x155fd3803b20033, likely client has closed socket
>   at 
> org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
>   at 
> org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
>   at java.lang.Thread.run(Thread.java:745)
> 2016-07-18 14:48:27,715 WARN  - 
> [NIOServerCxn.Factory:localhost/127.0.0.1:9026:] ~ caught end of stream 
> exception (NIOServerCnxn:357)
> EndOfStreamException: Unable to read additional data from client sessionid 
> 0x155fd3803b20031, likely client has closed socket
>   at 
> org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
>   at 
> org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
>   at java.lang.Thread.run(Thread.java:745)
> 2016-07-18 14:48:34,551 ERROR - [main-EventThread:] ~ Background operation 
> retry gave up (CuratorFrameworkImpl:537)
> org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode 
> = ConnectionLoss
>   at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
>   at 
> org.apache.curator.framework.imps.CuratorFrameworkImpl.checkBackgroundRetry(CuratorFrameworkImpl.java:708)
>   at 
> org.apache.curator.framework.imps.CuratorFrameworkImpl.processBackgroundOperation(CuratorFrameworkImpl.java:499)
>   at 
> org.apache.curator.framework.imps.BackgroundSyncImpl$1.processResult(BackgroundSyncImpl.java:50)
>   at 
> org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:609)
>   at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
> 2016-07-18 14:48:34,561 ERROR - [main-EventThread:] ~ Background operation 
> retry gave up (CuratorFrameworkImpl:537)
> org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode 
> = ConnectionLoss
>   at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
>   at 
> org.apache.curator.framework.imps.CuratorFrameworkImpl.checkBackgroundRetry(CuratorFrameworkImpl.java:708)
>   at 
> org.apache.curator.framework.imps.CuratorFrameworkImpl.processBackgroundOperation(CuratorFrameworkImpl.java:499)
>   at 
> org.apache.curator.framework.imps.BackgroundSyncImpl$1.processResult(BackgroundSyncImpl.java:50)
>   at 
> org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:609)
>   at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
> 2016-07-18 14:48:34,566 WARN  - 
> [NIOServerCxn.Factory:localhost/127.0.0.1:9026:] ~ Exception causing close of 
> session 0x155fd3803b20032 due to java.nio.channels.AsynchronousCloseException 
> (NIOServerCnxn:362)
> 2016-07-18 14:50:50,513 WARN  - [main-EventThread:] ~ Session expired event 
> received (ConnectionState:288)
> 2016-07-18 14:52:52,577 WARN  - 
> [NIOServerCxn.Factory:localhost/127.0.0.1:9026:] ~ caught end of stream 
> exception (NIOServerCnxn:357)
> EndOfStreamException: Unable to read additional data from client sessionid 
> 0x155fd3803b20034, likely client has closed socket
>   at 
> org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
>   at 
>

[jira] [Updated] (ATLAS-639) Exception for lineage request

2016-07-19 Thread Vimal Sharma (JIRA) 

 [ 
https://issues.apache.org/jira/browse/ATLAS-639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vimal Sharma updated ATLAS-639:
---
Attachment: ATLAS-639.patch

Added condition in Gremlin query to return in case of cycle in Titan graph.

Some tests in repository are failing after the change.

> Exception for lineage request
> -
>
> Key: ATLAS-639
> URL: https://issues.apache.org/jira/browse/ATLAS-639
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: trunk
>Reporter: Ayub Khan
>Assignee: Vimal Sharma
>Priority: Critical
> Fix For: trunk
>
> Attachments: ATLAS-639.patch
>
>
> Exception in log for lineage request
> Steps to reproduce:
>   create table j13 (col4 String);
>   create table j14 (col5 String);
>   insert into table j13 select * from j14;
>   insert into table j14 select * from j13;
> Lineage API call i.e 
> http://localhost:21000/api/atlas/lineage/"guid"/inputs/graph is 
> non-responsive. The following exception is observed in log file:
> 2016-07-18 14:46:20,841 WARN  - [ZkClient-EventThread-99-localhost:9026:] ~ 
> [atlas_hw-f45c89ac3a11.local-1468832155097-fb78fddf], no brokers found when 
> trying to rebalance. (Logging$class:83)
> 2016-07-18 14:46:20,848 WARN  - [ZkClient-EventThread-99-localhost:9026:] ~ 
> [atlas_hw-f45c89ac3a11.local-1468832155097-fb78fddf], Topic for path 
> /brokers/topics/ATLAS_HOOK gets deleted, which should not happen at this time 
> (Logging$class:83)
> 2016-07-18 14:48:27,697 WARN  - 
> [NIOServerCxn.Factory:localhost/127.0.0.1:9026:] ~ caught end of stream 
> exception (NIOServerCnxn:357)
> EndOfStreamException: Unable to read additional data from client sessionid 
> 0x155fd3803b20033, likely client has closed socket
>   at 
> org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
>   at 
> org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
>   at java.lang.Thread.run(Thread.java:745)
> 2016-07-18 14:48:27,715 WARN  - 
> [NIOServerCxn.Factory:localhost/127.0.0.1:9026:] ~ caught end of stream 
> exception (NIOServerCnxn:357)
> EndOfStreamException: Unable to read additional data from client sessionid 
> 0x155fd3803b20031, likely client has closed socket
>   at 
> org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
>   at 
> org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
>   at java.lang.Thread.run(Thread.java:745)
> 2016-07-18 14:48:34,551 ERROR - [main-EventThread:] ~ Background operation 
> retry gave up (CuratorFrameworkImpl:537)
> org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode 
> = ConnectionLoss
>   at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
>   at 
> org.apache.curator.framework.imps.CuratorFrameworkImpl.checkBackgroundRetry(CuratorFrameworkImpl.java:708)
>   at 
> org.apache.curator.framework.imps.CuratorFrameworkImpl.processBackgroundOperation(CuratorFrameworkImpl.java:499)
>   at 
> org.apache.curator.framework.imps.BackgroundSyncImpl$1.processResult(BackgroundSyncImpl.java:50)
>   at 
> org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:609)
>   at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
> 2016-07-18 14:48:34,561 ERROR - [main-EventThread:] ~ Background operation 
> retry gave up (CuratorFrameworkImpl:537)
> org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode 
> = ConnectionLoss
>   at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
>   at 
> org.apache.curator.framework.imps.CuratorFrameworkImpl.checkBackgroundRetry(CuratorFrameworkImpl.java:708)
>   at 
> org.apache.curator.framework.imps.CuratorFrameworkImpl.processBackgroundOperation(CuratorFrameworkImpl.java:499)
>   at 
> org.apache.curator.framework.imps.BackgroundSyncImpl$1.processResult(BackgroundSyncImpl.java:50)
>   at 
> org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:609)
>   at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
> 2016-07-18 14:48:34,566 WARN  - 
> [NIOServerCxn.Factory:localhost/127.0.0.1:9026:] ~ Exception causing close of 
> session 0x155fd3803b20032 due to java.nio.channels.AsynchronousCloseException 
> (NIOServerCnxn:362)
> 2016-07-18 14:50:50,513 WARN  - [main-EventThread:] ~ Session expired event 
> received (ConnectionState:288)
> 2016-07-18 14:52:52,577 WARN  - 
> [NIOServerCxn.Factory:localhost/127.0.0.1:9026:] ~ caught end of stream 
> exception (NIOServerCnxn:357)
> EndOfStreamException: Unable to read additional data from client sessionid 
> 0x155fd3803b20034, likely client has closed socket
>   at 
>

[jira] [Updated] (ATLAS-639) Exception for lineage request

2016-07-04 Thread Shwetha G S (JIRA) 

 [ 
https://issues.apache.org/jira/browse/ATLAS-639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shwetha G S updated ATLAS-639:
--
Priority: Critical  (was: Major)

> Exception for lineage request
> -
>
> Key: ATLAS-639
> URL: https://issues.apache.org/jira/browse/ATLAS-639
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: trunk
>Reporter: Ayub Khan
>Priority: Critical
> Fix For: trunk
>
>
> Exception in log for lineage request
> Steps to repro:
>   create table j13 (col4 String);
>   create table j14 (col5 String);
>   insert into table j13 select * from j14;
>   insert into table j14 select * from j13;
> Query for lineage of any of the above two entities..(also keep querying for 
> any other request along with this). Lineage request is timed-out and below 
> error messages are observed in the application log. The below messages are 
> seen continously.(Clean the data dir and manual restart will fix this).
> Environment: Atlas running in embedded mode on local setup.
> {noformat}
> 2016-04-06 11:41:45,112 DEBUG - [qtp1936542270-298 - 
> fecc3aa7-f4cf-4f6d-89a2-d973c05bc06f:] ~ graph commit 
> (GraphTransactionInterceptor:44)
> 2016-04-06 11:41:45,112 DEBUG - [qtp1936542270-298 - 
> fecc3aa7-f4cf-4f6d-89a2-d973c05bc06f:] ~ graph commit 
> (GraphTransactionInterceptor:44)
> 2016-04-06 11:41:48,935 INFO  - [main-SendThread(localhost:9026):] ~ Client 
> session timed out, have not heard from server in 1669ms for sessionid 
> 0x153ea2cd8da002b, closing socket connection and attempting reconnect 
> (ClientCnxn:1096)
> 2016-04-06 11:41:48,935 INFO  - [SessionTracker:] ~ Expiring session 
> 0x153ea2cd8da002a, timeout of 1000ms exceeded (ZooKeeperServer:347)
> 2016-04-06 11:41:48,935 INFO  - [main-SendThread(localhost:9026):] ~ Client 
> session timed out, have not heard from server in 1917ms for sessionid 
> 0x153ea2cd8da002a, closing socket connection and attempting reconnect 
> (ClientCnxn:1096)
> 2016-04-06 11:41:48,935 INFO  - [SessionTracker:] ~ Expiring session 
> 0x153ea2cd8da002b, timeout of 1000ms exceeded (ZooKeeperServer:347)
> 2016-04-06 11:41:48,935 WARN  - 
> [NIOServerCxn.Factory:localhost/127.0.0.1:9026:] ~ caught end of stream 
> exception (NIOServerCnxn:357)
> EndOfStreamException: Unable to read additional data from client sessionid 
> 0x153ea2cd8da002b, likely client has closed socket
>   at 
> org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
>   at 
> org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
>   at java.lang.Thread.run(Thread.java:745)
> 2016-04-06 11:41:48,935 INFO  - [ProcessThread(sid:0 cport:-1)::] ~ Processed 
> session termination for sessionid: 0x153ea2cd8da002a 
> (PrepRequestProcessor:494)
> 2016-04-06 11:41:48,936 INFO  - [ProcessThread(sid:0 cport:-1)::] ~ Processed 
> session termination for sessionid: 0x153ea2cd8da002b 
> (PrepRequestProcessor:494)
> 2016-04-06 11:41:48,936 INFO  - 
> [NIOServerCxn.Factory:localhost/127.0.0.1:9026:] ~ Closed socket connection 
> for client /127.0.0.1:51657 which had sessionid 0x153ea2cd8da002b 
> (NIOServerCnxn:1007)
> 2016-04-06 11:41:48,936 WARN  - 
> [NIOServerCxn.Factory:localhost/127.0.0.1:9026:] ~ caught end of stream 
> exception (NIOServerCnxn:357)
> EndOfStreamException: Unable to read additional data from client sessionid 
> 0x153ea2cd8da002a, likely client has closed socket
>   at 
> org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
>   at 
> org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
>   at java.lang.Thread.run(Thread.java:745)
> 2016-04-06 11:41:48,936 INFO  - 
> [NIOServerCxn.Factory:localhost/127.0.0.1:9026:] ~ Closed socket connection 
> for client /127.0.0.1:51652 which had sessionid 0x153ea2cd8da002a 
> (NIOServerCnxn:1007)
> 2016-04-06 11:41:49,040 INFO  - [main-EventThread:] ~ zookeeper state changed 
> (Disconnected) (ZkClient:711)
> 2016-04-06 11:41:49,040 INFO  - [main-EventThread:] ~ zookeeper state changed 
> (Disconnected) (ZkClient:711)
> 2016-04-06 11:41:58,894 INFO  - [main-SendThread(localhost:9026):] ~ Opening 
> socket connection to server localhost/127.0.0.1:9026. Will not attempt to 
> authenticate using SASL (unknown error) (ClientCnxn:975)
> 2016-04-06 11:41:58,894 INFO  - 
> [Curator-Framework-0-SendThread(localhost:9026):] ~ Client session timed out, 
> have not heard from server in 11587ms for sessionid 0x153ea2cd8da0025, 
> closing socket connection and attempting reconnect (ClientCnxn:1096)
> 2016-04-06 11:41:58,894 INFO  - [main-SendThread(localhost:9026):] ~ Socket 
> connection established to localhost/127.0.0.1:9026, initiating session 
> (ClientCnxn:852)
> 2016-04-06 11:41:58,894 INFO  - [main-SendThread(localhost:9026):] ~ Opening 
> socket connection

[jira] [Updated] (ATLAS-639) Exception for lineage request

2016-04-06 Thread Ayub Khan (JIRA) 

 [ 
https://issues.apache.org/jira/browse/ATLAS-639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ayub Khan updated ATLAS-639:

Description: 
Exception in log for lineage request

Steps to repro:
create table j13 (col4 String);
create table j14 (col5 String);
insert into table j13 select * from j14;
insert into table j14 select * from j13;

Query for lineage of any of the above two entities..(also keep querying for any 
other request along with this). Lineage request is timed-out and below error 
messages are observed in the application log. The below messages are seen 
continously.(Clean the data dir and manual restart will fix this).


Environment: Atlas running in embedded mode on local setup.

{noformat}
2016-04-06 11:41:45,112 DEBUG - [qtp1936542270-298 - 
fecc3aa7-f4cf-4f6d-89a2-d973c05bc06f:] ~ graph commit 
(GraphTransactionInterceptor:44)
2016-04-06 11:41:45,112 DEBUG - [qtp1936542270-298 - 
fecc3aa7-f4cf-4f6d-89a2-d973c05bc06f:] ~ graph commit 
(GraphTransactionInterceptor:44)
2016-04-06 11:41:48,935 INFO  - [main-SendThread(localhost:9026):] ~ Client 
session timed out, have not heard from server in 1669ms for sessionid 
0x153ea2cd8da002b, closing socket connection and attempting reconnect 
(ClientCnxn:1096)
2016-04-06 11:41:48,935 INFO  - [SessionTracker:] ~ Expiring session 
0x153ea2cd8da002a, timeout of 1000ms exceeded (ZooKeeperServer:347)
2016-04-06 11:41:48,935 INFO  - [main-SendThread(localhost:9026):] ~ Client 
session timed out, have not heard from server in 1917ms for sessionid 
0x153ea2cd8da002a, closing socket connection and attempting reconnect 
(ClientCnxn:1096)
2016-04-06 11:41:48,935 INFO  - [SessionTracker:] ~ Expiring session 
0x153ea2cd8da002b, timeout of 1000ms exceeded (ZooKeeperServer:347)
2016-04-06 11:41:48,935 WARN  - 
[NIOServerCxn.Factory:localhost/127.0.0.1:9026:] ~ caught end of stream 
exception (NIOServerCnxn:357)
EndOfStreamException: Unable to read additional data from client sessionid 
0x153ea2cd8da002b, likely client has closed socket
at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
at java.lang.Thread.run(Thread.java:745)
2016-04-06 11:41:48,935 INFO  - [ProcessThread(sid:0 cport:-1)::] ~ Processed 
session termination for sessionid: 0x153ea2cd8da002a (PrepRequestProcessor:494)
2016-04-06 11:41:48,936 INFO  - [ProcessThread(sid:0 cport:-1)::] ~ Processed 
session termination for sessionid: 0x153ea2cd8da002b (PrepRequestProcessor:494)
2016-04-06 11:41:48,936 INFO  - 
[NIOServerCxn.Factory:localhost/127.0.0.1:9026:] ~ Closed socket connection for 
client /127.0.0.1:51657 which had sessionid 0x153ea2cd8da002b 
(NIOServerCnxn:1007)
2016-04-06 11:41:48,936 WARN  - 
[NIOServerCxn.Factory:localhost/127.0.0.1:9026:] ~ caught end of stream 
exception (NIOServerCnxn:357)
EndOfStreamException: Unable to read additional data from client sessionid 
0x153ea2cd8da002a, likely client has closed socket
at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
at java.lang.Thread.run(Thread.java:745)
2016-04-06 11:41:48,936 INFO  - 
[NIOServerCxn.Factory:localhost/127.0.0.1:9026:] ~ Closed socket connection for 
client /127.0.0.1:51652 which had sessionid 0x153ea2cd8da002a 
(NIOServerCnxn:1007)
2016-04-06 11:41:49,040 INFO  - [main-EventThread:] ~ zookeeper state changed 
(Disconnected) (ZkClient:711)
2016-04-06 11:41:49,040 INFO  - [main-EventThread:] ~ zookeeper state changed 
(Disconnected) (ZkClient:711)
2016-04-06 11:41:58,894 INFO  - [main-SendThread(localhost:9026):] ~ Opening 
socket connection to server localhost/127.0.0.1:9026. Will not attempt to 
authenticate using SASL (unknown error) (ClientCnxn:975)
2016-04-06 11:41:58,894 INFO  - 
[Curator-Framework-0-SendThread(localhost:9026):] ~ Client session timed out, 
have not heard from server in 11587ms for sessionid 0x153ea2cd8da0025, closing 
socket connection and attempting reconnect (ClientCnxn:1096)
2016-04-06 11:41:58,894 INFO  - [main-SendThread(localhost:9026):] ~ Socket 
connection established to localhost/127.0.0.1:9026, initiating session 
(ClientCnxn:852)
2016-04-06 11:41:58,894 INFO  - [main-SendThread(localhost:9026):] ~ Opening 
socket connection to server localhost/127.0.0.1:9026. Will not attempt to 
authenticate using SASL (unknown error) (ClientCnxn:975)
2016-04-06 11:41:58,894 INFO  - [main-SendThread(localhost:9026):] ~ Socket 
connection established to localhost/127.0.0.1:9026, initiating session 
(ClientCnxn:852)
2016-04-06 11:41:58,894 INFO  - [SessionTracker:] ~ Expiring session 
0x153ea2cd8da0025, timeout of 1ms exceeded (ZooKeeperServer:347)
2016-04-06 11:41:58,895 WARN  - 
[NIOServerCxn.Factory:localhost/127.0.0.1:9026:] ~ caught end