[jira] [Commented] (ATLAS-247) hive_column leve lineage

2016-03-03 Thread Shwetha G S (JIRA) 

[ 
https://issues.apache.org/jira/browse/ATLAS-247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179486#comment-15179486
 ] 

Shwetha G S commented on ATLAS-247:
---

Since the hive patch will be in a future hive release and can't expect all to 
use the new hive version, we shouldn't fail the hook with old hive releases. We 
should add catch throwable around adding column level lineage and log and 
ignore. We should document this as well

> hive_column leve lineage
> 
>
> Key: ATLAS-247
> URL: https://issues.apache.org/jira/browse/ATLAS-247
> Project: Atlas
>  Issue Type: New Feature
>Affects Versions: 0.5-incubating
>Reporter: Herman Yu
>Assignee: Harish Butani
> Attachments: ATLAS-247.2.patch, ATLAS-247.patch
>
>
> hive_column is not inherited from DataSet, thus can't be using hive_process 
> to track column level lineages
> Is there specific reason that hive_column is not inheriting from Data Set? 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ATLAS-247) hive_column leve lineage

2016-03-03 Thread Shwetha G S (JIRA) 

[ 
https://issues.apache.org/jira/browse/ATLAS-247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179418#comment-15179418
 ] 

Shwetha G S commented on ATLAS-247:
---

Can you add asserts on the column level lineage in HiveHookIT? Can you add the 
documentation in 
https://github.com/hbutani/incubator-atlas/wiki/Column-Level-Lineage to 
Bridge-Hive.twiki?

Looks like hive publishes snapshot jars. So, we can change hive version to 
2.1.0-SNAPSHOT and commit this after hive patch is committed, right?

> hive_column leve lineage
> 
>
> Key: ATLAS-247
> URL: https://issues.apache.org/jira/browse/ATLAS-247
> Project: Atlas
>  Issue Type: New Feature
>Affects Versions: 0.5-incubating
>Reporter: Herman Yu
>Assignee: Harish Butani
> Attachments: ATLAS-247.2.patch, ATLAS-247.patch
>
>
> hive_column is not inherited from DataSet, thus can't be using hive_process 
> to track column level lineages
> Is there specific reason that hive_column is not inheriting from Data Set? 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ATLAS-474) Server does not start if the type is updated with same super type class information

2016-03-03 Thread Shwetha G S (JIRA) 

[ 
https://issues.apache.org/jira/browse/ATLAS-474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179384#comment-15179384
 ] 

Shwetha G S commented on ATLAS-474:
---

[~dkantor], [~yhemanth] will review

> Server does not start if the type is updated with same super type class 
> information
> ---
>
> Key: ATLAS-474
> URL: https://issues.apache.org/jira/browse/ATLAS-474
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: trunk
> Environment: sandbox
>Reporter: Chethana
>Assignee: David Kantor
>Priority: Blocker
> Attachments: rb44100.patch
>
>
> Create a class with a superType class.
> Use update API and do not change the request used.
> Restart atlas server 
> Fails with exception
> K":1},"pattern":"static","timestamp":"1454921806183"} stored data: 
> {"version":1,"subscription":{"ATLAS_HOOK":1},"pattern":"static","timestamp":"1454921372384"}
>  (ZkUtils$:68)
> 2016-02-09 00:00:02,149 INFO  - [ZkClient-EventThread-91-localhost:9026:] ~ I 
> wrote this conflicted ephemeral node 
> [{"version":1,"subscription":{"ATLAS_HOOK":1},"pattern":"static","timestamp":"1454921806183"}]
>  at /consumers/atlas/ids/atlas_Chethanas-MBP.local-1454412213224-de1ce8e6 a 
> while back in a different session, hence I will backoff for this node to be 
> deleted by Zookeeper and retry (ZkUtils$:68)
> 2016-02-09 00:00:02,554 INFO  - [ProcessThread(sid:0 cport:-1)::] ~ Got 
> user-level KeeperException when processing sessionid:0x152a1b9238e0051 
> type:create cxid:0x3f0bf zxid:0x1c0ec txntype:-1 reqpath:n/a Error 
> Path:/consumers/atlas/ids/atlas_Chethanas-MBP.local-1454412213224-de1ce8e6 
> Error:KeeperErrorCode = NodeExists for 
> /consumers/atlas/ids/atlas_Chethanas-MBP.local-1454412213224-de1ce8e6 
> (PrepRequest...skipping...
> at 
> org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
> at org.eclipse.jetty.server.Server.doStart(Server.java:354)
> at 
> org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
> at 
> org.apache.atlas.web.service.EmbeddedServer.start(EmbeddedServer.java:88)
> at org.apache.atlas.Atlas.main(Atlas.java:107)
> Caused by: java.lang.RuntimeException: org.apache.atlas.AtlasException: Type 
> classa3ozcd7yra extends superType superClassa3ozcd7yra multiple times
> at 
> org.apache.atlas.services.DefaultMetadataService.restoreTypeSystem(DefaultMetadataService.java:113)
> at 
> org.apache.atlas.services.DefaultMetadataService.(DefaultMetadataService.java:100)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native 
> Method)
> at 
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> at 
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
> at 
> com.google.inject.internal.DefaultConstructionProxyFactory$2.newInstance(DefaultConstructionProxyFactory.java:86)
> at 
> com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:105)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ATLAS-474) Server does not start if the type is updated with same super type class information

2016-03-03 Thread Shwetha G S (JIRA) 

[ 
https://issues.apache.org/jira/browse/ATLAS-474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179368#comment-15179368
 ] 

Shwetha G S commented on ATLAS-474:
---

Ah ok, I missed that in update. Thanks

> Server does not start if the type is updated with same super type class 
> information
> ---
>
> Key: ATLAS-474
> URL: https://issues.apache.org/jira/browse/ATLAS-474
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: trunk
> Environment: sandbox
>Reporter: Chethana
>Assignee: David Kantor
>Priority: Blocker
> Attachments: rb44100.patch
>
>
> Create a class with a superType class.
> Use update API and do not change the request used.
> Restart atlas server 
> Fails with exception
> K":1},"pattern":"static","timestamp":"1454921806183"} stored data: 
> {"version":1,"subscription":{"ATLAS_HOOK":1},"pattern":"static","timestamp":"1454921372384"}
>  (ZkUtils$:68)
> 2016-02-09 00:00:02,149 INFO  - [ZkClient-EventThread-91-localhost:9026:] ~ I 
> wrote this conflicted ephemeral node 
> [{"version":1,"subscription":{"ATLAS_HOOK":1},"pattern":"static","timestamp":"1454921806183"}]
>  at /consumers/atlas/ids/atlas_Chethanas-MBP.local-1454412213224-de1ce8e6 a 
> while back in a different session, hence I will backoff for this node to be 
> deleted by Zookeeper and retry (ZkUtils$:68)
> 2016-02-09 00:00:02,554 INFO  - [ProcessThread(sid:0 cport:-1)::] ~ Got 
> user-level KeeperException when processing sessionid:0x152a1b9238e0051 
> type:create cxid:0x3f0bf zxid:0x1c0ec txntype:-1 reqpath:n/a Error 
> Path:/consumers/atlas/ids/atlas_Chethanas-MBP.local-1454412213224-de1ce8e6 
> Error:KeeperErrorCode = NodeExists for 
> /consumers/atlas/ids/atlas_Chethanas-MBP.local-1454412213224-de1ce8e6 
> (PrepRequest...skipping...
> at 
> org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
> at org.eclipse.jetty.server.Server.doStart(Server.java:354)
> at 
> org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
> at 
> org.apache.atlas.web.service.EmbeddedServer.start(EmbeddedServer.java:88)
> at org.apache.atlas.Atlas.main(Atlas.java:107)
> Caused by: java.lang.RuntimeException: org.apache.atlas.AtlasException: Type 
> classa3ozcd7yra extends superType superClassa3ozcd7yra multiple times
> at 
> org.apache.atlas.services.DefaultMetadataService.restoreTypeSystem(DefaultMetadataService.java:113)
> at 
> org.apache.atlas.services.DefaultMetadataService.(DefaultMetadataService.java:100)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native 
> Method)
> at 
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> at 
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
> at 
> com.google.inject.internal.DefaultConstructionProxyFactory$2.newInstance(DefaultConstructionProxyFactory.java:86)
> at 
> com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:105)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ATLAS-549) FOREACH throwing error

2016-03-03 Thread vivek singh (JIRA) 

[ 
https://issues.apache.org/jira/browse/ATLAS-549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179317#comment-15179317
 ] 

vivek singh commented on ATLAS-549:
---

Hi.. I am using Pig version 0.12.0-cdh5.4.4 on cloudera version- 
2.6.0-cdh5.4.4. I am getting a strange issue using FOREACH. Below is what I am 
trying-
a= LOAD 'GCS_AGENT/agent_downtime_test.txt' using PigStorage(',') as 
(agent_key:chararray, status:chararray, time:chararray);
b= FOREACH a GENERATE (chararray) $0 AS agent_key;
dump b;
It is throwing the below error-
Pig Stack Trace
---
ERROR 6017: Job failed!

org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open 
iterator for alias b
at org.apache.pig.PigServer.openIterator(PigServer.java:892)
at 
org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:774)
at 
org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:372)
at 
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:198)
at 
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:173)
at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:84)
at org.apache.pig.Main.run(Main.java:607)
at org.apache.pig.Main.main(Main.java:156)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
Caused by: org.apache.pig.PigException: ERROR 1002: Unable to store alias b
at org.apache.pig.PigServer.storeEx(PigServer.java:994)
at org.apache.pig.PigServer.store(PigServer.java:954)
at org.apache.pig.PigServer.openIterator(PigServer.java:867)
... 13 more
Caused by: org.apache.pig.backend.executionengine.ExecException: ERROR 6017: 
Job failed!
at 
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.checkStopOnFailure(MapReduceLauncher.java:519)
at 
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:344)
at org.apache.pig.PigServer.launchPlan(PigServer.java:1334)
at 
org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1319)
at org.apache.pig.PigServer.storeEx(PigServer.java:990)
... 15 more


If I remove FOREACH, all the lines would work. Can you please help?

> FOREACH throwing error
> --
>
> Key: ATLAS-549
> URL: https://issues.apache.org/jira/browse/ATLAS-549
> Project: Atlas
>  Issue Type: Bug
>Reporter: vivek singh
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (ATLAS-549) FOREACH throwing error

2016-03-03 Thread vivek singh (JIRA) 
vivek singh created ATLAS-549:
-

 Summary: FOREACH throwing error
 Key: ATLAS-549
 URL: https://issues.apache.org/jira/browse/ATLAS-549
 Project: Atlas
  Issue Type: Bug
Reporter: vivek singh






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ATLAS-479) Add description for different types during create time

2016-03-03 Thread ATLAS QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/ATLAS-479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179151#comment-15179151
 ] 

ATLAS QA commented on ATLAS-479:


{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment
  http://issues.apache.org/jira/secure/attachment/12791366/rb43531%287%29.patch
  against master revision b9575f2.

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+1 tests included{color}.  The patch appears to include 9 new 
or modified test files.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javadoc{color}.  There were no new javadoc warning messages.

+1 checkstyle.  The patch generated 0 code style errors.

{color:red}-1 findbugs{color}.  The patch appears to introduce 335 new 
Findbugs (version 2.0.3) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:red}-1 core tests{color}.  The patch failed these unit tests in :
 
./webapp/test-output/junitreports/TEST-org.apache.atlas.web.resources.EntityJerseyResourceIT
./webapp/test-output/junitreports/TEST-org.apache.atlas.web.resources.MetadataDiscoveryJerseyResourceIT
./webapp/test-output/junitreports/TEST-org.apache.atlas.web.resources.RexsterGraphJerseyResourceIT
./webapp/test-output/junitreports/TEST-org.apache.atlas.web.resources.AdminJerseyResourceIT
./webapp/test-output/junitreports/TEST-org.apache.atlas.web.resources.TypesJerseyResourceIT

Test results: 
https://builds.apache.org/job/PreCommit-ATLAS-Build/49//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ATLAS-Build/49//artifact/patchprocess/newPatchFindbugsWarningsnotification.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ATLAS-Build/49//artifact/patchprocess/newPatchFindbugsWarningscommon.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ATLAS-Build/49//artifact/patchprocess/newPatchFindbugsWarningsclient.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ATLAS-Build/49//artifact/patchprocess/newPatchFindbugsWarningstitan.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ATLAS-Build/49//artifact/patchprocess/newPatchFindbugsWarningstypesystem.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ATLAS-Build/49//artifact/patchprocess/newPatchFindbugsWarningsrepository.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ATLAS-Build/49//artifact/patchprocess/newPatchFindbugsWarningswebapp.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ATLAS-Build/49//artifact/patchprocess/newPatchFindbugsWarningsfalcon-bridge.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ATLAS-Build/49//artifact/patchprocess/newPatchFindbugsWarningshive-bridge.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ATLAS-Build/49//artifact/patchprocess/newPatchFindbugsWarningsstorm-bridge.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ATLAS-Build/49//artifact/patchprocess/newPatchFindbugsWarningssqoop-bridge.html
Console output: https://builds.apache.org/job/PreCommit-ATLAS-Build/49//console

This message is automatically generated.

> Add description for different types during create time
> --
>
> Key: ATLAS-479
> URL: https://issues.apache.org/jira/browse/ATLAS-479
> Project: Atlas
>  Issue Type: Sub-task
>Affects Versions: 0.6-incubating
>Reporter: Neeru Gupta
>Assignee: Neeru Gupta
> Fix For: 0.7-incubating
>
> Attachments: graycol.gif, rb43531(7).patch
>
>
> Ability to specify description while creating different types like Struct, 
> Enum, Class and Trait type.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Comment Edited] (ATLAS-479) Add description for different types during create time

2016-03-03 Thread Neeru Gupta (JIRA) 

[ 
https://issues.apache.org/jira/browse/ATLAS-479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15179025#comment-15179025
 ] 

Neeru Gupta edited comment on ATLAS-479 at 3/4/16 12:34 AM:


Fixed the test failure issues caused by constructor overloading.

[~shwethags] Please review and commit.


was (Author: guptaneeru):
Fixed the test failure issues caused by constructor overloading.

> Add description for different types during create time
> --
>
> Key: ATLAS-479
> URL: https://issues.apache.org/jira/browse/ATLAS-479
> Project: Atlas
>  Issue Type: Sub-task
>Affects Versions: 0.6-incubating
>Reporter: Neeru Gupta
>Assignee: Neeru Gupta
> Fix For: 0.7-incubating
>
> Attachments: graycol.gif, rb43531(7).patch
>
>
> Ability to specify description while creating different types like Struct, 
> Enum, Class and Trait type.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (ATLAS-479) Add description for different types during create time

2016-03-03 Thread Neeru Gupta (JIRA) 

 [ 
https://issues.apache.org/jira/browse/ATLAS-479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Neeru Gupta updated ATLAS-479:
--
Attachment: rb43531(7).patch

Fixed the test failure issues caused by constructor overloading.

> Add description for different types during create time
> --
>
> Key: ATLAS-479
> URL: https://issues.apache.org/jira/browse/ATLAS-479
> Project: Atlas
>  Issue Type: Sub-task
>Affects Versions: 0.6-incubating
>Reporter: Neeru Gupta
>Assignee: Neeru Gupta
> Fix For: 0.7-incubating
>
> Attachments: graycol.gif, rb43531(7).patch
>
>
> Ability to specify description while creating different types like Struct, 
> Enum, Class and Trait type.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (ATLAS-479) Add description for different types during create time

2016-03-03 Thread Neeru Gupta (JIRA) 

 [ 
https://issues.apache.org/jira/browse/ATLAS-479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Neeru Gupta updated ATLAS-479:
--
Attachment: (was: rb43531(6).patch)

> Add description for different types during create time
> --
>
> Key: ATLAS-479
> URL: https://issues.apache.org/jira/browse/ATLAS-479
> Project: Atlas
>  Issue Type: Sub-task
>Affects Versions: 0.6-incubating
>Reporter: Neeru Gupta
>Assignee: Neeru Gupta
> Fix For: 0.7-incubating
>
> Attachments: graycol.gif
>
>
> Ability to specify description while creating different types like Struct, 
> Enum, Class and Trait type.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ATLAS-474) Server does not start if the type is updated with same super type class information

2016-03-03 Thread David Kantor (JIRA) 

[ 
https://issues.apache.org/jira/browse/ATLAS-474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178797#comment-15178797
 ] 

David Kantor commented on ATLAS-474:


[~shwethags] I have addressed your comment and uploaded the changes to 
https://reviews.apache.org/r/44100/  Kindly review and let me know if you have 
additional comments.  Thanks...

> Server does not start if the type is updated with same super type class 
> information
> ---
>
> Key: ATLAS-474
> URL: https://issues.apache.org/jira/browse/ATLAS-474
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: trunk
> Environment: sandbox
>Reporter: Chethana
>Assignee: David Kantor
>Priority: Blocker
> Attachments: rb44100.patch
>
>
> Create a class with a superType class.
> Use update API and do not change the request used.
> Restart atlas server 
> Fails with exception
> K":1},"pattern":"static","timestamp":"1454921806183"} stored data: 
> {"version":1,"subscription":{"ATLAS_HOOK":1},"pattern":"static","timestamp":"1454921372384"}
>  (ZkUtils$:68)
> 2016-02-09 00:00:02,149 INFO  - [ZkClient-EventThread-91-localhost:9026:] ~ I 
> wrote this conflicted ephemeral node 
> [{"version":1,"subscription":{"ATLAS_HOOK":1},"pattern":"static","timestamp":"1454921806183"}]
>  at /consumers/atlas/ids/atlas_Chethanas-MBP.local-1454412213224-de1ce8e6 a 
> while back in a different session, hence I will backoff for this node to be 
> deleted by Zookeeper and retry (ZkUtils$:68)
> 2016-02-09 00:00:02,554 INFO  - [ProcessThread(sid:0 cport:-1)::] ~ Got 
> user-level KeeperException when processing sessionid:0x152a1b9238e0051 
> type:create cxid:0x3f0bf zxid:0x1c0ec txntype:-1 reqpath:n/a Error 
> Path:/consumers/atlas/ids/atlas_Chethanas-MBP.local-1454412213224-de1ce8e6 
> Error:KeeperErrorCode = NodeExists for 
> /consumers/atlas/ids/atlas_Chethanas-MBP.local-1454412213224-de1ce8e6 
> (PrepRequest...skipping...
> at 
> org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
> at org.eclipse.jetty.server.Server.doStart(Server.java:354)
> at 
> org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
> at 
> org.apache.atlas.web.service.EmbeddedServer.start(EmbeddedServer.java:88)
> at org.apache.atlas.Atlas.main(Atlas.java:107)
> Caused by: java.lang.RuntimeException: org.apache.atlas.AtlasException: Type 
> classa3ozcd7yra extends superType superClassa3ozcd7yra multiple times
> at 
> org.apache.atlas.services.DefaultMetadataService.restoreTypeSystem(DefaultMetadataService.java:113)
> at 
> org.apache.atlas.services.DefaultMetadataService.(DefaultMetadataService.java:100)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native 
> Method)
> at 
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> at 
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
> at 
> com.google.inject.internal.DefaultConstructionProxyFactory$2.newInstance(DefaultConstructionProxyFactory.java:86)
> at 
> com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:105)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Comment Edited] (ATLAS-500) UI: Search Default

2016-03-03 Thread Erik Bergenholtz (JIRA) 

[ 
https://issues.apache.org/jira/browse/ATLAS-500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178724#comment-15178724
 ] 

Erik Bergenholtz edited comment on ATLAS-500 at 3/3/16 10:25 PM:
-

[~sanjayp] - [~yhemanth] makes valid points above. I would like to see the 
following set of items addressed:
# Clicking on a tag should result in DSL query being executed (not a freetext). 
# Hint Text should be based as per above:
## For DSL hint: "Search using a DSL query: e.g. DataSet where name='sales_fact'
## For Text hint: "Search using a query string: sales_fact"
# On 400 errors on DSL search, provide a message to the user that the "Invalid 
DSL Syntax, Click here to execute as a Text search" 
## where here is an href to perform the search as a text search

[~yhemanth] - on the query text hints, we can do something more sophisticated 
with dynamic DSL hint. 


was (Author: bergenholtz):
[~sanjayp] - [~yhemanth] makes valid points above. I would like to see the 
following set of items addressed:
# Clicking on a tag should result in DSL query being executed (not a freetext). 
# Hint Text should be based as per above:
## "Search using a DSL query: e.g. DataSet where name='sales_fact'
## "Search using a query string: sales_fact"
# On 400 errors on DSL search, provide a message to the user that the "Invalid 
DSL Syntax, Click here to execute as a Text search" 
## where here is an href to perform the search as a text search

[~yhemanth] - on the query text hints, we can do something more sophisticated 
with dynamic DSL hint. 

> UI: Search Default
> --
>
> Key: ATLAS-500
> URL: https://issues.apache.org/jira/browse/ATLAS-500
> Project: Atlas
>  Issue Type: Improvement
>Affects Versions: 0.7-incubating
>Reporter: Erik Bergenholtz
>Assignee: Sanjay Patel
> Fix For: 0.7-incubating
>
> Attachments: ATLAS-500-error.png, ATLAS-500-v0.patch, 
> ATLAS-500-v1.patch
>
>
> The UI should provide a means of selecting the type of search performed. The 
> UI should not default to a fulltext search unless explicitly directed by the 
> user. This can be confusing to the user.
> If the DSL search does no result in any 'hits', it should so indicate.
> The search bar should provide a means by which the user can specify what type 
> of search to perform. One of:
> - DSL
> - FreeText
> (Gremlin should not be offered as an option through the UI)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ATLAS-500) UI: Search Default

2016-03-03 Thread Erik Bergenholtz (JIRA) 

[ 
https://issues.apache.org/jira/browse/ATLAS-500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178724#comment-15178724
 ] 

Erik Bergenholtz commented on ATLAS-500:


[~sanjayp] - [~yhemanth] makes valid points above. I would like to see the 
following set of items addressed:
# Clicking on a tag should result in DSL query being executed (not a freetext). 
# Hint Text should be based as per above:
## "Search using a DSL query: e.g. DataSet where name='sales_fact'
## "Search using a query string: sales_fact"
# On 400 errors on DSL search, provide a message to the user that the "Invalid 
DSL Syntax, Click here to execute as a Text search" 
## where here is an href to perform the search as a text search

[~yhemanth] - on the query text hints, we can do something more sophisticated 
with dynamic DSL hint. 

> UI: Search Default
> --
>
> Key: ATLAS-500
> URL: https://issues.apache.org/jira/browse/ATLAS-500
> Project: Atlas
>  Issue Type: Improvement
>Affects Versions: 0.7-incubating
>Reporter: Erik Bergenholtz
>Assignee: Sanjay Patel
> Fix For: 0.7-incubating
>
> Attachments: ATLAS-500-error.png, ATLAS-500-v0.patch, 
> ATLAS-500-v1.patch
>
>
> The UI should provide a means of selecting the type of search performed. The 
> UI should not default to a fulltext search unless explicitly directed by the 
> user. This can be confusing to the user.
> If the DSL search does no result in any 'hits', it should so indicate.
> The search bar should provide a means by which the user can specify what type 
> of search to perform. One of:
> - DSL
> - FreeText
> (Gremlin should not be offered as an option through the UI)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ATLAS-547) Camel netty producer unable to open multiple channels for concurrent requests

2016-03-03 Thread Shrinidhi (JIRA) 

[ 
https://issues.apache.org/jira/browse/ATLAS-547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178473#comment-15178473
 ] 

Shrinidhi commented on ATLAS-547:
-

Yes, its camel netty issue.  

> Camel netty producer unable to open multiple channels for concurrent requests
> -
>
> Key: ATLAS-547
> URL: https://issues.apache.org/jira/browse/ATLAS-547
> Project: Atlas
>  Issue Type: Bug
>Reporter: Shrinidhi
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Atlas Source Repository Broken Links

2016-03-03 Thread Jatinder Singh 
Done!

https://issues.apache.org/jira/browse/ATLAS-548 


> On Mar 3, 2016, at 12:15 AM, Venkatesh Seetharam  wrote:
> 
> Thanks for the information, appreciate if you could please create a jira so 
> one of us can fix it.
> 
> -Venkatesh
> 
> On Wed, Mar 2, 2016 at 6:09 AM Jatinder Singh  > wrote:
> Hey Venkatesh,
> 
> When you get a chance could you please update the Source Repository page to 
> correct links. It should be:
> 
> https://git-wip-us.apache.org/repos/asf/incubator-atlas.git 
> 
> 
> Instead of:
> 
> https://git-wip-us.apache.org/repos/asf/incubator-atlas.git/atlas-docs 
> 
> 
> Thanks,
> Jatinder
>

Re: Review Request 43933: ATLAS-476: Update type attribute with Reserved characters updated the original type as unknown

2016-03-03 Thread Hemanth Yamijala 


> On March 2, 2016, 7:37 a.m., Shwetha GS wrote:
> > repository/src/main/java/org/apache/atlas/repository/typestore/GraphBackedTypeStore.java,
> >  line 80
> > 
> >
> > Avoid moving the code as it becomes difficult to figure out the diff

Thanks for the review, Shwetha. Have moved back the methods - so the diff is 
much more manageable now.


> On March 2, 2016, 7:37 a.m., Shwetha GS wrote:
> > repository/src/main/java/org/apache/atlas/repository/typestore/GraphBackedTypeStore.java,
> >  line 304
> > 
> >
> > TransientTypeSystem.dataType() has the same logic and 
> > TransientTypeSystem also has the types added/updated. Can we use 
> > TransientTypeSystem instead map?

I think I have addressed this. I needed to make TransientTypeSystem public to 
make this work. Hope this is OK. Also, I don't think we can use dataType but 
need to use the overridden getDataType (which is what is originally called as 
well). This change has mostly reverted all changes to the TypeStore interface 
and implementing class.


> On March 2, 2016, 7:37 a.m., Shwetha GS wrote:
> > repository/src/main/java/org/apache/atlas/services/DefaultMetadataService.java,
> >  line 183
> > 
> >
> > Can the createType() also use the same logic of verify(), store(), and 
> > update()? It also addresses few corner cases of concurrent calls

Done.


- Hemanth


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/43933/#review121599
---


On Feb. 24, 2016, 6:08 a.m., Hemanth Yamijala wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/43933/
> ---
> 
> (Updated Feb. 24, 2016, 6:08 a.m.)
> 
> 
> Review request for atlas.
> 
> 
> Bugs: ATLAS-476
> https://issues.apache.org/jira/browse/ATLAS-476
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> Patch implements the following changes:
> 
> * Splits the cache update into a verify step and update step.
> * Calls the updates after the index and graph backend are updated.
> * Removes code that deletes types from the Cache on exception.
> 
> 
> Diffs
> -
> 
>   
> repository/src/main/java/org/apache/atlas/repository/typestore/GraphBackedTypeStore.java
>  9789be7 
>   
> repository/src/main/java/org/apache/atlas/repository/typestore/ITypeStore.java
>  3a88856 
>   
> repository/src/main/java/org/apache/atlas/services/DefaultMetadataService.java
>  889e200 
>   
> repository/src/test/java/org/apache/atlas/repository/typestore/GraphBackedTypeStoreTest.java
>  8402eed 
>   
> repository/src/test/java/org/apache/atlas/service/DefaultMetadataServiceTest.java
>  d00f12e 
>   typesystem/src/main/java/org/apache/atlas/typesystem/types/TypeSystem.java 
> c0b0698 
> 
> Diff: https://reviews.apache.org/r/43933/diff/
> 
> 
> Testing
> ---
> 
> UTs - Added a UT that reproduces the scenario.
> Also ran hive-import on the Atlas binary created from the build to ensure 
> things are fine.
> 
> 
> Thanks,
> 
> Hemanth Yamijala
> 
>

[jira] [Commented] (ATLAS-247) hive_column leve lineage

2016-03-03 Thread Harish Butani (JIRA) 

[ 
https://issues.apache.org/jira/browse/ATLAS-247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178296#comment-15178296
 ] 

Harish Butani commented on ATLAS-247:
-

updated patch with fix for case when a column links to input table(s).

> hive_column leve lineage
> 
>
> Key: ATLAS-247
> URL: https://issues.apache.org/jira/browse/ATLAS-247
> Project: Atlas
>  Issue Type: New Feature
>Affects Versions: 0.5-incubating
>Reporter: Herman Yu
>Assignee: Harish Butani
> Attachments: ATLAS-247.2.patch, ATLAS-247.patch
>
>
> hive_column is not inherited from DataSet, thus can't be using hive_process 
> to track column level lineages
> Is there specific reason that hive_column is not inheriting from Data Set? 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (ATLAS-247) hive_column leve lineage

2016-03-03 Thread Harish Butani (JIRA) 

 [ 
https://issues.apache.org/jira/browse/ATLAS-247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Harish Butani updated ATLAS-247:

Attachment: ATLAS-247.2.patch

> hive_column leve lineage
> 
>
> Key: ATLAS-247
> URL: https://issues.apache.org/jira/browse/ATLAS-247
> Project: Atlas
>  Issue Type: New Feature
>Affects Versions: 0.5-incubating
>Reporter: Herman Yu
>Assignee: Harish Butani
> Attachments: ATLAS-247.2.patch, ATLAS-247.patch
>
>
> hive_column is not inherited from DataSet, thus can't be using hive_process 
> to track column level lineages
> Is there specific reason that hive_column is not inheriting from Data Set? 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ATLAS-476) Update type attribute with Reserved characters updated the original type as unknown

2016-03-03 Thread ATLAS QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/ATLAS-476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15178021#comment-15178021
 ] 

ATLAS QA commented on ATLAS-476:


{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment
  http://issues.apache.org/jira/secure/attachment/12791185/ATLAS-476-2.patch
  against master revision b9575f2.

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+1 tests included{color}.  The patch appears to include 2 new 
or modified test files.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javadoc{color}.  There were no new javadoc warning messages.

+1 checkstyle.  The patch generated 0 code style errors.

{color:red}-1 findbugs{color}.  The patch appears to introduce 334 new 
Findbugs (version 2.0.3) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:red}-1 core tests{color}.  The patch failed these unit tests in :
 
./webapp/test-output/junitreports/TEST-org.apache.atlas.web.resources.EntityJerseyResourceIT
./webapp/test-output/junitreports/TEST-org.apache.atlas.web.resources.MetadataDiscoveryJerseyResourceIT
./webapp/test-output/junitreports/TEST-org.apache.atlas.web.resources.RexsterGraphJerseyResourceIT
./webapp/test-output/junitreports/TEST-org.apache.atlas.web.resources.AdminJerseyResourceIT
./webapp/test-output/junitreports/TEST-org.apache.atlas.web.resources.TypesJerseyResourceIT
./webapp/target/failsafe-reports/junitreports/TEST-org.apache.atlas.examples.QuickStartIT

Test results: 
https://builds.apache.org/job/PreCommit-ATLAS-Build/48//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ATLAS-Build/48//artifact/patchprocess/newPatchFindbugsWarningsnotification.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ATLAS-Build/48//artifact/patchprocess/newPatchFindbugsWarningscommon.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ATLAS-Build/48//artifact/patchprocess/newPatchFindbugsWarningsclient.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ATLAS-Build/48//artifact/patchprocess/newPatchFindbugsWarningstitan.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ATLAS-Build/48//artifact/patchprocess/newPatchFindbugsWarningstypesystem.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ATLAS-Build/48//artifact/patchprocess/newPatchFindbugsWarningsrepository.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ATLAS-Build/48//artifact/patchprocess/newPatchFindbugsWarningswebapp.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ATLAS-Build/48//artifact/patchprocess/newPatchFindbugsWarningsfalcon-bridge.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ATLAS-Build/48//artifact/patchprocess/newPatchFindbugsWarningshive-bridge.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ATLAS-Build/48//artifact/patchprocess/newPatchFindbugsWarningsstorm-bridge.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ATLAS-Build/48//artifact/patchprocess/newPatchFindbugsWarningssqoop-bridge.html
Console output: https://builds.apache.org/job/PreCommit-ATLAS-Build/48//console

This message is automatically generated.

> Update type attribute with Reserved characters updated the original type as 
> unknown
> ---
>
> Key: ATLAS-476
> URL: https://issues.apache.org/jira/browse/ATLAS-476
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: trunk
> Environment: sandbox
>Reporter: Chethana
>Assignee: Hemanth Yamijala
>Priority: Blocker
> Fix For: 0.7-incubating
>
> Attachments: 1.log, ATLAS-476-2.patch, ATLAS-476.patch
>
>
> create a type with required attribute
> try to get this type created - the type data is returned
> try update this type by adding attribute with attribute name consisting of a 
> reserved character eg:test$
> this throws exception.
> Now use to get call to get the previously created type
> Expected:
> The type should not be updated.
> Actual:
> "error": "Unknown datatype: className_update_vsvrbzqaqg",
> "stackTrace": "org.apache.atlas.typesystem.exception.TypeNotFoundException: 
> Unknown datatype: className_update_vsvrbzqaqg\n\tat 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (ATLAS-476) Update type attribute with Reserved characters updated the original type as unknown

2016-03-03 Thread Hemanth Yamijala (JIRA) 

 [ 
https://issues.apache.org/jira/browse/ATLAS-476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hemanth Yamijala updated ATLAS-476:
---
Attachment: ATLAS-476-2.patch

Attaching latest patch from review board.

> Update type attribute with Reserved characters updated the original type as 
> unknown
> ---
>
> Key: ATLAS-476
> URL: https://issues.apache.org/jira/browse/ATLAS-476
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: trunk
> Environment: sandbox
>Reporter: Chethana
>Assignee: Hemanth Yamijala
>Priority: Blocker
> Fix For: 0.7-incubating
>
> Attachments: 1.log, ATLAS-476-2.patch, ATLAS-476.patch
>
>
> create a type with required attribute
> try to get this type created - the type data is returned
> try update this type by adding attribute with attribute name consisting of a 
> reserved character eg:test$
> this throws exception.
> Now use to get call to get the previously created type
> Expected:
> The type should not be updated.
> Actual:
> "error": "Unknown datatype: className_update_vsvrbzqaqg",
> "stackTrace": "org.apache.atlas.typesystem.exception.TypeNotFoundException: 
> Unknown datatype: className_update_vsvrbzqaqg\n\tat 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ATLAS-474) Server does not start if the type is updated with same super type class information

2016-03-03 Thread David Kantor (JIRA) 

[ 
https://issues.apache.org/jira/browse/ATLAS-474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177910#comment-15177910
 ] 

David Kantor commented on ATLAS-474:


[~shwethags] Agreed that super types should be a set in the type system, and I 
will make that change and re-submit.  However, the type store fix is still 
needed, as the problem of duplicate edges from type store updates was not 
limited to super types.  Currently, a type system update ends up duplicating 
all edges, including edges for attributes.  The other duplicate edges are not 
fatal to system startup and so have existed undetected since day one.  There is 
specific checking for duplicate super types in 
TypeSystem.TransientTypeSystem.validateSuperTypes() and that is what causes the 
server startup issue described in this bug.  The type system vertices are not 
duplicated during an update because there is a check to prevent duplicates in 
GraphBackedTypeStore.createVertex().  There was no such check in 
GraphBackedTypeStore.addEdge(), and as result, duplicate edges were written.  
So I believe the existence check fix that I've added there is still needed.

> Server does not start if the type is updated with same super type class 
> information
> ---
>
> Key: ATLAS-474
> URL: https://issues.apache.org/jira/browse/ATLAS-474
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: trunk
> Environment: sandbox
>Reporter: Chethana
>Assignee: David Kantor
>Priority: Blocker
> Attachments: rb44100.patch
>
>
> Create a class with a superType class.
> Use update API and do not change the request used.
> Restart atlas server 
> Fails with exception
> K":1},"pattern":"static","timestamp":"1454921806183"} stored data: 
> {"version":1,"subscription":{"ATLAS_HOOK":1},"pattern":"static","timestamp":"1454921372384"}
>  (ZkUtils$:68)
> 2016-02-09 00:00:02,149 INFO  - [ZkClient-EventThread-91-localhost:9026:] ~ I 
> wrote this conflicted ephemeral node 
> [{"version":1,"subscription":{"ATLAS_HOOK":1},"pattern":"static","timestamp":"1454921806183"}]
>  at /consumers/atlas/ids/atlas_Chethanas-MBP.local-1454412213224-de1ce8e6 a 
> while back in a different session, hence I will backoff for this node to be 
> deleted by Zookeeper and retry (ZkUtils$:68)
> 2016-02-09 00:00:02,554 INFO  - [ProcessThread(sid:0 cport:-1)::] ~ Got 
> user-level KeeperException when processing sessionid:0x152a1b9238e0051 
> type:create cxid:0x3f0bf zxid:0x1c0ec txntype:-1 reqpath:n/a Error 
> Path:/consumers/atlas/ids/atlas_Chethanas-MBP.local-1454412213224-de1ce8e6 
> Error:KeeperErrorCode = NodeExists for 
> /consumers/atlas/ids/atlas_Chethanas-MBP.local-1454412213224-de1ce8e6 
> (PrepRequest...skipping...
> at 
> org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
> at org.eclipse.jetty.server.Server.doStart(Server.java:354)
> at 
> org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
> at 
> org.apache.atlas.web.service.EmbeddedServer.start(EmbeddedServer.java:88)
> at org.apache.atlas.Atlas.main(Atlas.java:107)
> Caused by: java.lang.RuntimeException: org.apache.atlas.AtlasException: Type 
> classa3ozcd7yra extends superType superClassa3ozcd7yra multiple times
> at 
> org.apache.atlas.services.DefaultMetadataService.restoreTypeSystem(DefaultMetadataService.java:113)
> at 
> org.apache.atlas.services.DefaultMetadataService.(DefaultMetadataService.java:100)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native 
> Method)
> at 
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> at 
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
> at 
> com.google.inject.internal.DefaultConstructionProxyFactory$2.newInstance(DefaultConstructionProxyFactory.java:86)
> at 
> com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:105)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (ATLAS-548) Hyperlinks to source repository are broken

2016-03-03 Thread Jatinder Singh (JIRA) 
Jatinder Singh created ATLAS-548:


 Summary: Hyperlinks to source repository are broken
 Key: ATLAS-548
 URL: https://issues.apache.org/jira/browse/ATLAS-548
 Project: Atlas
  Issue Type: Bug
Reporter: Jatinder Singh
Priority: Minor


When you get a chance could you please update the Source Repository page to 
correct links. It should be:

https://git-wip-us.apache.org/repos/asf/incubator-atlas.git

Instead of:

https://git-wip-us.apache.org/repos/asf/incubator-atlas.git/atlas-docs




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ATLAS-537) Falcon hook failing when tried to submit a process which creates a hive table.

2016-03-03 Thread ATLAS QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/ATLAS-537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177540#comment-15177540
 ] 

ATLAS QA commented on ATLAS-537:


{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment
  http://issues.apache.org/jira/secure/attachment/12791125/ATLAS-537.patch
  against master revision b9575f2.

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+1 tests included{color}.  The patch appears to include 2 new 
or modified test files.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javadoc{color}.  There were no new javadoc warning messages.

+1 checkstyle.  The patch generated 0 code style errors.

{color:red}-1 findbugs{color}.  The patch appears to introduce 334 new 
Findbugs (version 2.0.3) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:red}-1 core tests{color}.  The patch failed these unit tests in :
 
./webapp/test-output/junitreports/TEST-org.apache.atlas.web.resources.EntityJerseyResourceIT
./webapp/test-output/junitreports/TEST-org.apache.atlas.web.resources.MetadataDiscoveryJerseyResourceIT
./webapp/test-output/junitreports/TEST-org.apache.atlas.web.resources.RexsterGraphJerseyResourceIT
./webapp/test-output/junitreports/TEST-org.apache.atlas.web.resources.AdminJerseyResourceIT
./webapp/test-output/junitreports/TEST-org.apache.atlas.web.resources.TypesJerseyResourceIT

Test results: 
https://builds.apache.org/job/PreCommit-ATLAS-Build/47//testReport/
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ATLAS-Build/47//artifact/patchprocess/newPatchFindbugsWarningsnotification.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ATLAS-Build/47//artifact/patchprocess/newPatchFindbugsWarningscommon.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ATLAS-Build/47//artifact/patchprocess/newPatchFindbugsWarningsclient.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ATLAS-Build/47//artifact/patchprocess/newPatchFindbugsWarningstitan.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ATLAS-Build/47//artifact/patchprocess/newPatchFindbugsWarningstypesystem.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ATLAS-Build/47//artifact/patchprocess/newPatchFindbugsWarningsrepository.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ATLAS-Build/47//artifact/patchprocess/newPatchFindbugsWarningswebapp.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ATLAS-Build/47//artifact/patchprocess/newPatchFindbugsWarningsfalcon-bridge.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ATLAS-Build/47//artifact/patchprocess/newPatchFindbugsWarningshive-bridge.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ATLAS-Build/47//artifact/patchprocess/newPatchFindbugsWarningsstorm-bridge.html
Findbugs warnings: 
https://builds.apache.org/job/PreCommit-ATLAS-Build/47//artifact/patchprocess/newPatchFindbugsWarningssqoop-bridge.html
Console output: https://builds.apache.org/job/PreCommit-ATLAS-Build/47//console

This message is automatically generated.

> Falcon hook failing when tried to submit a process which creates a hive table.
> --
>
> Key: ATLAS-537
> URL: https://issues.apache.org/jira/browse/ATLAS-537
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: trunk
>Reporter: Ayub Khan
>Assignee: Shwetha G S
>Priority: Blocker
> Fix For: 0.7-incubating
>
> Attachments: ATLAS-537.patch, logs.tar.gz
>
>
> Falcon hook failing when tried to submit a hive process.
> Stack trace from log:
> {noformat}
> 2016-02-25 11:40:38,894 INFO  - [479730212@qtp-989447607-2 - 
> 9f45adf1-2264-420a-8a4d-9d7a729f34b8:hrt_qa:POST//entities/submit/process] ~ 
> PROCESS/Aae61bc53-c2ee37c0123 is published into config store (AUDIT:229)
> 2016-02-25 11:40:38,894 INFO  - [479730212@qtp-989447607-2 - 
> 9f45adf1-2264-420a-8a4d-9d7a729f34b8:hrt_qa:POST//entities/submit/process] ~ 
> Submit successful: (process): Aae61bc53-c2ee37c0123 
> (AbstractEntityManager:417)
> 2016-02-25 11:40:38,895 INFO  - [479730212@qtp-989447607-2 - 
> 9f45adf1-2264-420a-8a4d-9d7a729f34b8:hrt_qa:POST//entities/submit/process] ~ 
> {Action:submit, Dimensions:{colo=NULL, entityType=process}, Status: 
> SUCCEEDED, Time-taken:350536678 ns} (METRIC:38)
> 2016-02-25 11:40:38,896 DEBUG - [479730212@qtp-989447607-2 - 
> 9f45adf1-2264-420a-8a4d-9d7a729f34b8:] ~ Audit: hrt_qa/172.22.101.126 
> performed request 
> http://apathan-atlas-erie-tp-testing-3.novalocal:15000/api/entities/submit/proc

[jira] [Commented] (ATLAS-474) Server does not start if the type is updated with same super type class information

2016-03-03 Thread Shwetha G S (JIRA) 

[ 
https://issues.apache.org/jira/browse/ATLAS-474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15177463#comment-15177463
 ] 

Shwetha G S commented on ATLAS-474:
---

It doesn't make sense for superTypes to be a list, it should be a set. Instead 
of fixing the type store, shouldn't we fix type system?

> Server does not start if the type is updated with same super type class 
> information
> ---
>
> Key: ATLAS-474
> URL: https://issues.apache.org/jira/browse/ATLAS-474
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: trunk
> Environment: sandbox
>Reporter: Chethana
>Assignee: David Kantor
>Priority: Blocker
> Attachments: rb44100.patch
>
>
> Create a class with a superType class.
> Use update API and do not change the request used.
> Restart atlas server 
> Fails with exception
> K":1},"pattern":"static","timestamp":"1454921806183"} stored data: 
> {"version":1,"subscription":{"ATLAS_HOOK":1},"pattern":"static","timestamp":"1454921372384"}
>  (ZkUtils$:68)
> 2016-02-09 00:00:02,149 INFO  - [ZkClient-EventThread-91-localhost:9026:] ~ I 
> wrote this conflicted ephemeral node 
> [{"version":1,"subscription":{"ATLAS_HOOK":1},"pattern":"static","timestamp":"1454921806183"}]
>  at /consumers/atlas/ids/atlas_Chethanas-MBP.local-1454412213224-de1ce8e6 a 
> while back in a different session, hence I will backoff for this node to be 
> deleted by Zookeeper and retry (ZkUtils$:68)
> 2016-02-09 00:00:02,554 INFO  - [ProcessThread(sid:0 cport:-1)::] ~ Got 
> user-level KeeperException when processing sessionid:0x152a1b9238e0051 
> type:create cxid:0x3f0bf zxid:0x1c0ec txntype:-1 reqpath:n/a Error 
> Path:/consumers/atlas/ids/atlas_Chethanas-MBP.local-1454412213224-de1ce8e6 
> Error:KeeperErrorCode = NodeExists for 
> /consumers/atlas/ids/atlas_Chethanas-MBP.local-1454412213224-de1ce8e6 
> (PrepRequest...skipping...
> at 
> org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:61)
> at org.eclipse.jetty.server.Server.doStart(Server.java:354)
> at 
> org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68)
> at 
> org.apache.atlas.web.service.EmbeddedServer.start(EmbeddedServer.java:88)
> at org.apache.atlas.Atlas.main(Atlas.java:107)
> Caused by: java.lang.RuntimeException: org.apache.atlas.AtlasException: Type 
> classa3ozcd7yra extends superType superClassa3ozcd7yra multiple times
> at 
> org.apache.atlas.services.DefaultMetadataService.restoreTypeSystem(DefaultMetadataService.java:113)
> at 
> org.apache.atlas.services.DefaultMetadataService.(DefaultMetadataService.java:100)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native 
> Method)
> at 
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
> at 
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
> at 
> com.google.inject.internal.DefaultConstructionProxyFactory$2.newInstance(DefaultConstructionProxyFactory.java:86)
> at 
> com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:105)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (ATLAS-537) Falcon hook failing when tried to submit a process which creates a hive table.

2016-03-03 Thread Shwetha G S (JIRA) 

 [ 
https://issues.apache.org/jira/browse/ATLAS-537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shwetha G S updated ATLAS-537:
--
Attachment: ATLAS-537.patch

> Falcon hook failing when tried to submit a process which creates a hive table.
> --
>
> Key: ATLAS-537
> URL: https://issues.apache.org/jira/browse/ATLAS-537
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: trunk
>Reporter: Ayub Khan
>Assignee: Shwetha G S
>Priority: Blocker
> Fix For: 0.7-incubating
>
> Attachments: ATLAS-537.patch, logs.tar.gz
>
>
> Falcon hook failing when tried to submit a hive process.
> Stack trace from log:
> {noformat}
> 2016-02-25 11:40:38,894 INFO  - [479730212@qtp-989447607-2 - 
> 9f45adf1-2264-420a-8a4d-9d7a729f34b8:hrt_qa:POST//entities/submit/process] ~ 
> PROCESS/Aae61bc53-c2ee37c0123 is published into config store (AUDIT:229)
> 2016-02-25 11:40:38,894 INFO  - [479730212@qtp-989447607-2 - 
> 9f45adf1-2264-420a-8a4d-9d7a729f34b8:hrt_qa:POST//entities/submit/process] ~ 
> Submit successful: (process): Aae61bc53-c2ee37c0123 
> (AbstractEntityManager:417)
> 2016-02-25 11:40:38,895 INFO  - [479730212@qtp-989447607-2 - 
> 9f45adf1-2264-420a-8a4d-9d7a729f34b8:hrt_qa:POST//entities/submit/process] ~ 
> {Action:submit, Dimensions:{colo=NULL, entityType=process}, Status: 
> SUCCEEDED, Time-taken:350536678 ns} (METRIC:38)
> 2016-02-25 11:40:38,896 DEBUG - [479730212@qtp-989447607-2 - 
> 9f45adf1-2264-420a-8a4d-9d7a729f34b8:] ~ Audit: hrt_qa/172.22.101.126 
> performed request 
> http://apathan-atlas-erie-tp-testing-3.novalocal:15000/api/entities/submit/process
>  (172.22.101.123) at time 2016-02-25T11:40Z (FalconAuditFilter:86)
> 2016-02-25 11:40:38,896 INFO  - [Atlas Logger 0:] ~ Entered Atlas hook for 
> Falcon hook operation ADD_PROCESS (FalconHook:167)
> 2016-02-25 11:40:39,625 INFO  - [Atlas Logger 0:] ~ 0: Opening raw store with 
> implemenation class:org.apache.hadoop.hive.metastore.ObjectStore 
> (HiveMetaStore:590)
> 2016-02-25 11:40:39,650 INFO  - [Atlas Logger 0:] ~ ObjectStore, initialize 
> called (ObjectStore:294)
> 2016-02-25 11:40:39,965 INFO  - [Atlas Logger 0:] ~ Property 
> hive.metastore.integral.jdo.pushdown unknown - will be ignored 
> (Persistence:77)
> 2016-02-25 11:40:39,966 INFO  - [Atlas Logger 0:] ~ Property 
> datanucleus.cache.level2 unknown - will be ignored (Persistence:77)
> 2016-02-25 11:40:41,822 WARN  - [Atlas Logger 0:] ~ Retrying creating default 
> database after error: Unexpected exception caught. (HiveMetaStore:623)
> javax.jdo.JDOFatalInternalException: Unexpected exception caught.
>   at 
> javax.jdo.JDOHelper.invokeGetPersistenceManagerFactoryOnImplementation(JDOHelper.java:1193)
>   at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:808)
>   at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:701)
>   at 
> org.apache.hadoop.hive.metastore.ObjectStore.getPMF(ObjectStore.java:374)
>   at 
> org.apache.hadoop.hive.metastore.ObjectStore.getPersistenceManager(ObjectStore.java:403)
>   at 
> org.apache.hadoop.hive.metastore.ObjectStore.initialize(ObjectStore.java:296)
>   at 
> org.apache.hadoop.hive.metastore.ObjectStore.setConf(ObjectStore.java:263)
>   at 
> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:76)
>   at 
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:136)
>   at 
> org.apache.hadoop.hive.metastore.RawStoreProxy.(RawStoreProxy.java:57)
>   at 
> org.apache.hadoop.hive.metastore.RawStoreProxy.getProxy(RawStoreProxy.java:66)
>   at 
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.newRawStore(HiveMetaStore.java:594)
>   at 
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:572)
>   at 
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:621)
>   at 
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:462)
>   at 
> org.apache.hadoop.hive.metastore.RetryingHMSHandler.(RetryingHMSHandler.java:66)
>   at 
> org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:72)
>   at 
> org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:5789)
>   at 
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.(HiveMetaStoreClient.java:199)
>   at 
> org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.(SessionHiveMetaStoreClient.java:74)
>   at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
>   at 
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
>   at 
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(De