Re: Review Request 37285: solr conf files and changes to make it work with upgraded titan

2015-08-10 Thread Shwetha GS 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/37285/#review94722
---

Ship it!


Ship It!

- Shwetha GS


On Aug. 10, 2015, 11:16 a.m., Suma Shivaprasad wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/37285/
> ---
> 
> (Updated Aug. 10, 2015, 11:16 a.m.)
> 
> 
> Review request for atlas and Shwetha GS.
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> changes for titan upgraded to solr 5
> 
> 
> Diffs
> -
> 
>   client/pom.xml d393b3a 
>   docs/src/site/twiki/InstallationSteps.twiki 0391c2d 
>   pom.xml facd539 
>   repository/pom.xml a2f8e08 
>   src/conf/solr/atlasConfig/conf/currency.xml PRE-CREATION 
>   src/conf/solr/atlasConfig/conf/lang/stopwords_en.txt PRE-CREATION 
>   src/conf/solr/atlasConfig/conf/protwords.txt PRE-CREATION 
>   src/conf/solr/atlasConfig/conf/schema.xml PRE-CREATION 
>   src/conf/solr/atlasConfig/conf/solrconfig.xml PRE-CREATION 
>   src/conf/solr/atlasConfig/conf/stopwords.txt PRE-CREATION 
>   src/conf/solr/atlasConfig/conf/synonyms.txt PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/37285/diff/
> 
> 
> Testing
> ---
> 
> All tests pass . No new tests added
> 
> 
> Thanks,
> 
> Suma Shivaprasad
> 
>

Re: Review Request 37285: solr conf files and changes to make it work with upgraded titan

2015-08-10 Thread Suma Shivaprasad 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/37285/
---

(Updated Aug. 10, 2015, 11:16 a.m.)


Review request for atlas and Shwetha GS.


Changes
---

Fixed doc review comments


Repository: atlas


Description
---

changes for titan upgraded to solr 5


Diffs (updated)
-

  client/pom.xml d393b3a 
  docs/src/site/twiki/InstallationSteps.twiki 0391c2d 
  pom.xml facd539 
  repository/pom.xml a2f8e08 
  src/conf/solr/atlasConfig/conf/currency.xml PRE-CREATION 
  src/conf/solr/atlasConfig/conf/lang/stopwords_en.txt PRE-CREATION 
  src/conf/solr/atlasConfig/conf/protwords.txt PRE-CREATION 
  src/conf/solr/atlasConfig/conf/schema.xml PRE-CREATION 
  src/conf/solr/atlasConfig/conf/solrconfig.xml PRE-CREATION 
  src/conf/solr/atlasConfig/conf/stopwords.txt PRE-CREATION 
  src/conf/solr/atlasConfig/conf/synonyms.txt PRE-CREATION 

Diff: https://reviews.apache.org/r/37285/diff/


Testing
---

All tests pass . No new tests added


Thanks,

Suma Shivaprasad

Re: Review Request 37285: solr conf files and changes to make it work with upgraded titan

2015-08-10 Thread Shwetha GS 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/37285/#review94720
---



docs/src/site/twiki/InstallationSteps.twiki (line 131)


in - should be is



docs/src/site/twiki/InstallationSteps.twiki (line 137)


Mention of namenode not required. You can just say, either re-use zookeeper 
or set-up new one



docs/src/site/twiki/InstallationSteps.twiki (line 146)


that you have in the cluster - change to 'that you have in the solr cluster'



docs/src/site/twiki/InstallationSteps.twiki (line 147)


Remove : at the end?



docs/src/site/twiki/InstallationSteps.twiki (line 149)


point to the properties file - /conf/application.properties



docs/src/site/twiki/InstallationSteps.twiki (line 150)


you can also add link to titan solr config page for more configs


Some comments on documnetation

- Shwetha GS


On Aug. 10, 2015, 9:12 a.m., Suma Shivaprasad wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/37285/
> ---
> 
> (Updated Aug. 10, 2015, 9:12 a.m.)
> 
> 
> Review request for atlas and Shwetha GS.
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> changes for titan upgraded to solr 5
> 
> 
> Diffs
> -
> 
>   client/pom.xml d393b3a 
>   docs/src/site/twiki/InstallationSteps.twiki 0391c2d 
>   pom.xml facd539 
>   repository/pom.xml a2f8e08 
>   src/conf/solr/atlasConfig/conf/currency.xml PRE-CREATION 
>   src/conf/solr/atlasConfig/conf/lang/stopwords_en.txt PRE-CREATION 
>   src/conf/solr/atlasConfig/conf/protwords.txt PRE-CREATION 
>   src/conf/solr/atlasConfig/conf/schema.xml PRE-CREATION 
>   src/conf/solr/atlasConfig/conf/solrconfig.xml PRE-CREATION 
>   src/conf/solr/atlasConfig/conf/stopwords.txt PRE-CREATION 
>   src/conf/solr/atlasConfig/conf/synonyms.txt PRE-CREATION 
> 
> Diff: https://reviews.apache.org/r/37285/diff/
> 
> 
> Testing
> ---
> 
> All tests pass . No new tests added
> 
> 
> Thanks,
> 
> Suma Shivaprasad
> 
>

Re: Review Request 37285: solr conf files and changes to make it work with upgraded titan

2015-08-10 Thread Suma Shivaprasad 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/37285/
---

(Updated Aug. 10, 2015, 9:12 a.m.)


Review request for atlas and Shwetha GS.


Changes
---

Fixed review comments


Repository: atlas


Description
---

changes for titan upgraded to solr 5


Diffs (updated)
-

  client/pom.xml d393b3a 
  docs/src/site/twiki/InstallationSteps.twiki 0391c2d 
  pom.xml facd539 
  repository/pom.xml a2f8e08 
  src/conf/solr/atlasConfig/conf/currency.xml PRE-CREATION 
  src/conf/solr/atlasConfig/conf/lang/stopwords_en.txt PRE-CREATION 
  src/conf/solr/atlasConfig/conf/protwords.txt PRE-CREATION 
  src/conf/solr/atlasConfig/conf/schema.xml PRE-CREATION 
  src/conf/solr/atlasConfig/conf/solrconfig.xml PRE-CREATION 
  src/conf/solr/atlasConfig/conf/stopwords.txt PRE-CREATION 
  src/conf/solr/atlasConfig/conf/synonyms.txt PRE-CREATION 

Diff: https://reviews.apache.org/r/37285/diff/


Testing
---

All tests pass . No new tests added


Thanks,

Suma Shivaprasad

Re: Review Request 37285: solr conf files and changes to make it work with upgraded titan

2015-08-10 Thread Suma Shivaprasad 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/37285/
---

(Updated Aug. 10, 2015, 8:57 a.m.)


Review request for atlas and Shwetha GS.


Changes
---

Added documentation for solr installation


Repository: atlas


Description
---

changes for titan upgraded to solr 5


Diffs (updated)
-

  client/pom.xml d393b3a 
  docs/src/site/twiki/InstallationSteps.twiki 0391c2d 
  pom.xml facd539 
  repository/pom.xml a2f8e08 
  src/conf/solr/atlasConfig/conf/currency.xml PRE-CREATION 
  src/conf/solr/atlasConfig/conf/lang/stopwords_en.txt PRE-CREATION 
  src/conf/solr/atlasConfig/conf/protwords.txt PRE-CREATION 
  src/conf/solr/atlasConfig/conf/schema.xml PRE-CREATION 
  src/conf/solr/atlasConfig/conf/solrconfig.xml PRE-CREATION 
  src/conf/solr/atlasConfig/conf/stopwords.txt PRE-CREATION 
  src/conf/solr/atlasConfig/conf/synonyms.txt PRE-CREATION 
  src/conf/solr/solr.xml PRE-CREATION 
  src/conf/solr/zoo.cfg PRE-CREATION 

Diff: https://reviews.apache.org/r/37285/diff/


Testing
---

All tests pass . No new tests added


Thanks,

Suma Shivaprasad

Re: Review Request 37181: ATLAS-59 De-duping of entities

2015-08-10 Thread Shwetha GS 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/37181/
---

(Updated Aug. 10, 2015, 10:43 a.m.)


Review request for atlas.


Changes
---

Adds referenceable type as a super type which contains qualified name as unique 
required attribute. Any class type that requires de-duping should extend this 
new type. 
Also added new API that gets entity definition by unique attribute name


Bugs: ATLAS-59
https://issues.apache.org/jira/browse/ATLAS-59


Repository: atlas


Description
---

Exposes qualifiedName that can be set on Referenceable. In the backend, it 
creates unique index for this property for all class types and createEntity 
fails if there is another entity of the same type with the same qualified name


Diffs (updated)
-

  client/src/main/java/org/apache/atlas/AtlasClient.java 1c7d62a 
  dashboard/v2/public/modules/details/detailsResource.js af2f249 
  
repository/src/main/java/org/apache/atlas/repository/EntityExistsException.java 
PRE-CREATION 
  repository/src/main/java/org/apache/atlas/repository/MetadataRepository.java 
1b0faa5 
  
repository/src/main/java/org/apache/atlas/repository/graph/GraphBackedMetadataRepository.java
 cc10ea3 
  repository/src/main/java/org/apache/atlas/repository/graph/GraphHelper.java 
ceb8a65 
  
repository/src/main/java/org/apache/atlas/services/DefaultMetadataService.java 
56168db 
  repository/src/main/java/org/apache/atlas/services/MetadataService.java 
8f82f88 
  
repository/src/test/java/org/apache/atlas/service/DefaultMetadataServiceTest.java
 PRE-CREATION 
  typesystem/src/main/java/org/apache/atlas/TypeExistsException.java 
PRE-CREATION 
  typesystem/src/main/java/org/apache/atlas/typesystem/types/TypeSystem.java 
d1e8dbd 
  webapp/src/main/java/org/apache/atlas/web/resources/EntitiesResource.java 
PRE-CREATION 
  webapp/src/main/java/org/apache/atlas/web/resources/EntityResource.java 
dcb460d 
  webapp/src/main/java/org/apache/atlas/web/resources/TypesResource.java 
d6d5915 
  
webapp/src/test/java/org/apache/atlas/web/resources/EntityJerseyResourceIT.java 
e6a7325 

Diff: https://reviews.apache.org/r/37181/diff/


Testing
---

UT and IT


Thanks,

Shwetha GS

[jira] [Commented] (ATLAS-96) import-hive.sh failed

2015-08-10 Thread Jason Xing (JIRA) 

[ 
https://issues.apache.org/jira/browse/ATLAS-96?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680074#comment-14680074
 ] 

Jason Xing commented on ATLAS-96:
-

Thank you!

> import-hive.sh failed
> -
>
> Key: ATLAS-96
> URL: https://issues.apache.org/jira/browse/ATLAS-96
> Project: Atlas
>  Issue Type: Bug
>Reporter: Jason Xing
>
> Exception in thread "main" org.apache.hadoop.hive.ql.metadata.HiveException: 
> java.lang.RuntimeException: Unable to instantiate 
> org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
>   at 
> org.apache.hadoop.hive.ql.metadata.Hive.getAllDatabases(Hive.java:1236)
>   at 
> org.apache.atlas.hive.bridge.HiveMetaStoreBridge.importDatabases(HiveMetaStoreBridge.java:94)
>   at 
> org.apache.atlas.hive.bridge.HiveMetaStoreBridge.importHiveMetadata(HiveMetaStoreBridge.java:90)
>   at 
> org.apache.atlas.hive.bridge.HiveMetaStoreBridge.main(HiveMetaStoreBridge.java:507)
> Caused by: java.lang.RuntimeException: Unable to instantiate 
> org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
>   at 
> org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1523)
>   at 
> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.(RetryingMetaStoreClient.java:86)
>   at 
> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:132)
>   at 
> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:104)
>   at 
> org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:3000)
>   at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:3019)
>   at 
> org.apache.hadoop.hive.ql.metadata.Hive.getAllDatabases(Hive.java:1234)
>   ... 3 more
> Caused by: java.lang.reflect.InvocationTargetException
>   at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
>   at 
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
>   at 
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>   at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
>   at 
> org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1521)
>   ... 9 more
> Caused by: javax.jdo.JDOFatalInternalException: Error creating transactional 
> connection factory
> NestedThrowables:
> java.lang.reflect.InvocationTargetException
>   at 
> org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:587)
>   at 
> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.freezeConfiguration(JDOPersistenceManagerFactory.java:788)
>   at 
> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.createPersistenceManagerFactory(JDOPersistenceManagerFactory.java:333)
>   at 
> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.getPersistenceManagerFactory(JDOPersistenceManagerFactory.java:202)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.lang.reflect.Method.invoke(Method.java:606)
>   at javax.jdo.JDOHelper$16.run(JDOHelper.java:1965)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.jdo.JDOHelper.invoke(JDOHelper.java:1960)
>   at 
> javax.jdo.JDOHelper.invokeGetPersistenceManagerFactoryOnImplementation(JDOHelper.java:1166)
>   at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:808)
>   at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:701)
>   at 
> org.apache.hadoop.hive.metastore.ObjectStore.getPMF(ObjectStore.java:365)
>   at 
> org.apache.hadoop.hive.metastore.ObjectStore.getPersistenceManager(ObjectStore.java:394)
>   at 
> org.apache.hadoop.hive.metastore.ObjectStore.initialize(ObjectStore.java:291)
>   at 
> org.apache.hadoop.hive.metastore.ObjectStore.setConf(ObjectStore.java:258)
>   at 
> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:76)
>   at 
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:136)
>   at 
> org.apache.hadoop.hive.metastore.RawStoreProxy.(RawStoreProxy.java:57)
>   at 
> org.apache.hadoop.hive.metastore.RawStoreProxy.getProxy(RawStoreProxy.java:66)
>   at 
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.newRawStore(HiveMetaStore.java:591)
>   at 
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:569)
>   at 
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:622)
>

[jira] [Issue Comment Deleted] (ATLAS-96) import-hive.sh failed

2015-08-10 Thread Jason Xing (JIRA) 

 [ 
https://issues.apache.org/jira/browse/ATLAS-96?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jason Xing updated ATLAS-96:

Comment: was deleted

(was: Thank you!)

> import-hive.sh failed
> -
>
> Key: ATLAS-96
> URL: https://issues.apache.org/jira/browse/ATLAS-96
> Project: Atlas
>  Issue Type: Bug
>Reporter: Jason Xing
>
> Exception in thread "main" org.apache.hadoop.hive.ql.metadata.HiveException: 
> java.lang.RuntimeException: Unable to instantiate 
> org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
>   at 
> org.apache.hadoop.hive.ql.metadata.Hive.getAllDatabases(Hive.java:1236)
>   at 
> org.apache.atlas.hive.bridge.HiveMetaStoreBridge.importDatabases(HiveMetaStoreBridge.java:94)
>   at 
> org.apache.atlas.hive.bridge.HiveMetaStoreBridge.importHiveMetadata(HiveMetaStoreBridge.java:90)
>   at 
> org.apache.atlas.hive.bridge.HiveMetaStoreBridge.main(HiveMetaStoreBridge.java:507)
> Caused by: java.lang.RuntimeException: Unable to instantiate 
> org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
>   at 
> org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1523)
>   at 
> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.(RetryingMetaStoreClient.java:86)
>   at 
> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:132)
>   at 
> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:104)
>   at 
> org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:3000)
>   at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:3019)
>   at 
> org.apache.hadoop.hive.ql.metadata.Hive.getAllDatabases(Hive.java:1234)
>   ... 3 more
> Caused by: java.lang.reflect.InvocationTargetException
>   at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
>   at 
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
>   at 
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>   at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
>   at 
> org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1521)
>   ... 9 more
> Caused by: javax.jdo.JDOFatalInternalException: Error creating transactional 
> connection factory
> NestedThrowables:
> java.lang.reflect.InvocationTargetException
>   at 
> org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:587)
>   at 
> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.freezeConfiguration(JDOPersistenceManagerFactory.java:788)
>   at 
> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.createPersistenceManagerFactory(JDOPersistenceManagerFactory.java:333)
>   at 
> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.getPersistenceManagerFactory(JDOPersistenceManagerFactory.java:202)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.lang.reflect.Method.invoke(Method.java:606)
>   at javax.jdo.JDOHelper$16.run(JDOHelper.java:1965)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.jdo.JDOHelper.invoke(JDOHelper.java:1960)
>   at 
> javax.jdo.JDOHelper.invokeGetPersistenceManagerFactoryOnImplementation(JDOHelper.java:1166)
>   at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:808)
>   at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:701)
>   at 
> org.apache.hadoop.hive.metastore.ObjectStore.getPMF(ObjectStore.java:365)
>   at 
> org.apache.hadoop.hive.metastore.ObjectStore.getPersistenceManager(ObjectStore.java:394)
>   at 
> org.apache.hadoop.hive.metastore.ObjectStore.initialize(ObjectStore.java:291)
>   at 
> org.apache.hadoop.hive.metastore.ObjectStore.setConf(ObjectStore.java:258)
>   at 
> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:76)
>   at 
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:136)
>   at 
> org.apache.hadoop.hive.metastore.RawStoreProxy.(RawStoreProxy.java:57)
>   at 
> org.apache.hadoop.hive.metastore.RawStoreProxy.getProxy(RawStoreProxy.java:66)
>   at 
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.newRawStore(HiveMetaStore.java:591)
>   at 
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:569)
>   at 
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:622)
>   at 
> org.apache.hadoop

[jira] [Commented] (ATLAS-96) import-hive.sh failed

2015-08-10 Thread Jason Xing (JIRA) 

[ 
https://issues.apache.org/jira/browse/ATLAS-96?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680073#comment-14680073
 ] 

Jason Xing commented on ATLAS-96:
-

Thank you!

> import-hive.sh failed
> -
>
> Key: ATLAS-96
> URL: https://issues.apache.org/jira/browse/ATLAS-96
> Project: Atlas
>  Issue Type: Bug
>Reporter: Jason Xing
>
> Exception in thread "main" org.apache.hadoop.hive.ql.metadata.HiveException: 
> java.lang.RuntimeException: Unable to instantiate 
> org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
>   at 
> org.apache.hadoop.hive.ql.metadata.Hive.getAllDatabases(Hive.java:1236)
>   at 
> org.apache.atlas.hive.bridge.HiveMetaStoreBridge.importDatabases(HiveMetaStoreBridge.java:94)
>   at 
> org.apache.atlas.hive.bridge.HiveMetaStoreBridge.importHiveMetadata(HiveMetaStoreBridge.java:90)
>   at 
> org.apache.atlas.hive.bridge.HiveMetaStoreBridge.main(HiveMetaStoreBridge.java:507)
> Caused by: java.lang.RuntimeException: Unable to instantiate 
> org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
>   at 
> org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1523)
>   at 
> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.(RetryingMetaStoreClient.java:86)
>   at 
> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:132)
>   at 
> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:104)
>   at 
> org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:3000)
>   at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:3019)
>   at 
> org.apache.hadoop.hive.ql.metadata.Hive.getAllDatabases(Hive.java:1234)
>   ... 3 more
> Caused by: java.lang.reflect.InvocationTargetException
>   at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
>   at 
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
>   at 
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>   at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
>   at 
> org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1521)
>   ... 9 more
> Caused by: javax.jdo.JDOFatalInternalException: Error creating transactional 
> connection factory
> NestedThrowables:
> java.lang.reflect.InvocationTargetException
>   at 
> org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:587)
>   at 
> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.freezeConfiguration(JDOPersistenceManagerFactory.java:788)
>   at 
> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.createPersistenceManagerFactory(JDOPersistenceManagerFactory.java:333)
>   at 
> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.getPersistenceManagerFactory(JDOPersistenceManagerFactory.java:202)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.lang.reflect.Method.invoke(Method.java:606)
>   at javax.jdo.JDOHelper$16.run(JDOHelper.java:1965)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.jdo.JDOHelper.invoke(JDOHelper.java:1960)
>   at 
> javax.jdo.JDOHelper.invokeGetPersistenceManagerFactoryOnImplementation(JDOHelper.java:1166)
>   at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:808)
>   at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:701)
>   at 
> org.apache.hadoop.hive.metastore.ObjectStore.getPMF(ObjectStore.java:365)
>   at 
> org.apache.hadoop.hive.metastore.ObjectStore.getPersistenceManager(ObjectStore.java:394)
>   at 
> org.apache.hadoop.hive.metastore.ObjectStore.initialize(ObjectStore.java:291)
>   at 
> org.apache.hadoop.hive.metastore.ObjectStore.setConf(ObjectStore.java:258)
>   at 
> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:76)
>   at 
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:136)
>   at 
> org.apache.hadoop.hive.metastore.RawStoreProxy.(RawStoreProxy.java:57)
>   at 
> org.apache.hadoop.hive.metastore.RawStoreProxy.getProxy(RawStoreProxy.java:66)
>   at 
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.newRawStore(HiveMetaStore.java:591)
>   at 
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:569)
>   at 
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:622)
>

[jira] [Updated] (ATLAS-91) Add solr configuration and documentation

2015-08-10 Thread Suma Shivaprasad (JIRA) 

 [ 
https://issues.apache.org/jira/browse/ATLAS-91?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suma Shivaprasad updated ATLAS-91:
--
Attachment: ATlAS-66.2.patch

> Add solr configuration and documentation
> 
>
> Key: ATLAS-91
> URL: https://issues.apache.org/jira/browse/ATLAS-91
> Project: Atlas
>  Issue Type: Task
>Reporter: Suma Shivaprasad
>Assignee: Suma Shivaprasad
> Attachments: ATlAS-66.1.patch, ATlAS-66.2.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ATLAS-96) import-hive.sh failed

2015-08-10 Thread Shwetha G S (JIRA) 

[ 
https://issues.apache.org/jira/browse/ATLAS-96?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679958#comment-14679958
 ] 

Shwetha G S commented on ATLAS-96:
--

Atlas has hive hook that can be added to hive CLI and hive server2. The hook 
captures all hive commands and registers the corresponding entities in atlas. 
import-hive.sh is added for one time use to import existing hive metadata at 
the time of hook set-up. Bridge-Hive.twiki contains the details of setting up 
atlas hive hook.

> import-hive.sh failed
> -
>
> Key: ATLAS-96
> URL: https://issues.apache.org/jira/browse/ATLAS-96
> Project: Atlas
>  Issue Type: Bug
>Reporter: Jason Xing
>
> Exception in thread "main" org.apache.hadoop.hive.ql.metadata.HiveException: 
> java.lang.RuntimeException: Unable to instantiate 
> org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
>   at 
> org.apache.hadoop.hive.ql.metadata.Hive.getAllDatabases(Hive.java:1236)
>   at 
> org.apache.atlas.hive.bridge.HiveMetaStoreBridge.importDatabases(HiveMetaStoreBridge.java:94)
>   at 
> org.apache.atlas.hive.bridge.HiveMetaStoreBridge.importHiveMetadata(HiveMetaStoreBridge.java:90)
>   at 
> org.apache.atlas.hive.bridge.HiveMetaStoreBridge.main(HiveMetaStoreBridge.java:507)
> Caused by: java.lang.RuntimeException: Unable to instantiate 
> org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient
>   at 
> org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1523)
>   at 
> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.(RetryingMetaStoreClient.java:86)
>   at 
> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:132)
>   at 
> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:104)
>   at 
> org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:3000)
>   at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:3019)
>   at 
> org.apache.hadoop.hive.ql.metadata.Hive.getAllDatabases(Hive.java:1234)
>   ... 3 more
> Caused by: java.lang.reflect.InvocationTargetException
>   at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
>   at 
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
>   at 
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>   at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
>   at 
> org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1521)
>   ... 9 more
> Caused by: javax.jdo.JDOFatalInternalException: Error creating transactional 
> connection factory
> NestedThrowables:
> java.lang.reflect.InvocationTargetException
>   at 
> org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:587)
>   at 
> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.freezeConfiguration(JDOPersistenceManagerFactory.java:788)
>   at 
> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.createPersistenceManagerFactory(JDOPersistenceManagerFactory.java:333)
>   at 
> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.getPersistenceManagerFactory(JDOPersistenceManagerFactory.java:202)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.lang.reflect.Method.invoke(Method.java:606)
>   at javax.jdo.JDOHelper$16.run(JDOHelper.java:1965)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.jdo.JDOHelper.invoke(JDOHelper.java:1960)
>   at 
> javax.jdo.JDOHelper.invokeGetPersistenceManagerFactoryOnImplementation(JDOHelper.java:1166)
>   at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:808)
>   at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:701)
>   at 
> org.apache.hadoop.hive.metastore.ObjectStore.getPMF(ObjectStore.java:365)
>   at 
> org.apache.hadoop.hive.metastore.ObjectStore.getPersistenceManager(ObjectStore.java:394)
>   at 
> org.apache.hadoop.hive.metastore.ObjectStore.initialize(ObjectStore.java:291)
>   at 
> org.apache.hadoop.hive.metastore.ObjectStore.setConf(ObjectStore.java:258)
>   at 
> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:76)
>   at 
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:136)
>   at 
> org.apache.hadoop.hive.metastore.RawStoreProxy.(RawStoreProxy.java:57)
>   at 
> org.apache.hadoop.hive.metastore.RawStoreProxy.getProxy(RawStoreProxy.java:66)
>

[jira] [Updated] (ATLAS-59) De-duping of entities

2015-08-10 Thread Shwetha G S (JIRA) 

 [ 
https://issues.apache.org/jira/browse/ATLAS-59?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shwetha G S updated ATLAS-59:
-
Attachment: ATLAS-59-v3.patch

> De-duping of entities
> -
>
> Key: ATLAS-59
> URL: https://issues.apache.org/jira/browse/ATLAS-59
> Project: Atlas
>  Issue Type: Sub-task
>Reporter: Shwetha G S
>Assignee: Shwetha G S
> Attachments: ATLAS-59-v2.patch, ATLAS-59-v3.patch
>
>
> With hive hook posting entities to be registered in message, we need a way of 
> de-duping the entities on some value on server. For example, for type 
> hive_db, the de-duping should be on clustername and dbname. The clients 
> should be able to specify what the de-duping criteria is



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (ATLAS-59) De-duping of entities

2015-08-10 Thread Shwetha G S (JIRA) 

 [ 
https://issues.apache.org/jira/browse/ATLAS-59?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shwetha G S updated ATLAS-59:
-
Attachment: (was: ATLAS-59-v2.patch)

> De-duping of entities
> -
>
> Key: ATLAS-59
> URL: https://issues.apache.org/jira/browse/ATLAS-59
> Project: Atlas
>  Issue Type: Sub-task
>Reporter: Shwetha G S
>Assignee: Shwetha G S
> Attachments: ATLAS-59-v3.patch
>
>
> With hive hook posting entities to be registered in message, we need a way of 
> de-duping the entities on some value on server. For example, for type 
> hive_db, the de-duping should be on clustername and dbname. The clients 
> should be able to specify what the de-duping criteria is



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (ATLAS-59) De-duping of entities

2015-08-10 Thread Shwetha G S (JIRA) 

 [ 
https://issues.apache.org/jira/browse/ATLAS-59?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shwetha G S updated ATLAS-59:
-
Attachment: ATLAS-59-v2.patch

Adds referenceable type as a super type which contains qualified name as unique 
required attribute. Any class type that requires de-duping should extend this 
new type. 
Also added new API that gets entity definition by unique attribute name

> De-duping of entities
> -
>
> Key: ATLAS-59
> URL: https://issues.apache.org/jira/browse/ATLAS-59
> Project: Atlas
>  Issue Type: Sub-task
>Reporter: Shwetha G S
>Assignee: Shwetha G S
> Attachments: ATLAS-59-v2.patch
>
>
> With hive hook posting entities to be registered in message, we need a way of 
> de-duping the entities on some value on server. For example, for type 
> hive_db, the de-duping should be on clustername and dbname. The clients 
> should be able to specify what the de-duping criteria is



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Resolved] (ATLAS-97) hive(1.2.0) hbase(1.1.1) integration issue with hadoop(2.7.0)

2015-08-10 Thread Suma Shivaprasad (JIRA) 

 [ 
https://issues.apache.org/jira/browse/ATLAS-97?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suma Shivaprasad resolved ATLAS-97.
---
Resolution: Invalid

Wrong jira queue. Should be files against hive

> hive(1.2.0) hbase(1.1.1) integration issue with hadoop(2.7.0)
> -
>
> Key: ATLAS-97
> URL: https://issues.apache.org/jira/browse/ATLAS-97
> Project: Atlas
>  Issue Type: Bug
>Reporter: Koushik Chandra
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (ATLAS-91) Add solr configuration and documentation

2015-08-10 Thread Suma Shivaprasad (JIRA) 

 [ 
https://issues.apache.org/jira/browse/ATLAS-91?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suma Shivaprasad updated ATLAS-91:
--
Attachment: ATlAS-66.1.patch

> Add solr configuration and documentation
> 
>
> Key: ATLAS-91
> URL: https://issues.apache.org/jira/browse/ATLAS-91
> Project: Atlas
>  Issue Type: Task
>Reporter: Suma Shivaprasad
>Assignee: Suma Shivaprasad
> Attachments: ATlAS-66.1.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (ATLAS-91) Add solr configuration and documentation

2015-08-10 Thread Suma Shivaprasad (JIRA) 

 [ 
https://issues.apache.org/jira/browse/ATLAS-91?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Suma Shivaprasad updated ATLAS-91:
--
Summary: Add solr configuration and documentation  (was: Add solr 
configuration and scripts)

> Add solr configuration and documentation
> 
>
> Key: ATLAS-91
> URL: https://issues.apache.org/jira/browse/ATLAS-91
> Project: Atlas
>  Issue Type: Task
>Reporter: Suma Shivaprasad
>Assignee: Suma Shivaprasad
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Review Request 37285: solr conf files and changes to make it work with upgraded titan

2015-08-10 Thread Suma Shivaprasad 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/37285/
---

Review request for atlas and Shwetha GS.


Repository: atlas


Description
---

changes for titan upgraded to solr 5


Diffs
-

  client/pom.xml d393b3a 
  pom.xml facd539 
  repository/pom.xml a2f8e08 
  src/conf/solr/atlasConfig/conf/currency.xml PRE-CREATION 
  src/conf/solr/atlasConfig/conf/lang/stopwords_en.txt PRE-CREATION 
  src/conf/solr/atlasConfig/conf/protwords.txt PRE-CREATION 
  src/conf/solr/atlasConfig/conf/schema.xml PRE-CREATION 
  src/conf/solr/atlasConfig/conf/solrconfig.xml PRE-CREATION 
  src/conf/solr/atlasConfig/conf/stopwords.txt PRE-CREATION 
  src/conf/solr/atlasConfig/conf/synonyms.txt PRE-CREATION 
  src/conf/solr/solr.xml PRE-CREATION 
  src/conf/solr/zoo.cfg PRE-CREATION 

Diff: https://reviews.apache.org/r/37285/diff/


Testing
---

All tests pass . No new tests added


Thanks,

Suma Shivaprasad