date:20161027

Review Request 53250: fix atlas after ten minutes i found it still alive.

2016-10-27 Thread Qiang Zhang


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/53250/
---

Review request for atlas.


Bugs: https://issues.apache.org/jira/browse/ATLAS-1248

https://issues.apache.org/jira/browse/https://issues.apache.org/jira/browse/ATLAS-1248


Repository: atlas


Description
---

fix  atlas  after ten minutes i found it still alive.


Diffs
-

  distro/src/bin/atlas_stop.py a72c724580aa294b4f0eebfc676464162cb301c6 

Diff: https://reviews.apache.org/r/53250/diff/


Testing
---

test success


Thanks,

Qiang Zhang

[jira] [Updated] (ATLAS-1248) execute ./bin/atlas_stop.py, After ten minuters process still alive

2016-10-27 Thread Qiang Zhang (JIRA)


 [ 
https://issues.apache.org/jira/browse/ATLAS-1248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Qiang Zhang updated ATLAS-1248:
---
Attachment: (was: atlas_stop.py)

> execute ./bin/atlas_stop.py,  After ten minuters process still alive
> 
>
> Key: ATLAS-1248
> URL: https://issues.apache.org/jira/browse/ATLAS-1248
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: 0.8-incubating
>Reporter: Qiang Zhang
>
> Hi All， 
>1. I executed ./bin/atlas_stop.py to stop atlas, but after ten minutes 
> i found it still alive.
>  
>2. By reviewing atlas_stop.py code , I found that we called  
> os.kill(pid, SIGTERM)  to kill the process, but it didn't work sometimes. 
>3. Then I referred to hadoop and hbase stop shell,  I found they both 
> Elegant kill process at first 
>4. Then check process whether still alive after sleeping some 
> seconds.(sleep(60))
>  
>5. If it was still alive, they compulsory kill process with 
> os.kill(pid, SIGKILL) . 
> Here is the log from console:  
> ---
> [glc@dap241 atlas-0.8]$ ./bin/atlas_stop.py 
> stopping atlas
> 
> [glc@dap241 atlas-0.8]$ jps
> 7296 jar
> 3017 ResourceManager
> 2613 NameNode
> 7573 Atlas
> 4089 HMaster
> 2806 SecondaryNameNode
> 3486 QuorumPeerMain
> 7043 jar
> 3392 JobHistoryServer
> 15957 Jps
> 
> [glc@dap241 atlas-0.8]$ ./bin/atlas_stop.py 
> No process ID file found. Server not running?
> -
> [glc@dap241 atlas-0.8]$ jps
> 7296 jar
> 3017 ResourceManager
> 2613 NameNode
> 7573 Atlas
> 4089 HMaster
> 2806 SecondaryNameNode
> 3486 QuorumPeerMain
> 7043 jar
> 3392 JobHistoryServer
> 15957 Jps
> 
> [glc@dap241 atlas-0.8]$ ps -ef |grep 7573
> glc   7573 1  2 Oct21 ?02:09:49 
> /home/glc/java/jdk1.7.80/bin/java 
> -Datlas.log.dir=/home/glc/atlas/atlas-0.8/logs 
> -Datlas.log.file=application.log -Datlas.home=/home/glc/atlas/atlas-0.8 
> -Datlas.conf=/home/glc/atlas/atlas-0.8/conf -Xms10240m -Xmx10240m 
> -XX:MaxNewSize=3072m -XX:PermSize=100M -XX:MaxPermSize=512m 
> -Dlog4j.configuration=atlas-log4j.xml -Djava.net.preferIPv4Stack=true -Xdebug 
> -Xrunjdwp:transport=dt_socket,address=10660,server=y,suspend=n -classpath 
> /home/glc/atlas/atlas-0.8/conf:/home/glc/atlas/atlas-0.8/server/webapp/atlas/WEB-INF/classes:/home/glc/atlas/atlas-0.8/server/webapp/atlas/WEB-INF/lib/*:/home/glc/atlas/atlas-0.8/libext/*:/home/glc/hbase/hbase-1.1.5/conf
>  org.apache.atlas.Atlas -app /home/glc/atlas/atlas-0.8/server/webapp/atlas
> glc  16003 15590  0 09:01 pts/100:00:00 grep 7573
> -
> [glc@dap241 atlas-0.8]$ ps -ef|grep atlas
> glc   7573 1  2 Oct21 ?02:09:49 
> /home/glc/java/jdk1.7.80/bin/java 
> -Datlas.log.dir=/home/glc/atlas/atlas-0.8/logs 
> -Datlas.log.file=application.log -Datlas.home=/home/glc/atlas/atlas-0.8 
> -Datlas.conf=/home/glc/atlas/atlas-0.8/conf -Xms10240m -Xmx10240m 
> -XX:MaxNewSize=3072m -XX:PermSize=100M -XX:MaxPermSize=512m 
> -Dlog4j.configuration=atlas-log4j.xml -Djava.net.preferIPv4Stack=true -Xdebug 
> -Xrunjdwp:transport=dt_socket,address=10660,server=y,suspend=n -classpath 
> /home/glc/atlas/atlas-0.8/conf:/home/glc/atlas/atlas-0.8/server/webapp/atlas/WEB-INF/classes:/home/glc/atlas/atlas-0.8/server/webapp/atlas/WEB-INF/lib/*:/home/glc/atlas/atlas-0.8/libext/*:/home/glc/hbase/hbase-1.1.5/conf
>  org.apache.atlas.Atlas -app /home/glc/atlas/atlas-0.8/server/webapp/atlas
> glc  16006 15590  0 09:01 pts/100:00:00 grep atlas



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Review Request 53207: Adding Change listeners to react on changes in TypesDef

2016-10-27 Thread Apoorv Naik


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/53207/#review154088
---




repository/src/main/java/org/apache/atlas/repository/graph/GraphBackedSearchIndexer.java
 (line 271)


Need to remove this comment. The implementation is complete and ready for 
validation/verification



repository/src/main/java/org/apache/atlas/repository/graph/GraphBackedSearchIndexer.java
 (line 281)


Need to move these into the constants class or see if there are existing 
ones.


- Apoorv Naik


On Oct. 28, 2016, 2:18 a.m., Apoorv Naik wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/53207/
> ---
> 
> (Updated Oct. 28, 2016, 2:18 a.m.)
> 
> 
> Review request for atlas, Madhan Neethiraj, Sarath Subramanian, Shwetha GS, 
> and Suma Shivaprasad.
> 
> 
> Bugs: ATLAS-1240
> https://issues.apache.org/jira/browse/ATLAS-1240
> 
> 
> Repository: atlas
> 
> 
> Description
> ---
> 
> Change listener implementation for legacy TypeSystem
> 
> 
> Diffs
> -
> 
>   intg/pom.xml 3ac19cf9f5310bd6f04ed5565291de2ec1ec7642 
>   intg/src/main/java/org/apache/atlas/AtlasErrorCode.java 
> ce68e6e4b21ac6e94ae7bfdc6578764c4bdaff6a 
>   intg/src/main/java/org/apache/atlas/exception/AtlasBaseException.java 
> d26ec0e01871b90c5daad4c3e7b0d7cb597e6263 
>   intg/src/main/java/org/apache/atlas/listener/ChangeOperation.java 
> PRE-CREATION 
>   intg/src/main/java/org/apache/atlas/listener/ChangedTypeDefs.java 
> PRE-CREATION 
>   intg/src/main/java/org/apache/atlas/listener/TypeDefChangeListener.java 
> PRE-CREATION 
>   intg/src/main/java/org/apache/atlas/type/AtlasType.java 
> a507bf4a1a92db6dca4cd569971f91fda9420279 
>   intg/src/main/java/org/apache/atlas/type/AtlasTypeUtil.java 
> 160f714047bfc626dc29e42694cf86f21ab250a8 
>   intg/src/test/java/org/apache/atlas/model/typedef/TestAtlasStructDef.java 
> b87b33e83c930df8b2e57b00f27f5d3b96e00ac0 
>   repository/src/main/java/org/apache/atlas/RepositoryMetadataModule.java 
> bbf75aec5b330929cbfd5bc24dfda5a3054aa910 
>   
> repository/src/main/java/org/apache/atlas/repository/graph/GraphBackedSearchIndexer.java
>  8038815383ebe1a613de7e314bdd5185dab8a629 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/AtlasTypeDefGraphStore.java
>  ebc7ab2ccd85f81993bf771542f97dd67af42c62 
>   
> repository/src/main/java/org/apache/atlas/repository/store/graph/v1/AtlasTypeDefGraphStoreV1.java
>  80feaf6c04a59ee410b18d6e5ac8121e7a419ebb 
>   
> repository/src/main/java/org/apache/atlas/services/DefaultMetadataService.java
>  5b4eb0e1ba305f3452911d74b8e4c49d5b315e97 
>   repository/src/test/java/org/apache/atlas/BaseRepositoryTest.java 
> 71a8756e6cf008ca846f41355eb315f2af74a29e 
>   repository/src/test/java/org/apache/atlas/TestUtils.java 
> 30071baaededfa954257fe2dcd74e53dac912c42 
>   
> repository/src/test/java/org/apache/atlas/discovery/GraphBackedDiscoveryServiceTest.java
>  13b7d22e4ea0f0c75db300e07d6e4613a5e00e8f 
>   
> repository/src/test/java/org/apache/atlas/repository/graph/GraphBackedMetadataRepositoryDeleteTestBase.java
>  6de995bc5ccf104b584fd4fce78e26b7a6432d5e 
>   
> repository/src/test/java/org/apache/atlas/repository/graph/GraphBackedMetadataRepositoryTest.java
>  7a57518a66e971df7ac722c82558101c6da73815 
>   
> repository/src/test/java/org/apache/atlas/repository/graph/GraphBackedSearchIndexerMockTest.java
>  398ea628f3ba6543163a8fd216a32ed3a2f91424 
>   
> repository/src/test/java/org/apache/atlas/repository/graph/GraphHelperTest.java
>  fe15014b3e676012eb9f92bba8b0aa78098e79fa 
>   
> repository/src/test/java/org/apache/atlas/repository/graph/GraphRepoMapperScaleTest.java
>  49ef5516cb6bb75da8ef13d3eda0c175194f4d28 
>   
> repository/src/test/java/org/apache/atlas/service/DefaultMetadataServiceTest.java
>  96cefe224f651d5e72d05abe210d2160b13e8d69 
>   repository/src/test/scala/org/apache/atlas/query/QueryTestsUtils.scala 
> 33275d3099b0fc4047dd7ca7ddee9bf285199f09 
>   typesystem/pom.xml c564442d2b34dba818b3a2230b340cf1b8cc34db 
>   typesystem/src/main/java/org/apache/atlas/typesystem/types/TypeSystem.java 
> 52637e6f904cbae6122e46a1728237aefb3799d9 
>   webapp/src/main/java/org/apache/atlas/web/rest/TypesREST.java 
> a2cfc6221af2c2509b2e57a3bd955a5d54410ff1 
>   
> webapp/src/main/java/org/apache/atlas/web/service/ActiveInstanceElectorModule.java
>  ee6035da62005accea354117423e5f249e39930b 
> 
> Diff: https://reviews.apache.org/r/53207/diff/
> 
> 
> Testing
> ---
> 
> 1. UnitTests passing with the new onChange call
> 2. Tested via curl/postman, changes are reflected immediately
> 
> 
> Thanks,
> 
> Apoorv Naik
> 
>

Re: Review Request 53207: Adding Change listeners to react on changes in TypesDef

2016-10-27 Thread Apoorv Naik


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/53207/
---

(Updated Oct. 28, 2016, 2:18 a.m.)


Review request for atlas, Madhan Neethiraj, Sarath Subramanian, Shwetha GS, and 
Suma Shivaprasad.


Changes
---

Removed DSL commit changes


Bugs: ATLAS-1240
https://issues.apache.org/jira/browse/ATLAS-1240


Repository: atlas


Description
---

Change listener implementation for legacy TypeSystem


Diffs (updated)
-

  intg/pom.xml 3ac19cf9f5310bd6f04ed5565291de2ec1ec7642 
  intg/src/main/java/org/apache/atlas/AtlasErrorCode.java 
ce68e6e4b21ac6e94ae7bfdc6578764c4bdaff6a 
  intg/src/main/java/org/apache/atlas/exception/AtlasBaseException.java 
d26ec0e01871b90c5daad4c3e7b0d7cb597e6263 
  intg/src/main/java/org/apache/atlas/listener/ChangeOperation.java 
PRE-CREATION 
  intg/src/main/java/org/apache/atlas/listener/ChangedTypeDefs.java 
PRE-CREATION 
  intg/src/main/java/org/apache/atlas/listener/TypeDefChangeListener.java 
PRE-CREATION 
  intg/src/main/java/org/apache/atlas/type/AtlasType.java 
a507bf4a1a92db6dca4cd569971f91fda9420279 
  intg/src/main/java/org/apache/atlas/type/AtlasTypeUtil.java 
160f714047bfc626dc29e42694cf86f21ab250a8 
  intg/src/test/java/org/apache/atlas/model/typedef/TestAtlasStructDef.java 
b87b33e83c930df8b2e57b00f27f5d3b96e00ac0 
  repository/src/main/java/org/apache/atlas/RepositoryMetadataModule.java 
bbf75aec5b330929cbfd5bc24dfda5a3054aa910 
  
repository/src/main/java/org/apache/atlas/repository/graph/GraphBackedSearchIndexer.java
 8038815383ebe1a613de7e314bdd5185dab8a629 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/AtlasTypeDefGraphStore.java
 ebc7ab2ccd85f81993bf771542f97dd67af42c62 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v1/AtlasTypeDefGraphStoreV1.java
 80feaf6c04a59ee410b18d6e5ac8121e7a419ebb 
  
repository/src/main/java/org/apache/atlas/services/DefaultMetadataService.java 
5b4eb0e1ba305f3452911d74b8e4c49d5b315e97 
  repository/src/test/java/org/apache/atlas/BaseRepositoryTest.java 
71a8756e6cf008ca846f41355eb315f2af74a29e 
  repository/src/test/java/org/apache/atlas/TestUtils.java 
30071baaededfa954257fe2dcd74e53dac912c42 
  
repository/src/test/java/org/apache/atlas/discovery/GraphBackedDiscoveryServiceTest.java
 13b7d22e4ea0f0c75db300e07d6e4613a5e00e8f 
  
repository/src/test/java/org/apache/atlas/repository/graph/GraphBackedMetadataRepositoryDeleteTestBase.java
 6de995bc5ccf104b584fd4fce78e26b7a6432d5e 
  
repository/src/test/java/org/apache/atlas/repository/graph/GraphBackedMetadataRepositoryTest.java
 7a57518a66e971df7ac722c82558101c6da73815 
  
repository/src/test/java/org/apache/atlas/repository/graph/GraphBackedSearchIndexerMockTest.java
 398ea628f3ba6543163a8fd216a32ed3a2f91424 
  
repository/src/test/java/org/apache/atlas/repository/graph/GraphHelperTest.java 
fe15014b3e676012eb9f92bba8b0aa78098e79fa 
  
repository/src/test/java/org/apache/atlas/repository/graph/GraphRepoMapperScaleTest.java
 49ef5516cb6bb75da8ef13d3eda0c175194f4d28 
  
repository/src/test/java/org/apache/atlas/service/DefaultMetadataServiceTest.java
 96cefe224f651d5e72d05abe210d2160b13e8d69 
  repository/src/test/scala/org/apache/atlas/query/QueryTestsUtils.scala 
33275d3099b0fc4047dd7ca7ddee9bf285199f09 
  typesystem/pom.xml c564442d2b34dba818b3a2230b340cf1b8cc34db 
  typesystem/src/main/java/org/apache/atlas/typesystem/types/TypeSystem.java 
52637e6f904cbae6122e46a1728237aefb3799d9 
  webapp/src/main/java/org/apache/atlas/web/rest/TypesREST.java 
a2cfc6221af2c2509b2e57a3bd955a5d54410ff1 
  
webapp/src/main/java/org/apache/atlas/web/service/ActiveInstanceElectorModule.java
 ee6035da62005accea354117423e5f249e39930b 

Diff: https://reviews.apache.org/r/53207/diff/


Testing
---

1. UnitTests passing with the new onChange call
2. Tested via curl/postman, changes are reflected immediately


Thanks,

Apoorv Naik

Re: Review Request 53207: Adding Change listeners to react on changes in TypesDef

2016-10-27 Thread Apoorv Naik


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/53207/
---

(Updated Oct. 28, 2016, 2:13 a.m.)


Review request for atlas, Madhan Neethiraj, Sarath Subramanian, Shwetha GS, and 
Suma Shivaprasad.


Changes
---

Completed indexer code with UT fixes


Bugs: ATLAS-1240
https://issues.apache.org/jira/browse/ATLAS-1240


Repository: atlas


Description (updated)
---

Change listener implementation for legacy TypeSystem


Diffs (updated)
-

  common/src/main/java/org/apache/atlas/groovy/AbstractGroovyExpression.java 
PRE-CREATION 
  common/src/main/java/org/apache/atlas/groovy/ArithmeticExpression.java 
PRE-CREATION 
  common/src/main/java/org/apache/atlas/groovy/BinaryExpression.java 
PRE-CREATION 
  common/src/main/java/org/apache/atlas/groovy/CastExpression.java PRE-CREATION 
  common/src/main/java/org/apache/atlas/groovy/ClosureExpression.java 
PRE-CREATION 
  common/src/main/java/org/apache/atlas/groovy/CodeBlockExpression.java 
PRE-CREATION 
  common/src/main/java/org/apache/atlas/groovy/ComparisonExpression.java 
PRE-CREATION 
  
common/src/main/java/org/apache/atlas/groovy/ComparisonOperatorExpression.java 
PRE-CREATION 
  common/src/main/java/org/apache/atlas/groovy/FieldExpression.java 
PRE-CREATION 
  common/src/main/java/org/apache/atlas/groovy/FunctionCallExpression.java 
PRE-CREATION 
  common/src/main/java/org/apache/atlas/groovy/GroovyExpression.java 
PRE-CREATION 
  common/src/main/java/org/apache/atlas/groovy/GroovyGenerationContext.java 
PRE-CREATION 
  common/src/main/java/org/apache/atlas/groovy/IdentifierExpression.java 
PRE-CREATION 
  common/src/main/java/org/apache/atlas/groovy/ListExpression.java PRE-CREATION 
  common/src/main/java/org/apache/atlas/groovy/LiteralExpression.java 
PRE-CREATION 
  common/src/main/java/org/apache/atlas/groovy/LogicalExpression.java 
PRE-CREATION 
  common/src/main/java/org/apache/atlas/groovy/RangeExpression.java 
PRE-CREATION 
  common/src/main/java/org/apache/atlas/groovy/TernaryOperatorExpression.java 
PRE-CREATION 
  common/src/main/java/org/apache/atlas/groovy/TypeCoersionExpression.java 
PRE-CREATION 
  
common/src/main/java/org/apache/atlas/groovy/VariableAssignmentExpression.java 
PRE-CREATION 
  graphdb/api/src/main/java/org/apache/atlas/repository/graphdb/AtlasGraph.java 
22280d500af1954abd1587ccbf66b85b601ba737 
  
graphdb/titan0/src/main/java/org/apache/atlas/repository/graphdb/titan0/Titan0Graph.java
 b5407888cc078c1133904ef8ddd5e88ef3f1d789 
  intg/pom.xml 3ac19cf9f5310bd6f04ed5565291de2ec1ec7642 
  intg/src/main/java/org/apache/atlas/AtlasErrorCode.java 
ce68e6e4b21ac6e94ae7bfdc6578764c4bdaff6a 
  intg/src/main/java/org/apache/atlas/exception/AtlasBaseException.java 
d26ec0e01871b90c5daad4c3e7b0d7cb597e6263 
  intg/src/main/java/org/apache/atlas/listener/ChangeOperation.java 
PRE-CREATION 
  intg/src/main/java/org/apache/atlas/listener/ChangedTypeDefs.java 
PRE-CREATION 
  intg/src/main/java/org/apache/atlas/listener/TypeDefChangeListener.java 
PRE-CREATION 
  intg/src/main/java/org/apache/atlas/type/AtlasType.java 
a507bf4a1a92db6dca4cd569971f91fda9420279 
  intg/src/main/java/org/apache/atlas/type/AtlasTypeUtil.java 
160f714047bfc626dc29e42694cf86f21ab250a8 
  intg/src/test/java/org/apache/atlas/model/typedef/TestAtlasStructDef.java 
b87b33e83c930df8b2e57b00f27f5d3b96e00ac0 
  release-log.txt 76c6a775bb0f6a4c16a1498bfbe7f833aad62e8e 
  repository/src/main/java/org/apache/atlas/RepositoryMetadataModule.java 
bbf75aec5b330929cbfd5bc24dfda5a3054aa910 
  
repository/src/main/java/org/apache/atlas/discovery/graph/DefaultGraphPersistenceStrategy.java
 1133b489f1927bfbc8b3adcbd8d975f00a625d53 
  
repository/src/main/java/org/apache/atlas/gremlin/Gremlin2ExpressionFactory.java
 PRE-CREATION 
  
repository/src/main/java/org/apache/atlas/gremlin/Gremlin3ExpressionFactory.java
 PRE-CREATION 
  
repository/src/main/java/org/apache/atlas/gremlin/GremlinExpressionFactory.java 
PRE-CREATION 
  
repository/src/main/java/org/apache/atlas/repository/graph/GraphBackedSearchIndexer.java
 8038815383ebe1a613de7e314bdd5185dab8a629 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/AtlasTypeDefGraphStore.java
 ebc7ab2ccd85f81993bf771542f97dd67af42c62 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v1/AtlasTypeDefGraphStoreV1.java
 80feaf6c04a59ee410b18d6e5ac8121e7a419ebb 
  
repository/src/main/java/org/apache/atlas/services/DefaultMetadataService.java 
5b4eb0e1ba305f3452911d74b8e4c49d5b315e97 
  
repository/src/main/scala/org/apache/atlas/query/GraphPersistenceStrategies.scala
 3ccc53f8f1d3c9b45e93e02c815652df1def4548 
  repository/src/main/scala/org/apache/atlas/query/GremlinQuery.scala 
447622b29e7bfd2a9bb1322fc0322b1eabac2ea8 
  repository/src/test/java/org/apache/atlas/BaseRepositoryTest.java 
71a8756e6cf008ca846f41355eb315f2af74a29e

Build failed in Jenkins: apache-atlas-nightly #453

2016-10-27 Thread Apache Jenkins Server

See 

Changes:

[dkantor] ATLAS-1195 Clean up DSL Translation (jnhagelb via dkantor)

--
[...truncated 9516 lines...]
127.0.0.1 - - [27/Oct/2016:20:45:25 +] "GET 
/api/atlas/entities?type=hive_table=qualifiedName=default.tablecgn8wtil9m@primary
 HTTP/1.1" 404 - "-" "Java/1.7.0_80"
127.0.0.1 - - [27/Oct/2016:20:45:25 +] "GET 
/api/atlas/entities?type=hive_table=qualifiedName=default.tablecgn8wtil9m@primary
 HTTP/1.1" 404 - "-" "Java/1.7.0_80"
127.0.0.1 - - [27/Oct/2016:20:45:30 +] "GET 
/api/atlas/entities?type=hive_table=qualifiedName=default.tablecgn8wtil9m@primary
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [27/Oct/2016:20:45:30 +] "GET 
/api/atlas/entities?type=hive_table=qualifiedName=default.tablecgn8wtil9m@primary
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [27/Oct/2016:20:45:30 +] "GET 
/api/atlas/entities?type=hive_column=qualifiedName=default.tablecgn8wtil9m.id_new@primary
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [27/Oct/2016:20:45:30 +] "GET 
/api/atlas/entities?type=hive_column=qualifiedName=default.tablecgn8wtil9m.id_new@primary
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [27/Oct/2016:20:45:30 +] "GET 
/api/atlas/entities?type=hive_table=qualifiedName=default.tableya53nzyxhq@primary
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [27/Oct/2016:20:45:30 +] "GET 
/api/atlas/entities?type=hive_table=qualifiedName=default.tableya53nzyxhq@primary
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [27/Oct/2016:20:45:30 +] "GET 
/api/atlas/entities?type=hive_process=qualifiedName=default.tablepddle3ff49@primary:147760113
 HTTP/1.1" 404 - "-" "Java/1.7.0_80"
127.0.0.1 - - [27/Oct/2016:20:45:35 +] "GET 
/api/atlas/entities?type=hive_process=qualifiedName=default.tablepddle3ff49@primary:147760113
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [27/Oct/2016:20:45:35 +] "GET 
/api/atlas/entities?type=hive_process=qualifiedName=default.tablepddle3ff49@primary:147760113
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [27/Oct/2016:20:45:35 +] "GET 
/api/atlas/entities?type=hive_table=qualifiedName=default.tablepddle3ff49@primary
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [27/Oct/2016:20:45:35 +] "GET 
/api/atlas/entities?type=hive_table=qualifiedName=default.tablepddle3ff49@primary
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [27/Oct/2016:20:45:35 +] "GET 
/api/atlas/lineage/hive/table/default.tablepddle3ff49@primary/inputs/graph 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [27/Oct/2016:20:45:39 +] "GET 
/api/atlas/entities?type=hive_process=qualifiedName=default.tablepddle3ff49@primary:147760113
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [27/Oct/2016:20:45:44 +] "GET 
/api/atlas/entities?type=hive_process=qualifiedName=default.tablepddle3ff49@primary:147760113
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [27/Oct/2016:20:45:44 +] "GET 
/api/atlas/entities?type=hive_process=qualifiedName=default.tablepddle3ff49@primary:147760113
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [27/Oct/2016:20:45:44 +] "GET 
/api/atlas/entities?type=hive_table=qualifiedName=default.tablecangdhoamj@primary
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [27/Oct/2016:20:45:44 +] "GET 
/api/atlas/entities?type=hive_table=qualifiedName=default.tablecangdhoamj@primary
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [27/Oct/2016:20:45:44 +] "GET 
/api/atlas/entities?type=hive_table=qualifiedName=default.tablepddle3ff49@primary
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [27/Oct/2016:20:45:44 +] "GET 
/api/atlas/entities?type=hive_table=qualifiedName=default.tablepddle3ff49@primary
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [27/Oct/2016:20:45:44 +] "GET 
/api/atlas/lineage/hive/table/default.tablepddle3ff49@primary/inputs/graph 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [27/Oct/2016:20:45:46 +] "GET 
/api/atlas/lineage/hive/table/default.tablepddle3ff49@primary/outputs/graph 
HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [27/Oct/2016:20:45:49 +] "GET 
/api/atlas/entities?type=hive_table=qualifiedName=default.tableewzoar0ner@primary
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [27/Oct/2016:20:45:49 +] "GET 
/api/atlas/entities?type=hive_table=qualifiedName=default.tableewzoar0ner@primary
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [27/Oct/2016:20:45:50 +] "GET 
/api/atlas/entities?type=hive_table=qualifiedName=default.tableewzoar0ner@primary
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [27/Oct/2016:20:45:50 +] "GET 
/api/atlas/entities?type=hive_table=qualifiedName=default.tableewzoar0ner@primary
 HTTP/1.1" 200 - "-" "Java/1.7.0_80"
127.0.0.1 - - [27/Oct/2016:20:45:51 +] "GET 
/api/atlas/entities?type=hive_table=qualifiedName=default.tableewzoar0ner@primary
 HTTP/1.1" 200 -

Re: Review Request 53207: Adding Change listeners to react on changes in TypesDef

2016-10-27 Thread Apoorv Naik


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/53207/
---

(Updated Oct. 27, 2016, 7:35 p.m.)


Review request for atlas, Madhan Neethiraj, Sarath Subramanian, Shwetha GS, and 
Suma Shivaprasad.


Changes
---

Removed Indexing support. Currently only LOG messages will show up when 
onChange is invoked


Bugs: ATLAS-1240
https://issues.apache.org/jira/browse/ATLAS-1240


Repository: atlas


Description
---

Change listener implementation for legacy TypeSystem

TODO: Complete Graph indexer code


Diffs (updated)
-

  intg/pom.xml 3ac19cf9f5310bd6f04ed5565291de2ec1ec7642 
  intg/src/main/java/org/apache/atlas/AtlasErrorCode.java 
ce68e6e4b21ac6e94ae7bfdc6578764c4bdaff6a 
  intg/src/main/java/org/apache/atlas/exception/AtlasBaseException.java 
d26ec0e01871b90c5daad4c3e7b0d7cb597e6263 
  intg/src/main/java/org/apache/atlas/listener/ChangeOperation.java 
PRE-CREATION 
  intg/src/main/java/org/apache/atlas/listener/ChangedTypeDefs.java 
PRE-CREATION 
  intg/src/main/java/org/apache/atlas/listener/TypeDefChangeListener.java 
PRE-CREATION 
  intg/src/main/java/org/apache/atlas/type/AtlasType.java 
a507bf4a1a92db6dca4cd569971f91fda9420279 
  intg/src/main/java/org/apache/atlas/type/AtlasTypeUtil.java 
160f714047bfc626dc29e42694cf86f21ab250a8 
  repository/src/main/java/org/apache/atlas/RepositoryMetadataModule.java 
bbf75aec5b330929cbfd5bc24dfda5a3054aa910 
  
repository/src/main/java/org/apache/atlas/repository/graph/GraphBackedSearchIndexer.java
 8038815383ebe1a613de7e314bdd5185dab8a629 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/AtlasTypeDefGraphStore.java
 ebc7ab2ccd85f81993bf771542f97dd67af42c62 
  
repository/src/main/java/org/apache/atlas/repository/store/graph/v1/AtlasTypeDefGraphStoreV1.java
 80feaf6c04a59ee410b18d6e5ac8121e7a419ebb 
  
repository/src/main/java/org/apache/atlas/services/DefaultMetadataService.java 
5b4eb0e1ba305f3452911d74b8e4c49d5b315e97 
  
repository/src/test/java/org/apache/atlas/service/DefaultMetadataServiceTest.java
 96cefe224f651d5e72d05abe210d2160b13e8d69 
  typesystem/pom.xml c564442d2b34dba818b3a2230b340cf1b8cc34db 
  typesystem/src/main/java/org/apache/atlas/typesystem/types/TypeSystem.java 
52637e6f904cbae6122e46a1728237aefb3799d9 
  webapp/src/main/java/org/apache/atlas/web/rest/TypesREST.java 
a2cfc6221af2c2509b2e57a3bd955a5d54410ff1 
  
webapp/src/main/java/org/apache/atlas/web/service/ActiveInstanceElectorModule.java
 ee6035da62005accea354117423e5f249e39930b 

Diff: https://reviews.apache.org/r/53207/diff/


Testing
---

1. UnitTests passing with the new onChange call
2. Tested via curl/postman, changes are reflected immediately


Thanks,

Apoorv Naik

[jira] [Comment Edited] (ATLAS-1195) Clean up DSL Translation

2016-10-27 Thread David Kantor (JIRA)


[ 
https://issues.apache.org/jira/browse/ATLAS-1195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15612808#comment-15612808
 ] 

David Kantor edited comment on ATLAS-1195 at 10/27/16 7:00 PM:
---

+1
Review approved by [~suma.shivaprasad]
Committed to trunk - thanks [~jnhagelb]


was (Author: dkantor):
Committed to trunk - thanks [~jnhagelb]

> Clean up DSL Translation
> 
>
> Key: ATLAS-1195
> URL: https://issues.apache.org/jira/browse/ATLAS-1195
> Project: Atlas
>  Issue Type: Sub-task
>Reporter: Jeffrey Hagelberg
>Assignee: Jeffrey Hagelberg
> Fix For: 0.8-incubating
>
> Attachments: rb53133.patch
>
>
> Right now, the DSL translation logic is full if statements like if(TP2) then 
> do this otherwise do that.  This needs to be cleaned up.  We need classes 
> that represent each gremlin construct and subclasses for TP2 / TP3 when 
> appropriate.  We should first look and see if the existing Expression classes 
> can be leveraged for this.  We should also try to make this general enough so 
> that whatever logic we put in place can also be leveraged by the catalog 
> project to generate TP2/TP3 gremlin.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Resolved] (ATLAS-1249) execution_timeout does not cause task to fail

2016-10-27 Thread Adam Gutcheon (JIRA)


 [ 
https://issues.apache.org/jira/browse/ATLAS-1249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Gutcheon resolved ATLAS-1249.
--
Resolution: Invalid

> execution_timeout does not cause task to fail
> -
>
> Key: ATLAS-1249
> URL: https://issues.apache.org/jira/browse/ATLAS-1249
> Project: Atlas
>  Issue Type: Bug
>Reporter: Adam Gutcheon
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (ATLAS-1249) execution_timeout does not cause task to fail

2016-10-27 Thread Adam Gutcheon (JIRA)

Adam Gutcheon created ATLAS-1249:


 Summary: execution_timeout does not cause task to fail
 Key: ATLAS-1249
 URL: https://issues.apache.org/jira/browse/ATLAS-1249
 Project: Atlas
  Issue Type: Bug
Reporter: Adam Gutcheon






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ATLAS-1247) Support for hive 2.x

2016-10-27 Thread Qiang Zhang (JIRA)


[ 
https://issues.apache.org/jira/browse/ATLAS-1247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15611240#comment-15611240
 ] 

Qiang Zhang commented on ATLAS-1247:


OK  I have done as you say， 
Hive storage type can be add as one property ？
  such as 
1)TEXTFILE  2)SEQUENCEFILE 
 3)RCFILE 4)ORCFILE
 should it  display in  foreground  web page ？

 https://issues.apache.org/jira/browse/ATLAS-1243

> Support for hive 2.x
> 
>
> Key: ATLAS-1247
> URL: https://issues.apache.org/jira/browse/ATLAS-1247
> Project: Atlas
>  Issue Type: Improvement
>Reporter: Shwetha G S
>Assignee: Vimal Sharma
> Attachments: hive2_atlas.patch
>
>
> Atlas hive hook works only with hive 1.x. Need support for hive 2.x



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (ATLAS-1243) Hive storage type can be add as one property

2016-10-27 Thread Qiang Zhang (JIRA)


 [ 
https://issues.apache.org/jira/browse/ATLAS-1243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Qiang Zhang updated ATLAS-1243:
---
Description: 
Hi, all.

 HIve data can be stored as follows in hive warehouse:
1)TEXTFILE 
2)SEQUENCEFILE 
3)RCFILE
4)ORCFILE 
5)user-defined inputformat & outputformat

e.g. 
 create external table IF NOT EXISTS http_orc(p_id INT ) stored as orc;

However, atlas only supports user-defined inputformat & outputformat.

Should we need to add hive Storage type as one property in 
HiveDataModelGenerator.java ?

e.g.
 public static final String STORAGE_TYPE = "storageType";

  was:
Hi, all.

Data can be stored as follows in hive warehouse:
1)TEXTFILE 
2)SEQUENCEFILE 
3)RCFILE
4)ORCFILE 
5)user-defined inputformat & outputformat

e.g. 
 create external table IF NOT EXISTS http_orc(p_id INT ) stored as orc;

However, atlas only supports user-defined inputformat & outputformat.

Should we need to add hive Storage type as one property in 
HiveDataModelGenerator.java ?

e.g.
 public static final String STORAGE_TYPE = "storageType";


> Hive storage type can be add as one property 
> -
>
> Key: ATLAS-1243
> URL: https://issues.apache.org/jira/browse/ATLAS-1243
> Project: Atlas
>  Issue Type: Improvement
>Affects Versions: 0.8-incubating
>Reporter: Qiang Zhang
>Priority: Critical
>
> Hi, all.
>  HIve data can be stored as follows in hive warehouse:
> 1)TEXTFILE 
> 2)SEQUENCEFILE 
> 3)RCFILE
> 4)ORCFILE 
> 5)user-defined inputformat & outputformat
> e.g. 
>  create external table IF NOT EXISTS http_orc(p_id INT ) stored as orc;
> However, atlas only supports user-defined inputformat & outputformat.
> Should we need to add hive Storage type as one property in 
> HiveDataModelGenerator.java ?
> e.g.
>  public static final String STORAGE_TYPE = "storageType";



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (ATLAS-1248) execute ./bin/atlas_stop.py, After ten minuters process still alive

2016-10-27 Thread Qiang Zhang (JIRA)


 [ 
https://issues.apache.org/jira/browse/ATLAS-1248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Qiang Zhang updated ATLAS-1248:
---
Attachment: atlas_stop.py

here is the patch  for atlas_stop.py

> execute ./bin/atlas_stop.py,  After ten minuters process still alive
> 
>
> Key: ATLAS-1248
> URL: https://issues.apache.org/jira/browse/ATLAS-1248
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: 0.8-incubating
>Reporter: Qiang Zhang
> Attachments: atlas_stop.py
>
>
> Hi All， 
>1. I executed ./bin/atlas_stop.py to stop atlas, but after ten minutes 
> i found it still alive.
>  
>2. By reviewing atlas_stop.py code , I found that we called  
> os.kill(pid, SIGTERM)  to kill the process, but it didn't work sometimes. 
>3. Then I referred to hadoop and hbase stop shell,  I found they both 
> Elegant kill process at first 
>4. Then check process whether still alive after sleeping some 
> seconds.(sleep(60))
>  
>5. If it was still alive, they compulsory kill process with 
> os.kill(pid, SIGKILL) . 
> Here is the log from console:  
> ---
> [glc@dap241 atlas-0.8]$ ./bin/atlas_stop.py 
> stopping atlas
> 
> [glc@dap241 atlas-0.8]$ jps
> 7296 jar
> 3017 ResourceManager
> 2613 NameNode
> 7573 Atlas
> 4089 HMaster
> 2806 SecondaryNameNode
> 3486 QuorumPeerMain
> 7043 jar
> 3392 JobHistoryServer
> 15957 Jps
> 
> [glc@dap241 atlas-0.8]$ ./bin/atlas_stop.py 
> No process ID file found. Server not running?
> -
> [glc@dap241 atlas-0.8]$ jps
> 7296 jar
> 3017 ResourceManager
> 2613 NameNode
> 7573 Atlas
> 4089 HMaster
> 2806 SecondaryNameNode
> 3486 QuorumPeerMain
> 7043 jar
> 3392 JobHistoryServer
> 15957 Jps
> 
> [glc@dap241 atlas-0.8]$ ps -ef |grep 7573
> glc   7573 1  2 Oct21 ?02:09:49 
> /home/glc/java/jdk1.7.80/bin/java 
> -Datlas.log.dir=/home/glc/atlas/atlas-0.8/logs 
> -Datlas.log.file=application.log -Datlas.home=/home/glc/atlas/atlas-0.8 
> -Datlas.conf=/home/glc/atlas/atlas-0.8/conf -Xms10240m -Xmx10240m 
> -XX:MaxNewSize=3072m -XX:PermSize=100M -XX:MaxPermSize=512m 
> -Dlog4j.configuration=atlas-log4j.xml -Djava.net.preferIPv4Stack=true -Xdebug 
> -Xrunjdwp:transport=dt_socket,address=10660,server=y,suspend=n -classpath 
> /home/glc/atlas/atlas-0.8/conf:/home/glc/atlas/atlas-0.8/server/webapp/atlas/WEB-INF/classes:/home/glc/atlas/atlas-0.8/server/webapp/atlas/WEB-INF/lib/*:/home/glc/atlas/atlas-0.8/libext/*:/home/glc/hbase/hbase-1.1.5/conf
>  org.apache.atlas.Atlas -app /home/glc/atlas/atlas-0.8/server/webapp/atlas
> glc  16003 15590  0 09:01 pts/100:00:00 grep 7573
> -
> [glc@dap241 atlas-0.8]$ ps -ef|grep atlas
> glc   7573 1  2 Oct21 ?02:09:49 
> /home/glc/java/jdk1.7.80/bin/java 
> -Datlas.log.dir=/home/glc/atlas/atlas-0.8/logs 
> -Datlas.log.file=application.log -Datlas.home=/home/glc/atlas/atlas-0.8 
> -Datlas.conf=/home/glc/atlas/atlas-0.8/conf -Xms10240m -Xmx10240m 
> -XX:MaxNewSize=3072m -XX:PermSize=100M -XX:MaxPermSize=512m 
> -Dlog4j.configuration=atlas-log4j.xml -Djava.net.preferIPv4Stack=true -Xdebug 
> -Xrunjdwp:transport=dt_socket,address=10660,server=y,suspend=n -classpath 
> /home/glc/atlas/atlas-0.8/conf:/home/glc/atlas/atlas-0.8/server/webapp/atlas/WEB-INF/classes:/home/glc/atlas/atlas-0.8/server/webapp/atlas/WEB-INF/lib/*:/home/glc/atlas/atlas-0.8/libext/*:/home/glc/hbase/hbase-1.1.5/conf
>  org.apache.atlas.Atlas -app /home/glc/atlas/atlas-0.8/server/webapp/atlas
> glc  16006 15590  0 09:01 pts/100:00:00 grep atlas



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (ATLAS-1248) execute ./bin/atlas_stop.py, After ten minuters process still alive

2016-10-27 Thread Qiang Zhang (JIRA)


 [ 
https://issues.apache.org/jira/browse/ATLAS-1248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Qiang Zhang updated ATLAS-1248:
---
Description: 
Hi All， 
   1. I executed ./bin/atlas_stop.py to stop atlas, but after ten minutes i 
found it still alive.
 
   2. By reviewing atlas_stop.py code , I found that we called  
os.kill(pid, SIGTERM)  to kill the process, but it didn't work sometimes. 

   3. Then I referred to hadoop and hbase stop shell,  I found they both 
Elegant kill process at first 
   4. Then check process whether still alive after sleeping some 
seconds.(sleep(60))
 
   5. If it was still alive, they compulsory kill process with os.kill(pid, 
SIGKILL) . 


Here is the log from console:  
---
[glc@dap241 atlas-0.8]$ ./bin/atlas_stop.py 
stopping atlas

[glc@dap241 atlas-0.8]$ jps
7296 jar
3017 ResourceManager
2613 NameNode
7573 Atlas
4089 HMaster
2806 SecondaryNameNode
3486 QuorumPeerMain
7043 jar
3392 JobHistoryServer
15957 Jps


[glc@dap241 atlas-0.8]$ ./bin/atlas_stop.py 
No process ID file found. Server not running?

-
[glc@dap241 atlas-0.8]$ jps
7296 jar
3017 ResourceManager
2613 NameNode
7573 Atlas
4089 HMaster
2806 SecondaryNameNode
3486 QuorumPeerMain
7043 jar
3392 JobHistoryServer
15957 Jps

[glc@dap241 atlas-0.8]$ ps -ef |grep 7573
glc   7573 1  2 Oct21 ?02:09:49 
/home/glc/java/jdk1.7.80/bin/java 
-Datlas.log.dir=/home/glc/atlas/atlas-0.8/logs -Datlas.log.file=application.log 
-Datlas.home=/home/glc/atlas/atlas-0.8 
-Datlas.conf=/home/glc/atlas/atlas-0.8/conf -Xms10240m -Xmx10240m 
-XX:MaxNewSize=3072m -XX:PermSize=100M -XX:MaxPermSize=512m 
-Dlog4j.configuration=atlas-log4j.xml -Djava.net.preferIPv4Stack=true -Xdebug 
-Xrunjdwp:transport=dt_socket,address=10660,server=y,suspend=n -classpath 
/home/glc/atlas/atlas-0.8/conf:/home/glc/atlas/atlas-0.8/server/webapp/atlas/WEB-INF/classes:/home/glc/atlas/atlas-0.8/server/webapp/atlas/WEB-INF/lib/*:/home/glc/atlas/atlas-0.8/libext/*:/home/glc/hbase/hbase-1.1.5/conf
 org.apache.atlas.Atlas -app /home/glc/atlas/atlas-0.8/server/webapp/atlas
glc  16003 15590  0 09:01 pts/100:00:00 grep 7573
-
[glc@dap241 atlas-0.8]$ ps -ef|grep atlas
glc   7573 1  2 Oct21 ?02:09:49 
/home/glc/java/jdk1.7.80/bin/java 
-Datlas.log.dir=/home/glc/atlas/atlas-0.8/logs -Datlas.log.file=application.log 
-Datlas.home=/home/glc/atlas/atlas-0.8 
-Datlas.conf=/home/glc/atlas/atlas-0.8/conf -Xms10240m -Xmx10240m 
-XX:MaxNewSize=3072m -XX:PermSize=100M -XX:MaxPermSize=512m 
-Dlog4j.configuration=atlas-log4j.xml -Djava.net.preferIPv4Stack=true -Xdebug 
-Xrunjdwp:transport=dt_socket,address=10660,server=y,suspend=n -classpath 
/home/glc/atlas/atlas-0.8/conf:/home/glc/atlas/atlas-0.8/server/webapp/atlas/WEB-INF/classes:/home/glc/atlas/atlas-0.8/server/webapp/atlas/WEB-INF/lib/*:/home/glc/atlas/atlas-0.8/libext/*:/home/glc/hbase/hbase-1.1.5/conf
 org.apache.atlas.Atlas -app /home/glc/atlas/atlas-0.8/server/webapp/atlas
glc  16006 15590  0 09:01 pts/100:00:00 grep atlas

  was:
Hi All， 
   1. I executed ./bin/atlas_stop.py to stop atlas, but after ten minutes i 
found it still alive.
 
   2. By reviewing atlas_stop.py code , I found that we called  
os.kill(pid, SIGTERM)  to kill the process, but it didn't work sometimes. 

   3. Then I referred to hadoop and hbase stop shell,  I found they both 
Elegant kill process at first 
   4. Then check process whether still alive after sleeping some 
seconds.(sleep(60))
 
   5. If it was still alive, they compulsory kill process with os.kill(pid, 
SIGKILL) . 


> execute ./bin/atlas_stop.py,  After ten minuters process still alive
> 
>
> Key: ATLAS-1248
> URL: https://issues.apache.org/jira/browse/ATLAS-1248
> Project: Atlas
>  Issue Type: Bug
>Affects Versions: 0.8-incubating
>Reporter: Qiang Zhang
>
> Hi All， 
>1. I executed ./bin/atlas_stop.py to stop atlas, but after ten minutes 
> i found it still alive.
>  
>2. By reviewing atlas_stop.py code , I found that we called  
> os.kill(pid, SIGTERM)  to kill the process, but it didn't work sometimes. 
>3. Then I referred to hadoop and hbase stop shell,  I found they both 
> Elegant kill process at first 
>4. Then check process whether still alive after sleeping some 
> seconds.(sleep(60))
>  
>5. If it was

[jira] [Created] (ATLAS-1248) execute ./bin/atlas_stop.py, After ten minuters process still alive

2016-10-27 Thread Qiang Zhang (JIRA)

Qiang Zhang created ATLAS-1248:
--

 Summary: execute ./bin/atlas_stop.py,  After ten minuters process 
still alive
 Key: ATLAS-1248
 URL: https://issues.apache.org/jira/browse/ATLAS-1248
 Project: Atlas
  Issue Type: Bug
Affects Versions: 0.8-incubating
Reporter: Qiang Zhang


Hi All， 
   1. I executed ./bin/atlas_stop.py to stop atlas, but after ten minutes i 
found it still alive.
 
   2. By reviewing atlas_stop.py code , I found that we called  
os.kill(pid, SIGTERM)  to kill the process, but it didn't work sometimes. 

   3. Then I referred to hadoop and hbase stop shell,  I found they both 
Elegant kill process at first 
   4. Then check process whether still alive after sleeping some 
seconds.(sleep(60))
 
   5. If it was still alive, they compulsory kill process with os.kill(pid, 
SIGKILL) . 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (ATLAS-1247) Support for hive 2.x

2016-10-27 Thread Shwetha G S (JIRA)


 [ 
https://issues.apache.org/jira/browse/ATLAS-1247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shwetha G S updated ATLAS-1247:
---
Attachment: hive2_atlas.patch

> Support for hive 2.x
> 
>
> Key: ATLAS-1247
> URL: https://issues.apache.org/jira/browse/ATLAS-1247
> Project: Atlas
>  Issue Type: Improvement
>Reporter: Shwetha G S
>Assignee: Vimal Sharma
> Attachments: hive2_atlas.patch
>
>
> Atlas hive hook works only with hive 1.x. Need support for hive 2.x



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ATLAS-1247) Support for hive 2.x

2016-10-27 Thread Shwetha G S (JIRA)


[ 
https://issues.apache.org/jira/browse/ATLAS-1247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15610942#comment-15610942
 ] 

Shwetha G S commented on ATLAS-1247:


Did the atlas hive hook work with hive 2.1.0? If it didn't work, you can try to 
figure out the issues. Another is to change hive.version in hive-bridge/pom.xml 
to 2.1.0 and make sure the tests pass. Vimal had an initial patch, attaching 
here

> Support for hive 2.x
> 
>
> Key: ATLAS-1247
> URL: https://issues.apache.org/jira/browse/ATLAS-1247
> Project: Atlas
>  Issue Type: Improvement
>Reporter: Shwetha G S
>Assignee: Vimal Sharma
> Attachments: hive2_atlas.patch
>
>
> Atlas hive hook works only with hive 1.x. Need support for hive 2.x



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (ATLAS-1247) Support for hive 2.x

2016-10-27 Thread Qiang Zhang (JIRA)


[ 
https://issues.apache.org/jira/browse/ATLAS-1247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15610931#comment-15610931
 ] 

Qiang Zhang commented on ATLAS-1247:


Recently, I also testing  it with hive2.1.0 incorporation with atlas  . If it's 
convenient canyou give me some hive  test sample, I also have energy to test it 
as well ,thanks 

> Support for hive 2.x
> 
>
> Key: ATLAS-1247
> URL: https://issues.apache.org/jira/browse/ATLAS-1247
> Project: Atlas
>  Issue Type: Improvement
>Reporter: Shwetha G S
>Assignee: Vimal Sharma
>
> Atlas hive hook works only with hive 1.x. Need support for hive 2.x



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Review Request 53250: fix atlas after ten minutes i found it still alive.

[jira] [Updated] (ATLAS-1248) execute ./bin/atlas_stop.py, After ten minuters process still alive

Re: Review Request 53207: Adding Change listeners to react on changes in TypesDef

Re: Review Request 53207: Adding Change listeners to react on changes in TypesDef

Re: Review Request 53207: Adding Change listeners to react on changes in TypesDef

Build failed in Jenkins: apache-atlas-nightly #453

Re: Review Request 53207: Adding Change listeners to react on changes in TypesDef

[jira] [Comment Edited] (ATLAS-1195) Clean up DSL Translation

[jira] [Resolved] (ATLAS-1249) execution_timeout does not cause task to fail

[jira] [Created] (ATLAS-1249) execution_timeout does not cause task to fail

[jira] [Commented] (ATLAS-1247) Support for hive 2.x

[jira] [Updated] (ATLAS-1243) Hive storage type can be add as one property

[jira] [Updated] (ATLAS-1248) execute ./bin/atlas_stop.py, After ten minuters process still alive

[jira] [Updated] (ATLAS-1248) execute ./bin/atlas_stop.py, After ten minuters process still alive

[jira] [Created] (ATLAS-1248) execute ./bin/atlas_stop.py, After ten minuters process still alive

[jira] [Updated] (ATLAS-1247) Support for hive 2.x

[jira] [Commented] (ATLAS-1247) Support for hive 2.x

[jira] [Commented] (ATLAS-1247) Support for hive 2.x

18 matches

Site Navigation

Mail list logo

Footer information