-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/65327/
-----------------------------------------------------------

(Updated Jan. 26, 2018, 1:18 a.m.)


Review request for atlas, Apoorv Naik and Madhan Neethiraj.


Changes
-------

Updates include:
- New class _SetupTestVerifier_ added.
- Updated _DSLQueriesTest_ to use the new verifier class.
- Addressed review comments.


Bugs: ATLAS-2378
    https://issues.apache.org/jira/browse/ATLAS-2378


Repository: atlas


Description
-------

**Approach for Analysis**
- Running tests for extended periods did not yield a predictable pattern.
- Exposing exceptions in the setup process helped me progress more quickly.
 
**Analysis & Findings**
- Spurious errors occur during test execution due to Solr, ZK and connectivity 
between them.
- _AtlasJanusGraphDatabase.cleanup_ occasionally fail due to some exception 
with BerkeleyDB shutdown. In short, our clean-up of the temporary folders 
within data directory are seldom succeed.
- TestNG invoking the tests cause occasional problem during setup.

**Fixes/Updates/Refactoring**
- Added guard conditions to AtlasJanusGraphDatabase.cleanup, this reduced 
exceptions.
- Expose exceptions (as opposed to swallowing them). This will give us a good 
starting point to analyze.
- Added TestNG’s _SkipException_ where we encounter setup failures. That will 
avoid showing incorrect test results and we will be able to proceed with builds.
- Got rid of DBSandboxer class as it caused more problems with DB cleanup.

**Possible Further improvement**
- Streamline the clean-up in a single class.


Diffs (updated)
-----

  graphdb/common/src/test/java/org/apache/atlas/graph/GraphSandboxUtil.java 
b8a9a49a 
  
graphdb/janus/src/main/java/org/apache/atlas/repository/graphdb/janus/AtlasJanusGraphDatabase.java
 f91226b8 
  pom.xml 5c4b4a7b 
  repository/pom.xml bb4d1eb4 
  repository/src/test/java/org/apache/atlas/DBSandboxer.java f4f099a6 
  repository/src/test/java/org/apache/atlas/TestModules.java df299cef 
  repository/src/test/java/org/apache/atlas/query/DSLQueriesTest.java c44eea3b 
  
repository/src/test/java/org/apache/atlas/repository/impexp/ImportServiceTestUtils.java
 72895125 
  repository/src/test/java/org/apache/atlas/services/MetricsServiceTest.java 
ca05cbeb 


Diff: https://reviews.apache.org/r/65327/diff/2/

Changes: https://reviews.apache.org/r/65327/diff/1-2/


Testing
-------

**Build**
Used the following command line for repeated execution. Executed between 2 to 4 
hours and monitoring errors.
```
while sleep 3; do mvn -f repository/pom.xml clean install | grep -v 
"INFO\|WARNING\|Running"; done
```


Thanks,

Ashutosh Mestry

Reply via email to