-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/66184/
-----------------------------------------------------------
(Updated March 20, 2018, 11:15 p.m.)
Review request for atlas, Madhan Neethiraj, Ruchi Solani, and Sarath
Subramanian.
Changes
-------
Updates include:
- Updated README file.
- Removed _migration-export-options.json_ file.
Bugs: ATLAS-2461
https://issues.apache.org/jira/browse/ATLAS-2461
Repository: atlas
Description
-------
**Background**
The migration utility committed ealier has couple of short comings:
- Relies on Export service.
- Needs _export-options.json_ to be specified.
- Exporting everything means meticuloulsy updating the options file. It is
likely some specification is missed and hence will lead to less data being
migrated.
- Suffers from performance problems for large data sets.
**Approach**
The new approach uses _Titan's_ _GraphSON_ writer. This is configured to export
all data in _EXTENDED_ format.
The _EXTENDED_ format separates _vertices_ and _edges_. This open other
interesting avenues for import.
**Implementation**
- Modified _Exporter_ to use _AtlasTypeRegistry_ and _GraphSONWriter_.
- Produced files:
- _atlas-typedef.json_: Contains type definitions of all types.
- _atlas-migration-data.json_: Contains data from the database.
Diffs (updated)
-----
tools/atlas-migration-exporter/pom.xml 5c6c61ee
tools/atlas-migration-exporter/src/main/java/org/apache/atlas/migration/Exporter.java
a9873df0
tools/atlas-migration-exporter/src/main/resources/README 2f2bf3e1
tools/atlas-migration-exporter/src/main/resources/migration-export-request.json
64002aff
Diff: https://reviews.apache.org/r/66184/diff/2/
Changes: https://reviews.apache.org/r/66184/diff/1-2/
Testing
-------
**Functional tests**
Export from repositories with:
- Custom types.
- Complex lineages.
- Created hive entities via beeline.
- Imported data.
**Gremlin Shell**
- Used _Gremlin_ shell to perform export operation.
Thanks,
Ashutosh Mestry