-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/72039/
-----------------------------------------------------------
(Updated Jan. 31, 2020, 11:52 a.m.)
Review request for atlas, Ashutosh Mestry, Madhan Neethiraj, Nixon Rodrigues,
and Sarath Subramanian.
Bugs: ATLAS-3595
https://issues.apache.org/jira/browse/ATLAS-3595
Repository: atlas
Description (updated)
-------
Data migration service added under ATLAS-2461 works with json files as input.
This improvement will enable Data Migration service to import data using a zip
file.
Approach:
* Property value for migration should contain full path of file, below is the
example.
* Data migration service will first check migration property if value refers to
a zip file.
* If true, it will call ZipMigrator to import data in zip file.
* ZipMigrator internally uses existing ImportService to ingest zip.
* Audit service & Notification service will also be started as a part of zip
import.
E.g. properties to enable zip data migration:
* atlas.migration.data.filename=/path/fileName.zip
* atlas.migration.mode.workers=5
* atlas.migration.mode.batch.size=20
Diffs
-----
common/src/main/java/org/apache/atlas/service/Services.java 7b36db5ff
repository/src/main/java/org/apache/atlas/repository/migration/DataMigrationService.java
170136195
repository/src/main/java/org/apache/atlas/repository/migration/ZipMigrator.java
PRE-CREATION
repository/src/test/java/org/apache/atlas/repository/migration/MigrationBaseAsserts.java
18e950e8c
Diff: https://reviews.apache.org/r/72039/diff/6/
Testing
-------
PC build - https://builds.apache.org/job/PreCommit-ATLAS-Build-Test/1614/
Thanks,
Nikhil Bonte