Ashutosh Mestry created ATLAS-3663: -------------------------------------- Summary: Import Service: Migration Import: Provide Ability to Resume from Last Successfully Imported State Key: ATLAS-3663 URL: https://issues.apache.org/jira/browse/ATLAS-3663 Project: Atlas Issue Type: Improvement Components: atlas-core Affects Versions: trunk Reporter: Ashutosh Mestry Assignee: Ashutosh Mestry Fix For: trunk
*Background* The new Migration Import implementation allows for importing large zip files. These imports can potentially run for long time. If the server shuts down while an import is in progress, there needs to be a mechanism so that the import resumes from the last imported entity. *Solution* * Implement _DataMigrationStatusService_ this will maintain a special vertex one of whose property will be the last successfully imported status. * Update this vertex on each successfully recorded import. * At the start of _ZipFileBaseMigration_ check for existence of this vertex. If it exists and has a valid position, use this to set the _startPosition_ in the _AtlasImportRequest_. -- This message was sent by Atlassian Jira (v8.3.4#803005)