Ashutosh Mestry created ATLAS-3663:
--------------------------------------

             Summary: Import Service: Migration Import: Provide Ability to 
Resume from Last Successfully Imported State
                 Key: ATLAS-3663
                 URL: https://issues.apache.org/jira/browse/ATLAS-3663
             Project: Atlas
          Issue Type: Improvement
          Components:  atlas-core
    Affects Versions: trunk
            Reporter: Ashutosh Mestry
            Assignee: Ashutosh Mestry
             Fix For: trunk


*Background*

The new Migration Import implementation allows for importing large zip files. 
These imports can potentially run for long time. If the server shuts down while 
an import is in progress, there needs to be a mechanism so that the import 
resumes from the last imported entity.

*Solution*
 * Implement _DataMigrationStatusService_ this will maintain a special vertex 
one of whose property will be the last successfully imported status.
 * Update this vertex on each successfully recorded import.
 * At the start of _ZipFileBaseMigration_ check for existence of this vertex. 
If it exists and has a valid position, use this to set the _startPosition_ in 
the _AtlasImportRequest_. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to