[
https://issues.apache.org/jira/browse/ATLAS-4121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ashutosh Mestry updated ATLAS-4121:
-----------------------------------
Attachment: ATLAS-4121-Concurrent-Import.patch
> Import Service: Improve Speed of Ingest for replicatedTo Option
> ---------------------------------------------------------------
>
> Key: ATLAS-4121
> URL: https://issues.apache.org/jira/browse/ATLAS-4121
> Project: Atlas
> Issue Type: Improvement
> Components: atlas-core
> Affects Versions: 2.1.0
> Reporter: Ashutosh Mestry
> Assignee: Ashutosh Mestry
> Priority: Major
> Fix For: trunk
>
> Attachments: ATLAS-4121-Concurrent-Import.patch
>
>
> *Background*
> For Import replication options that includes _skipLineage_ and
> _replicatedTo_, __ current implementation uses one entity-at-time import
> approach.
> This approach can be end up taking long time to import for large payloads.
> *Solution*
> * Use an approach that allows for entity of a type to be concurrently
> created.
> * This assumes that the incoming stream of entities to be imported is
> topologically sorted (where parent entities appear before the child entities).
> * Create entities of a type.
> * Once all entities of a type are created, fetch next type.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
