[ https://issues.apache.org/jira/browse/ATLAS-3320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17056121#comment-17056121 ]
ASF subversion and git services commented on ATLAS-3320: -------------------------------------------------------- Commit 765ea583b23d25ecc919d520092747c4158466a5 in atlas's branch refs/heads/master from Ashutosh Mestry [ https://gitbox.apache.org/repos/asf?p=atlas.git;h=765ea58 ] ATLAS-3320: Migration Import implementation. > Import Service: Support Concurrent Ingest > ----------------------------------------- > > Key: ATLAS-3320 > URL: https://issues.apache.org/jira/browse/ATLAS-3320 > Project: Atlas > Issue Type: Bug > Components: atlas-core > Affects Versions: trunk > Reporter: Ashutosh Mestry > Assignee: Ashutosh Mestry > Priority: Major > Fix For: trunk > > Attachments: ATLAS-3320-ImportService-Concurrent-ingest.patch > > > *Background* > Existing implementation of import supports single entity creation. This > greatly limits the rate of ingest. > *Solution Approach* > * Use existing producer-consumer framework to allow for configurable > consumers of entities from the input stream. > * Modify _BulkImporterImpl_ to implement the consumer. > * Modify _AtlasImportRequest_ to specify the batch size and number of > workers. > -- This message was sent by Atlassian Jira (v8.3.4#803005)