Ashutosh Mestry created ATLAS-3320: -------------------------------------- Summary: Import Service: Support Concurrent Ingest Key: ATLAS-3320 URL: https://issues.apache.org/jira/browse/ATLAS-3320 Project: Atlas Issue Type: Bug Components: atlas-core Affects Versions: trunk Reporter: Ashutosh Mestry Assignee: Ashutosh Mestry Fix For: trunk
*Background* Existing implementation of import supports single entity creation. This greatly limits the rate of ingest. *Solution Approach* * Use existing producer-consumer framework to allow for configurable consumers of entities from the input stream. * Modify _BulkImporterImpl_ to implement the consumer. * Modify _AtlasImportRequest_ to specify the batch size and number of workers. -- This message was sent by Atlassian JIRA (v7.6.3#76005)