Ashutosh Mestry created ATLAS-3320:
--------------------------------------

             Summary: Import Service: Support Concurrent Ingest
                 Key: ATLAS-3320
                 URL: https://issues.apache.org/jira/browse/ATLAS-3320
             Project: Atlas
          Issue Type: Bug
          Components:  atlas-core
    Affects Versions: trunk
            Reporter: Ashutosh Mestry
            Assignee: Ashutosh Mestry
             Fix For: trunk


*Background*

Existing implementation of import supports single entity creation. This greatly 
limits the rate of ingest.

*Solution Approach*
 * Use existing producer-consumer framework to allow for configurable consumers 
of entities from the input stream.
 * Modify _BulkImporterImpl_ to implement the consumer.
 * Modify _AtlasImportRequest_ to specify the batch size and number of workers.

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to