[jira] [Commented] (ATLAS-3320) Import Service: Support Concurrent Ingest
[ https://issues.apache.org/jira/browse/ATLAS-3320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17056121#comment-17056121 ] ASF subversion and git services commented on ATLAS-3320: Commit 765ea583b23d25ecc919d520092747c4158466a5 in atlas's branch refs/heads/master from Ashutosh Mestry [ https://gitbox.apache.org/repos/asf?p=atlas.git;h=765ea58 ] ATLAS-3320: Migration Import implementation. > Import Service: Support Concurrent Ingest > - > > Key: ATLAS-3320 > URL: https://issues.apache.org/jira/browse/ATLAS-3320 > Project: Atlas > Issue Type: Bug > Components: atlas-core >Affects Versions: trunk >Reporter: Ashutosh Mestry >Assignee: Ashutosh Mestry >Priority: Major > Fix For: trunk > > Attachments: ATLAS-3320-ImportService-Concurrent-ingest.patch > > > *Background* > Existing implementation of import supports single entity creation. This > greatly limits the rate of ingest. > *Solution Approach* > * Use existing producer-consumer framework to allow for configurable > consumers of entities from the input stream. > * Modify _BulkImporterImpl_ to implement the consumer. > * Modify _AtlasImportRequest_ to specify the batch size and number of > workers. > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (ATLAS-3320) Import Service: Support Concurrent Ingest
[ https://issues.apache.org/jira/browse/ATLAS-3320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17045295#comment-17045295 ] ASF subversion and git services commented on ATLAS-3320: Commit 024f5d52d0a972616362ac9b15ed7a417384026f in atlas's branch refs/heads/master from Nixon Rodrigues [ https://gitbox.apache.org/repos/asf?p=atlas.git;h=024f5d5 ] Revert "ATLAS-3320: Import Service. Support concurrent ingest." This reverts commit a2ccfb9f3577e911103041d8d4b91c169697f6a1. > Import Service: Support Concurrent Ingest > - > > Key: ATLAS-3320 > URL: https://issues.apache.org/jira/browse/ATLAS-3320 > Project: Atlas > Issue Type: Bug > Components: atlas-core >Affects Versions: trunk >Reporter: Ashutosh Mestry >Assignee: Ashutosh Mestry >Priority: Major > Fix For: trunk > > Attachments: ATLAS-3320-ImportService-Concurrent-ingest.patch > > > *Background* > Existing implementation of import supports single entity creation. This > greatly limits the rate of ingest. > *Solution Approach* > * Use existing producer-consumer framework to allow for configurable > consumers of entities from the input stream. > * Modify _BulkImporterImpl_ to implement the consumer. > * Modify _AtlasImportRequest_ to specify the batch size and number of > workers. > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (ATLAS-3320) Import Service: Support Concurrent Ingest
[ https://issues.apache.org/jira/browse/ATLAS-3320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041559#comment-17041559 ] ASF subversion and git services commented on ATLAS-3320: Commit a2ccfb9f3577e911103041d8d4b91c169697f6a1 in atlas's branch refs/heads/master from Ashutosh Mestry [ https://gitbox.apache.org/repos/asf?p=atlas.git;h=a2ccfb9 ] ATLAS-3320: Import Service. Support concurrent ingest. > Import Service: Support Concurrent Ingest > - > > Key: ATLAS-3320 > URL: https://issues.apache.org/jira/browse/ATLAS-3320 > Project: Atlas > Issue Type: Bug > Components: atlas-core >Affects Versions: trunk >Reporter: Ashutosh Mestry >Assignee: Ashutosh Mestry >Priority: Major > Fix For: trunk > > Attachments: ATLAS-3320-ImportService-Concurrent-ingest.patch > > > *Background* > Existing implementation of import supports single entity creation. This > greatly limits the rate of ingest. > *Solution Approach* > * Use existing producer-consumer framework to allow for configurable > consumers of entities from the input stream. > * Modify _BulkImporterImpl_ to implement the consumer. > * Modify _AtlasImportRequest_ to specify the batch size and number of > workers. > -- This message was sent by Atlassian Jira (v8.3.4#803005)
