Hi

Existing import processes 1 entity at a time. Thus time taken is linear. There 
is a JIRA that improves the situation. It is being tested right now.

Please take a look at: 
JIRA: https://issues.apache.org/jira/browse/ATLAS-3320
Review: https://reviews.apache.org/r/71025/ (latest patch is here)

Best regards,

~ ashutosh
.......
No hurry, no pause. – Tim Ferriss, Life Hacker, Author
 

On 7/23/19, 6:46 AM, "Nallapati, Sreenivasulu" 
<[email protected]> wrote:

    Hello folks,
    
    We are trying to export and import the existing data to different atlas 
system.
    We have around 10000 entities in the exported zip file. The export is 
taking around 2-3 mins.
    Total zip file size is 14 MB. The largest file in the zip is around 7 MB 
which has almost 1000 relationshipAttributes in it.
    When we try to import this, the import is running for more than 25 hours. 
Is this expected behaviour? Is there any way to speed up this process?
    
    Export command
    curl -igk -X POST -u admin:admin -H "Content-Type: application/json" -H 
"Cache-Control: no-cache" -d '{
        "itemsToExport": [
           { "typeName": "kafka_topic" }
        ],
        "options": {
            "matchType": "forType"
        }
    }' "http:// localhost:21000/api/atlas/admin/export" > /tmp/kafka_topic.zip
    
    
    Import command
    curl -ikg -X POST -u admin:admin -H "Content-Type: multipart/form-data" -H 
"Cache-Control: no-cache" -F data=@ kafka_topic.zip 
"http://localhost:21000/api/atlas/admin/import";
    
    let us know if we are missing in the import process
    
    
    ---
    Regards,
    Sreeni
    

Reply via email to