[ https://issues.apache.org/jira/browse/ATLAS-3715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ashutosh Mestry updated ATLAS-3715: ----------------------------------- Summary: Atlas: Improve Speed of Primitive Attribute Assignment (was: ZipFileMigrationImporter: Improve Speed of Primitive Attribute Assignment) > Atlas: Improve Speed of Primitive Attribute Assignment > ------------------------------------------------------ > > Key: ATLAS-3715 > URL: https://issues.apache.org/jira/browse/ATLAS-3715 > Project: Atlas > Issue Type: Improvement > Components: atlas-core > Affects Versions: trunk > Reporter: Ashutosh Mestry > Assignee: Ashutosh Mestry > Priority: Major > Fix For: trunk > > > *Background* > While profiling entity creation as part of zip file-based migration import, > it was observed that over 50% of time is spent in assigning values to > attributes that are of primitive type viz. string, date, etc. > *Methodology Used* > The entity creation flow already has _MetricRecorder_ added to key steps > within the entity creation flow. Additional methods (like > _mapPrimitiveValue_) were profiled to get complete breakdown. > Data set contained large number of entities of various types. Ones used were > _hdfs_path, hive_db, hive_table, hive_column, hive_process, > hive_process_execution, hive_column_lineage_. > *Solution* > Within the migration request context, use the _setEncodedProperty_ instead of > using the current route of creating _AtttributeMutationContext_. > -- This message was sent by Atlassian Jira (v8.3.4#803005)