[
https://issues.apache.org/jira/browse/ATLAS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17076041#comment-17076041
]
Nikhil Bonte commented on ATLAS-3702:
-------------------------------------
+1 for the part 2 patch.
Thanks Ashutosh for the patch.
> Entity Creation: Improve Edge Creation
> --------------------------------------
>
> Key: ATLAS-3702
> URL: https://issues.apache.org/jira/browse/ATLAS-3702
> Project: Atlas
> Issue Type: Improvement
> Components: atlas-core
> Affects Versions: trunk
> Reporter: Ashutosh Mestry
> Assignee: Ashutosh Mestry
> Priority: Major
> Fix For: trunk
>
> Attachments:
> ATLAS-3702-Edge-creation-performance-improvements.-P.patch
>
>
> *Background*
> When creating entities with Atlas at scale, few inefficiencies were observed.
> They were:
> * _GraphHelper.getAdjacentEdgesByLabel_: The existing approach results in
> high memory usage. The method could use graph api that already exists.
> * _AtlasRelationshipStoreV2.getRelationshipEdge_: This does full vertex
> comparison. This is expensive.
> * Edge label is not index. Indexing this will improve speed of edge by label
> lookup.
> *Solution*
> Profile Atlas with (using metrics) to establish baseline.
> Use the fixes mentioned to the places above and profile.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
