[ https://issues.apache.org/jira/browse/HADOOP-18129?focusedWorklogId=740753&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-740753 ]
ASF GitHub Bot logged work on HADOOP-18129: ------------------------------------------- Author: ASF GitHub Bot Created on: 14/Mar/22 09:44 Start Date: 14/Mar/22 09:44 Worklog Time Spent: 10m Work Description: abhishekdas99 commented on pull request #3996: URL: https://github.com/apache/hadoop/pull/3996#issuecomment-1066573970 > Can you also comment on performance implications of this change? Specifically `ViewFileSystem.getTargetFileSystemPaths` may now require parsing strings into URIs on each usage, where does this impose a performance penalty? The performance impact of this change where we are creating the URI object when its needed as well as creating a dummy URI object to check the validity of the path. I created 100000 URI objects in less than a second ( It took 700 msec to be precise). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking ------------------- Worklog Id: (was: 740753) Time Spent: 40m (was: 0.5h) > Change URI[] in INodeLink to String[] to reduce memory footprint of > ViewFileSystem > ---------------------------------------------------------------------------------- > > Key: HADOOP-18129 > URL: https://issues.apache.org/jira/browse/HADOOP-18129 > Project: Hadoop Common > Issue Type: Bug > Reporter: Abhishek Das > Assignee: Abhishek Das > Priority: Major > Labels: pull-request-available > Time Spent: 40m > Remaining Estimate: 0h > > Around 40k instances of INodeLink each of which is taking memory ranging from > 1680bytes to 1160bytes. Multiplying 40k with 1160bytes will give us > approximate 45mb. > With changing from URI to String in INodeLink the memory consumed by each of > the INodeLink objects has reduced from ~1160 bytes to ~320 bytes. Overall > size becomes (40k X 320) 12mb -- This message was sent by Atlassian Jira (v8.20.1#820001) --------------------------------------------------------------------- To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org