[
https://issues.apache.org/jira/browse/HADOOP-18129?focusedWorklogId=740753&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-740753
]
ASF GitHub Bot logged work on HADOOP-18129:
-------------------------------------------
Author: ASF GitHub Bot
Created on: 14/Mar/22 09:44
Start Date: 14/Mar/22 09:44
Worklog Time Spent: 10m
Work Description: abhishekdas99 commented on pull request #3996:
URL: https://github.com/apache/hadoop/pull/3996#issuecomment-1066573970
> Can you also comment on performance implications of this change?
Specifically `ViewFileSystem.getTargetFileSystemPaths` may now require parsing
strings into URIs on each usage, where does this impose a performance penalty?
The performance impact of this change where we are creating the URI object
when its needed as well as creating a dummy URI object to check the validity of
the path.
I created 100000 URI objects in less than a second ( It took 700 msec to be
precise).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 740753)
Time Spent: 40m (was: 0.5h)
> Change URI[] in INodeLink to String[] to reduce memory footprint of
> ViewFileSystem
> ----------------------------------------------------------------------------------
>
> Key: HADOOP-18129
> URL: https://issues.apache.org/jira/browse/HADOOP-18129
> Project: Hadoop Common
> Issue Type: Bug
> Reporter: Abhishek Das
> Assignee: Abhishek Das
> Priority: Major
> Labels: pull-request-available
> Time Spent: 40m
> Remaining Estimate: 0h
>
> Around 40k instances of INodeLink each of which is taking memory ranging from
> 1680bytes to 1160bytes. Multiplying 40k with 1160bytes will give us
> approximate 45mb.
> With changing from URI to String in INodeLink the memory consumed by each of
> the INodeLink objects has reduced from ~1160 bytes to ~320 bytes. Overall
> size becomes (40k X 320) 12mb
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
