[ https://issues.apache.org/jira/browse/HDFS-362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13083956#comment-13083956 ]
Uma Maheswara Rao G commented on HDFS-362: ------------------------------------------ Hi Eli, Thanks alot for taking a look!. The main problem here is, ArrayLengths has been checked here. If i change that to direct LongWritable.write(..) or ShortWritable.write(..), that array length will be changed, this will lead to ncompatible change. Do you have any alternative suggestion for this? --Thanks > FSEditLog should not writes long and short as UTF8 and should not use > ArrayWritable for writing non-array items > --------------------------------------------------------------------------------------------------------------- > > Key: HDFS-362 > URL: https://issues.apache.org/jira/browse/HDFS-362 > Project: Hadoop HDFS > Issue Type: Improvement > Components: name-node > Reporter: Tsz Wo (Nicholas), SZE > Assignee: Uma Maheswara Rao G > Attachments: HDFS-362.1.patch, HDFS-362.patch > > > In FSEditLog, > - long and short are first converted to String and are further converted to > UTF8 > - For some non-array items, it first create an ArrayWritable object to hold > all the items and then writes the ArrayWritable object. > These result creating many intermediate objects which affects Namenode CPU > performance and Namenode restart. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira