[ https://issues.apache.org/jira/browse/HDFS-5704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871812#comment-13871812 ]
Andrew Wang commented on HDFS-5704: ----------------------------------- Just a heads up, there's been another LV change in trunk/branch-2. We probably want to pull this one in too during the C5b2 backport bonanza. ---------- Forwarded message ---------- From: Jing Zhao (JIRA) <j...@apache.org> Date: Tue, Jan 14, 2014 at 11:21 PM Subject: [jira] [Updated] (HDFS-5704) Change OP_UPDATE_BLOCKS with a new OP_ADD_BLOCK To: andrew.w...@cloudera.com [ https://issues.apache.org/jira/browse/HDFS-5704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel] Jing Zhao updated HDFS-5704: ---------------------------- Attachment: editsStored HDFS-5704-branch2.patch Backport the change to branch-2. The backported patch merges all the editlog codes until 39 (OP_ADD_BLOCK) to branch-2, including all the codes used by CacheManager. HDFS-5704.001.patch, HDFS-5704.002.patch, HDFS-5704.003.patch, editsStored, editsStored written in the editlog in OP_UPDATE_BLOCKS operation. This has n^2 growth issue. The total size of editlog records for a file with large number of blocks could be huge. only records allocation of block and not the entire block list, on every block allocation. -- This message was sent by Atlassian JIRA (v6.1.5#6160) > Change OP_UPDATE_BLOCKS with a new OP_ADD_BLOCK > ------------------------------------------------ > > Key: HDFS-5704 > URL: https://issues.apache.org/jira/browse/HDFS-5704 > Project: Hadoop HDFS > Issue Type: Bug > Reporter: Suresh Srinivas > Assignee: Jing Zhao > Attachments: HDFS-5704-branch2.patch, HDFS-5704.000.patch, > HDFS-5704.001.patch, HDFS-5704.002.patch, HDFS-5704.003.patch, editsStored, > editsStored > > > Currently every time a block a allocated, the entire list of blocks are > written in the editlog in OP_UPDATE_BLOCKS operation. This has n^2 growth > issue. The total size of editlog records for a file with large number of > blocks could be huge. > The goal of this jira is discuss adding a different editlog record that only > records allocation of block and not the entire block list, on every block > allocation. -- This message was sent by Atlassian JIRA (v6.1.5#6160)