[ https://issues.apache.org/jira/browse/HADOOP-2154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12546990 ]
Rajagopal Natarajan commented on HADOOP-2154: --------------------------------------------- @Konstantin Apologies. I had misunderstood your proposal, that I thought it is to avoid the use of backupstream and write each chunk-crc pair to socket directly instead of buffering. Now I understand what you meant. > Non-interleaved checksums would optimize block transfers. > --------------------------------------------------------- > > Key: HADOOP-2154 > URL: https://issues.apache.org/jira/browse/HADOOP-2154 > Project: Hadoop > Issue Type: Improvement > Components: dfs > Affects Versions: 0.14.0 > Reporter: Konstantin Shvachko > Assignee: Rajagopal Natarajan > Fix For: 0.16.0 > > > Currently when a block is transfered to a data-node the client interleaves > data chunks with the respective checksums. > This requires creating an extra copy of the original data in a new buffer > interleaved with the crcs. > We can avoid extra copying if the data and the crc are fed to the socket one > after another. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.