[
https://issues.apache.org/jira/browse/HADOOP-1649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12515121
]
Doug Cutting commented on HADOOP-1649:
--------------------------------------
In HADOOP-1134 we talked of subsequently testing with larger values for
bytes.per.checksum. It would be interesting to see how changing this from 512
to to, e.g., 8k affects performance both pre- and post-1134. Have you looked
at that?
> Performance regression with Block CRCs
> --------------------------------------
>
> Key: HADOOP-1649
> URL: https://issues.apache.org/jira/browse/HADOOP-1649
> Project: Hadoop
> Issue Type: Bug
> Affects Versions: 0.14.0
> Reporter: Raghu Angadi
> Assignee: Raghu Angadi
> Priority: Blocker
> Fix For: 0.14.0
>
>
> Performance is noticeably affected by Block Level CRCs patch (HADOOP-1134).
> This is more noticeable on writes (randomriter test etc).
> With random writer, it takes 20-25% on small cluster (20 nodes) and many be
> 10% on larger cluster.
> There are a few differences in how data is written with 1134. As soon as I
> can reproduce this, I think it will be easier to fix.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
