[
https://issues.apache.org/jira/browse/HDFS-11765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
LiXin Ge updated HDFS-11765:
----------------------------
Description:
Recently I have upgraded my Hadoop version from 2.6 to 3.0, and I find that the
write performance decreased by 13%. After some days comparative analysis, It's
seems introduced by HADOOP-10865.
Since James Thomas have done the work that native checksum can run against
byte[] arrays instead of just against byte buffers, we may use native method
preferential because it runs faster than others.
[~szetszwo] and [~iwasakims] could you take a look at this to see if it make
bad effect on your benchmark test? [~tlipcon] could you help to see if I have
make mistakes in this patch?
thanks!
was:
Recently I have upgraded my Hadoop version from 2.6 to 3.0, and I find that the
write performance decreased by 13%. After some days comparative analysis, It's
seems introduced by HADOOP-10865.
Since James Thomas have done the work that native checksum can run against
byte[] arrays instead of just against byte buffers, we may use native method
preferential because it runs faster than others.
[~szetszwo]] and [~iwasakims] could you take a look at this to see if it make
bad effect on your benchmark test? [~tlipcon] could you help to see if I have
make mistakes in this patch?
thanks!
> Fix:Performance regression due to incorrect use of DataChecksum
> ---------------------------------------------------------------
>
> Key: HDFS-11765
> URL: https://issues.apache.org/jira/browse/HDFS-11765
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: native, performance
> Affects Versions: 2.8.0, 3.0.0-alpha1
> Reporter: LiXin Ge
> Fix For: 3.0.0-alpha2
>
> Attachments: HDFS-11765.patch
>
>
> Recently I have upgraded my Hadoop version from 2.6 to 3.0, and I find that
> the write performance decreased by 13%. After some days comparative analysis,
> It's seems introduced by HADOOP-10865.
> Since James Thomas have done the work that native checksum can run against
> byte[] arrays instead of just against byte buffers, we may use native method
> preferential because it runs faster than others.
> [~szetszwo] and [~iwasakims] could you take a look at this to see if it make
> bad effect on your benchmark test? [~tlipcon] could you help to see if I have
> make mistakes in this patch?
> thanks!
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
