[jira] [Commented] (HDFS-3528) Use native CRC32 in DFS write path

2014-09-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14122737#comment-14122737 ] Steve Loughran commented on HDFS-3528: -- This appears to have has broken all hadoop 2.

[jira] [Commented] (HDFS-3528) Use native CRC32 in DFS write path

2014-08-28 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14114681#comment-14114681 ] Todd Lipcon commented on HDFS-3528: --- Cool, I'll mark this as resolved then > Use native

[jira] [Commented] (HDFS-3528) Use native CRC32 in DFS write path

2014-08-28 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14114622#comment-14114622 ] James Thomas commented on HDFS-3528: Yep, think so -- for both ByteBuffers and byte arr

[jira] [Commented] (HDFS-3528) Use native CRC32 in DFS write path

2014-08-28 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14114615#comment-14114615 ] Todd Lipcon commented on HDFS-3528: --- hey [~james.thomas] -- now that HDFS-6865 is committ

[jira] [Commented] (HDFS-3528) Use native CRC32 in DFS write path

2014-07-07 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14053862#comment-14053862 ] Todd Lipcon commented on HDFS-3528: --- [~james.thomas] -- I think we should probably file a

[jira] [Commented] (HDFS-3528) Use native CRC32 in DFS write path

2014-07-02 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14050901#comment-14050901 ] Tsz Wo Nicholas Sze commented on HDFS-3528: --- It turns out that java.util.zip.CRC3

[jira] [Commented] (HDFS-3528) Use native CRC32 in DFS write path

2014-06-24 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14042406#comment-14042406 ] James Thomas commented on HDFS-3528: [~szetszwo] No, it is faster for both cases -- see

[jira] [Commented] (HDFS-3528) Use native CRC32 in DFS write path

2014-06-23 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14041545#comment-14041545 ] Tsz Wo Nicholas Sze commented on HDFS-3528: --- Is the native library faster than th

[jira] [Commented] (HDFS-3528) Use native CRC32 in DFS write path

2014-06-20 Thread James Thomas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14039098#comment-14039098 ] James Thomas commented on HDFS-3528: Moved patch to DN subtask. > Use native CRC32 in

[jira] [Commented] (HDFS-3528) Use native CRC32 in DFS write path

2014-06-12 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14029483#comment-14029483 ] Todd Lipcon commented on HDFS-3528: --- Cool, thanks for starting on this. For the full impr