[jira] [Created] (HDFS-10839) Add new BlockReaderl#readAll(ByteBuffer buf, int len) API

2016-09-04 Thread SammiChen (JIRA)
SammiChen created HDFS-10839: Summary: Add new BlockReaderl#readAll(ByteBuffer buf, int len) API Key: HDFS-10839 URL: https://issues.apache.org/jira/browse/HDFS-10839 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-8901) Use ByteBuffer in striping positional read

2016-09-02 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8901: Attachment: HDFS-8901-v19.patch 1. fix TestSnapshotFileLength test failure 2. fix 2 checkstyle issues. the

[jira] [Commented] (HDFS-8901) Use ByteBuffer in striping positional read

2016-09-02 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15458196#comment-15458196 ] SammiChen commented on HDFS-8901: - 1. {{TestPread}} failure is fixed. 2. {quote} Looking back at the

[jira] [Updated] (HDFS-8901) Use ByteBuffer in striping positional read

2016-09-02 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8901: Attachment: HDFS-8901-v18.patch > Use ByteBuffer in striping positional read >

[jira] [Commented] (HDFS-8901) Use ByteBuffer in striping positional read

2016-09-01 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15455110#comment-15455110 ] SammiChen commented on HDFS-8901: - attach patch v17, improve the code based on Zhe's good suggestions >

[jira] [Updated] (HDFS-8901) Use ByteBuffer in striping positional read

2016-09-01 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8901: Attachment: HDFS-8901-v17.patch > Use ByteBuffer in striping positional read >

[jira] [Commented] (HDFS-8901) Use ByteBuffer in striping positional read

2016-09-01 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15455103#comment-15455103 ] SammiChen commented on HDFS-8901: - Thanks Zhe for take a lot of time review patch and give so many good

[jira] [Commented] (HDFS-8901) Use ByteBuffer in striping positional read

2016-08-29 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15445461#comment-15445461 ] SammiChen commented on HDFS-8901: - I rerun the unit test TestErasureCodeBenchmarkThroughput locally with

[jira] [Updated] (HDFS-8901) Use ByteBuffer in striping positional read

2016-08-28 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8901: Attachment: HDFS-8901.v16.patch Fix one style checker reported issue. Another reported issue is a false

[jira] [Commented] (HDFS-8901) Use ByteBuffer in striping positional read

2016-08-26 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15438885#comment-15438885 ] SammiChen commented on HDFS-8901: - For question 4, why flip is not needed before? The reason is

[jira] [Updated] (HDFS-8901) Use ByteBuffer in striping positional read

2016-08-26 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8901: Attachment: HDFS-8901.v15.patch changes based on v14 patch, 1. rebase the patch 2. fix item 1,2,5 from

[jira] [Commented] (HDFS-8901) Use ByteBuffer in striping positional read

2016-08-25 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15438489#comment-15438489 ] SammiChen commented on HDFS-8901: - Hi Zhe, Thanks for your great effort to review the patch. Very good

[jira] [Updated] (HDFS-10795) Refactor ReaderStrategy#ByteBufferStrategy

2016-08-25 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10795: - Assignee: SammiChen Status: Patch Available (was: Open) > Refactor

[jira] [Updated] (HDFS-10795) Refactor ReaderStrategy#ByteBufferStrategy

2016-08-25 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10795: - Attachment: HDFS-10795-v1.patch upload the patch > Refactor ReaderStrategy#ByteBufferStrategy >

[jira] [Created] (HDFS-10795) Refactor ReaderStrategy#ByteBufferStrategy

2016-08-25 Thread SammiChen (JIRA)
SammiChen created HDFS-10795: Summary: Refactor ReaderStrategy#ByteBufferStrategy Key: HDFS-10795 URL: https://issues.apache.org/jira/browse/HDFS-10795 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-8905) Refactor DFSInputStream#ReaderStrategy

2016-08-24 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8905: Attachment: HDFS-8905-v15.patch Rebased against the latest trunk code > Refactor

[jira] [Commented] (HDFS-8905) Refactor DFSInputStream#ReaderStrategy

2016-08-22 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432179#comment-15432179 ] SammiChen commented on HDFS-8905: - I run the failed unit cases locally with the latest HDFS trunk + this

[jira] [Updated] (HDFS-8905) Refactor DFSInputStream#ReaderStrategy

2016-08-22 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8905: Attachment: HDFS-8905-v14.patch Thanks for Kai's review and suggestion. I remove the unnecessary

[jira] [Updated] (HDFS-8905) Refactor DFSInputStream#ReaderStrategy

2016-08-21 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8905: Attachment: HDFS-8905-v13.patch remove the unnecessary whitespace > Refactor DFSInputStream#ReaderStrategy

[jira] [Updated] (HDFS-8905) Refactor DFSInputStream#ReaderStrategy

2016-08-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8905: Attachment: HDFS-8905-v12.patch fix check style reported issues > Refactor DFSInputStream#ReaderStrategy >

[jira] [Commented] (HDFS-8905) Refactor DFSInputStream#ReaderStrategy

2016-08-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427992#comment-15427992 ] SammiChen commented on HDFS-8905: - fix the issue found in unit test failure > Refactor

[jira] [Updated] (HDFS-8905) Refactor DFSInputStream#ReaderStrategy

2016-08-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8905: Attachment: HDFS-8905-v11.patch > Refactor DFSInputStream#ReaderStrategy >

[jira] [Issue Comment Deleted] (HDFS-8905) Refactor DFSInputStream#ReaderStrategy

2016-08-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8905: Comment: was deleted (was: rebase the patch on latest trunk code ) > Refactor DFSInputStream#ReaderStrategy

[jira] [Updated] (HDFS-8905) Refactor DFSInputStream#ReaderStrategy

2016-08-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8905: Attachment: (was: HDFS-8905-v10.patch) > Refactor DFSInputStream#ReaderStrategy >

[jira] [Updated] (HDFS-8905) Refactor DFSInputStream#ReaderStrategy

2016-08-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8905: Attachment: HDFS-8905-v10.patch rebase the patch on latest trunk code > Refactor

[jira] [Updated] (HDFS-8668) Erasure Coding: revisit buffer used for encoding and decoding.

2016-08-12 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8668: Attachment: HDFS-8668-v9.patch > Erasure Coding: revisit buffer used for encoding and decoding. >

[jira] [Commented] (HDFS-8668) Erasure Coding: revisit buffer used for encoding and decoding.

2016-08-11 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15418280#comment-15418280 ] SammiChen commented on HDFS-8668: - Thanks for Kai's review. A new patch is uploaded, fix all mentioned

[jira] [Commented] (HDFS-8668) Erasure Coding: revisit buffer used for encoding and decoding.

2016-08-11 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15417006#comment-15417006 ] SammiChen commented on HDFS-8668: - fix checkstyle issues > Erasure Coding: revisit buffer used for

[jira] [Updated] (HDFS-8668) Erasure Coding: revisit buffer used for encoding and decoding.

2016-08-11 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8668: Attachment: HDFS-8668-v8.patch > Erasure Coding: revisit buffer used for encoding and decoding. >

[jira] [Commented] (HDFS-8668) Erasure Coding: revisit buffer used for encoding and decoding.

2016-08-11 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15416613#comment-15416613 ] SammiChen commented on HDFS-8668: - Update test file TestReconstructStripedFile,

[jira] [Updated] (HDFS-8668) Erasure Coding: revisit buffer used for encoding and decoding.

2016-08-10 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8668: Attachment: HDFS-8668-v7.patch > Erasure Coding: revisit buffer used for encoding and decoding. >

[jira] [Commented] (HDFS-8668) Erasure Coding: revisit buffer used for encoding and decoding.

2016-08-10 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15415276#comment-15415276 ] SammiChen commented on HDFS-8668: - 1. fix checkstyle 2. allocate direct ByteBuffer for checksumBuf per

[jira] [Updated] (HDFS-8668) Erasure Coding: revisit buffer used for encoding and decoding.

2016-08-10 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8668: Attachment: HDFS-8668-v6.patch > Erasure Coding: revisit buffer used for encoding and decoding. >

[jira] [Updated] (HDFS-8668) Erasure Coding: revisit buffer used for encoding and decoding.

2016-08-09 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8668: Attachment: HDFS-8668-v5.patch > Erasure Coding: revisit buffer used for encoding and decoding. >

[jira] [Commented] (HDFS-8668) Erasure Coding: revisit buffer used for encoding and decoding.

2016-08-08 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412992#comment-15412992 ] SammiChen commented on HDFS-8668: - Thanks for Kai's suggestion. The heap buffer convert process is removed

[jira] [Updated] (HDFS-10718) Prefer direct ByteBuffer in native RS encoder and decoder

2016-08-08 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10718: - Attachment: (was: HDFS-8668-v4.patch) > Prefer direct ByteBuffer in native RS encoder and decoder >

[jira] [Updated] (HDFS-8668) Erasure Coding: revisit buffer used for encoding and decoding.

2016-08-08 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8668: Attachment: HDFS-8668-v4.patch > Erasure Coding: revisit buffer used for encoding and decoding. >

[jira] [Updated] (HDFS-10718) Prefer direct ByteBuffer in native RS encoder and decoder

2016-08-08 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10718: - Attachment: HDFS-8668-v4.patch > Prefer direct ByteBuffer in native RS encoder and decoder >

[jira] [Updated] (HDFS-8668) Erasure Coding: revisit buffer used for encoding and decoding.

2016-08-04 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-8668: Attachment: HDFS-8668-v3.patch > Erasure Coding: revisit buffer used for encoding and decoding. >

[jira] [Updated] (HDFS-10718) Prefer direct ByteBuffer in native RS encoder and decoder

2016-08-03 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10718: - Attachment: HDFS-10718-v1.patch > Prefer direct ByteBuffer in native RS encoder and decoder >

[jira] [Updated] (HDFS-10718) Prefer direct ByteBuffer in native RS encoder and decoder

2016-08-03 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10718: - Status: Patch Available (was: Open) > Prefer direct ByteBuffer in native RS encoder and decoder >

[jira] [Created] (HDFS-10718) Prefer direct ByteBuffer in native RS encoder and decoder

2016-08-03 Thread SammiChen (JIRA)
SammiChen created HDFS-10718: Summary: Prefer direct ByteBuffer in native RS encoder and decoder Key: HDFS-10718 URL: https://issues.apache.org/jira/browse/HDFS-10718 Project: Hadoop HDFS Issue

<    2   3   4   5   6   7