[jira] [Commented] (HDFS-2129) Simplify BlockReader to not inherit from FSInputChecker

[ https://issues.apache.org/jira/browse/HDFS-2129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13142891#comment-13142891 ] Todd Lipcon commented on HDFS-2129: --- Committed to 0.23 for 0.23.1. Committed to trunk for

[jira] [Updated] (HDFS-2129) Simplify BlockReader to not inherit from FSInputChecker

[ https://issues.apache.org/jira/browse/HDFS-2129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-2129: -- Resolution: Fixed Fix Version/s: 0.23.1 Release Note: BlockReader has been reimplemented to

[jira] [Resolved] (HDFS-2080) Speed up DFS read path by lessening checksum overhead

[ https://issues.apache.org/jira/browse/HDFS-2080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-2080. --- Resolution: Fixed Fix Version/s: 0.23.1 Hadoop Flags: Reviewed All of the subtasks have

[jira] [Commented] (HDFS-2080) Speed up DFS read path by lessening checksum overhead

[ https://issues.apache.org/jira/browse/HDFS-2080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13142898#comment-13142898 ] Kihwal Lee commented on HDFS-2080: -- Good work, Todd! Speed up DFS read

[jira] [Commented] (HDFS-2129) Simplify BlockReader to not inherit from FSInputChecker

[ https://issues.apache.org/jira/browse/HDFS-2129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13142897#comment-13142897 ] Hudson commented on HDFS-2129: -- Integrated in Hadoop-Common-0.23-Commit #142 (See

[jira] [Commented] (HDFS-2129) Simplify BlockReader to not inherit from FSInputChecker

[ https://issues.apache.org/jira/browse/HDFS-2129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13142907#comment-13142907 ] Hudson commented on HDFS-2129: -- Integrated in Hadoop-Hdfs-0.23-Commit #142 (See

[jira] [Commented] (HDFS-2129) Simplify BlockReader to not inherit from FSInputChecker

[ https://issues.apache.org/jira/browse/HDFS-2129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13142923#comment-13142923 ] Hudson commented on HDFS-2129: -- Integrated in Hadoop-Mapreduce-trunk-Commit #1263 (See

[jira] [Commented] (HDFS-1580) Add interface for generic Write Ahead Logging mechanisms

[ https://issues.apache.org/jira/browse/HDFS-1580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13143044#comment-13143044 ] jirapos...@reviews.apache.org commented on HDFS-1580: -

[jira] [Updated] (HDFS-1580) Add interface for generic Write Ahead Logging mechanisms

[ https://issues.apache.org/jira/browse/HDFS-1580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Kelly updated HDFS-1580: - Attachment: HDFS-1580.diff Fixed javadoc issue. Add interface for generic Write Ahead

[jira] [Commented] (HDFS-2130) Switch default checksum to CRC32C

[ https://issues.apache.org/jira/browse/HDFS-2130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13143087#comment-13143087 ] Hudson commented on HDFS-2130: -- Integrated in Hadoop-Hdfs-0.23-Build #65 (See

[jira] [Commented] (HDFS-2533) Remove needless synchronization on FSDataSet.getBlockFile

[ https://issues.apache.org/jira/browse/HDFS-2533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13143083#comment-13143083 ] Hudson commented on HDFS-2533: -- Integrated in Hadoop-Hdfs-0.23-Build #65 (See

[jira] [Commented] (HDFS-2129) Simplify BlockReader to not inherit from FSInputChecker

[ https://issues.apache.org/jira/browse/HDFS-2129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13143093#comment-13143093 ] Hudson commented on HDFS-2129: -- Integrated in Hadoop-Hdfs-0.23-Build #65 (See

[jira] [Commented] (HDFS-2533) Remove needless synchronization on FSDataSet.getBlockFile

[ https://issues.apache.org/jira/browse/HDFS-2533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13143099#comment-13143099 ] Hudson commented on HDFS-2533: -- Integrated in Hadoop-Hdfs-trunk #852 (See

[jira] [Commented] (HDFS-2130) Switch default checksum to CRC32C

[ https://issues.apache.org/jira/browse/HDFS-2130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13143102#comment-13143102 ] Hudson commented on HDFS-2130: -- Integrated in Hadoop-Hdfs-trunk #852 (See

[jira] [Commented] (HDFS-2477) Optimize computing the diff between a block report and the namenode state.

[ https://issues.apache.org/jira/browse/HDFS-2477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13143109#comment-13143109 ] Hudson commented on HDFS-2477: -- Integrated in Hadoop-Hdfs-trunk #852 (See

[jira] [Commented] (HDFS-2129) Simplify BlockReader to not inherit from FSInputChecker

[ https://issues.apache.org/jira/browse/HDFS-2129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13143108#comment-13143108 ] Hudson commented on HDFS-2129: -- Integrated in Hadoop-Hdfs-trunk #852 (See

[jira] [Commented] (HDFS-2533) Remove needless synchronization on FSDataSet.getBlockFile

[ https://issues.apache.org/jira/browse/HDFS-2533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13143133#comment-13143133 ] Hudson commented on HDFS-2533: -- Integrated in Hadoop-Mapreduce-0.23-Build #79 (See

[jira] [Commented] (HDFS-2416) distcp with a webhdfs uri on a secure cluster fails

[ https://issues.apache.org/jira/browse/HDFS-2416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13143136#comment-13143136 ] Hudson commented on HDFS-2416: -- Integrated in Hadoop-Mapreduce-0.23-Build #79 (See

[jira] [Commented] (HDFS-2130) Switch default checksum to CRC32C

[ https://issues.apache.org/jira/browse/HDFS-2130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13143137#comment-13143137 ] Hudson commented on HDFS-2130: -- Integrated in Hadoop-Mapreduce-0.23-Build #79 (See

[jira] [Commented] (HDFS-2129) Simplify BlockReader to not inherit from FSInputChecker

[ https://issues.apache.org/jira/browse/HDFS-2129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13143144#comment-13143144 ] Hudson commented on HDFS-2129: -- Integrated in Hadoop-Mapreduce-0.23-Build #79 (See

[jira] [Commented] (HDFS-2533) Remove needless synchronization on FSDataSet.getBlockFile

[ https://issues.apache.org/jira/browse/HDFS-2533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13143147#comment-13143147 ] Hudson commented on HDFS-2533: -- Integrated in Hadoop-Mapreduce-trunk #886 (See

[jira] [Commented] (HDFS-2477) Optimize computing the diff between a block report and the namenode state.

[ https://issues.apache.org/jira/browse/HDFS-2477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13143157#comment-13143157 ] Hudson commented on HDFS-2477: -- Integrated in Hadoop-Mapreduce-trunk #886 (See

[jira] [Commented] (HDFS-2129) Simplify BlockReader to not inherit from FSInputChecker

[ https://issues.apache.org/jira/browse/HDFS-2129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13143156#comment-13143156 ] Hudson commented on HDFS-2129: -- Integrated in Hadoop-Mapreduce-trunk #886 (See

[jira] [Commented] (HDFS-1580) Add interface for generic Write Ahead Logging mechanisms

[ https://issues.apache.org/jira/browse/HDFS-1580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13143166#comment-13143166 ] Hadoop QA commented on HDFS-1580: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-2476) More CPU efficient data structure for under-replicated/over-replicated/invalidate blocks

[ https://issues.apache.org/jira/browse/HDFS-2476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13143294#comment-13143294 ] Hairong Kuang commented on HDFS-2476: - Todd, Steve, how does the latest patch look to

[jira] [Updated] (HDFS-2535) A Model for Data Durability

[ https://issues.apache.org/jira/browse/HDFS-2535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Chansler updated HDFS-2535: -- Attachment: LosingBlocks.xlsx Model Spreadsheet A Model for Data Durability

[jira] [Created] (HDFS-2535) A Model for Data Durability

A Model for Data Durability --- Key: HDFS-2535 URL: https://issues.apache.org/jira/browse/HDFS-2535 Project: Hadoop HDFS Issue Type: Task Components: documentation Reporter: Robert Chansler

[jira] [Resolved] (HDFS-2535) A Model for Data Durability

[ https://issues.apache.org/jira/browse/HDFS-2535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Chansler resolved HDFS-2535. --- Resolution: Fixed A Model for Data Durability ---

[jira] [Commented] (HDFS-2535) A Model for Data Durability

[ https://issues.apache.org/jira/browse/HDFS-2535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13143369#comment-13143369 ] Tsz Wo (Nicholas), SZE commented on HDFS-2535: -- +1 great work!

[jira] [Commented] (HDFS-2535) A Model for Data Durability

[ https://issues.apache.org/jira/browse/HDFS-2535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13143370#comment-13143370 ] Milind Bhandarkar commented on HDFS-2535: - Rob, I think a convenient place for this

[jira] [Commented] (HDFS-2316) webhdfs: a complete FileSystem implementation for accessing HDFS over HTTP

[ https://issues.apache.org/jira/browse/HDFS-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13143418#comment-13143418 ] Alejandro Abdelnur commented on HDFS-2316: -- Any update on the open issues? I'd

[jira] [Commented] (HDFS-2505) Add a test to verify getFileChecksum works with ViewFS

[ https://issues.apache.org/jira/browse/HDFS-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13143438#comment-13143438 ] Jitendra Nath Pandey commented on HDFS-2505: Is it possible to have a similar

[jira] [Commented] (HDFS-2316) webhdfs: a complete FileSystem implementation for accessing HDFS over HTTP

[ https://issues.apache.org/jira/browse/HDFS-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13143452#comment-13143452 ] Tsz Wo (Nicholas), SZE commented on HDFS-2316: -- gethomedir is required as you

[jira] [Created] (HDFS-2536) FSImageTransactionalStorageInspector has a bunch of unused imports

FSImageTransactionalStorageInspector has a bunch of unused imports -- Key: HDFS-2536 URL: https://issues.apache.org/jira/browse/HDFS-2536 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-2316) webhdfs: a complete FileSystem implementation for accessing HDFS over HTTP

[ https://issues.apache.org/jira/browse/HDFS-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13143459#comment-13143459 ] Tsz Wo (Nicholas), SZE commented on HDFS-2316: -- FileStatus JSON payload has

[jira] [Commented] (HDFS-2316) webhdfs: a complete FileSystem implementation for accessing HDFS over HTTP

[ https://issues.apache.org/jira/browse/HDFS-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13143460#comment-13143460 ] Alejandro Abdelnur commented on HDFS-2316: -- * The user.name would have to be

[jira] [Created] (HDFS-2537) re-replicating under replicated blocks should be more dynamic

re-replicating under replicated blocks should be more dynamic - Key: HDFS-2537 URL: https://issues.apache.org/jira/browse/HDFS-2537 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-2316) webhdfs: a complete FileSystem implementation for accessing HDFS over HTTP

[ https://issues.apache.org/jira/browse/HDFS-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-2316: - Attachment: WebHdfsAPI2003.pdf WebHdfsAPI2003.pdf: added JSON and error

[jira] [Commented] (HDFS-2537) re-replicating under replicated blocks should be more dynamic

[ https://issues.apache.org/jira/browse/HDFS-2537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13143493#comment-13143493 ] Aaron T. Myers commented on HDFS-2537: -- +1, something to address this issue would be

[jira] [Commented] (HDFS-2527) Remove the use of Range header from webhdfs

[ https://issues.apache.org/jira/browse/HDFS-2527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13143499#comment-13143499 ] Jitendra Nath Pandey commented on HDFS-2527: Looks good to me. +1

[jira] [Commented] (HDFS-2316) webhdfs: a complete FileSystem implementation for accessing HDFS over HTTP

[ https://issues.apache.org/jira/browse/HDFS-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13143509#comment-13143509 ] Alejandro Abdelnur commented on HDFS-2316: -- Thanks for the updated PDF with the

[jira] [Commented] (HDFS-2316) webhdfs: a complete FileSystem implementation for accessing HDFS over HTTP

[ https://issues.apache.org/jira/browse/HDFS-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13143518#comment-13143518 ] Alejandro Abdelnur commented on HDFS-2316: -- bq. #2, the reason for using

[jira] [Commented] (HDFS-2537) re-replicating under replicated blocks should be more dynamic

[ https://issues.apache.org/jira/browse/HDFS-2537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13143525#comment-13143525 ] Nathan Roberts commented on HDFS-2537: -- IIRC, the basic algorithm for this is:

[jira] [Commented] (HDFS-1580) Add interface for generic Write Ahead Logging mechanisms

[ https://issues.apache.org/jira/browse/HDFS-1580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13143541#comment-13143541 ] Ivan Kelly commented on HDFS-1580: -- Local reruns of TestAbandonBlock passes cleanly. Seems

[jira] [Updated] (HDFS-2527) Remove the use of Range header from webhdfs

[ https://issues.apache.org/jira/browse/HDFS-2527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-2527: - Resolution: Fixed Fix Version/s: 0.23.1 0.24.0

[jira] [Commented] (HDFS-2527) Remove the use of Range header from webhdfs

[ https://issues.apache.org/jira/browse/HDFS-2527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13143580#comment-13143580 ] Hudson commented on HDFS-2527: -- Integrated in Hadoop-Hdfs-0.23-Commit #146 (See

[jira] [Commented] (HDFS-2527) Remove the use of Range header from webhdfs

[ https://issues.apache.org/jira/browse/HDFS-2527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13143581#comment-13143581 ] Hudson commented on HDFS-2527: -- Integrated in Hadoop-Common-0.23-Commit #147 (See

[jira] [Commented] (HDFS-2527) Remove the use of Range header from webhdfs

[ https://issues.apache.org/jira/browse/HDFS-2527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13143589#comment-13143589 ] Hudson commented on HDFS-2527: -- Integrated in Hadoop-Mapreduce-trunk-Commit #1267 (See

[jira] [Commented] (HDFS-2527) Remove the use of Range header from webhdfs

[ https://issues.apache.org/jira/browse/HDFS-2527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13143592#comment-13143592 ] Hudson commented on HDFS-2527: -- Integrated in Hadoop-Mapreduce-0.23-Commit #158 (See

[jira] [Commented] (HDFS-2528) webhdfs rest call to a secure dn fails when a token is sent

[ https://issues.apache.org/jira/browse/HDFS-2528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13143641#comment-13143641 ] Arpit Gupta commented on HDFS-2528: --- Also make a getdelegationtoken call and send no auth

[jira] [Updated] (HDFS-2531) TestDFSClientExcludedNodes is failing in trunk.

[ https://issues.apache.org/jira/browse/HDFS-2531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-2531: -- Status: Patch Available (was: Open) As Todd pointed out, problem could be because of

[jira] [Updated] (HDFS-2528) webhdfs rest call to a secure dn fails when a token is sent

[ https://issues.apache.org/jira/browse/HDFS-2528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-2528: - Attachment: h2528_2003.patch h2528_2003_0.20s.patch

[jira] [Resolved] (HDFS-2448) Fix the 2 release audit warnings in trunk.

[ https://issues.apache.org/jira/browse/HDFS-2448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G resolved HDFS-2448. --- Resolution: Cannot Reproduce Release Note: I don't see the release audit