[jira] [Commented] (HDFS-8058) Erasure coding: use BlockInfo[] for both striped and contiguous blocks in INodeFile

2015-07-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14623237#comment-14623237 ] Zhe Zhang commented on HDFS-8058: - {{testTruncateWithDataNodesRestartImmediately}} failed w

[jira] [Commented] (HDFS-8744) Erasure Coding: the number of chunks in packet is not updated when writing parity data

2015-07-10 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14623235#comment-14623235 ] Walter Su commented on HDFS-8744: - You're right. I read DFSPacket carefully. Sorry, my prev

[jira] [Commented] (HDFS-8286) Scaling out the namespace using KV store

2015-07-10 Thread Yong Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14623205#comment-14623205 ] Yong Zhang commented on HDFS-8286: -- If HDFS keep metadata in a persistent KV store, such a

[jira] [Commented] (HDFS-8677) Ozone: Introduce KeyValueContainerDatasetSpi

2015-07-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14623204#comment-14623204 ] Hadoop QA commented on HDFS-8677: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8058) Erasure coding: use BlockInfo[] for both striped and contiguous blocks in INodeFile

2015-07-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14623201#comment-14623201 ] Hadoop QA commented on HDFS-8058: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8622) Implement GETCONTENTSUMMARY operation for WebImageViewe

2015-07-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14623192#comment-14623192 ] Hadoop QA commented on HDFS-8622: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8717) OzoneHandler : Add common bucket objects

2015-07-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14623172#comment-14623172 ] Hadoop QA commented on HDFS-8717: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8677) Ozone: Introduce KeyValueContainerDatasetSpi

2015-07-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14623169#comment-14623169 ] Hadoop QA commented on HDFS-8677: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Comment Edited] (HDFS-8745) Use Doxygen to generate documents for libhdfspp

2015-07-10 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14623118#comment-14623118 ] Haohui Mai edited comment on HDFS-8745 at 7/11/15 12:23 AM: bq.

[jira] [Commented] (HDFS-8745) Use Doxygen to generate documents for libhdfspp

2015-07-10 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14623118#comment-14623118 ] Haohui Mai commented on HDFS-8745: -- bq. I get that, but they need to get put in a place th

[jira] [Commented] (HDFS-8745) Use Doxygen to generate documents for libhdfspp

2015-07-10 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14623116#comment-14623116 ] Allen Wittenauer commented on HDFS-8745: I guess I'll just block this when it comes

[jira] [Commented] (HDFS-8744) Erasure Coding: the number of chunks in packet is not updated when writing parity data

2015-07-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14623112#comment-14623112 ] Jing Zhao commented on HDFS-8744: - But I think this is the format of the current packet: {c

[jira] [Updated] (HDFS-8759) Implement remote block reader in libhdfspp

2015-07-10 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8759: - Attachment: HDFS-8759.000.patch > Implement remote block reader in libhdfspp >

[jira] [Updated] (HDFS-8758) Implement the continuation library for libhdfspp

2015-07-10 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8758: - Attachment: HDFS-8758.000.patch > Implement the continuation library for libhdfspp > --

[jira] [Updated] (HDFS-8725) Use std::chrono to implement the timer in the asio library

2015-07-10 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8725: - Hadoop Flags: Reviewed > Use std::chrono to implement the timer in the asio library > -

[jira] [Updated] (HDFS-8724) Import third_party libraries into the repository

2015-07-10 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8724: - Hadoop Flags: Reviewed > Import third_party libraries into the repository > ---

[jira] [Resolved] (HDFS-8745) Use Doxygen to generate documents for libhdfspp

2015-07-10 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HDFS-8745. -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-8707 Target Version/

[jira] [Updated] (HDFS-8723) Integrate the build infrastructure with hdfs-client

2015-07-10 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8723: - Hadoop Flags: Reviewed > Integrate the build infrastructure with hdfs-client >

[jira] [Resolved] (HDFS-8737) Initial implementation of a Hadoop RPC v9 client

2015-07-10 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HDFS-8737. -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-8707 Target Version/

[jira] [Commented] (HDFS-8745) Use Doxygen to generate documents for libhdfspp

2015-07-10 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14623098#comment-14623098 ] Allen Wittenauer commented on HDFS-8745: bq. The generated documentation is similar

[jira] [Updated] (HDFS-8737) Initial implementation of a Hadoop RPC v9 client

2015-07-10 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8737: - Description: This jira tracks the initial effort of implementing a Hadoop RPC v9 client. Currently the cli

[jira] [Updated] (HDFS-8737) Initial implementation of a Hadoop RPC v9 client

2015-07-10 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8737: - Summary: Initial implementation of a Hadoop RPC v9 client (was: Implement the Hadoop RPC v9 protocol) > I

[jira] [Commented] (HDFS-8737) Implement the Hadoop RPC v9 protocol

2015-07-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14623092#comment-14623092 ] Jing Zhao commented on HDFS-8737: - The patch looks good to me. But looks like this is just

[jira] [Commented] (HDFS-8745) Use Doxygen to generate documents for libhdfspp

2015-07-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14623088#comment-14623088 ] Jing Zhao commented on HDFS-8745: - +1 > Use Doxygen to generate documents for libhdfspp >

[jira] [Commented] (HDFS-8745) Use Doxygen to generate documents for libhdfspp

2015-07-10 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14623086#comment-14623086 ] Haohui Mai commented on HDFS-8745: -- The generated documentation is similar to what we have

[jira] [Created] (HDFS-8760) Erasure Coding: reuse BlockReader when reading the same block in pread

2015-07-10 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-8760: --- Summary: Erasure Coding: reuse BlockReader when reading the same block in pread Key: HDFS-8760 URL: https://issues.apache.org/jira/browse/HDFS-8760 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8694) Expose the stats of IOErrors on each FsVolume through JMX

2015-07-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14623085#comment-14623085 ] Hadoop QA commented on HDFS-8694: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8745) Use Doxygen to generate documents for libhdfspp

2015-07-10 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8745: - Attachment: HDFS-8745.001.patch > Use Doxygen to generate documents for libhdfspp > ---

[jira] [Created] (HDFS-8759) Implement remote block reader in libhdfspp

2015-07-10 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-8759: Summary: Implement remote block reader in libhdfspp Key: HDFS-8759 URL: https://issues.apache.org/jira/browse/HDFS-8759 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-8744) Erasure Coding: the number of chunks in packet is not updated when writing parity data

2015-07-10 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14623082#comment-14623082 ] Walter Su commented on HDFS-8744: - Similarly, packet_1 should has 2 chunks. > Erasure Codi

[jira] [Commented] (HDFS-8744) Erasure Coding: the number of chunks in packet is not updated when writing parity data

2015-07-10 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14623080#comment-14623080 ] Walter Su commented on HDFS-8744: - I mean packet_0 should has 126 chunks, every chunk has 4

[jira] [Created] (HDFS-8758) Implement the continuation library for libhdfspp

2015-07-10 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-8758: Summary: Implement the continuation library for libhdfspp Key: HDFS-8758 URL: https://issues.apache.org/jira/browse/HDFS-8758 Project: Hadoop HDFS Issue Type: Sub-ta

[jira] [Commented] (HDFS-8702) Erasure coding: update BlockManager.blockHasEnoughRacks(..) logic for striped block

2015-07-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14623049#comment-14623049 ] Jing Zhao commented on HDFS-8702: - Thanks for working on this, [~kaisasak]! Here are the co

[jira] [Commented] (HDFS-4746) ClassCastException in BlockManager.addStoredBlock() due to that blockReceived came after file was closed.

2015-07-10 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14623039#comment-14623039 ] Aaron T. Myers commented on HDFS-4746: -- Should we go ahead and close out this JIRA, si

[jira] [Updated] (HDFS-8677) Ozone: Introduce KeyValueContainerDatasetSpi

2015-07-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8677: Attachment: HDFS-8677-HDFS-7240.04.patch Thanks, the intended behavior is just as you described. v04

[jira] [Updated] (HDFS-8058) Erasure coding: use BlockInfo[] for both striped and contiguous blocks in INodeFile

2015-07-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8058: Attachment: HDFS-8058-HDFS-7285.005.patch Thanks Walter for the additional review. Attaching updated patch.

[jira] [Commented] (HDFS-8677) Ozone: Introduce KeyValueContainerDatasetSpi

2015-07-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14623005#comment-14623005 ] Anu Engineer commented on HDFS-8677: Looks good, thanks. +1. Please feel free to check

[jira] [Commented] (HDFS-8755) Fix typos in hadoop-hdfs-project module

2015-07-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14623004#comment-14623004 ] Hadoop QA commented on HDFS-8755: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Comment Edited] (HDFS-8677) Ozone: Introduce KeyValueContainerDatasetSpi

2015-07-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622960#comment-14622960 ] Arpit Agarwal edited comment on HDFS-8677 at 7/10/15 10:14 PM: --

[jira] [Updated] (HDFS-8677) Ozone: Introduce KeyValueContainerDatasetSpi

2015-07-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8677: Attachment: HDFS-8677-HDFS-7240.03.patch > Ozone: Introduce KeyValueContainerDatasetSpi > ---

[jira] [Commented] (HDFS-8677) Ozone: Introduce KeyValueContainerDatasetSpi

2015-07-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622960#comment-14622960 ] Arpit Agarwal commented on HDFS-8677: - Thanks for the detailed reviews! [~kanaka]

[jira] [Updated] (HDFS-8677) Ozone: Introduce KeyValueContainerDatasetSpi

2015-07-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8677: Attachment: HDFS-8677-HDFS-7240.02.patch > Ozone: Introduce KeyValueContainerDatasetSpi > ---

[jira] [Commented] (HDFS-8727) Allow using path style addressing for accessing the s3 endpoint

2015-07-10 Thread Andrew Baptist (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622942#comment-14622942 ] Andrew Baptist commented on HDFS-8727: -- After further testing, it appears that the Ama

[jira] [Commented] (HDFS-8751) Remove setBlocks API from INodeFile and misc code cleanup

2015-07-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622915#comment-14622915 ] Hudson commented on HDFS-8751: -- FAILURE: Integrated in Hadoop-trunk-Commit #8149 (See [https:

[jira] [Updated] (HDFS-7483) Display information per tier on the Namenode UI

2015-07-10 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated HDFS-7483: --- Attachment: withTwoStorageType.png withOneStorageType.png HDFS-7483-002.

[jira] [Updated] (HDFS-8751) Remove setBlocks API from INodeFile and misc code cleanup

2015-07-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8751: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) I've commit

[jira] [Updated] (HDFS-8756) OzoneHandler : Enable stand-alone local testing mode

2015-07-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-8756: --- Summary: OzoneHandler : Enable stand-alone local testing mode (was: OzoneHandler : Enable stand-alone

[jira] [Created] (HDFS-8757) OzoneHandler : Add localStorageHandler support for Buckets

2015-07-10 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-8757: -- Summary: OzoneHandler : Add localStorageHandler support for Buckets Key: HDFS-8757 URL: https://issues.apache.org/jira/browse/HDFS-8757 Project: Hadoop HDFS Issu

[jira] [Created] (HDFS-8756) OzoneHandler : Enable stand-alone local testing more

2015-07-10 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-8756: -- Summary: OzoneHandler : Enable stand-alone local testing more Key: HDFS-8756 URL: https://issues.apache.org/jira/browse/HDFS-8756 Project: Hadoop HDFS Issue Type

[jira] [Commented] (HDFS-8755) Fix typos in hadoop-hdfs-project module

2015-07-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622875#comment-14622875 ] Hadoop QA commented on HDFS-8755: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8751) Remove setBlocks API from INodeFile and misc code cleanup

2015-07-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622861#comment-14622861 ] Zhe Zhang commented on HDFS-8751: - Thanks Jing for reviewing! {{testDatanodeRestarts}} is u

[jira] [Commented] (HDFS-8751) Remove setBlocks API from INodeFile and misc code cleanup

2015-07-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622855#comment-14622855 ] Hadoop QA commented on HDFS-8751: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8722) Optimize datanode writes for small writes and flushes

2015-07-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622825#comment-14622825 ] Arpit Agarwal commented on HDFS-8722: - Nice catch. A quick test shows ~15% throughput r

[jira] [Updated] (HDFS-8722) Optimize datanode writes for small writes and flushes

2015-07-10 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-8722: - Affects Version/s: 2.7.1 > Optimize datanode writes for small writes and flushes >

[jira] [Updated] (HDFS-8622) Implement GETCONTENTSUMMARY operation for WebImageViewe

2015-07-10 Thread Jagadesh Kiran N (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagadesh Kiran N updated HDFS-8622: --- Status: Patch Available (was: Open) > Implement GETCONTENTSUMMARY operation for WebImageViewe

[jira] [Updated] (HDFS-8717) OzoneHandler : Add common bucket objects

2015-07-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-8717: --- Status: Patch Available (was: Open) > OzoneHandler : Add common bucket objects > -

[jira] [Commented] (HDFS-7608) hdfs dfsclient newConnectedPeer has no write timeout

2015-07-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622721#comment-14622721 ] Colin Patrick McCabe commented on HDFS-7608: [~esteban], [~cnauroth]: I took an

[jira] [Updated] (HDFS-8680) OzoneHandler : Add Local StorageHandler support for volumes

2015-07-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8680: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status: Resol

[jira] [Moved] (HDFS-8755) Fix typos in hadoop-hdfs-project module

2015-07-10 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang moved HADOOP-12220 to HDFS-8755: --- Affects Version/s: (was: 2.7.1) 2.7.1

[jira] [Commented] (HDFS-8744) Erasure Coding: the number of chunks in packet is not updated when writing parity data

2015-07-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622683#comment-14622683 ] Jing Zhao commented on HDFS-8744: - bq. packet_0 has 504 checksum + 64512 data bq. packet_1

[jira] [Commented] (HDFS-8677) Ozone: Introduce KeyValueContainerDatasetSpi

2015-07-10 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622676#comment-14622676 ] Anu Engineer commented on HDFS-8677: Thanks for the patch. I am very excited to see thi

[jira] [Commented] (HDFS-8751) Remove setBlocks API from INodeFile and misc code cleanup

2015-07-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622655#comment-14622655 ] Jing Zhao commented on HDFS-8751: - +1 pending Jenkins. > Remove setBlocks API from INodeFi

[jira] [Commented] (HDFS-8742) Inotify: Support event for OP_TRUNCATE

2015-07-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622639#comment-14622639 ] Hadoop QA commented on HDFS-8742: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8751) Remove setBlocks API from INodeFile and misc code cleanup

2015-07-10 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8751: Attachment: HDFS-8751.01.patch Thanks Rakesh for reviewing the patch! Updating the patch to address the the

[jira] [Commented] (HDFS-8680) OzoneHandler : Add Local StorageHandler support for volumes

2015-07-10 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622558#comment-14622558 ] Chris Nauroth commented on HDFS-8680: - +1 from me too. Thanks, Anu and Arpit! > Ozone

[jira] [Resolved] (HDFS-8752) OzoneHandler : Add Volume Interface to Data Node HTTP Server

2015-07-10 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-8752. - Resolution: Duplicate > OzoneHandler : Add Volume Interface to Data Node HTTP Server >

[jira] [Commented] (HDFS-8752) OzoneHandler : Add Volume Interface to Data Node HTTP Server

2015-07-10 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622531#comment-14622531 ] Chris Nauroth commented on HDFS-8752: - Hello [~kanaka]. This effort is tracked in HDFS

[jira] [Updated] (HDFS-8622) Implement GETCONTENTSUMMARY operation for WebImageViewe

2015-07-10 Thread Jagadesh Kiran N (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jagadesh Kiran N updated HDFS-8622: --- Attachment: HDFS-8622-00.patch Please find the Patch attached ,Review the same and let me know

[jira] [Commented] (HDFS-8745) Use Doxygen to generate documents for libhdfspp

2015-07-10 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622504#comment-14622504 ] Allen Wittenauer commented on HDFS-8745: Also, how does this documentation get inte

[jira] [Commented] (HDFS-8745) Use Doxygen to generate documents for libhdfspp

2015-07-10 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622499#comment-14622499 ] Allen Wittenauer commented on HDFS-8745: This needs to update building.txt to list

[jira] [Commented] (HDFS-8729) Fix testTruncateWithDataNodesRestartImmediately occasionally failed

2015-07-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622432#comment-14622432 ] Hudson commented on HDFS-8729: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #250 (See

[jira] [Commented] (HDFS-8749) Fix findbugs warning in BlockManager.java

2015-07-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622431#comment-14622431 ] Hudson commented on HDFS-8749: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #250 (See

[jira] [Commented] (HDFS-2956) calling fetchdt without a --renewer argument throws NPE

2015-07-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622436#comment-14622436 ] Hudson commented on HDFS-2956: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #250 (See

[jira] [Updated] (HDFS-8754) Create logger and replay tool for libhdfspp

2015-07-10 Thread Ke Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ke Yang updated HDFS-8754: -- Description: Create a logger for libhdfspp and an external replay tool to replay all file accesses. So we can rep

[jira] [Created] (HDFS-8754) Create logger and replay tool for libhdfs++

2015-07-10 Thread Ke Yang (JIRA)
Ke Yang created HDFS-8754: - Summary: Create logger and replay tool for libhdfs++ Key: HDFS-8754 URL: https://issues.apache.org/jira/browse/HDFS-8754 Project: Hadoop HDFS Issue Type: New Feature

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-07-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622405#comment-14622405 ] Hadoop QA commented on HDFS-8578: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8750) FIleSystem does not honor Configuration.getClassLoader() while loading FileSystem implementations

2015-07-10 Thread Himanshu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Himanshu updated HDFS-8750: --- Attachment: HDFS-8750.001.patch > FIleSystem does not honor Configuration.getClassLoader() while loading > Fil

[jira] [Commented] (HDFS-8749) Fix findbugs warning in BlockManager.java

2015-07-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622368#comment-14622368 ] Hudson commented on HDFS-8749: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #240 (See [htt

[jira] [Commented] (HDFS-8729) Fix testTruncateWithDataNodesRestartImmediately occasionally failed

2015-07-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622369#comment-14622369 ] Hudson commented on HDFS-8729: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #240 (See [htt

[jira] [Commented] (HDFS-2956) calling fetchdt without a --renewer argument throws NPE

2015-07-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622373#comment-14622373 ] Hudson commented on HDFS-2956: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #240 (See [htt

[jira] [Commented] (HDFS-8742) Inotify: Support event for OP_TRUNCATE

2015-07-10 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622352#comment-14622352 ] Surendra Singh Lilhore commented on HDFS-8742: -- Attached initial patch , Pleas

[jira] [Updated] (HDFS-8742) Inotify: Support event for OP_TRUNCATE

2015-07-10 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-8742: - Status: Patch Available (was: Open) > Inotify: Support event for OP_TRUNCATE > ---

[jira] [Updated] (HDFS-8742) Inotify: Support event for OP_TRUNCATE

2015-07-10 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-8742: - Attachment: HDFS-8742.patch > Inotify: Support event for OP_TRUNCATE >

[jira] [Commented] (HDFS-8750) FIleSystem does not honor Configuration.getClassLoader() while loading FileSystem implementations

2015-07-10 Thread Himanshu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622349#comment-14622349 ] Himanshu commented on HDFS-8750: BTW, I understand that this is a corner case and Druid com

[jira] [Commented] (HDFS-8750) FIleSystem does not honor Configuration.getClassLoader() while loading FileSystem implementations

2015-07-10 Thread Himanshu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622338#comment-14622338 ] Himanshu commented on HDFS-8750: Druid (http://druid.io/) provides pluggable "deep storage"

[jira] [Commented] (HDFS-8729) Fix testTruncateWithDataNodesRestartImmediately occasionally failed

2015-07-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622297#comment-14622297 ] Hudson commented on HDFS-8729: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2198 (See [htt

[jira] [Commented] (HDFS-2956) calling fetchdt without a --renewer argument throws NPE

2015-07-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622301#comment-14622301 ] Hudson commented on HDFS-2956: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2198 (See [htt

[jira] [Commented] (HDFS-8749) Fix findbugs warning in BlockManager.java

2015-07-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622296#comment-14622296 ] Hudson commented on HDFS-8749: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2198 (See [htt

[jira] [Commented] (HDFS-8729) Fix testTruncateWithDataNodesRestartImmediately occasionally failed

2015-07-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622287#comment-14622287 ] Hudson commented on HDFS-8729: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2179 (See [https://

[jira] [Commented] (HDFS-2956) calling fetchdt without a --renewer argument throws NPE

2015-07-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622291#comment-14622291 ] Hudson commented on HDFS-2956: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2179 (See [https://

[jira] [Commented] (HDFS-8749) Fix findbugs warning in BlockManager.java

2015-07-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622286#comment-14622286 ] Hudson commented on HDFS-8749: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2179 (See [https://

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-07-10 Thread Raju Bairishetti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622262#comment-14622262 ] Raju Bairishetti commented on HDFS-8578: +1(non-binding) for the latest patch. >

[jira] [Updated] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-07-10 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8578: Attachment: HDFS-8578-04.patch Attached the patch, for using the max dataDirs size threads and Min 1.

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-07-10 Thread Raju Bairishetti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622209#comment-14622209 ] Raju Bairishetti commented on HDFS-8578: [~amareshwari] yes, we should go with the

[jira] [Commented] (HDFS-8495) Consolidate append() related implementation into a single class

2015-07-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622186#comment-14622186 ] Hadoop QA commented on HDFS-8495: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-07-10 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622180#comment-14622180 ] Amareshwari Sriramadasu commented on HDFS-8578: --- Go with number of total volu

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-07-10 Thread Raju Bairishetti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622173#comment-14622173 ] Raju Bairishetti commented on HDFS-8578: Thanks [~vinayrpet] for the quick response

[jira] [Commented] (HDFS-8677) Ozone: Introduce KeyValueContainerDatasetSpi

2015-07-10 Thread kanaka kumar avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622165#comment-14622165 ] kanaka kumar avvaru commented on HDFS-8677: --- Thanks for the patch [~arpitagarwal]

[jira] [Commented] (HDFS-8682) Should not remove decommissioned node,while calculating the number of live/dead decommissioned node.

2015-07-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622139#comment-14622139 ] Hadoop QA commented on HDFS-8682: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-2956) calling fetchdt without a --renewer argument throws NPE

2015-07-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14622135#comment-14622135 ] Hudson commented on HDFS-2956: -- FAILURE: Integrated in Hadoop-trunk-Commit #8147 (See [https:

  1   2   >