[jira] [Updated] (HDFS-12745) Ozone: XceiverClientManager should cache objects based on pipeline name

2017-11-03 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12745: - Attachment: HDFS-12745-HDFS-7240.002.patch > Ozone: XceiverClientManager should cache obje

[jira] [Commented] (HDFS-10528) Add logging to successful standby checkpointing

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238765#comment-16238765 ] Hadoop QA commented on HDFS-10528: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10528) Add logging to successful standby checkpointing

2017-11-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238764#comment-16238764 ] Hudson commented on HDFS-10528: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Updated] (HDFS-10528) Add logging to successful standby checkpointing

2017-11-03 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10528: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.1.0 Status: Resolved (w

[jira] [Commented] (HDFS-10528) Add logging to successful standby checkpointing

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238725#comment-16238725 ] Hadoop QA commented on HDFS-10528: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12774) Ozone: OzoneClient: Moving OzoneException from hadoop-hdfs to hadoop-hdfs-client

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238694#comment-16238694 ] Hadoop QA commented on HDFS-12774: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12685) [READ] FsVolumeImpl exception when scanning Provided storage volume

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238690#comment-16238690 ] Hadoop QA commented on HDFS-12685: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-11-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238688#comment-16238688 ] Hudson commented on HDFS-12681: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-12607) [READ] Even one dead datanode with PROVIDED storage results in ProvidedStorageInfo being marked as FAILED

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238682#comment-16238682 ] Hadoop QA commented on HDFS-12607: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12594) SnapshotDiff - snapshotDiff fails if the snapshotDiff report exceeds the RPC response limit

2017-11-03 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238671#comment-16238671 ] Tsz Wo Nicholas Sze commented on HDFS-12594: For RemoteIterator, since there i

[jira] [Commented] (HDFS-12594) SnapshotDiff - snapshotDiff fails if the snapshotDiff report exceeds the RPC response limit

2017-11-03 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238670#comment-16238670 ] Tsz Wo Nicholas Sze commented on HDFS-12594: Some other comments on the patch.

[jira] [Created] (HDFS-12779) [READ] Allow cluster id to be specified to the Image generation tool

2017-11-03 Thread Virajith Jalaparti (JIRA)
Virajith Jalaparti created HDFS-12779: - Summary: [READ] Allow cluster id to be specified to the Image generation tool Key: HDFS-12779 URL: https://issues.apache.org/jira/browse/HDFS-12779 Project:

[jira] [Commented] (HDFS-12713) [READ] Refactor FileRegion and BlockAliasMap to separate out HDFS metadata and PROVIDED storage metadata

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238627#comment-16238627 ] Virajith Jalaparti commented on HDFS-12713: --- Please see [this comment|https://i

[jira] [Updated] (HDFS-12775) [READ] Fix reporting of Provided volumes

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12775: -- Description: Provided Volumes currently report infinite capacity and 0 space used. Furth

[jira] [Updated] (HDFS-12775) [READ] Fix reporting for Provided volumes

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12775: -- Summary: [READ] Fix reporting for Provided volumes (was: [READ] Fix capacity reporting

[jira] [Updated] (HDFS-12775) [READ] Fix reporting of Provided volumes

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12775: -- Summary: [READ] Fix reporting of Provided volumes (was: [READ] Fix reporting for Provid

[jira] [Updated] (HDFS-12777) [READ] Reduce memory and CPU footprint for PROVIDED volumes.

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12777: -- Description: As opposed to local blocks, each DN keeps track of all blocks in PROVIDED

[jira] [Updated] (HDFS-12777) [READ] Reduce memory and CPU footprint for PROVIDED volumes.

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12777: -- Description: As opposed to local blocks, each DN keeps track of all blocks in PROVIDED

[jira] [Updated] (HDFS-12777) [READ] Reduce memory and CPU footprint for PROVIDED volumes.

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12777: -- Summary: [READ] Reduce memory and CPU footprint for PROVIDED volumes. (was: [READ] Shar

[jira] [Updated] (HDFS-12777) [READ] Reduce memory and CPU footprint for PROVIDED volumes.

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12777: -- Description: As opposed to local blocks, each DN keeps track of all blocks in PROVIDED

[jira] [Created] (HDFS-12778) [READ] Report multiple locations for PROVIDED blocks

2017-11-03 Thread Virajith Jalaparti (JIRA)
Virajith Jalaparti created HDFS-12778: - Summary: [READ] Report multiple locations for PROVIDED blocks Key: HDFS-12778 URL: https://issues.apache.org/jira/browse/HDFS-12778 Project: Hadoop HDFS

[jira] [Created] (HDFS-12777) [READ] Share URI prefix across Provided blocks to lower memory footprint.

2017-11-03 Thread Virajith Jalaparti (JIRA)
Virajith Jalaparti created HDFS-12777: - Summary: [READ] Share URI prefix across Provided blocks to lower memory footprint. Key: HDFS-12777 URL: https://issues.apache.org/jira/browse/HDFS-12777 Pro

[jira] [Commented] (HDFS-11754) Make FsServerDefaults cache configurable.

2017-11-03 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238612#comment-16238612 ] Subru Krishnan commented on HDFS-11754: --- Moving out to 2.10.0 as 2.9.0 release is on

[jira] [Updated] (HDFS-11754) Make FsServerDefaults cache configurable.

2017-11-03 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated HDFS-11754: -- Target Version/s: 2.10.0 (was: 2.9.0) > Make FsServerDefaults cache configurable. > ---

[jira] [Commented] (HDFS-12774) Ozone: OzoneClient: Moving OzoneException from hadoop-hdfs to hadoop-hdfs-client

2017-11-03 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238598#comment-16238598 ] Xiaoyu Yao commented on HDFS-12774: --- Thanks [~nandakumar131] for the patch. It looks goo

[jira] [Commented] (HDFS-12474) Ozone: SCM: Handling container report with key count and container usage.

2017-11-03 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238597#comment-16238597 ] Xiaoyu Yao commented on HDFS-12474: --- [~nandakumar131], can you rebase the patch as it do

[jira] [Created] (HDFS-12776) [READ] Increasing replication for PROVIDED files should create local replicas

2017-11-03 Thread Virajith Jalaparti (JIRA)
Virajith Jalaparti created HDFS-12776: - Summary: [READ] Increasing replication for PROVIDED files should create local replicas Key: HDFS-12776 URL: https://issues.apache.org/jira/browse/HDFS-12776

[jira] [Created] (HDFS-12775) [READ] Fix capacity reporting for Provided volumes

2017-11-03 Thread Virajith Jalaparti (JIRA)
Virajith Jalaparti created HDFS-12775: - Summary: [READ] Fix capacity reporting for Provided volumes Key: HDFS-12775 URL: https://issues.apache.org/jira/browse/HDFS-12775 Project: Hadoop HDFS

[jira] [Updated] (HDFS-10467) Router-based HDFS federation

2017-11-03 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-10467: --- Fix Version/s: 2.9.0 > Router-based HDFS federation > > >

[jira] [Commented] (HDFS-9240) Use Builder pattern for BlockLocation constructors

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238580#comment-16238580 ] Hadoop QA commented on HDFS-9240: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238568#comment-16238568 ] Virajith Jalaparti commented on HDFS-12665: --- Hi [~ehiggs], thanks for posting th

[jira] [Updated] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-11-03 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12681: - Resolution: Fixed Assignee: Chris Douglas Fix Version/s: 3.1.0 Status: R

[jira] [Commented] (HDFS-12772) RBF: Track Router states

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238523#comment-16238523 ] Hadoop QA commented on HDFS-12772: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12734) Ozone: generate version specific documentation during the build

2017-11-03 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238520#comment-16238520 ] Anu Engineer commented on HDFS-12734: - Sorry, my bad, not in case of Jenkins builds bu

[jira] [Commented] (HDFS-12734) Ozone: generate version specific documentation during the build

2017-11-03 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238499#comment-16238499 ] Allen Wittenauer commented on HDFS-12734: - bq. The only thing this patch does is t

[jira] [Comment Edited] (HDFS-12734) Ozone: generate version specific documentation during the build

2017-11-03 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238486#comment-16238486 ] Anu Engineer edited comment on HDFS-12734 at 11/3/17 10:19 PM: -

[jira] [Commented] (HDFS-12734) Ozone: generate version specific documentation during the build

2017-11-03 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238486#comment-16238486 ] Anu Engineer commented on HDFS-12734: - bq.the requirements that we place on end users

[jira] [Commented] (HDFS-12734) Ozone: generate version specific documentation during the build

2017-11-03 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238467#comment-16238467 ] Allen Wittenauer commented on HDFS-12734: - bq. from the comments on that thread, i

[jira] [Commented] (HDFS-12759) Ozone: web: integrate configuration reader page to the SCM/KSM web ui.

2017-11-03 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238464#comment-16238464 ] Anu Engineer commented on HDFS-12759: - Looks like the patch failed because it ran agai

[jira] [Commented] (HDFS-12734) Ozone: generate version specific documentation during the build

2017-11-03 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238457#comment-16238457 ] Anu Engineer commented on HDFS-12734: - bq. HADOOP-14163 has been open for over 6 month

[jira] [Commented] (HDFS-12734) Ozone: generate version specific documentation during the build

2017-11-03 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238440#comment-16238440 ] Allen Wittenauer commented on HDFS-12734: - HADOOP-14163 has been open for over 6 m

[jira] [Updated] (HDFS-12685) [READ] FsVolumeImpl exception when scanning Provided storage volume

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12685: -- Attachment: HDFS-12685-HDFS-9806.002.patch Posting a patch that rebases the earlier patc

[jira] [Updated] (HDFS-12685) [READ] FsVolumeImpl exception when scanning Provided storage volume

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12685: -- Status: Patch Available (was: Open) > [READ] FsVolumeImpl exception when scanning Provi

[jira] [Updated] (HDFS-12685) [READ] FsVolumeImpl exception when scanning Provided storage volume

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12685: -- Status: Open (was: Patch Available) > [READ] FsVolumeImpl exception when scanning Provi

[jira] [Updated] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-11-03 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12681: - Hadoop Flags: Incompatible change,Reviewed Release Note: HdfsFileStatus is now a subtype of Loc

[jira] [Commented] (HDFS-12607) [READ] Even one dead datanode with PROVIDED storage results in ProvidedStorageInfo being marked as FAILED

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238423#comment-16238423 ] Virajith Jalaparti commented on HDFS-12607: --- Posting a rebased patch. It also re

[jira] [Updated] (HDFS-12607) [READ] Even one dead datanode with PROVIDED storage results in ProvidedStorageInfo being marked as FAILED

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12607: -- Status: Patch Available (was: Open) > [READ] Even one dead datanode with PROVIDED stora

[jira] [Comment Edited] (HDFS-12734) Ozone: generate version specific documentation during the build

2017-11-03 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238422#comment-16238422 ] Anu Engineer edited comment on HDFS-12734 at 11/3/17 9:30 PM: --

[jira] [Updated] (HDFS-12607) [READ] Even one dead datanode with PROVIDED storage results in ProvidedStorageInfo being marked as FAILED

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12607: -- Status: Open (was: Patch Available) > [READ] Even one dead datanode with PROVIDED stora

[jira] [Updated] (HDFS-12607) [READ] Even one dead datanode with PROVIDED storage results in ProvidedStorageInfo being marked as FAILED

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12607: -- Attachment: HDFS-12607-HDFS-9806.003.patch > [READ] Even one dead datanode with PROVIDED

[jira] [Commented] (HDFS-12734) Ozone: generate version specific documentation during the build

2017-11-03 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238422#comment-16238422 ] Anu Engineer commented on HDFS-12734: - bq. This is not an option. mvn site needs to be

[jira] [Commented] (HDFS-12774) Ozone: OzoneClient: Moving OzoneException from hadoop-hdfs to hadoop-hdfs-client

2017-11-03 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238418#comment-16238418 ] Nanda kumar commented on HDFS-12774: More info [here | https://issues.apache.org/jira

[jira] [Updated] (HDFS-12774) Ozone: OzoneClient: Moving OzoneException from hadoop-hdfs to hadoop-hdfs-client

2017-11-03 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDFS-12774: --- Status: Patch Available (was: Open) > Ozone: OzoneClient: Moving OzoneException from hadoop-hdfs to

[jira] [Updated] (HDFS-12774) Ozone: OzoneClient: Moving OzoneException from hadoop-hdfs to hadoop-hdfs-client

2017-11-03 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDFS-12774: --- Attachment: HDFS-12774-HDFS-7240.000.patch > Ozone: OzoneClient: Moving OzoneException from hadoop-hdf

[jira] [Commented] (HDFS-12685) [READ] FsVolumeImpl exception when scanning Provided storage volume

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238403#comment-16238403 ] Hadoop QA commented on HDFS-12685: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12734) Ozone: generate version specific documentation during the build

2017-11-03 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238400#comment-16238400 ] Allen Wittenauer commented on HDFS-12734: - bq. If hugo is not there the documentat

[jira] [Commented] (HDFS-11246) FSNameSystem#logAuditEvent should be called outside the read or write locks

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238387#comment-16238387 ] Hadoop QA commented on HDFS-11246: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10419) Building HDFS on top of Ozone's storage containers

2017-11-03 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238379#comment-16238379 ] Sanjay Radia commented on HDFS-10419: - HDFS-5389 describes one approach of building a

[jira] [Commented] (HDFS-12756) Ozone: Add datanodeID to heartbeat responses and container protocol

2017-11-03 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238376#comment-16238376 ] Nanda kumar commented on HDFS-12756: Thanks [~anu] for the update. The patch is not a

[jira] [Commented] (HDFS-12549) Ozone: OzoneClient: Support for REST protocol

2017-11-03 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238371#comment-16238371 ] Nanda kumar commented on HDFS-12549: Thanks [~xyao] for the review. bq. Please separa

[jira] [Commented] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

2017-11-03 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238362#comment-16238362 ] Íñigo Goiri commented on HDFS-7060: --- [^HDFS-7060.003.patch] removed both {{statsLock}} an

[jira] [Updated] (HDFS-12774) Ozone: OzoneClient: Moving OzoneException from hadoop-hdfs to hadoop-hdfs-client

2017-11-03 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDFS-12774: --- Description: {{OzoneException}} has to be used in hadoop-hdfs-client, since we cannot refer classes in

[jira] [Created] (HDFS-12774) Ozone: OzoneClient: Moving OzoneException from hadoop-hdfs to hadoop-hdfs-client

2017-11-03 Thread Nanda kumar (JIRA)
Nanda kumar created HDFS-12774: -- Summary: Ozone: OzoneClient: Moving OzoneException from hadoop-hdfs to hadoop-hdfs-client Key: HDFS-12774 URL: https://issues.apache.org/jira/browse/HDFS-12774 Project: H

[jira] [Updated] (HDFS-7240) Object store in HDFS

2017-11-03 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia updated HDFS-7240: --- Attachment: HDFS Scalability and Ozone.pdf I have added a document that explains a design for scaling H

[jira] [Commented] (HDFS-12685) [READ] FsVolumeImpl exception when scanning Provided storage volume

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238345#comment-16238345 ] Virajith Jalaparti commented on HDFS-12685: --- [~ehiggs], can you check if this pa

[jira] [Commented] (HDFS-12771) Add genstamp and block size to metasave Corrupt blocks list

2017-11-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238343#comment-16238343 ] Hudson commented on HDFS-12771: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Updated] (HDFS-12685) [READ] FsVolumeImpl exception when scanning Provided storage volume

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12685: -- Status: Patch Available (was: Open) > [READ] FsVolumeImpl exception when scanning Provi

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Resolution: Fixed Status: Resolved (was: Patch Available) > [READ] Merge BlockF

[jira] [Updated] (HDFS-12685) [READ] FsVolumeImpl exception when scanning Provided storage volume

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12685: -- Status: Open (was: Patch Available) > [READ] FsVolumeImpl exception when scanning Provi

[jira] [Assigned] (HDFS-12685) [READ] FsVolumeImpl exception when scanning Provided storage volume

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti reassigned HDFS-12685: - Assignee: Virajith Jalaparti > [READ] FsVolumeImpl exception when scanning Provid

[jira] [Commented] (HDFS-12745) Ozone: XceiverClientManager should cache objects based on pipeline name

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238337#comment-16238337 ] Hadoop QA commented on HDFS-12745: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238328#comment-16238328 ] Virajith Jalaparti commented on HDFS-11902: --- The checkstyle issues are from {{DF

[jira] [Commented] (HDFS-12772) RBF: Track Router states

2017-11-03 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238318#comment-16238318 ] Íñigo Goiri commented on HDFS-12772: Currently it has: * Router state (including State

[jira] [Updated] (HDFS-12772) RBF: Track Router states

2017-11-03 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12772: --- Attachment: HDFS-12772.000.patch > RBF: Track Router states > > >

[jira] [Updated] (HDFS-12772) RBF: Track Router states

2017-11-03 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12772: --- Assignee: Íñigo Goiri Status: Patch Available (was: Open) > RBF: Track Router states >

[jira] [Updated] (HDFS-12771) Add genstamp and block size to metasave Corrupt blocks list

2017-11-03 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-12771: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.1.0 3.0.0

[jira] [Commented] (HDFS-12771) Add genstamp and block size to metasave Corrupt blocks list

2017-11-03 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238289#comment-16238289 ] Kihwal Lee commented on HDFS-12771: --- +1 > Add genstamp and block size to metasave Corr

[jira] [Commented] (HDFS-12771) Add genstamp and block size to metasave Corrupt blocks list

2017-11-03 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238268#comment-16238268 ] Kuhu Shukla commented on HDFS-12771: [~kihwal], could you share any review comments fo

[jira] [Commented] (HDFS-11467) Support ErasureCoding section in OIV XML/ReverseXML

2017-11-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238265#comment-16238265 ] Hudson commented on HDFS-11467: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-12754) Lease renewal can hit a deadlock

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238244#comment-16238244 ] Hadoop QA commented on HDFS-12754: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Assigned] (HDFS-9240) Use Builder pattern for BlockLocation constructors

2017-11-03 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao reassigned HDFS-9240: Assignee: Virajith Jalaparti (was: Xiaoyu Yao) > Use Builder pattern for BlockLocation constructors

[jira] [Updated] (HDFS-11246) FSNameSystem#logAuditEvent should be called outside the read or write locks

2017-11-03 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-11246: --- Attachment: HDFS-11246.004.patch Revised patch addressing comments from Daryn. > FSNameSystem#logAudi

[jira] [Updated] (HDFS-11467) Support ErasureCoding section in OIV XML/ReverseXML

2017-11-03 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-11467: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status: Resolved (was

[jira] [Commented] (HDFS-11467) Support ErasureCoding section in OIV XML/ReverseXML

2017-11-03 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238187#comment-16238187 ] Xiao Chen commented on HDFS-11467: -- Committed to trunk and branch-3.0. Thanks [~HuafengW

[jira] [Commented] (HDFS-11467) Support ErasureCoding section in OIV XML/ReverseXML

2017-11-03 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238183#comment-16238183 ] Xiao Chen commented on HDFS-11467: -- +1 from me too, Ran failed tests locally, all passed.

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-11-03 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238181#comment-16238181 ] stack commented on HDFS-12711: -- bq. For now, though, I'm sort of tired at looking at this pro

[jira] [Commented] (HDFS-12771) Add genstamp and block size to metasave Corrupt blocks list

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238175#comment-16238175 ] Hadoop QA commented on HDFS-12771: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Comment Edited] (HDFS-9240) Use Builder pattern for BlockLocation constructors

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238168#comment-16238168 ] Virajith Jalaparti edited comment on HDFS-9240 at 11/3/17 6:50 PM: --

[jira] [Updated] (HDFS-9240) Use Builder pattern for BlockLocation constructors

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-9240: - Status: Patch Available (was: Open) > Use Builder pattern for BlockLocation constructors >

[jira] [Commented] (HDFS-9240) Use Builder pattern for BlockLocation constructors

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238168#comment-16238168 ] Virajith Jalaparti commented on HDFS-9240: -- Thanks for taking a look [~xyao]. Post

[jira] [Updated] (HDFS-9240) Use Builder pattern for BlockLocation constructors

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-9240: - Status: Open (was: Patch Available) > Use Builder pattern for BlockLocation constructors >

[jira] [Updated] (HDFS-9240) Use Builder pattern for BlockLocation constructors

2017-11-03 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-9240: - Attachment: HDFS-9240.002.patch > Use Builder pattern for BlockLocation constructors >

[jira] [Commented] (HDFS-12773) RBF: Improve State Store FS implementation

2017-11-03 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238117#comment-16238117 ] Íñigo Goiri commented on HDFS-12773: In addition to the safer FS implementation: * Add

[jira] [Updated] (HDFS-12773) RBF: Improve State Store FS implementation

2017-11-03 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12773: --- Attachment: HDFS-12773.000.patch > RBF: Improve State Store FS implementation > --

[jira] [Updated] (HDFS-12773) RBF: Improve State Store FS implementation

2017-11-03 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12773: --- Priority: Normal (was: Trivial) > RBF: Improve State Store FS implementation > --

[jira] [Updated] (HDFS-12773) RBF: Improve State Store FS implementation

2017-11-03 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12773: --- Assignee: Íñigo Goiri Status: Patch Available (was: Open) > RBF: Improve State Store FS impleme

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-11-03 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238107#comment-16238107 ] Allen Wittenauer commented on HDFS-12711: - Thanks! I'll have to play around with

[jira] [Updated] (HDFS-12772) RBF: Track Router states

2017-11-03 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12772: --- Affects Version/s: 3.0.0 > RBF: Track Router states > > > Key

[jira] [Commented] (HDFS-12763) DataStreamer should heartbeat during flush

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238081#comment-16238081 ] Hadoop QA commented on HDFS-12763: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-12772) RBF: Track Router states

2017-11-03 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12772: --- Description: To monitor the state of the cluster, we should track the state of the routers. This shoul

  1   2   >