[jira] [Commented] (HDFS-8057) Move BlockReader implementation to the client implementation package

[ https://issues.apache.org/jira/browse/HDFS-8057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15249390#comment-15249390 ] Hadoop QA commented on HDFS-8057: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-5280) Corrupted meta files on data nodes prevents DFClient from connecting to data nodes and updating corruption status to name node.

[ https://issues.apache.org/jira/browse/HDFS-5280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andres Perez updated HDFS-5280: --- Attachment: HDFS-5280.patch > Corrupted meta files on data nodes prevents DFClient from connecting to d

[jira] [Updated] (HDFS-5280) Corrupted meta files on data nodes prevents DFClient from connecting to data nodes and updating corruption status to name node.

[ https://issues.apache.org/jira/browse/HDFS-5280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andres Perez updated HDFS-5280: --- Affects Version/s: 3.0.0 Status: Patch Available (was: Open) The {{IllegalArgumentExcep

[jira] [Commented] (HDFS-9869) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-2]

[ https://issues.apache.org/jira/browse/HDFS-9869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15249372#comment-15249372 ] Andrew Wang commented on HDFS-9869: --- I like Zhe's proposal. I'd prefer to keep the old ke

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15249371#comment-15249371 ] Hadoop QA commented on HDFS-7859: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9869) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-2]

[ https://issues.apache.org/jira/browse/HDFS-9869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15249363#comment-15249363 ] Zhe Zhang commented on HDFS-9869: - bq. How about keeping only the recent property name | d

[jira] [Commented] (HDFS-10313) Distcp does not check the order of snapshot names passed to -diff

[ https://issues.apache.org/jira/browse/HDFS-10313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15249351#comment-15249351 ] Hadoop QA commented on HDFS-10313: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Comment Edited] (HDFS-10256) Use GenericTestUtils.getTestDir method in tests for temporary directories

[ https://issues.apache.org/jira/browse/HDFS-10256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15249340#comment-15249340 ] Vinayakumar B edited comment on HDFS-10256 at 4/20/16 6:09 AM: -

[jira] [Commented] (HDFS-10256) Use GenericTestUtils.getTestDir method in tests for temporary directories

[ https://issues.apache.org/jira/browse/HDFS-10256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15249340#comment-15249340 ] Vinayakumar B commented on HDFS-10256: -- bq. MiniDFSCluster#shutdown() registers base_

[jira] [Commented] (HDFS-10308) TestRetryCacheWithHA#testRetryCacheOnStandbyNN failing

[ https://issues.apache.org/jira/browse/HDFS-10308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15249321#comment-15249321 ] Rakesh R commented on HDFS-10308: - Thanks [~brahmareddy] > TestRetryCacheWithHA#testRetry

[jira] [Commented] (HDFS-9958) BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages.

[ https://issues.apache.org/jira/browse/HDFS-9958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15249312#comment-15249312 ] Walter Su commented on HDFS-9958: - bq. we fix countNodes().corruptReplicas() to return the

[jira] [Updated] (HDFS-10313) Distcp does not check the order of snapshot names passed to -diff

[ https://issues.apache.org/jira/browse/HDFS-10313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-10313: - Attachment: HDFS-10313.001.patch > Distcp does not check the order of snapshot names passed to -diff > ---

[jira] [Updated] (HDFS-10313) Distcp does not check the order of snapshot names passed to -diff

[ https://issues.apache.org/jira/browse/HDFS-10313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-10313: - Attachment: (was: HDFS-10313.001.patch) > Distcp does not check the order of snapshot names passed to

[jira] [Commented] (HDFS-10312) Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction.

[ https://issues.apache.org/jira/browse/HDFS-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15249302#comment-15249302 ] Chris Nauroth commented on HDFS-10312: -- The remaining Checkstyle warning is for a lon

[jira] [Commented] (HDFS-10312) Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction.

[ https://issues.apache.org/jira/browse/HDFS-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15249299#comment-15249299 ] Chris Nauroth commented on HDFS-10312: -- It appears the discussions in those other JIR

[jira] [Commented] (HDFS-10308) TestRetryCacheWithHA#testRetryCacheOnStandbyNN failing

[ https://issues.apache.org/jira/browse/HDFS-10308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15249290#comment-15249290 ] Brahma Reddy Battula commented on HDFS-10308: - [~rakeshr] thanks for reporting

[jira] [Commented] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15249288#comment-15249288 ] Jitendra Nath Pandey commented on HDFS-9276: [~daryn] are you planning to revie

[jira] [Resolved] (HDFS-10315) Fix TestRetryCacheWithHA and TestNamenodeRetryCache failures

[ https://issues.apache.org/jira/browse/HDFS-10315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula resolved HDFS-10315. - Resolution: Duplicate > Fix TestRetryCacheWithHA and TestNamenodeRetryCache failur

[jira] [Created] (HDFS-10316) revisit corrupt replicas count

Walter Su created HDFS-10316: Summary: revisit corrupt replicas count Key: HDFS-10316 URL: https://issues.apache.org/jira/browse/HDFS-10316 Project: Hadoop HDFS Issue Type: Bug Report

[jira] [Commented] (HDFS-10313) Distcp does not check the order of snapshot names passed to -diff

[ https://issues.apache.org/jira/browse/HDFS-10313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15249281#comment-15249281 ] Hadoop QA commented on HDFS-10313: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10308) TestRetryCacheWithHA#testRetryCacheOnStandbyNN failing

[ https://issues.apache.org/jira/browse/HDFS-10308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15249276#comment-15249276 ] Rakesh R commented on HDFS-10308: - Test failure is unrelated to my patch, please ignore it

[jira] [Commented] (HDFS-10265) OEV tool fails to read edit xml file if OP_UPDATE_BLOCKS has no BLOCK tag

[ https://issues.apache.org/jira/browse/HDFS-10265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15249258#comment-15249258 ] Rakesh R commented on HDFS-10265: - Thanks [~brahmareddy]. Yesterday I've raised a jira HDF

[jira] [Updated] (HDFS-10313) Distcp does not check the order of snapshot names passed to -diff

[ https://issues.apache.org/jira/browse/HDFS-10313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-10313: - Attachment: HDFS-10313.001.patch Sorry, the previous is not completed, update a latest patch. > Distcp do

[jira] [Updated] (HDFS-10313) Distcp does not check the order of snapshot names passed to -diff

[ https://issues.apache.org/jira/browse/HDFS-10313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-10313: - Attachment: (was: HDFS-10313.001.patch) > Distcp does not check the order of snapshot names passed to

[jira] [Commented] (HDFS-10312) Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction.

[ https://issues.apache.org/jira/browse/HDFS-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15249247#comment-15249247 ] Brahma Reddy Battula commented on HDFS-10312: - We've seen same issue and repor

[jira] [Commented] (HDFS-10313) Distcp does not check the order of snapshot names passed to -diff

[ https://issues.apache.org/jira/browse/HDFS-10313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15249235#comment-15249235 ] Hadoop QA commented on HDFS-10313: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-8057) Move BlockReader implementation to the client implementation package

[ https://issues.apache.org/jira/browse/HDFS-8057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-8057: --- Status: Patch Available (was: Open) > Move BlockReader implementation to the client implementa

[jira] [Updated] (HDFS-8057) Move BlockReader implementation to the client implementation package

[ https://issues.apache.org/jira/browse/HDFS-8057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HDFS-8057: --- Attachment: HDFS-8057.1.patch Hi, [~szetszwo] I'm sorry for leaving this jira so long time. I'

[jira] [Updated] (HDFS-10313) Distcp does not check the order of snapshot names passed to -diff

[ https://issues.apache.org/jira/browse/HDFS-10313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-10313: - Attachment: HDFS-10313.001.patch > Distcp does not check the order of snapshot names passed to -diff > ---

[jira] [Updated] (HDFS-10313) Distcp does not check the order of snapshot names passed to -diff

[ https://issues.apache.org/jira/browse/HDFS-10313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-10313: - Status: Patch Available (was: Open) Attach a initial patch from me, thanks review. > Distcp does not che

[jira] [Created] (HDFS-10315) Fix TestRetryCacheWithHA and TestNamenodeRetryCache failures

Brahma Reddy Battula created HDFS-10315: --- Summary: Fix TestRetryCacheWithHA and TestNamenodeRetryCache failures Key: HDFS-10315 URL: https://issues.apache.org/jira/browse/HDFS-10315 Project: Had

[jira] [Updated] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinwei Qin updated HDFS-7859: -- Attachment: HDFS-7859.004.patch Rebase the patch with the latest trunk. > Erasure Coding: Persist erasur

[jira] [Commented] (HDFS-10265) OEV tool fails to read edit xml file if OP_UPDATE_BLOCKS has no BLOCK tag

[ https://issues.apache.org/jira/browse/HDFS-10265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15249220#comment-15249220 ] Brahma Reddy Battula commented on HDFS-10265: - Following two testcases are fai

[jira] [Commented] (HDFS-8449) Add tasks count metrics to datanode for ECWorker

[ https://issues.apache.org/jira/browse/HDFS-8449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15249133#comment-15249133 ] Kai Zheng commented on HDFS-8449: - Some comments. Could you help check? Thanks Bo. 1. In {{

[jira] [Commented] (HDFS-9530) huge Non-DFS Used in hadoop 2.6.2 & 2.7.1

[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15249142#comment-15249142 ] Ravi Prakash commented on HDFS-9530: Perhaps we can postpone the question of whether RB

[jira] [Commented] (HDFS-10312) Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction.

[ https://issues.apache.org/jira/browse/HDFS-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15249123#comment-15249123 ] Hadoop QA commented on HDFS-10312: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10313) Distcp does not check the order of snapshot names passed to -diff

[ https://issues.apache.org/jira/browse/HDFS-10313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15249114#comment-15249114 ] Lin Yiqun commented on HDFS-10313: -- Hi, [~yzhangal], I will upload a initial patch later.

[jira] [Assigned] (HDFS-10313) Distcp does not check the order of snapshot names passed to -diff

[ https://issues.apache.org/jira/browse/HDFS-10313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun reassigned HDFS-10313: Assignee: Lin Yiqun > Distcp does not check the order of snapshot names passed to -diff > -

[jira] [Commented] (HDFS-10312) Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction.

[ https://issues.apache.org/jira/browse/HDFS-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15249106#comment-15249106 ] Hadoop QA commented on HDFS-10312: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10312) Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction.

[ https://issues.apache.org/jira/browse/HDFS-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15249060#comment-15249060 ] Hadoop QA commented on HDFS-10312: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10312) Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction.

[ https://issues.apache.org/jira/browse/HDFS-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15249030#comment-15249030 ] Arpit Agarwal commented on HDFS-10312: -- Yeah I agree that is rather unfortunate since

[jira] [Commented] (HDFS-10312) Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction.

[ https://issues.apache.org/jira/browse/HDFS-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15249007#comment-15249007 ] Hadoop QA commented on HDFS-10312: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-9943) Support reconfiguring namenode replication confs

[ https://issues.apache.org/jira/browse/HDFS-9943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15248996#comment-15248996 ] Hadoop QA commented on HDFS-9943: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-10312) Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction.

[ https://issues.apache.org/jira/browse/HDFS-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15248984#comment-15248984 ] Chris Nauroth commented on HDFS-10312: -- [~arpitagarwal], I like your suggestion for s

[jira] [Comment Edited] (HDFS-9530) huge Non-DFS Used in hadoop 2.6.2 & 2.7.1

[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15248968#comment-15248968 ] Arpit Agarwal edited comment on HDFS-9530 at 4/19/16 11:57 PM: --

[jira] [Commented] (HDFS-9530) huge Non-DFS Used in hadoop 2.6.2 & 2.7.1

[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15248968#comment-15248968 ] Arpit Agarwal commented on HDFS-9530: - Thanks for continuing to work on this [~brahmare

[jira] [Commented] (HDFS-10225) DataNode hot swap drives should recognize storage type tags.

[ https://issues.apache.org/jira/browse/HDFS-10225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15248950#comment-15248950 ] Colin Patrick McCabe commented on HDFS-10225: - It seems cleaner to remove the

[jira] [Commented] (HDFS-10312) Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction.

[ https://issues.apache.org/jira/browse/HDFS-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15248947#comment-15248947 ] Arpit Agarwal commented on HDFS-10312: -- Pasting the delta inline to avoid confusing J

[jira] [Updated] (HDFS-10312) Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction.

[ https://issues.apache.org/jira/browse/HDFS-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10312: - Attachment: (was: test-delta.patch) > Large block reports may fail to decode at NameNode due t

[jira] [Commented] (HDFS-10312) Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction.

[ https://issues.apache.org/jira/browse/HDFS-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15248935#comment-15248935 ] Hadoop QA commented on HDFS-10312: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-10312) Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction.

[ https://issues.apache.org/jira/browse/HDFS-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10312: - Attachment: test-delta.patch Hi [~cnauroth], +1 for the v4 patch. Thanks for this improvement. Th

[jira] [Commented] (HDFS-10175) add per-operation stats to FileSystem.Statistics

[ https://issues.apache.org/jira/browse/HDFS-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15248877#comment-15248877 ] Colin Patrick McCabe commented on HDFS-10175: - I'll take a look tomorrow, [~li

[jira] [Updated] (HDFS-10312) Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction.

[ https://issues.apache.org/jira/browse/HDFS-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-10312: - Attachment: HDFS-10312.004.patch Patch v004 addresses the Checkstyle warnings. > Large block repo

[jira] [Commented] (HDFS-10312) Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction.

[ https://issues.apache.org/jira/browse/HDFS-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15248830#comment-15248830 ] Hadoop QA commented on HDFS-10312: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10312) Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction.

[ https://issues.apache.org/jira/browse/HDFS-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15248813#comment-15248813 ] Chris Nauroth commented on HDFS-10312: -- Yes, that's going to be a small change, but t

[jira] [Comment Edited] (HDFS-10314) Propose a new tool that wraps around distcp to "restore" changes on target cluster

[ https://issues.apache.org/jira/browse/HDFS-10314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15248778#comment-15248778 ] Yongjun Zhang edited comment on HDFS-10314 at 4/19/16 10:31 PM:

[jira] [Commented] (HDFS-9894) Add unsetStoragePolicy API to FileContext/AbstractFileSystem and derivatives

[ https://issues.apache.org/jira/browse/HDFS-9894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15248810#comment-15248810 ] Xiaobing Zhou commented on HDFS-9894: - The patch v000 is posted, please kindly review,

[jira] [Updated] (HDFS-10304) Implement moveToLocal

[ https://issues.apache.org/jira/browse/HDFS-10304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10304: - Status: Patch Available (was: Open) > Implement moveToLocal > - > >

[jira] [Updated] (HDFS-9894) Add unsetStoragePolicy API to FileContext/AbstractFileSystem and derivatives

[ https://issues.apache.org/jira/browse/HDFS-9894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9894: Attachment: HDFS-9894.000.patch > Add unsetStoragePolicy API to FileContext/AbstractFileSystem and de

[jira] [Updated] (HDFS-9894) Add unsetStoragePolicy API to FileContext/AbstractFileSystem and derivatives

[ https://issues.apache.org/jira/browse/HDFS-9894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9894: Status: Patch Available (was: Open) > Add unsetStoragePolicy API to FileContext/AbstractFileSystem a

[jira] [Commented] (HDFS-10312) Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction.

[ https://issues.apache.org/jira/browse/HDFS-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15248807#comment-15248807 ] Mingliang Liu commented on HDFS-10312: -- Shall we create a new jira for this? > Large

[jira] [Commented] (HDFS-10207) Support enable Hadoop IPC backoff without namenode restart

[ https://issues.apache.org/jira/browse/HDFS-10207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15248798#comment-15248798 ] Xiaoyu Yao commented on HDFS-10207: --- [~xiaobingo], thanks for updating the patch. Here a

[jira] [Updated] (HDFS-10312) Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction.

[ https://issues.apache.org/jira/browse/HDFS-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-10312: - Attachment: HDFS-10312.003.patch Here is patch v003 with one more change in the test. I found tha

[jira] [Commented] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15248797#comment-15248797 ] Yongjun Zhang commented on HDFS-9820: - Many thanks to [~jingzhao] for the offline discu

[jira] [Commented] (HDFS-10175) add per-operation stats to FileSystem.Statistics

[ https://issues.apache.org/jira/browse/HDFS-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15248792#comment-15248792 ] Mingliang Liu commented on HDFS-10175: -- Hi [~cmccabe], would you kindly have a look a

[jira] [Comment Edited] (HDFS-10314) Propose a new tool that wraps around distcp to "restore" changes on target cluster

[ https://issues.apache.org/jira/browse/HDFS-10314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15248778#comment-15248778 ] Yongjun Zhang edited comment on HDFS-10314 at 4/19/16 10:13 PM:

[jira] [Commented] (HDFS-10314) Propose a new tool that wraps around distcp to "restore" changes on target cluster

[ https://issues.apache.org/jira/browse/HDFS-10314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15248784#comment-15248784 ] Yongjun Zhang commented on HDFS-10314: -- Hi [~jingzhao], I'm thinking about implement

[jira] [Commented] (HDFS-10314) Propose a new tool that wraps around distcp to "restore" changes on target cluster

[ https://issues.apache.org/jira/browse/HDFS-10314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15248778#comment-15248778 ] Yongjun Zhang commented on HDFS-10314: -- The idea is the wrap around distcp as a tool

[jira] [Commented] (HDFS-9016) Display upgrade domain information in fsck

[ https://issues.apache.org/jira/browse/HDFS-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15248774#comment-15248774 ] Andrew Wang commented on HDFS-9016: --- I'm okay with the config flag, since it only affects

[jira] [Updated] (HDFS-10314) Propose a new tool that wraps around distcp to "restore" changes on target cluster

[ https://issues.apache.org/jira/browse/HDFS-10314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-10314: - Description: HDFS-9820 proposed adding -rdiff switch to distcp, as a reversed operation of -diff

[jira] [Created] (HDFS-10314) Propose a new tool that wraps around distcp to "restore" changes on target cluster

Yongjun Zhang created HDFS-10314: Summary: Propose a new tool that wraps around distcp to "restore" changes on target cluster Key: HDFS-10314 URL: https://issues.apache.org/jira/browse/HDFS-10314 Proj

[jira] [Created] (HDFS-10313) Distcp does not check the order of snapshot names passed to -diff

Yongjun Zhang created HDFS-10313: Summary: Distcp does not check the order of snapshot names passed to -diff Key: HDFS-10313 URL: https://issues.apache.org/jira/browse/HDFS-10313 Project: Hadoop HDFS

[jira] [Updated] (HDFS-10312) Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction.

[ https://issues.apache.org/jira/browse/HDFS-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-10312: - Attachment: HDFS-10312.002.patch [~liuml07] and [~xyao], thank you for the code reviews. That's a

[jira] [Commented] (HDFS-9943) Support reconfiguring namenode replication confs

[ https://issues.apache.org/jira/browse/HDFS-9943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15248716#comment-15248716 ] Xiaobing Zhou commented on HDFS-9943: - v002 is rebased on trunk. > Support reconfiguri

[jira] [Updated] (HDFS-9943) Support reconfiguring namenode replication confs

[ https://issues.apache.org/jira/browse/HDFS-9943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9943: Attachment: HDFS-9943-HDFS-9000.002.patch > Support reconfiguring namenode replication confs > --

[jira] [Commented] (HDFS-10312) Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction.

[ https://issues.apache.org/jira/browse/HDFS-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15248713#comment-15248713 ] Mingliang Liu commented on HDFS-10312: -- +1 (non-binding) One nit is that, in the uni

[jira] [Commented] (HDFS-10312) Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction.

[ https://issues.apache.org/jira/browse/HDFS-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15248712#comment-15248712 ] Xiaoyu Yao commented on HDFS-10312: --- As a follow up, I suggest we document this *ipc.max

[jira] [Commented] (HDFS-10312) Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction.

[ https://issues.apache.org/jira/browse/HDFS-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15248696#comment-15248696 ] Xiaoyu Yao commented on HDFS-10312: --- Thanks [~cnauroth] for posting the fix along with y

[jira] [Commented] (HDFS-10304) Implement moveToLocal

[ https://issues.apache.org/jira/browse/HDFS-10304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15248606#comment-15248606 ] Xiaobing Zhou commented on HDFS-10304: -- I posted the patch v000, please kindly review

[jira] [Updated] (HDFS-10304) Implement moveToLocal

[ https://issues.apache.org/jira/browse/HDFS-10304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10304: - Attachment: HDFS-10304.000.patch > Implement moveToLocal > - > >

[jira] [Commented] (HDFS-10304) Implement moveToLocal

[ https://issues.apache.org/jira/browse/HDFS-10304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15248601#comment-15248601 ] Xiaobing Zhou commented on HDFS-10304: -- Sorry [~steve_l], I mean it's the way I am go

[jira] [Updated] (HDFS-10304) Implement moveToLocal

[ https://issues.apache.org/jira/browse/HDFS-10304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10304: - Summary: Implement moveToLocal (was: implement moveToLocal) > Implement moveToLocal > ---

[jira] [Updated] (HDFS-10304) implement moveToLocal

[ https://issues.apache.org/jira/browse/HDFS-10304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10304: - Summary: implement moveToLocal (was: implement moveToLocal or remove it from the usage list) > i

[jira] [Updated] (HDFS-10312) Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction.

[ https://issues.apache.org/jira/browse/HDFS-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-10312: - Status: Patch Available (was: Open) > Large block reports may fail to decode at NameNode due to 6

[jira] [Updated] (HDFS-10312) Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction.

[ https://issues.apache.org/jira/browse/HDFS-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-10312: - Attachment: HDFS-10312.001.patch The attached patch passes the value of {{ipc.maximum.data.length}

[jira] [Commented] (HDFS-10312) Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction.

[ https://issues.apache.org/jira/browse/HDFS-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15248577#comment-15248577 ] Chris Nauroth commented on HDFS-10312: -- I saw this happen with a block report from a

[jira] [Created] (HDFS-10312) Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction.

Chris Nauroth created HDFS-10312: Summary: Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction. Key: HDFS-10312 URL: https://issues.apache.org/jira/browse/HDFS-10312

[jira] [Created] (HDFS-10311) libhdfs++: DatanodeConnection::Cancel should not delete the underlying socket

James Clampffer created HDFS-10311: -- Summary: libhdfs++: DatanodeConnection::Cancel should not delete the underlying socket Key: HDFS-10311 URL: https://issues.apache.org/jira/browse/HDFS-10311 Proje

[jira] [Created] (HDFS-10310) libhdfs++: hdfsConnect needs timeout logic

James Clampffer created HDFS-10310: -- Summary: libhdfs++: hdfsConnect needs timeout logic Key: HDFS-10310 URL: https://issues.apache.org/jira/browse/HDFS-10310 Project: Hadoop HDFS Issue Type

[jira] [Comment Edited] (HDFS-10276) Different results for exist call for file.ext/name

[ https://issues.apache.org/jira/browse/HDFS-10276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15248402#comment-15248402 ] Colin Patrick McCabe edited comment on HDFS-10276 at 4/19/16 6:49 PM: --

[jira] [Commented] (HDFS-10276) Different results for exist call for file.ext/name

[ https://issues.apache.org/jira/browse/HDFS-10276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15248402#comment-15248402 ] Colin Patrick McCabe commented on HDFS-10276: - bq. Thanks a lot for your comme

[jira] [Updated] (HDFS-7240) Object store in HDFS

[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-7240: --- Attachment: ozone_user_v0.pdf Proposed user interfaces for Ozone. Documentation of REST and CLI interfa

[jira] [Commented] (HDFS-10264) Logging improvements in FSImageFormatProtobuf.Saver

[ https://issues.apache.org/jira/browse/HDFS-10264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15248379#comment-15248379 ] Hudson commented on HDFS-10264: --- FAILURE: Integrated in Hadoop-trunk-Commit #9634 (See [htt

[jira] [Updated] (HDFS-10309) HDFS Balancer doesn't honor dfs.blocksize value defined with suffix k(kilo), m(mega), g(giga)

[ https://issues.apache.org/jira/browse/HDFS-10309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Anand updated HDFS-10309: -- Description: While running HDFS Balancer I get error given below when {{dfs.blockSize}} is defined with

[jira] [Updated] (HDFS-10264) Logging improvements in FSImageFormatProtobuf.Saver

[ https://issues.apache.org/jira/browse/HDFS-10264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10264: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.3 Target Versi

[jira] [Updated] (HDFS-10264) Logging improvements in FSImageFormatProtobuf.Saver

[ https://issues.apache.org/jira/browse/HDFS-10264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10264: - Issue Type: Improvement (was: Bug) > Logging improvements in FSImageFormatProtobuf.Saver > --

[jira] [Commented] (HDFS-10264) Logging improvements in FSImageFormatProtobuf.Saver

[ https://issues.apache.org/jira/browse/HDFS-10264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15248357#comment-15248357 ] Arpit Agarwal commented on HDFS-10264: -- +1 I will commit this shortly. > Logging imp

[jira] [Created] (HDFS-10309) HDFS Balancer doesn't honor dfs.blocksize value defined with suffix k(kilo), m(mega), g(giga)

Amit Anand created HDFS-10309: - Summary: HDFS Balancer doesn't honor dfs.blocksize value defined with suffix k(kilo), m(mega), g(giga) Key: HDFS-10309 URL: https://issues.apache.org/jira/browse/HDFS-10309

[jira] [Commented] (HDFS-10264) Logging improvements in FSImageFormatProtobuf.Saver

[ https://issues.apache.org/jira/browse/HDFS-10264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15248333#comment-15248333 ] Xiaobing Zhou commented on HDFS-10264: -- I verified the test failures are not related

[jira] [Commented] (HDFS-10308) TestRetryCacheWithHA#testRetryCacheOnStandbyNN failing

[ https://issues.apache.org/jira/browse/HDFS-10308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15248037#comment-15248037 ] Hadoop QA commented on HDFS-10308: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

  1   2   >