[jira] [Updated] (HDFS-8539) Hdfs doesnt have class 'debug' in windows

[ https://issues.apache.org/jira/browse/HDFS-8539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-8539: --- Attachment: hdfs-8539.001.patch hand tested on windows C:\testsite\hadoop-3.0.0-SNAPSHOT\bin>hdfs.cmd

[jira] [Updated] (HDFS-8539) Hdfs doesnt have class 'debug' in windows

[ https://issues.apache.org/jira/browse/HDFS-8539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-8539: --- Status: Patch Available (was: Open) > Hdfs doesnt have class 'debug' in windows >

[jira] [Commented] (HDFS-8116) RollingWindowManager#getTopUserForMetric should check if LOG.isDebugEnabled() before LOG.debug()

[ https://issues.apache.org/jira/browse/HDFS-8116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575615#comment-14575615 ] Xiaoyu Yao commented on HDFS-8116: -- +1 > RollingWindowManager#getTopUserForMetric should

[jira] [Assigned] (HDFS-8553) Document hdfs class path options

[ https://issues.apache.org/jira/browse/HDFS-8553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula reassigned HDFS-8553: -- Assignee: Brahma Reddy Battula > Document hdfs class path options >

[jira] [Commented] (HDFS-8116) RollingWindowManager#getTopUserForMetric should check if LOG.isDebugEnabled() before LOG.debug()

[ https://issues.apache.org/jira/browse/HDFS-8116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575614#comment-14575614 ] Brahma Reddy Battula commented on HDFS-8116: [~xyao] Now I attached the correct

[jira] [Updated] (HDFS-8116) RollingWindowManager#getTopUserForMetric should check if LOG.isDebugEnabled() before LOG.debug()

[ https://issues.apache.org/jira/browse/HDFS-8116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-8116: --- Attachment: HDFS-8116-002.patch > RollingWindowManager#getTopUserForMetric should check

[jira] [Created] (HDFS-8553) Document hdfs class path options

Xiaoyu Yao created HDFS-8553: Summary: Document hdfs class path options Key: HDFS-8553 URL: https://issues.apache.org/jira/browse/HDFS-8553 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-8116) RollingWindowManager#getTopUserForMetric should check if LOG.isDebugEnabled() before LOG.debug()

[ https://issues.apache.org/jira/browse/HDFS-8116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-8116: --- Attachment: (was: HDFS-8116-002.patch) > RollingWindowManager#getTopUserForMetric s

[jira] [Created] (HDFS-8552) Fix hdfs namenode CLI usage message and its document

Xiaoyu Yao created HDFS-8552: Summary: Fix hdfs namenode CLI usage message and its document Key: HDFS-8552 URL: https://issues.apache.org/jira/browse/HDFS-8552 Project: Hadoop HDFS Issue Type: Bu

[jira] [Created] (HDFS-8551) Fix hdfs datanode CLI usage message

Xiaoyu Yao created HDFS-8551: Summary: Fix hdfs datanode CLI usage message Key: HDFS-8551 URL: https://issues.apache.org/jira/browse/HDFS-8551 Project: Hadoop HDFS Issue Type: Bug Affects Ver

[jira] [Commented] (HDFS-8116) RollingWindowManager#getTopUserForMetric should check if LOG.isDebugEnabled() before LOG.debug()

[ https://issues.apache.org/jira/browse/HDFS-8116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575605#comment-14575605 ] Xiaoyu Yao commented on HDFS-8116: -- You may also remove the unnecessary empty line. The fi

[jira] [Commented] (HDFS-8116) RollingWindowManager#getTopUserForMetric should check if LOG.isDebugEnabled() before LOG.debug()

[ https://issues.apache.org/jira/browse/HDFS-8116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575602#comment-14575602 ] Xiaoyu Yao commented on HDFS-8116: -- [~brahmareddy], patch 002 seems to be the same as the

[jira] [Updated] (HDFS-8116) RollingWindowManager#getTopUserForMetric should check if LOG.isDebugEnabled() before LOG.debug()

[ https://issues.apache.org/jira/browse/HDFS-8116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-8116: --- Labels: (was: BB2015-05-TBR) > RollingWindowManager#getTopUserForMetric should check

[jira] [Commented] (HDFS-8116) RollingWindowManager#getTopUserForMetric should check if LOG.isDebugEnabled() before LOG.debug()

[ https://issues.apache.org/jira/browse/HDFS-8116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575593#comment-14575593 ] Brahma Reddy Battula commented on HDFS-8116: [~xyao] kindly review!! > Rolling

[jira] [Updated] (HDFS-8116) RollingWindowManager#getTopUserForMetric should check if LOG.isDebugEnabled() before LOG.debug()

[ https://issues.apache.org/jira/browse/HDFS-8116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-8116: --- Attachment: HDFS-8116-002.patch > RollingWindowManager#getTopUserForMetric should check

[jira] [Commented] (HDFS-8116) RollingWindowManager#getTopUserForMetric should check if LOG.isDebugEnabled() before LOG.debug()

[ https://issues.apache.org/jira/browse/HDFS-8116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575587#comment-14575587 ] Xiaoyu Yao commented on HDFS-8116: -- Can you reduce the 2 extra leading spaces of your chan

[jira] [Commented] (HDFS-8386) Improve synchronization of 'streamer' reference in DFSOutputStream

[ https://issues.apache.org/jira/browse/HDFS-8386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575579#comment-14575579 ] Rakesh R commented on HDFS-8386: Thank you [~szetszwo] for the detailed explanation. I got

[jira] [Created] (HDFS-8550) Erasure Coding: Fix FindBugs Multithreaded correctness Warning

Rakesh R created HDFS-8550: -- Summary: Erasure Coding: Fix FindBugs Multithreaded correctness Warning Key: HDFS-8550 URL: https://issues.apache.org/jira/browse/HDFS-8550 Project: Hadoop HDFS Issue T

[jira] [Commented] (HDFS-8337) httpfs doesn't work with creates from a jar with kerberos

[ https://issues.apache.org/jira/browse/HDFS-8337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575569#comment-14575569 ] Yongjun Zhang commented on HDFS-8337: - Found two issues: 1. HttpFSAuthenticationFilter

[jira] [Updated] (HDFS-8548) Minicluster throws NPE on shutdown

[ https://issues.apache.org/jira/browse/HDFS-8548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] surendra singh lilhore updated HDFS-8548: - Status: Patch Available (was: Open) > Minicluster throws NPE on shutdown > ---

[jira] [Updated] (HDFS-8548) Minicluster throws NPE on shutdown

[ https://issues.apache.org/jira/browse/HDFS-8548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] surendra singh lilhore updated HDFS-8548: - Attachment: HDFS-8548.patch sorry , updated description by mistake. {{BlocksMap.si

[jira] [Updated] (HDFS-8337) httpfs doesn't work with creates from a jar with kerberos

[ https://issues.apache.org/jira/browse/HDFS-8337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-8337: Component/s: webhdfs security > httpfs doesn't work with creates from a jar with ker

[jira] [Updated] (HDFS-8337) httpfs doesn't work with creates from a jar with kerberos

[ https://issues.apache.org/jira/browse/HDFS-8337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-8337: Attachment: HDFS-8337.001.patch > httpfs doesn't work with creates from a jar with kerberos > ---

[jira] [Updated] (HDFS-8337) httpfs doesn't work with creates from a jar with kerberos

[ https://issues.apache.org/jira/browse/HDFS-8337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-8337: Status: Patch Available (was: Open) > httpfs doesn't work with creates from a jar with kerberos > --

[jira] [Commented] (HDFS-8116) RollingWindowManager#getTopUserForMetric should check if LOG.isDebugEnabled() before LOG.debug()

[ https://issues.apache.org/jira/browse/HDFS-8116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575558#comment-14575558 ] Brahma Reddy Battula commented on HDFS-8116: [~xyao] agree with you..Kindly rev

[jira] [Assigned] (HDFS-8548) Minicluster throws NPE on shutdown

[ https://issues.apache.org/jira/browse/HDFS-8548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] surendra singh lilhore reassigned HDFS-8548: Assignee: surendra singh lilhore > Minicluster throws NPE on shutdown >

[jira] [Updated] (HDFS-8548) Minicluster throws NPE on shutdown

[ https://issues.apache.org/jira/browse/HDFS-8548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] surendra singh lilhore updated HDFS-8548: - Description: FtAfter running Solr tests, when we attempt to shut down the mini clus

[jira] [Commented] (HDFS-8396) NPE exception can be thrown in DatanodeManager#sortLocatedBlocks

[ https://issues.apache.org/jira/browse/HDFS-8396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575541#comment-14575541 ] Yongjun Zhang commented on HDFS-8396: - Thanks [~surendrasingh] and [~cnauroth], it's in

[jira] [Resolved] (HDFS-8396) NPE exception can be thrown in DatanodeManager#sortLocatedBlocks

[ https://issues.apache.org/jira/browse/HDFS-8396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang resolved HDFS-8396. - Resolution: Duplicate > NPE exception can be thrown in DatanodeManager#sortLocatedBlocks >

[jira] [Updated] (HDFS-8522) Change heavily recorded NN logs from INFO to DEBUG level

[ https://issues.apache.org/jira/browse/HDFS-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8522: - Resolution: Fixed Fix Version/s: 2.7.1 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Commented] (HDFS-8546) Use try with resources in DataStorage and Storage

[ https://issues.apache.org/jira/browse/HDFS-8546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575485#comment-14575485 ] Tsz Wo Nicholas Sze commented on HDFS-8546: --- - There is still a double try-statem

[jira] [Commented] (HDFS-8546) Use try with resources in DataStorage and Storage

[ https://issues.apache.org/jira/browse/HDFS-8546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575484#comment-14575484 ] Hadoop QA commented on HDFS-8546: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8546) Use try with resources in DataStorage and Storage

[ https://issues.apache.org/jira/browse/HDFS-8546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575473#comment-14575473 ] Hadoop QA commented on HDFS-8546: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8522) Change heavily recorded NN logs from INFO to DEBUG level

[ https://issues.apache.org/jira/browse/HDFS-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575459#comment-14575459 ] Arpit Agarwal commented on HDFS-8522: - +1 > Change heavily recorded NN logs from INFO

[jira] [Updated] (HDFS-8522) Change heavily recorded NN logs from INFO to DEBUG level

[ https://issues.apache.org/jira/browse/HDFS-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8522: - Attachment: HDFS-8522.branch-2.01.patch Thanks [~arpitagarwal] again for the review. branch-2.01.patch addr

[jira] [Updated] (HDFS-8546) Use try with resources in DataStorage and Storage

[ https://issues.apache.org/jira/browse/HDFS-8546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8546: -- Attachment: HDFS-8546.003.patch Thanks for reviewing Nicholas. I did that in writeProperties because I di

[jira] [Commented] (HDFS-8522) Change heavily recorded NN logs from INFO to DEBUG level

[ https://issues.apache.org/jira/browse/HDFS-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575451#comment-14575451 ] Arpit Agarwal commented on HDFS-8522: - The truncate log level is info in the branch-2 p

[jira] [Updated] (HDFS-8549) Abort the balancer if an upgrade is in progress

[ https://issues.apache.org/jira/browse/HDFS-8549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8549: -- Attachment: HDFS-8549.001.patch Patch attached. > Abort the balancer if an upgrade is in progress >

[jira] [Created] (HDFS-8549) Abort the balancer if an upgrade is in progress

Andrew Wang created HDFS-8549: - Summary: Abort the balancer if an upgrade is in progress Key: HDFS-8549 URL: https://issues.apache.org/jira/browse/HDFS-8549 Project: Hadoop HDFS Issue Type: Impro

[jira] [Updated] (HDFS-8522) Change heavily recorded NN logs from INFO to DEBUG level

[ https://issues.apache.org/jira/browse/HDFS-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8522: - Attachment: HDFS-8522.branch-2.00.patch Thanks [~arpitagarwal] for reviewing the branch-2.7 patch. Attach

[jira] [Commented] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575434#comment-14575434 ] Hadoop QA commented on HDFS-7923: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575423#comment-14575423 ] Hadoop QA commented on HDFS-7923: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8522) Change heavily recorded NN logs from INFO to DEBUG level

[ https://issues.apache.org/jira/browse/HDFS-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575412#comment-14575412 ] Arpit Agarwal commented on HDFS-8522: - +1 for the branch-2.7 patch. > Change heavily r

[jira] [Updated] (HDFS-8522) Change heavily recorded NN logs from INFO to DEBUG level

[ https://issues.apache.org/jira/browse/HDFS-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8522: - Attachment: HDFS-8522.branch-2.7.00.patch Attach a patch for branch-2.7, please review. Thanks! > Change h

[jira] [Commented] (HDFS-8386) Improve synchronization of 'streamer' reference in DFSOutputStream

[ https://issues.apache.org/jira/browse/HDFS-8386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575386#comment-14575386 ] Tsz Wo Nicholas Sze commented on HDFS-8386: --- It is fine to do refactoring in trun

[jira] [Commented] (HDFS-8546) Use try with resources in DataStorage and Storage

[ https://issues.apache.org/jira/browse/HDFS-8546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575382#comment-14575382 ] Tsz Wo Nicholas Sze commented on HDFS-8546: --- When using try-with-resources, we do

[jira] [Commented] (HDFS-8246) Get HDFS file name based on block pool id and block id

[ https://issues.apache.org/jira/browse/HDFS-8246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575381#comment-14575381 ] Tsz Wo Nicholas Sze commented on HDFS-8246: --- Thanks for the info. I think the ne

[jira] [Commented] (HDFS-8522) Change heavily recorded NN logs from INFO to DEBUG level

[ https://issues.apache.org/jira/browse/HDFS-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575350#comment-14575350 ] Hudson commented on HDFS-8522: -- SUCCESS: Integrated in Hadoop-trunk-Commit #7980 (See [https:

[jira] [Commented] (HDFS-8522) Change heavily recorded NN logs from INFO to DEBUG level

[ https://issues.apache.org/jira/browse/HDFS-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575348#comment-14575348 ] Hadoop QA commented on HDFS-8522: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8246) Get HDFS file name based on block pool id and block id

[ https://issues.apache.org/jira/browse/HDFS-8246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575343#comment-14575343 ] feng xu commented on HDFS-8246: --- At least this feature can help security software in local fi

[jira] [Commented] (HDFS-8450) Erasure Coding: Consolidate erasure coding zone related implementation into a single class

[ https://issues.apache.org/jira/browse/HDFS-8450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575334#comment-14575334 ] Kai Zheng commented on HDFS-8450: - Sounds great. Thanks! > Erasure Coding: Consolidate era

[jira] [Created] (HDFS-8548) Minicluster throws NPE on shutdown

Mike Drob created HDFS-8548: --- Summary: Minicluster throws NPE on shutdown Key: HDFS-8548 URL: https://issues.apache.org/jira/browse/HDFS-8548 Project: Hadoop HDFS Issue Type: Bug Affects Versio

[jira] [Commented] (HDFS-8522) Change heavily recorded NN logs from INFO to DEBUG level

[ https://issues.apache.org/jira/browse/HDFS-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575329#comment-14575329 ] Arpit Agarwal commented on HDFS-8522: - +1 for the v3 patch, pending Jenkins. > Change

[jira] [Updated] (HDFS-8522) Change heavily recorded NN logs from INFO to DEBUG level

[ https://issues.apache.org/jira/browse/HDFS-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8522: - Summary: Change heavily recorded NN logs from INFO to DEBUG level (was: Change heavily recorded NN logs fr

[jira] [Updated] (HDFS-8522) Change heavily recorded NN logs from INFO level to DEBUG level

[ https://issues.apache.org/jira/browse/HDFS-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8522: - Attachment: HDFS-8522.03.patch The only delta from .02->.03 is to revert unnecessary change at FSNamesyste

[jira] [Commented] (HDFS-8522) Change heavily recorded NN logs from INFO level to DEBUG level

[ https://issues.apache.org/jira/browse/HDFS-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575301#comment-14575301 ] Xiaoyu Yao commented on HDFS-8522: -- I don't add test because this is a log only changes. T

[jira] [Commented] (HDFS-8432) Introduce a minimum compatible layout version to allow downgrade in more rolling upgrade use cases.

[ https://issues.apache.org/jira/browse/HDFS-8432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575274#comment-14575274 ] Arpit Agarwal commented on HDFS-8432: - +1 for the branch-2 patch. I diff'ed it wrt the

[jira] [Commented] (HDFS-8547) The space reservation for RBW block is leaking

[ https://issues.apache.org/jira/browse/HDFS-8547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575259#comment-14575259 ] Arpit Agarwal commented on HDFS-8547: - Hi Kihwal, dup of HDFS-8072? > The space reserv

[jira] [Updated] (HDFS-8547) The space reservation for RBW block is leaking

[ https://issues.apache.org/jira/browse/HDFS-8547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-8547: - Description: HDFS-6898 added the feature to reserve space on datanode when creating RBW replicas. We have

[jira] [Commented] (HDFS-8433) blockToken is not set in constructInternalBlock and parseStripedBlockGroup in StripedBlockUtil

[ https://issues.apache.org/jira/browse/HDFS-8433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575254#comment-14575254 ] Zhe Zhang commented on HDFS-8433: - Thanks Walter for the work. # The overall approach of us

[jira] [Created] (HDFS-8547) The space reservation for RBW block is leaking

Kihwal Lee created HDFS-8547: Summary: The space reservation for RBW block is leaking Key: HDFS-8547 URL: https://issues.apache.org/jira/browse/HDFS-8547 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-8546) Use try with resources in DataStorage and Storage

[ https://issues.apache.org/jira/browse/HDFS-8546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8546: -- Attachment: HDFS-8546.002.patch Looking at it more, I realized that copying the dncp log over on upgrade

[jira] [Created] (HDFS-8546) Use try with resources in DataStorage and Storage

Andrew Wang created HDFS-8546: - Summary: Use try with resources in DataStorage and Storage Key: HDFS-8546 URL: https://issues.apache.org/jira/browse/HDFS-8546 Project: Hadoop HDFS Issue Type: Imp

[jira] [Updated] (HDFS-8546) Use try with resources in DataStorage and Storage

[ https://issues.apache.org/jira/browse/HDFS-8546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8546: -- Attachment: HDFS-8546.001.patch Patch attached > Use try with resources in DataStorage and Storage > ---

[jira] [Updated] (HDFS-8546) Use try with resources in DataStorage and Storage

[ https://issues.apache.org/jira/browse/HDFS-8546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8546: -- Status: Patch Available (was: Open) > Use try with resources in DataStorage and Storage > --

[jira] [Updated] (HDFS-8460) Erasure Coding: stateful read result doesn't match data occasionally because of flawed test

[ https://issues.apache.org/jira/browse/HDFS-8460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8460: Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed Status: Resolved (wa

[jira] [Commented] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575183#comment-14575183 ] Andrew Wang commented on HDFS-7923: --- Thanks Colin, +1 pending Jenkins. Great work on this

[jira] [Commented] (HDFS-8460) Erasure Coding: stateful read result doesn't match data occasionally because of flawed test

[ https://issues.apache.org/jira/browse/HDFS-8460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575185#comment-14575185 ] Zhe Zhang commented on HDFS-8460: - +1 on the patch. I just committed to the branch. Thanks

[jira] [Updated] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7923: --- Attachment: HDFS-7923.006.patch I need to make sure to treat the initial block report d

[jira] [Commented] (HDFS-8522) Change heavily recorded NN logs from INFO level to DEBUG level

[ https://issues.apache.org/jira/browse/HDFS-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575178#comment-14575178 ] Hadoop QA commented on HDFS-8522: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7923: --- Attachment: (was: HDFS-7923.005.patch) > The DataNodes should rate-limit their full

[jira] [Commented] (HDFS-8201) Refactor the end to end test for stripping file writing and reading

[ https://issues.apache.org/jira/browse/HDFS-8201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575173#comment-14575173 ] Zhe Zhang commented on HDFS-8201: - Moving as a follow-on since those tests are still being

[jira] [Updated] (HDFS-8201) Refactor the end to end test for stripping file writing and reading

[ https://issues.apache.org/jira/browse/HDFS-8201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8201: Parent Issue: HDFS-8031 (was: HDFS-7285) > Refactor the end to end test for stripping file writing and readi

[jira] [Commented] (HDFS-8480) Fix performance and timeout issues in HDFS-7929: use hard-links instead of copying edit logs

[ https://issues.apache.org/jira/browse/HDFS-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575169#comment-14575169 ] Hadoop QA commented on HDFS-8480: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7923: --- Attachment: HDFS-7923.005.patch > The DataNodes should rate-limit their full block repo

[jira] [Commented] (HDFS-8432) Introduce a minimum compatible layout version to allow downgrade in more rolling upgrade use cases.

[ https://issues.apache.org/jira/browse/HDFS-8432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575103#comment-14575103 ] Hadoop QA commented on HDFS-8432: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8522) Change heavily recorded NN logs from INFO level to DEBUG level

[ https://issues.apache.org/jira/browse/HDFS-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8522: - Component/s: namenode > Change heavily recorded NN logs from INFO level to DEBUG level > --

[jira] [Updated] (HDFS-8522) Change heavily recorded NN logs from INFO level to DEBUG level

[ https://issues.apache.org/jira/browse/HDFS-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8522: - Affects Version/s: 2.6.0 > Change heavily recorded NN logs from INFO level to DEBUG level > ---

[jira] [Commented] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575058#comment-14575058 ] Colin Patrick McCabe commented on HDFS-7923: bq. Should the checkLease logs be

[jira] [Commented] (HDFS-8505) Truncate should not be success when Truncate Size and Current Size are equal.

[ https://issues.apache.org/jira/browse/HDFS-8505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14574967#comment-14574967 ] Konstantin Shvachko commented on HDFS-8505: --- And resolution should probably be "N

[jira] [Commented] (HDFS-8505) Truncate should not be success when Truncate Size and Current Size are equal.

[ https://issues.apache.org/jira/browse/HDFS-8505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14574959#comment-14574959 ] Konstantin Shvachko commented on HDFS-8505: --- Guys, I think this works as designed

[jira] [Commented] (HDFS-8538) Change the default volume choosing policy to AvailableSpaceVolumeChoosingPolicy

[ https://issues.apache.org/jira/browse/HDFS-8538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14574914#comment-14574914 ] Andrew Wang commented on HDFS-8538: --- Thanks guys for the discussion, some replies: bq. Y

[jira] [Commented] (HDFS-7240) Object store in HDFS

[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14574870#comment-14574870 ] Jian Fang commented on HDFS-7240: - One more question is how you would handle object partiti

[jira] [Commented] (HDFS-8538) Change the default volume choosing policy to AvailableSpaceVolumeChoosingPolicy

[ https://issues.apache.org/jira/browse/HDFS-8538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14574868#comment-14574868 ] Arpit Agarwal commented on HDFS-8538: - bq. The writes are skewed towards the disks with

[jira] [Commented] (HDFS-8545) Add an API to fetch the total file length from a specific path, apart from getting by default from root

[ https://issues.apache.org/jira/browse/HDFS-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14574848#comment-14574848 ] Hadoop QA commented on HDFS-8545: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8522) Change heavily recorded NN logs from INFO level to DEBUG level

[ https://issues.apache.org/jira/browse/HDFS-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14574846#comment-14574846 ] Arpit Agarwal commented on HDFS-8522: - +1 for the .02 patch. > Change heavily recorded

[jira] [Comment Edited] (HDFS-8522) Change heavily recorded NN logs from INFO level to DEBUG level

[ https://issues.apache.org/jira/browse/HDFS-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14574846#comment-14574846 ] Arpit Agarwal edited comment on HDFS-8522 at 6/5/15 5:10 PM: - +

[jira] [Updated] (HDFS-8522) Change heavily recorded NN logs from INFO level to DEBUG level

[ https://issues.apache.org/jira/browse/HDFS-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8522: - Attachment: HDFS-8522.02.patch Fit the lines within 80 columns. > Change heavily recorded NN logs from INF

[jira] [Commented] (HDFS-7240) Object store in HDFS

[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14574840#comment-14574840 ] Jian Fang commented on HDFS-7240: - Sorry for jumping in. I saw the following statement and

[jira] [Updated] (HDFS-8499) Merge BlockInfoUnderConstruction into trunk

[ https://issues.apache.org/jira/browse/HDFS-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8499: Status: Open (was: Patch Available) > Merge BlockInfoUnderConstruction into trunk >

[jira] [Updated] (HDFS-8499) Merge BlockInfoUnderConstruction into trunk

[ https://issues.apache.org/jira/browse/HDFS-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8499: Status: Patch Available (was: Open) > Merge BlockInfoUnderConstruction into trunk >

[jira] [Commented] (HDFS-8499) Merge BlockInfoUnderConstruction into trunk

[ https://issues.apache.org/jira/browse/HDFS-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14574833#comment-14574833 ] Zhe Zhang commented on HDFS-8499: - [~hitliuyi] great points! I didn't notice that the copy

[jira] [Commented] (HDFS-8525) API getUsed() returns the file lengh only from root "/"

[ https://issues.apache.org/jira/browse/HDFS-8525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14574824#comment-14574824 ] Hadoop QA commented on HDFS-8525: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8480) Fix performance and timeout issues in HDFS-7929: use hard-links instead of copying edit logs

[ https://issues.apache.org/jira/browse/HDFS-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8480: Status: Patch Available (was: Open) Initial patch. Will add a test in next rev. > Fix performance and timeo

[jira] [Updated] (HDFS-8480) Fix performance and timeout issues in HDFS-7929: use hard-links instead of copying edit logs

[ https://issues.apache.org/jira/browse/HDFS-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8480: Attachment: HDFS-8480.00.patch > Fix performance and timeout issues in HDFS-7929: use hard-links instead of

[jira] [Updated] (HDFS-8432) Introduce a minimum compatible layout version to allow downgrade in more rolling upgrade use cases.

[ https://issues.apache.org/jira/browse/HDFS-8432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-8432: Attachment: HDFS-8432-branch-2.003.patch Jenkins did complete a run of the branch-2 patch, but jira w

[jira] [Commented] (HDFS-8532) Make the visibility of DFSOutputStream#streamer member variable to private

[ https://issues.apache.org/jira/browse/HDFS-8532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14574656#comment-14574656 ] Hudson commented on HDFS-8532: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #217 (See

[jira] [Commented] (HDFS-8463) Calling DFSInputStream.seekToNewSource just after stream creation causes NullPointerException

[ https://issues.apache.org/jira/browse/HDFS-8463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14574650#comment-14574650 ] Hudson commented on HDFS-8463: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #217 (See

[jira] [Commented] (HDFS-8535) Clarify that dfs usage in dfsadmin -report output includes all block replicas.

[ https://issues.apache.org/jira/browse/HDFS-8535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14574657#comment-14574657 ] Hudson commented on HDFS-8535: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #217 (See

[jira] [Commented] (HDFS-8463) Calling DFSInputStream.seekToNewSource just after stream creation causes NullPointerException

[ https://issues.apache.org/jira/browse/HDFS-8463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14574622#comment-14574622 ] Hudson commented on HDFS-8463: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2165 (See [htt

  1   2   >