[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in Namenode

2016-04-27 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15261637#comment-15261637 ] Kai Zheng commented on HDFS-10285: -- Thanks Uma. bq. Could you elaborate a bit? Sure, I me

[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in Namenode

2016-04-27 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15261581#comment-15261581 ] Uma Maheswara Rao G commented on HDFS-10285: {quote} So does this mean there w

[jira] [Updated] (HDFS-10337) OfflineEditsViewer stats option should print 0 instead of null for the count of operations

2016-04-27 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-10337: - Attachment: HDFS-10337.002.patch Thanks for the quick review. Update the latest patch for addressing the c

[jira] [Commented] (HDFS-8449) Add tasks count metrics to datanode for ECWorker

2016-04-27 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15261472#comment-15261472 ] Li Bo commented on HDFS-8449: - The two failed unit tests have no relation with this patch and w

[jira] [Commented] (HDFS-9276) Failed to Update HDFS Delegation Token for long running application in HA mode

2016-04-27 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15261467#comment-15261467 ] Yi Liu commented on HDFS-9276: -- Not only one people tell me they encounter this issue in real

[jira] [Assigned] (HDFS-10338) DistCp masks potential CRC check failures

2016-04-27 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun reassigned HDFS-10338: Assignee: Lin Yiqun > DistCp masks potential CRC check failures > -

[jira] [Commented] (HDFS-10338) DistCp masks potential CRC check failures

2016-04-27 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15261456#comment-15261456 ] Lin Yiqun commented on HDFS-10338: -- Hi, [~teabot], I have two comments for this: * It lo

[jira] [Commented] (HDFS-9869) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-2]

2016-04-27 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15261451#comment-15261451 ] Rakesh R commented on HDFS-9869: Thanks a lot [~zhz], [~andrew.wang] for the useful discuss

[jira] [Commented] (HDFS-10337) OfflineEditsViewer stats option should print 0 instead of null for the count of operations

2016-04-27 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15261442#comment-15261442 ] Akira AJISAKA commented on HDFS-10337: -- Thank you for your patch. Yes, it fixes this

[jira] [Commented] (HDFS-10337) OfflineEditsViewer stats option should print 0 instead of null for the count of operations

2016-04-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15261402#comment-15261402 ] Hadoop QA commented on HDFS-10337: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10337) OfflineEditsViewer stats option should print 0 instead of null for the count of operations

2016-04-27 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15261401#comment-15261401 ] Lin Yiqun commented on HDFS-10337: -- HI, [~ajisakaa], I attach a patch for this, can this

[jira] [Updated] (HDFS-10337) OfflineEditsViewer stats option should print 0 instead of null for the count of operations

2016-04-27 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-10337: - Attachment: HDFS-10337.001.patch > OfflineEditsViewer stats option should print 0 instead of null for the

[jira] [Updated] (HDFS-10337) OfflineEditsViewer stats option should print 0 instead of null for the count of operations

2016-04-27 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-10337: - Status: Patch Available (was: Open) > OfflineEditsViewer stats option should print 0 instead of null for

[jira] [Assigned] (HDFS-10337) OfflineEditsViewer stats option should print 0 instead of null for the count of operations

2016-04-27 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun reassigned HDFS-10337: Assignee: Lin Yiqun > OfflineEditsViewer stats option should print 0 instead of null for the count

[jira] [Commented] (HDFS-9958) BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages.

2016-04-27 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15261388#comment-15261388 ] Walter Su commented on HDFS-9958: - bq. I think only DFSClient currently reports storageID.

[jira] [Updated] (HDFS-7877) Support maintenance state for datanodes

2016-04-27 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7877: -- Component/s: namenode datanode > Support maintenance state for datanodes

[jira] [Commented] (HDFS-9389) Add maintenance states to AdminStates

2016-04-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15261264#comment-15261264 ] Hadoop QA commented on HDFS-9389: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-10324) Trash directory in an encryption zone should be pre-created with sticky bit

2016-04-27 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15261263#comment-15261263 ] Andrew Wang commented on HDFS-10324: Sounds good to me [~xyao]. Let's also do the prov

[jira] [Updated] (HDFS-10297) Increase default balance bandwidth and concurrent moves

2016-04-27 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10297: --- Resolution: Fixed Fix Version/s: (was: 2.9.0) 2.8.0 Status: Re

[jira] [Updated] (HDFS-9389) Add maintenance states to AdminStates

2016-04-27 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9389: -- Assignee: Ming Ma Status: Patch Available (was: Open) > Add maintenance states to AdminStates > --

[jira] [Updated] (HDFS-9389) Add maintenance states to AdminStates

2016-04-27 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9389: -- Attachment: HDFS-9389.patch Here is the draft patch. The rest of maintenance functionalities are covered by othe

[jira] [Comment Edited] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-04-27 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15261052#comment-15261052 ] Lei (Eddy) Xu edited comment on HDFS-3702 at 4/27/16 11:45 PM: --

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-04-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15261153#comment-15261153 ] Hudson commented on HDFS-3702: -- FAILURE: Integrated in Hadoop-trunk-Commit #9686 (See [https:

[jira] [Commented] (HDFS-10338) DistCp masks potential CRC check failures

2016-04-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15261127#comment-15261127 ] Mingliang Liu commented on HDFS-10338: -- I'm favor of propagating the IOException thro

[jira] [Commented] (HDFS-10220) Namenode failover due to too long loking in LeaseManager.Monitor

2016-04-27 Thread Nicolas Fraison (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15261064#comment-15261064 ] Nicolas Fraison commented on HDFS-10220: Thanks [~walter.k.su] for the catch. We c

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-04-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15261063#comment-15261063 ] Hudson commented on HDFS-3702: -- FAILURE: Integrated in Hadoop-trunk-Commit #9685 (See [https:

[jira] [Updated] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-04-27 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-3702: Resolution: Fixed Fix Version/s: 2.9.0 3.0.0 Status: Resolved (w

[jira] [Created] (HDFS-10339) libhdfs++: Expose async operations through the C API

2016-04-27 Thread James Clampffer (JIRA)
James Clampffer created HDFS-10339: -- Summary: libhdfs++: Expose async operations through the C API Key: HDFS-10339 URL: https://issues.apache.org/jira/browse/HDFS-10339 Project: Hadoop HDFS

[jira] [Updated] (HDFS-9758) libhdfs++: Implement Python bindings

2016-04-27 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9758: -- Attachment: hdfs_posix.py Adding my example using the the C API and CTypes to implement File and

[jira] [Commented] (HDFS-6489) DFS Used space is not correct computed on frequent append operations

2016-04-27 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15260954#comment-15260954 ] Ravi Prakash commented on HDFS-6489: The problem is here: https://github.com/apache/ha

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-04-27 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15260953#comment-15260953 ] Tsz Wo Nicholas Sze commented on HDFS-3702: --- After a second thought, I agree that

[jira] [Commented] (HDFS-10335) Mover$Processor#chooseTarget() always chooses the first matching target storage group

2016-04-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15260943#comment-15260943 ] Mingliang Liu commented on HDFS-10335: -- Thanks for your discussion and review, [~szet

[jira] [Commented] (HDFS-10335) Mover$Processor#chooseTarget() always chooses the first matching target storage group

2016-04-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15260940#comment-15260940 ] Mingliang Liu commented on HDFS-10335: -- {code} Step 16 : RUN cabal update && cabal in

[jira] [Commented] (HDFS-10335) Mover$Processor#chooseTarget() always chooses the first matching target storage group

2016-04-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15260934#comment-15260934 ] Hadoop QA commented on HDFS-10335: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-9902) Support different values of dfs.datanode.du.reserved per storage type

2016-04-27 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9902: Summary: Support different values of dfs.datanode.du.reserved per storage type (was: dfs.datanode.du

[jira] [Updated] (HDFS-10335) Mover$Processor#chooseTarget() always chooses the first matching target storage group

2016-04-27 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-10335: --- Hadoop Flags: Reviewed +1 patch looks good. > Mover$Processor#chooseTarget() always c

[jira] [Commented] (HDFS-10335) Mover$Processor#chooseTarget() always chooses the first matching target storage group

2016-04-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15260873#comment-15260873 ] Hadoop QA commented on HDFS-10335: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-10335) Mover$Processor#chooseTarget() always chooses the first matching target storage group

2016-04-27 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10335: - Status: Patch Available (was: In Progress) > Mover$Processor#chooseTarget() always chooses the fi

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-04-27 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15260856#comment-15260856 ] Lei (Eddy) Xu commented on HDFS-3702: - All the tests failures are not related. I pass a

[jira] [Commented] (HDFS-10220) Namenode failover due to too long loking in LeaseManager.Monitor

2016-04-27 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15260674#comment-15260674 ] Ravi Prakash commented on HDFS-10220: - Good catch Walter! That seems broken prior to t

[jira] [Commented] (HDFS-9902) dfs.datanode.du.reserved should be difference between StorageType DISK and RAM_DISK

2016-04-27 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15260499#comment-15260499 ] Xiaoyu Yao commented on HDFS-9902: -- Agree with [~arpitagarwal], we need to document the ne

[jira] [Commented] (HDFS-10175) add per-operation stats to FileSystem.Statistics

2016-04-27 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15260498#comment-15260498 ] Colin Patrick McCabe commented on HDFS-10175: - BTW, sorry for the last-minute-

[jira] [Created] (HDFS-10338) DistCp masks potential CRC check failures

2016-04-27 Thread Elliot West (JIRA)
Elliot West created HDFS-10338: -- Summary: DistCp masks potential CRC check failures Key: HDFS-10338 URL: https://issues.apache.org/jira/browse/HDFS-10338 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-10175) add per-operation stats to FileSystem.Statistics

2016-04-27 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15260487#comment-15260487 ] Colin Patrick McCabe commented on HDFS-10175: - Great. Let me add a webex > a

[jira] [Created] (HDFS-10337) OfflineEditsViewer stats option should print 0 instead of null for the count of operations

2016-04-27 Thread Akira AJISAKA (JIRA)
Akira AJISAKA created HDFS-10337: Summary: OfflineEditsViewer stats option should print 0 instead of null for the count of operations Key: HDFS-10337 URL: https://issues.apache.org/jira/browse/HDFS-10337

[jira] [Comment Edited] (HDFS-9902) dfs.datanode.du.reserved should be difference between StorageType DISK and RAM_DISK

2016-04-27 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15260434#comment-15260434 ] Arpit Agarwal edited comment on HDFS-9902 at 4/27/16 4:31 PM: --

[jira] [Commented] (HDFS-9902) dfs.datanode.du.reserved should be difference between StorageType DISK and RAM_DISK

2016-04-27 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15260434#comment-15260434 ] Arpit Agarwal commented on HDFS-9902: - Hi [~brahmareddy], thank you for reporting this.

[jira] [Assigned] (HDFS-8746) Reduce the latency of streaming reads by re-using DN connections

2016-04-27 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer reassigned HDFS-8746: - Assignee: James Clampffer (was: Bob Hansen) > Reduce the latency of streaming reads by re

[jira] [Commented] (HDFS-9758) libhdfs++: Implement Python bindings

2016-04-27 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15260423#comment-15260423 ] James Clampffer commented on HDFS-9758: --- Here's a bunch of my thoughts about this, le

[jira] [Updated] (HDFS-10332) hdfs-native-client fails to build with CMake 2.8.11 or earlier

2016-04-27 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10332: --- Resolution: Fixed Status: Resolved (was: Patch Available) > hdfs-native-client fails

[jira] [Commented] (HDFS-10332) hdfs-native-client fails to build with CMake 2.8.11 or earlier

2016-04-27 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15260355#comment-15260355 ] James Clampffer commented on HDFS-10332: Hi Tibor, Thanks for finding this problem

[jira] [Updated] (HDFS-10287) MiniDFSCluster should implement AutoCloseable

2016-04-27 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated HDFS-10287: Attachment: HDFS-10287.01.patch > MiniDFSCluster should implement AutoCloseable > --

[jira] [Updated] (HDFS-10287) MiniDFSCluster should implement AutoCloseable

2016-04-27 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated HDFS-10287: Attachment: (was: HDFS-10287.01.patch) > MiniDFSCluster should implement AutoCloseable > ---

[jira] [Updated] (HDFS-10287) MiniDFSCluster should implement AutoCloseable

2016-04-27 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated HDFS-10287: Attachment: HDFS-10287.01.patch I added AutoCloseable to the class and I also modified the realated

[jira] [Comment Edited] (HDFS-9958) BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages.

2016-04-27 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15260200#comment-15260200 ] Kihwal Lee edited comment on HDFS-9958 at 4/27/16 2:20 PM: --- I was

[jira] [Commented] (HDFS-9958) BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages.

2016-04-27 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15260226#comment-15260226 ] Kihwal Lee commented on HDFS-9958: -- bq. I'm surprised that most of the time, {{storageID}}

[jira] [Commented] (HDFS-10330) Add Corrupt Blocks Information in Metasave Output

2016-04-27 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15260215#comment-15260215 ] Kuhu Shukla commented on HDFS-10330: Thanks a lot Kihwal! > Add Corrupt Blocks Inform

[jira] [Commented] (HDFS-9958) BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages.

2016-04-27 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15260200#comment-15260200 ] Daryn Sharp commented on HDFS-9958: --- I was on and off helping Ku with the patch. I'll ta

[jira] [Updated] (HDFS-10330) Add Corrupt Blocks Information in Metasave Output

2016-04-27 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10330: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (w

[jira] [Commented] (HDFS-10330) Add Corrupt Blocks Information in Metasave Output

2016-04-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15260150#comment-15260150 ] Hudson commented on HDFS-10330: --- FAILURE: Integrated in Hadoop-trunk-Commit #9680 (See [htt

[jira] [Commented] (HDFS-10330) Add Corrupt Blocks Information in Metasave Output

2016-04-27 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15260111#comment-15260111 ] Kihwal Lee commented on HDFS-10330: --- Sample output {noformat} Corrupt Blocks: Block=1234

[jira] [Commented] (HDFS-8449) Add tasks count metrics to datanode for ECWorker

2016-04-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259993#comment-15259993 ] Hadoop QA commented on HDFS-8449: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9958) BlockManager#createLocatedBlocks can throw NPE for corruptBlocks on failed storages.

2016-04-27 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259918#comment-15259918 ] Walter Su commented on HDFS-9958: - Failed tests are not related. Will commit shortly if the

[jira] [Commented] (HDFS-6187) Update the document of hftp / hsftp in branch-2

2016-04-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259891#comment-15259891 ] Hadoop QA commented on HDFS-6187: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Updated] (HDFS-10332) hdfs-native-client fails to build with CMake 2.8.11 or earlier

2016-04-27 Thread Tibor Kiss (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tibor Kiss updated HDFS-10332: -- Attachment: (was: HDFS-10332-HDFS-8707.001.patch) > hdfs-native-client fails to build with CMake 2.8

[jira] [Commented] (HDFS-10175) add per-operation stats to FileSystem.Statistics

2016-04-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259851#comment-15259851 ] Steve Loughran commented on HDFS-10175: --- bq. One thing that is a bit concerning abou

[jira] [Commented] (HDFS-10175) add per-operation stats to FileSystem.Statistics

2016-04-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259838#comment-15259838 ] Steve Loughran commented on HDFS-10175: --- Wednesday april 26, 10:30 AM PST; 18:30 UK,

[jira] [Updated] (HDFS-6187) Update the document of hftp / hsftp in branch-2

2016-04-27 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-6187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Novák updated HDFS-6187: Attachment: HDFS-6187.branch-2.001.patch > Update the document of hftp / hsftp in branch-2 >

[jira] [Commented] (HDFS-6187) Update the document of hftp / hsftp in branch-2

2016-04-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259827#comment-15259827 ] Hadoop QA commented on HDFS-6187: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-8449) Add tasks count metrics to datanode for ECWorker

2016-04-27 Thread Li Bo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-8449: Attachment: HDFS-8449-006.patch > Add tasks count metrics to datanode for ECWorker >

[jira] [Updated] (HDFS-6187) Update the document of hftp / hsftp in branch-2

2016-04-27 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-6187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Novák updated HDFS-6187: Status: Patch Available (was: Open) > Update the document of hftp / hsftp in branch-2 >

[jira] [Commented] (HDFS-6187) Update the document of hftp / hsftp in branch-2

2016-04-27 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-6187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259812#comment-15259812 ] Gergely Novák commented on HDFS-6187: - Added deprecated message to the HFTP Guide docum

[jira] [Updated] (HDFS-6187) Update the document of hftp / hsftp in branch-2

2016-04-27 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-6187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Novák updated HDFS-6187: Attachment: HDFS-6187.001.patch > Update the document of hftp / hsftp in branch-2 > -

[jira] [Commented] (HDFS-9758) libhdfs++: Implement Python bindings

2016-04-27 Thread Tibor Kiss (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259810#comment-15259810 ] Tibor Kiss commented on HDFS-9758: -- We have several options to implement Python bindings f

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-04-27 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259688#comment-15259688 ] Konstantin Shvachko commented on HDFS-10301: ??Maybe I'm misunderstanding the

[jira] [Commented] (HDFS-10336) TestBalancer failing intermittently because of not reseting UserGroupInformation completely

2016-04-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259683#comment-15259683 ] Hadoop QA commented on HDFS-10336: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote