[jira] [Commented] (HDFS-7430) Rewrite the BlockScanner to use O(1) memory and use multiple threads

2015-02-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318984#comment-14318984 ] Colin Patrick McCabe commented on HDFS-7430: Once HDFS-7686 is committed

[jira] [Reopened] (HDFS-7083) TestDecommission#testIncludeByRegistrationName sometimes fails

2015-02-12 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe reopened HDFS-7083: TestDecommission#testIncludeByRegistrationName sometimes fails

[jira] [Commented] (HDFS-7771) fuse_dfs should permit FILE: on the front of KRB5CCNAME

2015-02-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14316898#comment-14316898 ] Colin Patrick McCabe commented on HDFS-7771: Thanks, guys. Findbugs warning is

[jira] [Updated] (HDFS-7771) fuse_dfs should permit FILE: on the front of KRB5CCNAME

2015-02-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7771: --- Resolution: Fixed Fix Version/s: 2.7.0 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-7686) Re-add rapid rescan of possibly corrupt block feature to the block scanner

2015-02-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7686: --- Summary: Re-add rapid rescan of possibly corrupt block feature to the block scanner

[jira] [Updated] (HDFS-7686) Re-add rapid rescan of possibly corrupt block feature to the block scanner

2015-02-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7686: --- Description: When doing a transferTo (aka sendfile operation) from the DataNode to a

[jira] [Updated] (HDFS-7686) Corrupt block reporting to namenode soon feature is overwritten by HDFS-7430

2015-02-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7686: --- Status: Patch Available (was: Open) Corrupt block reporting to namenode soon feature

[jira] [Updated] (HDFS-7686) Corrupt block reporting to namenode soon feature is overwritten by HDFS-7430

2015-02-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7686: --- Attachment: HDFS-7686.002.patch Corrupt block reporting to namenode soon feature is

[jira] [Updated] (HDFS-7686) Re-add rapid rescan of possibly corrupt block feature to the block scanner

2015-02-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7686: --- Attachment: HDFS-7686.003.patch Re-add rapid rescan of possibly corrupt block feature

[jira] [Commented] (HDFS-7763) fix zkfc hung issue due to not catching exception in a corner case

2015-02-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317518#comment-14317518 ] Colin Patrick McCabe commented on HDFS-7763: I feel a bit confused here.

[jira] [Commented] (HDFS-7686) Re-add rapid rescan of possibly corrupt block feature to the block scanner

2015-02-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317511#comment-14317511 ] Colin Patrick McCabe commented on HDFS-7686: bq. Unused Iterator import in the

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-02-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317523#comment-14317523 ] Colin Patrick McCabe commented on HDFS-7648: Thank you for sticking with this.

[jira] [Updated] (HDFS-7694) FSDataInputStream should support unbuffer

2015-02-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7694: --- Attachment: HDFS-7694.005.patch FSDataInputStream should support unbuffer

[jira] [Updated] (HDFS-7694) FSDataInputStream should support unbuffer

2015-02-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7694: --- Attachment: (was: HDFS-7694.005.patch) FSDataInputStream should support unbuffer

[jira] [Updated] (HDFS-7694) FSDataInputStream should support unbuffer

2015-02-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7694: --- Attachment: HDFS-7694.005.patch add a test of reading after calling unbuffer()

[jira] [Updated] (HDFS-7771) fuse_dfs should permit FILE: on the front of KRB5CCNAME

2015-02-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7771: --- Attachment: HDFS-7771.001.patch fuse_dfs should permit FILE: on the front of

[jira] [Created] (HDFS-7771) fuse_dfs should permit FILE: on the front of KRB5CCNAME

2015-02-10 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-7771: -- Summary: fuse_dfs should permit FILE: on the front of KRB5CCNAME Key: HDFS-7771 URL: https://issues.apache.org/jira/browse/HDFS-7771 Project: Hadoop HDFS

[jira] [Updated] (HDFS-7771) fuse_dfs should permit FILE: on the front of KRB5CCNAME

2015-02-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7771: --- Status: Patch Available (was: Open) fuse_dfs should permit FILE: on the front of

[jira] [Updated] (HDFS-7694) FSDataInputStream should support unbuffer

2015-02-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7694: --- Attachment: HDFS-7694.004.patch rebase on HDFS-7744 now that it's in

[jira] [Comment Edited] (HDFS-7722) DataNode#checkDiskError should also remove Storage when error is found.

2015-02-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315064#comment-14315064 ] Colin Patrick McCabe edited comment on HDFS-7722 at 2/10/15 10:14 PM:

[jira] [Commented] (HDFS-7722) DataNode#checkDiskError should also remove Storage when error is found.

2015-02-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315064#comment-14315064 ] Colin Patrick McCabe commented on HDFS-7722: FsDatasetSpi#checkDataDir is

[jira] [Commented] (HDFS-7771) fuse_dfs should permit FILE: on the front of KRB5CCNAME

2015-02-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315248#comment-14315248 ] Colin Patrick McCabe commented on HDFS-7771: Hi Yongjun, That's a fair

[jira] [Commented] (HDFS-7608) hdfs dfsclient newConnectedPeer has no write timeout

2015-02-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315270#comment-14315270 ] Colin Patrick McCabe commented on HDFS-7608: Chris, I think you're absolutely

[jira] [Commented] (HDFS-7755) httpfs shell code has hardcoded path to bash

2015-02-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315290#comment-14315290 ] Colin Patrick McCabe commented on HDFS-7755: bq. What system is this [that

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-02-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315296#comment-14315296 ] Colin Patrick McCabe commented on HDFS-7648: I think the current patch is fine,

[jira] [Commented] (HDFS-7718) DFSClient objects created by AbstractFileSystem objects created by FileContext are not closed and results in thread leakage

2015-02-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313528#comment-14313528 ] Colin Patrick McCabe commented on HDFS-7718: Findbugs warning is about

[jira] [Commented] (HDFS-7744) Fix potential NPE in DFSInputStream after setDropBehind or setReadahead is called

2015-02-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313516#comment-14313516 ] Colin Patrick McCabe commented on HDFS-7744: Findbugs warning is unrelated (it

[jira] [Commented] (HDFS-7744) Fix potential NPE in DFSInputStream after setDropBehind or setReadahead is called

2015-02-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14312643#comment-14312643 ] Colin Patrick McCabe commented on HDFS-7744: address Akira's comments Fix

[jira] [Updated] (HDFS-7744) Fix potential NPE in DFSInputStream after setDropBehind or setReadahead is called

2015-02-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7744: --- Attachment: HDFS-7744.002.patch Fix potential NPE in DFSInputStream after

[jira] [Commented] (HDFS-7718) DFSClient objects created by AbstractFileSystem objects created by FileContext are not closed and results in thread leakage

2015-02-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14312967#comment-14312967 ] Colin Patrick McCabe commented on HDFS-7718: bq. Yup.. it needs to be there

[jira] [Commented] (HDFS-7322) deprecate sbin/*.sh

2015-02-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313244#comment-14313244 ] Colin Patrick McCabe commented on HDFS-7322: fair enough deprecate sbin/*.sh

[jira] [Commented] (HDFS-7322) deprecate sbin/*.sh

2015-02-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313106#comment-14313106 ] Colin Patrick McCabe commented on HDFS-7322: What's the rationale for

[jira] [Commented] (HDFS-7608) hdfs dfsclient newConnectedPeer has no write timeout

2015-02-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313133#comment-14313133 ] Colin Patrick McCabe commented on HDFS-7608: {code} socketTimeout =

[jira] [Commented] (HDFS-7755) httpfs shell code has hardcoded path to bash

2015-02-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313115#comment-14313115 ] Colin Patrick McCabe commented on HDFS-7755: Thanks, guys. This looks good.

[jira] [Updated] (HDFS-7744) Fix potential NPE in DFSInputStream after setDropBehind or setReadahead is called

2015-02-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7744: --- Resolution: Fixed Fix Version/s: 2.7.0 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-7718) Store KeyProvider in ClientContext to avoid leaking key provider threads when using FileContext

2015-02-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7718: --- Resolution: Fixed Fix Version/s: 2.7.0 Status: Resolved (was: Patch

[jira] [Created] (HDFS-7744) Fix potential NPE in DFSInputStream after setDropBehind or setReadahead is called

2015-02-06 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-7744: -- Summary: Fix potential NPE in DFSInputStream after setDropBehind or setReadahead is called Key: HDFS-7744 URL: https://issues.apache.org/jira/browse/HDFS-7744

[jira] [Commented] (HDFS-7694) FSDataInputStream should support unbuffer

2015-02-06 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14309780#comment-14309780 ] Colin Patrick McCabe commented on HDFS-7694: bq. CanUnbuffer ain't too pretty.

[jira] [Commented] (HDFS-7694) FSDataInputStream should support unbuffer

2015-02-06 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14309862#comment-14309862 ] Colin Patrick McCabe commented on HDFS-7694: I filed HDFS-7744 for the existing

[jira] [Updated] (HDFS-7694) FSDataInputStream should support unbuffer

2015-02-06 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7694: --- Attachment: HDFS-7694.003.patch FSDataInputStream should support unbuffer

[jira] [Updated] (HDFS-7744) Fix potential NPE in DFSInputStream after setDropBehind or setReadahead is called

2015-02-06 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7744: --- Status: Patch Available (was: Open) Fix potential NPE in DFSInputStream after

[jira] [Updated] (HDFS-7744) Fix potential NPE in DFSInputStream after setDropBehind or setReadahead is called

2015-02-06 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7744: --- Attachment: HDFS-7744.001.patch Fix potential NPE in DFSInputStream after

[jira] [Commented] (HDFS-7732) Fix the order of the parameters in DFSConfigKeys

2015-02-06 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14309686#comment-14309686 ] Colin Patrick McCabe commented on HDFS-7732: +1 Fix the order of the

[jira] [Commented] (HDFS-7718) DFSClient objects created by AbstractFileSystem objects created by FileContext are not closed and results in thread leakage

2015-02-06 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310483#comment-14310483 ] Colin Patrick McCabe commented on HDFS-7718: I apologize for the review delay.

[jira] [Commented] (HDFS-7686) Corrupt block reporting to namenode soon feature is overwritten by HDFS-7430

2015-02-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308565#comment-14308565 ] Colin Patrick McCabe commented on HDFS-7686: Thanks, guys. I have a patch for

[jira] [Commented] (HDFS-7694) FSDataInputStream should support unbuffer

2015-02-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308568#comment-14308568 ] Colin Patrick McCabe commented on HDFS-7694: bq. One question, in what cases,

[jira] [Updated] (HDFS-7694) FSDataInputStream should support unbuffer

2015-02-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7694: --- Attachment: HDFS-7694.002.patch rebased patch FSDataInputStream should support

[jira] [Commented] (HDFS-7741) Remove unnecessary synchronized in FSDataInputStream and HdfsDataInputStream

2015-02-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308484#comment-14308484 ] Colin Patrick McCabe commented on HDFS-7741: +1 pending jenkins. The locking

[jira] [Comment Edited] (HDFS-7698) Fix locking on HDFS read statistics and add a method for clearing them.

2015-02-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308414#comment-14308414 ] Colin Patrick McCabe edited comment on HDFS-7698 at 2/6/15 2:28 AM:

[jira] [Commented] (HDFS-7698) Fix locking on HDFS read statistics and add a method for clearing them.

2015-02-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308485#comment-14308485 ] Colin Patrick McCabe commented on HDFS-7698: Thanks, Yi. Fix locking on HDFS

[jira] [Assigned] (HDFS-7686) Corrupt block reporting to namenode soon feature is overwritten by HDFS-7430

2015-02-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe reassigned HDFS-7686: -- Assignee: Colin Patrick McCabe Corrupt block reporting to namenode soon

[jira] [Commented] (HDFS-7709) Fix findbug warnings in httpfs

2015-02-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14307678#comment-14307678 ] Colin Patrick McCabe commented on HDFS-7709: Thanks, Rakesh. Fix findbug

[jira] [Commented] (HDFS-7708) Balancer should delete its pid file when it completes rebalance

2015-02-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14307690#comment-14307690 ] Colin Patrick McCabe commented on HDFS-7708: Hi Rakesh, Thanks for looking at

[jira] [Commented] (HDFS-7698) Fix locking on HDFS read statistics and add a method for clearing them.

2015-02-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14307697#comment-14307697 ] Colin Patrick McCabe commented on HDFS-7698: bq. In

[jira] [Updated] (HDFS-7698) Fix locking on HDFS read statistics and add a method for clearing them.

2015-02-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7698: --- Attachment: HDFS-7698.003.patch Fix locking on HDFS read statistics and add a method

[jira] [Commented] (HDFS-7719) BlockPoolSliceStorage#removeVolumes fails to remove some in-memory state associated with volumes

2015-02-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14305849#comment-14305849 ] Colin Patrick McCabe commented on HDFS-7719: +1. Thanks, Eddy {code}

[jira] [Updated] (HDFS-7719) BlockPoolSliceStorage#removeVolumes fails to remove some in-memory state associated with volumes

2015-02-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7719: --- Summary: BlockPoolSliceStorage#removeVolumes fails to remove some in-memory state

[jira] [Comment Edited] (HDFS-7719) BlockPoolSliceStorage#removeVolumes fails to remove some in-memory state associated with volumes

2015-02-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14305849#comment-14305849 ] Colin Patrick McCabe edited comment on HDFS-7719 at 2/4/15 8:01 PM:

[jira] [Commented] (HDFS-7719) BlockPoolSliceStorage#removeVolumes fails to remove some in-memory state associated with volumes

2015-02-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14305860#comment-14305860 ] Colin Patrick McCabe commented on HDFS-7719: I ran TestDFSMkdirs locally and

[jira] [Resolved] (HDFS-7018) Implement hdfs.h interface in libhdfs3

2015-02-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-7018. Resolution: Fixed Fix Version/s: HDFS-6994 Target Version/s:

[jira] [Updated] (HDFS-7719) BlockPoolSliceStorage#removeVolumes fails to remove some in-memory state associated with volumes

2015-02-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7719: --- Resolution: Fixed Fix Version/s: 2.7.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-7018) Implement C interface for libhdfs3

2015-02-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14305907#comment-14305907 ] Colin Patrick McCabe commented on HDFS-7018: +1. Thanks, Zhanwei. Implement

[jira] [Commented] (HDFS-6994) libhdfs3 - A native C/C++ HDFS client

2015-02-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14305880#comment-14305880 ] Colin Patrick McCabe commented on HDFS-6994: Hi Haohui, That is interesting.

[jira] [Updated] (HDFS-7018) Implement hdfs.h interface in libhdfs3

2015-02-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7018: --- Summary: Implement hdfs.h interface in libhdfs3 (was: Implement C interface for

[jira] [Updated] (HDFS-7721) The HDFS BlockScanner may run fast during the first hour

2015-02-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7721: --- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-7719) BlockPoolSliceStorage could not remove storageDir.

2015-02-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301774#comment-14301774 ] Colin Patrick McCabe commented on HDFS-7719: The solution here seems to be to

[jira] [Commented] (HDFS-7709) Fix Findbug Warnings

2015-02-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301802#comment-14301802 ] Colin Patrick McCabe commented on HDFS-7709: The best way would be to fix it :)

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

2015-02-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301870#comment-14301870 ] Colin Patrick McCabe commented on HDFS-7411: Thanks for splitting off the

[jira] [Commented] (HDFS-7718) DFSClient objects created by AbstractFileSystem objects created by FileContext are not closed and results in thread leakage

2015-02-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301880#comment-14301880 ] Colin Patrick McCabe commented on HDFS-7718: {code} 3465 public

[jira] [Commented] (HDFS-7722) DataNode#checkDiskError should also remove Storage when error is found.

2015-02-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301785#comment-14301785 ] Colin Patrick McCabe commented on HDFS-7722: good idea

[jira] [Commented] (HDFS-7718) DFSClient objects created by AbstractFileSystem objects created by FileContext are not closed and results in thread leakage

2015-02-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301790#comment-14301790 ] Colin Patrick McCabe commented on HDFS-7718: There was some discussion about

[jira] [Commented] (HDFS-7708) Balancer should delete its pid file when it completes rebalance

2015-02-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301807#comment-14301807 ] Colin Patrick McCabe commented on HDFS-7708: Good find. It seems like the

[jira] [Commented] (HDFS-7721) TestBlockScanner.testScanRateLimit may fail

2015-02-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302288#comment-14302288 ] Colin Patrick McCabe commented on HDFS-7721: * Avoid running the scanner fast

[jira] [Updated] (HDFS-7721) TestBlockScanner.testScanRateLimit may fail

2015-02-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7721: --- Attachment: HDFS-7721.001.patch TestBlockScanner.testScanRateLimit may fail

[jira] [Updated] (HDFS-7721) TestBlockScanner.testScanRateLimit may fail

2015-02-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7721: --- Assignee: Colin Patrick McCabe Status: Patch Available (was: Open)

[jira] [Updated] (HDFS-7721) The HDFS BlockScanner may run fast during the first hour

2015-02-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7721: --- Summary: The HDFS BlockScanner may run fast during the first hour (was:

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

2015-02-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302319#comment-14302319 ] Colin Patrick McCabe commented on HDFS-7411: I don't see any benefit to

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-01-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299387#comment-14299387 ] Colin Patrick McCabe commented on HDFS-7648: bq. The original design of

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2015-01-29 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14297894#comment-14297894 ] Colin Patrick McCabe commented on HDFS-7648: bq. Do you meant, DirectoryScanner

[jira] [Created] (HDFS-7693) libhdfs: add hdfsFile cache

2015-01-28 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-7693: -- Summary: libhdfs: add hdfsFile cache Key: HDFS-7693 URL: https://issues.apache.org/jira/browse/HDFS-7693 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-7694) FSDataInputStream should support unbuffer

2015-01-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7694: --- Status: Patch Available (was: Open) FSDataInputStream should support unbuffer

[jira] [Updated] (HDFS-7693) libhdfs: add hdfsFile cache

2015-01-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7693: --- Attachment: HDFS-7693.001.patch libhdfs: add hdfsFile cache

[jira] [Created] (HDFS-7694) FSDataInputStream should support unbuffer

2015-01-28 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-7694: -- Summary: FSDataInputStream should support unbuffer Key: HDFS-7694 URL: https://issues.apache.org/jira/browse/HDFS-7694 Project: Hadoop HDFS

[jira] [Updated] (HDFS-7694) FSDataInputStream should support unbuffer

2015-01-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7694: --- Attachment: HDFS-7694.001.patch FSDataInputStream should support unbuffer

[jira] [Updated] (HDFS-7693) libhdfs: add hdfsFile cache

2015-01-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7693: --- Status: Patch Available (was: Open) libhdfs: add hdfsFile cache

[jira] [Created] (HDFS-7698) Fix locking on HDFS read statistics and add a method for clearing them.

2015-01-28 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-7698: -- Summary: Fix locking on HDFS read statistics and add a method for clearing them. Key: HDFS-7698 URL: https://issues.apache.org/jira/browse/HDFS-7698

[jira] [Commented] (HDFS-7698) Fix locking on HDFS read statistics and add a method for clearing them.

2015-01-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296318#comment-14296318 ] Colin Patrick McCabe commented on HDFS-7698: * It is not necessary (or useful)

[jira] [Updated] (HDFS-7698) Fix locking on HDFS read statistics and add a method for clearing them.

2015-01-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7698: --- Attachment: HDFS-7698.002.patch Fix locking on HDFS read statistics and add a method

[jira] [Updated] (HDFS-7698) Fix locking on HDFS read statistics and add a method for clearing them.

2015-01-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7698: --- Target Version/s: 2.7.0 Affects Version/s: 2.7.0 Status: Patch

[jira] [Comment Edited] (HDFS-7698) Fix locking on HDFS read statistics and add a method for clearing them.

2015-01-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296318#comment-14296318 ] Colin Patrick McCabe edited comment on HDFS-7698 at 1/29/15 3:11 AM:

[jira] [Updated] (HDFS-7698) Fix locking on HDFS read statistics and add a method for clearing them.

2015-01-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7698: --- Attachment: HDFS-7698.001.patch Fix locking on HDFS read statistics and add a method

[jira] [Updated] (HDFS-7698) Fix locking on HDFS read statistics and add a method for clearing them.

2015-01-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7698: --- Attachment: (was: HDFS-7698.001.patch) Fix locking on HDFS read statistics and

[jira] [Commented] (HDFS-7675) Unused member DFSClient.spanReceiverHost

2015-01-27 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14294005#comment-14294005 ] Colin Patrick McCabe commented on HDFS-7675: Currently, we don't reference

[jira] [Commented] (HDFS-7018) Implement C interface for libhdfs3

2015-01-27 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14294266#comment-14294266 ] Colin Patrick McCabe commented on HDFS-7018: First off, I apologize for being

[jira] [Commented] (HDFS-7675) Unused member DFSClient.spanReceiverHost

2015-01-27 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14294269#comment-14294269 ] Colin Patrick McCabe commented on HDFS-7675: I don't see a good reason to use a

[jira] [Updated] (HDFS-7675) Unused member DFSClient.spanReceiverHost

2015-01-27 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7675: --- Description: {{DFSClient#spanReceiverHost}} is initialised but never used. (was:

[jira] [Updated] (HDFS-7675) Unused member DFSClient.spanReceiverHost

2015-01-27 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7675: --- Status: Patch Available (was: Open) Unused member DFSClient.spanReceiverHost

[jira] [Updated] (HDFS-7675) Unused member DFSClient.spanReceiverHost

2015-01-27 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7675: --- Priority: Trivial (was: Major) Unused member DFSClient.spanReceiverHost

[jira] [Updated] (HDFS-7675) Unused member DFSClient.spanReceiverHost

2015-01-27 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7675: --- Attachment: HDFS-7675.001.patch This patch will fix the warning. We can file a

[jira] [Resolved] (HDFS-7577) Add additional headers that includes need by Windows

2015-01-27 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-7577. Resolution: Fixed Fix Version/s: HDFS-6994 +1. Committed, thanks! Add

<    8   9   10   11   12   13   14   15   16   17   >