[jira] [Commented] (HDFS-9541) Add hdfsStreamBuilder API to libhdfs to support defaultBlockSizes greater than 2 GB

2015-12-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051798#comment-15051798 ] Colin Patrick McCabe commented on HDFS-9541: This patch is compatible since it just adds new

[jira] [Commented] (HDFS-8562) HDFS Performance is impacted by FileInputStream Finalizer

2015-12-10 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051986#comment-15051986 ] Colin Patrick McCabe commented on HDFS-8562: Thanks for reporting this. I think it would be a

[jira] [Commented] (HDFS-9281) Change TestDeleteBlockPool to not explicitly use File to check block pool existence.

2015-12-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048937#comment-15048937 ] Colin Patrick McCabe commented on HDFS-9281: Thanks, [~eddyxu]. {{checkBlockPool}} feels like

[jira] [Commented] (HDFS-9267) TestDiskError should get stored replicas through FsDatasetTestUtils.

2015-12-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042211#comment-15042211 ] Colin Patrick McCabe commented on HDFS-9267: +1. Thanks, [~eddyxu]. > TestDiskError should

[jira] [Updated] (HDFS-9267) TestDiskError should get stored replicas through FsDatasetTestUtils.

2015-12-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9267: --- Resolution: Fixed Fix Version/s: 2.9.0 Target Version/s: 3.0.0, 2.9.0

[jira] [Commented] (HDFS-9267) TestDiskError should get stored replicas through FsDatasetTestUtils.

2015-12-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15035454#comment-15035454 ] Colin Patrick McCabe commented on HDFS-9267: Thanks for working on this, [~eddyxu]. This is a

[jira] [Commented] (HDFS-9429) Tests in TestDFSAdminWithHA intermittently fail with EOFException

2015-12-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15036881#comment-15036881 ] Colin Patrick McCabe commented on HDFS-9429: Thanks for the reminder, [~zhz]. It should be on

[jira] [Commented] (HDFS-9429) Tests in TestDFSAdminWithHA intermittently fail with EOFException

2015-12-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15035397#comment-15035397 ] Colin Patrick McCabe commented on HDFS-9429: +1. Thanks, [~xiaochen]. > Tests in

[jira] [Updated] (HDFS-9429) Tests in TestDFSAdminWithHA intermittently fail with EOFException

2015-12-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9429: --- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-7764) DirectoryScanner shouldn't abort the scan if one directory had an error

2015-11-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032490#comment-15032490 ] Colin Patrick McCabe commented on HDFS-7764: Thanks, [~rakeshr]. {code} 856 if

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

2015-11-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032506#comment-15032506 ] Colin Patrick McCabe commented on HDFS-8791: Thanks, guys. +1 for this in trunk and branch-2.

[jira] [Commented] (HDFS-9484) NNThroughputBenchmark$BlockReportStats should not send empty block reports

2015-11-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032516#comment-15032516 ] Colin Patrick McCabe commented on HDFS-9484: Good find, [~liuml07]. >

[jira] [Commented] (HDFS-9429) Tests in TestDFSAdminWithHA intermittently fail with EOFException

2015-11-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032355#comment-15032355 ] Colin Patrick McCabe commented on HDFS-9429: This looks good. Just one comment, though: can we

[jira] [Commented] (HDFS-9446) tSize of libhdfs in hadoop-2.7.1 is still int32_t

2015-11-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032684#comment-15032684 ] Colin Patrick McCabe commented on HDFS-9446: Please do not change the type of {{tSize}}. It

[jira] [Commented] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

2015-11-23 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15023692#comment-15023692 ] Colin Patrick McCabe commented on HDFS-7060: I took another look at this, and it seems

[jira] [Commented] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-11-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15015171#comment-15015171 ] Colin Patrick McCabe commented on HDFS-7847: bq. what are you measuring NNThroughput, measured

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

2015-11-18 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15012922#comment-15012922 ] Colin Patrick McCabe commented on HDFS-8791: Thanks for working on this, [~ctrezzo]. I think

[jira] [Commented] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-11-18 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15012903#comment-15012903 ] Colin Patrick McCabe commented on HDFS-7847: bq. If understand this correctly, you are not

[jira] [Commented] (HDFS-9252) Change TestFileTruncate to use FsDatasetTestUtils to get block file size and genstamp.

2015-11-17 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009235#comment-15009235 ] Colin Patrick McCabe commented on HDFS-9252: +1. Thanks, [~eddyxu]. > Change TestFileTruncate

[jira] [Updated] (HDFS-9252) Change TestFileTruncate to use FsDatasetTestUtils to get block file size and genstamp.

2015-11-17 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9252: --- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

2015-11-17 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009722#comment-15009722 ] Colin Patrick McCabe commented on HDFS-7847: bq. Shouldn't we be specifying the namenode using

[jira] [Commented] (HDFS-9252) Change TestFileTruncate to use FsDatasetTestUtils to get block file size and genstamp.

2015-11-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992280#comment-14992280 ] Colin Patrick McCabe commented on HDFS-9252: Looks like some unit tests failed because they

[jira] [Commented] (HDFS-8965) Harden edit log reading code against out of memory errors

2015-11-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992293#comment-14992293 ] Colin Patrick McCabe commented on HDFS-8965: bq. 1. What do we do with the corrupted edit log

[jira] [Commented] (HDFS-9267) TestDiskError should get stored replicas through FsDatasetTestUtils.

2015-10-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979062#comment-14979062 ] Colin Patrick McCabe commented on HDFS-9267: I don't see why you have to load all replicas into

[jira] [Updated] (HDFS-9299) Give ReplicationMonitor a readable thread name

2015-10-27 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9299: --- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-9307) fuseConnect should be private to fuse_connect.c

2015-10-27 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9307: --- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-9307) fuseConnect should be private to fuse_connect.c

2015-10-27 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14976939#comment-14976939 ] Colin Patrick McCabe commented on HDFS-9307: +1. Thanks, [~liuml07]. > fuseConnect should be

[jira] [Commented] (HDFS-9292) Make TestFileConcorruption independent to underlying FsDataset Implementation.

2015-10-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14974972#comment-14974972 ] Colin Patrick McCabe commented on HDFS-9292: {code} 81

[jira] [Commented] (HDFS-9299) Give ReplicationMonitor a readable thread name

2015-10-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14974974#comment-14974974 ] Colin Patrick McCabe commented on HDFS-9299: +1 pending jenkins. > Give ReplicationMonitor a

[jira] [Updated] (HDFS-9268) fuse_dfs chown crashes when uid is passed as -1

2015-10-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9268: --- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-9307) fuseConnect should be private to fuse_connect.c

2015-10-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975087#comment-14975087 ] Colin Patrick McCabe commented on HDFS-9307: Thanks, [~liuml07]. can you remove it from the

[jira] [Commented] (HDFS-9291) Fix TestInterDatanodeProtocol to be FsDataset-agnostic.

2015-10-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14974965#comment-14974965 ] Colin Patrick McCabe commented on HDFS-9291: +1. Thanks, [~eddyxu]. > Fix

[jira] [Commented] (HDFS-9268) fuse_dfs chown crashes when uid is passed as -1

2015-10-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14974983#comment-14974983 ] Colin Patrick McCabe commented on HDFS-9268: Thanks, [~zhz]. I'll open a follow-on JIRA for

[jira] [Created] (HDFS-9307) fuseConnect should be private to fuse_connect.c

2015-10-26 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-9307: -- Summary: fuseConnect should be private to fuse_connect.c Key: HDFS-9307 URL: https://issues.apache.org/jira/browse/HDFS-9307 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9268) fuse_dfs chown crashes when uid is passed as -1

2015-10-23 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14972001#comment-14972001 ] Colin Patrick McCabe commented on HDFS-9268: I don't think {{fuseConnect}} is used anywhere but

[jira] [Commented] (HDFS-9252) Change TestFileTruncate to use FsDatasetTestUtils to get block file size and genstamp.

2015-10-23 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971552#comment-14971552 ] Colin Patrick McCabe commented on HDFS-9252: I kicked a new jenkins build for this, since it

[jira] [Commented] (HDFS-9267) TestDiskError should get stored replicas through FsDatasetTestUtils.

2015-10-21 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14968060#comment-14968060 ] Colin Patrick McCabe commented on HDFS-9267: Hmm. Good idea overall. Do you think it would be

[jira] [Updated] (HDFS-9270) TestShortCircuitLocalRead should not leave socket after unit test

2015-10-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9270: --- Resolution: Fixed Fix Version/s: 2.8.0 Target Version/s: 2.8.0

[jira] [Commented] (HDFS-9241) HDFS clients can't construct HdfsConfiguration instances

2015-10-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965550#comment-14965550 ] Colin Patrick McCabe commented on HDFS-9241: Protobuf is used in RPCv9. The client must speak

[jira] [Commented] (HDFS-9268) JVM crashes when attempting to update a file in fuse file system using vim

2015-10-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965466#comment-14965466 ] Colin Patrick McCabe commented on HDFS-9268: Hi [~jojochuang], good job debugging this.

[jira] [Commented] (HDFS-9270) TestShortCircuitLocalRead should not leave socket after unit test

2015-10-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965462#comment-14965462 ] Colin Patrick McCabe commented on HDFS-9270: +1. Thanks, [~iwasakims]. >

[jira] [Updated] (HDFS-9268) fuse_dfs chown crashes when uid is passed as -1

2015-10-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9268: --- Assignee: Colin Patrick McCabe (was: Wei-Chiu Chuang) Target Version/s:

[jira] [Updated] (HDFS-9268) fuse_dfs chown crashes when uid is passed as -1

2015-10-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9268: --- Summary: fuse_dfs chown crashes when uid is passed as -1 (was: JVM crashes when

[jira] [Commented] (HDFS-9268) fuse_dfs chown crashes when uid is passed as -1

2015-10-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965632#comment-14965632 ] Colin Patrick McCabe commented on HDFS-9268: I posted a patch which fixes the root of the

[jira] [Updated] (HDFS-9268) fuse_dfs chown crashes when uid is passed as -1

2015-10-20 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9268: --- Attachment: HDFS-9268.002.patch > fuse_dfs chown crashes when uid is passed as -1 >

[jira] [Commented] (HDFS-9241) HDFS clients can't construct HdfsConfiguration instances

2015-10-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14964044#comment-14964044 ] Colin Patrick McCabe commented on HDFS-9241: bq. I see your point, but I will note that it

[jira] [Commented] (HDFS-9252) Change TestFileTruncate to use FsDatasetTestUtils to get block file size and genstamp.

2015-10-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14964229#comment-14964229 ] Colin Patrick McCabe commented on HDFS-9252: bq. The data length and genstemp read from disk

[jira] [Commented] (HDFS-9251) Refactor TestWriteToReplica and TestFsDatasetImpl to avoid explicitly creating Files in tests code.

2015-10-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14964246#comment-14964246 ] Colin Patrick McCabe commented on HDFS-9251: +1 pending Jenkins. Thanks, [~eddyxu]. >

[jira] [Commented] (HDFS-9259) Make SO_SNDBUF size configurable at DFSClient side for hdfs write scenario

2015-10-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14964250#comment-14964250 ] Colin Patrick McCabe commented on HDFS-9259: That seems reasonable to me. It sounds like we

[jira] [Commented] (HDFS-9252) Change TestFileTruncate to use FsDatasetTestUtils to get block file size and genstamp.

2015-10-17 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14962134#comment-14962134 ] Colin Patrick McCabe commented on HDFS-9252: Thanks, [~eddyxu]. {code} + if

[jira] [Commented] (HDFS-9251) Refactor TestWriteToReplica and TestFsDatasetImpl to avoid explicitly creating Files in tests code.

2015-10-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961607#comment-14961607 ] Colin Patrick McCabe commented on HDFS-9251: Thanks, [~eddyxu]. {code} 222

[jira] [Commented] (HDFS-9188) Make block corruption related tests FsDataset-agnostic.

2015-10-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957754#comment-14957754 ] Colin Patrick McCabe commented on HDFS-9188: Thanks, [~eddyxu]. {code} 1533

[jira] [Updated] (HDFS-9187) Fix null pointer error in Globber when FS was not constructed via FileSystem#createFileSystem

2015-10-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9187: --- Attachment: HDFS-9187.003.patch > Fix null pointer error in Globber when FS was not

[jira] [Commented] (HDFS-9187) Fix null pointer error in Globber when FS was not constructed via FileSystem#createFileSystem

2015-10-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1494#comment-1494 ] Colin Patrick McCabe commented on HDFS-9187: Thanks, [~sjlee0]. Should be fixed in v3. > Fix

[jira] [Commented] (HDFS-9011) Support splitting BlockReport of a storage into multiple RPC

2015-10-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955565#comment-14955565 ] Colin Patrick McCabe commented on HDFS-9011: It would be simpler for the admin to create two

[jira] [Updated] (HDFS-9187) Fix null pointer error in Globber when FS was not constructed via FileSystem#createFileSystem

2015-10-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9187: --- Summary: Fix null pointer error in Globber when FS was not constructed via

[jira] [Commented] (HDFS-9047) deprecate libwebhdfs in branch-2; remove from trunk

2015-10-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955574#comment-14955574 ] Colin Patrick McCabe commented on HDFS-9047: bq. Hi Colin Patrick McCabe, as HDFS-9170 has been

[jira] [Commented] (HDFS-9187) Fix null pointer error in Globber when FS was not constructed via FileSystem#createFileSystem

2015-10-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955906#comment-14955906 ] Colin Patrick McCabe commented on HDFS-9187: The test failures are not related (they succeeded

[jira] [Updated] (HDFS-9187) Fix null pointer error in Globber when FS was not constructed via FileSystem#createFileSystem

2015-10-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9187: --- Resolution: Fixed Fix Version/s: 2.8.0 Target Version/s: 2.8.0

[jira] [Commented] (HDFS-9047) deprecate libwebhdfs in branch-2; remove from trunk

2015-10-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956087#comment-14956087 ] Colin Patrick McCabe commented on HDFS-9047: The fact that libwebhdfs has a dependency on JNI

[jira] [Commented] (HDFS-9221) Reduce allocation during block reports

2015-10-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951028#comment-14951028 ] Colin Patrick McCabe commented on HDFS-9221: +1 pending jenkins. Thanks, [~sfriberg]. >

[jira] [Updated] (HDFS-9221) Reduce allocation during block reports

2015-10-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9221: --- Status: Patch Available (was: Open) > Reduce allocation during block reports >

[jira] [Updated] (HDFS-9221) HdfsServerConstants#ReplicaState#getState should avoid calling values() since it creates a temporary array

2015-10-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9221: --- Summary: HdfsServerConstants#ReplicaState#getState should avoid calling values() since

[jira] [Updated] (HDFS-9221) HdfsServerConstants#getState should avoid calling values() since it creates a temporary array

2015-10-09 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9221: --- Summary: HdfsServerConstants#getState should avoid calling values() since it creates a

[jira] [Commented] (HDFS-9188) Make block corruption related tests FsDataset-agnostic.

2015-10-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14949291#comment-14949291 ] Colin Patrick McCabe commented on HDFS-9188: Also, shouldn't we fail to create the materialized

[jira] [Commented] (HDFS-9188) Make block corruption related tests FsDataset-agnostic.

2015-10-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14949284#comment-14949284 ] Colin Patrick McCabe commented on HDFS-9188: Thanks, [~eddyxu]. {code} 38abstract

[jira] [Commented] (HDFS-9137) DeadLock between DataNode#refreshVolumes and BPOfferService#registrationSucceeded

2015-10-07 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14947310#comment-14947310 ] Colin Patrick McCabe commented on HDFS-9137: {code} 512 LOG.warn("Exception while

[jira] [Commented] (HDFS-9000) Allow reconfiguration without restart for parameters where applicable.

2015-10-06 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14945577#comment-14945577 ] Colin Patrick McCabe commented on HDFS-9000: [~wheat9], I agree that supporting reconfiguration

[jira] [Commented] (HDFS-8850) VolumeScanner thread exits with exception if there is no block pool to be scanned but there are suspicious blocks

2015-10-06 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14945437#comment-14945437 ] Colin Patrick McCabe commented on HDFS-8850: I think this makes sense for 2.7.2. Thanks, all.

[jira] [Updated] (HDFS-9155) OEV should treat .XML files as XML even when the file name extension is uppercase

2015-10-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9155: --- Resolution: Fixed Fix Version/s: 2.8.0 Target Version/s: 2.8.0

[jira] [Commented] (HDFS-9138) TestDatanodeStartupFixesLegacyStorageIDs fails on Windows due to failure to unpack old image tarball that contains hard links

2015-10-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14943915#comment-14943915 ] Colin Patrick McCabe commented on HDFS-9138: [~cnauroth], just out of curiosity, what was the

[jira] [Commented] (HDFS-9155) [OEV] : The inputFile does not follow case insensitiveness incase of XML file

2015-10-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14943924#comment-14943924 ] Colin Patrick McCabe commented on HDFS-9155: +1. Thanks, nijel > [OEV] : The inputFile does

[jira] [Updated] (HDFS-9155) OEV should treat .XML files as XML even when the extension is uppercase

2015-10-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9155: --- Summary: OEV should treat .XML files as XML even when the extension is uppercase

[jira] [Commented] (HDFS-9138) TestDatanodeStartupFixesLegacyStorageIDs fails on Windows due to failure to unpack old image tarball that contains hard links

2015-10-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14944385#comment-14944385 ] Colin Patrick McCabe commented on HDFS-9138: Thanks, [~cnauroth]. >

[jira] [Commented] (HDFS-9137) DeadLock between DataNode#refreshVolumes and BPOfferService#registrationSucceeded

2015-10-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14943908#comment-14943908 ] Colin Patrick McCabe commented on HDFS-9137: bq. In an another thought.. How about updating the

[jira] [Updated] (HDFS-9155) OEV should treat .XML files as XML even when the file name extension is uppercase

2015-10-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9155: --- Summary: OEV should treat .XML files as XML even when the file name extension is

[jira] [Commented] (HDFS-9184) Logging HDFS operation's caller context into audit logs

2015-10-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941542#comment-14941542 ] Colin Patrick McCabe commented on HDFS-9184: Is it documented anywhere that the audit log is

[jira] [Commented] (HDFS-9184) Logging HDFS operation's caller context into audit logs

2015-10-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941696#comment-14941696 ] Colin Patrick McCabe commented on HDFS-9184: [~aw]: I feel like this is a good example of why

[jira] [Commented] (HDFS-9188) Make block corruption related tests FsDataset-agnostic.

2015-10-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14942001#comment-14942001 ] Colin Patrick McCabe commented on HDFS-9188: thanks, [~eddyxu]. {{ReplicaToCorrupt}}: it seems

[jira] [Commented] (HDFS-9187) Check if tracer is null before using it

2015-10-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14940594#comment-14940594 ] Colin Patrick McCabe commented on HDFS-9187: I think adding a NullTracer would make sense. I

[jira] [Commented] (HDFS-9184) Logging HDFS operation's caller context into audit logs

2015-10-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14940562#comment-14940562 ] Colin Patrick McCabe commented on HDFS-9184: HTrace doesn't need to be enabled at 100% sampling

[jira] [Updated] (HDFS-9187) Check if tracer is null before using it

2015-10-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9187: --- Assignee: Colin Patrick McCabe Status: Patch Available (was: Open) > Check if

[jira] [Updated] (HDFS-9187) Check if tracer is null before using it

2015-10-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9187: --- Attachment: HDFS-9187.002.patch > Check if tracer is null before using it >

[jira] [Commented] (HDFS-9187) Check if tracer is null before using it

2015-10-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14940608#comment-14940608 ] Colin Patrick McCabe commented on HDFS-9187: This is a different approach that just removes

[jira] [Commented] (HDFS-9187) Check if tracer is null before using it

2015-10-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14940616#comment-14940616 ] Colin Patrick McCabe commented on HDFS-9187: bq. Globber is only place that uses the FS tracer?

[jira] [Commented] (HDFS-9170) Move libhdfs / fuse-dfs / libwebhdfs to a separate module

2015-09-29 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14934782#comment-14934782 ] Colin Patrick McCabe commented on HDFS-9170: I don't have any objections to moving libhdfs,

[jira] [Updated] (HDFS-9080) update htrace version to 4.0.1

2015-09-29 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9080: --- Component/s: tracing > update htrace version to 4.0.1 > --

[jira] [Created] (HDFS-9177) TestTextCommand: use mkdirs rather than mkdir to create test directory

2015-09-29 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-9177: -- Summary: TestTextCommand: use mkdirs rather than mkdir to create test directory Key: HDFS-9177 URL: https://issues.apache.org/jira/browse/HDFS-9177

[jira] [Commented] (HDFS-9080) update htrace version to 4.0.1

2015-09-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14933380#comment-14933380 ] Colin Patrick McCabe commented on HDFS-9080: The "new findbugs" warning files are empty, and

[jira] [Updated] (HDFS-9080) update htrace version to 4.0.1

2015-09-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9080: --- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-9080) update htrace version to 4.0.1

2015-09-28 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9080: --- Attachment: HDFS-9080.013.patch > update htrace version to 4.0.1 >

[jira] [Updated] (HDFS-8873) Allow the directoryScanner to be rate-limited

2015-09-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8873: --- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-8873) Allow the directoryScanner to be rate-limited

2015-09-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8873: --- Summary: Allow the directoryScanner to be rate-limited (was: throttle

[jira] [Commented] (HDFS-8873) Allow the directoryScanner to be rate-limited

2015-09-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909206#comment-14909206 ] Colin Patrick McCabe commented on HDFS-8873: +1. Thanks, [~templedf]. The test failures are

[jira] [Commented] (HDFS-9087) Add some jitter to DataNode.checkDiskErrorThread

2015-09-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909207#comment-14909207 ] Colin Patrick McCabe commented on HDFS-9087: +1. Thanks, [~eclark]. > Add some jitter to

[jira] [Updated] (HDFS-9080) update htrace version to 4.0.1

2015-09-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9080: --- Summary: update htrace version to 4.0.1 (was: update htrace version to 4.0) > update

[jira] [Updated] (HDFS-9080) update htrace version to 4.0.1

2015-09-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9080: --- Attachment: HDFS-9080.011.patch > update htrace version to 4.0.1 >

[jira] [Updated] (HDFS-9147) Fix the setting of visibleLength in ExternalBlockReader

2015-09-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9147: --- Status: Patch Available (was: Open) > Fix the setting of visibleLength in

[jira] [Updated] (HDFS-9080) update htrace version to 4.0.1

2015-09-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9080: --- Attachment: HDFS-9080.012.patch Remove unused include Don't use deprecated Builder

[jira] [Updated] (HDFS-9147) Fix the setting of visibleLength in ExternalBlockReader

2015-09-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9147: --- Attachment: HDFS-9147.001.patch > Fix the setting of visibleLength in

<    1   2   3   4   5   6   7   8   9   10   >