[jira] [Commented] (HDFS-3908) In HA mode, when there is a ledger in BK missing, which is generated after the last checkpoint, NN can not restore it.

2012-09-11 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453764#comment-13453764 ] Vinay commented on HDFS-3908: - Hi Xiao, Here is my understanding about the problem: 1. In Non-

[jira] [Commented] (HDFS-3925) Prettify PipelineAck#toString() for printing to a log

2012-09-11 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453759#comment-13453759 ] Todd Lipcon commented on HDFS-3925: --- +1 pending Hudson > Prettify Pipeli

[jira] [Commented] (HDFS-3924) Multi-byte id in HdfsVolumeId

2012-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453750#comment-13453750 ] Hadoop QA commented on HDFS-3924: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3919) MiniDFSCluster:waitClusterUp can hang forever

2012-09-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453748#comment-13453748 ] Hudson commented on HDFS-3919: -- Integrated in Hadoop-Mapreduce-trunk-Commit #2748 (See [https

[jira] [Updated] (HDFS-3926) QJM: Add user documentation for QJM

2012-09-11 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-3926: - Attachment: regular-ha-doc.diff qjm-ha-doc.diff HDFS-3926.patch He

[jira] [Created] (HDFS-3926) QJM: Add user documentation for QJM

2012-09-11 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-3926: Summary: QJM: Add user documentation for QJM Key: HDFS-3926 URL: https://issues.apache.org/jira/browse/HDFS-3926 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-3925) Prettify PipelineAck#toString() for printing to a log

2012-09-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-3925: -- Target Version/s: 2.0.3-alpha Status: Patch Available (was: Open) > Prettify Pipeline

[jira] [Updated] (HDFS-3925) Prettify PipelineAck#toString() for printing to a log

2012-09-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-3925: -- Attachment: hdfs-3925-1.patch Trivial patch attached. Calling TextFormat#shortDebugString instead uses t

[jira] [Created] (HDFS-3925) Prettify PipelineAck#toString() for printing to a log

2012-09-11 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-3925: - Summary: Prettify PipelineAck#toString() for printing to a log Key: HDFS-3925 URL: https://issues.apache.org/jira/browse/HDFS-3925 Project: Hadoop HDFS Issue Type:

[jira] [Assigned] (HDFS-3925) Prettify PipelineAck#toString() for printing to a log

2012-09-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-3925: - Assignee: Andrew Wang > Prettify PipelineAck#toString() for printing to a log > --

[jira] [Commented] (HDFS-3664) BlockManager race when stopping active services

2012-09-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453716#comment-13453716 ] Hudson commented on HDFS-3664: -- Integrated in Hadoop-Mapreduce-trunk-Commit #2747 (See [https

[jira] [Commented] (HDFS-3919) MiniDFSCluster:waitClusterUp can hang forever

2012-09-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453701#comment-13453701 ] Hudson commented on HDFS-3919: -- Integrated in Hadoop-Hdfs-trunk-Commit #2787 (See [https://bu

[jira] [Commented] (HDFS-3919) MiniDFSCluster:waitClusterUp can hang forever

2012-09-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453700#comment-13453700 ] Hudson commented on HDFS-3919: -- Integrated in Hadoop-Common-trunk-Commit #2724 (See [https://

[jira] [Updated] (HDFS-3919) MiniDFSCluster:waitClusterUp can hang forever

2012-09-11 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3919: -- Resolution: Fixed Fix Version/s: 2.0.3-alpha Target Version/s: (was: 2.0.2-alpha)

[jira] [Updated] (HDFS-3924) Multi-byte id in HdfsVolumeId

2012-09-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-3924: -- Status: Patch Available (was: Open) > Multi-byte id in HdfsVolumeId > -

[jira] [Commented] (HDFS-3664) BlockManager race when stopping active services

2012-09-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453696#comment-13453696 ] Hudson commented on HDFS-3664: -- Integrated in Hadoop-Hdfs-trunk-Commit #2786 (See [https://bu

[jira] [Commented] (HDFS-3664) BlockManager race when stopping active services

2012-09-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453695#comment-13453695 ] Hudson commented on HDFS-3664: -- Integrated in Hadoop-Common-trunk-Commit #2723 (See [https://

[jira] [Updated] (HDFS-3924) Multi-byte id in HdfsVolumeId

2012-09-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-3924: -- Attachment: hdfs-3924-1.patch Patch changing the {{byte}} to an {{int}}, which should be sufficient for

[jira] [Updated] (HDFS-3924) Multi-byte id in HdfsVolumeId

2012-09-11 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-3924: -- Description: Currently, the {{id}} in {{HdfsVolumeId}} is just a single byte. It'd be nice to make this

[jira] [Commented] (HDFS-3902) TestDatanodeBlockScanner is flaky, broke entirely after HDFS-3828

2012-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453690#comment-13453690 ] Hadoop QA commented on HDFS-3902: - -1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-2656) Implement a pure c client based on webhdfs

2012-09-11 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-2656: -- Fix Version/s: (was: 3.0.0) 2.0.3-alpha Updating the fix version to 2.0.3 since i

[jira] [Updated] (HDFS-3664) BlockManager race when stopping active services

2012-09-11 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3664: -- Resolution: Fixed Fix Version/s: 2.0.2-alpha Target Version/s: (was: 2.0.2-alpha)

[jira] [Commented] (HDFS-3664) BlockManager race when stopping active services

2012-09-11 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453683#comment-13453683 ] Eli Collins commented on HDFS-3664: --- Good catch. +1 (test failure is still unrelated)

[jira] [Updated] (HDFS-3924) Multi-byte id in HdfsVolumeId

2012-09-11 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-3924: - Component/s: hdfs client > Multi-byte id in HdfsVolumeId > - > >

[jira] [Updated] (HDFS-3924) Multi-byte id in HdfsVolumeId

2012-09-11 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-3924: - Target Version/s: 2.0.3-alpha > Multi-byte id in HdfsVolumeId > -

[jira] [Commented] (HDFS-3902) TestDatanodeBlockScanner is flaky, broke entirely after HDFS-3828

2012-09-11 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453682#comment-13453682 ] Andy Isaacson commented on HDFS-3902: - bq. TestDatanodeBlockScanner still fails about 1

[jira] [Commented] (HDFS-3916) libwebhdfs (C client) code cleanups

2012-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453678#comment-13453678 ] Hadoop QA commented on HDFS-3916: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3370) HDFS hardlink

2012-09-11 Thread Jesse Yates (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453667#comment-13453667 ] Jesse Yates commented on HDFS-3370: --- @Jaganar - with HBASE-6055 (currently in review) you

[jira] [Created] (HDFS-3924) Multi-byte id in HdfsVolumeId

2012-09-11 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-3924: - Summary: Multi-byte id in HdfsVolumeId Key: HDFS-3924 URL: https://issues.apache.org/jira/browse/HDFS-3924 Project: Hadoop HDFS Issue Type: Bug Affects Version

[jira] [Commented] (HDFS-3664) BlockManager race when stopping active services

2012-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453656#comment-13453656 ] Hadoop QA commented on HDFS-3664: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3703) Decrease the datanode failure detection time

2012-09-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453653#comment-13453653 ] Jing Zhao commented on HDFS-3703: - The two test failures are mentioned in HDFS-3811 and HDF

[jira] [Updated] (HDFS-49) MiniDFSCluster.stopDataNode will always shut down a node in the cluster if a matching name is not found

2012-09-11 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-49?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-49: Fix Version/s: (was: 1.1.0) > MiniDFSCluster.stopDataNode will always shut down a node in the

[jira] [Updated] (HDFS-2317) Read access to HDFS using HTTP REST

2012-09-11 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-2317: -- Fix Version/s: (was: 1.1.0) > Read access to HDFS using HTTP REST >

[jira] [Updated] (HDFS-2065) Fix NPE in DFSClient.getFileChecksum

2012-09-11 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-2065: -- Fix Version/s: (was: 1.1.0) > Fix NPE in DFSClient.getFileChecksum > ---

[jira] [Updated] (HDFS-2318) Provide authentication to webhdfs using SPNEGO

2012-09-11 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-2318: -- Fix Version/s: (was: 1.1.0) > Provide authentication to webhdfs using SPNEGO > -

[jira] [Updated] (HDFS-2331) Hdfs compilation fails

2012-09-11 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-2331: -- Fix Version/s: (was: 1.1.0) > Hdfs compilation fails > -- > >

[jira] [Updated] (HDFS-2427) webhdfs mkdirs api call creates path with 777 permission, we should default it to 755

2012-09-11 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-2427: -- Fix Version/s: (was: 1.1.0) > webhdfs mkdirs api call creates path with 777 permission,

[jira] [Updated] (HDFS-2361) hftp is broken

2012-09-11 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-2361: -- Fix Version/s: (was: 1.1.0) > hftp is broken > -- > > Key: H

[jira] [Updated] (HDFS-2368) defaults created for web keytab and principal, these properties should not have defaults

2012-09-11 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-2368: -- Fix Version/s: (was: 1.1.0) > defaults created for web keytab and principal, these prope

[jira] [Updated] (HDFS-2366) webhdfs throws a npe when ugi is null from getDelegationToken

2012-09-11 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-2366: -- Fix Version/s: (was: 1.1.0) > webhdfs throws a npe when ugi is null from getDelegationTo

[jira] [Updated] (HDFS-2356) webhdfs: support case insensitive query parameter names

2012-09-11 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-2356: -- Fix Version/s: (was: 1.1.0) > webhdfs: support case insensitive query parameter names >

[jira] [Updated] (HDFS-2333) HDFS-2284 introduced 2 findbugs warnings on trunk

2012-09-11 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-2333: -- Fix Version/s: (was: 1.1.0) > HDFS-2284 introduced 2 findbugs warnings on trunk > --

[jira] [Updated] (HDFS-2340) Support getFileBlockLocations and getDelegationToken in webhdfs

2012-09-11 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-2340: -- Fix Version/s: (was: 1.1.0) > Support getFileBlockLocations and getDelegationToken in we

[jira] [Updated] (HDFS-2338) Configuration option to enable/disable webhdfs.

2012-09-11 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-2338: -- Fix Version/s: (was: 1.1.0) > Configuration option to enable/disable webhdfs. >

[jira] [Updated] (HDFS-2348) Support getContentSummary and getFileChecksum in webhdfs

2012-09-11 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-2348: -- Fix Version/s: (was: 1.1.0) > Support getContentSummary and getFileChecksum in webhdfs >

[jira] [Updated] (HDFS-2453) tail using a webhdfs uri throws an error

2012-09-11 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-2453: -- Fix Version/s: (was: 1.1.0) > tail using a webhdfs uri throws an error > ---

[jira] [Updated] (HDFS-2432) webhdfs setreplication api should return a 403 when called on a directory

2012-09-11 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-2432: -- Target Version/s: 1.0.0, 0.23.0, 0.24.0 (was: 0.23.0, 0.24.0, 1.0.0) Fix Version/s: (

[jira] [Updated] (HDFS-2494) [webhdfs] When Getting the file using OP=OPEN with DN http address, ESTABLISHED sockets are growing.

2012-09-11 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-2494: -- Target Version/s: 1.0.0, 0.24.0 (was: 0.24.0, 1.0.0) Fix Version/s: (was: 1.1.0)

[jira] [Updated] (HDFS-2501) add version prefix and root methods to webhdfs

2012-09-11 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-2501: -- Target Version/s: 1.0.0, 0.23.0, 0.24.0 (was: 0.23.0, 0.24.0, 1.0.0) Fix Version/s: (

[jira] [Updated] (HDFS-2552) Add WebHdfs Forrest doc

2012-09-11 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-2552: -- Fix Version/s: (was: 1.1.0) > Add WebHdfs Forrest doc > --- > >

[jira] [Updated] (HDFS-2604) Add a log message to show if WebHDFS is enabled

2012-09-11 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-2604: -- Fix Version/s: (was: 1.1.0) > Add a log message to show if WebHDFS is enabled >

[jira] [Commented] (HDFS-3703) Decrease the datanode failure detection time

2012-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453631#comment-13453631 ] Hadoop QA commented on HDFS-3703: - -1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-3902) TestDatanodeBlockScanner is flaky, broke entirely after HDFS-3828

2012-09-11 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-3902: Attachment: hdfs3902.txt Due to HDFS-1371, the {{IOUtils.copyBytes}} in testBlockCorruptionPolicy do

[jira] [Updated] (HDFS-3902) TestDatanodeBlockScanner is flaky, broke entirely after HDFS-3828

2012-09-11 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-3902: Status: Patch Available (was: Open) Attaching hdfs3902.txt which fixes the reliable test failure in

[jira] [Updated] (HDFS-3916) libwebhdfs (C client) code cleanups

2012-09-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3916: --- Attachment: HDFS-3916.005.patch * don't need to typecast result of {{malloc}}, {{callo

[jira] [Commented] (HDFS-3923) libwebhdfs testing code cleanup

2012-09-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453602#comment-13453602 ] Colin Patrick McCabe commented on HDFS-3923: Yeah, it will definitely be nice t

[jira] [Updated] (HDFS-3664) BlockManager race when stopping active services

2012-09-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3664: --- Attachment: HDFS-3664.002.patch > BlockManager race when stopping active services

[jira] [Commented] (HDFS-3664) BlockManager race when stopping active services

2012-09-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453590#comment-13453590 ] Colin Patrick McCabe commented on HDFS-3664: bq. Not your change but in BlockMa

[jira] [Commented] (HDFS-3664) BlockManager race when stopping active services

2012-09-11 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453585#comment-13453585 ] Eli Collins commented on HDFS-3664: --- Change looks good. And the test failures look unrela

[jira] [Commented] (HDFS-3919) MiniDFSCluster:waitClusterUp can hang forever

2012-09-11 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453580#comment-13453580 ] Eli Collins commented on HDFS-3919: --- +1 lgtm. test failures are unrelated.

[jira] [Updated] (HDFS-3176) JsonUtil should not parse the MD5MD5CRC32FileChecksum bytes on its own.

2012-09-11 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-3176: -- Target Version/s: 1.1.0 Fix Version/s: 1.1.0 > JsonUtil should not parse the MD5MD5CR

[jira] [Updated] (HDFS-3461) HFTP should use the same port & protocol for getting the delegation token

2012-09-11 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-3461: -- Fix Version/s: (was: 1.1.0) > HFTP should use the same port & protocol for getting the d

[jira] [Updated] (HDFS-3461) HFTP should use the same port & protocol for getting the delegation token

2012-09-11 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-3461: -- Target Version/s: 1.1.0 > HFTP should use the same port & protocol for getting the delegatio

[jira] [Updated] (HDFS-3696) Create files with WebHdfsFileSystem goes OOM when file size is big

2012-09-11 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-3696: -- Target Version/s: 1.1.0 Fix Version/s: 1.1.0 > Create files with WebHdfsFileSystem go

[jira] [Commented] (HDFS-3664) BlockManager race when stopping active services

2012-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453568#comment-13453568 ] Hadoop QA commented on HDFS-3664: - -1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-3819) Should check whether invalidate work percentage default value is not greater than 1.0f

2012-09-11 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-3819: -- Fix Version/s: (was: 1.1.0) 1.2.0 > Should check whether invalidate w

[jira] [Commented] (HDFS-2656) Implement a pure c client based on webhdfs

2012-09-11 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453563#comment-13453563 ] Tsz Wo (Nicholas), SZE commented on HDFS-2656: -- {quote} ... I thought this JI

[jira] [Updated] (HDFS-3044) fsck move should be non-destructive by default

2012-09-11 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-3044: -- Target Version/s: 1.1.0 > fsck move should be non-destructive by default > -

[jira] [Updated] (HDFS-1108) Log newly allocated blocks

2012-09-11 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-1108: -- Fix Version/s: (was: 1.1.0) 1.2.0 > Log newly allocated blocks >

[jira] [Updated] (HDFS-3919) MiniDFSCluster:waitClusterUp can hang forever

2012-09-11 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3919: -- Target Version/s: 2.0.2-alpha > MiniDFSCluster:waitClusterUp can hang forever >

[jira] [Updated] (HDFS-3909) Change Jenkins setting to test libwebhdfs

2012-09-11 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3909: - Description: HDFS-2656 adds libwebhdfs but Jenkins is not yet able to build it and

[jira] [Commented] (HDFS-2631) Add optional libwebhdfs support to fuse-dfs

2012-09-11 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453554#comment-13453554 ] Eli Collins commented on HDFS-2631: --- Yea, that's why we use the target version.

[jira] [Commented] (HDFS-3912) Detecting and avoiding stale datanodes for writing

2012-09-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453552#comment-13453552 ] Jing Zhao commented on HDFS-3912: - Move and summarize part of the comments from HDFS-3703 h

[jira] [Commented] (HDFS-3912) Detecting and avoiding stale datanodes for writing

2012-09-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453551#comment-13453551 ] Jing Zhao commented on HDFS-3912: - Suresh's comments in HDFS-3703: bq. However for the writ

[jira] [Updated] (HDFS-3922) 0.22 and 0.23 namenode throws away blocks under construction on restart

2012-09-11 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-3922: -- Fix Version/s: (was: 0.23.4) (was: 0.22.1) Kihwal, I just reset Fix V

[jira] [Updated] (HDFS-3920) libwebdhfs code cleanup: string processing and using strerror consistently to handle all errors

2012-09-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3920: Description: 1. Clean up code for string processing; 2. Using strerror consistently for error handling; 3. U

[jira] [Created] (HDFS-3923) libwebhdfs testing code cleanup

2012-09-11 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-3923: --- Summary: libwebhdfs testing code cleanup Key: HDFS-3923 URL: https://issues.apache.org/jira/browse/HDFS-3923 Project: Hadoop HDFS Issue Type: Sub-task Repo

[jira] [Commented] (HDFS-3540) Further improvement on recovery mode and edit log toleration in branch-1

2012-09-11 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453547#comment-13453547 ] Tsz Wo (Nicholas), SZE commented on HDFS-3540: -- For the suggestion on printing

[jira] [Commented] (HDFS-3919) MiniDFSCluster:waitClusterUp can hang forever

2012-09-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453528#comment-13453528 ] Hadoop QA commented on HDFS-3919: - -1 overall. Here are the results of testing the latest

[jira] [Created] (HDFS-3922) 0.22 and 0.23 namenode throws away blocks under construction on restart

2012-09-11 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-3922: Summary: 0.22 and 0.23 namenode throws away blocks under construction on restart Key: HDFS-3922 URL: https://issues.apache.org/jira/browse/HDFS-3922 Project: Hadoop HDFS

[jira] [Updated] (HDFS-3703) Decrease the datanode failure detection time

2012-09-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3703: Attachment: HDFS-3703-trunk-read-only.patch Correct the error that the old patch did not check if the lastup

[jira] [Commented] (HDFS-3703) Decrease the datanode failure detection time

2012-09-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453521#comment-13453521 ] Jing Zhao commented on HDFS-3703: - Also combine the two test cases in TestGetBlocks.

[jira] [Commented] (HDFS-2631) Add optional libwebhdfs support to fuse-dfs

2012-09-11 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453515#comment-13453515 ] Suresh Srinivas commented on HDFS-2631: --- bq. It's not clear, often having it unset me

[jira] [Commented] (HDFS-3920) libwebdhfs code cleanup: string processing and using strerror consistently to handle all errors

2012-09-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453514#comment-13453514 ] Jing Zhao commented on HDFS-3920: - Thanks for the comments Colin! I will pay attention to t

[jira] [Commented] (HDFS-2631) Add optional libwebhdfs support to fuse-dfs

2012-09-11 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453512#comment-13453512 ] Eli Collins commented on HDFS-2631: --- bq. Not sure I understand this comment and why it wa

[jira] [Commented] (HDFS-3731) 2.0 release upgrade must handle blocks being written from 1.0

2012-09-11 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453511#comment-13453511 ] Kihwal Lee commented on HDFS-3731: -- bq. Bobby is busy is busy I meant that he's extre

[jira] [Commented] (HDFS-3731) 2.0 release upgrade must handle blocks being written from 1.0

2012-09-11 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453510#comment-13453510 ] Kihwal Lee commented on HDFS-3731: -- Since Bobby is busy is busy with the 0.23.3 release, I

[jira] [Assigned] (HDFS-3664) BlockManager race when stopping active services

2012-09-11 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins reassigned HDFS-3664: - Assignee: Colin Patrick McCabe > BlockManager race when stopping active services > ---

[jira] [Commented] (HDFS-3920) libwebdhfs code cleanup: string processing and using strerror consistently to handle all errors

2012-09-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453503#comment-13453503 ] Colin Patrick McCabe commented on HDFS-3920: note: strerror itself isn't thread

[jira] [Commented] (HDFS-2631) Add optional libwebhdfs support to fuse-dfs

2012-09-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453497#comment-13453497 ] Jing Zhao commented on HDFS-2631: - Thanks for the updating Eli! Right now because I only th

[jira] [Commented] (HDFS-3916) libwebhdfs (C client) code cleanups

2012-09-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453496#comment-13453496 ] Colin Patrick McCabe commented on HDFS-3916: bq. sizeof(char) is defined to be

[jira] [Updated] (HDFS-3916) libwebhdfs (C client) code cleanups

2012-09-11 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-3916: -- Affects Version/s: (was: 2.0.3-alpha) 3.0.0 > libwebhdfs (C clien

[jira] [Updated] (HDFS-2656) Implement a pure c client based on webhdfs

2012-09-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-2656: Fix Version/s: (was: 2.0.3-alpha) 3.0.0 > Implement a pure c client based on webh

[jira] [Assigned] (HDFS-3731) 2.0 release upgrade must handle blocks being written from 1.0

2012-09-11 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee reassigned HDFS-3731: Assignee: Kihwal Lee (was: Robert Joseph Evans) > 2.0 release upgrade must handle blocks being

[jira] [Commented] (HDFS-2631) Add optional libwebhdfs support to fuse-dfs

2012-09-11 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453495#comment-13453495 ] Suresh Srinivas commented on HDFS-2631: --- Eli, thanks for updating the summary. bq.

[jira] [Updated] (HDFS-2631) Add optional libwebhdfs support to fuse-dfs

2012-09-11 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-2631: -- Component/s: fuse-dfs Summary: Add optional libwebhdfs support to fuse-dfs (was: Rewrite fuse-d

[jira] [Commented] (HDFS-3910) DFSTestUtil#waitReplication should timeout

2012-09-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453483#comment-13453483 ] Hudson commented on HDFS-3910: -- Integrated in Hadoop-Mapreduce-trunk-Commit #2744 (See [https

[jira] [Updated] (HDFS-3664) BlockManager race when stopping active services

2012-09-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3664: --- Status: Patch Available (was: Open) > BlockManager race when stopping active serv

[jira] [Updated] (HDFS-3664) BlockManager race when stopping active services

2012-09-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-3664: --- Attachment: HDFS-3664.001.patch * Previously, we were setting blocksMap to {{null}} be

[jira] [Commented] (HDFS-2631) Rewrite fuse-dfs to use libwebhdfs

2012-09-11 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453469#comment-13453469 ] Colin Patrick McCabe commented on HDFS-2631: Yeah. The goal should be to have

  1   2   >