[jira] [Commented] (HDFS-4720) Misleading warning message in WebhdfsFileSystem when trying to check whether path exist using webhdfs url

2013-04-22 Thread Jerry He (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13637783#comment-13637783 ] Jerry He commented on HDFS-4720: Is this the message and stack before your fix? $ hadoop

[jira] [Commented] (HDFS-4723) Occasional failure in TestDFSClientRetries#testGetFileChecksum because the number of available xcievers is set too low

2013-04-22 Thread Andrew Purtell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13637791#comment-13637791 ] Andrew Purtell commented on HDFS-4723: -- Using a new clean configuration object works.

[jira] [Commented] (HDFS-4720) Misleading warning message in WebhdfsFileSystem when trying to check whether path exist using webhdfs url

2013-04-22 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13637833#comment-13637833 ] Yu Li commented on HDFS-4720: - Hello [~jerryhe], The message and stack I observed(as shown

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

2013-04-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13637867#comment-13637867 ] Ted Yu commented on HDFS-4721: -- In FSNamesystem#internalReleaseLease(): {code} case

[jira] [Commented] (HDFS-3705) Add the possibility to mark a node as 'low priority' for read in the DFSClient

2013-04-22 Thread Nicolas Liochon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13637922#comment-13637922 ] Nicolas Liochon commented on HDFS-3705: --- This JIRA is actually more critical than I

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

2013-04-22 Thread Varun Sharma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638125#comment-13638125 ] Varun Sharma commented on HDFS-4721: nicholas, Good point. I will create a patch which

[jira] [Created] (HDFS-4724) Provide API for checking whether lease is recovered or not

2013-04-22 Thread Ted Yu (JIRA)
Ted Yu created HDFS-4724: Summary: Provide API for checking whether lease is recovered or not Key: HDFS-4724 URL: https://issues.apache.org/jira/browse/HDFS-4724 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-4725) fix HDFS file handle leaks

2013-04-22 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-4725: --- Summary: fix HDFS file handle leaks Key: HDFS-4725 URL: https://issues.apache.org/jira/browse/HDFS-4725 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-4724) Provide API for checking whether lease is recovered or not

2013-04-22 Thread Varun Sharma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638172#comment-13638172 ] Varun Sharma commented on HDFS-4724: I guess we still need a client side timeout.

[jira] [Commented] (HDFS-4722) TestGetConf#testFederation times out on Windows

2013-04-22 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638181#comment-13638181 ] Daryn Sharp commented on HDFS-4722: --- +1 TestGetConf#testFederation

[jira] [Commented] (HDFS-4715) Backport HDFS-3577 and other related WebHDFS issue to branch-1

2013-04-22 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638183#comment-13638183 ] Tsz Wo (Nicholas), SZE commented on HDFS-4715: -- Thanks Mark, patch looks good.

[jira] [Updated] (HDFS-4715) Backport HDFS-3577 and other related WebHDFS issue to branch-1

2013-04-22 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-4715: - Attachment: HDFS-4751.2.patch HDFS-4751.2.patch: addresses above two minor

[jira] [Commented] (HDFS-4715) Backport HDFS-3577 and other related WebHDFS issue to branch-1

2013-04-22 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638185#comment-13638185 ] Tsz Wo (Nicholas), SZE commented on HDFS-4715: -- Mark, since Jenkins won't be

[jira] [Commented] (HDFS-4715) Backport HDFS-3577 and other related WebHDFS issue to branch-1

2013-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638188#comment-13638188 ] Hadoop QA commented on HDFS-4715: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-4715) Backport HDFS-3577 and other related WebHDFS issue to branch-1

2013-04-22 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-4715: - Attachment: (was: HDFS-4751.2.patch) Backport HDFS-3577 and other

[jira] [Commented] (HDFS-4715) Backport HDFS-3577 and other related WebHDFS issue to branch-1

2013-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638200#comment-13638200 ] Hadoop QA commented on HDFS-4715: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4708) Add snapshot user guide

2013-04-22 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638203#comment-13638203 ] Suresh Srinivas commented on HDFS-4708: --- Thanks for adding the document. Comments: #

[jira] [Commented] (HDFS-4715) Backport HDFS-3577 and other related WebHDFS issue to branch-1

2013-04-22 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638213#comment-13638213 ] Tsz Wo (Nicholas), SZE commented on HDFS-4715: -- test-patch results: {noformat}

[jira] [Commented] (HDFS-4724) Provide API for checking whether lease is recovered or not

2013-04-22 Thread Enis Soztutar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638243#comment-13638243 ] Enis Soztutar commented on HDFS-4724: - Now that HDFS-4525 is resolved, should we close

[jira] [Commented] (HDFS-4722) TestGetConf#testFederation times out on Windows

2013-04-22 Thread Ivan Mitic (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638260#comment-13638260 ] Ivan Mitic commented on HDFS-4722: -- Thanks Daryn!

[jira] [Commented] (HDFS-4525) Provide an API for knowing that whether file is closed or not.

2013-04-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638275#comment-13638275 ] Ted Yu commented on HDFS-4525: -- This API is very useful for client to determine whether lease

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

2013-04-22 Thread Nicolas Liochon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638295#comment-13638295 ] Nicolas Liochon commented on HDFS-4721: --- The algo as I understand it is: namenode

[jira] [Updated] (HDFS-4708) Add snapshot user guide

2013-04-22 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-4708: - Attachment: h4708_20130422.patch h4708_20130422.patch: addresses Suresh's

[jira] [Commented] (HDFS-4715) Backport HDFS-3577 and other related WebHDFS issue to branch-1

2013-04-22 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638314#comment-13638314 ] Tsz Wo (Nicholas), SZE commented on HDFS-4715: -- All unit tests passed in my

[jira] [Updated] (HDFS-4715) Backport HDFS-3577 and other related WebHDFS issue to branch-1

2013-04-22 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-4715: - Resolution: Fixed Fix Version/s: 1.2.0 Hadoop Flags: Reviewed

[jira] [Commented] (HDFS-4708) Add snapshot user guide

2013-04-22 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638335#comment-13638335 ] Suresh Srinivas commented on HDFS-4708: --- +1 for the patch. Add

[jira] [Commented] (HDFS-4719) Minor simplifications to snapshot code

2013-04-22 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638359#comment-13638359 ] Tsz Wo (Nicholas), SZE commented on HDFS-4719: -- Thanks Arpit. The patch looks

[jira] [Resolved] (HDFS-4724) Provide API for checking whether lease is recovered or not

2013-04-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HDFS-4724. -- Resolution: Duplicate Duplicate of HDFS-4525 Provide API for checking whether lease is

[jira] [Commented] (HDFS-4704) Add a transient flag to file so that transient files won't be included in any snapshot

2013-04-22 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638393#comment-13638393 ] Daryn Sharp commented on HDFS-4704: --- This would fit nicely into adding xattr support for

[jira] [Created] (HDFS-4726) Fix test failures after merging the mapping from INodeId to INode

2013-04-22 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-4726: --- Summary: Fix test failures after merging the mapping from INodeId to INode Key: HDFS-4726 URL: https://issues.apache.org/jira/browse/HDFS-4726 Project: Hadoop HDFS

[jira] [Updated] (HDFS-4726) Fix test failures after merging the mapping from INodeId to INode

2013-04-22 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4726: Attachment: HDFS-4726.001.patch With the patch all the failed tests

[jira] [Updated] (HDFS-4713) Wrong server principal is used for rpc calls to namenode if HA is enabled

2013-04-22 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-4713: - Priority: Major (was: Blocker) Wrong server principal is used for rpc calls to namenode if HA is

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

2013-04-22 Thread Varun Sharma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638457#comment-13638457 ] Varun Sharma commented on HDFS-4721: Attached v2 which does the following: 1)

[jira] [Commented] (HDFS-4680) Audit logging of client names

2013-04-22 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638459#comment-13638459 ] Daryn Sharp commented on HDFS-4680: --- [~tlipcon] Yes, the client would be able to name

[jira] [Updated] (HDFS-4726) Fix test failures after merging the mapping from INodeId to INode

2013-04-22 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-4726: - Component/s: (was: datanode) Priority: Minor (was: Major) Hadoop

[jira] [Created] (HDFS-4727) Update inodeMap after deleting files/directories/snapshots

2013-04-22 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-4727: --- Summary: Update inodeMap after deleting files/directories/snapshots Key: HDFS-4727 URL: https://issues.apache.org/jira/browse/HDFS-4727 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-4269) DatanodeManager#registerDatanode rejects all datanode registrations from localhost in single-node developer setup

2013-04-22 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638500#comment-13638500 ] Daryn Sharp commented on HDFS-4269: --- Sorry, was OOO. Performing the lookups outside of

[jira] [Resolved] (HDFS-4726) Fix test failures after merging the mapping from INodeId to INode

2013-04-22 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE resolved HDFS-4726. -- Resolution: Fixed Fix Version/s: Snapshot (HDFS-2802) I have committed

[jira] [Created] (HDFS-4728) Snapshot tests broken after merge from trunk

2013-04-22 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-4728: --- Summary: Snapshot tests broken after merge from trunk Key: HDFS-4728 URL: https://issues.apache.org/jira/browse/HDFS-4728 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-4269) DatanodeManager#registerDatanode rejects all datanode registrations from localhost in single-node developer setup

2013-04-22 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638519#comment-13638519 ] Chris Nauroth commented on HDFS-4269: - No worries, Daryn. Thanks for clarification of

[jira] [Resolved] (HDFS-4728) Snapshot tests broken after merge from trunk

2013-04-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-4728. - Resolution: Duplicate Too slow - dup'ed to HDFS-4726. Snapshot tests broken

[jira] [Commented] (HDFS-4726) Fix test failures after merging the mapping from INodeId to INode

2013-04-22 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638521#comment-13638521 ] Jing Zhao commented on HDFS-4726: - Created HDFS-4727 to fix the remaining issue.

[jira] [Updated] (HDFS-4727) Update inodeMap after deleting files/directories/snapshots

2013-04-22 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4727: Attachment: HDFS-4727.001.patch 1. Update inodeMap after file/dir/snapshot deletion. 2. Add new inode into

[jira] [Updated] (HDFS-4719) Minor simplifications to snapshot code

2013-04-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-4719: Attachment: HDFS-4719.004.patch Fixed. Apologies for the oversights. Thanks, Arpit

[jira] [Commented] (HDFS-4680) Audit logging of client names

2013-04-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638547#comment-13638547 ] Andrew Wang commented on HDFS-4680: --- [~daryn] I skimmed the Dapper paper a bit too, it

[jira] [Updated] (HDFS-4725) fix HDFS file handle leaks

2013-04-22 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-4725: Attachment: HDFS-4725.1.patch I'm attaching a patch to address the file handle leaks that I've

[jira] [Updated] (HDFS-4725) fix HDFS file handle leaks

2013-04-22 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-4725: Status: Patch Available (was: Open) fix HDFS file handle leaks --

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

2013-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638558#comment-13638558 ] Hadoop QA commented on HDFS-4721: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

2013-04-22 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638561#comment-13638561 ] Tsz Wo (Nicholas), SZE commented on HDFS-4721: -- I think we don't need the new

[jira] [Commented] (HDFS-4269) DatanodeManager#registerDatanode rejects all datanode registrations from localhost in single-node developer setup

2013-04-22 Thread Jagane Sundar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638563#comment-13638563 ] Jagane Sundar commented on HDFS-4269: - OK. The TCP endpoint gives you an IP address,

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

2013-04-22 Thread Varun Sharma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638569#comment-13638569 ] Varun Sharma commented on HDFS-4721: Hi Nicholas, Thanks for taking a look... In my

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

2013-04-22 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638575#comment-13638575 ] Tsz Wo (Nicholas), SZE commented on HDFS-4721: -- So, you think we should

[jira] [Updated] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

2013-04-22 Thread Varun Sharma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Sharma updated HDFS-4721: --- Attachment: 4721-v3.patch Speed up lease/block recovery when DN fails and a block goes into

[jira] [Commented] (HDFS-4719) Minor simplifications to snapshot code

2013-04-22 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638577#comment-13638577 ] Tsz Wo (Nicholas), SZE commented on HDFS-4719: -- +1 on the latest patch. I

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

2013-04-22 Thread Varun Sharma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638578#comment-13638578 ] Varun Sharma commented on HDFS-4721: Hi Nicholas, I attached v3 which does that.

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

2013-04-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638584#comment-13638584 ] Andrew Wang commented on HDFS-4721: --- I took a look at the latest patch, some comments:

[jira] [Updated] (HDFS-4727) Update inodeMap after deleting files/directories/snapshots

2013-04-22 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-4727: - Component/s: (was: datanode) Hadoop Flags: Reviewed +1 patch looks good.

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

2013-04-22 Thread Varun Sharma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638595#comment-13638595 ] Varun Sharma commented on HDFS-4721: Thanks Andrew for taking a look ! I just attached

[jira] [Resolved] (HDFS-4727) Update inodeMap after deleting files/directories/snapshots

2013-04-22 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE resolved HDFS-4727. -- Resolution: Fixed Fix Version/s: Snapshot (HDFS-2802) I have committed

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

2013-04-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638603#comment-13638603 ] Andrew Wang commented on HDFS-4721: --- Regarding repeated recoveries, I had the same

[jira] [Updated] (HDFS-2802) Support for RW/RO snapshots in HDFS

2013-04-22 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-2802: - Attachment: h2802_20130422.patch h2802_20130422.patch: merged with inode id map.

[jira] [Created] (HDFS-4729) Update OfflineImageViewer and fix TestOfflineImageViewer

2013-04-22 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-4729: --- Summary: Update OfflineImageViewer and fix TestOfflineImageViewer Key: HDFS-4729 URL: https://issues.apache.org/jira/browse/HDFS-4729 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

2013-04-22 Thread Varun Sharma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638614#comment-13638614 ] Varun Sharma commented on HDFS-4721: Yeah, so currently, we just try to avoid trying

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

2013-04-22 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638617#comment-13638617 ] Tsz Wo (Nicholas), SZE commented on HDFS-4721: -- It is better to try all

[jira] [Updated] (HDFS-4729) Update OfflineImageViewer and fix TestOfflineImageViewer

2013-04-22 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4729: Attachment: HDFS-4729.001.patch The initial patch can fix current TestOfflineImageViewer. Will update the

[jira] [Commented] (HDFS-4719) Minor simplifications to snapshot code

2013-04-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638621#comment-13638621 ] Arpit Agarwal commented on HDFS-4719: - Thanks for all the reviews Nicholas!

[jira] [Commented] (HDFS-4725) fix HDFS file handle leaks

2013-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638627#comment-13638627 ] Hadoop QA commented on HDFS-4725: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-4725) fix HDFS file handle leaks

2013-04-22 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-4725: - Hadoop Flags: Reviewed +1 patch looks good. fix HDFS file

[jira] [Updated] (HDFS-4725) fix HDFS file handle leaks

2013-04-22 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-4725: - Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was:

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

2013-04-22 Thread Varun Sharma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638679#comment-13638679 ] Varun Sharma commented on HDFS-4721: Hi Nicholas, I think thats a good point. Do you

[jira] [Commented] (HDFS-4725) fix HDFS file handle leaks

2013-04-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638683#comment-13638683 ] Hudson commented on HDFS-4725: -- Integrated in Hadoop-trunk-Commit #3647 (See

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

2013-04-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638684#comment-13638684 ] Ted Yu commented on HDFS-4721: -- I think the actual failure scenarios in production cluster are

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

2013-04-22 Thread Varun Sharma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638694#comment-13638694 ] Varun Sharma commented on HDFS-4721: I think in 99 % of cases, when we see no heart

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

2013-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638698#comment-13638698 ] Hadoop QA commented on HDFS-4721: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

2013-04-22 Thread Varun Sharma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Sharma updated HDFS-4721: --- Attachment: 4721-v4.patch Speed up lease/block recovery when DN fails and a block goes into

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

2013-04-22 Thread Varun Sharma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638723#comment-13638723 ] Varun Sharma commented on HDFS-4721: Attached patch v4... This one is a lot cleaner

[jira] [Updated] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

2013-04-22 Thread Varun Sharma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Sharma updated HDFS-4721: --- Attachment: (was: 4721-v4.patch) Speed up lease/block recovery when DN fails and a block

[jira] [Updated] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

2013-04-22 Thread Varun Sharma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Sharma updated HDFS-4721: --- Attachment: 4721-v4.patch Speed up lease/block recovery when DN fails and a block goes into

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

2013-04-22 Thread Varun Sharma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638726#comment-13638726 ] Varun Sharma commented on HDFS-4721: Sorry, there was some issue with the previous

[jira] [Commented] (HDFS-2802) Support for RW/RO snapshots in HDFS

2013-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638728#comment-13638728 ] Hadoop QA commented on HDFS-2802: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (HDFS-4730) KeyManagerFactory.getInstance supports SunX509 ibmX509 in HsftpFileSystem.java

2013-04-22 Thread Tian Hong Wang (JIRA)
Tian Hong Wang created HDFS-4730: Summary: KeyManagerFactory.getInstance supports SunX509 ibmX509 in HsftpFileSystem.java Key: HDFS-4730 URL: https://issues.apache.org/jira/browse/HDFS-4730 Project:

[jira] [Updated] (HDFS-4730) KeyManagerFactory.getInstance supports SunX509 ibmX509 in HsftpFileSystem.java

2013-04-22 Thread Tian Hong Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tian Hong Wang updated HDFS-4730: - Summary: KeyManagerFactory.getInstance supports SunX509 ibmX509 in HsftpFileSystem.java (was:

[jira] [Updated] (HDFS-4730) KeyManagerFactory.getInstance supports SunX509 ibmX509 in HsftpFileSystem.java

2013-04-22 Thread Tian Hong Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tian Hong Wang updated HDFS-4730: - Attachment: HDFS-4730_trunk.patch KeyManagerFactory.getInstance supports SunX509 ibmX509 in

[jira] [Updated] (HDFS-4730) KeyManagerFactory.getInstance supports SunX509 ibmX509 in HsftpFileSystem.java

2013-04-22 Thread Tian Hong Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tian Hong Wang updated HDFS-4730: - Status: Patch Available (was: Open) KeyManagerFactory.getInstance supports SunX509 ibmX509

[jira] [Updated] (HDFS-4686) Fix quota computation for rename with snapshots

2013-04-22 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4686: Attachment: HDFS-4686.002.patch Rebase the patch and fix another bug. Fix quota

[jira] [Commented] (HDFS-4721) Speed up lease/block recovery when DN fails and a block goes into recovery

2013-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638761#comment-13638761 ] Hadoop QA commented on HDFS-4721: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-4709) TestDFSClientRetries-testGetFileChecksum fails on IBM JAVA 6

2013-04-22 Thread Amir Sanjar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amir Sanjar updated HDFS-4709: -- Summary: TestDFSClientRetries-testGetFileChecksum fails on IBM JAVA 6 (was:

[jira] [Updated] (HDFS-4709) TestDFSClientRetries-estGetFileChecksum fails on IBM JAVA 6

2013-04-22 Thread Amir Sanjar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amir Sanjar updated HDFS-4709: -- Summary: TestDFSClientRetries-estGetFileChecksum fails on IBM JAVA 6 (was:

[jira] [Commented] (HDFS-4730) KeyManagerFactory.getInstance supports SunX509 ibmX509 in HsftpFileSystem.java

2013-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638793#comment-13638793 ] Hadoop QA commented on HDFS-4730: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-4730) KeyManagerFactory.getInstance supports SunX509 ibmX509 in HsftpFileSystem.java

2013-04-22 Thread Tian Hong Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tian Hong Wang updated HDFS-4730: - Attachment: HDFS-4730-v1.patch KeyManagerFactory.getInstance supports SunX509 ibmX509 in

[jira] [Updated] (HDFS-4730) KeyManagerFactory.getInstance supports SunX509 ibmX509 in HsftpFileSystem.java

2013-04-22 Thread Tian Hong Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tian Hong Wang updated HDFS-4730: - Fix Version/s: 2.0.3-alpha Status: Patch Available (was: Open)

[jira] [Updated] (HDFS-4730) KeyManagerFactory.getInstance supports SunX509 ibmX509 in HsftpFileSystem.java

2013-04-22 Thread Tian Hong Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tian Hong Wang updated HDFS-4730: - Status: Open (was: Patch Available) KeyManagerFactory.getInstance supports SunX509 ibmX509