[jira] [Commented] (HDFS-3343) Improve metrics for DN read latency

2012-07-02 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405656#comment-13405656 ] Todd Lipcon commented on HDFS-3343: --- +1 pending Jenkins test-patch results

[jira] [Commented] (HDFS-3370) HDFS hardlink

2012-07-02 Thread Jesse Yates (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405654#comment-13405654 ] Jesse Yates commented on HDFS-3370: --- Sorry for the slow reply, been a bit busy of late...

[jira] [Commented] (HDFS-3370) HDFS hardlink

2012-07-02 Thread Jesse Yates (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405655#comment-13405655 ] Jesse Yates commented on HDFS-3370: --- Another, simpler way to do hardlinks with cross-serv

[jira] [Updated] (HDFS-3343) Improve metrics for DN read latency

2012-07-02 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3343: -- Status: Patch Available (was: Open) Marking patch available so the jenkins bot runs. >

[jira] [Commented] (HDFS-3582) Hook System.exit in MiniDFSCluster

2012-07-02 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405627#comment-13405627 ] Tsz Wo (Nicholas), SZE commented on HDFS-3582: -- I think we should check if the

[jira] [Commented] (HDFS-3581) FSPermissionChecker#checkPermission stick bit check missing range check

2012-07-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405607#comment-13405607 ] Hadoop QA commented on HDFS-3581: - +1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-3574) Fix small race and do some cleanup in GetImageServlet

2012-07-02 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3574: -- Attachment: hdfs-3574.txt New patch tries to address findbugs warnings. > Fix small rac

[jira] [Commented] (HDFS-3574) Fix small race and do some cleanup in GetImageServlet

2012-07-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405506#comment-13405506 ] Hadoop QA commented on HDFS-3574: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3591) Backport HDFS-3357 to branch-0.23

2012-07-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405505#comment-13405505 ] Hadoop QA commented on HDFS-3591: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-3510) Improve FSEditLog pre-allocation

2012-07-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405493#comment-13405493 ] Colin Patrick McCabe commented on HDFS-3510: Yeah, the branch-1 version is in t

[jira] [Commented] (HDFS-3586) Blocks are not getting replicate even DN's are availble.

2012-07-02 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405484#comment-13405484 ] Uma Maheswara Rao G commented on HDFS-3586: --- Hi Konstantin, {code} I don't see h

[jira] [Commented] (HDFS-3190) Simple refactors in existing NN code to assist QuorumJournalManager extension

2012-07-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405482#comment-13405482 ] Hadoop QA commented on HDFS-3190: - -1 overall. Here are the results of testing the latest

[jira] [Updated] (HDFS-3343) Improve metrics for DN read latency

2012-07-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-3343: -- Attachment: hdfs-3343-4.patch Realized I was silly about the public thing, and just changed it to access

[jira] [Updated] (HDFS-3190) Simple refactors in existing NN code to assist QuorumJournalManager extension

2012-07-02 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3190: -- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available) Commit

[jira] [Commented] (HDFS-3190) Simple refactors in existing NN code to assist QuorumJournalManager extension

2012-07-02 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405451#comment-13405451 ] Todd Lipcon commented on HDFS-3190: --- Thanks for the review, Suresh. I'll commit this mome

[jira] [Commented] (HDFS-3190) Simple refactors in existing NN code to assist QuorumJournalManager extension

2012-07-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405446#comment-13405446 ] Hadoop QA commented on HDFS-3190: - -1 overall. Here are the results of testing the latest

[jira] [Created] (HDFS-3592) libhdfs should expose ClientProtocol::mkdirs2

2012-07-02 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-3592: -- Summary: libhdfs should expose ClientProtocol::mkdirs2 Key: HDFS-3592 URL: https://issues.apache.org/jira/browse/HDFS-3592 Project: Hadoop HDFS I

[jira] [Commented] (HDFS-3191) Active NN should exit when it cannot write to quorum number of Journal Daemons

2012-07-02 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405429#comment-13405429 ] Todd Lipcon commented on HDFS-3191: --- I think this is already satisfied by the current cod

[jira] [Commented] (HDFS-3582) Hook System.exit in MiniDFSCluster

2012-07-02 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405408#comment-13405408 ] Eli Collins commented on HDFS-3582: --- Right but why does what's done here break that? If y

[jira] [Commented] (HDFS-3586) Blocks are not getting replicate even DN's are availble.

2012-07-02 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405404#comment-13405404 ] Konstantin Shvachko commented on HDFS-3586: --- Uma, I think that the RBW replicas o

[jira] [Updated] (HDFS-3574) Fix small race and do some cleanup in GetImageServlet

2012-07-02 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3574: -- Attachment: hdfs-3574.txt Attached patch adds the file path to the FileNotFoundException thrown. I also

[jira] [Commented] (HDFS-3510) Improve FSEditLog pre-allocation

2012-07-02 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405398#comment-13405398 ] Suresh Srinivas commented on HDFS-3510: --- Colin, making this change for 1.x release se

[jira] [Commented] (HDFS-3190) Simple refactors in existing NN code to assist QuorumJournalManager extension

2012-07-02 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405382#comment-13405382 ] Suresh Srinivas commented on HDFS-3190: --- +1 for the patch. > Simple

[jira] [Commented] (HDFS-3590) Print a WARN if the edit log sync period takes more than X time units

2012-07-02 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405333#comment-13405333 ] Andy Isaacson commented on HDFS-3590: - I'm +1 on the concept of logging a message when

[jira] [Updated] (HDFS-3553) Hftp proxy tokens are broken

2012-07-02 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-3553: -- Attachment: HDFS-3553-1.branch-1.0.patch Problem is in both the hftp client and the NN. # NN is trying t

[jira] [Commented] (HDFS-3586) Blocks are not getting replicate even DN's are availble.

2012-07-02 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405293#comment-13405293 ] Uma Maheswara Rao G commented on HDFS-3586: --- Hi Konstantin, What is your suggest

[jira] [Commented] (HDFS-3585) Blocks are getting marked as corrupt when commitblocksyncronization(Since recovery called by another client) is success before BR send

2012-07-02 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405291#comment-13405291 ] Uma Maheswara Rao G commented on HDFS-3585: --- Todd, If this situation happened for

[jira] [Commented] (HDFS-3113) httpfs does not support delegation tokens

2012-07-02 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405287#comment-13405287 ] Alejandro Abdelnur commented on HDFS-3113: -- @Daryn, I'm looking at the Token#decod

[jira] [Commented] (HDFS-3582) Hook System.exit in MiniDFSCluster

2012-07-02 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405244#comment-13405244 ] Alejandro Abdelnur commented on HDFS-3582: -- In the case of HDFS testcases it may w

[jira] [Commented] (HDFS-3561) ZKFC retries for 45 times to connect to other NN during fencing when network between NNs broken and standby Nn will not take over as active

2012-07-02 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405238#comment-13405238 ] Uma Maheswara Rao G commented on HDFS-3561: --- Thanks Aaron :-) {quote} Regardless

[jira] [Commented] (HDFS-3370) HDFS hardlink

2012-07-02 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405228#comment-13405228 ] Andy Isaacson commented on HDFS-3370: - The Windows ".lnk" file scheme is a pretty awful

[jira] [Commented] (HDFS-3561) ZKFC retries for 45 times to connect to other NN during fencing when network between NNs broken and standby Nn will not take over as active

2012-07-02 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405227#comment-13405227 ] Aaron T. Myers commented on HDFS-3561: -- Ah, yes. Both in the case of BKJM or the QJM,

[jira] [Commented] (HDFS-3561) ZKFC retries for 45 times to connect to other NN during fencing when network between NNs broken and standby Nn will not take over as active

2012-07-02 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405222#comment-13405222 ] Uma Maheswara Rao G commented on HDFS-3561: --- Hi Aaron, Thanks a lot. {code}

[jira] [Commented] (HDFS-3582) Hook System.exit in MiniDFSCluster

2012-07-02 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405213#comment-13405213 ] Eli Collins commented on HDFS-3582: --- I should say before it creates the NN, 2NN, DNs, etc

[jira] [Commented] (HDFS-3582) Hook System.exit in MiniDFSCluster

2012-07-02 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405211#comment-13405211 ] Eli Collins commented on HDFS-3582: --- That's correct, I'm assuming the mini cluster is ini

[jira] [Updated] (HDFS-3573) Supply NamespaceInfo when instantiating JournalManagers

2012-07-02 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3573: -- Resolution: Fixed Fix Version/s: 3.0.0 Hadoop Flags: Reviewed Status: Resolved (w

[jira] [Commented] (HDFS-3568) fuse_dfs: add support for security

2012-07-02 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405202#comment-13405202 ] Colin Patrick McCabe commented on HDFS-3568: The general approach here is to al

[jira] [Commented] (HDFS-3113) httpfs does not support delegation tokens

2012-07-02 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405203#comment-13405203 ] Alejandro Abdelnur commented on HDFS-3113: -- bq. Would you please elaborate ... If

[jira] [Updated] (HDFS-3591) Backport HDFS-3357 to branch-0.23

2012-07-02 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Joseph Evans updated HDFS-3591: -- Status: Patch Available (was: Open) This patch does not apply to trunk, or branch-0.23.

[jira] [Updated] (HDFS-3591) Backport HDFS-3357 to branch-0.23

2012-07-02 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Joseph Evans updated HDFS-3591: -- Attachment: HDFS-3357-branch-0.23.txt This is mostly a direct port of HDFS-3357 and HADO

[jira] [Commented] (HDFS-3370) HDFS hardlink

2012-07-02 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405195#comment-13405195 ] Daryn Sharp commented on HDFS-3370: --- Jesse describes NNs proxying requests to each other

[jira] [Updated] (HDFS-3573) Supply NamespaceInfo when instantiating JournalManagers

2012-07-02 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3573: -- Attachment: hdfs-3573.txt Addressed ATM's style nit above. I'll commit this momentarily since the only

[jira] [Updated] (HDFS-3190) Simple refactors in existing NN code to assist QuorumJournalManager extension

2012-07-02 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3190: -- Attachment: hdfs-3190.txt Thanks for the review, Suresh. Here's an updated patch. - Fixed the 80+ long

[jira] [Commented] (HDFS-3582) Hook System.exit in MiniDFSCluster

2012-07-02 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405192#comment-13405192 ] Alejandro Abdelnur commented on HDFS-3582: -- Then, shouldn't you setup the the secu

[jira] [Created] (HDFS-3591) Backport HDFS-3357 to branch-0.23

2012-07-02 Thread Robert Joseph Evans (JIRA)
Robert Joseph Evans created HDFS-3591: - Summary: Backport HDFS-3357 to branch-0.23 Key: HDFS-3591 URL: https://issues.apache.org/jira/browse/HDFS-3591 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-3586) Blocks are not getting replicate even DN's are availble.

2012-07-02 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405178#comment-13405178 ] Uma Maheswara Rao G commented on HDFS-3586: --- Thanks Brahma for filing the JIRA.

[jira] [Commented] (HDFS-3590) Print a WARN if the edit log sync period takes more than X time units

2012-07-02 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405170#comment-13405170 ] Todd Lipcon commented on HDFS-3590: --- Nice idea. Per-directory metrics would also be a nic

[jira] [Created] (HDFS-3590) Print a WARN if the edit log sync period takes more than X time units

2012-07-02 Thread Harsh J (JIRA)
Harsh J created HDFS-3590: - Summary: Print a WARN if the edit log sync period takes more than X time units Key: HDFS-3590 URL: https://issues.apache.org/jira/browse/HDFS-3590 Project: Hadoop HDFS Is

[jira] [Commented] (HDFS-3585) Blocks are getting marked as corrupt when commitblocksyncronization(Since recovery called by another client) is success before BR send

2012-07-02 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405167#comment-13405167 ] Todd Lipcon commented on HDFS-3585: --- If I follow correctly, you're saying that the BR con

[jira] [Assigned] (HDFS-3585) Blocks are getting marked as corrupt when commitblocksyncronization(Since recovery called by another client) is success before BR send

2012-07-02 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reassigned HDFS-3585: - Assignee: (was: Todd Lipcon) (oops, I didn't mean to assign this... just meant to comment)

[jira] [Assigned] (HDFS-3585) Blocks are getting marked as corrupt when commitblocksyncronization(Since recovery called by another client) is success before BR send

2012-07-02 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reassigned HDFS-3585: - Assignee: Todd Lipcon > Blocks are getting marked as corrupt when commitblocksyncronization(Si

[jira] [Commented] (HDFS-3575) HttpFS does not log Exception Stacktraces

2012-07-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405158#comment-13405158 ] Hudson commented on HDFS-3575: -- Integrated in Hadoop-Mapreduce-trunk-Commit #2437 (See [https

[jira] [Commented] (HDFS-3582) Hook System.exit in MiniDFSCluster

2012-07-02 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405155#comment-13405155 ] Eli Collins commented on HDFS-3582: --- @Alejandro, those should still work right? An exampl

[jira] [Created] (HDFS-3589) Package hadoop-pipes examples/bin directory (again)

2012-07-02 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-3589: -- Summary: Package hadoop-pipes examples/bin directory (again) Key: HDFS-3589 URL: https://issues.apache.org/jira/browse/HDFS-3589 Project: Hadoop HDFS

[jira] [Commented] (HDFS-3561) ZKFC retries for 45 times to connect to other NN during fencing when network between NNs broken and standby Nn will not take over as active

2012-07-02 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405151#comment-13405151 ] Aaron T. Myers commented on HDFS-3561: -- bq. How we can do shared storage fencing from

[jira] [Updated] (HDFS-3581) FSPermissionChecker#checkPermission stick bit check missing range check

2012-07-02 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-3581: - Status: Patch Available (was: Open) Marking PA for Eli. > FSPermissionChecker#ch

[jira] [Commented] (HDFS-3370) HDFS hardlink

2012-07-02 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405142#comment-13405142 ] Konstantin Shvachko commented on HDFS-3370: --- Jesse, thanks for the detailed propo

[jira] [Commented] (HDFS-3557) provide means of escaping special characters to `hadoop fs` command

2012-07-02 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405141#comment-13405141 ] Daryn Sharp commented on HDFS-3557: --- Would you please fill in the affected versions?

[jira] [Commented] (HDFS-3588) Wget retrieval of fsimage fails

2012-07-02 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405137#comment-13405137 ] Harsh J commented on HDFS-3588: --- I think we should document here or via another JIRA that /ge

[jira] [Commented] (HDFS-3113) httpfs does not support delegation tokens

2012-07-02 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405133#comment-13405133 ] Daryn Sharp commented on HDFS-3113: --- I think the new patch addressed the few token servic

[jira] [Resolved] (HDFS-3588) Wget retrieval of fsimage fails

2012-07-02 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-3588. --- Resolution: Invalid > Wget retrieval of fsimage fails > --- > >

[jira] [Commented] (HDFS-3588) Wget retrieval of fsimage fails

2012-07-02 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405132#comment-13405132 ] Todd Lipcon commented on HDFS-3588: --- You need to specify which image you want to download

[jira] [Commented] (HDFS-3575) HttpFS does not log Exception Stacktraces

2012-07-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405130#comment-13405130 ] Hudson commented on HDFS-3575: -- Integrated in Hadoop-Hdfs-trunk-Commit #2488 (See [https://bu

[jira] [Created] (HDFS-3588) Wget retrieval of fsimage fails

2012-07-02 Thread Jeff Lord (JIRA)
Jeff Lord created HDFS-3588: --- Summary: Wget retrieval of fsimage fails Key: HDFS-3588 URL: https://issues.apache.org/jira/browse/HDFS-3588 Project: Hadoop HDFS Issue Type: Bug Components:

[jira] [Commented] (HDFS-3575) HttpFS does not log Exception Stacktraces

2012-07-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405127#comment-13405127 ] Hudson commented on HDFS-3575: -- Integrated in Hadoop-Common-trunk-Commit #2420 (See [https://

[jira] [Created] (HDFS-3587) Direct write the packet to datanode when dataQueue is empty

2012-07-02 Thread binlijin (JIRA)
binlijin created HDFS-3587: -- Summary: Direct write the packet to datanode when dataQueue is empty Key: HDFS-3587 URL: https://issues.apache.org/jira/browse/HDFS-3587 Project: Hadoop HDFS Issue Type

[jira] [Updated] (HDFS-3575) HttpFS does not log Exception Stacktraces

2012-07-02 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated HDFS-3575: - Resolution: Fixed Fix Version/s: 2.0.1-alpha Hadoop Flags: Reviewed

[jira] [Updated] (HDFS-3586) Blocks are not getting replicate even DN's are availble.

2012-07-02 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-3586: --- Attachment: HDFS-3586-analysis.txt Attaching anlyased sheet > Blocks

[jira] [Assigned] (HDFS-3575) HttpFS does not log Exception Stacktraces

2012-07-02 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur reassigned HDFS-3575: Assignee: Brock Noland +1 > HttpFS does not log Exception Stacktrac

[jira] [Commented] (HDFS-3582) Hook System.exit in MiniDFSCluster

2012-07-02 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405097#comment-13405097 ] Alejandro Abdelnur commented on HDFS-3582: -- @Eli, it would be great if the Miniclu

[jira] [Created] (HDFS-3586) Blocks are not getting replicate even DN's are availble.

2012-07-02 Thread Brahma Reddy Battula (JIRA)
Brahma Reddy Battula created HDFS-3586: -- Summary: Blocks are not getting replicate even DN's are availble. Key: HDFS-3586 URL: https://issues.apache.org/jira/browse/HDFS-3586 Project: Hadoop HDFS

[jira] [Commented] (HDFS-3585) Blocks are getting marked as corrupt when commitblocksyncronization(Since recovery called by another client) is success before BR send

2012-07-02 Thread amith (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405055#comment-13405055 ] amith commented on HDFS-3585: - In the mentioned scenario consider we a have block of GS 1002 a

[jira] [Commented] (HDFS-3584) Blocks are getting marked as corrupt with append operation under high load.

2012-07-02 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405043#comment-13405043 ] Uma Maheswara Rao G commented on HDFS-3584: --- Thanks Brahma and Amith for digging

[jira] [Commented] (HDFS-3584) Blocks are getting marked as corrupt with append operation under high load.

2012-07-02 Thread amith (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405025#comment-13405025 ] amith commented on HDFS-3584: - Here I can see client1 are not able to get the lease renewed wit

[jira] [Commented] (HDFS-3157) Error in deleting block is keep on coming from DN even after the block report and directory scanning has happened

2012-07-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405016#comment-13405016 ] Hudson commented on HDFS-3157: -- Integrated in Hadoop-Hdfs-trunk #1093 (See [https://builds.ap

[jira] [Commented] (HDFS-3585) Blocks are getting marked as corrupt when commitblocksyncronization(Since recovery called by another client) is success before BR send

2012-07-02 Thread amith (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13404992#comment-13404992 ] amith commented on HDFS-3585: - Here the scenario is 1. Create 2 clients 2. write a file using

[jira] [Commented] (HDFS-3122) Block recovery with closeFile flag true can race with blockReport. Due to this blocks are getting marked as corrupt.

2012-07-02 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13404950#comment-13404950 ] Uma Maheswara Rao G commented on HDFS-3122: --- Hi Nicholas, I feel this issue is

[jira] [Created] (HDFS-3585) Blocks are getting marked as corrupt when commitblocksyncronization(Since recovery called by another client) is success before BR send

2012-07-02 Thread Brahma Reddy Battula (JIRA)
Brahma Reddy Battula created HDFS-3585: -- Summary: Blocks are getting marked as corrupt when commitblocksyncronization(Since recovery called by another client) is success before BR send Key: HDFS-3585 URL: ht

[jira] [Commented] (HDFS-3157) Error in deleting block is keep on coming from DN even after the block report and directory scanning has happened

2012-07-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13404940#comment-13404940 ] Hudson commented on HDFS-3157: -- Integrated in Hadoop-Mapreduce-trunk-Commit #2436 (See [https

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2012-07-02 Thread zhiyuan.dai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13404937#comment-13404937 ] zhiyuan.dai commented on HDFS-1783: --- @Lars Hofhansl Is this patch available in your vers

[jira] [Commented] (HDFS-3157) Error in deleting block is keep on coming from DN even after the block report and directory scanning has happened

2012-07-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13404928#comment-13404928 ] Hudson commented on HDFS-3157: -- Integrated in Hadoop-Common-trunk-Commit #2419 (See [https://

[jira] [Commented] (HDFS-3157) Error in deleting block is keep on coming from DN even after the block report and directory scanning has happened

2012-07-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13404925#comment-13404925 ] Hudson commented on HDFS-3157: -- Integrated in Hadoop-Hdfs-trunk-Commit #2487 (See [https://bu

[jira] [Updated] (HDFS-3157) Error in deleting block is keep on coming from DN even after the block report and directory scanning has happened

2012-07-02 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-3157: - Resolution: Fixed Fix Version/s: 2.0.1-alpha Hadoop Flags: Reviewed

[jira] [Commented] (HDFS-3157) Error in deleting block is keep on coming from DN even after the block report and directory scanning has happened

2012-07-02 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13404913#comment-13404913 ] Uma Maheswara Rao G commented on HDFS-3157: --- Thanks Nicholas for the explanation.