[jira] Updated: (HDFS-970) FSImage writing should always fsync before close

[ https://issues.apache.org/jira/browse/HDFS-970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-970: - Attachment: hdfs-970.txt Trivial patch to add fsyncs to the image saving, fstime writing, and

[jira] Updated: (HDFS-970) FSImage writing should always fsync before close

[ https://issues.apache.org/jira/browse/HDFS-970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-970: - Status: Patch Available (was: Open) FSImage writing should always fsync before close

[jira] Commented: (HDFS-556) Provide info on failed volumes in the web ui

[ https://issues.apache.org/jira/browse/HDFS-556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866074#action_12866074 ] dhruba borthakur commented on HDFS-556: --- This will be very helpful for system

[jira] Commented: (HDFS-1141) completeFile does not check lease ownership

[ https://issues.apache.org/jira/browse/HDFS-1141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866075#action_12866075 ] dhruba borthakur commented on HDFS-1141: +1, code looks good. I will commit in a day

[jira] Commented: (HDFS-988) saveNamespace can corrupt edits log

[ https://issues.apache.org/jira/browse/HDFS-988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866081#action_12866081 ] dhruba borthakur commented on HDFS-988: --- Code looks excellent. can we add a unit test

[jira] Commented: (HDFS-970) FSImage writing should always fsync before close

[ https://issues.apache.org/jira/browse/HDFS-970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866115#action_12866115 ] Hadoop QA commented on HDFS-970: -1 overall. Here are the results of testing the latest

[jira] Commented: (HDFS-1141) completeFile does not check lease ownership

[ https://issues.apache.org/jira/browse/HDFS-1141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866176#action_12866176 ] Tsz Wo (Nicholas), SZE commented on HDFS-1141: -- +1 thanks for working on it,

[jira] Updated: (HDFS-1141) completeFile does not check lease ownership

[ https://issues.apache.org/jira/browse/HDFS-1141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1141: -- Attachment: hdfs-1141.txt Updated patch based on Nicholas's feedback. I also removed CompleteFileStatus

[jira] Updated: (HDFS-1141) completeFile does not check lease ownership

[ https://issues.apache.org/jira/browse/HDFS-1141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1141: -- Status: Open (was: Patch Available) completeFile does not check lease ownership

[jira] Updated: (HDFS-1141) completeFile does not check lease ownership

[ https://issues.apache.org/jira/browse/HDFS-1141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1141: -- Status: Patch Available (was: Open) completeFile does not check lease ownership

[jira] Commented: (HDFS-556) Provide info on failed volumes in the web ui

[ https://issues.apache.org/jira/browse/HDFS-556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866222#action_12866222 ] Andrew Ryan commented on HDFS-556: -- For sysadmins of clusters of any size, providing this in

[jira] Commented: (HDFS-1140) Speedup INode.getPathComponents

[ https://issues.apache.org/jira/browse/HDFS-1140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866224#action_12866224 ] Hairong Kuang commented on HDFS-1140: - All paths are stored as bytes in memory. In

[jira] Commented: (HDFS-556) Provide info on failed volumes in the web ui

[ https://issues.apache.org/jira/browse/HDFS-556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866227#action_12866227 ] dhruba borthakur commented on HDFS-556: --- @andrew: how about if we put this info in the

[jira] Commented: (HDFS-556) Provide info on failed volumes in the web ui

[ https://issues.apache.org/jira/browse/HDFS-556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866228#action_12866228 ] Eli Collins commented on HDFS-556: -- @Andrew: I added a volumes failed metric in HDFS-811 for

[jira] Commented: (HDFS-1141) completeFile does not check lease ownership

[ https://issues.apache.org/jira/browse/HDFS-1141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866233#action_12866233 ] Tsz Wo (Nicholas), SZE commented on HDFS-1141: -- Not sure what you're referring

[jira] Updated: (HDFS-1061) Memory footprint optimization for INodeFile object.

[ https://issues.apache.org/jira/browse/HDFS-1061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-1061: -- Hadoop Flags: [Incompatible change, Reviewed] Contrib test failure unrelated. +1. Marking as

[jira] Updated: (HDFS-1061) Memory footprint optimization for INodeFile object.

[ https://issues.apache.org/jira/browse/HDFS-1061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-1061: -- Status: Resolved (was: Patch Available) Resolution: Fixed I've just committed this. Thanks,

[jira] Commented: (HDFS-1141) completeFile does not check lease ownership

[ https://issues.apache.org/jira/browse/HDFS-1141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866256#action_12866256 ] Hadoop QA commented on HDFS-1141: - -1 overall. Here are the results of testing the latest

[jira] Updated: (HDFS-218) name node should provide status of dfs.name.dir's

[ https://issues.apache.org/jira/browse/HDFS-218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Phulari updated HDFS-218: -- Status: Patch Available (was: Open) Resubmitting patch for hudson queue. name node should provide

[jira] Created: (HDFS-1143) Implement Background deletion

Implement Background deletion - Key: HDFS-1143 URL: https://issues.apache.org/jira/browse/HDFS-1143 Project: Hadoop HDFS Issue Type: Improvement Reporter: Dmytro Molkov Assignee: Scott

[jira] Commented: (HDFS-1138) Modification times are being overwritten when FSImage loads

[ https://issues.apache.org/jira/browse/HDFS-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866274#action_12866274 ] Eli Collins commented on HDFS-1138: --- Nice catch Dmytro! Patch looks good to me. * I'd

[jira] Created: (HDFS-1144) Improve Trash Emptier

Improve Trash Emptier - Key: HDFS-1144 URL: https://issues.apache.org/jira/browse/HDFS-1144 Project: Hadoop HDFS Issue Type: Improvement Reporter: Dmytro Molkov Assignee: Dmytro Molkov There are

[jira] Created: (HDFS-1145) When NameNode is shutdown it tries to exit safemode

When NameNode is shutdown it tries to exit safemode --- Key: HDFS-1145 URL: https://issues.apache.org/jira/browse/HDFS-1145 Project: Hadoop HDFS Issue Type: Bug Components: name-node

[jira] Assigned: (HDFS-1145) When NameNode is shutdown it tries to exit safemode

[ https://issues.apache.org/jira/browse/HDFS-1145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur reassigned HDFS-1145: -- Assignee: dhruba borthakur When NameNode is shutdown it tries to exit safemode

[jira] Commented: (HDFS-1145) When NameNode is shutdown it tries to exit safemode

[ https://issues.apache.org/jira/browse/HDFS-1145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866298#action_12866298 ] Ravi Phulari commented on HDFS-1145: Good catch Dhruba, One minor correction, Could

[jira] Updated: (HDFS-1138) Modification times are being overwritten when FSImage loads

[ https://issues.apache.org/jira/browse/HDFS-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmytro Molkov updated HDFS-1138: Attachment: HDFS-1138.2.patch This one addresses Eli's comments. Modification times are being

[jira] Updated: (HDFS-1145) When NameNode is shutdown it tries to exit safemode

[ https://issues.apache.org/jira/browse/HDFS-1145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HDFS-1145: --- Attachment: NNsafemodeMonitor.txt I had attached an older version of this patch. here is the

[jira] Commented: (HDFS-1141) completeFile does not check lease ownership

[ https://issues.apache.org/jira/browse/HDFS-1141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866319#action_12866319 ] Todd Lipcon commented on HDFS-1141: --- The failed tests are unrelated (TestNodeCounts passes

[jira] Commented: (HDFS-889) Possible race condition in BlocksMap.NodeIterator.

[ https://issues.apache.org/jira/browse/HDFS-889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866322#action_12866322 ] Todd Lipcon commented on HDFS-889: -- Is this just a test bug? i.e is the contract of

[jira] Commented: (HDFS-1103) Replica recovery doesn't distinguish between flushed-but-corrupted last chunk and unflushed last chunk

[ https://issues.apache.org/jira/browse/HDFS-1103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866329#action_12866329 ] Todd Lipcon commented on HDFS-1103: --- I worked on this a bit, and think we have a few

[jira] Commented: (HDFS-1143) Implement Background deletion

[ https://issues.apache.org/jira/browse/HDFS-1143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866330#action_12866330 ] dhruba borthakur commented on HDFS-1143: One option is to remove the inode from the

[jira] Resolved: (HDFS-1144) Improve Trash Emptier

[ https://issues.apache.org/jira/browse/HDFS-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmytro Molkov resolved HDFS-1144. - Resolution: Duplicate Since Trash is actually a part of Common I created HADOOP-6761 Improve

[jira] Updated: (HDFS-1142) Lease recovery doesn't reassign lease when triggered by append()

[ https://issues.apache.org/jira/browse/HDFS-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1142: -- Attachment: hdfs-1142.txt New patch on top of trunk (since HDFS-1141 got committed) Lease recovery

[jira] Updated: (HDFS-1142) Lease recovery doesn't reassign lease when triggered by append()

[ https://issues.apache.org/jira/browse/HDFS-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1142: -- Status: Patch Available (was: Open) Lease recovery doesn't reassign lease when triggered by append()

[jira] Commented: (HDFS-1138) Modification times are being overwritten when FSImage loads

[ https://issues.apache.org/jira/browse/HDFS-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866347#action_12866347 ] Eli Collins commented on HDFS-1138: --- +1 Patch looks good. Modification times are being

[jira] Updated: (HDFS-988) saveNamespace can corrupt edits log

[ https://issues.apache.org/jira/browse/HDFS-988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HDFS-988: -- Status: Open (was: Patch Available) hi todd, can we get a unit test for this one (as described

[jira] Commented: (HDFS-218) name node should provide status of dfs.name.dir's

[ https://issues.apache.org/jira/browse/HDFS-218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866357#action_12866357 ] Hadoop QA commented on HDFS-218: -1 overall. Here are the results of testing the latest

[jira] Updated: (HDFS-1138) Modification times are being overwritten when FSImage loads

[ https://issues.apache.org/jira/browse/HDFS-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HDFS-1138: --- Status: Resolved (was: Patch Available) Hadoop Flags: [Reviewed] Fix

[jira] Commented: (HDFS-1142) Lease recovery doesn't reassign lease when triggered by append()

[ https://issues.apache.org/jira/browse/HDFS-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866361#action_12866361 ] dhruba borthakur commented on HDFS-1142: can we re-run hadoopQA tests on the new

[jira] Commented: (HDFS-1142) Lease recovery doesn't reassign lease when triggered by append()

[ https://issues.apache.org/jira/browse/HDFS-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866362#action_12866362 ] Todd Lipcon commented on HDFS-1142: --- Yea, I toggled patch available when I uploaded,

[jira] Commented: (HDFS-1053) A client side mount table to give per-application/per-job file system view

[ https://issues.apache.org/jira/browse/HDFS-1053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866371#action_12866371 ] Milind Bhandarkar commented on HDFS-1053: - Sanjay, do you have a proposal /

[jira] Commented: (HDFS-1138) Modification times are being overwritten when FSImage loads

[ https://issues.apache.org/jira/browse/HDFS-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866375#action_12866375 ] Hadoop QA commented on HDFS-1138: - -1 overall. Here are the results of testing the latest

[jira] Updated: (HDFS-1142) Lease recovery doesn't reassign lease when triggered by append()

[ https://issues.apache.org/jira/browse/HDFS-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1142: -- Status: Patch Available (was: Open) Toggling cuz Hudson build screwed up (silly NoClassDefFound thing,

[jira] Updated: (HDFS-606) ConcurrentModificationException in invalidateCorruptReplicas()

[ https://issues.apache.org/jira/browse/HDFS-606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-606: - Attachment: hdfs-606-branch20.txt Ran into this issue stress testing the append work on branch 20. This

[jira] Updated: (HDFS-1146) Javadoc for getDelegationTokenSecretManager in FSNamesystem

[ https://issues.apache.org/jira/browse/HDFS-1146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-1146: --- Attachment: HDFS-1146-y20.1.patch patch for yahoo-20. Javadoc for

[jira] Commented: (HDFS-1003) authorization checks for inter-server protocol (based on HADOOP-6600)

[ https://issues.apache.org/jira/browse/HDFS-1003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866418#action_12866418 ] Jitendra Nath Pandey commented on HDFS-1003: +1 pending hudson tests.

[jira] Commented: (HDFS-1142) Lease recovery doesn't reassign lease when triggered by append()

[ https://issues.apache.org/jira/browse/HDFS-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866424#action_12866424 ] Hadoop QA commented on HDFS-1142: - -1 overall. Here are the results of testing the latest

[jira] Commented: (HDFS-1142) Lease recovery doesn't reassign lease when triggered by append()

[ https://issues.apache.org/jira/browse/HDFS-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866436#action_12866436 ] dhruba borthakur commented on HDFS-1142: +1 code looks good to me. can somebody else

[jira] Commented: (HDFS-1145) When NameNode is shutdown it tries to exit safemode

[ https://issues.apache.org/jira/browse/HDFS-1145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866439#action_12866439 ] dhruba borthakur commented on HDFS-1145: Thanks Ravi, can you pl review the new

[jira] Commented: (HDFS-1130) Pass Administrator acl to HTTPServer for common servlet access.

[ https://issues.apache.org/jira/browse/HDFS-1130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866446#action_12866446 ] Amareshwari Sriramadasu commented on HDFS-1130: --- A couple of comments on the

[jira] Commented: (HDFS-941) Datanode xceiver protocol should allow reuse of a connection

[ https://issues.apache.org/jira/browse/HDFS-941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866456#action_12866456 ] sam rash commented on HDFS-941: --- +1 for the idea of caching sockets, but I have some

[jira] Created: (HDFS-1147) Reduce NN startup time by reducing the processing time of block reports

Reduce NN startup time by reducing the processing time of block reports --- Key: HDFS-1147 URL: https://issues.apache.org/jira/browse/HDFS-1147 Project: Hadoop HDFS Issue

[jira] Assigned: (HDFS-1147) Reduce NN startup time by reducing the processing time of block reports

[ https://issues.apache.org/jira/browse/HDFS-1147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur reassigned HDFS-1147: -- Assignee: dhruba borthakur Reduce NN startup time by reducing the processing time of

[jira] Commented: (HDFS-1147) Reduce NN startup time by reducing the processing time of block reports

[ https://issues.apache.org/jira/browse/HDFS-1147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12866474#action_12866474 ] dhruba borthakur commented on HDFS-1147: One proposal that I have is that the NN can