[jira] [Commented] (HDFS-2273) Refactor BlockManager.recentInvalidateSets to a new class

[ https://issues.apache.org/jira/browse/HDFS-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089473#comment-13089473 ] Hudson commented on HDFS-2273: -- Integrated in Hadoop-Hdfs-trunk #763 (See [https://builds.apa

[jira] [Commented] (HDFS-2266) Add a Namesystem interface to avoid directly referring to FSNamesystem

[ https://issues.apache.org/jira/browse/HDFS-2266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089476#comment-13089476 ] Hudson commented on HDFS-2266: -- Integrated in Hadoop-Hdfs-trunk #763 (See [https://builds.apa

[jira] [Commented] (HDFS-2273) Refactor BlockManager.recentInvalidateSets to a new class

[ https://issues.apache.org/jira/browse/HDFS-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089482#comment-13089482 ] Hudson commented on HDFS-2273: -- Integrated in Hadoop-Mapreduce-trunk #779 (See [https://build

[jira] [Commented] (HDFS-2266) Add a Namesystem interface to avoid directly referring to FSNamesystem

[ https://issues.apache.org/jira/browse/HDFS-2266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089485#comment-13089485 ] Hudson commented on HDFS-2266: -- Integrated in Hadoop-Mapreduce-trunk #779 (See [https://build

[jira] [Updated] (HDFS-2243) DataXceiver per accept seems to be a bottleneck in HBase/YCSB test

[ https://issues.apache.org/jira/browse/HDFS-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Caspole updated HDFS-2243: --- Attachment: HDFS-2234-branch-0.20-append.patch Here is a thread pool patch based on branch-0.20-append

[jira] [Commented] (HDFS-2243) DataXceiver per accept seems to be a bottleneck in HBase/YCSB test

[ https://issues.apache.org/jira/browse/HDFS-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089627#comment-13089627 ] Todd Lipcon commented on HDFS-2243: --- Hey Eric. This is reasonable, but I think the gains

[jira] [Commented] (HDFS-1108) Log newly allocated blocks

[ https://issues.apache.org/jira/browse/HDFS-1108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089658#comment-13089658 ] Konstantin Shvachko commented on HDFS-1108: --- bq. We currently log addBlocks but d

[jira] [Commented] (HDFS-2243) DataXceiver per accept seems to be a bottleneck in HBase/YCSB test

[ https://issues.apache.org/jira/browse/HDFS-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089665#comment-13089665 ] Eric Caspole commented on HDFS-2243: OK, I will try that and re-profile it. > DataXcei

[jira] [Created] (HDFS-2280) BackupNode fails with MD5 checksum Exception during checkpoint if BN's image is outdated.

BackupNode fails with MD5 checksum Exception during checkpoint if BN's image is outdated. - Key: HDFS-2280 URL: https://issues.apache.org/jira/browse/HDFS-2280 Pr

[jira] [Commented] (HDFS-1108) Log newly allocated blocks

[ https://issues.apache.org/jira/browse/HDFS-1108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089683#comment-13089683 ] Todd Lipcon commented on HDFS-1108: --- bq. This should be similar to how we treat setTime()

[jira] [Commented] (HDFS-2243) DataXceiver per accept seems to be a bottleneck in HBase/YCSB test

[ https://issues.apache.org/jira/browse/HDFS-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089684#comment-13089684 ] Todd Lipcon commented on HDFS-2243: --- Great. Feel free to ping me on IRC (tlipcon in #hado

[jira] [Updated] (HDFS-2267) DataXceiver thread name incorrect while waiting on op during keepalive

[ https://issues.apache.org/jira/browse/HDFS-2267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-2267: -- Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) Comm

[jira] [Commented] (HDFS-2267) DataXceiver thread name incorrect while waiting on op during keepalive

[ https://issues.apache.org/jira/browse/HDFS-2267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089702#comment-13089702 ] Hudson commented on HDFS-2267: -- Integrated in Hadoop-Hdfs-trunk-Commit #849 (See [https://bui

[jira] [Commented] (HDFS-2267) DataXceiver thread name incorrect while waiting on op during keepalive

[ https://issues.apache.org/jira/browse/HDFS-2267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089703#comment-13089703 ] Hudson commented on HDFS-2267: -- Integrated in Hadoop-Common-trunk-Commit #772 (See [https://b

[jira] [Updated] (HDFS-2277) CLASSPATH for locating HDFS jar file is incorrect

[ https://issues.apache.org/jira/browse/HDFS-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated HDFS-2277: Resolution: Duplicate Status: Resolved (was: Patch Available) This is closely related to HADOOP-756

[jira] [Commented] (HDFS-1108) Log newly allocated blocks

[ https://issues.apache.org/jira/browse/HDFS-1108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089749#comment-13089749 ] Konstantin Shvachko commented on HDFS-1108: --- Data loss on failover is not accepta

[jira] [Commented] (HDFS-2267) DataXceiver thread name incorrect while waiting on op during keepalive

[ https://issues.apache.org/jira/browse/HDFS-2267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089753#comment-13089753 ] Hudson commented on HDFS-2267: -- Integrated in Hadoop-Mapreduce-trunk #780 (See [https://build

[jira] [Commented] (HDFS-2267) DataXceiver thread name incorrect while waiting on op during keepalive

[ https://issues.apache.org/jira/browse/HDFS-2267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089751#comment-13089751 ] Hadoop QA commented on HDFS-2267: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-1480) All replicas for a block with repl=2 end up in same rack

[ https://issues.apache.org/jira/browse/HDFS-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089757#comment-13089757 ] Hadoop QA commented on HDFS-1480: - -1 overall. Here are the results of testing the latest

[jira] [Commented] (HDFS-2264) NamenodeProtocol has the wrong value for clientPrincipal in KerberosInfo annotation

[ https://issues.apache.org/jira/browse/HDFS-2264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089769#comment-13089769 ] Aaron T. Myers commented on HDFS-2264: -- Hey Harsh, that seems like a fine plan to me.

[jira] [Commented] (HDFS-1108) Log newly allocated blocks

[ https://issues.apache.org/jira/browse/HDFS-1108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089782#comment-13089782 ] Todd Lipcon commented on HDFS-1108: --- Currently there are two proposals for the implementa

[jira] [Commented] (HDFS-1480) All replicas for a block with repl=2 end up in same rack

[ https://issues.apache.org/jira/browse/HDFS-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089801#comment-13089801 ] Todd Lipcon commented on HDFS-1480: --- The failing tests are also failing in trunk (see HDF

[jira] [Updated] (HDFS-1480) All replicas of a block can end up on the same rack when some datanodes are decommissioning.

[ https://issues.apache.org/jira/browse/HDFS-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1480: -- Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) > Al

[jira] [Updated] (HDFS-1480) All replicas of a block can end up on the same rack when some datanodes are decommissioning.

[ https://issues.apache.org/jira/browse/HDFS-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-1480: -- Summary: All replicas of a block can end up on the same rack when some datanodes are decommissioning. (

[jira] [Commented] (HDFS-1973) HA: HDFS clients must handle namenode failover and switch over to the new active namenode.

[ https://issues.apache.org/jira/browse/HDFS-1973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089807#comment-13089807 ] Aaron T. Myers commented on HDFS-1973: -- bq. Alternatively client gets the address of b

[jira] [Commented] (HDFS-1480) All replicas of a block can end up on the same rack when some datanodes are decommissioning.

[ https://issues.apache.org/jira/browse/HDFS-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089811#comment-13089811 ] Hudson commented on HDFS-1480: -- Integrated in Hadoop-Hdfs-trunk-Commit #850 (See [https://bui

[jira] [Commented] (HDFS-1480) All replicas of a block can end up on the same rack when some datanodes are decommissioning.

[ https://issues.apache.org/jira/browse/HDFS-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089813#comment-13089813 ] Hudson commented on HDFS-1480: -- Integrated in Hadoop-Common-trunk-Commit #773 (See [https://b

[jira] [Commented] (HDFS-1480) All replicas of a block can end up on the same rack when some datanodes are decommissioning.

[ https://issues.apache.org/jira/browse/HDFS-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089817#comment-13089817 ] Hudson commented on HDFS-1480: -- Integrated in Hadoop-Mapreduce-trunk-Commit #770 (See [https:

[jira] [Commented] (HDFS-362) FSEditLog should not writes long and short as UTF8 and should not use ArrayWritable for writing non-array items

[ https://issues.apache.org/jira/browse/HDFS-362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089818#comment-13089818 ] Todd Lipcon commented on HDFS-362: -- Rather than comparing the logVersion variable against t

[jira] [Commented] (HDFS-1108) Log newly allocated blocks

[ https://issues.apache.org/jira/browse/HDFS-1108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089840#comment-13089840 ] Konstantin Shvachko commented on HDFS-1108: --- Yes, two proposals. So let me ask yo

[jira] [Updated] (HDFS-395) DFS Scalability: Incremental block reports

[ https://issues.apache.org/jira/browse/HDFS-395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomasz Nykiel updated HDFS-395: --- Attachment: explicitAcks.patch-4 Adjusted to recent changes. > DFS Scalability: Incremental block repo

[jira] [Commented] (HDFS-395) DFS Scalability: Incremental block reports

[ https://issues.apache.org/jira/browse/HDFS-395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089843#comment-13089843 ] jirapos...@reviews.apache.org commented on HDFS-395: --

[jira] [Commented] (HDFS-2018) 1073: Move all journal stream management code into one place

[ https://issues.apache.org/jira/browse/HDFS-2018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089875#comment-13089875 ] Todd Lipcon commented on HDFS-2018: --- Just wanted to write some thoughts on this before th

[jira] [Commented] (HDFS-2271) startJournalSpool should invoke ProcessIOError with failed storage directories if createEditLogFile throws any exception.

[ https://issues.apache.org/jira/browse/HDFS-2271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089882#comment-13089882 ] Konstantin Shvachko commented on HDFS-2271: --- I am wondering what are you running?

[jira] [Commented] (HDFS-1108) Log newly allocated blocks

[ https://issues.apache.org/jira/browse/HDFS-1108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089883#comment-13089883 ] Todd Lipcon commented on HDFS-1108: --- Hi Konstantin. I and several others am working on ap

[jira] [Commented] (HDFS-395) DFS Scalability: Incremental block reports

[ https://issues.apache.org/jira/browse/HDFS-395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089884#comment-13089884 ] Hadoop QA commented on HDFS-395: -1 overall. Here are the results of testing the latest att

[jira] [Commented] (HDFS-1480) All replicas of a block can end up on the same rack when some datanodes are decommissioning.

[ https://issues.apache.org/jira/browse/HDFS-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089903#comment-13089903 ] Hudson commented on HDFS-1480: -- Integrated in Hadoop-Mapreduce-trunk #783 (See [https://build

[jira] [Resolved] (HDFS-2242) HDFS tests are failing due to storage directory issues

[ https://issues.apache.org/jira/browse/HDFS-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-2242. --- Resolution: Fixed These sets of tests seem to be fixed now. > HDFS tests are failing due to storage d

[jira] [Commented] (HDFS-2271) startJournalSpool should invoke ProcessIOError with failed storage directories if createEditLogFile throws any exception.

[ https://issues.apache.org/jira/browse/HDFS-2271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089923#comment-13089923 ] Uma Maheswara Rao G commented on HDFS-2271: --- Hi Konstantin, My code base is from

[jira] [Commented] (HDFS-1975) HA: Support for sharing the namenode state from active to standby.

[ https://issues.apache.org/jira/browse/HDFS-1975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089929#comment-13089929 ] Todd Lipcon commented on HDFS-1975: --- Hi Jitendra. If you plan to use the generation stamp

[jira] [Created] (HDFS-2281) NPE in checkpoint during processIOError()

NPE in checkpoint during processIOError() - Key: HDFS-2281 URL: https://issues.apache.org/jira/browse/HDFS-2281 Project: Hadoop HDFS Issue Type: Bug Components: name-node Affects Versions

[jira] [Updated] (HDFS-2281) NPE in checkpoint during processIOError()

[ https://issues.apache.org/jira/browse/HDFS-2281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-2281: -- Attachment: BN-bug-NPE.txt > NPE in checkpoint during processIOError() > ---

[jira] [Updated] (HDFS-2232) TestHDFSCLI fails on 0.22 branch

[ https://issues.apache.org/jira/browse/HDFS-2232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-2232: --- Attachment: HDFS-2232.patch Changed the regex based on Konstantin's log of failed tests. Chang

[jira] [Commented] (HDFS-2257) HftpFileSystem should implement getDelegationTokens

[ https://issues.apache.org/jira/browse/HDFS-2257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089952#comment-13089952 ] Jitendra Nath Pandey commented on HDFS-2257: I think we should restrict the 2

[jira] [Assigned] (HDFS-1172) Blocks in newly completed files are considered under-replicated too quickly

[ https://issues.apache.org/jira/browse/HDFS-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reassigned HDFS-1172: - Assignee: Todd Lipcon (was: Hairong Kuang) Reassigning patch to try to get this fixed for 23. >

[jira] [Created] (HDFS-2282) Semi-harmless race between block reports and block invalidation

Semi-harmless race between block reports and block invalidation --- Key: HDFS-2282 URL: https://issues.apache.org/jira/browse/HDFS-2282 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-2282) Semi-harmless race between block reports and block invalidation

[ https://issues.apache.org/jira/browse/HDFS-2282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-2282: -- Attachment: hdfs-2282-20.txt Here's a patch for 20. Before resolving we should write a unit test and als

[jira] [Updated] (HDFS-2282) Semi-harmless race between block reports and block invalidation

[ https://issues.apache.org/jira/browse/HDFS-2282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-2282: -- Attachment: hdfs-2282-20.txt oops, correcting slight error in previous upload > Semi-harmless race betw

[jira] [Updated] (HDFS-395) DFS Scalability: Incremental block reports

[ https://issues.apache.org/jira/browse/HDFS-395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomasz Nykiel updated HDFS-395: --- Attachment: explicitAcks.patch-5 > DFS Scalability: Incremental block reports > ---

[jira] [Commented] (HDFS-395) DFS Scalability: Incremental block reports

[ https://issues.apache.org/jira/browse/HDFS-395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089980#comment-13089980 ] jirapos...@reviews.apache.org commented on HDFS-395: --

[jira] [Commented] (HDFS-1108) Log newly allocated blocks

[ https://issues.apache.org/jira/browse/HDFS-1108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13090001#comment-13090001 ] Suresh Srinivas commented on HDFS-1108: --- bq. Data loss on failover is not acceptable.

[jira] [Commented] (HDFS-395) DFS Scalability: Incremental block reports

[ https://issues.apache.org/jira/browse/HDFS-395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13090003#comment-13090003 ] Hadoop QA commented on HDFS-395: -1 overall. Here are the results of testing the latest att

[jira] [Commented] (HDFS-1108) Log newly allocated blocks

[ https://issues.apache.org/jira/browse/HDFS-1108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13090013#comment-13090013 ] Milind Bhandarkar commented on HDFS-1108: - Suresh, based on your comments, you shou

[jira] [Commented] (HDFS-1108) Log newly allocated blocks

[ https://issues.apache.org/jira/browse/HDFS-1108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13090017#comment-13090017 ] Milind Bhandarkar commented on HDFS-1108: - Sorry to come to this party late. Stepp