[jira] Commented: (HDFS-543) Break FSDatasetInterface#writeToBlock() into writeToTemporary, writeToRBW, and append

[ https://issues.apache.org/jira/browse/HDFS-543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12748270#action_12748270 ] dhruba borthakur commented on HDFS-543: --- +1 looks good. For writeToTemporary() and FSD

[jira] Commented: (HDFS-531) Renaming of configuration keys

[ https://issues.apache.org/jira/browse/HDFS-531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12748266#action_12748266 ] dhruba borthakur commented on HDFS-531: --- > dfs.max.replication.streams and dfs.heartbea

[jira] Commented: (HDFS-492) Expose corrupt replica/block information

[ https://issues.apache.org/jira/browse/HDFS-492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12748264#action_12748264 ] Hadoop QA commented on HDFS-492: -1 overall. Here are the results of testing the latest atta

[jira] Updated: (HDFS-565) Introduce block committing logic during new block allocation and file close.

[ https://issues.apache.org/jira/browse/HDFS-565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-565: - Attachment: CommitBlock.patch > 1. convertLastBlockToUnderConstruction(): why relax the res

[jira] Commented: (HDFS-200) In HDFS, sync() not yet guarantees data available to the new readers

[ https://issues.apache.org/jira/browse/HDFS-200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12748236#action_12748236 ] ryan rawson commented on HDFS-200: -- I've been testing this on my 20 node cluster here. Lease

[jira] Updated: (HDFS-200) In HDFS, sync() not yet guarantees data available to the new readers

[ https://issues.apache.org/jira/browse/HDFS-200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ryan rawson updated HDFS-200: - Attachment: hdfs-200-ryan-existing-file-fail.txt > In HDFS, sync() not yet guarantees data available to the

[jira] Updated: (HDFS-525) ListPathsServlet.java uses static SimpleDateFormat that has threading issues

[ https://issues.apache.org/jira/browse/HDFS-525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-525: --- Attachment: HDFS.525-3.patch Sorry to be late to this issue, but a wrapper class for a ThreadLocal wrap

[jira] Commented: (HDFS-574) Hadoop Doc Split: HDFS Docs

[ https://issues.apache.org/jira/browse/HDFS-574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12748220#action_12748220 ] Hadoop QA commented on HDFS-574: -1 overall. Here are the results of testing the latest atta

[jira] Commented: (HDFS-531) Renaming of configuration keys

[ https://issues.apache.org/jira/browse/HDFS-531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12748214#action_12748214 ] Owen O'Malley commented on HDFS-531: I agree with all of Tom's comments. 1. all topology

[jira] Commented: (HDFS-557) 0.20 HDFS documentation for dfsadmin is using bin/hadoop instead of bin/hdfs

[ https://issues.apache.org/jira/browse/HDFS-557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12748198#action_12748198 ] Corinne Chandel commented on HDFS-557: -- Changes suggested by Boris are included in JIRA

[jira] Resolved: (HDFS-407) data node startup problem

[ https://issues.apache.org/jira/browse/HDFS-407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Phulari resolved HDFS-407. --- Resolution: Cannot Reproduce This is data node start up issue,not a bug. Closing this Jira. > data nod

[jira] Updated: (HDFS-492) Expose corrupt replica/block information

[ https://issues.apache.org/jira/browse/HDFS-492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Zeller updated HDFS-492: - Status: Patch Available (was: Open) > Expose corrupt replica/block information > -

[jira] Commented: (HDFS-492) Expose corrupt replica/block information

[ https://issues.apache.org/jira/browse/HDFS-492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12748189#action_12748189 ] Suresh Srinivas commented on HDFS-492: -- +1 for the patch > Expose corrupt replica/block

[jira] Updated: (HDFS-492) Expose corrupt replica/block information

[ https://issues.apache.org/jira/browse/HDFS-492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Zeller updated HDFS-492: - Attachment: hdfs-492-9.patch > Expose corrupt replica/block information > -

[jira] Updated: (HDFS-492) Expose corrupt replica/block information

[ https://issues.apache.org/jira/browse/HDFS-492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Zeller updated HDFS-492: - Status: Open (was: Patch Available) > Expose corrupt replica/block information > -

[jira] Commented: (HDFS-574) Hadoop Doc Split: HDFS Docs

[ https://issues.apache.org/jira/browse/HDFS-574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12748180#action_12748180 ] Corinne Chandel commented on HDFS-574: -- This wiki page, linked to from the docs, needs t

[jira] Commented: (HDFS-543) Break FSDatasetInterface#writeToBlock() into writeToTemporary, writeToRBW, and append

[ https://issues.apache.org/jira/browse/HDFS-543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12748170#action_12748170 ] Suresh Srinivas commented on HDFS-543: -- +1 for the patch > Break FSDatasetInterface#wri

[jira] Updated: (HDFS-563) Simplify the codes in FSNamesystem.getBlockLocations(..)

[ https://issues.apache.org/jira/browse/HDFS-563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-563: Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Pat

[jira] Commented: (HDFS-563) Simplify the codes in FSNamesystem.getBlockLocations(..)

[ https://issues.apache.org/jira/browse/HDFS-563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12748161#action_12748161 ] Tsz Wo (Nicholas), SZE commented on HDFS-563: - The latest patch only changed a cl

[jira] Updated: (HDFS-543) Break FSDatasetInterface#writeToBlock() into writeToTemporary, writeToRBW, and append

[ https://issues.apache.org/jira/browse/HDFS-543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-543: --- Attachment: writeToReplica3.patch This patch additionally adds a BlockNotFoundException to handle the e

[jira] Commented: (HDFS-563) Simplify the codes in FSNamesystem.getBlockLocations(..)

[ https://issues.apache.org/jira/browse/HDFS-563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12748155#action_12748155 ] Konstantin Shvachko commented on HDFS-563: -- +1 > Simplify the codes in FSNamesystem

[jira] Commented: (HDFS-553) BlockSender reports wrong failed position in ChecksumException

[ https://issues.apache.org/jira/browse/HDFS-553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12748149#action_12748149 ] dhruba borthakur commented on HDFS-553: --- I propose that we backport this to 0.20? This

[jira] Commented: (HDFS-570) When opening a file for read, make the file length avaliable to client.

[ https://issues.apache.org/jira/browse/HDFS-570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12748148#action_12748148 ] Tsz Wo (Nicholas), SZE commented on HDFS-570: - I suggest to implement Algorithm 1

[jira] Commented: (HDFS-567) Two contrib tools to facilitate searching for block history information

[ https://issues.apache.org/jira/browse/HDFS-567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12748147#action_12748147 ] Bill Zeller commented on HDFS-567: -- The failed test is unrelated to this patch. See: https:/

[jira] Updated: (HDFS-574) Hadoop Doc Split: HDFS Docs

[ https://issues.apache.org/jira/browse/HDFS-574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Corinne Chandel updated HDFS-574: - Status: Patch Available (was: Open) Apply this patch to: https://svn.apache.org/repos/asf/hadoop/h

[jira] Updated: (HDFS-574) Hadoop Doc Split: HDFS Docs

[ https://issues.apache.org/jira/browse/HDFS-574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Corinne Chandel updated HDFS-574: - Attachment: Hadoop-Doc-Split.doc HDFS-574-hdfs.patch (1) HDFS-574-hdfs.patch - path

[jira] Created: (HDFS-574) Hadoop Doc Split: HDFS Docs

Hadoop Doc Split: HDFS Docs --- Key: HDFS-574 URL: https://issues.apache.org/jira/browse/HDFS-574 Project: Hadoop HDFS Issue Type: Task Components: documentation Affects Versions: 0.21.0 Repo

[jira] Commented: (HDFS-572) HDFS Web UI displays comments from dfs.exclude file and counts them as dead nodes

[ https://issues.apache.org/jira/browse/HDFS-572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12748125#action_12748125 ] Tsz Wo (Nicholas), SZE commented on HDFS-572: - Oops, the codes actually belong to

[jira] Commented: (HDFS-570) When opening a file for read, make the file length avaliable to client.

[ https://issues.apache.org/jira/browse/HDFS-570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12748106#action_12748106 ] dhruba borthakur commented on HDFS-570: --- Are we implementing algorithm 1 or algorithm 2

[jira] Commented: (HDFS-573) Porting libhdfs to Windows

[ https://issues.apache.org/jira/browse/HDFS-573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12748105#action_12748105 ] dhruba borthakur commented on HDFS-573: --- OK, thanks for the explanation. > Porting lib

[jira] Commented: (HDFS-573) Porting libhdfs to Windows

[ https://issues.apache.org/jira/browse/HDFS-573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12748099#action_12748099 ] Ziliang Guo commented on HDFS-573: -- I should have been more explicit. That is exactly what

[jira] Commented: (HDFS-573) Porting libhdfs to Windows

[ https://issues.apache.org/jira/browse/HDFS-573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12748092#action_12748092 ] dhruba borthakur commented on HDFS-573: --- Is there a way to create a new file that conta

[jira] Created: (HDFS-573) Porting libhdfs to Windows

Porting libhdfs to Windows -- Key: HDFS-573 URL: https://issues.apache.org/jira/browse/HDFS-573 Project: Hadoop HDFS Issue Type: Improvement Components: hdfs client Environment: Windows, Visual Stud

[jira] Commented: (HDFS-543) Break FSDatasetInterface#writeToBlock() into writeToTemporary, writeToRBW, and append

[ https://issues.apache.org/jira/browse/HDFS-543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12748076#action_12748076 ] Konstantin Boudnik commented on HDFS-543: - +1 on the new test implementation. > Brea

[jira] Commented: (HDFS-568) TestServiceLevelAuthorization fails on latest build in Hudson

[ https://issues.apache.org/jira/browse/HDFS-568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12748074#action_12748074 ] Jakob Homan commented on HDFS-568: -- I was seeing the same behavior. > TestServiceLevelAut

[jira] Commented: (HDFS-568) TestServiceLevelAuthorization fails on latest build in Hudson

[ https://issues.apache.org/jira/browse/HDFS-568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12748065#action_12748065 ] Tsz Wo (Nicholas), SZE commented on HDFS-568: - > Interestingly, TestServiceLevelA

[jira] Updated: (HDFS-572) HDFS Web UI displays comments from dfs.exclude file and counts them as dead nodes

[ https://issues.apache.org/jira/browse/HDFS-572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-572: Component/s: name-node > HDFS Web UI displays comments from dfs.exclude file and coun

[jira] Moved: (HDFS-572) HDFS Web UI displays comments from dfs.exclude file and counts them as dead nodes

[ https://issues.apache.org/jira/browse/HDFS-572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE moved HADOOP-6214 to HDFS-572: - Key: HDFS-572 (was: HADOOP-6214) Project: Hadoop HD

[jira] Commented: (HDFS-543) Break FSDatasetInterface#writeToBlock() into writeToTemporary, writeToRBW, and append

[ https://issues.apache.org/jira/browse/HDFS-543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12748060#action_12748060 ] Hairong Kuang commented on HDFS-543: [exec] +1 overall. [exec] [exec]

[jira] Commented: (HDFS-550) DataNode restarts may introduce corrupt/duplicated/lost replicas when handling detached replicas

[ https://issues.apache.org/jira/browse/HDFS-550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12748056#action_12748056 ] Konstantin Shvachko commented on HDFS-550: -- Suffix ".unlinked" would be better. > D

[jira] Updated: (HDFS-563) Simplify the codes in FSNamesystem.getBlockLocations(..)

[ https://issues.apache.org/jira/browse/HDFS-563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-563: Attachment: h563_20090826.patch h563_20090826.patch: renamed the class to NameNodeAda

[jira] Updated: (HDFS-543) Break FSDatasetInterface#writeToBlock() into writeToTemporary, writeToRBW, and append

[ https://issues.apache.org/jira/browse/HDFS-543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-543: --- Attachment: writeToReplica2.patch This patch incorporates comments 1 and 4. I also changed TestDataNode

[jira] Resolved: (HDFS-314) Comment in dfs.hosts.exclude

[ https://issues.apache.org/jira/browse/HDFS-314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Phulari resolved HDFS-314. --- Resolution: Duplicate Closing this ticket. > Comment in dfs.hosts.exclude > --

[jira] Commented: (HDFS-563) Simplify the codes in FSNamesystem.getBlockLocations(..)

[ https://issues.apache.org/jira/browse/HDFS-563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12748045#action_12748045 ] Konstantin Shvachko commented on HDFS-563: -- I was thinking about the right name for

[jira] Commented: (HDFS-15) All replicas of a block end up on only 1 rack

[ https://issues.apache.org/jira/browse/HDFS-15?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12748029#action_12748029 ] Hadoop QA commented on HDFS-15: --- -1 overall. Here are the results of testing the latest attachm

[jira] Moved: (HDFS-571) Hdfs source code has significant number of JavaDocs errors and warnings

[ https://issues.apache.org/jira/browse/HDFS-571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik moved HADOOP-6211 to HDFS-571: - Key: HDFS-571 (was: HADOOP-6211) Project: Hadoop HDFS (was

[jira] Commented: (HDFS-543) Break FSDatasetInterface#writeToBlock() into writeToTemporary, writeToRBW, and append

[ https://issues.apache.org/jira/browse/HDFS-543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12748007#action_12748007 ] Konstantin Boudnik commented on HDFS-543: - +1 on the test framework version: new test

[jira] Updated: (HDFS-456) Problems with dfs.name.edits.dirs as URI

[ https://issues.apache.org/jira/browse/HDFS-456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luca Telloli updated HDFS-456: -- Attachment: HDFS-456.patch Suresh, thanks for the detailed comments, my replies are below. In general,

[jira] Commented: (HDFS-559) Work out the memory consumption of NN artifacts on a compressed pointer JVM

[ https://issues.apache.org/jira/browse/HDFS-559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12747952#action_12747952 ] Steve Loughran commented on HDFS-559: - I tried creating {{BlockInfo}} instances with diff

[jira] Commented: (HDFS-567) Two contrib tools to facilitate searching for block history information

[ https://issues.apache.org/jira/browse/HDFS-567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12747914#action_12747914 ] Hadoop QA commented on HDFS-567: -1 overall. Here are the results of testing the latest atta

[jira] Updated: (HDFS-1) HDFS Web UI displays comments from dfs.exclude file and counts them as dead nodes

[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Phulari updated HDFS-1: Attachment: HDFS-1.patch > HDFS Web UI displays comments from dfs.exclude file and counts them as dead > nodes

[jira] Assigned: (HDFS-1) HDFS Web UI displays comments from dfs.exclude file and counts them as dead nodes

[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Phulari reassigned HDFS-1: --- Assignee: Ravi Phulari > HDFS Web UI displays comments from dfs.exclude file and counts them as dead > n

[jira] Commented: (HDFS-543) Break FSDatasetInterface#writeToBlock() into writeToTemporary, writeToRBW, and append

[ https://issues.apache.org/jira/browse/HDFS-543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12747808#action_12747808 ] Suresh Srinivas commented on HDFS-543: -- Comments: # nit: Some of the lines exceed 80 cha