[jira] Commented: (HDFS-708) A stress-test tool for HDFS.

2010-02-10 Thread Wang Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12831913#action_12831913 ] Wang Xu commented on HDFS-708: -- I clean up our code and put them in google code ( http://code.

[jira] Commented: (HDFS-959) Performance improvements to DFSClient and DataNode for faster DFS write at replication factor of 1

2010-02-10 Thread Naredula Janardhana Reddy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12831965#action_12831965 ] Naredula Janardhana Reddy commented on HDFS-959: bq. In my mind, the ack sign

[jira] Updated: (HDFS-959) Performance improvements to DFSClient and DataNode for faster DFS write at replication factor of 1

2010-02-10 Thread Naredula Janardhana Reddy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naredula Janardhana Reddy updated HDFS-959: --- Attachment: performance_patch > Performance improvements to DFSClient and DataN

[jira] Updated: (HDFS-959) Performance improvements to DFSClient and DataNode for faster DFS write at replication factor of 1

2010-02-10 Thread Naredula Janardhana Reddy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naredula Janardhana Reddy updated HDFS-959: --- Fix Version/s: (was: 0.22.0) Affects Version/s: (was: 0.22.0)

[jira] Commented: (HDFS-959) Performance improvements to DFSClient and DataNode for faster DFS write at replication factor of 1

2010-02-10 Thread Naredula Janardhana Reddy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12831969#action_12831969 ] Naredula Janardhana Reddy commented on HDFS-959: I have uploaded the patch fo

[jira] Commented: (HDFS-959) Performance improvements to DFSClient and DataNode for faster DFS write at replication factor of 1

2010-02-10 Thread Naredula Janardhana Reddy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12831971#action_12831971 ] Naredula Janardhana Reddy commented on HDFS-959: bq. You are writing at > 100

[jira] Commented: (HDFS-959) Performance improvements to DFSClient and DataNode for faster DFS write at replication factor of 1

2010-02-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12831972#action_12831972 ] Hadoop QA commented on HDFS-959: -1 overall. Here are the results of testing the latest atta

[jira] Commented: (HDFS-959) Performance improvements to DFSClient and DataNode for faster DFS write at replication factor of 1

2010-02-10 Thread Naredula Janardhana Reddy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832091#action_12832091 ] Naredula Janardhana Reddy commented on HDFS-959: bq. How does item 1 relate t

[jira] Updated: (HDFS-737) Improvement in metasave output

2010-02-10 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-737: - Release Note: Add full path name of the file to the under replicated block information and summary

[jira] Commented: (HDFS-931) DFSClient.close doesn't rethrow exceptions thrown by automatically closed clients

2010-02-10 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832113#action_12832113 ] dhruba borthakur commented on HDFS-931: --- I think we should make this change only in tru

[jira] Commented: (HDFS-959) Performance improvements to DFSClient and DataNode for faster DFS write at replication factor of 1

2010-02-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832115#action_12832115 ] Konstantin Shvachko commented on HDFS-959: -- > Regarding the Disk bandwidth What is

[jira] Commented: (HDFS-930) o.a.h.hdfs.server.datanode.DataXceiver - run() - Version mismatch exception - more context to help debugging

2010-02-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832121#action_12832121 ] Konstantin Shvachko commented on HDFS-930: -- This is HDFS-965. > o.a.h.hdfs.server.d

[jira] Commented: (HDFS-931) DFSClient.close doesn't rethrow exceptions thrown by automatically closed clients

2010-02-10 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832125#action_12832125 ] Todd Lipcon commented on HDFS-931: -- bq. I think we should make this change only in trunk. Do

[jira] Updated: (HDFS-931) DFSClient.close doesn't rethrow exceptions thrown by automatically closed clients

2010-02-10 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-931: Hadoop Flags: [Incompatible change] Mark this as Incompatible change. > DFSClient.cl

[jira] Updated: (HDFS-930) o.a.h.hdfs.server.datanode.DataXceiver - run() - Version mismatch exception - more context to help debugging

2010-02-10 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-930: Resolution: Fixed Fix Version/s: 0.22.0 Status: Resolved (was: Patc

[jira] Commented: (HDFS-909) Race condition between rollEditLog or rollFSImage ant FSEditsLog.write operations corrupts edits log

2010-02-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832142#action_12832142 ] Konstantin Shvachko commented on HDFS-909: -- > Unfortunately, I wasn't able to write

[jira] Commented: (HDFS-909) Race condition between rollEditLog or rollFSImage ant FSEditsLog.write operations corrupts edits log

2010-02-10 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832145#action_12832145 ] Todd Lipcon commented on HDFS-909: -- {quote} But you can reproduce the problem manually, then

[jira] Commented: (HDFS-909) Race condition between rollEditLog or rollFSImage ant FSEditsLog.write operations corrupts edits log

2010-02-10 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832153#action_12832153 ] Konstantin Boudnik commented on HDFS-909: - bq. But you can reproduce the problem manu

[jira] Commented: (HDFS-907) Add tests for getBlockLocations and totalLoad metrics.

2010-02-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832156#action_12832156 ] Hudson commented on HDFS-907: - Integrated in Hadoop-Hdfs-trunk-Commit #191 (See [http://hudson.z

[jira] Commented: (HDFS-935) Real user in delegation token.

2010-02-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832155#action_12832155 ] Hudson commented on HDFS-935: - Integrated in Hadoop-Hdfs-trunk-Commit #191 (See [http://hudson.z

[jira] Commented: (HDFS-949) Move Delegation token into Common so that we can use it for MapReduce also

2010-02-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832157#action_12832157 ] Hudson commented on HDFS-949: - Integrated in Hadoop-Hdfs-trunk-Commit #191 (See [http://hudson.z

[jira] Updated: (HDFS-968) s/StringBuffer/StringBuilder - as necessary

2010-02-10 Thread Kay Kay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated HDFS-968: - Status: Patch Available (was: Open) > s/StringBuffer/StringBuilder - as necessary > --

[jira] Updated: (HDFS-968) s/StringBuffer/StringBuilder - as necessary

2010-02-10 Thread Kay Kay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Kay updated HDFS-968: - Attachment: HDFS-968.patch > s/StringBuffer/StringBuilder - as necessary >

[jira] Created: (HDFS-968) s/StringBuffer/StringBuilder - as necessary

2010-02-10 Thread Kay Kay (JIRA)
s/StringBuffer/StringBuilder - as necessary --- Key: HDFS-968 URL: https://issues.apache.org/jira/browse/HDFS-968 Project: Hadoop HDFS Issue Type: Improvement Reporter: Kay Kay Att

[jira] Commented: (HDFS-955) FSImage.saveFSImage can lose edits

2010-02-10 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832212#action_12832212 ] Todd Lipcon commented on HDFS-955: -- h2. Without concurrent checkpoint Looking at this as a

[jira] Commented: (HDFS-957) FSImage layout version should be only once file is complete

2010-02-10 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832216#action_12832216 ] Todd Lipcon commented on HDFS-957: -- See my motivation for the ability to tell if an image is

[jira] Commented: (HDFS-955) FSImage.saveFSImage can lose edits

2010-02-10 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832220#action_12832220 ] Todd Lipcon commented on HDFS-955: -- Unfortunately HDFS-957 I think provides a fix for both o

[jira] Commented: (HDFS-958) Remove uneccessary creation of FileStatus objects in NameNode

2010-02-10 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832299#action_12832299 ] Hairong Kuang commented on HDFS-958: > Doesn't logAuditEvent need to be updated to take a

[jira] Updated: (HDFS-946) NameNode should not return full path name when lisitng a diretory or getting the status of a file

2010-02-10 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-946: --- Attachment: HDFSFileStatus.patch This patch does the following: 1. create a new file status in HDFS, ca

[jira] Updated: (HDFS-946) NameNode should not return full path name when lisitng a diretory or getting the status of a file

2010-02-10 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-946: --- Attachment: HDFSFileStatus.patch This patch does the following: 1. create a new file status in HDFS, ca

[jira] Assigned: (HDFS-946) NameNode should not return full path name when lisitng a diretory or getting the status of a file

2010-02-10 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang reassigned HDFS-946: -- Assignee: Hairong Kuang > NameNode should not return full path name when lisitng a diretory or ge

[jira] Commented: (HDFS-959) Performance improvements to DFSClient and DataNode for faster DFS write at replication factor of 1

2010-02-10 Thread Naredula Janardhana Reddy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12832407#action_12832407 ] Naredula Janardhana Reddy commented on HDFS-959: bq. What is the bandwidth of