[jira] Commented: (HDFS-578) Support for using server default values for blockSize and replication when creating a file

2009-08-31 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12749766#action_12749766 ] dhruba borthakur commented on HDFS-578: --- > Do you expect a significant performance diff

[jira] Commented: (HDFS-567) Two contrib tools to facilitate searching for block history information

2009-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12749753#action_12749753 ] Hadoop QA commented on HDFS-567: -1 overall. Here are the results of testing the latest atta

[jira] Commented: (HDFS-578) Support for using server default values for blockSize and replication when creating a file

2009-08-31 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12749736#action_12749736 ] Sanjay Radia commented on HDFS-578: --- I was proposing that we remove that flexibility. How m

[jira] Updated: (HDFS-516) Low Latency distributed reads

2009-08-31 Thread Jay Booth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Booth updated HDFS-516: --- Attachment: hdfs-516-20090831.patch New patch, IPC server was too slow for IO operations (like 40 times slower

[jira] Updated: (HDFS-551) Create new functional test for a block report.

2009-08-31 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated HDFS-551: Attachment: HDFS-551.patch All verifications are working as expected now. > Create new funct

[jira] Commented: (HDFS-578) Support for using server default values for blockSize and replication when creating a file

2009-08-31 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12749717#action_12749717 ] dhruba borthakur commented on HDFS-578: --- > My current thinking is if the client chooses

[jira] Commented: (HDFS-565) Introduce block committing logic during new block allocation and file close.

2009-08-31 Thread Hairong Kuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12749714#action_12749714 ] Hairong Kuang commented on HDFS-565: This patch seems to has another bug. When complete a

[jira] Commented: (HDFS-503) Implement erasure coding as a layer on HDFS

2009-08-31 Thread Andrew Ryan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12749701#action_12749701 ] Andrew Ryan commented on HDFS-503: -- In speaking with Dhruba about this, I had one additional

[jira] Updated: (HDFS-581) Introduce an iterator over blocks in the block report array.

2009-08-31 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-581: - Attachment: BlockReportIterator.patch A minor improvement. The patch introduces the default

[jira] Updated: (HDFS-567) Two contrib tools to facilitate searching for block history information

2009-08-31 Thread Bill Zeller (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Zeller updated HDFS-567: - Attachment: hdfs-567-4.patch > Two contrib tools to facilitate searching for block history information > -

[jira] Updated: (HDFS-567) Two contrib tools to facilitate searching for block history information

2009-08-31 Thread Bill Zeller (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Zeller updated HDFS-567: - Status: Patch Available (was: Open) > Two contrib tools to facilitate searching for block history informat

[jira] Updated: (HDFS-567) Two contrib tools to facilitate searching for block history information

2009-08-31 Thread Bill Zeller (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Zeller updated HDFS-567: - Status: Open (was: Patch Available) > Two contrib tools to facilitate searching for block history informat

[jira] Updated: (HDFS-567) Two contrib tools to facilitate searching for block history information

2009-08-31 Thread Bill Zeller (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Zeller updated HDFS-567: - Attachment: hdfs-567-3.patch > Two contrib tools to facilitate searching for block history information > -

[jira] Commented: (HDFS-581) Introduce an iterator over blocks in the block report array.

2009-08-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12749684#action_12749684 ] Hadoop QA commented on HDFS-581: -1 overall. Here are the results of testing the latest atta

[jira] Commented: (HDFS-573) Porting libhdfs to Windows

2009-08-31 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12749671#action_12749671 ] dhruba borthakur commented on HDFS-573: --- Some of the details are in http://wiki.apache.

[jira] Commented: (HDFS-578) Support for using server default values for blockSize and replication when creating a file

2009-08-31 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12749657#action_12749657 ] Sanjay Radia commented on HDFS-578: --- Proposal: BlockSize(BS) and RepF (RF)are either obtain

[jira] Updated: (HDFS-581) Introduce an iterator over blocks in the block report array.

2009-08-31 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-581: - Status: Patch Available (was: Open) > Introduce an iterator over blocks in the block repor

[jira] Updated: (HDFS-581) Introduce an iterator over blocks in the block report array.

2009-08-31 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-581: - Attachment: BlockReportIterator.patch This patch introduces {{BlockReportIterator}} in {{Bl

[jira] Created: (HDFS-581) Introduce an iterator over blocks in the block report array.

2009-08-31 Thread Konstantin Shvachko (JIRA)
Introduce an iterator over blocks in the block report array. Key: HDFS-581 URL: https://issues.apache.org/jira/browse/HDFS-581 Project: Hadoop HDFS Issue Type: Improvement

[jira] Commented: (HDFS-565) Introduce block committing logic during new block allocation and file close.

2009-08-31 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12749606#action_12749606 ] Tsz Wo (Nicholas), SZE commented on HDFS-565: - > The patch passes all unit tests.

[jira] Commented: (HDFS-549) Allow non fault-inject specific tests execution with an explicit -Dtestcase=... setting

2009-08-31 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12749583#action_12749583 ] Konstantin Boudnik commented on HDFS-549: - Thanks for getting this out, Nicholas. I

[jira] Commented: (HDFS-472) Document hdfsproxy design and set-up guide

2009-08-31 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12749563#action_12749563 ] Chris Douglas commented on HDFS-472: +1 The latest version looks good. Would it make sen

[jira] Commented: (HDFS-577) Name node doesn't always properly recognize health of data node

2009-08-31 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12749562#action_12749562 ] Allen Wittenauer commented on HDFS-577: --- Just to put what I suspect is the basic concer

[jira] Updated: (HDFS-574) Hadoop Doc Split: HDFS Docs

2009-08-31 Thread Corinne Chandel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Corinne Chandel updated HDFS-574: - Priority: Blocker (was: Minor) > Hadoop Doc Split: HDFS Docs > --- > >

[jira] Commented: (HDFS-580) Name node will exit safe mode w/0 blocks even if data nodes are broken

2009-08-31 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12749553#action_12749553 ] Allen Wittenauer commented on HDFS-580: --- My gut tells me that since there are zero bloc

[jira] Created: (HDFS-580) Name node will exit safe mode w/0 blocks even if data nodes are broken

2009-08-31 Thread Allen Wittenauer (JIRA)
Name node will exit safe mode w/0 blocks even if data nodes are broken -- Key: HDFS-580 URL: https://issues.apache.org/jira/browse/HDFS-580 Project: Hadoop HDFS Issue Type:

[jira] Updated: (HDFS-15) All replicas of a block end up on only 1 rack

2009-08-31 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-15?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-15: - Resolution: Fixed Status: Resolved (was: Patch Available) > All replicas of a block

[jira] Commented: (HDFS-573) Porting libhdfs to Windows

2009-08-31 Thread Ziliang Guo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12749550#action_12749550 ] Ziliang Guo commented on HDFS-573: -- Fasial has tested the current code on Linux and besides

[jira] Commented: (HDFS-578) Support for using server default values for blockSize and replication when creating a file

2009-08-31 Thread Kan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12749547#action_12749547 ] Kan Zhang commented on HDFS-578: Yes, io.file.buffer.size is passed in to DFSOutputStream cto

[jira] Updated: (HDFS-472) Document hdfsproxy design and set-up guide

2009-08-31 Thread zhiyong zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhiyong zhang updated HDFS-472: --- Attachment: HDFS-472.patch Hi Chris, Thanks for the comments. I uploaded the new patch. * The "advanta

[jira] Commented: (HDFS-542) Support fault injection tests in Hudson

2009-08-31 Thread Giridharan Kesavan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12749430#action_12749430 ] Giridharan Kesavan commented on HDFS-542: - I somehow missed this issues.. I have co

[jira] Commented: (HDFS-577) Name node doesn't always properly recognize health of data node

2009-08-31 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12749416#action_12749416 ] dhruba borthakur commented on HDFS-577: --- Do you have a proposal on how this can be dete

[jira] Commented: (HDFS-578) Support for using server default values for blockSize and replication when creating a file

2009-08-31 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12749412#action_12749412 ] dhruba borthakur commented on HDFS-578: --- There are many other parameters that the clien

[jira] Commented: (HDFS-245) Create symbolic links in HDFS

2009-08-31 Thread Yajun Dong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12749405#action_12749405 ] Yajun Dong commented on HDFS-245: - @dhruba borthakur, Thanks for your comment. Can I ask whe