[jira] [Updated] (HDFS-4068) DatanodeID and DatanodeInfo member should be private

2012-10-17 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-4068: -- Priority: Minor (was: Major) DatanodeID and DatanodeInfo member should be private

[jira] [Updated] (HDFS-3990) NN's health report has severe performance problems

2012-10-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3990: -- Attachment: hdfs-3990.txt What do you think of the attached patch? # The NN looks up the DN hostname

[jira] [Commented] (HDFS-4053) Increase the default block size

2012-10-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477661#comment-13477661 ] Hadoop QA commented on HDFS-4053: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4053) Increase the default block size

2012-10-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477687#comment-13477687 ] Hadoop QA commented on HDFS-4053: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4068) DatanodeID and DatanodeInfo member should be private

2012-10-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477713#comment-13477713 ] Hadoop QA commented on HDFS-4068: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (HDFS-4069) Security bits of some scripts in rpm package are incorrect

2012-10-17 Thread Haoquan Wang (JIRA)
Haoquan Wang created HDFS-4069: -- Summary: Security bits of some scripts in rpm package are incorrect Key: HDFS-4069 URL: https://issues.apache.org/jira/browse/HDFS-4069 Project: Hadoop HDFS

[jira] [Updated] (HDFS-4069) Security bits of some scripts in rpm package are incorrect

2012-10-17 Thread Haoquan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haoquan Wang updated HDFS-4069: --- Description: These scripts should have execute permission(755). It only happens to rpm package, deb

[jira] [Updated] (HDFS-4069) Security bits of some scripts in rpm package are incorrect

2012-10-17 Thread Haoquan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haoquan Wang updated HDFS-4069: --- Description: These scripts should have execute permission(755). It only happens to rpm package, deb

[jira] [Updated] (HDFS-4069) File mode bits of some scripts in rpm package are incorrect

2012-10-17 Thread Haoquan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haoquan Wang updated HDFS-4069: --- Summary: File mode bits of some scripts in rpm package are incorrect (was: Security bits of some

[jira] [Commented] (HDFS-4039) Add option for WebHDFS to be a proxy, rather than just 302 to the DNs

2012-10-17 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477736#comment-13477736 ] Steve Loughran commented on HDFS-4039: -- for a small transient EC-2 hosted cluster,

[jira] [Commented] (HDFS-4029) GenerationStamp should use an AtomicLong

2012-10-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477762#comment-13477762 ] Hudson commented on HDFS-4029: -- Integrated in Hadoop-Yarn-trunk #6 (See

[jira] [Commented] (HDFS-4055) TestAuditLogs is flaky

2012-10-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477767#comment-13477767 ] Hudson commented on HDFS-4055: -- Integrated in Hadoop-Yarn-trunk #6 (See

[jira] [Commented] (HDFS-4059) Add number of stale DataNodes to metrics

2012-10-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1340#comment-1340 ] Hudson commented on HDFS-4059: -- Integrated in Hadoop-Yarn-trunk #6 (See

[jira] [Commented] (HDFS-4061) TestBalancer and TestUnderReplicatedBlocks need timeouts

2012-10-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1342#comment-1342 ] Hudson commented on HDFS-4061: -- Integrated in Hadoop-Yarn-trunk #6 (See

[jira] [Commented] (HDFS-3985) Add timeouts to TestMulitipleNNDataBlockScanner

2012-10-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1343#comment-1343 ] Hudson commented on HDFS-3985: -- Integrated in Hadoop-Yarn-trunk #6 (See

[jira] [Commented] (HDFS-3997) OfflineImageViewer incorrectly passes value of imageVersion when visiting IS_COMPRESSED element

2012-10-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1345#comment-1345 ] Hudson commented on HDFS-3997: -- Integrated in Hadoop-Yarn-trunk #6 (See

[jira] [Created] (HDFS-4070) DFSClient ignores bufferSize argument always performs small writes

2012-10-17 Thread Gopal V (JIRA)
Gopal V created HDFS-4070: - Summary: DFSClient ignores bufferSize argument always performs small writes Key: HDFS-4070 URL: https://issues.apache.org/jira/browse/HDFS-4070 Project: Hadoop HDFS

[jira] [Commented] (HDFS-3582) Hook daemon process exit for testing

2012-10-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477822#comment-13477822 ] Hudson commented on HDFS-3582: -- Integrated in Hadoop-Hdfs-0.23-Build #407 (See

[jira] [Commented] (HDFS-4016) back-port HDFS-3582 to branch-0.23

2012-10-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477823#comment-13477823 ] Hudson commented on HDFS-4016: -- Integrated in Hadoop-Hdfs-0.23-Build #407 (See

[jira] [Commented] (HDFS-4029) GenerationStamp should use an AtomicLong

2012-10-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477831#comment-13477831 ] Hudson commented on HDFS-4029: -- Integrated in Hadoop-Hdfs-trunk #1198 (See

[jira] [Commented] (HDFS-4055) TestAuditLogs is flaky

2012-10-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477836#comment-13477836 ] Hudson commented on HDFS-4055: -- Integrated in Hadoop-Hdfs-trunk #1198 (See

[jira] [Commented] (HDFS-4059) Add number of stale DataNodes to metrics

2012-10-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477839#comment-13477839 ] Hudson commented on HDFS-4059: -- Integrated in Hadoop-Hdfs-trunk #1198 (See

[jira] [Commented] (HDFS-3985) Add timeouts to TestMulitipleNNDataBlockScanner

2012-10-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477842#comment-13477842 ] Hudson commented on HDFS-3985: -- Integrated in Hadoop-Hdfs-trunk #1198 (See

[jira] [Commented] (HDFS-4061) TestBalancer and TestUnderReplicatedBlocks need timeouts

2012-10-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477841#comment-13477841 ] Hudson commented on HDFS-4061: -- Integrated in Hadoop-Hdfs-trunk #1198 (See

[jira] [Commented] (HDFS-3997) OfflineImageViewer incorrectly passes value of imageVersion when visiting IS_COMPRESSED element

2012-10-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477844#comment-13477844 ] Hudson commented on HDFS-3997: -- Integrated in Hadoop-Hdfs-trunk #1198 (See

[jira] [Commented] (HDFS-4029) GenerationStamp should use an AtomicLong

2012-10-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477853#comment-13477853 ] Hudson commented on HDFS-4029: -- Integrated in Hadoop-Mapreduce-trunk #1228 (See

[jira] [Commented] (HDFS-4037) Rename the getReplication() method in BlockCollection to getBlockReplication()

2012-10-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477854#comment-13477854 ] Hudson commented on HDFS-4037: -- Integrated in Hadoop-Mapreduce-trunk #1228 (See

[jira] [Commented] (HDFS-3678) Edit log files are never being purged from 2NN

2012-10-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477856#comment-13477856 ] Hudson commented on HDFS-3678: -- Integrated in Hadoop-Mapreduce-trunk #1228 (See

[jira] [Commented] (HDFS-4036) FSDirectory.unprotectedAddFile(..) should not throw UnresolvedLinkException

2012-10-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477859#comment-13477859 ] Hudson commented on HDFS-4036: -- Integrated in Hadoop-Mapreduce-trunk #1228 (See

[jira] [Commented] (HDFS-4058) DirectoryScanner may fail with IOOB if the directory scanning threads return out of volume order

2012-10-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477862#comment-13477862 ] Hudson commented on HDFS-4058: -- Integrated in Hadoop-Mapreduce-trunk #1228 (See

[jira] [Commented] (HDFS-4055) TestAuditLogs is flaky

2012-10-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477864#comment-13477864 ] Hudson commented on HDFS-4055: -- Integrated in Hadoop-Mapreduce-trunk #1228 (See

[jira] [Commented] (HDFS-4049) hflush performance regression due to nagling delays

2012-10-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477865#comment-13477865 ] Hudson commented on HDFS-4049: -- Integrated in Hadoop-Mapreduce-trunk #1228 (See

[jira] [Commented] (HDFS-4059) Add number of stale DataNodes to metrics

2012-10-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477868#comment-13477868 ] Hudson commented on HDFS-4059: -- Integrated in Hadoop-Mapreduce-trunk #1228 (See

[jira] [Commented] (HDFS-4061) TestBalancer and TestUnderReplicatedBlocks need timeouts

2012-10-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477870#comment-13477870 ] Hudson commented on HDFS-4061: -- Integrated in Hadoop-Mapreduce-trunk #1228 (See

[jira] [Commented] (HDFS-3985) Add timeouts to TestMulitipleNNDataBlockScanner

2012-10-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477873#comment-13477873 ] Hudson commented on HDFS-3985: -- Integrated in Hadoop-Mapreduce-trunk #1228 (See

[jira] [Commented] (HDFS-4052) BlockManager#invalidateWork should print logs outside the lock

2012-10-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477871#comment-13477871 ] Hudson commented on HDFS-4052: -- Integrated in Hadoop-Mapreduce-trunk #1228 (See

[jira] [Commented] (HDFS-3997) OfflineImageViewer incorrectly passes value of imageVersion when visiting IS_COMPRESSED element

2012-10-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477875#comment-13477875 ] Hudson commented on HDFS-3997: -- Integrated in Hadoop-Mapreduce-trunk #1228 (See

[jira] [Commented] (HDFS-2946) HA: Put a cap on the number of completed edits files retained by the NN

2012-10-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477876#comment-13477876 ] Hudson commented on HDFS-2946: -- Integrated in Hadoop-Mapreduce-trunk #1228 (See

[jira] [Commented] (HDFS-4056) Always start the NN's SecretManager

2012-10-17 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477902#comment-13477902 ] Daryn Sharp commented on HDFS-4056: --- SIMPLE is still supported as it currently is today.

[jira] [Commented] (HDFS-3990) NN's health report has severe performance problems

2012-10-17 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477909#comment-13477909 ] Daryn Sharp commented on HDFS-3990: --- In your patch, it's not necessary for the NN to do

[jira] [Updated] (HDFS-3990) NN's health report has severe performance problems

2012-10-17 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-3990: -- Attachment: HDFS-3990.patch Sorry, I accidentally re-submitted the wrong patch (same as prior)

[jira] [Updated] (HDFS-3990) NN's health report has severe performance problems

2012-10-17 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-3990: -- Status: Patch Available (was: Open) NN's health report has severe performance problems

[jira] [Commented] (HDFS-4070) DFSClient ignores bufferSize argument always performs small writes

2012-10-17 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477923#comment-13477923 ] Suresh Srinivas commented on HDFS-4070: --- Gopal, perhaps we can also revisit the

[jira] [Commented] (HDFS-4053) Increase the default block size

2012-10-17 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477935#comment-13477935 ] Daryn Sharp commented on HDFS-4053: --- +1 Assuming test failure is unrelated. I'd suggest

[jira] [Commented] (HDFS-4065) TestDFSShell.testGet sporadically fails attempting to corrupt block files due to race condition

2012-10-17 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477942#comment-13477942 ] Daryn Sharp commented on HDFS-4065: --- Could you do something like sync or flush? The

[jira] [Commented] (HDFS-4069) File mode bits of some scripts in rpm package are incorrect

2012-10-17 Thread Haoquan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477962#comment-13477962 ] Haoquan Wang commented on HDFS-4069: Temporarily resolution: chmod +x /usr/sbin/s*.sh

[jira] [Commented] (HDFS-4070) DFSClient ignores bufferSize argument always performs small writes

2012-10-17 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477963#comment-13477963 ] Uma Maheswara Rao G commented on HDFS-4070: --- Gopal, I agree, we are ignoring the

[jira] [Commented] (HDFS-3990) NN's health report has severe performance problems

2012-10-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477975#comment-13477975 ] Hadoop QA commented on HDFS-3990: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4070) DFSClient ignores bufferSize argument always performs small writes

2012-10-17 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477984#comment-13477984 ] Gopal V commented on HDFS-4070: --- The property is global, which makes it impossible for a

[jira] [Commented] (HDFS-4070) DFSClient ignores bufferSize argument always performs small writes

2012-10-17 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477998#comment-13477998 ] Uma Maheswara Rao G commented on HDFS-4070: --- Ok, make sense. Thanks for working

[jira] [Commented] (HDFS-4056) Always start the NN's SecretManager

2012-10-17 Thread Kan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477996#comment-13477996 ] Kan Zhang commented on HDFS-4056: - Let's use an example to explain. Suppose security is

[jira] [Commented] (HDFS-3990) NN's health report has severe performance problems

2012-10-17 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13478000#comment-13478000 ] Daryn Sharp commented on HDFS-3990: --- The balancer test seems to randomly fail. It passes

[jira] [Commented] (HDFS-3402) Fix hdfs script for for secure datanodes

2012-10-17 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13478027#comment-13478027 ] Suresh Srinivas commented on HDFS-3402: --- Benoy, quick question - what does the

[jira] [Commented] (HDFS-3402) Fix hdfs script for for secure datanodes

2012-10-17 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13478040#comment-13478040 ] Suresh Srinivas commented on HDFS-3402: --- Ok foudn the answer in bash parameter

[jira] [Comment Edited] (HDFS-3402) Fix hdfs script for for secure datanodes

2012-10-17 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13478040#comment-13478040 ] Suresh Srinivas edited comment on HDFS-3402 at 10/17/12 5:15 PM:

[jira] [Commented] (HDFS-4068) DatanodeID and DatanodeInfo member should be private

2012-10-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13478057#comment-13478057 ] Eli Collins commented on HDFS-4068: --- Test failure is HDFS-3806, since this is just clean

[jira] [Commented] (HDFS-4043) Namenode Kerberos Login does not use proper hostname for host qualified hdfs principal name.

2012-10-17 Thread Ahad Rana (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13478067#comment-13478067 ] Ahad Rana commented on HDFS-4043: - Hi, Can you explicitly set the namenode principal name

[jira] [Commented] (HDFS-4059) Add number of stale DataNodes to metrics

2012-10-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13478076#comment-13478076 ] Jing Zhao commented on HDFS-4059: - I backport the patch to branch-1. Since the code is

[jira] [Created] (HDFS-4071) Add number of stale DataNodes to metrics for Branch-1

2012-10-17 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-4071: --- Summary: Add number of stale DataNodes to metrics for Branch-1 Key: HDFS-4071 URL: https://issues.apache.org/jira/browse/HDFS-4071 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-4071) Add number of stale DataNodes to metrics for Branch-1

2012-10-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4071: Attachment: HDFS-4059-backport-branch-1.001.patch To avoid bringing extra complexity to TestNameNodeMetrics

[jira] [Resolved] (HDFS-3953) DFSOutputStream constructor does not use bufferSize parameter

2012-10-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-3953. - Resolution: Duplicate Duplicated with HDFS-4070 DFSOutputStream constructor does not

[jira] [Commented] (HDFS-4070) DFSClient ignores bufferSize argument always performs small writes

2012-10-17 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13478094#comment-13478094 ] Andy Isaacson commented on HDFS-4070: - I'm a little surprised that increasing buffer

[jira] [Commented] (HDFS-4022) Replication not happening for appended block

2012-10-17 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13478102#comment-13478102 ] Tsz Wo (Nicholas), SZE commented on HDFS-4022: -- replication change flow is

[jira] [Updated] (HDFS-4053) Increase the default block size

2012-10-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-4053: -- Attachment: hdfs-4053.txt Updated to 128*1024*1024. The TestBalancer timeout is unrelated (HDFS-4061).

[jira] [Commented] (HDFS-3990) NN's health report has severe performance problems

2012-10-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13478271#comment-13478271 ] Eli Collins commented on HDFS-3990: --- Think the approach in the latest patch should work.

[jira] [Commented] (HDFS-4056) Always start the NN's SecretManager

2012-10-17 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13478279#comment-13478279 ] Daryn Sharp commented on HDFS-4056: --- bq. the job client will always fetch a NN delegation

[jira] [Commented] (HDFS-4068) DatanodeID and DatanodeInfo member should be private

2012-10-17 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13478282#comment-13478282 ] Daryn Sharp commented on HDFS-4068: --- +1 Looks good. Thanks for breaking this out of

[jira] [Commented] (HDFS-4056) Always start the NN's SecretManager

2012-10-17 Thread Kan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13478324#comment-13478324 ] Kan Zhang commented on HDFS-4056: - I think it's more appropriate for me to add this comment

[jira] [Updated] (HDFS-4057) NameNode.namesystem should be private. Use getNamesystem() instead.

2012-10-17 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-4057: - Hadoop Flags: Reviewed +1 Patch looks good. Could you run test-patch and unit

[jira] [Commented] (HDFS-4053) Increase the default block size

2012-10-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13478335#comment-13478335 ] Hadoop QA commented on HDFS-4053: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4057) NameNode.namesystem should be private. Use getNamesystem() instead.

2012-10-17 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13478337#comment-13478337 ] Suresh Srinivas commented on HDFS-4057: --- This patch needs more work. Tests do not

[jira] [Commented] (HDFS-3990) NN's health report has severe performance problems

2012-10-17 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13478350#comment-13478350 ] Daryn Sharp commented on HDFS-3990: --- I'm making the changes, but I found that I cannot

[jira] [Created] (HDFS-4072) When deleting a file, it would be better to also remove corresponding block records from BlockManager#pendingReplications

2012-10-17 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-4072: --- Summary: When deleting a file, it would be better to also remove corresponding block records from BlockManager#pendingReplications Key: HDFS-4072 URL:

[jira] [Updated] (HDFS-4072) When deleting a file, it would be better to also remove corresponding block records from BlockManager#pendingReplications

2012-10-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4072: Attachment: TestPendingAndDelete.java The attached test may generate the scenario where a

[jira] [Commented] (HDFS-4056) Always start the NN's SecretManager

2012-10-17 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13478360#comment-13478360 ] Daryn Sharp commented on HDFS-4056: --- Yes, I do understand exactly what you are saying,

[jira] [Updated] (HDFS-4072) When deleting a file, it would be better to also remove corresponding block records from BlockManager#pendingReplications

2012-10-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4072: Attachment: HDFS-4072.trunk.001.patch And a simple patch uploaded. When deleting a file,

[jira] [Updated] (HDFS-4072) When deleting a file, it would be better to also remove corresponding block records from BlockManager#pendingReplications

2012-10-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4072: Status: Patch Available (was: Open) When deleting a file, it would be better to also remove

[jira] [Commented] (HDFS-4065) TestDFSShell.testGet sporadically fails attempting to corrupt block files due to race condition

2012-10-17 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13478378#comment-13478378 ] Chris Nauroth commented on HDFS-4065: - Hello, Daryn. My measurements show that

[jira] [Commented] (HDFS-4053) Increase the default block size

2012-10-17 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13478407#comment-13478407 ] Harsh J commented on HDFS-4053: --- bq. I'm sure we have a conversion method lurking somewhere

[jira] [Commented] (HDFS-4036) FSDirectory.unprotectedAddFile(..) should not throw UnresolvedLinkException

2012-10-17 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13478418#comment-13478418 ] Tsz Wo (Nicholas), SZE commented on HDFS-4036: -- Nicholas, but why is it

[jira] [Updated] (HDFS-4068) DatanodeID and DatanodeInfo member should be private

2012-10-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-4068: -- Resolution: Fixed Fix Version/s: 2.0.3-alpha Target Version/s: (was: 0.23.4,

[jira] [Commented] (HDFS-4068) DatanodeID and DatanodeInfo member should be private

2012-10-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13478422#comment-13478422 ] Eli Collins commented on HDFS-4068: --- Forgot to mention, I've committed this to trunk and

[jira] [Commented] (HDFS-4046) ChecksumTypeProto use NULL as enum value which is illegal in C/C++

2012-10-17 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13478423#comment-13478423 ] Suresh Srinivas commented on HDFS-4046: --- bq. 1. refactor all DataChecksum.Type.NULL

[jira] [Commented] (HDFS-4068) DatanodeID and DatanodeInfo member should be private

2012-10-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13478425#comment-13478425 ] Hudson commented on HDFS-4068: -- Integrated in Hadoop-trunk-Commit #2884 (See

[jira] [Resolved] (HDFS-3461) HFTP should use the same port protocol for getting the delegation token

2012-10-17 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-3461. -- Resolution: Fixed Fix was committed by Owen on 10/1/2012. HFTP should use the same

[jira] [Closed] (HDFS-3461) HFTP should use the same port protocol for getting the delegation token

2012-10-17 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley closed HDFS-3461. Closed upon release of Hadoop-1.1.0. HFTP should use the same port protocol for getting the

[jira] [Updated] (HDFS-4071) Add number of stale DataNodes to metrics for Branch-1

2012-10-17 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley updated HDFS-4071: - Target Version/s: 1.1.1, 3.0.0, 2.0.3-alpha Fix Version/s: (was: 2.0.3-alpha)

[jira] [Commented] (HDFS-4036) FSDirectory.unprotectedAddFile(..) should not throw UnresolvedLinkException

2012-10-17 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13478433#comment-13478433 ] Eli Collins commented on HDFS-4036: --- Right, hence the suggestion to either fix it here

[jira] [Commented] (HDFS-4072) When deleting a file, it would be better to also remove corresponding block records from BlockManager#pendingReplications

2012-10-17 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13478435#comment-13478435 ] Suresh Srinivas commented on HDFS-4072: --- Patch looks good. Can you combine the test

[jira] [Updated] (HDFS-3990) NN's health report has severe performance problems

2012-10-17 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-3990: -- Attachment: HDFS-3990.patch Will upload 23 patch shortly. NN's health report has

[jira] [Updated] (HDFS-4063) Unable to change JAVA_HOME directory in hadoop-setup-conf.sh script.

2012-10-17 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley updated HDFS-4063: - Target Version/s: 1.1.1, 2.0.3-alpha (was: 1.0.4, 1.1.1, 2.0.3-alpha) 1.0.4 was released without this

[jira] [Updated] (HDFS-1108) Log newly allocated blocks

2012-10-17 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley updated HDFS-1108: - Target Version/s: 1.2.0 (was: 1.1.0) Log newly allocated blocks --

[jira] [Updated] (HDFS-4057) NameNode.namesystem should be private. Use getNamesystem() instead.

2012-10-17 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-4057: - Attachment: HDFS-4057.branch-1.patch Re-based the patch and fixed the compilation problem. Sorry.

[jira] [Closed] (HDFS-3162) BlockMap's corruptNodes count and CorruptReplicas map count is not matching.

2012-10-17 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley closed HDFS-3162. BlockMap's corruptNodes count and CorruptReplicas map count is not matching.

[jira] [Commented] (HDFS-4056) Always start the NN's SecretManager

2012-10-17 Thread Kan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13478451#comment-13478451 ] Kan Zhang commented on HDFS-4056: - What combinations of initial and subsequent auth modes

[jira] [Reopened] (HDFS-3553) Hftp proxy tokens are broken

2012-10-17 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley reopened HDFS-3553: -- 1.1.0 was released without this patch. Changing the Target Version to 1.1.1. However, is this really

[jira] [Commented] (HDFS-4072) When deleting a file, it would be better to also remove corresponding block records from BlockManager#pendingReplications

2012-10-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13478455#comment-13478455 ] Hadoop QA commented on HDFS-4072: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-3553) Hftp proxy tokens are broken

2012-10-17 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley updated HDFS-3553: - Target Version/s: 0.23.4, 1.1.1, 3.0.0, 2.0.3-alpha (was: 1.1.0) Hftp proxy tokens are broken

[jira] [Commented] (HDFS-4057) NameNode.namesystem should be private. Use getNamesystem() instead.

2012-10-17 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13478476#comment-13478476 ] Brandon Li commented on HDFS-4057: -- test-patch result: {noformat} -1 overall. +1

[jira] [Commented] (HDFS-4014) Fix warnings found by findbugs2

2012-10-17 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13478483#comment-13478483 ] Tsz Wo (Nicholas), SZE commented on HDFS-4014: -- This findbugs 2 warnings for

  1   2   >