[jira] [Commented] (HDFS-4059) Add number of stale DataNodes to metrics

2012-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13476781#comment-13476781 ] Hadoop QA commented on HDFS-4059: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-3985) TestMulitipleNNDataBlockScanner may hang

2012-10-16 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3985: -- Attachment: hdfs-3985-timeouts.txt Attached patch adds 120sec timeouts to all the test cases in this

[jira] [Updated] (HDFS-3985) TestMulitipleNNDataBlockScanner may hang

2012-10-16 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-3985: -- Status: Patch Available (was: Open) TestMulitipleNNDataBlockScanner may hang

[jira] [Commented] (HDFS-3985) TestMulitipleNNDataBlockScanner may hang

2012-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13476835#comment-13476835 ] Hadoop QA commented on HDFS-3985: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-3219) Disambiguate visible length in the code and docs

2012-10-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13476875#comment-13476875 ] Yanbo Liang commented on HDFS-3219: --- If the last block is uncompleted and is in the state

[jira] [Created] (HDFS-4063) Unable to change JAVA_HOME directory in hadoop-setup-conf.sh script.

2012-10-16 Thread Haoquan Wang (JIRA)
Haoquan Wang created HDFS-4063: -- Summary: Unable to change JAVA_HOME directory in hadoop-setup-conf.sh script. Key: HDFS-4063 URL: https://issues.apache.org/jira/browse/HDFS-4063 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-4063) Unable to change JAVA_HOME directory in hadoop-setup-conf.sh script.

2012-10-16 Thread Haoquan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haoquan Wang resolved HDFS-4063. Resolution: Fixed Amend line 509 in file /sbin/hadoop-setup-conf.sh from:

[jira] [Reopened] (HDFS-4063) Unable to change JAVA_HOME directory in hadoop-setup-conf.sh script.

2012-10-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reopened HDFS-4063: -- reopening as it isn't fixed until the patch is checked in. Unable to change

[jira] [Commented] (HDFS-3678) Edit log files are never being purged from 2NN

2012-10-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13476896#comment-13476896 ] Hudson commented on HDFS-3678: -- Integrated in Hadoop-Yarn-trunk #5 (See

[jira] [Commented] (HDFS-4052) BlockManager#invalidateWork should print logs outside the lock

2012-10-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13476898#comment-13476898 ] Hudson commented on HDFS-4052: -- Integrated in Hadoop-Yarn-trunk #5 (See

[jira] [Commented] (HDFS-4058) DirectoryScanner may fail with IOOB if the directory scanning threads return out of volume order

2012-10-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13476900#comment-13476900 ] Hudson commented on HDFS-4058: -- Integrated in Hadoop-Yarn-trunk #5 (See

[jira] [Commented] (HDFS-2946) HA: Put a cap on the number of completed edits files retained by the NN

2012-10-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13476901#comment-13476901 ] Hudson commented on HDFS-2946: -- Integrated in Hadoop-Yarn-trunk #5 (See

[jira] [Commented] (HDFS-4049) hflush performance regression due to nagling delays

2012-10-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13476902#comment-13476902 ] Hudson commented on HDFS-4049: -- Integrated in Hadoop-Yarn-trunk #5 (See

Unknown Space used by Hadoop cluster !

2012-10-16 Thread Prachi Shah
Hello Hadoop Team, We have organized 9 node Seismic Hadoop cluster. We loaded a 4gb SegY file on this cluster. To load a file in HDFS (Hadoop distributed File System) we use following command: ./suhdp load -input /usr/share/dumphere/seismic_4GB.segy -output

[jira] [Updated] (HDFS-4016) back-port HDFS-3582 to branch-0.23

2012-10-16 Thread Ivan A. Veselovsky (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan A. Veselovsky updated HDFS-4016: - Attachment: (was: HDFS-4016-branch-0.23.patch) back-port HDFS-3582 to

[jira] [Updated] (HDFS-4016) back-port HDFS-3582 to branch-0.23

2012-10-16 Thread Ivan A. Veselovsky (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan A. Veselovsky updated HDFS-4016: - Attachment: HDFS-4016-branch-0.23.patch Attached 2nd patch version which fixes all the

[jira] [Commented] (HDFS-4016) back-port HDFS-3582 to branch-0.23

2012-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13476937#comment-13476937 ] Hadoop QA commented on HDFS-4016: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-4063) Unable to change JAVA_HOME directory in hadoop-setup-conf.sh script.

2012-10-16 Thread Haoquan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haoquan Wang updated HDFS-4063: --- Affects Version/s: 1.1.1 2.0.2-alpha Unable to change JAVA_HOME directory

[jira] [Updated] (HDFS-4063) Unable to change JAVA_HOME directory in hadoop-setup-conf.sh script.

2012-10-16 Thread Haoquan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haoquan Wang updated HDFS-4063: --- Target Version/s: 1.0.4, 1.1.1, 2.0.3-alpha (was: 1.0.4) Unable to change JAVA_HOME directory

[jira] [Updated] (HDFS-4063) Unable to change JAVA_HOME directory in hadoop-setup-conf.sh script.

2012-10-16 Thread Haoquan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haoquan Wang updated HDFS-4063: --- Affects Version/s: (was: 1.1.1) 1.1.0 Unable to change JAVA_HOME

[jira] [Updated] (HDFS-4063) Unable to change JAVA_HOME directory in hadoop-setup-conf.sh script.

2012-10-16 Thread Haoquan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haoquan Wang updated HDFS-4063: --- Fix Version/s: (was: 1.0.3) Unable to change JAVA_HOME directory in hadoop-setup-conf.sh

[jira] [Commented] (HDFS-4056) Always start the NN's SecretManager

2012-10-16 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13476994#comment-13476994 ] Daryn Sharp commented on HDFS-4056: --- While I agree, I believe you are describing the goal

[jira] [Commented] (HDFS-4016) back-port HDFS-3582 to branch-0.23

2012-10-16 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477051#comment-13477051 ] Robert Joseph Evans commented on HDFS-4016: --- The patch looks good to me. I am

[jira] [Commented] (HDFS-3990) NN's health report has severe performance problems

2012-10-16 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477053#comment-13477053 ] Daryn Sharp commented on HDFS-3990: --- bq. Maintaining both an ipAddr/hostName plus

[jira] [Created] (HDFS-4064) JNI-based user-group mapping modules can be too chatty on lookup failures

2012-10-16 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-4064: Summary: JNI-based user-group mapping modules can be too chatty on lookup failures Key: HDFS-4064 URL: https://issues.apache.org/jira/browse/HDFS-4064 Project: Hadoop HDFS

[jira] [Commented] (HDFS-4039) Add option for WebHDFS to be a proxy, rather than just 302 to the DNs

2012-10-16 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477068#comment-13477068 ] Steve Loughran commented on HDFS-4039: -- alejandro - I knew about HttFS, I was just

[jira] [Commented] (HDFS-4039) Add option for WebHDFS to be a proxy, rather than just 302 to the DNs

2012-10-16 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477070#comment-13477070 ] Alejandro Abdelnur commented on HDFS-4039: -- Are you suggesting to run funnel all

[jira] [Commented] (HDFS-3985) TestMulitipleNNDataBlockScanner may hang

2012-10-16 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477111#comment-13477111 ] Eli Collins commented on HDFS-3985: --- +1 lgtm

[jira] [Commented] (HDFS-3990) NN's health report has severe performance problems

2012-10-16 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477131#comment-13477131 ] Eli Collins commented on HDFS-3990: --- bq. They will change when a pre-existing node, say

[jira] [Updated] (HDFS-3985) TestMulitipleNNDataBlockScanner may hang

2012-10-16 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3985: -- Resolution: Fixed Fix Version/s: 2.0.3-alpha Hadoop Flags: Reviewed Status:

[jira] [Updated] (HDFS-3985) Add timeouts to TestMulitipleNNDataBlockScanner

2012-10-16 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3985: -- Summary: Add timeouts to TestMulitipleNNDataBlockScanner (was: TestMulitipleNNDataBlockScanner may

[jira] [Commented] (HDFS-3985) Add timeouts to TestMulitipleNNDataBlockScanner

2012-10-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477138#comment-13477138 ] Hudson commented on HDFS-3985: -- Integrated in Hadoop-trunk-Commit #2869 (See

[jira] [Commented] (HDFS-4056) Always start the NN's SecretManager

2012-10-16 Thread Kan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477142#comment-13477142 ] Kan Zhang commented on HDFS-4056: - My comment is less about adding new auth options or

[jira] [Commented] (HDFS-4063) Unable to change JAVA_HOME directory in hadoop-setup-conf.sh script.

2012-10-16 Thread Arpit Gupta (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477149#comment-13477149 ] Arpit Gupta commented on HDFS-4063: --- These scripts were written to help with setup for

[jira] [Commented] (HDFS-3920) libwebdhfs code cleanup: string processing and using strerror consistently to handle all errors

2012-10-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477160#comment-13477160 ] Colin Patrick McCabe commented on HDFS-3920: Thanks, Jing. This is a big

[jira] [Commented] (HDFS-3912) Detecting and avoiding stale datanodes for writing

2012-10-16 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477166#comment-13477166 ] Suresh Srinivas commented on HDFS-3912: --- Jing, branch-1 patch does not cleanly apply.

[jira] [Commented] (HDFS-3920) libwebdhfs code cleanup: string processing and using strerror consistently to handle all errors

2012-10-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477167#comment-13477167 ] Colin Patrick McCabe commented on HDFS-3920: Oh, also, you have a bunch of

[jira] [Updated] (HDFS-4059) Add number of stale DataNodes to metrics

2012-10-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4059: Attachment: HDFS-4059.trunk.002.patch Thanks for the comments Suresh! The testStaleNodes testcase now

[jira] [Commented] (HDFS-3990) NN's health report has severe performance problems

2012-10-16 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477181#comment-13477181 ] Daryn Sharp commented on HDFS-3990: --- bq. I'm not sure re-registering with a new IP and

[jira] [Commented] (HDFS-4048) Use ERROR instead of INFO for volume failure logs

2012-10-16 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477187#comment-13477187 ] Stephen Chu commented on HDFS-4048: --- Thanks for the suggestion. I'll change the level to

[jira] [Assigned] (HDFS-3935) QJM: Add JournalNode to the start / stop scripts

2012-10-16 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson reassigned HDFS-3935: --- Assignee: Andy Isaacson (was: Eli Collins) QJM: Add JournalNode to the start / stop

[jira] [Commented] (HDFS-4059) Add number of stale DataNodes to metrics

2012-10-16 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477202#comment-13477202 ] Suresh Srinivas commented on HDFS-4059: --- Calling metrics StaleDataNodes is better

[jira] [Updated] (HDFS-4059) Add number of stale DataNodes to metrics

2012-10-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4059: Attachment: HDFS-4059.trunk.003.patch Updated based on Suresh's comments. Add number of

[jira] [Updated] (HDFS-4016) back-port HDFS-3582 to branch-0.23

2012-10-16 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Joseph Evans updated HDFS-4016: -- Resolution: Fixed Fix Version/s: 0.23.5 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-4056) Always start the NN's SecretManager

2012-10-16 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477213#comment-13477213 ] Daryn Sharp commented on HDFS-4056: --- After this change SIMPLE + SIMPLE will work just as

[jira] [Updated] (HDFS-4061) TestBalancer and TestUnderReplicatedBlocks need timeouts

2012-10-16 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4061: - Status: Patch Available (was: Open) TestBalancer and TestUnderReplicatedBlocks need

[jira] [Commented] (HDFS-4061) TestBalancer and TestUnderReplicatedBlocks need timeouts

2012-10-16 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477215#comment-13477215 ] Aaron T. Myers commented on HDFS-4061: -- +1 pending Jenkins. Choosing a 100k ms

[jira] [Updated] (HDFS-3990) NN's health report has severe performance problems

2012-10-16 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-3990: -- Attachment: HDFS-3990.patch Uses the resolved hostname of the ipc connection and rejects unresolved

[jira] [Updated] (HDFS-3990) NN's health report has severe performance problems

2012-10-16 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-3990: -- Status: Patch Available (was: Open) NN's health report has severe performance problems

[jira] [Commented] (HDFS-4059) Add number of stale DataNodes to metrics

2012-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477268#comment-13477268 ] Hadoop QA commented on HDFS-4059: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4061) TestBalancer and TestUnderReplicatedBlocks need timeouts

2012-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477279#comment-13477279 ] Hadoop QA commented on HDFS-4061: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4059) Add number of stale DataNodes to metrics

2012-10-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477285#comment-13477285 ] Hudson commented on HDFS-4059: -- Integrated in Hadoop-trunk-Commit #2873 (See

[jira] [Updated] (HDFS-4059) Add number of stale DataNodes to metrics

2012-10-16 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-4059: -- Resolution: Fixed Fix Version/s: (was: 1.1.0) Release Note: This jira adds a

[jira] [Commented] (HDFS-4059) Add number of stale DataNodes to metrics

2012-10-16 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477288#comment-13477288 ] Suresh Srinivas commented on HDFS-4059: --- We should probably make this change in

[jira] [Commented] (HDFS-3990) NN's health report has severe performance problems

2012-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477296#comment-13477296 ] Hadoop QA commented on HDFS-3990: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-2434) TestNameNodeMetrics.testCorruptBlock fails intermittently

2012-10-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-2434: Attachment: HDFS-2434.trunk.003.patch Made some further changes for the patch. In the testCorrupt testcase,

[jira] [Commented] (HDFS-4063) Unable to change JAVA_HOME directory in hadoop-setup-conf.sh script.

2012-10-16 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477338#comment-13477338 ] Aaron T. Myers commented on HDFS-4063: -- bq. Given the discussion on HADOOP-8925 which

[jira] [Commented] (HDFS-4029) GenerationStamp should use an AtomicLong

2012-10-16 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477363#comment-13477363 ] Todd Lipcon commented on HDFS-4029: --- +1, this looks reasonable to me.

[jira] [Commented] (HDFS-3990) NN's health report has severe performance problems

2012-10-16 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477373#comment-13477373 ] Daryn Sharp commented on HDFS-3990: --- Ignoring the hostname the datanode claims to be is

[jira] [Updated] (HDFS-3912) Detecting and avoiding stale datanodes for writing

2012-10-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3912: Attachment: HDFS-3912-branch-1.patch The patch for branch-1. Detecting and avoiding stale

[jira] [Commented] (HDFS-4061) TestBalancer and TestUnderReplicatedBlocks need timeouts

2012-10-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477391#comment-13477391 ] Hudson commented on HDFS-4061: -- Integrated in Hadoop-trunk-Commit #2875 (See

[jira] [Commented] (HDFS-3912) Detecting and avoiding stale datanodes for writing

2012-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477403#comment-13477403 ] Hadoop QA commented on HDFS-3912: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-4061) TestBalancer and TestUnderReplicatedBlocks need timeouts

2012-10-16 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-4061: -- Resolution: Fixed Fix Version/s: 2.0.3-alpha Target Version/s: (was: 2.0.3-alpha)

[jira] [Commented] (HDFS-3990) NN's health report has severe performance problems

2012-10-16 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477409#comment-13477409 ] Eli Collins commented on HDFS-3990: --- Yea, that's what I meant above by This breaks

[jira] [Created] (HDFS-4065) TestDFSShell.testGet sporadically fails attempting to corrupt block files due to race condition

2012-10-16 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-4065: --- Summary: TestDFSShell.testGet sporadically fails attempting to corrupt block files due to race condition Key: HDFS-4065 URL: https://issues.apache.org/jira/browse/HDFS-4065

[jira] [Commented] (HDFS-4065) TestDFSShell.testGet sporadically fails attempting to corrupt block files due to race condition

2012-10-16 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477411#comment-13477411 ] Chris Nauroth commented on HDFS-4065: - This is the output from a failed test run:

[jira] [Updated] (HDFS-3990) NN's health report has severe performance problems

2012-10-16 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-3990: -- Attachment: HDFS-3990.patch Track the peer name from the socket separately. NN's

[jira] [Updated] (HDFS-4065) TestDFSShell.testGet sporadically fails attempting to corrupt block files due to race condition

2012-10-16 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-4065: Attachment: HDFS-4065-branch-1-win.patch With this patch, the test fully shuts down the

[jira] [Commented] (HDFS-3990) NN's health report has severe performance problems

2012-10-16 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477415#comment-13477415 ] Daryn Sharp commented on HDFS-3990: --- bq. Btw the latest patch has some changes like

[jira] [Commented] (HDFS-3990) NN's health report has severe performance problems

2012-10-16 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477420#comment-13477420 ] Daryn Sharp commented on HDFS-3990: --- I forgot to mention that I think you'll find

[jira] [Updated] (HDFS-3920) libwebdhfs code cleanup: string processing and using strerror consistently to handle all errors

2012-10-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3920: Attachment: HDFS-3920-007.patch Colin, thanks for the comments! I've addressed most of your comments and

[jira] [Commented] (HDFS-4065) TestDFSShell.testGet sporadically fails attempting to corrupt block files due to race condition

2012-10-16 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477447#comment-13477447 ] Brandon Li commented on HDFS-4065: -- +1, the patch looks good to me. Thanks for the fixing,

[jira] [Commented] (HDFS-4056) Always start the NN's SecretManager

2012-10-16 Thread Kan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477485#comment-13477485 ] Kan Zhang commented on HDFS-4056: - bq. After this change SIMPLE + SIMPLE will work just as

[jira] [Commented] (HDFS-3980) NPE in HttpURLConnection.java while starting SecondaryNameNode.

2012-10-16 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477495#comment-13477495 ] Aaron T. Myers commented on HDFS-3980: -- Hi Brahma, can you tell me exactly what you

[jira] [Updated] (HDFS-3997) OfflineImageViewer incorrectly passes value of imageVersion when visiting IS_COMPRESSED element

2012-10-16 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-3997: - Summary: OfflineImageViewer incorrectly passes value of imageVersion when visiting IS_COMPRESSED

[jira] [Updated] (HDFS-3997) OfflineImageViewer incorrectly passes value of imageVersion when visiting IS_COMPRESSED element

2012-10-16 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-3997: - Resolution: Fixed Fix Version/s: 2.0.3-alpha Hadoop Flags: Reviewed Status:

[jira] [Commented] (HDFS-3997) OfflineImageViewer incorrectly passes value of imageVersion when visiting IS_COMPRESSED element

2012-10-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477517#comment-13477517 ] Hudson commented on HDFS-3997: -- Integrated in Hadoop-trunk-Commit #2877 (See

[jira] [Commented] (HDFS-3912) Detecting and avoiding stale datanodes for writing

2012-10-16 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477534#comment-13477534 ] Suresh Srinivas commented on HDFS-3912: --- Typo in the patch: ecxludedNodes. This also

[jira] [Updated] (HDFS-3912) Detecting and avoiding stale datanodes for writing

2012-10-16 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-3912: -- Status: Open (was: Patch Available) Canceling patch to prevent Jenkins from running builds for

[jira] [Updated] (HDFS-3912) Detecting and avoiding stale datanodes for writing

2012-10-16 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-3912: -- Attachment: HDFS-3912.branch-1.patch Fixed the typo Detecting and avoiding

[jira] [Resolved] (HDFS-3912) Detecting and avoiding stale datanodes for writing

2012-10-16 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-3912. --- Resolution: Fixed Fix Version/s: 2.0.3-alpha 1.2.0 Hadoop

[jira] [Commented] (HDFS-4022) Replication not happening for appended block

2012-10-16 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477553#comment-13477553 ] Tsz Wo (Nicholas), SZE commented on HDFS-4022: -- Hi Vinay, thanks for working

[jira] [Updated] (HDFS-2434) TestNameNodeMetrics.testCorruptBlock fails intermittently

2012-10-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-2434: Attachment: HDFS-2434.trunk.004.patch The 003 patch could not apply to trunk after the changes in

[jira] [Commented] (HDFS-3219) Disambiguate visible length in the code and docs

2012-10-16 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477560#comment-13477560 ] Tsz Wo (Nicholas), SZE commented on HDFS-3219: -- ... The result may be

[jira] [Updated] (HDFS-2434) TestNameNodeMetrics.testCorruptBlock fails intermittently

2012-10-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-2434: Affects Version/s: 3.0.0 Status: Patch Available (was: Reopened)

[jira] [Commented] (HDFS-4022) Replication not happening for appended block

2012-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477569#comment-13477569 ] Hadoop QA commented on HDFS-4022: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4060) TestHSync#testSequenceFileSync failed

2012-10-16 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477584#comment-13477584 ] Lars Hofhansl commented on HDFS-4060: - The sync to disk is not actually on a

[jira] [Updated] (HDFS-4055) TestAuditLogs is flaky

2012-10-16 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-4055: -- Summary: TestAuditLogs is flaky (was: TestAuditLogs has some chances to fail.) TestAuditLogs is

[jira] [Updated] (HDFS-4055) TestAuditLogs is flaky

2012-10-16 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-4055: -- Resolution: Fixed Fix Version/s: 2.0.3-alpha Hadoop Flags: Reviewed Status:

[jira] [Commented] (HDFS-4022) Replication not happening for appended block

2012-10-16 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477594#comment-13477594 ] Uma Maheswara Rao G commented on HDFS-4022: --- {quote}

[jira] [Commented] (HDFS-4022) Replication not happening for appended block

2012-10-16 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477593#comment-13477593 ] Uma Maheswara Rao G commented on HDFS-4022: --- {quote}

[jira] [Updated] (HDFS-4053) Increase the default block size

2012-10-16 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-4053: -- Attachment: hdfs-4053.txt Patch attached. Increase the default block size

[jira] [Updated] (HDFS-4053) Increase the default block size

2012-10-16 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-4053: -- Status: Patch Available (was: Open) Increase the default block size

[jira] [Commented] (HDFS-4055) TestAuditLogs is flaky

2012-10-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477596#comment-13477596 ] Hudson commented on HDFS-4055: -- Integrated in Hadoop-trunk-Commit #2879 (See

[jira] [Commented] (HDFS-2434) TestNameNodeMetrics.testCorruptBlock fails intermittently

2012-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477599#comment-13477599 ] Hadoop QA commented on HDFS-2434: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-3981) access time is set without holding writelock in FSNamesystem

2012-10-16 Thread Xiaobo Peng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobo Peng updated HDFS-3981: -- Attachment: HDFS-3981-branch-0.23.4.patch I prepare the pathc by following the instructions at

[jira] [Created] (HDFS-4067) TestUnderReplicatedBlocks may fail due to ReplicaAlreadyExistsException

2012-10-16 Thread Eli Collins (JIRA)
Eli Collins created HDFS-4067: - Summary: TestUnderReplicatedBlocks may fail due to ReplicaAlreadyExistsException Key: HDFS-4067 URL: https://issues.apache.org/jira/browse/HDFS-4067 Project: Hadoop HDFS

[jira] [Commented] (HDFS-4022) Replication not happening for appended block

2012-10-16 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13477606#comment-13477606 ] Uma Maheswara Rao G commented on HDFS-4022: --- Thanks Nicholas, for the comments.

[jira] [Updated] (HDFS-4029) GenerationStamp should use an AtomicLong

2012-10-16 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-4029: -- Resolution: Fixed Fix Version/s: 2.0.3-alpha Target Version/s: (was: 2.0.3-alpha)

[jira] [Updated] (HDFS-3990) NN's health report has severe performance problems

2012-10-16 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-3990: -- Status: Open (was: Patch Available) NN's health report has severe performance problems

  1   2   >