Regarding HADOOP-7191 BackUpNameNode is using 100% CPU and not accepting any requests.

2011-03-14 Thread Uma Mahesh
Hi All, Any one faced this problem? In one of our cluster we faced this problem. At that time BackUpNameNode not accepting any requests and also CPU usage bcame 100%. Please share the information if any workaround or fix available for this problem. Regards, Uma Mahesh

[jira] Moved: (HDFS-1756) BackUpNameNode is using 100% CPU and not accepting any requests.

2011-03-14 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G moved HADOOP-7186 to HDFS-1756: --- Component/s: (was: ipc) (was: io)

[jira] Updated: (HDFS-1748) Balancer utilization classification is incomplete

2011-03-14 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-1748: - Fix Version/s: Federation Branch Merged this (r1080836) from trunk to federation.

[jira] Updated: (HDFS-1755) Hdfs Federation: The BPOfferService must always connect to namenode as the login user.

2011-03-14 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-1755: --- Attachment: HDFS-1755.2.patch The patch wraps the call to create namenode proxy within

[jira] Resolved: (HDFS-1754) Federation HDFS: testFsck fails

2011-03-14 Thread Boris Shkolnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik resolved HDFS-1754. -- Resolution: Fixed > Federation HDFS: testFsck fails > --- > >

[jira] Updated: (HDFS-1754) Federation HDFS: testFsck fails

2011-03-14 Thread Boris Shkolnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated HDFS-1754: - Hadoop Flags: [Reviewed] Summary: Federation HDFS: testFsck fails (was: Federation HDFS:

[jira] Commented: (HDFS-1750) fs -ls hftp://file not working

2011-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006705#comment-13006705 ] Hadoop QA commented on HDFS-1750: - -1 overall. Here are the results of testing the latest

[jira] Created: (HDFS-1755) Hdfs Federation: The BPOfferService must always connect to namenode as the login user.

2011-03-14 Thread Jitendra Nath Pandey (JIRA)
Hdfs Federation: The BPOfferService must always connect to namenode as the login user. -- Key: HDFS-1755 URL: https://issues.apache.org/jira/browse/HDFS-1755 Project:

[jira] Updated: (HDFS-1754) Federation HDFS: :testFsck fails

2011-03-14 Thread Boris Shkolnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated HDFS-1754: - Attachment: HDFS-1754-2.patch added @param > Federation HDFS: :testFsck fails >

[jira] Commented: (HDFS-1754) Federation HDFS: :testFsck fails

2011-03-14 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006698#comment-13006698 ] Suresh Srinivas commented on HDFS-1754: --- +1 for the patch. > Federation HDFS: :testF

[jira] Commented: (HDFS-1751) Intrinsic limits for HDFS files, directories

2011-03-14 Thread Boris Shkolnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006685#comment-13006685 ] Boris Shkolnik commented on HDFS-1751: -- quick question - how 'limit on the number of n

[jira] Updated: (HDFS-1754) Federation HDFS: :testFsck fails

2011-03-14 Thread Boris Shkolnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated HDFS-1754: - Attachment: HDFS-1754-1.patch clean up and review comments > Federation HDFS: :testFsck fails > -

[jira] Commented: (HDFS-1754) Federation HDFS: :testFsck fails

2011-03-14 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006677#comment-13006677 ] Suresh Srinivas commented on HDFS-1754: --- All comments are minor: # DFSUtil#getInfoSer

[jira] Commented: (HDFS-1675) Transfer RBW between datanodes

2011-03-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006674#comment-13006674 ] Hudson commented on HDFS-1675: -- Integrated in Hadoop-Hdfs-trunk-Commit #559 (See [https://hud

[jira] Updated: (HDFS-1750) fs -ls hftp://file not working

2011-03-14 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-1750: - Summary: fs -ls hftp://file not working (was: ls hftp://file not working) > fs -l

[jira] Updated: (HDFS-1675) Transfer RBW between datanodes

2011-03-14 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-1675: - Resolution: Fixed Fix Version/s: 0.23.0 Release Note: Added a new stage

[jira] Updated: (HDFS-1750) ls hftp://file not working

2011-03-14 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-1750: - Affects Version/s: 0.21.1 Status: Patch Available (was: Open) > ls

[jira] Updated: (HDFS-1750) ls hftp://file not working

2011-03-14 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-1750: - Attachment: h1750_20110314.patch h1750_20110314.patch: use getFullPath(..) in List

[jira] Commented: (HDFS-1675) Transfer RBW between datanodes

2011-03-14 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006657#comment-13006657 ] Jitendra Nath Pandey commented on HDFS-1675: +1 for the patch. > Transfer RBW

[jira] Commented: (HDFS-780) Revive TestFuseDFS

2011-03-14 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006638#comment-13006638 ] Todd Lipcon commented on HDFS-780: -- - why use instead of using the built-in ant copy task?

[jira] Updated: (HDFS-1754) Federation HDFS: :testFsck fails

2011-03-14 Thread Boris Shkolnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated HDFS-1754: - Attachment: HDFS-1754.patch > Federation HDFS: :testFsck fails >

[jira] Updated: (HDFS-1754) Federation HDFS: :testFsck fails

2011-03-14 Thread Boris Shkolnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated HDFS-1754: - Description: getting config value for HTTP server is changed to read new (federation)style configu

[jira] Created: (HDFS-1754) testFsck fails

2011-03-14 Thread Boris Shkolnik (JIRA)
testFsck fails -- Key: HDFS-1754 URL: https://issues.apache.org/jira/browse/HDFS-1754 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Boris Shkolnik Assignee: Boris Shkolnik -- This message is auto

[jira] Commented: (HDFS-281) Explore usage of the sendfile api via java.nio.channels.FileChannel.transfer{To|From} for i/o in datanodes

2011-03-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006574#comment-13006574 ] Kihwal Lee commented on HDFS-281: - I believe it was fixed by HADOOP-3164, which was committe

[jira] Updated: (HDFS-780) Revive TestFuseDFS

2011-03-14 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-780: - Attachment: hdfs-780-3.patch Minor update to the last patch: adds fuse-dfs back into build-contrib.xml so i

[jira] Updated: (HDFS-420) fuse_dfs is unable to connect to the dfs after a copying a large number of files into the dfs over fuse

2011-03-14 Thread Brian Bockelman (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Bockelman updated HDFS-420: - Attachment: fuse_dfs_020_memleaks_v3.patch There seems to be threading issues in libhdfs when disco

[jira] Commented: (HDFS-1594) When the disk becomes full Namenode is getting shutdown and not able to recover

2011-03-14 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006527#comment-13006527 ] dhruba borthakur commented on HDFS-1594: @Devaraj: ur proposal to make the NN go in

[jira] Commented: (HDFS-1594) When the disk becomes full Namenode is getting shutdown and not able to recover

2011-03-14 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006515#comment-13006515 ] Todd Lipcon commented on HDFS-1594: --- Dhruba: I haven't dug into it yet, but I've also see

[jira] Commented: (HDFS-1587) JVM crash under writes: ExceptionMark destructor expects no pending exceptions

2011-03-14 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006507#comment-13006507 ] Todd Lipcon commented on HDFS-1587: --- It has "Review ID" 1985110, but it didn't get assign

[jira] Commented: (HDFS-1751) Intrinsic limits for HDFS files, directories

2011-03-14 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006491#comment-13006491 ] Daryn Sharp commented on HDFS-1751: --- The following tests that failed are unrelated to thi

[jira] Commented: (HDFS-1751) Intrinsic limits for HDFS files, directories

2011-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006476#comment-13006476 ] Hadoop QA commented on HDFS-1751: - -1 overall. Here are the results of testing the latest

[jira] Updated: (HDFS-1521) Persist transaction ID on disk between NN restarts

2011-03-14 Thread Ivan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Kelly updated HDFS-1521: - Status: Patch Available (was: Open) > Persist transaction ID on disk between NN restarts > --

[jira] Updated: (HDFS-1521) Persist transaction ID on disk between NN restarts

2011-03-14 Thread Ivan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Kelly updated HDFS-1521: - Status: Open (was: Patch Available) > Persist transaction ID on disk between NN restarts > --

[jira] Updated: (HDFS-1752) Chance of Resource Leak in org.apache.hadoop.hdfs.server.namenode.FsImage.

2011-03-14 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-1752: -- Priority: Minor (was: Major) > Chance of Resource Leak in org.apache.hadoop.hdfs.server

[jira] Updated: (HDFS-1753) Resource Leak in org.apache.hadoop.hdfs.server.namenode.StreamFile

2011-03-14 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-1753: -- Description: In doGet Method, final DFSInputStream in = dfs.open(filename); final long

[jira] Created: (HDFS-1753) Resource Leak in org.apache.hadoop.hdfs.server.namenode.StreamFile

2011-03-14 Thread Uma Maheswara Rao G (JIRA)
Resource Leak in org.apache.hadoop.hdfs.server.namenode.StreamFile -- Key: HDFS-1753 URL: https://issues.apache.org/jira/browse/HDFS-1753 Project: Hadoop HDFS Issue Type: Bug

[jira] Updated: (HDFS-1752) Chance of Resource Leak in org.apache.hadoop.hdfs.server.namenode.FsImage.

2011-03-14 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-1752: -- Component/s: name-node > Chance of Resource Leak in org.apache.hadoop.hdfs.server.nameno

[jira] Moved: (HDFS-1752) Chance of Resource Leak in org.apache.hadoop.hdfs.server.namenode.FsImage.

2011-03-14 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G moved HADOOP-7188 to HDFS-1752: --- Key: HDFS-1752 (was: HADOOP-7188) Project: Hadoop HDFS

[jira] Commented: (HDFS-1521) Persist transaction ID on disk between NN restarts

2011-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006458#comment-13006458 ] Hadoop QA commented on HDFS-1521: - -1 overall. Here are the results of testing the latest

[jira] Updated: (HDFS-1751) Intrinsic limits for HDFS files, directories

2011-03-14 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-1751: -- Attachment: HDFS-1751.patch Add min/max component length, max items per directory. Full set of unit tes

[jira] Updated: (HDFS-1751) Intrinsic limits for HDFS files, directories

2011-03-14 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-1751: -- Status: Patch Available (was: Open) > Intrinsic limits for HDFS files, directories > --

[jira] Created: (HDFS-1751) Intrinsic limits for HDFS files, directories

2011-03-14 Thread Daryn Sharp (JIRA)
Intrinsic limits for HDFS files, directories Key: HDFS-1751 URL: https://issues.apache.org/jira/browse/HDFS-1751 Project: Hadoop HDFS Issue Type: New Feature Components: data-node Af

[jira] Updated: (HDFS-1521) Persist transaction ID on disk between NN restarts

2011-03-14 Thread Ivan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Kelly updated HDFS-1521: - Attachment: HDFS-1521.diff Merged shv's changes with the main patch. One minor change, in that storage is

[jira] Updated: (HDFS-1521) Persist transaction ID on disk between NN restarts

2011-03-14 Thread Ivan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Kelly updated HDFS-1521: - Status: Patch Available (was: Open) > Persist transaction ID on disk between NN restarts > --

[jira] Updated: (HDFS-1521) Persist transaction ID on disk between NN restarts

2011-03-14 Thread Ivan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Kelly updated HDFS-1521: - Status: Open (was: Patch Available) > Persist transaction ID on disk between NN restarts > --

[jira] Commented: (HDFS-1594) When the disk becomes full Namenode is getting shutdown and not able to recover

2011-03-14 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13006368#comment-13006368 ] Devaraj K commented on HDFS-1594: - During write operation, if the name node encounters disk