Class responsible for Registered DataNode.

2013-04-24 Thread Mohammad Mustaqeem
Which class keeps track of all the registered DataNodes? -- *With regards ---* *Mohammad Mustaqeem*, M.Tech (CSE) MNNIT Allahabad 9026604270

[jira] [Resolved] (HDFS-252) Export the HDFS file system through a NFS protocol

2013-04-24 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li resolved HDFS-252. - Resolution: Duplicate > Export the HDFS file system through a NFS protocol > --

Unable to delete symlinks in HDFS via FileContext

2013-04-24 Thread Dia Kharrat
Hi, We have an HDFS setup (v2.0.0) managed by Cloudera. I'm having trouble getting the FileStatus of a symlink or deleting it. According to the documentation, FileContext#getFileLinkStatus() or FileContext#delete() should operate on the symlink itself if the provided path is a symlink. However,

Re: Why failed to use Distcp over FTP protocol?

2013-04-24 Thread sam liu
I could execute: - hadoop fs -ls ftp://ftpuser:ftpuser@hostname/tmp/testdir - hadoop fs -lsr ftp://ftpuser:ftpuser@hostname/tmp/testdir Is there any special requirement to ftp configurations for running distcp tool? In my env, if issue 'hadoop fs -lsr ftp://ftpuser:ftpuser@hostname', it will retur

[jira] [Created] (HDFS-4751) TestLeaseRenewer#testThreadName flakes

2013-04-24 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-4751: - Summary: TestLeaseRenewer#testThreadName flakes Key: HDFS-4751 URL: https://issues.apache.org/jira/browse/HDFS-4751 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-4750) Support NFSv3 interface to HDFS

2013-04-24 Thread Brandon Li (JIRA)
Brandon Li created HDFS-4750: Summary: Support NFSv3 interface to HDFS Key: HDFS-4750 URL: https://issues.apache.org/jira/browse/HDFS-4750 Project: Hadoop HDFS Issue Type: New Feature Affects

[jira] [Created] (HDFS-4749) Use INodeId to identify the corresponding directory node for FSImage saving/loading

2013-04-24 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-4749: --- Summary: Use INodeId to identify the corresponding directory node for FSImage saving/loading Key: HDFS-4749 URL: https://issues.apache.org/jira/browse/HDFS-4749 Project: Hadoop

[jira] [Resolved] (HDFS-4276) HDFS tests have multiple failures on Windows due to file locking conflict

2013-04-24 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-4276. - Resolution: Not A Problem I think this issue has gone out of date, so I'm resolving it. Many of t

[jira] [Created] (HDFS-4748) MiniJournalCluster#restartJournalNode leaks resources, which causes sporadic test failures

2013-04-24 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-4748: --- Summary: MiniJournalCluster#restartJournalNode leaks resources, which causes sporadic test failures Key: HDFS-4748 URL: https://issues.apache.org/jira/browse/HDFS-4748

[jira] [Created] (HDFS-4747) Convert snapshot user guide to APT from XDOC

2013-04-24 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-4747: Summary: Convert snapshot user guide to APT from XDOC Key: HDFS-4747 URL: https://issues.apache.org/jira/browse/HDFS-4747 Project: Hadoop HDFS Issue Type: Su

[jira] [Created] (HDFS-4746) ClassCastException in BlockManager.addStoredBlock() due to that blockReceived came after file was closed.

2013-04-24 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-4746: - Summary: ClassCastException in BlockManager.addStoredBlock() due to that blockReceived came after file was closed. Key: HDFS-4746 URL: https://issues.apache.org/jira/bro

[jira] [Created] (HDFS-4745) TestDataTransferKeepalive#testSlowReader has race condition that causes sporadic failure

2013-04-24 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-4745: --- Summary: TestDataTransferKeepalive#testSlowReader has race condition that causes sporadic failure Key: HDFS-4745 URL: https://issues.apache.org/jira/browse/HDFS-4745 Pr

[jira] [Created] (HDFS-4744) TestBlockRecovery should bind ephemeral ports redux

2013-04-24 Thread Andrew Purtell (JIRA)
Andrew Purtell created HDFS-4744: Summary: TestBlockRecovery should bind ephemeral ports redux Key: HDFS-4744 URL: https://issues.apache.org/jira/browse/HDFS-4744 Project: Hadoop HDFS Issue T

Re: Heads up - Snapshots feature merge into trunk

2013-04-24 Thread Suresh Srinivas
I think we should take this on the jira than the merge heads up thread. Nicholas, please suggest a jira where we can continue the Some comments inline: On Wed, Apr 24, 2013 at 1:25 PM, Todd Lipcon wrote: > On Fri, Apr 19, 2013 at 3:36 AM, Aaron T. Myers wrote: > > > On Fri, Apr 19, 2013 at 6:

[jira] [Created] (HDFS-4743) TestNNStorageRetentionManager fails on Windows

2013-04-24 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-4743: --- Summary: TestNNStorageRetentionManager fails on Windows Key: HDFS-4743 URL: https://issues.apache.org/jira/browse/HDFS-4743 Project: Hadoop HDFS Issue Type: Bu

[jira] [Resolved] (HDFS-4729) Fix OfflineImageViewer and permission checking for snapshot operations

2013-04-24 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE resolved HDFS-4729. -- Resolution: Fixed Fix Version/s: Snapshot (HDFS-2802) I have committed th

[jira] [Created] (HDFS-4742) Fix appending a renamed file

2013-04-24 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-4742: --- Summary: Fix appending a renamed file Key: HDFS-4742 URL: https://issues.apache.org/jira/browse/HDFS-4742 Project: Hadoop HDFS Issue Type: Sub-task Reporte

[jira] [Resolved] (HDFS-4686) Fix quota computation for rename with snapshots

2013-04-24 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE resolved HDFS-4686. -- Resolution: Fixed Fix Version/s: Snapshot (HDFS-2802) I have committed th

[jira] [Created] (HDFS-4741) TestStorageRestore#testStorageRestoreFailure fails on Windows

2013-04-24 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-4741: --- Summary: TestStorageRestore#testStorageRestoreFailure fails on Windows Key: HDFS-4741 URL: https://issues.apache.org/jira/browse/HDFS-4741 Project: Hadoop HDFS

Re: Heads up - Snapshots feature merge into trunk

2013-04-24 Thread Todd Lipcon
On Fri, Apr 19, 2013 at 3:36 AM, Aaron T. Myers wrote: > On Fri, Apr 19, 2013 at 6:53 AM, Tsz Wo Sze wrote: > > > HdfsAdmin is also for admin operations. However, createSnapshot etc > > methods aren't. > > > > I agree that they're not administrative operations in the sense that they > don't str

[jira] [Resolved] (HDFS-4713) Wrong server principal is used for rpc calls to namenode if HA is enabled

2013-04-24 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-4713. -- Resolution: Won't Fix By requiring "_HOST" to be used, we rely on the rpc server address to guess the s

[jira] [Created] (HDFS-4739) NN can miscalculate the number of extra edit log segments to retain

2013-04-24 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-4739: Summary: NN can miscalculate the number of extra edit log segments to retain Key: HDFS-4739 URL: https://issues.apache.org/jira/browse/HDFS-4739 Project: Hadoop HDFS

Re: Why failed to use Distcp over FTP protocol?

2013-04-24 Thread Daryn Sharp
Listing the root is a bit of a special case that is different than N-many directories deep. Can you list ftp://hadoopadm:@ftphostname/some/dir/file or ftp://hadoopadm:@ftphostname/some/dir? I suspect ftp fs has a bug, so they will fail too. On Apr 23, 2013, at 8:03 PM, sam li

The current/ directory

2013-04-24 Thread Eitan Rosenfeld
Hi all, Two questions: 1. I'd like to store groups of blk_ and .meta files within different partitions alongside the data/current/ folder. I'd like to store only the blk and .meta files in these partitions, leaving out all other directories and files. This would result in the data directory havi

Build failed in Jenkins: Hadoop-Hdfs-trunk #1382

2013-04-24 Thread Apache Jenkins Server
See Changes: [atm] HDFS-4737. JVM path embedded in fuse binaries. Contributed by Sean Mackrory. [vinodkv] YARN-581. Added a test to verify that app delegation tokens are restored after RM restart. Contributed by Jian He. [vinodkv]

Hadoop-Hdfs-trunk - Build # 1382 - Still Failing

2013-04-24 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1382/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 14321 lines...] at sun.reflect.NativeMethodAcces

Jenkins build is back to stable : Hadoop-Hdfs-0.23-Build #591

2013-04-24 Thread Apache Jenkins Server
See