Re: Unable to use ./hdfs dfsadmin -report with HDFS Federation

2015-08-23 Thread EUGEO 2015 
who is this?

On Sun, Aug 23, 2015 at 8:54 PM, Todd  wrote:

> Hi, our hadoop cluster is using HDFS Federation, but when use the
> following command to report the HDFS status
> It gives me the following message that viewfs is NOT HDFS filesystem
> Then how can I proceed to report the hdfs status
> Thanks!
>
> [admin@namenode1]$ ./hdfs dfsadmin -report
> report: FileSystem viewfs://nsX/ is not an HDFS file system
> Usage: hdfs dfsadmin [-report] [-live] [-dead] [-decommissioning]
>
>

Re: Unable to use ./hdfs dfsadmin -report with HDFS Federation

2015-08-23 Thread Akira AJISAKA 
If you want to get the summary from a cluster, I'm thinking you can use 
"-fs" option to specify the NameNode of the cluster. The command will be 
"hdfs dfsadmin -fs hdfs://nn1:port -report".


dfsadmin -report does not support reporting the summary of all the 
cluster mounted on a viewfs.


Regards,
Akira

On 8/24/15 13:45, Brahma Reddy Battula wrote:

To get dfsadmin report in the federated cluster, you need to do
configure core-site.xml like below.( client side)

1) Configure all the nameservices
2) Configure the fs.defaultFS to corresponding name service..

Example:

If we Four name services are running in federated cluster, you can
configure like following..


fs.viewfs.mounttable.ClusterX.link./dir2
hdfs://ns1/dir1



fs.viewfs.mounttable.ClusterX.link./dir3
hdfs://ns2/dir2



fs.viewfs.mounttable.ClusterX.link./dir4
hdfs://ns3/dir3



fs.viewfs.mounttable.ClusterX.link./dir5
hdfs://ns4/dir4


And if you want get admin report for ns1 and configure like below.


fs.defaultFS
hdfs://ns1


Hence it will print details for ns1..


*
For more details check following.*

http://hadoop.apache.org/docs/r2.7.1/hadoop-project-dist/hadoop-hdfs/ViewFs.html


Hope this can answer your query.



Thanks & Regards

Brahma Reddy Battula

*
*


*From:* Todd [bit1...@163.com]
*Sent:* Monday, August 24, 2015 9:33 AM
*To:* user@hadoop.apache.org
*Subject:* Re:RE: Unable to use ./hdfs dfsadmin -report with HDFS Federation


Thanks Chinnappan for the quick reply!
  Looks that the command hdfs dfsadmin -report should work if I want to
see the whole cluster's status. But as you see, I see the message that
view.fs is not   HDFS file system.
If I want to see part of the whole cluster, then how I could go on?
could you please show me the command? Thanks!




At 2015-08-24 11:57:26, "Chinnappan Chandrasekaran"
 wrote:

**

*hdfs dfsadmin –report*

The above command will show entire cluster status

*From:*Todd [mailto:bit1...@163.com ]
*Sent:* Monday, 24 August, 2015 11:54 AM
*To:* user@hadoop.apache.org 
*Subject:* Unable to use ./hdfs dfsadmin -report with HDFS Federation

Hi, our hadoop cluster is using HDFS Federation, but when use the
following command to report the HDFS status
It gives me the following message that viewfs is NOT HDFS filesystem
Then how can I proceed to report the hdfs status
Thanks!

[admin@namenode1]$ ./hdfs dfsadmin -report

report: FileSystem viewfs://nsX/ is not an HDFS file system
Usage: hdfs dfsadmin [-report] [-live] [-dead] [-decommissioning]


__
This email has been scanned by the Symantec Email Security.cloud
service.
For more information please visit http://www.symanteccloud.com
__

/For general enquiries, please contact us at JOS Enquiry Email:
//enqu...@jos.com.sg/ /Hotline: (+65)
6551 9611**/

/For JOS Support, please contact us at JOS Services Email:
//servi...@jos.com.sg/ /Hotline: (+65)
6484 2302/

**

*/A member of the Jardine Matheson Group, Jardine OneSolution is one
of Asia’s leading providers of integrated IT services and solutions
with offices in Singapore, Malaysia, Hong Kong and China. Find out
more about JOS at /**/www.jos.com/* **

*//*
Confidentiality Notice and Disclaimer:
This email (including any attachment to it) is confidential and
intended only for the use of the individual or entity named above
and may contain information that is privileged. If you are not the
intended recipient, you are notified that any dissemination,
distribution or copying of this email is strictly prohibited. If you
have received this email in error, please notify us immediately by
return email or telephone and destroy the original message
(including any attachment to it). Thank you.*//*


__
This email has been scanned by the Symantec Email Security.cloud
service.
Confidentiality Notice and Disclaimer: This email (including any
attachment to it) is confidential and intended only for the use of
the individual or entity named above and may contain information
that is privileged. If you are not the intended recipient, you are
notified that any dissemination, distribution or copying of this
email is strictly prohibited. If you have received this email in
error, please notify us immediately by return email or telephone and
destroy the original message (including any attachment to it). Thank
you.
__

RE: Unable to use ./hdfs dfsadmin -report with HDFS Federation

2015-08-23 Thread Chinnappan Chandrasekaran 

hdfs dfsadmin -report

The above command will show entire cluster status

From: Todd [mailto:bit1...@163.com]
Sent: Monday, 24 August, 2015 11:54 AM
To: user@hadoop.apache.org
Subject: Unable to use ./hdfs dfsadmin -report with HDFS Federation

Hi, our hadoop cluster is using HDFS Federation, but when use the following 
command to report the HDFS status
It gives me the following message that viewfs is NOT HDFS filesystem
Then how can I proceed to report the hdfs status
Thanks!

[admin@namenode1]$ ./hdfs dfsadmin -report
report: FileSystem viewfs://nsX/ is not an HDFS file system
Usage: hdfs dfsadmin [-report] [-live] [-dead] [-decommissioning]

__
This email has been scanned by the Symantec Email Security.cloud service.
For more information please visit http://www.symanteccloud.com
__
[http://img.photobucket.com/albums/v232/RiZZo66/WLAchieverAward2014BampW.jpg]
For general enquiries, please contact us at JOS Enquiry Email: 
enqu...@jos.com.sg Hotline: (+65) 6551 9611
For JOS Support, please contact us at JOS Services Email: 
servi...@jos.com.sg Hotline: (+65) 6484 2302

A member of the Jardine Matheson Group, Jardine OneSolution is one of Asia's 
leading providers of integrated IT services and solutions with offices in 
Singapore, Malaysia, Hong Kong and China. Find out more about JOS at 
www.jos.com

Confidentiality Notice and Disclaimer:
This email (including any attachment to it) is confidential and intended only 
for the use of the individual or entity named above and may contain information 
that is privileged. If you are not the intended recipient, you are notified 
that any dissemination, distribution or copying of this email is strictly 
prohibited. If you have received this email in error, please notify us 
immediately by return email or telephone and destroy the original message 
(including any attachment to it). Thank you.



__
This email has been scanned by the Symantec Email Security.cloud service.
Confidentiality Notice and Disclaimer: This email (including any attachment to 
it) is confidential and intended only for the use of the individual or entity 
named above and may contain information that is privileged.  If you are not the 
intended recipient, you are notified that any dissemination, distribution or 
copying of this email is strictly prohibited.  If you have received this email 
in error, please notify us immediately by return email or telephone and destroy 
the original message (including any attachment to it).  Thank you.
__