Hi Omprakash,
I feel hadoop-hdfs-client-2.8.0.jar is missing in your class path. After 2.7.2 release org.apache.hadoop.hdfs.DistributedFileSystem class is moved from hadoop-hdfs.x.x.x.jar to hadoop-hdfs-client-x.x.x.jar. Regards, Surendra From: omprakash [mailto:ompraka...@cdac.in] Sent: 31 July 2017 18:10 To: Brahma Reddy Battula; 'user' Subject: RE: No FileSystem for scheme: hdfs when using hadoop-2.8.0 jars Hi, I am executing the client from eclipse from my dev machine. The Hadoop cluster is a remote machine. I have added the required jars(including hadoop-hdfs-2.8.0.jar) in the classpath of project. But the issue is still there. I removed and added again but no success. Regards Omprakash From: Brahma Reddy Battula [mailto:brahmareddy.batt...@huawei.com] Sent: 31 July 2017 16:15 To: omprakash <ompraka...@cdac.in<mailto:ompraka...@cdac.in>>; 'user' <user@hadoop.apache.org<mailto:user@hadoop.apache.org>> Subject: RE: No FileSystem for scheme: hdfs when using hadoop-2.8.0 jars Looks jar(hadoop-hdfs-2.8.0.jar) is missing in the classpath.Please check the client classpath. Might be there are no permissions OR missed the this jar while copying..? Reference: org.apache.hadoop.fs.FileSystem#getFileSystemClass if (clazz == null) { throw new UnsupportedFileSystemException("No FileSystem for scheme " + "\"" + scheme + "\""); } --Brahma Reddy Battula From: omprakash [mailto:ompraka...@cdac.in] Sent: 31 July 2017 18:17 To: 'user' Subject: No FileSystem for scheme: hdfs when using hadoop-2.8.0 jars Hi all, I have moved my Hadoop-2.7.0 cluster to 2.8.0 version. I have a client application that uses hdfs to get and store file. But after replacing the 2.7.0 jars with new jars(version 2.8.0) I am facing below exception Exception in thread "main" java.io.IOException: No FileSystem for scheme: hdfs at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2798) at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2809) at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:100) at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2848) at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2830) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:389) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:181) at HadoopTestStubs.HadoopHighAvailabilityTest.main(HadoopHighAvailabilityTest.java:31) Below is the code I am trying to execute import java.io.IOException; import org.apache.hadoop.conf.Configuration; import org.apache.hadoop.fs.FileSystem; import org.apache.hadoop.fs.Path; public class HadoopHighAvailabilityTest { public static void main(String[] args) throws IOException { Configuration conf = new Configuration(false); conf.set("fs.defaultFS", "hdfs://HdfsCluster"); conf.set("fs.default.name", conf.get("fs.defaultFS")); conf.set("dfs.nameservices","HdfsCluster"); conf.set("dfs.ha.namenodes.HdfsCluster", "namenode1,namenode2"); conf.set("dfs.namenode.rpc-address.HdfsCluster.namenode1","node1:8020"); conf.set("dfs.namenode.rpc-address.HdfsCluster.namenode2", "node2:8020"); conf.set("dfs.client.failover.proxy.provider.HdfsCluster","org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider"); printConfigurations(conf); FileSystem fs = FileSystem.get(conf); // Exception here } } What am I doing wrong here? I have checked the core-site.xml file for release 2.8.0. I can see there are change in FileSystem implementation but couldn't figure out why above code is not working. Please help. Regards Omprakash Paliwal ------------------------------------------------------------------------------------------------------------------------------- [ C-DAC is on Social-Media too. Kindly follow us at: Facebook: https://www.facebook.com/CDACINDIA & Twitter: @cdacindia ] This e-mail is for the sole use of the intended recipient(s) and may contain confidential and privileged information. If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies and the original message. Any unauthorized review, use, disclosure, dissemination, forwarding, printing or copying of this email is strictly prohibited and appropriate legal action will be taken. ------------------------------------------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------------------------------------------- [ C-DAC is on Social-Media too. Kindly follow us at: Facebook: https://www.facebook.com/CDACINDIA & Twitter: @cdacindia ] This e-mail is for the sole use of the intended recipient(s) and may contain confidential and privileged information. If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies and the original message. Any unauthorized review, use, disclosure, dissemination, forwarding, printing or copying of this email is strictly prohibited and appropriate legal action will be taken. -------------------------------------------------------------------------------------------------------------------------------
