Re: [ceph-users] how to use hadoop when system is CephFS
Hi Peng The conf in my cluster is almost the same with yours, but when i run #bin/hadoop fs -ls / It failed with: Exception in thread main java.lang.NoClassDefFoundError: com/ceph/fs/CephFileAlreadyExistsException at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:249) at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:802) at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:847) at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1405) at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66) at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1429) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:254) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:123) at org.apache.hadoop.fs.FsShell.init(FsShell.java:82) at org.apache.hadoop.fs.FsShell.run(FsShell.java:1745) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79) at org.apache.hadoop.fs.FsShell.main(FsShell.java:1895) Caused by: java.lang.ClassNotFoundException: com.ceph.fs.CephFileAlreadyExistsException at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) ... 14 more Is there anyone came across this exception before? How to deal with it? Thanks, Kai At 2013-10-17 19:17:05,鹏 wkp4...@126.com wrote: | Hi all ! I think I suceed using cephFS with hadoop, but I still face lost question for that I am a newer in hadoop and ceph! first, my ceph version is 0.62. java is 1.6.0_45 .hadoop is 1.1.2 I think suceed because: # hadoop fs -ls / drwxrwxrwx - root 0 2013-10-16 10:57 /libcephfs_junit but, when I use the commond hadoop dfsadmin -report, nothing printed on theterminal。 [] #hadoop dfsadmin -report [] # and then , I try some mapreduce's work! #hadoop jar hadoop-examples-1.1.2.jar wordcount /tmp/wordcount/word.txt /tmp/wordcount/out .INFO ceph.CephFileSystem:... ... ..WARN Snappy.Load Dnappy: Snappy native library not loaded. INFO:map 0% reduce 0% and Nothing was print on! I wait for it more then 10 Minute and the word.txt content less the 10 words. by the way, the jps restut is: #jps 2913 secondaryNameNode 17888 TaskTracker 4581 JPS 2974 JobTracker and my hadoop conf is core-site.xml hadoop.tmp.dir = /usr/hadoop/tmp fs.ceph.impl =org.apache.hadoop.fs.ceph.CephFileSystem fs.default.name = ceph://192.168.58.129/ ceph.conf.file = /etc/ceph/ceph.conf mapres-site.xml mapred.job.tracket=http://192.168.58.132:9001 ndfs-site.xml dfs.replication=1 thanks peng | | | | | | ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] how to use hadoop when system is CephFS
Hi Peng, Noah Thanks for your help. Now the hadoop ceph are working now! It takes 11m59.464s to finish MrBenchmark x 50 times. Cheers! Kai At 2013-10-18 06:27:56,Noah Watkins noah.watk...@inktank.com wrote: Kai, It looks like libcephfs-java (the CephFS Java bindings) are not in your classpath. Where did you install them? -Noah On Thu, Oct 17, 2013 at 11:30 PM, log1024 log1...@yeah.net wrote: Hi Peng The conf in my cluster is almost the same with yours, but when i run #bin/hadoop fs -ls / It failed with: Exception in thread main java.lang.NoClassDefFoundError: com/ceph/fs/CephFileAlreadyExistsException at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:249) at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:802) at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:847) at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1405) at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66) at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1429) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:254) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:123) at org.apache.hadoop.fs.FsShell.init(FsShell.java:82) at org.apache.hadoop.fs.FsShell.run(FsShell.java:1745) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79) at org.apache.hadoop.fs.FsShell.main(FsShell.java:1895) Caused by: java.lang.ClassNotFoundException: com.ceph.fs.CephFileAlreadyExistsException at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:306) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) at java.lang.ClassLoader.loadClass(ClassLoader.java:247) ... 14 more Is there anyone came across this exception before? How to deal with it? Thanks, Kai At 2013-10-17 19:17:05,鹏 wkp4...@126.com wrote: | Hi all ! I think I suceed using cephFS with hadoop, but I still face lost question for that I am a newer in hadoop and ceph! first, my ceph version is 0.62. java is 1.6.0_45 .hadoop is 1.1.2 I think suceed because: # hadoop fs -ls / drwxrwxrwx - root 0 2013-10-16 10:57 /libcephfs_junit but, when I use the commond hadoop dfsadmin -report, nothing printed on theterminal。 [] #hadoop dfsadmin -report [] # and then , I try some mapreduce's work! #hadoop jar hadoop-examples-1.1.2.jar wordcount /tmp/wordcount/word.txt /tmp/wordcount/out .INFO ceph.CephFileSystem:... ... ..WARN Snappy.Load Dnappy: Snappy native library not loaded. INFO:map 0% reduce 0% and Nothing was print on! I wait for it more then 10 Minute and the word.txt content less the 10 words. by the way, the jps restut is: #jps 2913 secondaryNameNode 17888 TaskTracker 4581 JPS 2974 JobTracker and my hadoop conf is core-site.xml hadoop.tmp.dir = /usr/hadoop/tmp fs.ceph.impl =org.apache.hadoop.fs.ceph.CephFileSystem fs.default.name = ceph://192.168.58.129/ ceph.conf.file = /etc/ceph/ceph.conf mapres-site.xml mapred.job.tracket=http://192.168.58.132:9001 ndfs-site.xml dfs.replication=1 thanks peng | | | | | | ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] Using Hadoop With Cephfs
Hi,
I have a 4-node Ceph cluster(2 mon, 1 mds, 2 osd) and a Hadoop node.
Currently, I'm trying to replace HDFS with CephFS. I followed the instructions
in USING HADOOP WITH CEPHFS. But every time I run bin/start-all.sh to run
Hadoop, it failed with:
starting namenode, logging to
/usr/local/hadoop/libexec/../logs/hadoop-hduser-namenode-ceph-srv1.out
localhost: starting datanode, logging to
/usr/local/hadoop/libexec/../logs/hadoop-hduser-datanode-ceph-srv1.out
localhost: Exception in thread IPC Client (47) connection to
/172.29.84.56:6789 from hduser java.lang.RuntimeException: readObject can't
find class
localhost: at
org.apache.hadoop.io.ObjectWritable.readObject(ObjectWritable.java:185)
localhost: at
org.apache.hadoop.io.ObjectWritable.readFields(ObjectWritable.java:66)
localhost: at
org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:851)
localhost: at org.apache.hadoop.ipc.Client$Connection.run(Client.java:786)
localhost: Caused by: java.lang.ClassNotFoundException:
localhost: at java.lang.Class.forName0(Native Method)
localhost: at java.lang.Class.forName(Class.java:249)
localhost: at
org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:802)
localhost: at
org.apache.hadoop.io.ObjectWritable.readObject(ObjectWritable.java:183)
My core-site.xml:
configuration
property
nameceph.conf.file/name
value/etc/ceph/ceph.conf/value
/property
property
namefs.default.name/name
valueceph://172.29.84.56:6789//value
/property
property
nameceph.mon.address/name
value172.29.84.56:6789/value
/property
property
nameceph.auth.keyring/name
value/etc/ceph/ceph.client.admin.keyring/value
/property
property
nameceph.data.pools/name
valuehadoop1/value
/property
/configuration
Here is my ceph -s output:
ceph -s
cluster 942afa43-9a92-434b-9dfa-e893d4e5d565
health HEALTH_WARN 16 pgs degraded; 16 pgs stuck unclean; recovery 505/1719
degraded (29.378%); clock skew detected on mon.ceph-srv3
monmap e1: 2 mons at
{ceph-srv2=172.29.84.56:6789/0,ceph-srv3=172.29.84.57:6789/0}, election epoch
12, quorum 0,1 ceph-srv2,ceph-srv3
osdmap e52: 2 osds: 2 up, 2 in
pgmap v33521: 372 pgs: 356 active+clean, 16 active+degraded; 4097 MB data,
8277 MB used, 1384 GB / 1392 GB avail; 505/1719 degraded (29.378%)
mdsmap e17: 1/1/1 up {0=ceph-srv2=up:active}
Can anyone show me how to use hadoop with cephfs correctly?
Thanks,
Kai___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
