Hey Noah, Yes it does look like an older version 56.6, I got it from the Ubuntu Repo. Is there another method or pull request I can run to get the latest? I am having a hard time finding it.
Thanks On Sun, Aug 4, 2013 at 10:33 PM, Noah Watkins <noah.watk...@inktank.com>wrote: > Hey Scott, > > Things look OK, but I'm a little foggy on what exactly was shipping in > the libcephfs-java jar file back at 0.61. There was definitely a time > where Hadoop and libcephfs.jar in the Debian repos were out of sync, > and that might be what you are seeing. > > Could you list the contents of the libcephfs.jar file, to see if > CephPoolException.class is in there? It might just be that the > libcephfs.jar is out-of-date. > > -Noah > > On Sun, Aug 4, 2013 at 8:44 PM, Scottix <scot...@gmail.com> wrote: > > I am running into an issues connecting hadoop to my ceph cluster and I'm > > sure I am missing something but can't figure it out. > > I have a Ceph cluster with MDS running fine and I can do a basic mount > > perfectly normal. > > I have hadoop fs -ls with basic file:/// working well. > > > > Info: > > ceph cluster version 0.61.7 > > Ubuntu Server 13.04 x86_64 > > hadoop 1.2.1-1 deb install (stable now I did try 1.1.2 same issue) > > libcephfs-java both hadoop-cephfs.jar and libcephfs.jar show up in > "hadoop > > classpath" > > libcephfs-jni with symlink trick > /usr/share/hadoop/lib/native/Linux-amd64-64 > > listed here > > > http://thread.gmane.org/gmane.comp.file-systems.ceph.user/1788/focus=1806 > > and the LD_LIBRARY_PATH in hadoop-env.sh > > > > When I try to setup the ceph mount within Hadoop I get an exception > > > > $ hadoop fs -ls > > Exception in thread "main" java.lang.NoClassDefFoundError: > > com/ceph/fs/CephPoolException > > at > > > org.apache.hadoop.fs.ceph.CephFileSystem.initialize(CephFileSystem.java:96) > > at > > org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1446) > > at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:67) > > at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1464) > > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:263) > > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:124) > > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:247) > > at org.apache.hadoop.fs.Path.getFileSystem(Path.java:187) > > at org.apache.hadoop.fs.FsShell.ls(FsShell.java:583) > > at org.apache.hadoop.fs.FsShell.run(FsShell.java:1812) > > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) > > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79) > > at org.apache.hadoop.fs.FsShell.main(FsShell.java:1916) > > Caused by: java.lang.ClassNotFoundException: > com.ceph.fs.CephPoolException > > > > Followed the tutorial here > > http://ceph.com/docs/next/cephfs/hadoop/ > > > > core-site.xml settings > > ... > > <property> > > <name>fs.ceph.impl</name> > > <value>org.apache.hadoop.fs.ceph.CephFileSystem</value> > > </property> > > <property> > > <name>fs.default.name</name> > > <value>ceph://192.168.1.11:6789</value> > > </property> > > <property> > > <name>ceph.data.pools</name> > > <value>hadoop1</value> > > </property> > > <property> > > <name>ceph.auth.id</name> > > <value>admin</value> > > </property> > > <property> > > <name>ceph.auth.keyfile</name> > > <value>/etc/ceph/admin.secret</value> > > </property> > > > > Any Help Appreciated > > > > _______________________________________________ > > ceph-users mailing list > > ceph-users@lists.ceph.com > > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > > > -- Follow Me: @Scottix <http://www.twitter.com/scottix> http://about.me/scottix scot...@gmail.com
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
