[ceph-users] using ceph with hadoop

2013-10-14 Thread 鹏 
|
 


hi all
I follow the mail  configure the ceph with hadoop 
(http://permalink.gmane.org/gmane.comp.file-systems.ceph.user/1809).
1. Install additional packages: libcephfs-java libcephfs-jni  using the 
commonds:
./configure --enable-cephfs-java
make  make install
cp /src/java/libcephfs.jar  /usr/hadoop/lib/
2. Download http://ceph.com/download/hadoop-cephfs.jar
 cp hadoop-cephfs.jar /usr/hadoop/lib
   

  3. Symink JNI library
cd /usr/hadoop/lib/native/Linux-amd64-64 
ln -s /usr/local/lib/libcephfs_jni.so .

   4 vim  core-site.xml 
fs.default.name=ceph://192.168.22.158:6789/
fs.ceph.impl=org.apache.hadoop.fs.ceph.CephFileSystem
ceph.conf.file=/etc/ceph/ceph.conf

and then  
   # hadoop fs -ls
   ls: cannot access . :no such file or directory
#hadoop dfsadmin -report
report:FileSystem ceph://192.168.22.158:6789 is not a distributed file 
System
Usage: java DFSAdmin[-report]
# /usr/hadoop/bin/stop-all.sh
# /usr/hadoop/bin/start-all.sh
   hadoop:Exception in thread IPC Client(47) Connection to 
192.168.58.129:6789 from rwt java.lang.RuntimeException:readObject cant find 
class



 thanks
pengft









|
|
|   |   |
|___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Using ceph with hadoop error

2013-10-14 Thread Noah Watkins 
On Sun, Oct 13, 2013 at 8:28 PM, 鹏 wkp4...@126.com wrote:
  hi all:
 Exception in thread main java.lang.NoClassDefFoundError:
 com/ceph/fs/cephFileAlreadyExisteException
 at java.lang.class.forName0(Native Method)

This looks like a bug, which I'll fixup today. But it shouldn't be
related to the problems you are seeing.

 Caused by :
 java.lang.classNotFoundException:com.ceph.fs.CephFileAlreadyExistsException
  at java.net.URLClassLoader$1.run(URLClassLoader.jar:202)
  at

This looks like you don't have the CephFS Java bindings in a place
that Hadoop can locate. Typically you can stick the libcephfs-jar file
into the lib directory of Hadoop, or add it to your classpath.
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] using ceph with hadoop

2013-10-14 Thread Noah Watkins 
The error below seems to indicate that Hadoop isn't aware of the `ceph://`
file system. You'll need to manually add this to your core-site.xml:

* property** namefs.ceph.impl/name** 
valueorg.apache.hadoop.fs.ceph.CephFileSystem/value** /property*



 report:FileSystem ceph://192.168.22.158:6789 is not a distributed file 
 System
 Usage: java DFSAdmin[-report]
 # /usr/hadoop/bin/stop-all.sh
 # /usr/hadoop/bin/start-all.sh
hadoop:Exception in thread IPC Client(47) Connection to 
 192.168.58.129:6789 from rwt java.lang.RuntimeException:readObject cant find 
 class



  thanks
 pengft









 **




___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[ceph-users] Using ceph with hadoop error

2013-10-13 Thread 鹏 
 hi all:
I configure the ceph with hadoop  system;  when I run the commod
# hadoop fs -ls
It return the  folliws :
Exception in thread main java.lang.NoClassDefFoundError: 
com/ceph/fs/cephFileAlreadyExisteException
at java.lang.class.forName0(Native Method)
.
.
.
Caused by : 
java.lang.classNotFoundException:com.ceph.fs.CephFileAlreadyExistsException
 at java.net.URLClassLoader$1.run(URLClassLoader.jar:202)
 at
 .
 .
 .

what mistake I make!
thank you !
pengft
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com