Re: [ceph-users] Hadoop on Ceph error

2018-01-18 Thread Bishoy Mikhael 
here is my core-site.xml file




   
  fs.default.name
  ceph://host01:6789/
   
   
  fs.defaultFS
  ceph://host01:6789
   
   
  io.file.buffer.size
  131072
   
   
  hadoop.tmp.dir
  /mnt/hadoop/hadoop_tmp
   
   
  ceph.conf.file
  /etc/ceph/ceph.conf
   
   
  fs.AbstractFileSystem.ceph.impl
  org.apache.hadoop.fs.ceph.CephFs
   
   
  fs.ceph.impl
  org.apache.hadoop.fs.ceph.CephFileSystem
   
   
  ceph.auth.keyring
  /etc/ceph/ceph.client.admin.keyring
   
   
  ceph.object.size
  67108864
   
   
  ceph.data.pools
  hadoop_data
   
   
  ceph.localize.reads
  true
   


here is the permissions for the client keyring

# ls -lh /etc/ceph/ceph.client.admin.keyring

-rw---. 1 root root 137 Jan 12 00:14 /etc/ceph/ceph.client.admin.keyring

here is the permission for ceph.conf

# ls -lh /etc/ceph/ceph.conf

-rw-r--r--. 1 root root 3.0K Jan 12 00:14 /etc/ceph/ceph.conf

how to set debug option in ceph.conf.options with Hadoop xml config file?

On Thu, Jan 18, 2018 at 7:54 PM, Jean-Charles Lopez 
wrote:

> Hi,
>
> What’s your Hadoop xml config file like?
>
> Have you checked the permissions of the ceph.conf and keyring file?
>
> In case all good may be consider setting debug option in ceph.conf.options
> with Hadoop xml config file
>
> JC
>
>
> On Jan 18, 2018, at 16:55, Bishoy Mikhael  wrote:
>
> Hi All,
>
> I've a tiny Ceph 12.2.2 cluster setup with three nodes, 17 OSDs, 3
> MON,MDS,MGR (spanned across the three nodes).
> Hadoop 2.7.3 is configured on only one of the three nodes as follows:
> - Hadoop binaries was extracted to /opt/hadoop/bin/
> - Hadoop config files where at /opt/hadoop/etc/hadoop/
> - Hadoop-cephfs.jar was downloaded from http://download.ceph.com/tarballs/
> to /opt/hadoop/lib/ which the last update to it was on 12-Mar-2013
> - The following symbolic links have been done:
> # ln -s /usr/lib64/libcephfs_jni.so.1.0.0 /usr/lib64/libcephfs_jni.so
> # cp /usr/lib64/libcephfs_jni.so.1.0.0 /opt/hadoop/lib/native/
> # ln -s /opt/hadoop/lib/native/libcephfs_jni.so.1.0.0
> /opt/hadoop/lib/native/libcephfs_jni.so.1
> # ln -s /opt/hadoop/lib/native/libcephfs_jni.so.1.0.0
> /opt/hadoop/lib/native/libcephfs_jni.so
> # ln -s /usr/share/java/libcephfs.jar /opt/hadoop/lib/
> The following modification to Hadoop-config.sh has been done:
>
> */opt/hadoop/libexec/hadoop-config.sh*
> # CLASSPATH initially contains $HADOOP_CONF_DIR
> CLASSPATH="${HADOOP_CONF_DIR}:/opt/hadoop/lib/libcephfs.jar:
> /opt/hadoop/lib/hadoop-cephfs.jar"
>
> So writes and reads to/from Ceph using HDFS CLI works fine, but when I use
> hadoop Java library I get the following error:
>
> ERROR HdfsTraveller:58 - com.ceph.fs.CephNotMountedException: not mounted
>
> fileSystem.globStatus(path)
> FileSystem.globStatus in hdfs api
> ceph returns null pointer
>
> Any idea what's going on? is it a configuration problem? is it a Ceph
> problem? Did anybody see that error before?
>
>
> Regards,
> Bishoy
>
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
>
>
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Hadoop on Ceph error

2018-01-18 Thread Jean-Charles Lopez 
Hi,

What’s your Hadoop xml config file like?

Have you checked the permissions of the ceph.conf and keyring file?

In case all good may be consider setting debug option in ceph.conf.options with 
Hadoop xml config file

JC


> On Jan 18, 2018, at 16:55, Bishoy Mikhael  wrote:
> 
> Hi All,
> 
> I've a tiny Ceph 12.2.2 cluster setup with three nodes, 17 OSDs, 3 
> MON,MDS,MGR (spanned across the three nodes).
> Hadoop 2.7.3 is configured on only one of the three nodes as follows:
> - Hadoop binaries was extracted to /opt/hadoop/bin/
> - Hadoop config files where at /opt/hadoop/etc/hadoop/
> - Hadoop-cephfs.jar was downloaded from http://download.ceph.com/tarballs/ 
>  to /opt/hadoop/lib/ which the last 
> update to it was on 12-Mar-2013
> - The following symbolic links have been done:
> # ln -s /usr/lib64/libcephfs_jni.so.1.0.0 /usr/lib64/libcephfs_jni.so
> # cp /usr/lib64/libcephfs_jni.so.1.0.0 /opt/hadoop/lib/native/
> # ln -s /opt/hadoop/lib/native/libcephfs_jni.so.1.0.0 
> /opt/hadoop/lib/native/libcephfs_jni.so.1
> # ln -s /opt/hadoop/lib/native/libcephfs_jni.so.1.0.0 
> /opt/hadoop/lib/native/libcephfs_jni.so
> # ln -s /usr/share/java/libcephfs.jar /opt/hadoop/lib/
> The following modification to Hadoop-config.sh has been done:
> /opt/hadoop/libexec/hadoop-config.sh
> # CLASSPATH initially contains $HADOOP_CONF_DIR
> CLASSPATH="${HADOOP_CONF_DIR}:/opt/hadoop/lib/libcephfs.jar:/opt/hadoop/lib/hadoop-cephfs.jar"
> 
> So writes and reads to/from Ceph using HDFS CLI works fine, but when I use 
> hadoop Java library I get the following error:
> 
> ERROR HdfsTraveller:58 - com.ceph.fs.CephNotMountedException: not mounted
> 
> fileSystem.globStatus(path)
> FileSystem.globStatus in hdfs api
> ceph returns null pointer
> 
> Any idea what's going on? is it a configuration problem? is it a Ceph 
> problem? Did anybody see that error before?
> 
> 
> Regards,
> Bishoy
> 
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com