Re: [ceph-users] Ceph and hadoop (fstab insted of CephFS)

2016-02-06 Thread Zoltan Arnold Nagy
gt; but i have doubts if any hadoop feature would work bad if replication is > disabled "from the hadoop side". > > THanks! > De: Zoltan Arnold Nagy <zol...@linux.vnet.ibm.com > <mailto:zol...@linux.vnet.ibm.com>> > Enviado: viernes, 05 de febrero de 2016 02:2

Re: [ceph-users] Ceph and hadoop (fstab insted of CephFS)

2016-02-06 Thread Zoltan Arnold Nagy
t;zol...@linux.vnet.ibm.com > <mailto:zol...@linux.vnet.ibm.com>> > Enviado: jueves, 04 de febrero de 2016 06:07 p.m. > Para: John Spray > Cc: Jose M; ceph-users@lists.ceph.com <mailto:ceph-users@lists.ceph.com> > Asunto: Re: [ceph-users] Ceph and hadoop (fstab inste

Re: [ceph-users] Ceph and hadoop (fstab insted of CephFS)

2016-02-05 Thread Jose M
til now with hadoop). De: Zoltan Arnold Nagy <zol...@linux.vnet.ibm.com> Enviado: jueves, 04 de febrero de 2016 06:07 p.m. Para: John Spray Cc: Jose M; ceph-users@lists.ceph.com Asunto: Re: [ceph-users] Ceph and hadoop (fstab insted of CephFS) Might be totally wrong here, but it's not layeri

Re: [ceph-users] Ceph and hadoop (fstab insted of CephFS)

2016-02-04 Thread Zoltan Arnold Nagy
Might be totally wrong here, but it’s not layering them but replacing hdfs:// URLs with ceph:// URLs so all the mapreduce/spark/hbase/whatever is on top can use CephFS directly which is not a bad thing to do (if it works) :-) > On 02 Feb 2016, at 16:50, John Spray wrote: >

Re: [ceph-users] Ceph and hadoop (fstab insted of CephFS)

2016-02-03 Thread Noah Watkins
Hi Jose, I believe what you are referring to is using Hadoop over Ceph via the VFS implementation of the Ceph client vs the user-space libcephfs client library. The current Hadoop plugin for Ceph uses the client library. You could run Hadoop over Ceph using a local Ceph mount point, but it would

[ceph-users] Ceph and hadoop (fstab insted of CephFS)

2016-02-02 Thread Jose M
Hi, One simple question, in the ceph docs says that to use Ceph as an HDFS replacement, I can use the CephFs Hadoop plugin (http://docs.ceph.com/docs/master/cephfs/hadoop/). What I would like to know if instead of using the plugin, I can mount ceph in fstab and then point hdfs dirs

Re: [ceph-users] Ceph and hadoop (fstab insted of CephFS)

2016-02-02 Thread John Spray
On Tue, Feb 2, 2016 at 3:42 PM, Jose M wrote: > Hi, > > > One simple question, in the ceph docs says that to use Ceph as an HDFS > replacement, I can use the CephFs Hadoop plugin > (http://docs.ceph.com/docs/master/cephfs/hadoop/). > > > What I would like to know if