Re: [ceph-users] FW: Ceph data locality

2015-07-07 Thread Dmitry Meytin
ideas how to improve it? Thank you very much, Dmitry -Original Message- From: Lionel Bouton [mailto:lionel+c...@bouton.name] Sent: Tuesday, July 07, 2015 6:07 PM To: Dmitry Meytin Cc: ceph-users@lists.ceph.com Subject: Re: [ceph-users] FW: Ceph data locality Hi Dmitry, On 07/07/15 14

Re: [ceph-users] FW: Ceph data locality

2015-07-07 Thread Dmitry Meytin
To: Dmitry Meytin Cc: ceph-users@lists.ceph.com Subject: Re: [ceph-users] FW: Ceph data locality On 07/07/15 18:20, Dmitry Meytin wrote: Exactly because of that issue I've reduced the number of Ceph replications to 2 and the number of HDFS copies is also 2 (so we're talking about 4 copies). I want

[ceph-users] Ceph data locality

2015-07-07 Thread Dmitry Meytin
Hi, I need a help to configure clients to write data to the primary osd on the local server. I have a cluster with 20 nodes and on each server I have a client which writes/reads data to/from Ceph cluster (typical OpenStack installation with Ceph on each compute node). I see a lot of networking

[ceph-users] FW: Ceph data locality

2015-07-07 Thread Dmitry Meytin
[mailto:rovanleeu...@ebay.com] Sent: Tuesday, July 07, 2015 12:59 PM To: Dmitry Meytin Subject: Re: [ceph-users] Ceph data locality I need a help to configure clients to write data to the primary osd on the local server. I see a lot of networking when VM is trying to read data which was written by the same

Re: [ceph-users] FW: Ceph data locality

2015-07-07 Thread Dmitry Meytin
...@ceph.com Cc: Dmitry Meytin Subject: Re: [ceph-users] FW: Ceph data locality Hello, On Tue, 7 Jul 2015 11:45:11 + Dmitry Meytin wrote: I think it's essential for huge data clusters to deal with data locality. Even very expensive network stack (100Gb/s) will not mitigate the problem

[ceph-users] CephFS as HDFS

2015-04-06 Thread Dmitry Meytin
Hello, I want to use CephFS instead of vanilla HDFS. I have a question in regards to data locality. When I configure the object size (ceph.object.size) as 64MB what will happen with data striping (http://ceph.com/docs/master/architecture/#data-striping), is it still will be striped by unit-size

[ceph-users] CephFS as HDFS

2015-04-06 Thread Dmitry Meytin
Hello, I want to use CephFS instead of vanilla HDFS. I have a question in regards to data locality. When I configure the object size (ceph.object.size) as 64MB what will happen with data striping (http://ceph.com/docs/master/architecture/#data-striping), is it still will be striped by unit-size