Re: [ceph-users] Is there a limit for object size in CephFS?

4.0.6-300.fc22.x86_64 On Tue, Aug 11, 2015 at 10:24 PM, Yan, Zheng wrote: > On Wed, Aug 12, 2015 at 5:33 AM, Hadi Montakhabi wrote: > >> ​​ >> [sequential read] >> readwrite=read >> size=2g >> directory=/mnt/mycephfs >> ioengine=libaio >>

Re: [ceph-users] Is there a limit for object size in CephFS?

/mycephfs ioengine=libaio direct=1 blocksize=${BLOCKSIZE} numjobs=1 iodepth=1 invalidate=1 On Sun, Aug 9, 2015 at 9:27 PM, Yan, Zheng wrote: > > On Sun, Aug 9, 2015 at 8:57 AM, Hadi Montakhabi wrote: > >> I am using fio. >> I use the kernel module to Mount CephFS. >> > &g

Re: [ceph-users] Is there a limit for object size in CephFS?

I am using fio. I use the kernel module to Mount CephFS. On Aug 8, 2015 10:52 AM, "Ketor D" wrote: > Hi Haidi, > Which bench tool do you use? And how you mount CephFS, ceph-fuse or > kernel-cephfs? > > On Fri, Aug 7, 2015 at 11:50 PM, Hadi Montakhabi wrote: >

[ceph-users] Is there a limit for object size in CephFS?

Hello Cephers, I am benchmarking CephFS. In one of my experiments, I change the object size. I start from 64kb. Everytime I do different block size reads and writes. By increasing the object size to 64MB and increasing the block size to 64MB, CephFS crashes (shown in the chart below). What I mean

[ceph-users] CephFS vs RBD

Hello Cephers, I've been experimenting with CephFS and RBD for some time now. >From what I have seen so far, RBD outperforms CephFS by far. However, there is a catch! RBD could be mounted on one client at a time! Now, assuming that we have multiple clients running some MPI code (and doing some dis

Re: [ceph-users] client io doing unrequested reads

client to get you out of it. You are absolutely right. It goes away when I reboot the client node. Thanks, Hadi On Tue, Jul 21, 2015 at 4:57 PM, John Spray wrote: > > > On 21/07/15 21:54, Hadi Montakhabi wrote: > > Hello Cephers, > > I am using CephFS, and running som

[ceph-users] client io doing unrequested reads

Hello Cephers, I am using CephFS, and running some benchmarks using fio. After increasing the object_size to 33554432, when I try to run some read and write tests with different block sizes, when I get to block size of 64m and beyond, Ceph does not finish the operation (I tried letting it run for

Re: [ceph-users] Cannot map rbd image with striping!

un...@lists.ceph.com] *On Behalf > Of *Hadi Montakhabi > *Sent:* Wednesday, July 08, 2015 12:56 PM > *To:* ceph-users@lists.ceph.com > *Subject:* [ceph-users] Cannot map rbd image with striping! > > > > Hi Cephers, > > > > Here is the problem I am facing. > >

[ceph-users] Cannot map rbd image with striping!

Hi Cephers, Here is the problem I am facing. I would like to use striping feature with rbd. When I create an image with striping arguments defined, I cannot map it: [cephuser@node01 ~]$ rbd create ceph-client0-rbd0 --image-format 2 --size 10240 --stripe-unit 65536 --stripe-count 4 [cephuser@node0

Re: [ceph-users] Difference between CephFS and RBD

tiple > machines, then CephFS is your best bet. If you want to store a disk image, > perhaps for use with virtual machines, then you want RBD. If you want > storage that is mostly compatible with Amazon's S3, then use radosgw. > > On Mon, Jul 6, 2015 at 8:04 AM Hadi Montakhabi

[ceph-users] Difference between CephFS and RBD

Hello Cephers, I can't quite grasp the difference between CephFS and Rados Block Device (RBD). In both cases we do mount the storage on the client and it is using the storage from the storage cluster. Would someone explain it to me like I am five please? Thanks, Hadi _

[ceph-users] How to use different Ceph interfaces?

How could I use ceph different interfaces? Here is what I understand so far. Please correct me if I am mistaken. 1. Ceph Object Gatewa y: I am assuming the only way to use it is to utilize the API. 2. Ceph Block Devic: Here is where I am not very clear. I

[ceph-users] Simple CephFS benchmark

I have set up a ceph storage cluster and I'd like to utilize the cephfs (I am assuming this is the only way one could use some other code without using the API). To do so, I have mounted my cephfs on the client node. I'd like to know what would be a good benchmark for measuring write and read perfo