Re: [ceph-users] Cephfs on an EC Pool - What determines object size
Thanks so much for your help! On Mon, Apr 29, 2019 at 6:49 PM Gregory Farnum wrote: > Yes, check out the file layout options: > http://docs.ceph.com/docs/master/cephfs/file-layouts/ > > On Mon, Apr 29, 2019 at 3:32 PM Daniel Williams > wrote: > > > > Is the 4MB configurable? > > > > On Mon, Apr 29, 2019 at 4:36 PM Gregory Farnum > wrote: > >> > >> CephFS automatically chunks objects into 4MB objects by default. For > >> an EC pool, RADOS internally will further subdivide them based on the > >> erasure code and striping strategy, with a layout that can vary. But > >> by default if you have eg an 8+3 EC code, you'll end up with a bunch > >> of (4MB/8=)512KB objects within the OSD. > >> -Greg > >> > >> On Sun, Apr 28, 2019 at 12:42 PM Daniel Williams > wrote: > >> > > >> > Hey, > >> > > >> > What controls / determines object size of a purely cephfs ec (6.3) > pool? I have large file but seemingly small objects. > >> > > >> > Daniel > >> > ___ > >> > ceph-users mailing list > >> > ceph-users@lists.ceph.com > >> > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Cephfs on an EC Pool - What determines object size
Yes, check out the file layout options: http://docs.ceph.com/docs/master/cephfs/file-layouts/ On Mon, Apr 29, 2019 at 3:32 PM Daniel Williams wrote: > > Is the 4MB configurable? > > On Mon, Apr 29, 2019 at 4:36 PM Gregory Farnum wrote: >> >> CephFS automatically chunks objects into 4MB objects by default. For >> an EC pool, RADOS internally will further subdivide them based on the >> erasure code and striping strategy, with a layout that can vary. But >> by default if you have eg an 8+3 EC code, you'll end up with a bunch >> of (4MB/8=)512KB objects within the OSD. >> -Greg >> >> On Sun, Apr 28, 2019 at 12:42 PM Daniel Williams wrote: >> > >> > Hey, >> > >> > What controls / determines object size of a purely cephfs ec (6.3) pool? I >> > have large file but seemingly small objects. >> > >> > Daniel >> > ___ >> > ceph-users mailing list >> > ceph-users@lists.ceph.com >> > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Cephfs on an EC Pool - What determines object size
Is the 4MB configurable? On Mon, Apr 29, 2019 at 4:36 PM Gregory Farnum wrote: > CephFS automatically chunks objects into 4MB objects by default. For > an EC pool, RADOS internally will further subdivide them based on the > erasure code and striping strategy, with a layout that can vary. But > by default if you have eg an 8+3 EC code, you'll end up with a bunch > of (4MB/8=)512KB objects within the OSD. > -Greg > > On Sun, Apr 28, 2019 at 12:42 PM Daniel Williams > wrote: > > > > Hey, > > > > What controls / determines object size of a purely cephfs ec (6.3) pool? > I have large file but seemingly small objects. > > > > Daniel > > ___ > > ceph-users mailing list > > ceph-users@lists.ceph.com > > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Cephfs on an EC Pool - What determines object size
CephFS automatically chunks objects into 4MB objects by default. For an EC pool, RADOS internally will further subdivide them based on the erasure code and striping strategy, with a layout that can vary. But by default if you have eg an 8+3 EC code, you'll end up with a bunch of (4MB/8=)512KB objects within the OSD. -Greg On Sun, Apr 28, 2019 at 12:42 PM Daniel Williams wrote: > > Hey, > > What controls / determines object size of a purely cephfs ec (6.3) pool? I > have large file but seemingly small objects. > > Daniel > ___ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] Cephfs on an EC Pool - What determines object size
Hey, What controls / determines object size of a purely cephfs ec (6.3) pool? I have large file but seemingly small objects. Daniel ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
