Re: [ceph-users] Pool shard/stripe settings for file too large files?
Yes, I actually changed it back to the default after reading somewhat about it (https://github.com/ceph/ceph/pull/15520). I wanted to store 5GB and 12GB files, that makes recovery not to nice. I thought there was a setting to split them up automatically like with rbd pools. -Original Message- From: Kevin Hrpcek [mailto:kevin.hrp...@ssec.wisc.edu] Sent: donderdag 9 november 2017 21:09 To: Marc Roos Cc: ceph-users Subject: Re: [ceph-users] Pool shard/stripe settings for file too large files? Marc, If you're running luminous you may need to increase osd_max_object_size. This snippet is from the Luminous change log. "The default maximum size for a single RADOS object has been reduced from 100GB to 128MB. The 100GB limit was completely impractical in practice while the 128MB limit is a bit high but not unreasonable. If you have an application written directly to librados that is using objects larger than 128MB you may need to adjust osd_max_object_size" Kevin On 11/09/2017 02:01 PM, Marc Roos wrote: I would like store objects with rados -p ec32 put test2G.img test2G.img error putting ec32/test2G.img: (27) File too large Changing the pool application from custom to rgw did not help ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Pool shard/stripe settings for file too large files?
Do you know of a rados client that uses this? Maybe a simple 'mount' so I can cp the files on it? -Original Message- From: Christian Wuerdig [mailto:christian.wuer...@gmail.com] Sent: donderdag 9 november 2017 22:01 To: Kevin Hrpcek Cc: Marc Roos; ceph-users Subject: Re: [ceph-users] Pool shard/stripe settings for file too large files? It should be noted that the general advise is to not use such large objects since cluster performance will suffer, see also this thread: http://lists.ceph.com/pipermail/ceph-users-ceph.com/2017-September/021051.html libradosstriper might be an option which will automatically break the object into smaller chunks On Fri, Nov 10, 2017 at 9:08 AM, Kevin Hrpcek wrote: > Marc, > > If you're running luminous you may need to increase osd_max_object_size. > This snippet is from the Luminous change log. > > "The default maximum size for a single RADOS object has been reduced > from 100GB to 128MB. The 100GB limit was completely impractical in > practice while the 128MB limit is a bit high but not unreasonable. If > you have an application written directly to librados that is using > objects larger than 128MB you may need to adjust osd_max_object_size" > > Kevin > > On 11/09/2017 02:01 PM, Marc Roos wrote: > > > I would like store objects with > > rados -p ec32 put test2G.img test2G.img > > error putting ec32/test2G.img: (27) File too large > > Changing the pool application from custom to rgw did not help > > > > > > > > > > ___ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > > > > ___ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Pool shard/stripe settings for file too large files?
It should be noted that the general advise is to not use such large objects since cluster performance will suffer, see also this thread: http://lists.ceph.com/pipermail/ceph-users-ceph.com/2017-September/021051.html libradosstriper might be an option which will automatically break the object into smaller chunks On Fri, Nov 10, 2017 at 9:08 AM, Kevin Hrpcek wrote: > Marc, > > If you're running luminous you may need to increase osd_max_object_size. > This snippet is from the Luminous change log. > > "The default maximum size for a single RADOS object has been reduced from > 100GB to 128MB. The 100GB limit was completely impractical in practice while > the 128MB limit is a bit high but not unreasonable. If you have an > application written directly to librados that is using objects larger than > 128MB you may need to adjust osd_max_object_size" > > Kevin > > On 11/09/2017 02:01 PM, Marc Roos wrote: > > > I would like store objects with > > rados -p ec32 put test2G.img test2G.img > > error putting ec32/test2G.img: (27) File too large > > Changing the pool application from custom to rgw did not help > > > > > > > > > > ___ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > > > > ___ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] Pool shard/stripe settings for file too large files?
Marc, If you're running luminous you may need to increase osd_max_object_size. This snippet is from the Luminous change log. "The default maximum size for a single RADOS object has been reduced from 100GB to 128MB. The 100GB limit was completely impractical in practice while the 128MB limit is a bit high but not unreasonable. If you have an application written directly to librados that is using objects larger than 128MB you may need to adjust osd_max_object_size" Kevin On 11/09/2017 02:01 PM, Marc Roos wrote: I would like store objects with rados -p ec32 put test2G.img test2G.img error putting ec32/test2G.img: (27) File too large Changing the pool application from custom to rgw did not help ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
