[ceph-users] Re: Performance issues with writing files to Ceph via S3 API

2024-02-08 Thread Anthony D'Atri
> On Feb 8, 2024, at 07:05, Renann Prado wrote: > > Hello Anthony, > > Sorry for the late reply. > My thought process behind it was that maybe there's some kind of indexing > that Ceph does under the hood, and perhaps the bucket structure could > influence that. Absolutely, that's why I asked

[ceph-users] Re: Performance issues with writing files to Ceph via S3 API

2024-02-08 Thread Renann Prado
Hello Anthony, Sorry for the late reply. My thought process behind it was that maybe there's some kind of indexing that Ceph does under the hood, and perhaps the bucket structure could influence that. But if you say it's not the case, then I was on the wrong path. Sorry for the daley, but I also

[ceph-users] Re: Performance issues with writing files to Ceph via S3 API

2024-02-03 Thread Anthony D'Atri
The slashes don’t mean much if anything to Ceph. Buckets are not hierarchical filesystems. You speak of millions of files. How many millions? How big are they? Very small objects stress any object system. Very large objects may be multi part uploads that stage to slow media or otherwise ad