[ceph-users] RGW Bucket Notifications and http push-endpoint

I am experimenting with RGW bucket notifications and the simple https endpoint. I have it mostly working expect for the concept of telling RGW that I have received the notification. If I set persistent = False when I issue a put from an s3 compatible client the command “hangs” as I think

[ceph-users] Re: Announcing go-ceph v0.16.0

On Tuesday, June 14, 2022 4:29:59 PM EDT John Mulligan wrote: > I'm happy to announce another release of the go-ceph API library. This is a > regular release following our every-two-months release cadence. > > https://github.com/ceph/go-ceph/releases/tag/v0.64.0 > Eventually I was bound to typo

[ceph-users] Announcing go-ceph v0.16.0

I'm happy to announce another release of the go-ceph API library. This is a regular release following our every-two-months release cadence. https://github.com/ceph/go-ceph/releases/tag/v0.64.0 Changes include additions to the cephfs admin package and rbd package. More details are available at

[ceph-users] Re: Ceph on RHEL 9

I enabled Centos EPEL Next and downloaded the ceph RPMs from https://cbs.centos.org/koji/buildinfo?buildID=39161 - there were a few additional dependencies I had to get for libarrow as well. My history also shows installing thrift as well. This was everything I downloaded and installed

[ceph-users] Re: Ceph Octopus RGW - files vanished from rados while still in bucket index

Hi Eric, oh, the pastebin shows how an available file looks (very small file which got uploaded as multipart). The unavailable file has the "_multipart" rados object missing, everything else is very close. I could have phrased that better. The customer now checked all their files and they are

[ceph-users] Re: Possible to recover deleted files from CephFS?

Thank you, this is extremely helpful! Unfortunately, none of the inodes mentioned in the `stray/` logs are present in the output of `rados -p cephfs_data ls` Am I correct in assuming that this means they’re gone for good? I did shut down the MDS with `ceph fs fail cephfs` when we noticed the

[ceph-users] Re: Possible to recover deleted files from CephFS?

On Tue, Jun 14, 2022 at 8:50 AM Michael Sherman wrote: > > Hi, > > We discovered that a number of files were deleted from our cephfs filesystem, > and haven’t been able to find current backups or snapshots. > > Is it possible to “undelete” a file by modifying metadata? Using >

[ceph-users] Re: Ceph Octopus RGW - files vanished from rados while still in bucket index

Hi Boris, I’m a little confused. The pastebin seems to show that you can stat "ff7a8b0c-07e6-463a-861b-78f0adeba8ad.81095307.17600__multipart_available_file1.pdf.2~ve8VhAEvaRSzAPfacz9rI-aLMpLY_Yw.1”, but I thought it was missing. Can you clarify? The bug has been in RGW for a quite a while,

[ceph-users] Re: How suitable is CEPH for....

> I'm reading and trying to figure out how crazy > is using Ceph for all of the above targets [MySQL] Not crazy at all, it just depends on your performance needs. 16K I/O is not the best Ceph use case, but the snapshot/qcow2 features may justify it. The biggest problem I have with MySQL is that

[ceph-users] Possible to recover deleted files from CephFS?

Hi, We discovered that a number of files were deleted from our cephfs filesystem, and haven’t been able to find current backups or snapshots. Is it possible to “undelete” a file by modifying metadata? Using `cephfs-journal-tool`, I am able to find the `unlink` event for each file, looking

[ceph-users] Re: Changes to Crush Weight Causing Degraded PGs instead of Remapped

I have made https://tracker.ceph.com/issues/56046 regarding the issue I am observing. Respectfully, *Wes Dillingham* w...@wesdillingham.com LinkedIn On Tue, Jun 14, 2022 at 5:32 AM Eugen Block wrote: > I found the thread I was referring to [1].

[ceph-users] How suitable is CEPH for....

Greetings to all great people from Ceph community, I'm currently digging and trying to collect pros and cons of using CEPH for below purposes: - for MySQL server datastore (InnoDB) using Cephfs or rbd. Let's say we have 1 running Mysql server (active) and in case it fails the same InnoDB

[ceph-users] set configuration options in the cephadm age

https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-pg/ talks about changing 'osd_crush_chooseleaf_type' before creating monitors or OSDs, for the special case of a 1-node-cluster. However, the documentation fails to explain how/where to set this option, seeing that with

[ceph-users] Re: something wrong with my monitor database ?

Le 13/06/2022 à 18:37, Stefan Kooman a écrit : CAUTION: This email originated from outside the organization. Do not click links or open attachments unless you recognize the sender and know the content is safe. On 6/13/22 18:21, Eric Le Lay wrote: Those objects are deleted but have

[ceph-users] Re: Changes to Crush Weight Causing Degraded PGs instead of Remapped

I found the thread I was referring to [1]. The report was very similar to yours, apparently the balancer seems to cause the "degraded" messages, but the thread was not concluded. Maybe a tracker ticket should be created if it doesn't already exist, I didn't find a ticket related to that in

[ceph-users] Re: OSD crash with "no available blob id" and check for Zombie blobs

Thanks , we have backport some PR to 12.2.12,but the problem remain.Are there any other fixes? eg: > os/bluestore: apply garbage collection against excessive blob count growth https://github.com/ceph/ceph/pull/28229 AND the ceph-bluestore-tool fsck/repair

[ceph-users] Re: OSD crash with "no available blob id" and check for Zombie blobs

Hi, Many of fixes for "zombie blobs" landed in last Nautilus release I suggest to upgrade to last Nautilus version k > On 14 Jun 2022, at 10:23, tao song wrote: > > I have a old Cluster 12.2.12 running bluestore ,use iscsi + RBD in EC > pools（k:m=2:1） with ec_overwrites flags. Multiple OSD

[ceph-users] OSD crash with "no available blob id" and check for Zombie blobs

I have a old Cluster 12.2.12 running bluestore ,use iscsi + RBD in EC pools（k:m=2:1） with ec_overwrites flags. Multiple OSD crashes occurred due to assert (0 == "no available blob id"). The problems occur periodically when the RBD volume is cyclically overwritten. 2022-05-24 22:08:19.950550

[ceph-users] Re: Copying and renaming pools

You asked for advice in your earlier thread [1] and the recommendation was to simply use a different rule for the images pool to point to the SSDs. That would have prevented what you're now seeing. IIRC the rbd children refer to their parents via pool id (not name) so you would need to