Re: [ceph-users] Luminous with osd flapping, slow requests when deep scrubbing

2018-10-16 Thread Christian Balzer
Hello, On Tue, 16 Oct 2018 14:09:23 +0100 (BST) Andrei Mikhailovsky wrote: > Hi Christian, > > > - Original Message - > > From: "Christian Balzer" > > To: "ceph-users" > > Cc: "Andrei Mikhailovsky" > > Sent: Tuesday, 16 October, 2018 08:51:36 > > Subject: Re: [ceph-users] Luminous

Re: [ceph-users] Resolving Large omap objects in RGW index pool

2018-10-16 Thread Chris Sarginson
Hi, Having spent some time on the below issue, here are the steps I took to resolve the "Large omap objects" warning. Hopefully this will help others who find themselves in this situation. I got the object ID and OSD ID implicated from the ceph cluster logfile on the mon. I then proceeded to th

Re: [ceph-users] How to debug problem in MDS ?

2018-10-16 Thread Sergey Malinin
Are you running multiple active MDS daemons? On MDS host issue "ceph-daemon mds.X config set debug_mds 20" for maximum logging verbosity. > On 16.10.2018, at 19:23, Florent B wrote: > > Hi, > > A few months ago I sent a message to that list about a problem with a > Ceph + Dovecot setup. > > B

Re: [ceph-users] warning: fast-diff map is invalid operation may be slow; object map invalid

2018-10-16 Thread Jason Dillaman
On Mon, Oct 15, 2018 at 4:04 PM Anthony D'Atri wrote: > > > We turned on all the RBD v2 features while running Jewel; since then all > clusters have been updated to Luminous 12.2.2 and additional clusters added > that have never run Jewel. > > Today I find that a few percent of volumes in each c

Re: [ceph-users] Ceph mds is stuck in creating status

2018-10-16 Thread Kisik Jeong
Oh my god. The network configuration was the problem. Fixing network configuration, I successfully created CephFS. Thank you very much. -Kisik 2018년 10월 16일 (화) 오후 9:58, John Spray 님이 작성: > On Mon, Oct 15, 2018 at 7:15 PM Kisik Jeong > wrote: > > > > I attached osd & fs dumps. There are two poo

[ceph-users] weekly report 41(ifed)

2018-10-16 Thread Igor Fedotov
[read]: [amber]: [green]: * Almost done with: os/bluestore: allow ceph-bluestore-tool to coalesce BlueFS backing volumes [#core] https://github.com/ceph/ceph/pull/23103 Got a preliminary approval from Sage but still working on bringing in the lates

Re: [ceph-users] Disabling RGW Encryption support in Luminous

2018-10-16 Thread Casey Bodley
That's not currently possible, no. And I don't think it's a good idea to add such a feature; if the client requests that something be encrypted, the server should either encrypt it or reject the request. There is a config called rgw_crypt_s3_kms_encryption_keys that we use for testing, though,

Re: [ceph-users] Luminous with osd flapping, slow requests when deep scrubbing

2018-10-16 Thread Andrei Mikhailovsky
Hi Christian, - Original Message - > From: "Christian Balzer" > To: "ceph-users" > Cc: "Andrei Mikhailovsky" > Sent: Tuesday, 16 October, 2018 08:51:36 > Subject: Re: [ceph-users] Luminous with osd flapping, slow requests when deep > scrubbing > Hello, > > On Mon, 15 Oct 2018 12:26:

Re: [ceph-users] Ceph mds is stuck in creating status

2018-10-16 Thread John Spray
On Mon, Oct 15, 2018 at 7:15 PM Kisik Jeong wrote: > > I attached osd & fs dumps. There are two pools (cephfs_data, cephfs_metadata) > for CephFS clearly. And this system's network is 40Gbps ethernet for public & > cluster. So I don't think the network speed would be problem. Thank you. Ah, you

[ceph-users] Disabling RGW Encryption support in Luminous

2018-10-16 Thread Arvydas Opulskis
Hi, got no success on IRC, maybe someone will help me here. After RGW upgrade from Jewel to Luminous, one S3 user started to receive errors from his postgre wal-e solution. Error is like this: "Server Side Encryption with KMS managed key requires HTTP header x-amz-server-side-encryption : aws:kms

Re: [ceph-users] OSD log being spammed with BlueStore stupidallocator dump

2018-10-16 Thread Wido den Hollander
On 10/16/18 11:32 AM, Igor Fedotov wrote: > > > On 10/16/2018 6:57 AM, Wido den Hollander wrote: >> >> On 10/16/2018 12:04 AM, Igor Fedotov wrote: >>> On 10/15/2018 11:47 PM, Wido den Hollander wrote: Hi, On 10/15/2018 10:43 PM, Igor Fedotov wrote: > Hi Wido, > > once

Re: [ceph-users] OSD log being spammed with BlueStore stupidallocator dump

2018-10-16 Thread Igor Fedotov
On 10/16/2018 6:57 AM, Wido den Hollander wrote: On 10/16/2018 12:04 AM, Igor Fedotov wrote: On 10/15/2018 11:47 PM, Wido den Hollander wrote: Hi, On 10/15/2018 10:43 PM, Igor Fedotov wrote: Hi Wido, once you apply the PR you'll probably see the initial error in the log that triggers the

[ceph-users] how can i config pg_num

2018-10-16 Thread xiang . dai
I install a ceph cluster with 8 osds, 3 pools and 1 replication(as osd_pool_default_size) in 2 machines. I follow formula in http://docs.ceph.com/docs/mimic/rados/operations/placement-groups/#choosing-the-number-of-placement-groups to count pg_nu. Then get total pg_num equal to 192, i set eac

Re: [ceph-users] Luminous with osd flapping, slow requests when deep scrubbing

2018-10-16 Thread Christian Balzer
Hello, On Mon, 15 Oct 2018 12:26:50 +0100 (BST) Andrei Mikhailovsky wrote: > Hello, > > I am currently running Luminous 12.2.8 on Ubuntu with 4.15.0-36-generic > kernel from the official ubuntu repo. The cluster has 4 mon + osd servers. > Each osd server has the total of 9 spinning osds and

[ceph-users] ceph pg/pgp number calculation

2018-10-16 Thread Zhenshi Zhou
Hi, I have a cluster serving rbd and cephfs storage for a period of time. I added rgw in the cluster yesterday and wanted it to server object storage. Everything seems good. What I'm confused is how to calculate the pg/pgp number. As we all know, the formula of calculating pgs is: Total PGs = ((