[ceph-users] Public Swift yielding errors since 14.2.12

Hi all, In reference to: https://lists.ceph.io/hyperkitty/list/ceph-users@ceph.io/thread/Y2KTC7RXQYWRA54PVBAMEXSNNBRZUXP7/ We are seeing similar behavior with public Swift bucket access being broken. In this case RadosGW Nautilus integrated to OpenStack Queens Keystone. Public Swift containers

[ceph-users] Re: November Ceph Science User Group Virtual Meeting

Here's the recording in case you missed it: https://www.youtube.com/watch?v=WXtptiLtTCg On Fri, Nov 20, 2020 at 5:44 AM Kevin Hrpcek wrote: > Hey all, > > We will be having a Ceph science/research/big cluster call on Wednesday > November 25th. If anyone wants to discuss something specific they

[ceph-users] high memory usage in osd_pglog

We are seeing very high osd_pglog usage in mempools for ceph osds. For example... "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluestore_alloc_bytes": 41857200, "bluestore_alloc_items": 523215, "bluestore_cache_data_bytes": 50876416,

[ceph-users] Re: replace osd with Octopus

Thank you Eugen for pointing it out. Yes, OSDs are deployed by cephadm with drive_group. It seems that the orch module simplifies the process to make it easier for users. When replacing an osd, there will be no PG remapping, and backfill will restore the data on the new disk, right? In case of re

[ceph-users] Re: Misleading error (osd has already bound to class) when starting osd on nautilus?

This was my first thought too. Is it just this one drive, all drives on this host, or all drives in the cluster? I’m curious if stupid HBA tricks are afoot, if this is a SAS / SATA drive. Especially if it’s a RAID-capable HBA vs passthrough. >>> It might be an issue with the driver then rep

[ceph-users] Re: Planning: Ceph User Survey 2020

Hi Mike, For some of the multiple answer questions like "Which resources do you check when you need help?" could these be ranked answers instead? It would allow to see which resources are more useful to the community On Tue, Nov 24, 2020 at 10:06 AM Mike Perez wrote: > > Hi everyone, > > The Cep

[ceph-users] Re: Planning: Ceph User Survey 2020

Hi Mike, Could we add more questions on RGW usecases and functionality adoption? For instance: bucket notifications: * do you use "bucket notifications"? * if so, which endpoint do you use: kafka, amqp, http? * which other endpoints would you like to see there? sync modules: * do you use the clo

[ceph-users] DocuBetter Meeting Today

There is a general documentation meeting called the "DocuBetter Meeting", and it is held every two weeks. The next DocuBetter Meeting will be on Nov 26, 2020 at 0200 UTC, and will run for thirty minutes. Everyone with a documentation-related request or complaint is invited. The meeting will be held

[ceph-users] Re: Ceph on ARM ?

Just to add our perspective here, I’d like to second Darren’s message here that Ceph is great on ARM. We’re intensely familiar with this as we’ve been running it smoothly for years. We have some very credible customer references that have been running our product at scale for a while. I know the

[ceph-users] uniform and list crush bucket algorithm usage in data centers

Hi all, For placement purposes ceph uses the default straw2 bucket algorithm. I am curious if the other two bucket algorithms like uniform and list are also being used in some present use cases in data centers? Are there any use cases where straw2 is not being used at all ? BR __

[ceph-users] KeyError: 'targets' when adding second gateway on ceph-iscsi - BUG

Hi, I have installed ceph-iscsi on ubuntu 20 manully, But when I want to add second gateway it will show me error: ``` OS: Ubuntu 20 LTS ceph version : octopus I install cluster with ceph-ansible but I install ceph-iscsi manually via following link: https://docs.ceph.com/en/latest/rbd/iscsi-targ

[ceph-users] Re: Ceph on ARM ?

Hi guys, Thank you all for your input. I will try to get my hands on a few Huawei servers for testing before deciding. The specs are really interesting, it looks like they have some power in them besides the high core numbers (2.6 Ghz) : https://en.wikichip.org/wiki/hisilicon/kunpeng/920-64

[ceph-users] Re: Documentation of older Ceph version not accessible anymore on docs.ceph.com

I'll carry this message to the Leadership Team this week and, if Thanksgiving proves an impediment to addressing it, next week. Thanks for raising this concern. Zac Dover Upstream Docs Ceph On Wed, Nov 25, 2020 at 1:43 AM Marc Roos wrote: > > > 2nd that. Why even remove old documentation befor

[ceph-users] Re: Misleading error (osd has already bound to class) when starting osd on nautilus?

Forwarding here in case anyone is seeing the same/similar issue, Amit gave really good pointers and a workaround :) Thanks Amit! On 11/25 16:08, Amit Ghadge wrote: > Yes, and if you want avoid in future update this flag to 0 by $echo 0 > > /sys/block/sdx/queue/rotational > > Thanks > > On We

[ceph-users] Re: Ceph on ARM ?

Sorry, I can't compare. Not used Ceph in anger anywhere else. In our case we were looking for Kubernetes on-premises storage and several points led us to the Ambedded solution. I wouldn't expect them to have the sort of throughput of a full size Xeon server but for our immediate purposes that is no

[ceph-users] Re: replace osd with Octopus

Hi, assuming you deployed with cephadm since you're mentioning Octopus there's a brief section in [1]. The basis for the OSD deployment is the drive_group configuration. If nothing has changed in your setup and you replace an OSD cephadm will detect the available disk and match it with th

[ceph-users] Misleading error (osd has already bound to class) when starting osd on nautilus?

Hi! I have a nautilus ceph cluster, and today I restarted one of the osd daemons and spend some time trying to debug an error I was seeing in the log, though it seems the osd is actually working. The error I was seeing is: ``` Nov 25 09:07:43 osd15 systemd[1]: Starting Ceph object storage daemo

[ceph-users] Re: Ceph on ARM ?

How does ARM compare to Xeon in latency and cluster utilization? -Original Message-; ceph-users Subject: [ceph-users] Re: Ceph on ARM ? Indeed it does run very happily on ARM. We have three of the Mars 400 appliances from Ambedded and they work exceedingly well. 8 micro servers pe

[ceph-users] S3 Object Lock - ceph nautilus

We are running our S3 Ceph Cluster on Nautilus 14.2.9 and want to use features like Object-lock-enabled. A creation of a bucket is possible with: aws s3api create-bucket --bucket locktest --endpoint http://our-s3 --object-lock-enabled-for-bucket & aws s3api put-object-loc

[ceph-users] Re: Ceph on ARM ?

Indeed it does run very happily on ARM. We have three of the Mars 400 appliances from Ambedded and they work exceedingly well. 8 micro servers per chassis. 1 is a MON server and the rest are OSD (or other services). Each micro server is running CentOS 7 and ceph so real easy to maintain. And each c

[ceph-users] Re: Certificate for Dashboard / Grafana

FYI: I've found a solution for the Grafana Certificate. Just run the following commands: 1. ceph config-key set mgr/cephadm/grafana_crt -i ceph config-key set mgr/cephadm/grafana_key -i 2. ceph orch redeploy grafana 3. ceph config set mgr mgr/dashboard/GRAFANA_API_URL https://ceph01.domain.t