[ceph-users] cosbench problem

2019-11-07 Thread 展荣臻(信泰)
Hi all, I am testing my rgw with cosbench. READ/WRITE is successful when worker is less 17 WRITE fail when worker more than 17 I can see ERROR in driver's log(0.4.2.c4/log/libs.log). 2019-11-07 23:46:24,098 [WARN] [Timer-0] org.apache.catalina.startup.DigesterFactory - Could not get url for

Re: [ceph-users] ceph-objectstore-tool crash when trying to recover pg from OSD

2019-11-07 Thread Igor Fedotov
Hi Eugene, this looks like https://tracker.ceph.com/issues/42223 indeed. Would you please find the first crash for these OSDs and share corresponding logs in the ticket. Unfortunately I don't know reliable enough ways to recover OSD after such a failure. If they exist at all... :( I've be

Re: [ceph-users] ceph-objectstore-tool crash when trying to recover pg from OSD

2019-11-07 Thread Brad Hubbard
I'd suggest you open a tracker under the Bluestore component so someone can take a look. I'd also suggest you include a log with 'debug_bluestore=20' added to the COT command line. On Thu, Nov 7, 2019 at 6:56 PM Eugene de Beste wrote: > > Hi, does anyone have any feedback for me regarding this? >

Re: [ceph-users] how to find the lazy egg - poor performance - interesting observations [klartext]

2019-11-07 Thread Stefan Bauer
Thank you Paul. I'm not sure if these low values will be of any help: osd commit_latency(ms) apply_latency(ms)   0  0 0   1  0 0   5  0 0   4  0 0   3 

Re: [ceph-users] how to find the lazy egg - poor performance - interesting observations [klartext]

2019-11-07 Thread Paul Emmerich
You can have a look at subop_latency in "ceph daemon osd.XX perf dump", it tells you how long an OSD took to reply to another OSD. That's usually a good indicator if an OSD is dragging down others. Or have a look at "ceph osd perf dump" which is basically disk latency; simpler to acquire but with l

[ceph-users] how to find the lazy egg - poor performance - interesting observations [klartext]

2019-11-07 Thread Stefan Bauer
Hi folks, we are running a 3 node proxmox-cluster with - of corse - ceph :) ceph version 12.2.12 (39cfebf25a7011204a9876d2950e4b28aba66d11) luminous (stable) 10G network. iperf reports almost 10G between all nodes. We are using mixed standard SSDs (crucial / samsung). We are aware, that

Re: [ceph-users] Ceph install from EL7 repo error

2019-11-07 Thread Salsa
Then try running with "--release nautilus". -- Salsa Sent with [ProtonMail](https://protonmail.com) Secure Email. ‐‐‐ Original Message ‐‐‐ On Wednesday, November 6, 2019 7:30 PM, Cranage, Steve wrote: > No, I’m just running Ceph-deploy install with the one host name. > > Steve Cranage

Re: [ceph-users] ceph-objectstore-tool crash when trying to recover pg from OSD

2019-11-07 Thread Eugene de Beste
Hi, does anyone have any feedback for me regarding this? Here's the log I get when trying to restart the OSD via systemctl: https://pastebin.com/tshuqsLP On Mon, 4 Nov 2019 at 12:42, Eugene de Beste mailto:eug...@sanbi.ac.za)> wrote: > Hi everyone > > I have a cluster that was initially set up wi