Re: [ceph-users] Possible improvements for a slow write speed (excluding independent SSD journals)

On Thu, 30 Apr 2015 18:01:44 -0400 Anthony Levesque wrote: > Im planning to setup 4-6 POC in the next 2 week to test various > scenarios here. > > Im checking to get POC with s3610, s3710, p3500(seem to be knew. I know > the lifespam is lower) and maybe P3700 > Don't ignore the S3700, it is fas

Re: [ceph-users] Possible improvements for a slow write speed (excluding independent SSD journals)

Im planning to setup 4-6 POC in the next 2 week to test various scenarios here. Im checking to get POC with s3610, s3710, p3500(seem to be knew. I know the lifespam is lower) and maybe P3700 The speed of the 400GB p3500 seem very nice and the price is alright. The major difference will be th

Re: [ceph-users] Shadow Files

Going to hold off on our 94.1 update for this issue Hopefully this can make it into a 94.2 or a v95 git release. -Ben On Mon, Apr 27, 2015 at 2:32 PM, Ben wrote: > How long are you thinking here? > > We added more storage to our cluster to overcome these issues, and we > can't keep throwing st

Re: [ceph-users] RHEL7/HAMMER cache tier doesn't flush or evict?

On Thu, Apr 30, 2015 at 10:57 AM, Nick Fisk wrote: > I'm using Inkscope to monitor my cluster and looking at the pool details I > saw that mode was set to none. I'm pretty sure there must be a ceph cmd line > to get the option state but I couldn't find anything obvious when I was > looking for it.

Re: [ceph-users] RHEL7/HAMMER cache tier doesn't flush or evict?

Mohamed, Well, that’s interesting… and in direct conflict with what is written in the documentation (wherein it describes relative sizing as proportional to the cache pool’s capacity). I am presently reinstalling, so I’ll give that a

Re: [ceph-users] RHEL7/HAMMER cache tier doesn't flush or evict?

Hi Don, You have to provide the target size through target_max_bytes. target_dirty_ratio and target_full_ratio values are based upon target_max_bytes. If you provide target_max bytes as 200 GB and target_dirty_ratio as 0.4, ceph will start the fulshing, when the cache tier has 60GB of dirty object

Re: [ceph-users] RHEL7/HAMMER cache tier doesn't flush or evict?

OK... When I hit the wall, Ceph got pretty unusable; I haven't figured out how to restore it to health. So to do as you suggest, I am going to have to scrape everything into the trash and try again (3rd time's the charm, right?) - so let me get started on that. I will pause before I run the b

Re: [ceph-users] RHEL7/HAMMER cache tier doesn't flush or evict?

Hi Mohamed, I did not. But: ·I confirmed that (by default) cache_target_dirty_ratio was set to 0.4 (40%) and cache_target_full_ratio was set to 0.8 (80%). ·I did not set target_max_bytes (I felt that the simple, pure relative sizing controls were sufficient for my experiment).

Re: [ceph-users] RHEL7/HAMMER cache tier doesn't flush or evict?

I'm using Inkscope to monitor my cluster and looking at the pool details I saw that mode was set to none. I'm pretty sure there must be a ceph cmd line to get the option state but I couldn't find anything obvious when I was looking for it. > -Original Message- > From: ceph-users [mailto:ce

Re: [ceph-users] Ceph Fuse Crashed when Reading and How to Backup the data

The not permitted bit usually means that your client doesn't have access permissions to the data pool in use. I'm not sure why it would be getting aborted without any output though — is there any traceback at all in the logs? A message about the OOM-killer zapping it or something? -Greg On Thu,

Re: [ceph-users] ceph-dokan mount error

Yup I think you are correct, I see this listed under issues https://github.com/ketor/ceph-dokan/issues/5 On Thu, Apr 30, 2015 at 12:58 PM, Gregory Farnum wrote: > On Thu, Apr 30, 2015 at 9:49 AM, James Devine wrote: >> So I am trying to get ceph-dokan to work. Upon running it with >> ./ceph-dok

Re: [ceph-users] ceph-dokan mount error

On Thu, Apr 30, 2015 at 9:49 AM, James Devine wrote: > So I am trying to get ceph-dokan to work. Upon running it with > ./ceph-dokan.exe -c ceph.conf -l e it indicates there was a mount > error and the monitor it connects to logs cephx server client.admin: > unexpected key: req.key=0 expected_key

Re: [ceph-users] cache pool parameters and pressure

On Thu, Apr 30, 2015 at 2:03 AM, Kenneth Waegeman wrote: > So the cache is empty, but I get warning when I check the health: > health HEALTH_WARN > mds0: Client cephtst.cubone.os failing to respond to cache > pressure > > Someone an idea what is happening here? This means that th

Re: [ceph-users] RHEL7/HAMMER cache tier doesn't flush or evict?

Hi Don, Did you configure target_ dirty_ratio, target_full_ratio and target_max_bytes? K.Mohamed Pakkeer On Thu, Apr 30, 2015 at 10:26 PM, Don Doerner wrote: > All, > > > > Synopsis: I can’t get cache tiering to work in HAMMER on RHEL7. > > > > Process: > > 1. Fresh install of HAMMER on

Re: [ceph-users] RHEL7/HAMMER cache tier doesn't flush or evict?

Hi Nick, For brevity, I didn't detail all of the commands I issued. Looking back through my command history, I can confirm that I did explicitly set cache-mode to writeback (and later reset it to forward to try flush-and-evict). Question: how did you determine that your cache-mode was not wri

Re: [ceph-users] RHEL7/HAMMER cache tier doesn't flush or evict?

Hi Don, I experienced the same thing a couple of days ago on Hammer. On investigation the cache mode wasn't set to writeback even though I'm sure it accepted the command successfully when I set the pool up. Could you reapply the cache mode writeback command and see if that makes a difference? Ni

Re: [ceph-users] Kicking 'Remapped' PGs

On Wed, Apr 29, 2015 at 6:06 PM, Paul Evans wrote: > In one of our clusters we sometimes end up with PGs that are mapped > incorrectly and settle into a ‘remapped’ state (forever). Is there a way to > nudge a specific PG to recalculate placement and relocate the data? One > option that we’re *da

[ceph-users] journal raw partition

I am experimenting with different external journal partitions as raw partitions (no file system). using ceph-deploy osd prepare foo:/mount-point-for-data-partition:journal-partition followed by ceph-deploy osd activate (same arguments) When the specified journal-partition is on an ssd drive

Re: [ceph-users] Upgrade from Giant to Hammer and after some basic operations most of the OSD's went down

Thanks man. I'll try it tomorrow. Have a good one. Br,T Original message From: Sage Weil Date: 30/04/2015 18:23 (GMT+02:00) To: Tuomas Juntunen Cc: ceph-users@lists.ceph.com, ceph-de...@vger.kernel.org Subject: RE: [ceph-users] Upgrade from Giant to Hammer and after some

[ceph-users] RHEL7/HAMMER cache tier doesn't flush or evict?

All, Synopsis: I can't get cache tiering to work in HAMMER on RHEL7. Process: 1. Fresh install of HAMMER on RHEL7 went well. 2. Crush map adapted to provide two "root" level resources a. "ctstorage", to use as a cache tier based on very high-performance, high IOPS SSD (intrins

[ceph-users] ceph-dokan mount error

So I am trying to get ceph-dokan to work. Upon running it with ./ceph-dokan.exe -c ceph.conf -l e it indicates there was a mount error and the monitor it connects to logs cephx server client.admin: unexpected key: req.key=0 expected_key=d7901d515f6b0c61 According to the debug output attached ceph

Re: [ceph-users] Can not access the Ceph's main page ceph.com intermittently

Oh, I'm sorry, I found that it is the China GWF's problem, because I can access the site from my new proxy. So sad for the truth! Thank you! Wenjun Huang 2015-04-30 18:30 GMT+08:00 Milton Suen 孫文東 : > Yes, I think it’s China Great Firewall issue. It works well in Hong > Kong. > > Thanks & Be

Re: [ceph-users] [cephfs][ceph-fuse] cache size or memory leak?

On Thu, Apr 30, 2015 at 4:37 PM, Dexter Xiong wrote: > Hi, > I got these message when I remount: > 2015-04-30 15:47:58.199837 7f9ad30a27c0 -1 asok(0x3c83480) > AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to > bind the UNIX domain socket to '/var/run/ceph/ceph-clien

Re: [ceph-users] Can not access the Ceph's main page ceph.com intermittently

I've got this problem sometimes as well (accessing from Brazil, BTW). The site takes a long time to load and I get some timeouts. But when I try accessing it during the day, it will eventually load. I don't see this problem when I'm using the EU mirror.

Re: [ceph-users] RBD storage pool support in Libvirt not enabled on CentOS

The issue appears to be tracked with the following BZ for RHEL 7: https://bugzilla.redhat.com/show_bug.cgi?id=1187533 -- Jason Dillaman Red Hat dilla...@redhat.com http://www.redhat.com - Original Message - From: "Wido den Hollander" To: "Somnath Roy" , ceph-users@lists.ceph.com

[ceph-users] ceph-deploy with multipath devices

Hi, Tried ceph-deploy with multipath devices; seems like it does not recognize such devices due to certain hardcoded checks in ceph-disk, etc. Has anybody got ceph-deploy to work with multipath devices (/dev/mapper/mpath0, etc). If so, can you provide the steps. Regards, Dhiraj __

[ceph-users] Cache Pool Flush/Eviction Limits - Hard of Soft?

Does anyone know if the Flush and Eviction limits are hard limits, ie as soon as they are exceeded writes will block, or will the pool only block when it reaches Target_max_bytes? I'm see really poor performance and frequent requests are blocked messages once data starts having to be evicted/fl

Re: [ceph-users] Upgrade to Hammer

I think you can take a look at [ceph-ansible][1], and the [rolling_update][2] particularly. And in the upgrade, every thing goes smoothly, except the [dirty data issue][3] bugged me a lot. [1]: https://github.com/ceph/ceph-ansible [2]: https://github.com/ceph/ceph-ansible/blob/master/rolling_

Re: [ceph-users] Can not access the Ceph's main page ceph.com intermittently

Yes, I think it’s China Great Firewall issue. It works well in Hong Kong. Thanks & Best Regards, [cid:4EABB7FB-72B4-47CB-AF26-E521060C19B8] From: Ray Sun Date: Thursday, 30 April, 2015 3:08 pm To: Karan Singh Cc: 黄文俊, "ceph-users@lists.ceph.com" Subject: Re: [ce

Re: [ceph-users] Cache Pool PG Split

> -Original Message- > From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of > Sage Weil > Sent: 29 April 2015 17:46 > To: Nick Fisk > Cc: ceph-users@lists.ceph.com > Subject: Re: [ceph-users] Cache Pool PG Split > > On Wed, 29 Apr 2015, Nick Fisk wrote: > > Hi All, > >

Re: [ceph-users] cache pool parameters and pressure

> -Original Message- > From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of > Kenneth Waegeman > Sent: 30 April 2015 10:03 > To: ceph-users@lists.ceph.com > Subject: [ceph-users] cache pool parameters and pressure > > Hi all, > > I have some question related to the

[ceph-users] Upgrade to Hammer

Hi cephler, how critical is the Upgrade from 0.87.1 to 0.94.1! What is the "best practice method" to upgrade the cluster?? thx best regards ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-cep

Re: [ceph-users] Cost- and Powerefficient OSD-Nodes

If you don't need LACP you could use round-robin bonding mode. With 4x1Gbit NICs you can get a bandwidth of 4Gbit per TCP connection. Either create trunks on stacked switches (e.g. Avaya) or use single switches (e.g. HP 1810-24) and a locally managed MAC address per node/bond. The latter is some

[ceph-users] cache pool parameters and pressure

Hi all, I have some question related to the caching layer. I am using the latest version of ceph: 0.94.1. I created the ceph pool with this options: ceph osd tier add ecdata cache ceph osd tier cache-mode cache writeback ceph osd tier set-overlay ecdata cache ceph osd pool set cache hit_set_ty

Re: [ceph-users] Can not access the Ceph's main page ceph.com intermittently

Second this. An VPN works when you cannot open ceph.com. And FYI, you can use 'eu.ceph.com' to download packages when GFW sucks. On 2015年04月30日 15:08, Ray Sun wrote: I think it's GFW's problem. I think it's ok for me to use a VPN inside a wall. Best Regards -- Ray On Thu, Apr 30, 2015 at 3:00

Re: [ceph-users] Ceph Fuse Crashed when Reading and How to Backup the data

Sorry，I cannot reproduce the "Operation not permitted" log Here is a small portion of log with "debug_client = 20/20" == -22> 2015-04-30 16:29:12.858309 7fe9757f2700 10 client.58272 check_caps on 115.head(ref=2 ll_ref=10 cap_refs

Re: [ceph-users] [cephfs][ceph-fuse] cache size or memory leak?

Hi, I got these message when I remount: 2015-04-30 15:47:58.199837 7f9ad30a27c0 -1 asok(0x3c83480) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/ceph-client.admin.asok': (17) File exists fuse: bad mount point `ceph-fuse

[ceph-users] Ceph Fuse Crashed when Reading and How to Backup the data

When I read the file through the ceph-fuse, the process crashed. Here is the log - terminate called after throwing an instance of 'ceph::buffer::end_of_buffer' what(): buffer::end_of_buffer *** Caught signal (Aborted) ** in thread 7fe0814d3700 ceph version 0.94.1 (e4bfad

[ceph-users] radosgw : Cannot set a new region as default

Hi, I am in the process of setting up radosgw for a firefly ceph-cluster. I have followed the docs for creating alternate region region map and zones. Now I want to delete the default region . Is it possible to do that ? Also I'm not able to promote my new region regeion1 as default region.

Re: [ceph-users] can't delete buckets in radosgw after i recreated the radosgw pools

okay i used the following python client https://github.com/AlexYangYu/s3-cli and created a bucket with the command s3-cli create_bucket MYBUCKET then with radosgw-admin i tried a fix with the following command radosgw-admin --uid=chef bucket check --bucket=MYBUCKET--fix and did the trick i ca

Re: [ceph-users] Can not access the Ceph's main page ceph.com intermittently

I think it's GFW's problem. I think it's ok for me to use a VPN inside a wall. Best Regards -- Ray On Thu, Apr 30, 2015 at 3:00 PM, Karan Singh wrote: > Hi Wenjun > > Are you sure , is everything all right at your end. > > ceph.com seems to be working fine for me from Finland > > **

Re: [ceph-users] Can not access the Ceph's main page ceph.com intermittently

Hi Wenjun Are you sure , is everything all right at your end. ceph.com seems to be working fine for me from Finland Karan Singh Systems Specialist , Storage Platforms CSC - IT Center for Science, Keilaranta 14,