Hi James...
I am assuming that you have properly removed the dead OSDs from the
crush map.
I've tested a scenario like the one you described and realized that pgs
will never leave the creating state until you restart all OSDs.
Have you done that?
Cheers
Goncalo
On 10/15/2015 01:54 AM, J
I don't know enough on ocfs to help. Sounds like you have unconccurent writes
though
Sent from TypeMail
On Oct 15, 2015, 1:53 AM, at 1:53 AM, gjprabu wrote:
>Hi Tyler,
>
>
>
> Can please send me the next setup action to be taken on this issue.
>
>
>
>Regards
>
>Prabu
>
>
>
>
>
> On Wed
I've been trying to find a way to limit the number of request an user
can make the radosgw per unit of time - first thing developers done
here is as fast as possible parallel queries to the radosgw, making it
very slow.
I've looked into quotas, but they only refer to space, objects and buckets.
I
On 15-10-15 13:56, Luis Periquito wrote:
> I've been trying to find a way to limit the number of request an user
> can make the radosgw per unit of time - first thing developers done
> here is as fast as possible parallel queries to the radosgw, making it
> very slow.
>
> I've looked into quotas
Hi all,
I'm trying to upgrade a ceph cluster (prev hammer release) to the last
release of infernalis. So far so good while upgrading the mon servers, all
work fine. But then when trying to upgrade the OSD servers I got an error
while trying to start the osd services again:
What I did is first to
I’m having some trouble with radosgw and keystone integration, I always get the
following error:
user does not hold a matching role; required roles: Member,user,_member_,admin
Despite my token clearly having one of the roles:
"user": {
"id": "401375297eb540bbb1c32432439827b
HI Goncalo,
I removed the OSDs using the commands ceph auth del, ceph osd crush rm, and
ceph osd rm as I have been with other OSDs that have failed. I noticed in the
crushmap that I linked, the removed OSDs were still in the crushmap showing as
"device 2 device2" I tried removing them from the
Hello all,
Does anybody try to use cephfs?
I have two servers with RHEL7.1(latest kernel 3.10.0-229.14.1.el7.x86_64). Each
server has 15G flash for ceph journal and 12*2Tb SATA disk for data.
I have Infiniband(ipoib) 56Gb/s interconnect between nodes.
Cluster version
# ceph -v
ceph version 0.94
On Thu, Oct 15, 2015 at 8:34 AM, Mike Lowe wrote:
> I’m having some trouble with radosgw and keystone integration, I always get
> the following error:
>
> user does not hold a matching role; required roles: Member,user,_member_,admin
>
> Despite my token clearly having one of the roles:
>
>
I think so, unless I misunderstand how it works.
(openstack) role list --user jomlowe --project jomlowe
+--+--+-+-+
| ID | Name | Project | User|
+--+--+-+-
On Thu, Oct 15, 2015 at 5:11 PM, Butkeev Stas wrote:
> Hello all,
> Does anybody try to use cephfs?
>
> I have two servers with RHEL7.1(latest kernel 3.10.0-229.14.1.el7.x86_64).
> Each server has 15G flash for ceph journal and 12*2Tb SATA disk for data.
> I have Infiniband(ipoib) 56Gb/s intercon
I wonder if there are routing issues with IPv6 in the DreamHost cloud?
http://ipv6-test.com/validate.php prints the right IP, but then "web
server is unreachable : Connection timed out"
- Ken
On Thu, Oct 15, 2015 at 12:41 AM, Björn Lässig wrote:
> On 10/14/2015 09:19 PM, Wido den Hollander wrot
Good suggestion! Done: http://download.ceph.com/keys/release.asc
The gitbuilder key is now there also:
http://download.ceph.com/keys/autobuild.asc
- Ken
On Wed, Oct 14, 2015 at 1:22 PM, Wido den Hollander wrote:
> Hi,
>
> Currently the public keys for signing the packages can be found on
> git.
Thank you for your comment. I know what does mean option oflag=direct and other
things about stress testing.
Unfortunately speed is very slow for this cluster FS.
The same test on another cluster FS(GPFS) which consist of 4 disks
# dd if=/dev/zero|pv|dd oflag=direct of=9 bs=4k count=10k
40.
On Thu, Oct 15, 2015 at 8:46 PM, Butkeev Stas wrote:
> Thank you for your comment. I know what does mean option oflag=direct and
> other things about stress testing.
> Unfortunately speed is very slow for this cluster FS.
>
> The same test on another cluster FS(GPFS) which consist of 4 disks
>
>
On Thu, Oct 15, 2015 at 8:17 PM, Butkeev Stas wrote:
> Hello John
>
> Yes, of course, write speed is rising, because we are increasing amount of
> data per one operation by disk.
> But, do you know at least one software which write data by 1Mb blocks? I
> don't know, you too.
Plenty of applicat
Stas,
as you said: "Each server has 15G flash for ceph journal and 12*2Tb
SATA disk for"
What is this 15G flash and is it used for all 12 SATA drives?
On Thu, Oct 15, 2015 at 1:05 PM, John Spray wrote:
> On Thu, Oct 15, 2015 at 8:46 PM, Butkeev Stas wrote:
>> Thank you for your comment. I know
Hello Max,
It is 15G scsi disk which was exported from Flash array to server.
# multipath -ll
X dm-3 XX
size=15G features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
|- 5:0:0:2 sdp 8:240 active ready running
|- 4:0:0:2 sdq 65:0 acti
Yes,The GPFS use option "pagepool" for caching IO.
But my cluster now use tiny piece of the memory for caching. And we can
consider that this cluster doesn't use cache.
# mmlsconfig
Configuration data for cluster XX:
-
myNodeConfigNumber 3
clusterNa
Hello John
Yes, of course, write speed is rising, because we are increasing amount of data
per one operation by disk.
But, do you know at least one software which write data by 1Mb blocks? I don't
know, you too.
Simple test: dd to common 2Tb SATA disk
# dd if=/dev/zero|pv|dd oflag=direct of=
In the Ceph docs, at:
http://docs.ceph.com/docs/master/rados/deployment/ceph-deploy-osd/
It says (under "Prepare OSDs"):
"Note: When running multiple Ceph OSD daemons on a single node, and
sharing a partioned journal with each OSD daemon, you should consider
the entire node the minimum failure d
Did you try to fio test the journal device (direct=1), so you would
have an idea where the system is bounded. For a journal to be
effective it must operate faster than backstore sata. In your case the
journal device must support the needs of 12 SATA drives.
Approximate theoretical limits for 12 SA
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256
ceph df (ceph version 0.94.3-252-g629b631
(629b631488f044150422371ac77dfc005f3de1bc)) is showing some odd
results:
root@nodez:~# ceph df
GLOBAL:
SIZE AVAIL RAW USED %RAW USED
24518G 21670G1602G 6.53
POOLS:
I was not able to trigger eviction using percentage settings. I run
the hot pool into "cluster is full" and the eviction did not start. As
an option a threshold on # of objects did trigger an eviction.
Unfortunately it stalled all the writes to the hot pool until the
eviction was complete.
On Th
> -Original Message-
> From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of
> Robert LeBlanc
> Sent: 15 October 2015 22:06
> To: ceph-users@lists.ceph.com
> Subject: [ceph-users] Cache Tiering Question
>
> -BEGIN PGP SIGNED MESSAGE-
> Hash: SHA256
>
> ceph
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256
hmmm...
http://docs.ceph.com/docs/master/rados/operations/cache-tiering/#relative-sizing
makes it sound like it should be based on the size of the pool and
that you don't have to set anything like max bytes/objects. Can you
confirm that cache_targe
Hi Robert,
yes they do.
Pools don’t have a size when you create them hence the couple value/ratio that
is to be defined for cache tiering mechanism. Pool only have a number of PGs
assigned. So setting the max values and the ratios for dirty and full must be
set explicitly to match your configu
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256
One more question. Is max_{bytes,objects} before or after replication factor?
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Thu, Oct 15, 2015 at 4:42 PM, LOPEZ Jean-Charles wrote:
> Hi Robe
Hi Robert
usable bytes so before replication. The size of the actual original objects you
write.
Cheers
JC
> On 15 Oct 2015, at 16:33, Robert LeBlanc wrote:
>
> -BEGIN PGP SIGNED MESSAGE-
> Hash: SHA256
>
> One more question. Is max_{bytes,objects} before or after replication factor?
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256
Thanks
-
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904 C70E E654 3BB2 FA62 B9F1
On Thu, Oct 15, 2015 at 5:38 PM, JC Lopez wrote:
> Hi Robert
>
> usable bytes so before replication. The size of the actual original object
Hello,
Having run into this myself two days ago (setting relative sizing values
doesn't flush things when expected) I'd say that the documentation is
highly misleading when it comes to the relative settings.
And unclear when it comes to the size/object settings.
Guess this section needs at leas
Hello,
On Thu, 15 Oct 2015 16:55:18 -0400 J David wrote:
> In the Ceph docs, at:
>
> http://docs.ceph.com/docs/master/rados/deployment/ceph-deploy-osd/
>
> It says (under "Prepare OSDs"):
>
> "Note: When running multiple Ceph OSD daemons on a single node, and
> sharing a partioned journal wit
Hello Ceph-users!
This is my first attempt at getting ceph running.
Does the following, in isolation, indicate any potential troubleshooting
directions
# ceph -s
2015-10-15 18:12:45.586529 7fc86041b700 0 -- :/1006343 >>
10.10.20.60:6789/0 pipe(0x7fc85c00d4c0 sd=3 :0 s=1 pgs=0 cs=0 l=1
c=0x7fc85
*cluster info:*
cluster b23b48bf-373a-489c-821a-31b60b5b5af0
health HEALTH_OK
monmap e1: 3 mons at {node1=
192.168.0.207:6789/0,node2=192.168.0.208:6789/0,node3=192.168.0.209:6789/0},
election epoch 24, quorum 0,1,2 node1,node2,node3
mdsmap e42: 2/2/1 up {0=0=up:active,1=1=up:acti
On 10/15/2015 09:40 PM, Ken Dreyer wrote:
I wonder if there are routing issues with IPv6 in the DreamHost cloud?
http://ipv6-test.com/validate.php prints the right IP, but then "web
server is unreachable : Connection timed out"
Getting the same error here.
With sixxs 4 out of 5 wgets are faili
download.ceph.com resolves to 2607:f298:6050:51f3:f816:3eff:fe50:5ec here. Ping
seems to be blocked. Connect to port 80
works every few requests, probably 50%. So I assume there's some load-balancer
there with a dead backend, which the
load-balancer didn't detect/ kick...just guessing. Best Corin
Hi Artie,
Did you check your mon ？ How many monitors in this cluster？
Best wishes,
Mika
2015-10-16 9:23 GMT+08:00 Artie Ziff :
> Hello Ceph-users!
>
> This is my first attempt at getting ceph running.
>
> Does the following, in isolation, indicate any potential troubleshooting
> directions
>
One more thing, did you check the setting of firewall？
Best wishes,
Mika
2015-10-16 14:54 GMT+08:00 Vickie ch :
> Hi Artie,
> Did you check your mon ？ How many monitors in this cluster？
>
>
>
> Best wishes,
> Mika
>
>
> 2015-10-16 9:23 GMT+08:00 Artie Ziff :
>
>> Hello Ceph-users!
>>
>> This
38 matches
Mail list logo
