[ceph-users] [Ceph Admin & Monitoring] Inkscope is back

[ghislain.chevalier]

Hi,

Inkscope, a ceph admin and monitoring GUI, is still alive.
It can be now installed with an ansible playbook.
https://github.com/inkscope/inkscope-ansible

Best regards
- - - - - - - - - - - - - - - - - 
Ghislain Chevalier 
ORANGE/IMT/OLS/DIESE/LCP/DDSD
Software-Defined Storage Architect
 +33299124432
 +33788624370


_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Federated gateways

[ghislain.chevalier]

Hi,

We did a PoC at Orange and encountered some difficulties in configurating 
federation.

Can you check that placements  targets are identical on each zone?

brgds

De : ceph-users [mailto:ceph-users-boun...@lists.ceph.com] De la part de 
wd_hw...@wistron.com
Envoyé : vendredi 6 novembre 2015 03:01
À : cle...@centraldesktop.com
Cc : ceph-users@lists.ceph.com
Objet : Re: [ceph-users] Federated gateways

Hi Craig,
I am testing the federated gateway of 1 region with 2 zones. And I found only 
metadata is replicated, the data is NOT.
According to your check list, I am sure all thinks are checked. Could you 
review my configuration scripts? The configuration files are similar to 
http://docs.ceph.com/docs/master/radosgw/federated-config/.

1. For the master zone with 5 nodes of the region
(1) create keyring
  sudo ceph-authtool --create-keyring /etc/ceph/ceph.client.radosgw.keyring
  sudo chmod +r /etc/ceph/ceph.client.radosgw.keyring
  sudo ceph-authtool /etc/ceph/ceph.client.radosgw.keyring -n 
client.radosgw.us-east-1 --gen-key
  sudo ceph-authtool /etc/ceph/ceph.client.radosgw.keyring -n 
client.radosgw.us-west-1 --gen-key
  sudo ceph-authtool -n client.radosgw.us-east-1 --cap osd 'allow rwx' --cap 
mon 'allow rwx' /etc/ceph/ceph.client.radosgw.keyring
  sudo ceph-authtool -n client.radosgw.us-west-1 --cap osd 'allow rwx' --cap 
mon 'allow rwx' /etc/ceph/ceph.client.radosgw.keyring
  sudo ceph -k /etc/ceph/ceph.client.admin.keyring auth add 
client.radosgw.us-east-1 -i /etc/ceph/ceph.client.radosgw.keyring
  sudo ceph -k /etc/ceph/ceph.client.admin.keyring auth add 
client.radosgw.us-west-1 -i /etc/ceph/ceph.client.radosgw.keyring

(2) modify Ceph cluster configurations and synchronize it
  ceph-deploy --overwrite-conf config push node1 node2 node3 node4 node5

(3) configure Apache
(4) configure region
  sudo apt-get install -y radosgw radosgw-agent python-pip
  sudo radosgw-admin region set --infile /home/ceph/us.json --name 
client.radosgw.us-east-1
  sudo radosgw-admin region set --infile /home/ceph/us.json --name 
client.radosgw.us-west-1
  sudo rados -p .us.rgw.root rm region_info.default
  sudo radosgw-admin region default --rgw-region=us --name 
client.radosgw.us-east-1
  sudo radosgw-admin region default --rgw-region=us --name 
client.radosgw.us-west-1
  sudo radosgw-admin regionmap update --name client.radosgw.us-east-1
  sudo radosgw-admin regionmap update --name client.radosgw.us-west-1

(5) create master zone
  sudo radosgw-admin zone set --rgw-zone=us-east --infile 
/home/ceph/us-east.json --name client.radosgw.us-east-1
  sudo radosgw-admin zone set --rgw-zone=us-east --infile 
/home/ceph/us-east.json --name client.radosgw.us-west-1
  sudo radosgw-admin zone set --rgw-zone=us-west --infile 
/home/ceph/us-west.json --name client.radosgw.us-east-1
  sudo radosgw-admin zone set --rgw-zone=us-west --infile 
/home/ceph/us-west.json --name client.radosgw.us-west-1
  sudo rados -p .rgw.root rm zone_info.default
  sudo radosgw-admin regionmap update --name client.radosgw.us-east-1
  sudo radosgw-admin regionmap update --name client.radosgw.us-west-1

(6) create master zone's users
  sudo radosgw-admin user create --uid="us-east" --display-name="Region-us 
Zone-East" --name client.radosgw.us-east-1 --system --access_key=us_access_key 
--secret=us_secret_key
  sudo radosgw-admin user create --uid="us-west" --display-name="Region-us 
Zone-West" --name client.radosgw.us-west-1 --system --access_key=us_access_key 
--secret=us_secret_key

(7) restart Ceph & apache2 & radosgw services



2. For the secondary zone with 5 nodes of the region
(1) copy the keyring file 'ceph.client.radosgw.keyring' from master zone and 
import the keyring
  sudo ceph -k /etc/ceph/ceph.client.admin.keyring auth add 
client.radosgw.us-east-1 -i /etc/ceph/ceph.client.radosgw.keyring
  sudo ceph -k /etc/ceph/ceph.client.admin.keyring auth add 
client.radosgw.us-west-1 -i /etc/ceph/ceph.client.radosgw.keyring

(2) modify Ceph cluster configurations and synchronize it
ceph-deploy --overwrite-conf config push node1 node2 node3 node4 node5

(3) configure Apache
(4) copy infile '/home/ceph/us.json' for the master zone and create 'us' region
  sudo apt-get install -y radosgw radosgw-agent python-pip
  sudo radosgw-admin region set --infile /home/ceph/us.json --name 
client.radosgw.us-east-1
  sudo radosgw-admin region set --infile /home/ceph/us.json --name 
client.radosgw.us-west-1
  sudo radosgw-admin region default --rgw-region=us --name 
client.radosgw.us-east-1
  sudo radosgw-admin region default --rgw-region=us --name 
client.radosgw.us-west-1
  sudo radosgw-admin regionmap update --name client.radosgw.us-east-1
  sudo radosgw-admin regionmap update --name client.radosgw.us-west-1

(5) create secondary one
  sudo radosgw-admin zone set --rgw-zone=us-east --infile 
/home/ceph/us-east.json --name client.radosgw.us-east-1
  sudo radosgw-admin zone set --rgw-zone=us-east --infile 
/home/ceph/us-east.json --name 

Re: [ceph-users] RGW pool contents

[ghislain.chevalier]

Hi,
Did you try to use the cleanup and dispose steps of cosbench?
brgds

De : ceph-users [mailto:ceph-users-boun...@lists.ceph.com] De la part de 
Somnath Roy
Envoyé : mardi 24 novembre 2015 20:49
À : ceph-users@lists.ceph.com
Objet : [ceph-users] RGW pool contents

Hi Yehuda/RGW experts,
I have one cluster with RGW up and running in the customer site.
I did some heavy performance testing on that with CosBench and as a result 
written significant amount of data to showcase performance on that.
Over time, customer also wrote significant amount of data using S3 api into the 
cluster.
Now, I want to remove the buckets/objects created by CosBench and need some 
help on that.
I ran the following command to list the buckets.

"radosgw-admin bucket list"

The output is the following snippet..

"rgwdef42",
"rgwdefghijklmnop79",
"rgwyzabc43",
"rgwdefgh43",
"rgwdefghijklm200",

..
..

My understanding is , cosbench should create containers with "mycontainers_" 
 and objects with format "myobjects_" prefix (?). But, it's not there in the 
output of the above command.

Next, I tried to list the contents of the different rgw pools..

rados -p .rgw.buckets.index ls

.dir.default.5407.17
.dir.default.6063.24
.dir.default.6068.23
.dir.default.6046.7
.dir.default.6065.44
.dir.default.5409.3
...
...

Nothing with rgw prefix...Shouldn't the bucketindex objects having similar 
prefix with bucket names ?


Now, tried to get the actual objects...
rados -p .rgw.buckets ls

default.6662.5_myobjects57862
default.5193.18_myobjects6615
default.5410.5_myobjects68518
default.6661.8_myobjects7407
default.5410.22_myobjects54939
default.6651.6_myobjects23790


...

So, looking at these, it seems cosbench run is creating the .dir.default.* 
buckets and the default._myobjects* objects (?)

But, these buckets are not listed by the first "radosgw-admin" command, why ?

Next, I listed the contents of the .rgw pool and here is the output..

rados -p .rgw ls

.bucket.meta.rgwdefghijklm78:default.6069.18
rgwdef42
rgwdefghijklmnop79
rgwyzabc43
.bucket.meta.rgwdefghijklmnopqr71:default.6655.3
rgwdefgh43
.bucket.meta.rgwdefghijklm119:default.6066.25
rgwdefghijklm200
.bucket.meta.rgwxghi2:default.5203.4
rgwxjk17
rgwdefghijklm196

...
...

It seems this pool has the buckets listed by the radosgw-admin command.

Can anybody explain what is .rgw pool supposed to contain ?

Also, what is the difference between .users.uid and .users pool ?


Appreciate any help on this.

Thanks & Regards
Somnath

_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] [Ceph] Not able to use erasure code profile

[ghislain.chevalier]

Hi Quentin
Did you check the pool was correctly created
(Pg allocation)?

Envoyé de mon Galaxy Ace4 Orange


 Message d'origine 
De : quentin.d...@orange.com
Date :17/12/2015 19:45 (GMT+01:00)
À : ceph-users@lists.ceph.com
Cc :
Objet : [ceph-users] [Ceph] Not able to use erasure code profile

Hello,

I try to use the default erasure code profile in Ceph 
(v0.80.9-0ubuntu0.14.04.2).
I have created the following pool :

$ ceph osd pool create defaultpool 12 12 erasure

And try to put a file in like this :

$rados --pool=defaultpool put test test.tar

But I am blocked in the process and need a ctrl+c to end.
Here is the debug information (debug ms = 5/5) :

2015-08-04 17:45:59.605003 7f781899a7c0  1 -- :/0 messenger.start
2015-08-04 17:45:59.607497 7f781899a7c0  1 -- :/1014044 --> 127.0.0.1:6789/0 -- 
auth(proto 0 30 bytes epoch 0) v1 -- ?+0 0x7f781ab47260 con 0x7f781ab46dd0
2015-08-04 17:45:59.607936 7f7818992700  1 -- 127.0.0.1:0/1014044 learned my 
addr 127.0.0.1:0/1014044
2015-08-04 17:45:59.608517 7f7813af5700  1 -- 127.0.0.1:0/1014044 <== mon.0 
127.0.0.1:6789/0 1  mon_map v1  191+0+0 (1947850903 0 0) 0x7f7808000ab0 
con 0x7f781ab46dd0
2015-08-04 17:45:59.611547 7f7813af5700  1 -- 127.0.0.1:0/1014044 <== mon.0 
127.0.0.1:6789/0 2  auth_reply(proto 1 0 (0) Success) v1  24+0+0 
(2103380028 0 0) 0x7f7808000e50 con 0x7f781ab46dd0
2015-08-04 17:45:59.611628 7f7813af5700  1 -- 127.0.0.1:0/1014044 --> 
127.0.0.1:6789/0 -- mon_subscribe({monmap=0+}) v2 -- ?+0 0x7f781ab47870 con 
0x7f781ab46dd0
2015-08-04 17:45:59.611822 7f781899a7c0  1 -- 127.0.0.1:0/1014044 --> 
127.0.0.1:6789/0 -- mon_subscribe({monmap=2+,osdmap=0}) v2 -- ?+0 
0x7f781ab485f0 con 0x7f781ab46dd0
2015-08-04 17:45:59.611830 7f781899a7c0  1 -- 127.0.0.1:0/1014044 --> 
127.0.0.1:6789/0 -- mon_subscribe({monmap=2+,osdmap=0}) v2 -- ?+0 
0x7f781ab48b50 con 0x7f781ab46dd0
2015-08-04 17:45:59.612800 7f7813af5700  1 -- 127.0.0.1:0/1014044 <== mon.0 
127.0.0.1:6789/0 3  mon_map v1  191+0+0 (1947850903 0 0) 0x7f7808000ab0 
con 0x7f781ab46dd0
2015-08-04 17:45:59.612891 7f7813af5700  1 -- 127.0.0.1:0/1014044 <== mon.0 
127.0.0.1:6789/0 4  mon_subscribe_ack(300s) v1  20+0+0 (3912512126 0 0) 
0x7f7808000ab0 con 0x7f781ab46dd0
2015-08-04 17:45:59.612977 7f7813af5700  1 -- 127.0.0.1:0/1014044 <== mon.0 
127.0.0.1:6789/0 5  osd_map(80..80 src has 1..80) v3  10805+0+0 
(3315356140 0 0) 0x7f7808003480 con 0x7f781ab46dd0
2015-08-04 17:45:59.613338 7f781899a7c0  1 -- 127.0.0.1:0/1014044 --> 
127.0.0.1:6789/0 -- mon_subscribe({monmap=2+,osdmap=81}) v2 -- ?+0 
0x7f781ab49380 con 0x7f781ab46dd0
2015-08-04 17:45:59.613550 7f7813af5700  1 -- 127.0.0.1:0/1014044 <== mon.0 
127.0.0.1:6789/0 6  mon_subscribe_ack(300s) v1  20+0+0 (3912512126 0 0) 
0x7f7808000a30 con 0x7f781ab46dd0
2015-08-04 17:45:59.615178 7f7813af5700  1 -- 127.0.0.1:0/1014044 <== mon.0 
127.0.0.1:6789/0 7  osd_map(80..80 src has 1..80) v3  10805+0+0 
(3315356140 0 0) 0x7f7808003450 con 0x7f781ab46dd0
2015-08-04 17:45:59.615257 7f7813af5700  1 -- 127.0.0.1:0/1014044 <== mon.0 
127.0.0.1:6789/0 8  mon_subscribe_ack(300s) v1  20+0+0 (3912512126 0 0) 
0x7f7808000a30 con 0x7f781ab46dd0
2015-08-04 17:45:59.615449 7f7813af5700  1 -- 127.0.0.1:0/1014044 <== mon.0 
127.0.0.1:6789/0 9  mon_subscribe_ack(300s) v1  20+0+0 (3912512126 0 0) 
0x7f7808000a30 con 0x7f781ab46dd0
2015-08-04 17:46:04.612263 7f78119f0700  1 -- 127.0.0.1:0/1014044 --> 
127.0.0.1:6789/0 -- mon_subscribe({monmap=2+,osdmap=81}) v2 -- ?+0 
0x7f77f4000a00 con 0x7f781ab46dd0
2015-08-04 17:46:04.612837 7f7813af5700  1 -- 127.0.0.1:0/1014044 <== mon.0 
127.0.0.1:6789/0 10  mon_subscribe_ack(300s) v1  20+0+0 (3912512126 0 
0) 0x7f7808000a30 con 0x7f781ab46dd0
^C

But if I use a replicated pool, it works fine, I can put and get correctly the 
file using the same command.

Is there something particular to set in ceph.conf to be able to use erasure 
code plugin ?
Sorry if it’s a newby question, but I start with ceph.

Best regards.

_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have 

Re: [ceph-users] Placement rule not resolved

[ghislain.chevalier]

Hi Robert,

Sorry for replying late

We finally use a step take at root on the production  platform
Even if I tested a rule on the sandbox platform with a step take at a non-root 
level ... and it works.

Brgds

-Message d'origine-
De : Robert LeBlanc [mailto:rob...@leblancnet.us] 
Envoyé : mardi 6 octobre 2015 17:55
À : CHEVALIER Ghislain IMT/OLPS
Cc : ceph-users
Objet : Re: [ceph-users] Placement rule not resolved

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256

I've only done a 'step take ' where  is a root entry. I haven't tried with it 
being under the root. I would suspect it would work, but you can try to put 
your tiers in a root section and test it there.
- 
Robert LeBlanc
PGP Fingerprint 79A2 9CA4 6CC4 45DD A904  C70E E654 3BB2 FA62 B9F1


On Tue, Oct 6, 2015 at 6:18 AM,   wrote:
> Hi,
>
>
>
> Context:
>
> Firefly 0.80.9
>
> 8 storage nodes
>
> 176 osds : 14*8 sas and 8*8 ssd
>
> 3 monitors
>
>
>
> I create an alternate crushmap in order to fulfill tiering requirement i.e.
> select ssd or sas.
>
> I created specific buckets “host-ssd” and “host-sas” and regroup them 
> in “tier-ssd” and “tier-sas” under a “tier-root”
>
> E.g. I want to select 1 ssd in 3 distinct hosts
>
>
>
> I don’t understand why the placement rule for sas is working and not 
> for ssd.
>
> Sas are selected even if ,according to the crushmap,  they are not in 
> the right tree.
>
> When sometimes 3 ssd are selected, the pgs stay stuck but active
>
>
>
> I attached the crushmap and ceph osd tree.
>
>
>
> Can someone have a look and tell me where the default is?
>
>
>
> Bgrds
>
> - - - - - - - - - - - - - - - - -
> Ghislain Chevalier
> ORANGE/IMT/OLPS/ASE/DAPI/CSE
>
> Architecte de services d’infrastructure de stockage
>
> Sofware-Defined Storage Architect
> +33299124432
>
> +33788624370
> ghislain.cheval...@orange.com
>
> P Pensez à l'Environnement avant d'imprimer ce message !
>
>
>
> __
> ___
>
> Ce message et ses pieces jointes peuvent contenir des informations 
> confidentielles ou privilegiees et ne doivent donc pas etre diffuses, 
> exploites ou copies sans autorisation. Si vous avez recu ce message 
> par erreur, veuillez le signaler a l'expediteur et le detruire ainsi 
> que les pieces jointes. Les messages electroniques etant susceptibles 
> d'alteration, Orange decline toute responsabilite si ce message a ete 
> altere, deforme ou falsifie. Merci.
>
> This message and its attachments may contain confidential or 
> privileged information that may be protected by law; they should not 
> be distributed, used or copied without authorisation.
> If you have received this email in error, please notify the sender and 
> delete this message and its attachments.
> As emails may be altered, Orange is not liable for messages that have 
> been modified, changed or falsified.
> Thank you.
>
>
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>

-BEGIN PGP SIGNATURE-
Version: Mailvelope v1.2.0
Comment: https://www.mailvelope.com

wsFcBAEBCAAQBQJWE+7gCRDmVDuy+mK58QAAdlYQAIKPgcewctAfPisSwvdl
iS60T15U2r2rnuh4G3AQjnmI0eb+nj9O7a1ZH7ttL1k3b5bZz/9/qjK+xnBe
z2UvTjdZltlWVkOSjyjRBpU4JWRS2wZXeMIqVcC71NHT4zGD0otQloftrPLA
ciQ73FDWOJgoA+PMca2oHO91IqQ+UZWr6BAs22scumTW9Zwb/E3QxZJyuh2F
3ajkvalXne97IIMO02ZFB+5PZgg34FukvcdJ/Z/eb+GCE1A57mkL9Wuazu46
u1NvatNWH13I0hZruR5ltWqLV8elTnFFd5KU5XWcyeewKbwbEzFUprUI5xlO
uLNN4vGPrcYYmx6Tm8wWEpSFoZrhOF8NHfIbjn3jM+ZAawzozh1WrMTwWXWG
a6hce307WuJVn/fvNY4IKOzUIwyh/OXPUq+R7RvvkGtnAGJn7aBjuUn6mg6x
AE60XWibRzPGsXvRebEeqEzsfuxbxdt+oml02LByoxei+IZScj446HuyiVqp
9skPJEQgEJL8TChs6+ctS6hkZmo9vJ9Ysk14fJSjXIvTV8eJb12LK9aNig7G
gXYxczfV9fjV/h4TKFcKRYddUj7g8tYpXb8ggJMtqP0B1Pi0gfrV5lsDVH6V
r77ZWisSJ9w+f6lMGzRJTnpeDualcolheBvyFKiqrjoEbxivnow9GFXl7WfT
GpUp
=4tHA
-END PGP SIGNATURE-

_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.

Re: [ceph-users] Placement rule not resolved

[ghislain.chevalier]

Hi all,

After installing the cluster, all the disks (sas and ssd) were mixed under a 
host, so the calculated reweight was related to the entire capacity.

It doesn't explain why sas disks were selected when using a specific ssd-driven 
rule.

Brgds

De : CHEVALIER Ghislain IMT/OLPS
Envoyé : jeudi 8 octobre 2015 10:47
À : ceph-users; ceph-de...@vger.kernel.org
Objet : RE: [ceph-users] Placement rule not resolved

HI all,

I didn't notice that osd reweight for ssd was curiously set to a low value.
I don't know how and when these values were set so low.
Our environment is Mirantis-driven and the installation was powered by fuel and 
puppet.
(the installation was run by the openstack team and I checked the ceph cluster 
configuration afterwards)

After reweighing them to 1, the ceph-cluster is working properly.
Thanks to object lookup module of inkscope, I checked that the osd allocation 
was ok.

What is not normal is that crush tried to allocated osd that are not targeted 
by the rule in that case sas disks instead of ssd disks?
Must the cluster normal behavior ,i.e. the pg allocation, be  to be frozen?
I can say that because if I analyze the stuck pgs (inkscope module) and noticed 
that osd allocation for these pgs were either not correct (acting list) or 
uncomplete.

Best regards

De : ceph-users [mailto:ceph-users-boun...@lists.ceph.com] De la part de 
ghislain.cheval...@orange.com
Envoyé : mardi 6 octobre 2015 14:18
À : ceph-users
Objet : [ceph-users] Placement rule not resolved

Hi,

Context:
Firefly 0.80.9
8 storage nodes
176 osds : 14*8 sas and 8*8 ssd
3 monitors

I create an alternate crushmap in order to fulfill tiering requirement i.e. 
select ssd or sas.
I created specific buckets "host-ssd" and "host-sas" and regroup them in 
"tier-ssd" and "tier-sas" under a "tier-root"
E.g. I want to select 1 ssd in 3 distinct hosts

I don't understand why the placement rule for sas is working and not for ssd.
Sas are selected even if ,according to the crushmap,  they are not in the right 
tree.
When sometimes 3 ssd are selected, the pgs stay stuck but active

I attached the crushmap and ceph osd tree.

Can someone have a look and tell me where the default is?

Bgrds
- - - - - - - - - - - - - - - - -
Ghislain Chevalier
ORANGE/IMT/OLPS/ASE/DAPI/CSE
Architecte de services d'infrastructure de stockage
Sofware-Defined Storage Architect
+33299124432
+33788624370
ghislain.cheval...@orange.com
P Pensez à l'Environnement avant d'imprimer ce message !


_



Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc

pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler

a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,

Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.



This message and its attachments may contain confidential or privileged 
information that may be protected by law;

they should not be distributed, used or copied without authorisation.

If you have received this email in error, please notify the sender and delete 
this message and its attachments.

As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.

Thank you.

_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Placement rule not resolved

[ghislain.chevalier]

HI all,

I didn't notice that osd reweight for ssd was curiously set to a low value.
I don't know how and when these values were set so low.
Our environment is Mirantis-driven and the installation was powered by fuel and 
puppet.
(the installation was run by the openstack team and I checked the ceph cluster 
configuration afterwards)

After reweighing them to 1, the ceph-cluster is working properly.
Thanks to object lookup module of inkscope, I checked that the osd allocation 
was ok.

What is not normal is that crush tried to allocated osd that are not targeted 
by the rule in that case sas disks instead of ssd disks?
Must the cluster normal behavior ,i.e. the pg allocation, be  to be frozen?
I can say that because if I analyze the stuck pgs (inkscope module) and noticed 
that osd allocation for these pgs were either not correct (acting list) or 
uncomplete.

Best regards

De : ceph-users [mailto:ceph-users-boun...@lists.ceph.com] De la part de 
ghislain.cheval...@orange.com
Envoyé : mardi 6 octobre 2015 14:18
À : ceph-users
Objet : [ceph-users] Placement rule not resolved

Hi,

Context:
Firefly 0.80.9
8 storage nodes
176 osds : 14*8 sas and 8*8 ssd
3 monitors

I create an alternate crushmap in order to fulfill tiering requirement i.e. 
select ssd or sas.
I created specific buckets "host-ssd" and "host-sas" and regroup them in 
"tier-ssd" and "tier-sas" under a "tier-root"
E.g. I want to select 1 ssd in 3 distinct hosts

I don't understand why the placement rule for sas is working and not for ssd.
Sas are selected even if ,according to the crushmap,  they are not in the right 
tree.
When sometimes 3 ssd are selected, the pgs stay stuck but active

I attached the crushmap and ceph osd tree.

Can someone have a look and tell me where the default is?

Bgrds
- - - - - - - - - - - - - - - - -
Ghislain Chevalier
ORANGE/IMT/OLPS/ASE/DAPI/CSE
Architecte de services d'infrastructure de stockage
Sofware-Defined Storage Architect
+33299124432
+33788624370
ghislain.cheval...@orange.com
P Pensez à l'Environnement avant d'imprimer ce message !


_



Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc

pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler

a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,

Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.



This message and its attachments may contain confidential or privileged 
information that may be protected by law;

they should not be distributed, used or copied without authorisation.

If you have received this email in error, please notify the sender and delete 
this message and its attachments.

As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.

Thank you.

_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[ceph-users] Placement rule not resolved

[ghislain.chevalier]

Hi,

Context:
Firefly 0.80.9
8 storage nodes
176 osds : 14*8 sas and 8*8 ssd
3 monitors

I create an alternate crushmap in order to fulfill tiering requirement i.e. 
select ssd or sas.
I created specific buckets "host-ssd" and "host-sas" and regroup them in 
"tier-ssd" and "tier-sas" under a "tier-root"
E.g. I want to select 1 ssd in 3 distinct hosts

I don't understand why the placement rule for sas is working and not for ssd.
Sas are selected even if ,according to the crushmap,  they are not in the right 
tree.
When sometimes 3 ssd are selected, the pgs stay stuck but active

I attached the crushmap and ceph osd tree.

Can someone have a look and tell me where the default is?

Bgrds
- - - - - - - - - - - - - - - - -
Ghislain Chevalier
ORANGE/IMT/OLPS/ASE/DAPI/CSE
Architecte de services d'infrastructure de stockage
Sofware-Defined Storage Architect
+33299124432
+33788624370
ghislain.cheval...@orange.com
P Pensez à l'Environnement avant d'imprimer ce message !


_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.

# begin crush map
tunable choose_local_tries 0
tunable choose_local_fallback_tries 0
tunable choose_total_tries 50
tunable chooseleaf_descend_once 1
tunable straw_calc_version 1

# devices
device 0 osd.0
device 1 osd.1
device 2 osd.2
device 3 osd.3
device 4 osd.4
device 5 osd.5
device 6 osd.6
device 7 osd.7
device 8 osd.8
device 9 osd.9
device 10 osd.10
device 11 osd.11
device 12 osd.12
device 13 osd.13
device 14 osd.14
device 15 osd.15
device 16 osd.16
device 17 osd.17
device 18 osd.18
device 19 osd.19
device 20 osd.20
device 21 osd.21
device 22 osd.22
device 23 osd.23
device 24 osd.24
device 25 osd.25
device 26 osd.26
device 27 osd.27
device 28 osd.28
device 29 osd.29
device 30 osd.30
device 31 osd.31
device 32 osd.32
device 33 osd.33
device 34 osd.34
device 35 osd.35
device 36 osd.36
device 37 osd.37
device 38 osd.38
device 39 osd.39
device 40 osd.40
device 41 osd.41
device 42 osd.42
device 43 osd.43
device 44 osd.44
device 45 osd.45
device 46 osd.46
device 47 osd.47
device 48 osd.48
device 49 osd.49
device 50 osd.50
device 51 osd.51
device 52 osd.52
device 53 osd.53
device 54 osd.54
device 55 osd.55
device 56 osd.56
device 57 osd.57
device 58 osd.58
device 59 osd.59
device 60 osd.60
device 61 osd.61
device 62 osd.62
device 63 osd.63
device 64 osd.64
device 65 osd.65
device 66 osd.66
device 67 osd.67
device 68 osd.68
device 69 osd.69
device 70 osd.70
device 71 osd.71
device 72 osd.72
device 73 osd.73
device 74 osd.74
device 75 osd.75
device 76 osd.76
device 77 osd.77
device 78 osd.78
device 79 osd.79
device 80 osd.80
device 81 osd.81
device 82 osd.82
device 83 osd.83
device 84 osd.84
device 85 osd.85
device 86 osd.86
device 87 osd.87
device 88 osd.88
device 89 osd.89
device 90 osd.90
device 91 osd.91
device 92 osd.92
device 93 osd.93
device 94 osd.94
device 95 osd.95
device 96 osd.96
device 97 osd.97
device 98 osd.98
device 99 osd.99
device 100 osd.100
device 101 osd.101
device 102 osd.102
device 103 osd.103
device 104 osd.104
device 105 osd.105
device 106 osd.106
device 107 osd.107
device 108 osd.108
device 109 osd.109
device 110 osd.110
device 111 osd.111
device 112 osd.112
device 113 osd.113
device 114 osd.114
device 115 osd.115
device 116 osd.116
device 117 osd.117
device 118 osd.118
device 119 osd.119
device 120 osd.120
device 121 osd.121
device 122 osd.122
device 123 osd.123
device 124 osd.124
device 125 osd.125
device 126 osd.126
device 127 osd.127
device 128 osd.128
device 129 osd.129
device 130 osd.130
device 131 osd.131
device 132 osd.132
device 133 osd.133
device 134 osd.134
device 135 osd.135
device 136 osd.136
device 137 osd.137
device 138 osd.138
device 139 osd.139
device 140 osd.140
device 141 osd.141
device 142 osd.142
device 143 osd.143
device 144 osd.144
device 145 osd.145
device 146 osd.146
device 147 osd.147
device 148 osd.148
device 149 osd.149
device 150 osd.150
device 151 osd.151
device 152 osd.152
device 153 osd.153
device 154 osd.154
device 155 osd.155
device 156 osd.156
device 157 osd.157
device 

Re: [ceph-users] Rados Gateway and keystone

[ghislain.chevalier]

Thx Mark

I understand the specific parameters are mandatory for the S3 implementation 
but as they are not for the swift implementation (I tested it...)
it should have been better to distinguish which parameter is mandatory 
according to the implementation.
For the S3 implementation, the creation of ec2-credentials is also missing.

I hope this discussion will help.

Best regards


-Message d'origine-
De : ceph-users [mailto:ceph-users-boun...@lists.ceph.com] De la part de Mark 
Kirkwood
Envoyé : jeudi 7 mai 2015 11:24
À : ceph-users@lists.ceph.com
Objet : Re: [ceph-users] Rados Gateway and keystone

On 07/05/15 20:21, ghislain.cheval...@orange.com wrote:
 HI all,

 After adding the nss and the keystone admin url  parameters in ceph.conf and 
 creating the openSSL certificates, all is working well.

 If I had followed the doc and processed by copy/paste, I wouldn't have 
 encountered any problems.

 As all is working well without this set of parameters using the swift API and 
 keystone, It would be helpful if the page 
 http://ceph.com/docs/master/radosgw/keystone/  was more precise according to 
 this implementation.

 Best regards

 -Message d'origine-
 De : CHEVALIER Ghislain IMT/OLPS
 Envoyé : lundi 13 avril 2015 16:17
 À : ceph-users
 Objet : RE: [ceph-users] Rados Gateway and keystone

 Hi all,

 Coming back to that issue.

 I successfully used keystone users for the rados gateway and the swift 
 API but I still don't understand how it can work with S3 API and i.e. 
 S3 users (AccessKey/SecretKey)

 I found a swift3 initiative but I think It's only compliant in a pure 
 OpenStack swift environment  by setting up a specific plug-in.
 https://github.com/stackforge/swift3

 A rgw can be, at the same, time under keystone control and  standard 
 radosgw-admin if
 - for swift, you use the right authentication service (keystone or 
 internal)
 - for S3, you use the internal authentication service

 So, my questions are still valid.
 How can a rgw work for S3 users if there are stored in keystone? Which is the 
 accesskey and secretkey?
 What is the purpose of rgw s3 auth use keystone parameter ?


The difference is that (in particular with the v2 protocol) swift clients talk 
to keystone to a) authenticate and b) find the swift storage endpoint (even if 
it is actually pointing to rgw).

In contrast s3 clients will talk directly to the rgw, and *it* will talk to 
kesystone to check the client's s3 credentials fir them. That's why rgw need to 
have rgw s3 auth use keystone and similar parameters.

Cheers

Mark
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Rados Gateway and keystone

[ghislain.chevalier]

HI all,

After adding the nss and the keystone admin url  parameters in ceph.conf and 
creating the openSSL certificates, all is working well.

If I had followed the doc and processed by copy/paste, I wouldn't have 
encountered any problems.

As all is working well without this set of parameters using the swift API and 
keystone, It would be helpful if the page 
http://ceph.com/docs/master/radosgw/keystone/  was more precise according to 
this implementation.

Best regards

-Message d'origine-
De : CHEVALIER Ghislain IMT/OLPS 
Envoyé : lundi 13 avril 2015 16:17
À : ceph-users
Objet : RE: [ceph-users] Rados Gateway and keystone

Hi all,

Coming back to that issue.

I successfully used keystone users for the rados gateway and the swift API but 
I still don't understand how it can work with S3 API and i.e. S3 users 
(AccessKey/SecretKey)

I found a swift3 initiative but I think It's only compliant in a pure OpenStack 
swift environment  by setting up a specific plug-in. 
https://github.com/stackforge/swift3

A rgw can be, at the same, time under keystone control and  standard 
radosgw-admin if
- for swift, you use the right authentication service (keystone or internal)
- for S3, you use the internal authentication service

So, my questions are still valid.
How can a rgw work for S3 users if there are stored in keystone? Which is the 
accesskey and secretkey?
What is the purpose of rgw s3 auth use keystone parameter ?

Best regards

--
De : ceph-users [mailto:ceph-users-boun...@lists.ceph.com] De la part de 
ghislain.cheval...@orange.com Envoyé : lundi 23 mars 2015 14:03 À : ceph-users 
Objet : [ceph-users] Rados Gateway and keystone

Hi All,

I just would to be sure about keystone configuration for Rados Gateway.

I read the documentation http://ceph.com/docs/master/radosgw/keystone/ and 
http://ceph.com/docs/master/radosgw/config-ref/?highlight=keystone
but I didn't catch if after having configured the rados gateway (ceph.conf) in 
order to use keystone, it becomes mandatory to create all the users in it. 

In other words, can a rgw be, at the same, time under keystone control and  
standard radosgw-admin ?
How does it work for S3 users ?
What is the purpose of rgw s3 auth use keystone parameter ?

Best regards

- - - - - - - - - - - - - - - - -
Ghislain Chevalier
+33299124432
+33788624370
ghislain.cheval...@orange.com
_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc pas etre diffuses, exploites 
ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez 
le signaler a l'expediteur et le detruire ainsi que les pieces jointes. Les 
messages electroniques etant susceptibles d'alteration, Orange decline toute 
responsabilite si ce message a ete altere, deforme ou falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law; they should not be distributed, used 
or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.

_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Rados Gateway and keystone

[ghislain.chevalier]

Hi,

Coming back to that issue.

My endpoint wasn’t right set up.
I changed it to myrgw:myport (rgwow:8080) in the cloudberry profile or in the 
curl request and  I got a 403 error due to a potential bad role returned by 
keystone.
In the radosgw log, I got
2015-05-05 14:58:23.895961 7fb9f4fe9700  1 == starting new request 
req=0x7fba040177c0 =
2015-05-05 14:58:23.895975 7fb9f4fe9700  2 req 82:0.15::GET /::initializing
2015-05-05 14:58:23.896009 7fb9f4fe9700 10 s-object=NULL s-bucket=NULL
2015-05-05 14:58:23.896014 7fb9f4fe9700  2 req 82:0.54:s3:GET /::getting op
2015-05-05 14:58:23.896018 7fb9f4fe9700  2 req 82:0.58:s3:GET 
/:list_buckets:authorizing
2015-05-05 14:58:23.896022 7fb9f4fe9700  2 req 82:0.62:s3:GET 
/:list_buckets:reading permissions
2015-05-05 14:58:23.896027 7fb9f4fe9700  2 req 82:0.67:s3:GET 
/:list_buckets:init op
2015-05-05 14:58:23.896030 7fb9f4fe9700  2 req 82:0.70:s3:GET 
/:list_buckets:verifying op mask
2015-05-05 14:58:23.896032 7fb9f4fe9700 20 required_mask= 1 user.op_mask=7
2015-05-05 14:58:23.896033 7fb9f4fe9700  2 req 82:0.73:s3:GET 
/:list_buckets:verifying op permissions
2015-05-05 14:58:23.896036 7fb9f4fe9700  2 req 82:0.75:s3:GET 
/:list_buckets:verifying op params
2015-05-05 14:58:23.896037 7fb9f4fe9700  2 req 82:0.77:s3:GET 
/:list_buckets:executing
2015-05-05 14:58:23.898267 7fb9f4fe9700  5 nothing to log for operation
2015-05-05 14:58:23.898286 7fb9f4fe9700  2 req 82:0.002326:s3:GET 
/:list_buckets:http status=200
2015-05-05 14:58:23.898293 7fb9f4fe9700  1 == req done req=0x7fba040177c0 
http_status=200 ==
2015-05-05 14:58:24.227297 7fba215f8700 20 enqueued request req=0x7fba04013580
2015-05-05 14:58:24.227318 7fba215f8700 20 RGWWQ:
2015-05-05 14:58:24.227320 7fba215f8700 20 req: 0x7fba04013580
2015-05-05 14:58:24.227328 7fba215f8700 10 allocated request req=0x7fba04012050
2015-05-05 14:58:24.227454 7fb9f57ea700 20 dequeued request req=0x7fba04013580
2015-05-05 14:58:24.227471 7fb9f57ea700 20 RGWWQ: empty
2015-05-05 14:58:24.227512 7fb9f57ea700 20 DOCUMENT_ROOT=/var/www/radosgw
2015-05-05 14:58:24.227515 7fb9f57ea700 20 FCGI_ROLE=RESPONDER
2015-05-05 14:58:24.227516 7fb9f57ea700 20 GATEWAY_INTERFACE=CGI/1.1
2015-05-05 14:58:24.227517 7fb9f57ea700 20 HTTP_ACCEPT=*/*
2015-05-05 14:58:24.227518 7fb9f57ea700 20 HTTP_AUTHORIZATION=AWS 
ffd80839282d4183afedff542de10760:9vF6bLQCF4a/bYTgaxPjl1bFro4=
2015-05-05 14:58:24.227520 7fb9f57ea700 20 HTTP_CONNECTION=close
2015-05-05 14:58:24.227521 7fb9f57ea700 20 HTTP_DATE=Tue, 05 May 2015 12:58:24 
+
2015-05-05 14:58:24.227522 7fb9f57ea700 20 HTTP_HOST=rgwow:8080
2015-05-05 14:58:24.227523 7fb9f57ea700 20 HTTP_USER_AGENT=curl/7.22.0 
(x86_64-pc-linux-gnu) libcurl/7.22.0 OpenSSL/1.0.1 zlib/1.2.3.4 libidn/1.23 
librtmp/2.3
2015-05-05 14:58:24.227524 7fb9f57ea700 20 PATH=/usr/local/bin:/usr/bin:/bin
2015-05-05 14:58:24.227525 7fb9f57ea700 20 QUERY_STRING=page=params=
2015-05-05 14:58:24.227526 7fb9f57ea700 20 REMOTE_ADDR=10.193.108.105
2015-05-05 14:58:24.227527 7fb9f57ea700 20 REMOTE_PORT=44436
2015-05-05 14:58:24.227528 7fb9f57ea700 20 REQUEST_METHOD=GET
2015-05-05 14:58:24.227528 7fb9f57ea700 20 REQUEST_URI=/
2015-05-05 14:58:24.227529 7fb9f57ea700 20 
SCRIPT_FILENAME=/var/www/radosgw/s3gw.fcgi
2015-05-05 14:58:24.227530 7fb9f57ea700 20 SCRIPT_NAME=/
2015-05-05 14:58:24.227530 7fb9f57ea700 20 SCRIPT_URI=http://rgwow:8080/
2015-05-05 14:58:24.227531 7fb9f57ea700 20 SCRIPT_URL=/
2015-05-05 14:58:24.227532 7fb9f57ea700 20 SERVER_ADDR=10.193.108.236
2015-05-05 14:58:24.227532 7fb9f57ea700 20 SERVER_ADMIN=[no address given]
2015-05-05 14:58:24.227533 7fb9f57ea700 20 SERVER_NAME=rgwow
2015-05-05 14:58:24.227534 7fb9f57ea700 20 SERVER_PORT=8080
2015-05-05 14:58:24.227534 7fb9f57ea700 20 SERVER_PROTOCOL=HTTP/1.1
2015-05-05 14:58:24.227535 7fb9f57ea700 20 SERVER_SIGNATURE=
2015-05-05 14:58:24.227536 7fb9f57ea700 20 SERVER_SOFTWARE=Apache/2.2.22 
(Ubuntu)
2015-05-05 14:58:24.227537 7fb9f57ea700  1 == starting new request 
req=0x7fba04013580 =
2015-05-05 14:58:24.227551 7fb9f57ea700  2 req 83:0.14::GET /::initializing
2015-05-05 14:58:24.227557 7fb9f57ea700 10 host=rgwow:8080 rgw_dns_name=rgwow
2015-05-05 14:58:24.227588 7fb9f57ea700 10 s-object=NULL s-bucket=NULL
2015-05-05 14:58:24.227593 7fb9f57ea700  2 req 83:0.56:s3:GET /::getting op
2015-05-05 14:58:24.227596 7fb9f57ea700  2 req 83:0.59:s3:GET 
/:list_buckets:authorizing
2015-05-05 14:58:24.227600 7fb9f57ea700 20 s3 keystone: trying keystone auth
2015-05-05 14:58:24.227693 7fb9f57ea700 10 get_canon_resource(): dest=/
2015-05-05 14:58:24.227776 7fb9f57ea700 20 sending request to 
10.194.167.23:5000/v2.0/s3tokens
2015-05-05 14:58:24.233049 7fb9f57ea700  5 s3 keystone: user does not hold a 
matching role; required roles: _member_, Member, admin, swiftoperator
2015-05-05 14:58:24.233121 7fb9f57ea700 20 get_obj_state: rctx=0x7fba6c0021e0 
obj=.users:ffd80839282d4183afedff542de10760 state=0x7fba6c00b1a8 

Re: [ceph-users] Rados Gateway and keystone

[ghislain.chevalier]

Addendum

In the keystone log, I got
2015-05-06 11:42:24.594 10435 INFO eventlet.wsgi.server [-] 10.193.108.238 - - 
[06/May/2015 11:42:24] POST /v2.0/s3tokens HTTP/1.1 404 247 0.003872

Something is missing

This is my new quest…


De : CHEVALIER Ghislain IMT/OLPS
Envoyé : mercredi 6 mai 2015 10:24
À : ceph-users
Objet : RE: [ceph-users] Rados Gateway and keystone

Hi,

Coming back to that issue.
My endpoint wasn’t right set up.
I changed it to myrgw:myport (rgwow:8080) in the cloudberry profile or in the 
curl request and  I got a 403 error due to a potential bad role returned by 
keystone.
In the radosgw log, I got
2015-05-05 14:58:23.895961 7fb9f4fe9700  1 == starting new request 
req=0x7fba040177c0 =
2015-05-05 14:58:23.895975 7fb9f4fe9700  2 req 82:0.15::GET /::initializing
2015-05-05 14:58:23.896009 7fb9f4fe9700 10 s-object=NULL s-bucket=NULL
2015-05-05 14:58:23.896014 7fb9f4fe9700  2 req 82:0.54:s3:GET /::getting op
2015-05-05 14:58:23.896018 7fb9f4fe9700  2 req 82:0.58:s3:GET 
/:list_buckets:authorizing
2015-05-05 14:58:23.896022 7fb9f4fe9700  2 req 82:0.62:s3:GET 
/:list_buckets:reading permissions
2015-05-05 14:58:23.896027 7fb9f4fe9700  2 req 82:0.67:s3:GET 
/:list_buckets:init op
2015-05-05 14:58:23.896030 7fb9f4fe9700  2 req 82:0.70:s3:GET 
/:list_buckets:verifying op mask
2015-05-05 14:58:23.896032 7fb9f4fe9700 20 required_mask= 1 user.op_mask=7
2015-05-05 14:58:23.896033 7fb9f4fe9700  2 req 82:0.73:s3:GET 
/:list_buckets:verifying op permissions
2015-05-05 14:58:23.896036 7fb9f4fe9700  2 req 82:0.75:s3:GET 
/:list_buckets:verifying op params
2015-05-05 14:58:23.896037 7fb9f4fe9700  2 req 82:0.77:s3:GET 
/:list_buckets:executing
2015-05-05 14:58:23.898267 7fb9f4fe9700  5 nothing to log for operation
2015-05-05 14:58:23.898286 7fb9f4fe9700  2 req 82:0.002326:s3:GET 
/:list_buckets:http status=200
2015-05-05 14:58:23.898293 7fb9f4fe9700  1 == req done req=0x7fba040177c0 
http_status=200 ==
2015-05-05 14:58:24.227297 7fba215f8700 20 enqueued request req=0x7fba04013580
2015-05-05 14:58:24.227318 7fba215f8700 20 RGWWQ:
2015-05-05 14:58:24.227320 7fba215f8700 20 req: 0x7fba04013580
2015-05-05 14:58:24.227328 7fba215f8700 10 allocated request req=0x7fba04012050
2015-05-05 14:58:24.227454 7fb9f57ea700 20 dequeued request req=0x7fba04013580
2015-05-05 14:58:24.227471 7fb9f57ea700 20 RGWWQ: empty
2015-05-05 14:58:24.227512 7fb9f57ea700 20 DOCUMENT_ROOT=/var/www/radosgw
2015-05-05 14:58:24.227515 7fb9f57ea700 20 FCGI_ROLE=RESPONDER
2015-05-05 14:58:24.227516 7fb9f57ea700 20 GATEWAY_INTERFACE=CGI/1.1
2015-05-05 14:58:24.227517 7fb9f57ea700 20 HTTP_ACCEPT=*/*
2015-05-05 14:58:24.227518 7fb9f57ea700 20 HTTP_AUTHORIZATION=AWS 
ffd80839282d4183afedff542de10760:9vF6bLQCF4a/bYTgaxPjl1bFro4=
2015-05-05 14:58:24.227520 7fb9f57ea700 20 HTTP_CONNECTION=close
2015-05-05 14:58:24.227521 7fb9f57ea700 20 HTTP_DATE=Tue, 05 May 2015 12:58:24 
+
2015-05-05 14:58:24.227522 7fb9f57ea700 20 HTTP_HOST=rgwow:8080
2015-05-05 14:58:24.227523 7fb9f57ea700 20 HTTP_USER_AGENT=curl/7.22.0 
(x86_64-pc-linux-gnu) libcurl/7.22.0 OpenSSL/1.0.1 zlib/1.2.3.4 libidn/1.23 
librtmp/2.3
2015-05-05 14:58:24.227524 7fb9f57ea700 20 PATH=/usr/local/bin:/usr/bin:/bin
2015-05-05 14:58:24.227525 7fb9f57ea700 20 QUERY_STRING=page=params=
2015-05-05 14:58:24.227526 7fb9f57ea700 20 REMOTE_ADDR=10.193.108.105
2015-05-05 14:58:24.227527 7fb9f57ea700 20 REMOTE_PORT=44436
2015-05-05 14:58:24.227528 7fb9f57ea700 20 REQUEST_METHOD=GET
2015-05-05 14:58:24.227528 7fb9f57ea700 20 REQUEST_URI=/
2015-05-05 14:58:24.227529 7fb9f57ea700 20 
SCRIPT_FILENAME=/var/www/radosgw/s3gw.fcgi
2015-05-05 14:58:24.227530 7fb9f57ea700 20 SCRIPT_NAME=/
2015-05-05 14:58:24.227530 7fb9f57ea700 20 SCRIPT_URI=http://rgwow:8080/
2015-05-05 14:58:24.227531 7fb9f57ea700 20 SCRIPT_URL=/
2015-05-05 14:58:24.227532 7fb9f57ea700 20 SERVER_ADDR=10.193.108.236
2015-05-05 14:58:24.227532 7fb9f57ea700 20 SERVER_ADMIN=[no address given]
2015-05-05 14:58:24.227533 7fb9f57ea700 20 SERVER_NAME=rgwow
2015-05-05 14:58:24.227534 7fb9f57ea700 20 SERVER_PORT=8080
2015-05-05 14:58:24.227534 7fb9f57ea700 20 SERVER_PROTOCOL=HTTP/1.1
2015-05-05 14:58:24.227535 7fb9f57ea700 20 SERVER_SIGNATURE=
2015-05-05 14:58:24.227536 7fb9f57ea700 20 SERVER_SOFTWARE=Apache/2.2.22 
(Ubuntu)
2015-05-05 14:58:24.227537 7fb9f57ea700  1 == starting new request 
req=0x7fba04013580 =
2015-05-05 14:58:24.227551 7fb9f57ea700  2 req 83:0.14::GET /::initializing
2015-05-05 14:58:24.227557 7fb9f57ea700 10 host=rgwow:8080 rgw_dns_name=rgwow
2015-05-05 14:58:24.227588 7fb9f57ea700 10 s-object=NULL s-bucket=NULL
2015-05-05 14:58:24.227593 7fb9f57ea700  2 req 83:0.56:s3:GET /::getting op
2015-05-05 14:58:24.227596 7fb9f57ea700  2 req 83:0.59:s3:GET 
/:list_buckets:authorizing
2015-05-05 14:58:24.227600 7fb9f57ea700 20 s3 keystone: trying keystone auth
2015-05-05 14:58:24.227693 7fb9f57ea700 10 get_canon_resource(): dest=/
2015-05-05 14:58:24.227776 

Re: [ceph-users] Rados Gateway and keystone

[ghislain.chevalier]

Hi again,

I found that a keystone extension is required to interact between s3 and 
keystone and it’s possible to get the list of the installed extensions.

When I request post http://10.194.167.23:5000/v2.0/extension, I got in the 
response body
?xml version=1.0 encoding=UTF-8?
extensions xmlns=http://docs.openstack.org/identity/api/v2.0;
  extension updated=2014-02-24T20:51:0-00:00 name=OpenStack Revoke API 
namespace=http://docs.openstack.org/identity/api/ext/OS-REVOKE/v1.0; 
alias=OS-REVOKE
links
  link 
href=https://github.com/openstack/identity-api/blob/master/openstack-identity-api/v3/src/markdown/identity-api-v3-os-revoke-ext.md;
 type=text/html rel=describedby/
/links
descriptionOpenStack revoked token reporting mechanism./description
  /extension
  extension updated=2013-12-17T12:00:0-00:00 name=OpenStack Federation 
APIs namespace=http://docs.openstack.org/identity/api/ext/OS-FEDERATION/v1.0; 
alias=OS-FEDERATION
links
  link href=https://github.com/openstack/identity-api; type=text/html 
rel=describedby/
/links
descriptionOpenStack Identity Providers Mechanism./description
  /extension
  extension updated=2013-07-07T12:00:0-00:00 name=OpenStack Keystone User 
CRUD namespace=http://docs.openstack.org/identity/api/ext/OS-KSCRUD/v1.0; 
alias=OS-KSCRUD
links
  link href=https://github.com/openstack/identity-api; type=text/html 
rel=describedby/
/links
descriptionOpenStack extensions to Keystone v2.0 API enabling User 
Operations./description
  /extension
  extension updated=2013-07-07T12:00:0-00:00 name=OpenStack EC2 API 
namespace=http://docs.openstack.org/identity/api/ext/OS-EC2/v1.0; 
alias=OS-EC2
links
  link href=https://github.com/openstack/identity-api; type=text/html 
rel=describedby/
/links
descriptionOpenStack EC2 Credentials backend./description
  /extension
  extension updated=2014-01-20T12:00:0-00:00 name=OpenStack Simple 
Certificate API 
namespace=http://docs.openstack.org/identity/api/ext/OS-SIMPLE-CERT/v1.0; 
alias=OS-SIMPLE-CERT
links
  link href=https://github.com/openstack/identity-api; type=text/html 
rel=describedby/
/links
descriptionOpenStack simple certificate retrieval extension/description
  /extension
/extensions

In other words, no S3 extension

But, when I request post http://10.194.167.23:35357/v2.0/extension, I got in 
the response body
?xml version=1.0 encoding=UTF-8?
extensions xmlns=http://docs.openstack.org/identity/api/v2.0;
  extension updated=2013-07-07T12:00:0-00:00 name=OpenStack S3 API 
namespace=http://docs.openstack.org/identity/api/ext/s3tokens/v1.0; 
alias=s3tokens
links
  link href=https://github.com/openstack/identity-api; type=text/html 
rel=describedby/
/links
descriptionOpenStack S3 API./description
  /extension
  extension updated=2013-07-23T12:00:0-00:00 name=OpenStack Keystone 
Endpoint Filter API 
namespace=http://docs.openstack.org/identity/api/ext/OS-EP-FILTER/v1.0; 
alias=OS-EP-FILTER
links
  link 
href=https://github.com/openstack/identity-api/blob/master/openstack-identity-api/v3/src/markdown/identity-api-v3-os-ep-filter-ext.md;
 type=text/html rel=describedby/
/links
descriptionOpenStack Keystone Endpoint Filter API./description
  /extension
  extension updated=2014-02-24T20:51:0-00:00 name=OpenStack Revoke API 
namespace=http://docs.openstack.org/identity/api/ext/OS-REVOKE/v1.0; 
alias=OS-REVOKE
links
  link 
href=https://github.com/openstack/identity-api/blob/master/openstack-identity-api/v3/src/markdown/identity-api-v3-os-revoke-ext.md;
 type=text/html rel=describedby/
/links
descriptionOpenStack revoked token reporting mechanism./description
  /extension
  extension updated=2013-12-17T12:00:0-00:00 name=OpenStack Federation 
APIs namespace=http://docs.openstack.org/identity/api/ext/OS-FEDERATION/v1.0; 
alias=OS-FEDERATION
links
  link href=https://github.com/openstack/identity-api; type=text/html 
rel=describedby/
/links
descriptionOpenStack Identity Providers Mechanism./description
  /extension
  extension updated=2013-07-11T17:14:00-00:00 name=OpenStack Keystone 
Admin namespace=http://docs.openstack.org/identity/api/ext/OS-KSADM/v1.0; 
alias=OS-KSADM
links
  link href=https://github.com/openstack/identity-api; type=text/html 
rel=describedby/
/links
descriptionOpenStack extensions to Keystone v2.0 API enabling 
Administrative Operations./description
  /extension
  extension updated=2014-01-20T12:00:0-00:00 name=OpenStack Simple 
Certificate API 
namespace=http://docs.openstack.org/identity/api/ext/OS-SIMPLE-CERT/v1.0; 
alias=OS-SIMPLE-CERT
links
  link href=https://github.com/openstack/identity-api; type=text/html 
rel=describedby/
/links
descriptionOpenStack simple certificate retrieval extension/description
  /extension
  extension updated=2013-07-07T12:00:0-00:00 name=OpenStack EC2 API 
namespace=http://docs.openstack.org/identity/api/ext/OS-EC2/v1.0; 

Re: [ceph-users] Rados Gateway and keystone

[ghislain.chevalier]

Hi,

I finally configure a cloudberry profile by setting what seems to be the right 
endpoint for object storage according to the openstack environment : 
myrgw:myport/swift/v1
I got a “204 no content” error even if 2 containers were previously created by 
a swift operation with object into them.

In the log, I saw a dialog between the rgw and keystone but the right service 
doesn’t seem to be selected and the id became anonymous.

Any idea?

De : ceph-users [mailto:ceph-users-boun...@lists.ceph.com] De la part de 
ghislain.cheval...@orange.com
Envoyé : mercredi 15 avril 2015 18:39
À : ceph-users
Objet : Re: [ceph-users] Rados Gateway and keystone

Hi,

Despite the creation of ec2 credentials which provides an accesskey and a 
secretkey for a user, it’s always impossible to connect using S3 
(Forbidden/Access denied).
All is right using swift (create container, list container, get object, put 
object, delete object)
I use cloudberry client to do so.

Does someone know how I can check if the interoperability between keystone and 
the rgw is correctly set up?
In the rgw pools? in the radosgw metadata?

Best regards

De : ceph-users [mailto:ceph-users-boun...@lists.ceph.com] De la part de 
ghislain.cheval...@orange.commailto:ghislain.cheval...@orange.com
Envoyé : mercredi 15 avril 2015 13:16
À : Erik McCormick
Cc : ceph-users
Objet : Re: [ceph-users] Rados Gateway and keystone

Thanks a lot
That helps.

De : Erik McCormick [mailto:emccorm...@cirrusseven.com]
Envoyé : lundi 13 avril 2015 18:32
À : CHEVALIER Ghislain IMT/OLPS
Cc : ceph-users
Objet : Re: [ceph-users] Rados Gateway and keystone

I haven't really used the S3 stuff much, but the credentials should be in 
keystone already. If you're in horizon, you can download them under Access and 
Security-API Access. Using the CLI you can use the openstack client like 
openstack credential list | show | create | delete | set or with the 
keystone client like keystone ec2-credentials-list, etc.  Then you should be 
able to feed those credentials to the rgw like a normal S3 API call.

Cheers,
Erik

On Mon, Apr 13, 2015 at 10:16 AM, 
ghislain.cheval...@orange.commailto:ghislain.cheval...@orange.com wrote:
Hi all,

Coming back to that issue.

I successfully used keystone users for the rados gateway and the swift API but 
I still don't understand how it can work with S3 API and i.e. S3 users 
(AccessKey/SecretKey)

I found a swift3 initiative but I think It's only compliant in a pure OpenStack 
swift environment  by setting up a specific plug-in.
https://github.com/stackforge/swift3

A rgw can be, at the same, time under keystone control and  standard 
radosgw-admin if
- for swift, you use the right authentication service (keystone or internal)
- for S3, you use the internal authentication service

So, my questions are still valid.
How can a rgw work for S3 users if there are stored in keystone? Which is the 
accesskey and secretkey?
What is the purpose of rgw s3 auth use keystone parameter ?

Best regards

--
De : ceph-users 
[mailto:ceph-users-boun...@lists.ceph.commailto:ceph-users-boun...@lists.ceph.com]
 De la part de 
ghislain.cheval...@orange.commailto:ghislain.cheval...@orange.com
Envoyé : lundi 23 mars 2015 14:03
À : ceph-users
Objet : [ceph-users] Rados Gateway and keystone

Hi All,

I just would to be sure about keystone configuration for Rados Gateway.

I read the documentation http://ceph.com/docs/master/radosgw/keystone/ and 
http://ceph.com/docs/master/radosgw/config-ref/?highlight=keystone
but I didn't catch if after having configured the rados gateway (ceph.conf) in 
order to use keystone, it becomes mandatory to create all the users in it.

In other words, can a rgw be, at the same, time under keystone control and  
standard radosgw-admin ?
How does it work for S3 users ?
What is the purpose of rgw s3 auth use keystone parameter ?

Best regards

- - - - - - - - - - - - - - - - -
Ghislain Chevalier
+33299124432tel:%2B33299124432
+33788624370tel:%2B33788624370
ghislain.cheval...@orange.commailto:ghislain.cheval...@orange.com
_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable 

Re: [ceph-users] Rados Gateway and keystone

[ghislain.chevalier]

Hi,

Despite the creation of ec2 credentials which provides an accesskey and a 
secretkey for a user, it’s always impossible to connect using S3 
(Forbidden/Access denied).
All is right using swift (create container, list container, get object, put 
object, delete object)
I use cloudberry client to do so.

Does someone know how I can check if the interoperability between keystone and 
the rgw is correctly set up?
In the rgw pools? in the radosgw metadata?

Best regards

De : ceph-users [mailto:ceph-users-boun...@lists.ceph.com] De la part de 
ghislain.cheval...@orange.com
Envoyé : mercredi 15 avril 2015 13:16
À : Erik McCormick
Cc : ceph-users
Objet : Re: [ceph-users] Rados Gateway and keystone

Thanks a lot
That helps.

De : Erik McCormick [mailto:emccorm...@cirrusseven.com]
Envoyé : lundi 13 avril 2015 18:32
À : CHEVALIER Ghislain IMT/OLPS
Cc : ceph-users
Objet : Re: [ceph-users] Rados Gateway and keystone

I haven't really used the S3 stuff much, but the credentials should be in 
keystone already. If you're in horizon, you can download them under Access and 
Security-API Access. Using the CLI you can use the openstack client like 
openstack credential list | show | create | delete | set or with the 
keystone client like keystone ec2-credentials-list, etc.  Then you should be 
able to feed those credentials to the rgw like a normal S3 API call.

Cheers,
Erik

On Mon, Apr 13, 2015 at 10:16 AM, 
ghislain.cheval...@orange.commailto:ghislain.cheval...@orange.com wrote:
Hi all,

Coming back to that issue.

I successfully used keystone users for the rados gateway and the swift API but 
I still don't understand how it can work with S3 API and i.e. S3 users 
(AccessKey/SecretKey)

I found a swift3 initiative but I think It's only compliant in a pure OpenStack 
swift environment  by setting up a specific plug-in.
https://github.com/stackforge/swift3

A rgw can be, at the same, time under keystone control and  standard 
radosgw-admin if
- for swift, you use the right authentication service (keystone or internal)
- for S3, you use the internal authentication service

So, my questions are still valid.
How can a rgw work for S3 users if there are stored in keystone? Which is the 
accesskey and secretkey?
What is the purpose of rgw s3 auth use keystone parameter ?

Best regards

--
De : ceph-users 
[mailto:ceph-users-boun...@lists.ceph.commailto:ceph-users-boun...@lists.ceph.com]
 De la part de 
ghislain.cheval...@orange.commailto:ghislain.cheval...@orange.com
Envoyé : lundi 23 mars 2015 14:03
À : ceph-users
Objet : [ceph-users] Rados Gateway and keystone

Hi All,

I just would to be sure about keystone configuration for Rados Gateway.

I read the documentation http://ceph.com/docs/master/radosgw/keystone/ and 
http://ceph.com/docs/master/radosgw/config-ref/?highlight=keystone
but I didn't catch if after having configured the rados gateway (ceph.conf) in 
order to use keystone, it becomes mandatory to create all the users in it.

In other words, can a rgw be, at the same, time under keystone control and  
standard radosgw-admin ?
How does it work for S3 users ?
What is the purpose of rgw s3 auth use keystone parameter ?

Best regards

- - - - - - - - - - - - - - - - -
Ghislain Chevalier
+33299124432tel:%2B33299124432
+33788624370tel:%2B33788624370
ghislain.cheval...@orange.commailto:ghislain.cheval...@orange.com
_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.

_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may 

Re: [ceph-users] how to compute Ceph durability?

[ghislain.chevalier]

Thanks Mark
Loic also gave me this link

It would be a good start for sure

Best regards

-Message d'origine-
De : ceph-users [mailto:ceph-users-boun...@lists.ceph.com] De la part de Mark 
Nelson
Envoyé : mardi 14 avril 2015 14:11
À : ceph-users@lists.ceph.com
Objet : Re: [ceph-users] how to compute Ceph durability?

Hi Ghislain,

Mark Kampe was working on durability models a couple of years ago, but I'm not 
sure if they ever were completed or if anyone has reviewed them. 
  The source code is available here:

https://github.com/ceph/ceph-tools/tree/master/models/reliability

This was before EC was in Ceph, so I'm guessing new models would need to be 
created for that, but this may at least be a good place to start.

Mark

On 04/14/2015 07:04 AM, ghislain.cheval...@orange.com wrote:
 Hi All,

 Am I alone to have this need ?

 *De :*ceph-users [mailto:ceph-users-boun...@lists.ceph.com] *De la 
 part
 de* ghislain.cheval...@orange.com
 *Envoyé :* vendredi 20 mars 2015 11:47 *À :* ceph-users *Objet :* 
 [ceph-users] how to compute Ceph durability?

 Hi all,

 I would like to compute the durability of data stored in a  ceph 
 environment according to the cluster topology (failure domains) and 
 the data resiliency (replication/erasure coding).

 Does a tool exist ?

 Best regards

 *- - - - - - - - - - - - - - - - -*
 *Ghislain Chevalier ORANGE*
 +33299124432

 +33788624370
 ghislain.cheval...@orange.com
 mailto:ghislain.cheval...@orange-ftgroup.com

 __
 ___



 Ce message et ses pieces jointes peuvent contenir des informations 
 confidentielles ou privilegiees et ne doivent donc

 pas etre diffuses, exploites ou copies sans autorisation. Si vous avez 
 recu ce message par erreur, veuillez le signaler

 a l'expediteur et le detruire ainsi que les pieces jointes. Les 
 messages electroniques etant susceptibles d'alteration,

 Orange decline toute responsabilite si ce message a ete altere, deforme ou 
 falsifie. Merci.



 This message and its attachments may contain confidential or 
 privileged information that may be protected by law;

 they should not be distributed, used or copied without authorisation.

 If you have received this email in error, please notify the sender and delete 
 this message and its attachments.

 As emails may be altered, Orange is not liable for messages that have been 
 modified, changed or falsified.

 Thank you.

 __
 ___

 Ce message et ses pieces jointes peuvent contenir des informations 
 confidentielles ou privilegiees et ne doivent donc pas etre diffuses, 
 exploites ou copies sans autorisation. Si vous avez recu ce message 
 par erreur, veuillez le signaler a l'expediteur et le detruire ainsi que les 
 pieces jointes. Les messages electroniques etant susceptibles d'alteration, 
 Orange decline toute responsabilite si ce message a ete altere, deforme ou 
 falsifie. Merci.

 This message and its attachments may contain confidential or 
 privileged information that may be protected by law; they should not be 
 distributed, used or copied without authorisation.
 If you have received this email in error, please notify the sender and delete 
 this message and its attachments.
 As emails may be altered, Orange is not liable for messages that have been 
 modified, changed or falsified.
 Thank you.



 ___
 ceph-users mailing list
 ceph-users@lists.ceph.com
 http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Rados Gateway and keystone

[ghislain.chevalier]

Thanks a lot
That helps.

De : Erik McCormick [mailto:emccorm...@cirrusseven.com]
Envoyé : lundi 13 avril 2015 18:32
À : CHEVALIER Ghislain IMT/OLPS
Cc : ceph-users
Objet : Re: [ceph-users] Rados Gateway and keystone

I haven't really used the S3 stuff much, but the credentials should be in 
keystone already. If you're in horizon, you can download them under Access and 
Security-API Access. Using the CLI you can use the openstack client like 
openstack credential list | show | create | delete | set or with the 
keystone client like keystone ec2-credentials-list, etc.  Then you should be 
able to feed those credentials to the rgw like a normal S3 API call.

Cheers,
Erik

On Mon, Apr 13, 2015 at 10:16 AM, 
ghislain.cheval...@orange.commailto:ghislain.cheval...@orange.com wrote:
Hi all,

Coming back to that issue.

I successfully used keystone users for the rados gateway and the swift API but 
I still don't understand how it can work with S3 API and i.e. S3 users 
(AccessKey/SecretKey)

I found a swift3 initiative but I think It's only compliant in a pure OpenStack 
swift environment  by setting up a specific plug-in.
https://github.com/stackforge/swift3

A rgw can be, at the same, time under keystone control and  standard 
radosgw-admin if
- for swift, you use the right authentication service (keystone or internal)
- for S3, you use the internal authentication service

So, my questions are still valid.
How can a rgw work for S3 users if there are stored in keystone? Which is the 
accesskey and secretkey?
What is the purpose of rgw s3 auth use keystone parameter ?

Best regards

--
De : ceph-users 
[mailto:ceph-users-boun...@lists.ceph.commailto:ceph-users-boun...@lists.ceph.com]
 De la part de 
ghislain.cheval...@orange.commailto:ghislain.cheval...@orange.com
Envoyé : lundi 23 mars 2015 14:03
À : ceph-users
Objet : [ceph-users] Rados Gateway and keystone

Hi All,

I just would to be sure about keystone configuration for Rados Gateway.

I read the documentation http://ceph.com/docs/master/radosgw/keystone/ and 
http://ceph.com/docs/master/radosgw/config-ref/?highlight=keystone
but I didn't catch if after having configured the rados gateway (ceph.conf) in 
order to use keystone, it becomes mandatory to create all the users in it.

In other words, can a rgw be, at the same, time under keystone control and  
standard radosgw-admin ?
How does it work for S3 users ?
What is the purpose of rgw s3 auth use keystone parameter ?

Best regards

- - - - - - - - - - - - - - - - -
Ghislain Chevalier
+33299124432tel:%2B33299124432
+33788624370tel:%2B33788624370
ghislain.cheval...@orange.commailto:ghislain.cheval...@orange.com
_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.

_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.
___
ceph-users mailing list
ceph-users@lists.ceph.commailto:ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


_

Ce message et ses 

Re: [ceph-users] how to compute Ceph durability?

[ghislain.chevalier]

Hi All,

Am I alone to have this need ?

De : ceph-users [mailto:ceph-users-boun...@lists.ceph.com] De la part de 
ghislain.cheval...@orange.com
Envoyé : vendredi 20 mars 2015 11:47
À : ceph-users
Objet : [ceph-users] how to compute Ceph durability?

Hi all,

I would like to compute the durability of data stored in a  ceph environment 
according to the cluster topology (failure domains) and the data resiliency 
(replication/erasure coding).

Does a tool exist ?

Best regards

- - - - - - - - - - - - - - - - -
Ghislain Chevalier ORANGE
+33299124432
+33788624370
ghislain.cheval...@orange.commailto:ghislain.cheval...@orange-ftgroup.com

_



Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc

pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler

a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,

Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.



This message and its attachments may contain confidential or privileged 
information that may be protected by law;

they should not be distributed, used or copied without authorisation.

If you have received this email in error, please notify the sender and delete 
this message and its attachments.

As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.

Thank you.

_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Rados Gateway and keystone

[ghislain.chevalier]

Hi all,

Coming back to that issue.

I successfully used keystone users for the rados gateway and the swift API but 
I still don't understand how it can work with S3 API and i.e. S3 users 
(AccessKey/SecretKey)

I found a swift3 initiative but I think It's only compliant in a pure OpenStack 
swift environment  by setting up a specific plug-in. 
https://github.com/stackforge/swift3

A rgw can be, at the same, time under keystone control and  standard 
radosgw-admin if
- for swift, you use the right authentication service (keystone or internal)
- for S3, you use the internal authentication service

So, my questions are still valid.
How can a rgw work for S3 users if there are stored in keystone? Which is the 
accesskey and secretkey?
What is the purpose of rgw s3 auth use keystone parameter ?

Best regards

--
De : ceph-users [mailto:ceph-users-boun...@lists.ceph.com] De la part de 
ghislain.cheval...@orange.com
Envoyé : lundi 23 mars 2015 14:03
À : ceph-users
Objet : [ceph-users] Rados Gateway and keystone

Hi All,

I just would to be sure about keystone configuration for Rados Gateway.

I read the documentation http://ceph.com/docs/master/radosgw/keystone/ and 
http://ceph.com/docs/master/radosgw/config-ref/?highlight=keystone
but I didn't catch if after having configured the rados gateway (ceph.conf) in 
order to use keystone, it becomes mandatory to create all the users in it. 

In other words, can a rgw be, at the same, time under keystone control and  
standard radosgw-admin ?
How does it work for S3 users ?
What is the purpose of rgw s3 auth use keystone parameter ?

Best regards

- - - - - - - - - - - - - - - - - 
Ghislain Chevalier
+33299124432
+33788624370
ghislain.cheval...@orange.com 
_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.

_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] [radosgw] ceph daemon usage

[ghislain.chevalier]

HI all,

Works with ceph -admin-daemon 
/var/run/ceph/ceph-client.radosgw.fr-rennes-radosgw1.asok config set debug_rgw 
20

De : ceph-users [mailto:ceph-users-boun...@lists.ceph.com] De la part de 
ghislain.cheval...@orange.com
Envoyé : mercredi 25 février 2015 15:06
À : Ceph Users
Objet : [ceph-users] [radosgw] ceph daemon usage


Hi all



Context : Firefly 0.80.8, Ubuntu 14.04 LTS



I tried to change « live » the debug level of a rados gateway using ceph daemon 
/var/run/ceph/ceph-client.radosgw.fr-rennes-radosgw1.asok config set debug_rgw 
20 the response is { success: } but it has no effect.



Is there another parameter to change?



Best regards



- - - - - - - - - - - - - - - - -

Ghislain Chevalier

ORANGE FRANCE


_



Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc

pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler

a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,

Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.



This message and its attachments may contain confidential or privileged 
information that may be protected by law;

they should not be distributed, used or copied without authorisation.

If you have received this email in error, please notify the sender and delete 
this message and its attachments.

As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.

Thank you.

_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[ceph-users] Rados Gateway and keystone

[ghislain.chevalier]

Hi All,

I just would to be sure about keystone configuration for Rados Gateway.

I read the documentation http://ceph.com/docs/master/radosgw/keystone/ and 
http://ceph.com/docs/master/radosgw/config-ref/?highlight=keystone
but I didn't catch if after having configured the rados gateway (ceph.conf) in 
order to use keystone, it becomes mandatory to create all the users in it.

In other words, can a rgw be, at the same, time under keystone control and  
standard radosgw-admin ?
How does it work for S3 users ?

What is the purpose of rgw s3 auth use keystone parameter ?

Best regards

- - - - - - - - - - - - - - - - -
Ghislain Chevalier
+33299124432
+33788624370
ghislain.cheval...@orange.commailto:ghislain.cheval...@orange-ftgroup.com

_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[ceph-users] how to compute Ceph durability?

[ghislain.chevalier]

Hi all,

I would like to compute the durability of data stored in a  ceph environment 
according to the cluster topology (failure domains) and the data resiliency 
(replication/erasure coding).

Does a tool exist ?

Best regards

- - - - - - - - - - - - - - - - -
Ghislain Chevalier ORANGE
+33299124432
+33788624370
ghislain.cheval...@orange.commailto:ghislain.cheval...@orange-ftgroup.com

_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Shadow files

[ghislain.chevalier]

Hi
I just want to tell you there is a rgw object visualisation that could help you 
in our tool called inkscope available on github
Best regards



Envoyé de mon Galaxy Ace4 Orange


 Message d'origine 
De : Italo Santos okd...@gmail.com
Date :12/03/2015 21:26 (GMT+01:00)
À : Ben b@benjackson.email
Cc : Yehuda Sadeh-Weinraub yeh...@redhat.com, ceph-us...@ceph.com
Objet : Re: [ceph-users] Shadow files

Hello Ben,

I’m facing with the same issue - #10295http://tracker.ceph.com/issues/10295 
and I remove the object directly from that rados successfully. But is very 
important map all object before do that. I recommend you take a look to the 
links bellow to understand more about the objects name:

Translating a RadosGW object name into a filename on disk
https://www.mail-archive.com/ceph-users@lists.ceph.com/msg12161.html
http://www.spinics.net/lists/ceph-devel/msg20426.html

Regards.

Italo Santos
http://italosantos.com.br/


On Thursday, March 12, 2015 at 12:25 PM, Yehuda Sadeh-Weinraub wrote:


- Original Message -
From: Ben b@benjackson.emailmailto:b@benjackson.email
To: ceph-us...@ceph.commailto:ceph-us...@ceph.com
Sent: Wednesday, March 11, 2015 8:46:25 PM
Subject: Re: [ceph-users] Shadow files

Anyone got any info on this?

Is it safe to delete shadow files?

It depends. Shadow files are badly named objects that represent part of the 
objects data. They are only safe to remove if you know that the corresponding 
objects no longer exist.

Yehuda


On 2015-03-11 10:03, Ben wrote:
We have a large number of shadow files in our cluster that aren't
being deleted automatically as data is deleted.

Is it safe to delete these files?
Is there something we need to be aware of when deleting them?
Is there a script that we can run that will delete these safely?

Is there something wrong with our cluster that it isn't deleting these
files when it should be?

We are using civetweb with radosgw, with tengine ssl proxy infront of
it

Any advice please
Thanks
___
ceph-users mailing list
ceph-users@lists.ceph.commailto:ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
___
ceph-users mailing list
ceph-users@lists.ceph.commailto:ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[ceph-users] Tr : RadosGW - Bucket link and ACLs

[ghislain.chevalier]

 Message d'origine 
De : CHEVALIER Ghislain IMT/OLPS ghislain.cheval...@orange.com
Date :06/03/2015 21:56 (GMT+01:00)
À : Italo Santos okd...@gmail.com
Cc :
Objet : RE : [ceph-users] RadosGW - Bucket link and ACLs

Hi
We encountered this behavior when developing the rgw admin module in inkscope 
and we fixed it as foĺlowed:
As you created the user access key and secret key with the admin user it seems 
better to create the bucket with these credentials

Best regards

Envoyé de mon Galaxy Ace4 Orange


 Message d'origine 
De : Italo Santos okd...@gmail.com
Date :06/03/2015 20:52 (GMT+01:00)
À : ceph-users@lists.ceph.com
Cc :
Objet : [ceph-users] RadosGW - Bucket link and ACLs

Hello,

I’m building a object storage environment and I’m in trouble with some 
administration ops, to manage the entire environment I decided create an admin 
user and use that to manage the client users which I’ll create further.

Using the admin (called “italux) I created a new user (called cliente”) and 
after that I created a new bucket with the admin user (called cliente-bucket). 
After that, still using the admin, I change the permissions of the 
cliente-bucket” (which is owned by admin) granting FULL_CONTROL to the 
“cliente” user.

So, using the admin API I unlink the “cliente-bucket” from the admin user and 
link to the “cliente” user, changing the ownership of the bucket:

In [86]: url = 
'http://radosgw.example.com/admin/bucket?format=jsonbucket=cliente-bucket'
In [87]: r = requests.get(url, auth=S3Auth(access_key, secret_key, server))
In [88]: r.content
Out[88]: 
'{bucket:cliente-bucket,pool:.rgw.buckets,index_pool:.rgw.buckets.index,id:default.4361528.1,marker:default.4361528.1,owner:cliente,ver:1,master_ver:0,mtime:1425670280,max_marker:,usage:{},bucket_quota:{enabled:false,max_size_kb:-1,max_objects:-1}}’

After that, when I try change the permissions/acls of the bucket using the 
“cliente” user and I’m getting AccessDenied. Looking to the raw debug logs it 
seems that the owner of the bucket wasn’t change. Anyone knows why?

RadosGW debug logs:

2015-03-06 16:32:55.943167 7fd32bf57700  1 == starting new request 
req=0x3cf78a0 =
2015-03-06 16:32:55.943183 7fd32bf57700  2 req 2:0.16::PUT /::initializing
2015-03-06 16:32:55.943189 7fd32bf57700 10 
host=cliente-bucket.radosgw.example.com 
rgw_dns_name=object-storage.locaweb.com.br
2015-03-06 16:32:55.943220 7fd32bf57700 10 s-object=NULL 
s-bucket=cliente-bucket
2015-03-06 16:32:55.943225 7fd32bf57700  2 req 2:0.57:s3:PUT /::getting op
2015-03-06 16:32:55.943230 7fd32bf57700  2 req 2:0.62:s3:PUT 
/:put_acls:authorizing
2015-03-06 16:32:55.943269 7fd32bf57700 10 get_canon_resource(): 
dest=/cliente-bucket/?acl
2015-03-06 16:32:55.943272 7fd32bf57700 10 auth_hdr:
PUT


Fri, 06 Mar 2015 19:32:55 GMT
/cliente-bucket/?acl
2015-03-06 16:32:55.943370 7fd32bf57700 15 calculated 
digest=xtSrQR+GsHyqjqGLdiPmjoP62x4=
2015-03-06 16:32:55.943375 7fd32bf57700 15 
auth_sign=xtSrQR+GsHyqjqGLdiPmjoP62x4=
2015-03-06 16:32:55.943377 7fd32bf57700 15 compare=0
2015-03-06 16:32:55.943384 7fd32bf57700  2 req 2:0.000216:s3:PUT 
/:put_acls:reading permissions
2015-03-06 16:32:55.943425 7fd32bf57700 15 Read 
AccessControlPolicyAccessControlPolicy 
xmlns=http://s3.amazonaws.com/doc/2006-03-01/;OwnerIDitalux/IDDisplayNameItalo
 Santos/DisplayName/OwnerAccessControlListGrantGrantee 
xmlns:xsi=http://www.w3.org/2001/XMLSchema-instance; 
xsi:type=CanonicalUserIDcliente/IDDisplayNameCliente/DisplayName/GranteePermissionFULL_CONTROL/Permission/Grant/AccessControlList/AccessControlPolicy
2015-03-06 16:32:55.943441 7fd32bf57700  2 req 2:0.000273:s3:PUT 
/:put_acls:init op
2015-03-06 16:32:55.943447 7fd32bf57700  2 req 2:0.000280:s3:PUT 
/:put_acls:verifying op mask
2015-03-06 16:32:55.943451 7fd32bf57700 20 required_mask= 2 user.op_mask=7
2015-03-06 16:32:55.943453 7fd32bf57700  2 req 2:0.000286:s3:PUT 
/:put_acls:verifying op permissions
2015-03-06 16:32:55.943457 7fd32bf57700  5 Searching permissions for 
uid=cliente mask=56
2015-03-06 16:32:55.943461 7fd32bf57700  5 Found permission: 15
2015-03-06 16:32:55.943462 7fd32bf57700  5 Searching permissions for group=1 
mask=56
2015-03-06 16:32:55.943464 7fd32bf57700  5 Permissions for group not found
2015-03-06 16:32:55.943466 7fd32bf57700  5 Searching permissions for group=2 
mask=56
2015-03-06 16:32:55.943468 7fd32bf57700  5 Permissions for group not found
2015-03-06 16:32:55.943469 7fd32bf57700  5 Getting permissions id=cliente 
owner=italux perm=8
2015-03-06 16:32:55.943471 7fd32bf57700 10  uid=cliente requested perm 
(type)=8, policy perm=8, user_perm_mask=8, acl perm=8
2015-03-06 16:32:55.943475 7fd32bf57700  2 req 2:0.000308:s3:PUT 
/:put_acls:verifying op params
2015-03-06 16:32:55.943480 7fd32bf57700  2 req 2:0.000313:s3:PUT 
/:put_acls:executing
2015-03-06 16:32:55.943547 7fd32bf57700 15 read len=831 data=?xml 
version=1.0 encoding=UTF-8?AccessControlPolicy 

Re: [ceph-users] question about rgw create bucket

[ghislain.chevalier]

HI all,
I think this question can maybe be linked to the mail I sent (fev 25) related 
to unconsistency between bucket and bucket.instance.
Best regards
De : ceph-users [mailto:ceph-users-boun...@lists.ceph.com] De la part de 
baijia...@126.com
Envoyé : lundi 2 mars 2015 08:00
À : ceph-users; Ceph?Development
Objet : [ceph-users] question about rgw create bucket

when I create bucket, why rgw create 2 objects in the domain root pool.
and one object store struct RGWBucketInfo  and the other object store struct 
RGWBucketEntryPoint

and when I delete the bucket , why rgw only delete one object.


baijia...@126.commailto:baijia...@126.com

_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[ceph-users] [radosgw] unconsistency between bucket and bucket.instance metadata

[ghislain.chevalier]

Hi all,



Context : Firefly 0.80.8, Ubuntu 14.04 LTS, Lab cluster





Yesterday, I successfully deleted a s3 bucket Bucket001ghis after removing 
the contents that were in.



Today, as I was browsing the radosgw system metadata, I discovered an 
difference between the bucket metadata and the bucket.instance metadata as 
followed.

radosgw-admin --name client.radosgw.fr-rennes-radosgw1 metadata list bucket [

bucket001ghis,

   ghis,

bucket001johndoe,

bucket001transfert,

myb1,

mybucket]





radosgw-admin --name client.radosgw.fr-rennes-radosgw1 metadata list 
bucket.instance [

bucket001ghis:fr-rennes-radosgw1.247011.1,

Bucket001ghis:fr-rennes-radosgw1.244654.2,

myb1:fr-rennes-radosgw1.246846.1,

mybucket:fr-rennes-radosgw1.244748.1,

bucket001transfert:fr-rennes-radosgw1.244654.1,

bucket001johndoe:fr-rennes-radosgw1.244742.1,

ghis:fr-rennes-radosgw1.246056.1]



Bucket001ghis:fr-rennes-radosgw1.244654.2 is still referenced in the 
bucket.instance metadata.



What can be the defect?



Best regards






_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[ceph-users] [radosgw] ceph daemon usage

[ghislain.chevalier]

Hi all



Context : Firefly 0.80.8, Ubuntu 14.04 LTS



I tried to change  live  the debug level of a rados gateway using ceph daemon 
/var/run/ceph/ceph-client.radosgw.fr-rennes-radosgw1.asok config set debug_rgw 
20 the response is { success: } but it has no effect.



Is there another parameter to change?



Best regards



- - - - - - - - - - - - - - - - -

Ghislain Chevalier

ORANGE FRANCE


_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] radosgw-agent failed to parse

[ghislain.chevalier]

HI all,

Context : Ubuntu 14.04 TLS firefly 0.80.7

I recently encountered the same issue as described below.
Maybe I missed something between July and January…


I found that the http request wasn't correctly built by 
/usr/lib/python2.7/dist-packages/radosgw_agent/client.py



I did the changes below

#url = '{protocol}://{host}{path}'.format(protocol=request.protocol,

# host=request.host,

# path=request.path)

 url = '{path}'.format(protocol=, host=, path=request.path)



The request is then correctly built and sent.

Best regards

De : ceph-users [mailto:ceph-users-boun...@lists.ceph.com] De la part de Peter
Envoyé : mercredi 23 juillet 2014 13:38
À : Craig Lewis; Ceph Users
Objet : Re: [ceph-users] radosgw-agent failed to parse

hello again,

i have reviewed my deployment, and --name argument is used everywhere with 
radosgw-admin command.

as i create the pools during deploy, there is no rgw.root pool, so i cannot 
make changes to it.

I still think this is an issue with radosgw-agent, as if i change the 
destination on the command line, it also changes in the botched up URL it tries 
to hit:  radosgw-agent http://example2.net; this appears in the error:

DEBUG:boto:url = 
'http://example2.nethttp://example2.net/admin/confighttps://example.comhttps:/example.com/admin/config'

so it is definitely coming from input from command line.
On 22/07/14 20:44, Craig Lewis wrote:
You should use the --name argument with every radosgw-admin command.  If you 
don't, you'll end up making changes to .rgw.root, not .us.rgw.root.

I'd run through the federation setup again, making sure to include the 
appropriate --name.  As Kurt said, it's safe to reload and reapply the configs. 
 Make sure you restart radosgw when it says.

One of my problems during setup was that I had a bad config loaded in 
.rgw.root, but the correct one in .us.rgw.root.  It caused all sorts of 
problems when I forgot the --name arg.

Setting up federation is somewhat sensitive to order of operations.  When I was 
testing it, I frequently messed something up.  Several times it was faster to 
delete all the pools and start over, rather than figuring out what I broke.


On Tue, Jul 22, 2014 at 7:46 AM, Peter 
ptier...@tchpc.tcd.iemailto:ptier...@tchpc.tcd.ie wrote:
adding --name to regionmap update command has allowed me to update the 
regionmap:


radosgw-admin regionmap update --name client.radosgw.us-master-1

so now i have reloaded zone and region and updated region map on the gateway in 
each zone, then restarted whole clusters, then restarted apahce and radosgw, 
same problem.

I cannot see how this can be anything other than an issue inside radosgw-agent 
as it is not hitting the gateway due to the botched


DEBUG:boto:url = 
'https://example.comhttps://example.com/admin/confighttps://example.comhttps:/example.com/admin/config'

Im out of ideas. Should i submit this as a bug?


On 22/07/14 15:25, Bachelder, Kurt wrote:
It certainly doesn’t hurt to reload your zone and region configurations on your 
RGWs and re-run the regionmap update for the instances tied to each zone, just 
to ensure consistency.

From: Peter [mailto:ptier...@tchpc.tcd.ie]
Sent: Tuesday, July 22, 2014 10:20 AM
To: Bachelder, Kurt; Craig Lewis
Cc: Ceph Users
Subject: Re: [ceph-users] radosgw-agent failed to parse

thanks for the suggestion. ive attempted a regionmap update but im hitting this 
error:

failed to list regions: (2) No such file or directory
2014-07-22 14:13:04.096601 7ff825ac77c0 -1 failed to list objects 
pool_iterate_begin() returned r=-2

so perhaps i do have some issue with my configuration. Although i would have 
thought that if the gateway is outputting the correct regionmap at 
/admin/config path, then all should be well with regionmap.


On 22/07/14 14:13, Bachelder, Kurt wrote:
I’m sure you’ve already tried this, but we’ve gotten burned a few times by not 
running radosgw-admin regionmap update after making region/zone changes.  
Bouncing the RGW’s probably wouldn’t hurt either.

From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of Peter
Sent: Tuesday, July 22, 2014 4:51 AM
To: Craig Lewis
Cc: Ceph Users
Subject: Re: [ceph-users] radosgw-agent failed to parse

yes, im scratching my head over this too. It doesn't seem to be an 
authentication issue as the radosgw-agent never reaches the us-secondary 
gateway (i've kept an eye on us-secondary logs as i execute radosgw-agent on 
us-master).

On 22/07/14 03:51, Craig Lewis wrote:
I was hoping for some easy fixes :-P

I created two system users, in both zones.  Each user has different access and 
secret, but I copied the access and secret from the primary to the secondary.  
I can't imaging that this would cause the problem you're seeing, but it is 
something different from the examples.

Sorry, I'm out of ideas.


On Mon, Jul 21, 2014 at 7:13 AM, Peter 

[ceph-users] [rgw] chunk size

[ghislain.chevalier]

Hi all

Context : firefly 0.80.7
OS : ubuntu 14.04.1 LTS

I'd like to change the chunk size for object stored with rgw to 1MB (4MB is the 
default)

I changed ceph.conf setting rgw object stripe size = 1048576 and restarted the 
rgw.

The chunk size remains to 4MB.

I saw in different exchanges that rgw max chunk size must also be set but it's 
not documented.

Is there a guideline to set the right parameters ?

Best regards

Ghislain


_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] [Ceph-rgw] pool assignment

[ghislain.chevalier]

Before configuring region and zone, I would like to known which tags can be 
updated in metadata bucket.instance?

Are there restrictions according to the capabilities applied to radosgw-admin?


-Message d'origine-
De : ceph-users-boun...@lists.ceph.com 
[mailto:ceph-users-boun...@lists.ceph.com] De la part de 
ghislain.cheval...@orange.com
Envoyé : mardi 15 avril 2014 18:21
À : Yehuda Sadeh
Cc : ceph-users@lists.ceph.com
Objet : Re: [ceph-users] [Ceph-rgw] pool assignment

Thanks

Sorry for answering late

I'm going to implement region, zone and placement targets in order to reach my 
goals.

Best regards

-Message d'origine-
De : Yehuda Sadeh [mailto:yeh...@inktank.com] 
Envoyé : vendredi 11 avril 2014 18:34
À : CHEVALIER Ghislain IMT/OLPS
Cc : ceph-users@lists.ceph.com
Objet : Re: [ceph-users] [Ceph-rgw] pool assigment

On Fri, Apr 11, 2014 at 3:20 AM,  ghislain.cheval...@orange.com wrote:
 Hi all,

 Context : CEPH dumpling on Ubuntu 12.04

 I would like to manage as accurately as possible the pools assigned to Rados
 gateway
 My goal is to apply specific SLA to applications which use http-driven
 storage.
 I 'd like to store the contents by associating a pool to a bucket, or a pool
 to a user(account)

 Today, all the contents are stored in .rgw.buckets
 I read in a post that if the pool .rgw.bucketname exists, contents will be
 stored in it, but it fails.

That's incorrect.


 I tried to modify the metadata associated to the bucket but it fails.
 radosgw-admin metadata get bucket:bucketname gives a set information

 { key: bucket:bucketname,
   ver: { tag:  _fimhlBaK9aEKoX--jQKuvjT,
   ver: 1},
   mtime: 1394793288,
   data: { bucket: { name: bucketname,
   pool: .rgw. bucketname,
   index_pool: .rgw. bucketname.index,
   marker: default.9841.1,
   bucket_id: default.9841.1},
   owner: johndoe,
   creation_time: 1394793288,
   linked: true,
   has_bucket_info: false}}

 which don't match with information given by radosgw-admin bucket
 -bucket=bucketname stats
 { bucket: bucketname,
   pool: .rgw.buckets,
   index_pool: .rgw.buckets.index,
   id: default.9841.1,
   marker: default.9841.1,
   owner: johndoe,
   ver: 45,
   master_ver: 0,
   mtime: 1394793288,
   max_marker: ,
   usage: { rgw.main: { size_kb: 3005,
   size_kb_actual: 3016,
   num_objects: 3}}

 Is there a guideline I can rely on in order to reach my goal?


Look here:

http://comments.gmane.org/gmane.comp.file-systems.ceph.user/4992

The idea is to define different placement targets. You can change a
user's default placement target, and on bucket creation users can
define which placement target to use (if they're allowed).

Yehuda

_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.

___
ceph-users mailing list
ceph-users@lists.ceph.com

Re: [ceph-users] [Ceph-rgw] pool assignment

[ghislain.chevalier]

Thanks

Sorry for answering late

I'm going to implement region, zone and placement targets in order to reach my 
goals.

Best regards

-Message d'origine-
De : Yehuda Sadeh [mailto:yeh...@inktank.com] 
Envoyé : vendredi 11 avril 2014 18:34
À : CHEVALIER Ghislain IMT/OLPS
Cc : ceph-users@lists.ceph.com
Objet : Re: [ceph-users] [Ceph-rgw] pool assigment

On Fri, Apr 11, 2014 at 3:20 AM,  ghislain.cheval...@orange.com wrote:
 Hi all,

 Context : CEPH dumpling on Ubuntu 12.04

 I would like to manage as accurately as possible the pools assigned to Rados
 gateway
 My goal is to apply specific SLA to applications which use http-driven
 storage.
 I 'd like to store the contents by associating a pool to a bucket, or a pool
 to a user(account)

 Today, all the contents are stored in .rgw.buckets
 I read in a post that if the pool .rgw.bucketname exists, contents will be
 stored in it, but it fails.

That's incorrect.


 I tried to modify the metadata associated to the bucket but it fails.
 radosgw-admin metadata get bucket:bucketname gives a set information

 { key: bucket:bucketname,
   ver: { tag:  _fimhlBaK9aEKoX--jQKuvjT,
   ver: 1},
   mtime: 1394793288,
   data: { bucket: { name: bucketname,
   pool: .rgw. bucketname,
   index_pool: .rgw. bucketname.index,
   marker: default.9841.1,
   bucket_id: default.9841.1},
   owner: johndoe,
   creation_time: 1394793288,
   linked: true,
   has_bucket_info: false}}

 which don't match with information given by radosgw-admin bucket
 -bucket=bucketname stats
 { bucket: bucketname,
   pool: .rgw.buckets,
   index_pool: .rgw.buckets.index,
   id: default.9841.1,
   marker: default.9841.1,
   owner: johndoe,
   ver: 45,
   master_ver: 0,
   mtime: 1394793288,
   max_marker: ,
   usage: { rgw.main: { size_kb: 3005,
   size_kb_actual: 3016,
   num_objects: 3}}

 Is there a guideline I can rely on in order to reach my goal?


Look here:

http://comments.gmane.org/gmane.comp.file-systems.ceph.user/4992

The idea is to define different placement targets. You can change a
user's default placement target, and on bucket creation users can
define which placement target to use (if they're allowed).

Yehuda

_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[ceph-users] [Ceph-rgw] pool assigment

[ghislain.chevalier]

Hi all,

Context : CEPH dumpling on Ubuntu 12.04

I would like to manage as accurately as possible the pools assigned to Rados 
gateway
My goal is to apply specific SLA to applications which use http-driven storage.
I 'd like to store the contents by associating a pool to a bucket, or a pool to 
a user(account)

Today, all the contents are stored in .rgw.buckets
I read in a post that if the pool .rgw.bucketname exists, contents will be 
stored in it, but it fails.

I tried to modify the metadata associated to the bucket but it fails.
radosgw-admin metadata get bucket:bucketname gives a set information

{ key: bucket:bucketname,
  ver: { tag:  _fimhlBaK9aEKoX--jQKuvjT,
  ver: 1},
  mtime: 1394793288,
  data: { bucket: { name: bucketname,
  pool: .rgw. bucketname,
  index_pool: .rgw. bucketname.index,
  marker: default.9841.1,
  bucket_id: default.9841.1},
  owner: johndoe,
  creation_time: 1394793288,
  linked: true,
  has_bucket_info: false}}

which don't match with information given by radosgw-admin bucket 
-bucket=bucketname stats
{ bucket: bucketname,
  pool: .rgw.buckets,
  index_pool: .rgw.buckets.index,
  id: default.9841.1,
  marker: default.9841.1,
  owner: johndoe,
  ver: 45,
  master_ver: 0,
  mtime: 1394793288,
  max_marker: ,
  usage: { rgw.main: { size_kb: 3005,
  size_kb_actual: 3016,
  num_objects: 3}}

Is there a guideline I can rely on in order to reach my goal?

best regards

- - - - - - - - - - - - - - - - -
Ghislain Chevalier
ORANGE/OLNC/OLPS/ASE/DAPI/CSE
Storage Service Architect
 +33299124432
ghislain.cheval...@orange.commailto:ghislain.cheval...@orange-ftgroup.com
* Pensez à l'Environnement avant d'imprimer ce message !




_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[ceph-users] Failure in OSD creation process using ceph-deploy

[ghislain.chevalier]

Hi all,

I'd like to submit a strange behavior...

Context : lab platform
CEPH emperor
Ceph-deploy 1.3.4
Ubuntu 12.04

Issue:
We have 3 OSD up and running; we encountered no difficulties in creating them.
We tried to create an osd.3 using ceph-deploy on a storage node (r-cephosd301) 
from an admin server (r-cephrgw01)
We have to use an external SATA 3 TB disk; the journal will be set on the first 
sectors.
We encountered a lot of problems but we succeeded.

As we also encountered the same difficulties creating the osd.4  
(r-cephosd302), I decided to trace the process.

We had the following lines in ceph.conf (journal size is set in the osd section 
because it's not taken into account in osd.4 section)
[osd.4]
host = r-cephosd302
public_addr = 10.194.182.52
cluster_addr = 192.168.182.52

root@r-cephrgw01:/etc/ceph# ceph-deploy --overwrite-conf osd --zap-disk create 
r-cephosd302:/dev/sdc
[ceph_deploy.cli][INFO  ] Invoked (1.3.4): /usr/bin/ceph-deploy 
--overwrite-conf osd --zap-disk create r-cephosd302:/dev/sdc
[ceph_deploy.osd][DEBUG ] Preparing cluster ceph disks r-cephosd302:/dev/sdc:
[r-cephosd302][DEBUG ] connected to host: r-cephosd302
[r-cephosd302][DEBUG ] detect platform information from remote host
[r-cephosd302][DEBUG ] detect machine type
[ceph_deploy.osd][INFO  ] Distro info: Ubuntu 12.04 precise
[ceph_deploy.osd][DEBUG ] Deploying osd to r-cephosd302
[r-cephosd302][DEBUG ] write cluster configuration to /etc/ceph/{cluster}.conf
[r-cephosd302][INFO  ] Running command: udevadm trigger --subsystem-match=block 
--action=add
[ceph_deploy.osd][DEBUG ] Preparing host r-cephosd302 disk /dev/sdc journal 
None activate True
[r-cephosd302][INFO  ] Running command: ceph-disk-prepare --zap-disk --fs-type 
xfs --cluster ceph -- /dev/sdc
[r-cephosd302][WARNIN] Caution: invalid backup GPT header, but valid main 
header; regenerating
[r-cephosd302][WARNIN] backup header from main header.
[r-cephosd302][WARNIN]
[r-cephosd302][WARNIN] Warning! Main and backup partition tables differ! Use 
the 'c' and 'e' options
[r-cephosd302][WARNIN] on the recovery  transformation menu to examine the two 
tables.
[r-cephosd302][WARNIN]
[r-cephosd302][WARNIN] Warning! One or more CRCs don't match. You should repair 
the disk!
[r-cephosd302][WARNIN]
[r-cephosd302][WARNIN] INFO:ceph-disk:Will colocate journal with data on 
/dev/sdc
[r-cephosd302][DEBUG ] 

[r-cephosd302][DEBUG ] Caution: Found protective or hybrid MBR and corrupt GPT. 
Using GPT, but disk
[r-cephosd302][DEBUG ] verification and recovery are STRONGLY recommended.
[r-cephosd302][DEBUG ] 

[r-cephosd302][DEBUG ] GPT data structures destroyed! You may now partition the 
disk using fdisk or
[r-cephosd302][DEBUG ] other utilities.
[r-cephosd302][DEBUG ] The operation has completed successfully.
[r-cephosd302][DEBUG ] Information: Moved requested sector from 34 to 2048 in
[r-cephosd302][DEBUG ] order to align on 2048-sector boundaries.
[r-cephosd302][DEBUG ] The operation has completed successfully.
[r-cephosd302][DEBUG ] Information: Moved requested sector from 38912001 to 
38914048 in
[r-cephosd302][DEBUG ] order to align on 2048-sector boundaries.
[r-cephosd302][DEBUG ] The operation has completed successfully.
[r-cephosd302][DEBUG ] meta-data=/dev/sdc1  isize=2048   agcount=4, 
agsize=181925597 blks
[r-cephosd302][DEBUG ]  =   sectsz=512   attr=2, 
projid32bit=0
[r-cephosd302][DEBUG ] data =   bsize=4096   
blocks=727702385, imaxpct=5
[r-cephosd302][DEBUG ]  =   sunit=0  swidth=0 
blks
[r-cephosd302][DEBUG ] naming   =version 2  bsize=4096   ascii-ci=0
[r-cephosd302][DEBUG ] log  =internal log   bsize=4096   
blocks=355323, version=2
[r-cephosd302][DEBUG ]  =   sectsz=512   sunit=0 
blks, lazy-count=1
[r-cephosd302][DEBUG ] realtime =none   extsz=4096   blocks=0, 
rtextents=0
[r-cephosd302][DEBUG ] The operation has completed successfully.
[r-cephosd302][INFO  ] Running command: udevadm trigger --subsystem-match=block 
--action=add
[ceph_deploy.osd][DEBUG ] Host r-cephosd302 is now ready for osd use.

the process seems to finish normally, but...

root@r-cephrgw01:/etc/ceph# ceph osd tree
# idweight  type name   up/down reweight
-1  4.06root default
-2  0.45host r-cephosd101
0   0.45osd.0   up  1
-3  0.45host r-cephosd102
1   0.45osd.1   up  1
-4  0.45host r-cephosd103
2   0.45osd.2   up  1
-5  2.71host r-cephosd301
3   2.71osd.3   up  1

The OSD is not in the cluster and it seems that Ceph tried to create a new 
osd.0 according to the log file found on the remote