Re: [ceph-users] krbd map on Jewel, sysfs write failed when rbd map

2016-04-26 Thread Ilya Dryomov 
On Tue, Apr 26, 2016 at 5:45 PM, Somnath Roy  wrote:
> By default image format is 2 in jewel which is not supported by krbd..try
> creating image with --image-format 1 and it should be resolved..

With the default striping pattern (no --stripe-unit or --stripe-count
at create time), --image-format 2 is supported by krbd since kernel
3.10.

Thanks,

Ilya
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] krbd map on Jewel, sysfs write failed when rbd map

2016-04-26 Thread Somnath Roy 
By default image format is 2 in jewel which is not supported by krbd..try 
creating image with --image-format 1 and it should be resolved..

Thanks
Somnath

Sent from my iPhone

On Apr 25, 2016, at 9:38 PM, 
"wd_hw...@wistron.com" 
> wrote:

Dear Cephers:
  I got the same issue under Ubuntu 14.04, even I try to use the image format 
‘1’.
# modinfo rbd
filename:   /lib/modules/3.13.0-85-generic/kernel/drivers/block/rbd.ko
license:GPL
author: Jeff Garzik >
description:rados block device
author: Yehuda Sadeh 
>
author: Sage Weil >
author: Alex Elder >
srcversion: 48BFBD5C3D31D799F01D218
depends:libceph
intree: Y
vermagic:   3.13.0-85-generic SMP mod_unload modversions
signer: Magrathea: Glacier signing key
sig_key:C6:33:E9:BF:A6:CA:49:D5:3D:2E:B5:25:6A:35:87:7D:04:F1:64:F8
sig_hashalgo:   sha512

##
# rbd info block_data/data01
rbd image 'data01':
size 10240 MB in 2560 objects
order 22 (4096 kB objects)
block_name_prefix: rbd_data.540752ae8944a
format: 2
features:
flags:
# rbd map block_data/data01
rbd: sysfs write failed
rbd: map failed: (5) Input/output error

##
# rbd info block_data/data02
rbd image 'data02':
size 10240 MB in 2560 objects
order 22 (4096 kB objects)
block_name_prefix: rbd_data.2aac0238e1f29
format: 2
features: layering
   flags:
# rbd map block_data/data02
rbd: sysfs write failed
rbd: map failed: (5) Input/output error

  Is there any new idea to solve this issue?

Thanks a lot,
WD

---

This email contains confidential or legally privileged information and is for 
the sole use of its intended recipient.

Any unauthorized review, use, copying or distribution of this email or the 
content of this email is strictly prohibited.

If you are not the intended recipient, you may reply to the sender and should 
delete this e-mail immediately.

---

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
PLEASE NOTE: The information contained in this electronic mail message is 
intended only for the use of the designated recipient(s) named above. If the 
reader of this message is not the intended recipient, you are hereby notified 
that you have received this message in error and that any review, 
dissemination, distribution, or copying of this message is strictly prohibited. 
If you have received this communication in error, please notify the sender by 
telephone or e-mail (as shown above) immediately and destroy any and all copies 
of this message in your possession (whether hard copies or electronically 
stored copies).
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] krbd map on Jewel, sysfs write failed when rbd map

2016-04-26 Thread Stefan Lissmats 
Hello again!

I normally map with rbd map data03 -p block_data but your format should work.
Mabye it's woth a try anyway?
Is there any more explaining errors in dmesg after trying to map the image?
Maybe there could be some clue what's happening there?
Also is there any possibility to update the kernel? I see the kernel is quite 
old. In Ubuntu 14.04.4 the kernel version is now at 3.16.0-70-generic.

Regards
Stefan


Från: wd_hw...@wistron.com [wd_hw...@wistron.com]
Skickat: den 26 april 2016 08:30
Till: Stefan Lissmats; ceph-users-boun...@lists.ceph.com
Kopia: ceph-users@lists.ceph.com
Ämne: RE: [ceph-users] krbd map on Jewel, sysfs write failed when rbd map

Hello:
  Sorry for that I forgot paste the results of image format 1. And I still 
cannot mount the format 1 or 2 block on Ubuntu 14.04 client, which the kernel 
is 3.13.0-85-generic #129-Ubuntu.

##
# rbd create block_data/data03 -s 10G --image-format 1
rbd: image format 1 is deprecated

# rbd info block_data/data03
2016-04-26 14:21:47.033360 7fb74e438700 -1 librbd::image::OpenRequest: RBD 
image format 1 is deprecated. Please copy this image to image format 2.
rbd image 'data03':
size 10240 MB in 2560 objects
order 22 (4096 kB objects)
block_name_prefix: rb.0.541ab.2ae8944a
format: 1

# rbd map block_data/data03
rbd: sysfs write failed
rbd: map failed: (5) Input/output error

Thanks a lot.
WD

From: Stefan Lissmats [mailto:ste...@trimmat.se]
Sent: Tuesday, April 26, 2016 2:15 PM
To: WD Hwang/WHQ/Wistron; ceph-users-boun...@lists.ceph.com
Cc: ceph-users@lists.ceph.com
Subject: SV: [ceph-users] krbd map on Jewel, sysfs write failed when rbd map

Hello!

It seems you referring to an earlier message but i can't find it.
It doesn't look that you have created image format 1 images.
I have created images in Jewel (10.2.0 and also som erlier releases) with the 
switch --image-format 1 and seems to work perfectly even if it's a depreciated 
switch and causes warnings i have used it successfully with krbd and Ubuntu 
14.04.
The image format is going to stop workning i future releases as I understand så 
using this should probably just be used if you don't plan to use them for 
production for an extended time.

Regards
Stefan


Från: ceph-users [ceph-users-boun...@lists.ceph.com] för 
wd_hw...@wistron.com<mailto:wd_hw...@wistron.com> [wd_hw...@wistron.com]
Skickat: den 26 april 2016 04:32
Till: 
ceph-users-boun...@lists.ceph.com<mailto:ceph-users-boun...@lists.ceph.com>
Kopia: ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com>
Ämne: Re: [ceph-users] krbd map on Jewel, sysfs write failed when rbd map
Dear Cephers:
  I got the same issue under Ubuntu 14.04, even I try to use the image format 
‘1’.
# modinfo rbd
filename:   /lib/modules/3.13.0-85-generic/kernel/drivers/block/rbd.ko
license:GPL
author: Jeff Garzik <j...@garzik.org<mailto:j...@garzik.org>>
description:rados block device
author: Yehuda Sadeh 
<yeh...@hq.newdream.net<mailto:yeh...@hq.newdream.net>>
author: Sage Weil <s...@newdream.net<mailto:s...@newdream.net>>
author: Alex Elder <el...@inktank.com<mailto:el...@inktank.com>>
srcversion: 48BFBD5C3D31D799F01D218
depends:libceph
intree: Y
vermagic:   3.13.0-85-generic SMP mod_unload modversions
signer: Magrathea: Glacier signing key
sig_key:C6:33:E9:BF:A6:CA:49:D5:3D:2E:B5:25:6A:35:87:7D:04:F1:64:F8
sig_hashalgo:   sha512

##
# rbd info block_data/data01
rbd image 'data01':
size 10240 MB in 2560 objects
order 22 (4096 kB objects)
block_name_prefix: rbd_data.540752ae8944a
format: 2
features:
flags:
# rbd map block_data/data01
rbd: sysfs write failed
rbd: map failed: (5) Input/output error

##
# rbd info block_data/data02
rbd image 'data02':
size 10240 MB in 2560 objects
order 22 (4096 kB objects)
block_name_prefix: rbd_data.2aac0238e1f29
format: 2
features: layering
   flags:
# rbd map block_data/data02
rbd: sysfs write failed
rbd: map failed: (5) Input/output error

  Is there any new idea to solve this issue?

Thanks a lot,
WD

---

This email contains confidential or legally privileged information and is for 
the sole use of its intended recipient.

Any unauthorized review, use, copying or distribution of this email or the 
content of this email is strictly prohibited.

If you are not the intended recipient, you may reply to the sender and should 
delete this e-mail immediately.

--

Re: [ceph-users] krbd map on Jewel, sysfs write failed when rbd map

2016-04-26 Thread WD_Hwang 
Hello:
  Sorry for that I forgot paste the results of image format 1. And I still 
cannot mount the format 1 or 2 block on Ubuntu 14.04 client, which the kernel 
is 3.13.0-85-generic #129-Ubuntu.

##
# rbd create block_data/data03 -s 10G --image-format 1
rbd: image format 1 is deprecated

# rbd info block_data/data03
2016-04-26 14:21:47.033360 7fb74e438700 -1 librbd::image::OpenRequest: RBD 
image format 1 is deprecated. Please copy this image to image format 2.
rbd image 'data03':
size 10240 MB in 2560 objects
order 22 (4096 kB objects)
block_name_prefix: rb.0.541ab.2ae8944a
format: 1

# rbd map block_data/data03
rbd: sysfs write failed
rbd: map failed: (5) Input/output error

Thanks a lot.
WD

From: Stefan Lissmats [mailto:ste...@trimmat.se]
Sent: Tuesday, April 26, 2016 2:15 PM
To: WD Hwang/WHQ/Wistron; ceph-users-boun...@lists.ceph.com
Cc: ceph-users@lists.ceph.com
Subject: SV: [ceph-users] krbd map on Jewel, sysfs write failed when rbd map

Hello!

It seems you referring to an earlier message but i can't find it.
It doesn't look that you have created image format 1 images.
I have created images in Jewel (10.2.0 and also som erlier releases) with the 
switch --image-format 1 and seems to work perfectly even if it's a depreciated 
switch and causes warnings i have used it successfully with krbd and Ubuntu 
14.04.
The image format is going to stop workning i future releases as I understand så 
using this should probably just be used if you don't plan to use them for 
production for an extended time.

Regards
Stefan


Från: ceph-users [ceph-users-boun...@lists.ceph.com] för 
wd_hw...@wistron.com<mailto:wd_hw...@wistron.com> [wd_hw...@wistron.com]
Skickat: den 26 april 2016 04:32
Till: 
ceph-users-boun...@lists.ceph.com<mailto:ceph-users-boun...@lists.ceph.com>
Kopia: ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com>
Ämne: Re: [ceph-users] krbd map on Jewel, sysfs write failed when rbd map
Dear Cephers:
  I got the same issue under Ubuntu 14.04, even I try to use the image format 
'1'.
# modinfo rbd
filename:   /lib/modules/3.13.0-85-generic/kernel/drivers/block/rbd.ko
license:GPL
author: Jeff Garzik <j...@garzik.org<mailto:j...@garzik.org>>
description:rados block device
author: Yehuda Sadeh 
<yeh...@hq.newdream.net<mailto:yeh...@hq.newdream.net>>
author: Sage Weil <s...@newdream.net<mailto:s...@newdream.net>>
author: Alex Elder <el...@inktank.com<mailto:el...@inktank.com>>
srcversion: 48BFBD5C3D31D799F01D218
depends:libceph
intree: Y
vermagic:   3.13.0-85-generic SMP mod_unload modversions
signer: Magrathea: Glacier signing key
sig_key:C6:33:E9:BF:A6:CA:49:D5:3D:2E:B5:25:6A:35:87:7D:04:F1:64:F8
sig_hashalgo:   sha512

##
# rbd info block_data/data01
rbd image 'data01':
size 10240 MB in 2560 objects
order 22 (4096 kB objects)
block_name_prefix: rbd_data.540752ae8944a
format: 2
features:
flags:
# rbd map block_data/data01
rbd: sysfs write failed
rbd: map failed: (5) Input/output error

##
# rbd info block_data/data02
rbd image 'data02':
size 10240 MB in 2560 objects
order 22 (4096 kB objects)
block_name_prefix: rbd_data.2aac0238e1f29
format: 2
features: layering
   flags:
# rbd map block_data/data02
rbd: sysfs write failed
rbd: map failed: (5) Input/output error

  Is there any new idea to solve this issue?

Thanks a lot,
WD

---

This email contains confidential or legally privileged information and is for 
the sole use of its intended recipient.

Any unauthorized review, use, copying or distribution of this email or the 
content of this email is strictly prohibited.

If you are not the intended recipient, you may reply to the sender and should 
delete this e-mail immediately.

---
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] krbd map on Jewel, sysfs write failed when rbd map

2016-04-26 Thread Stefan Lissmats 
Hello!

It seems you referring to an earlier message but i can't find it.
It doesn't look that you have created image format 1 images.
I have created images in Jewel (10.2.0 and also som erlier releases) with the 
switch --image-format 1 and seems to work perfectly even if it's a depreciated 
switch and causes warnings i have used it successfully with krbd and Ubuntu 
14.04.
The image format is going to stop workning i future releases as I understand så 
using this should probably just be used if you don't plan to use them for 
production for an extended time.

Regards
Stefan


Från: ceph-users [ceph-users-boun...@lists.ceph.com] för wd_hw...@wistron.com 
[wd_hw...@wistron.com]
Skickat: den 26 april 2016 04:32
Till: ceph-users-boun...@lists.ceph.com
Kopia: ceph-users@lists.ceph.com
Ämne: Re: [ceph-users] krbd map on Jewel, sysfs write failed when rbd map

Dear Cephers:
  I got the same issue under Ubuntu 14.04, even I try to use the image format 
‘1’.
# modinfo rbd
filename:   /lib/modules/3.13.0-85-generic/kernel/drivers/block/rbd.ko
license:GPL
author: Jeff Garzik <j...@garzik.org>
description:rados block device
author: Yehuda Sadeh <yeh...@hq.newdream.net>
author: Sage Weil <s...@newdream.net>
author: Alex Elder <el...@inktank.com>
srcversion: 48BFBD5C3D31D799F01D218
depends:libceph
intree: Y
vermagic:   3.13.0-85-generic SMP mod_unload modversions
signer: Magrathea: Glacier signing key
sig_key:C6:33:E9:BF:A6:CA:49:D5:3D:2E:B5:25:6A:35:87:7D:04:F1:64:F8
sig_hashalgo:   sha512

##
# rbd info block_data/data01
rbd image 'data01':
size 10240 MB in 2560 objects
order 22 (4096 kB objects)
block_name_prefix: rbd_data.540752ae8944a
format: 2
features:
flags:
# rbd map block_data/data01
rbd: sysfs write failed
rbd: map failed: (5) Input/output error

##
# rbd info block_data/data02
rbd image 'data02':
size 10240 MB in 2560 objects
order 22 (4096 kB objects)
block_name_prefix: rbd_data.2aac0238e1f29
format: 2
features: layering
   flags:
# rbd map block_data/data02
rbd: sysfs write failed
rbd: map failed: (5) Input/output error

  Is there any new idea to solve this issue?

Thanks a lot,
WD

---

This email contains confidential or legally privileged information and is for 
the sole use of its intended recipient.

Any unauthorized review, use, copying or distribution of this email or the 
content of this email is strictly prohibited.

If you are not the intended recipient, you may reply to the sender and should 
delete this e-mail immediately.

---
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] krbd map on Jewel, sysfs write failed when rbd map

2016-04-25 Thread WD_Hwang 
Dear Cephers:
  I got the same issue under Ubuntu 14.04, even I try to use the image format 
‘1’.
# modinfo rbd
filename:   /lib/modules/3.13.0-85-generic/kernel/drivers/block/rbd.ko
license:GPL
author: Jeff Garzik 
description:rados block device
author: Yehuda Sadeh 
author: Sage Weil 
author: Alex Elder 
srcversion: 48BFBD5C3D31D799F01D218
depends:libceph
intree: Y
vermagic:   3.13.0-85-generic SMP mod_unload modversions
signer: Magrathea: Glacier signing key
sig_key:C6:33:E9:BF:A6:CA:49:D5:3D:2E:B5:25:6A:35:87:7D:04:F1:64:F8
sig_hashalgo:   sha512

##
# rbd info block_data/data01
rbd image 'data01':
size 10240 MB in 2560 objects
order 22 (4096 kB objects)
block_name_prefix: rbd_data.540752ae8944a
format: 2
features:
flags:
# rbd map block_data/data01
rbd: sysfs write failed
rbd: map failed: (5) Input/output error

##
# rbd info block_data/data02
rbd image 'data02':
size 10240 MB in 2560 objects
order 22 (4096 kB objects)
block_name_prefix: rbd_data.2aac0238e1f29
format: 2
features: layering
   flags:
# rbd map block_data/data02
rbd: sysfs write failed
rbd: map failed: (5) Input/output error

  Is there any new idea to solve this issue?

Thanks a lot,
WD

---
This email contains confidential or legally privileged information and is for 
the sole use of its intended recipient. 
Any unauthorized review, use, copying or distribution of this email or the 
content of this email is strictly prohibited.
If you are not the intended recipient, you may reply to the sender and should 
delete this e-mail immediately.
---
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] krbd map on Jewel, sysfs write failed when rbd map

2016-04-21 Thread Jason Dillaman 
Slight clarification: to disable these features on existing images, you
should run the following:

rbd feature disable  deep-flatten,fast-diff,object-map,
exclusive-lock

(note the commas instead of the spaces when disabling multiple features at
once).

--

Jason

On Thu, Apr 21, 2016 at 4:48 AM, Ilya Dryomov  wrote:

> On Thu, Apr 21, 2016 at 11:41 AM, Mika c  wrote:
> > Hi xizhiyong,
> > Thanks for your infomation. I am using Jewel right now(10.1.2), the
> > setting "rbd_default_features = 3" not working for me.
> > And this setting will enable "exclusive-lock, object-map, fast-diff,
> > deep-flatten" features.
>
> Setting "rbd default features = 3" will ensure that new images are
> created with only layering and stripingv2 features enabled.  To disable
> exclusive-lock, object-map, etc on the already created image, you have
> to use "rbd feature disable".
>
> Where are you setting it?  It has to be set in the client-side
> ceph.conf, as it's the client who decides which feature bits to enable
> on creation.  Setting it on the OSDs will have no effect.
>
> Thanks,
>
> Ilya
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] krbd map on Jewel, sysfs write failed when rbd map

2016-04-21 Thread 席智勇 
hi:
I am using the same verion with you.
This set only effects new created volumes.

2016-04-21 17:41 GMT+08:00 Mika c :

> Hi xizhiyong,
> Thanks for your infomation. I am using Jewel right now(10.1.2), the
> setting "rbd_default_features = 3" not working for me.
> And this setting will enable "exclusive-lock, object-map, fast-diff,
> deep-flatten" features.
>
>
>
>
> Best wishes,
> Mika
>
>
> 2016-04-21 16:56 GMT+08:00 席智勇 :
>
>> That's true for me too.
>> You can disable them via set in the conf file.
>>
>> #ceph.conf
>> rbd_default_features = 3
>> #meens only enable layering and striping
>>
>> 2016-04-21 16:00 GMT+08:00 Mika c :
>>
>>> Hi cephers,
>>> Had the same issue too. But the command "rbd feature disable" not
>>> working to me.
>>> Any comment will be appreciated.
>>>
>>> $sudo rbd feature disable timg1 deep-flatten fast-diff object-map
>>> exclusive-lock
>>> rbd: failed to update image features: (22) Invalid argument
>>> 2016-04-21 15:53:10.260671 7f95ff5d9d80 -1 librbd: failed to update
>>> features: (22) Invalid argument
>>>
>>>
>>>
>>> Best wishes,
>>> Mika
>>>
>>>
>>> 2016-04-19 18:44 GMT+08:00 Ilya Dryomov :
>>>
 On Mon, Apr 18, 2016 at 11:58 AM, Tim Bishop 
 wrote:
 > I had the same issue when testing on Ubuntu xenial beta. That has 4.4,
 > so should be fine? I had to create images without the new RBD features
 > to make it works.

 None of the "new" features are currently supported by krbd.  4.7 will
 support exclusive-lock with most of the rest following in 4.8.

 You don't have to recreate images: while those features are enabled in
 jewel by default, you should be able to dynamically disable them with
 "rbd feature disable imagename deep-flatten fast-diff object-map
 exclusive-lock".

 Thanks,

 Ilya
 ___
 ceph-users mailing list
 ceph-users@lists.ceph.com
 http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

>>>
>>>
>>> ___
>>> ceph-users mailing list
>>> ceph-users@lists.ceph.com
>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>>
>>>
>>
>
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] krbd map on Jewel, sysfs write failed when rbd map

2016-04-21 Thread Ilya Dryomov 
On Thu, Apr 21, 2016 at 10:00 AM, Mika c  wrote:
> Hi cephers,
> Had the same issue too. But the command "rbd feature disable" not
> working to me.
> Any comment will be appreciated.
>
> $sudo rbd feature disable timg1 deep-flatten fast-diff object-map
> exclusive-lock
> rbd: failed to update image features: (22) Invalid argument
> 2016-04-21 15:53:10.260671 7f95ff5d9d80 -1 librbd: failed to update
> features: (22) Invalid argument

What's the output of

$ rbd info timg1

Could you try again with

$ rbd --debug-rbd 20 feature disable timg1 deep-flatten fast-diff
object-map exclusive-lock

Thanks,

Ilya
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] krbd map on Jewel, sysfs write failed when rbd map

2016-04-21 Thread Mika c 
Hi xizhiyong,
Thanks for your infomation. I am using Jewel right now(10.1.2), the
setting "rbd_default_features = 3" not working for me.
And this setting will enable "exclusive-lock, object-map, fast-diff,
deep-flatten" features.




Best wishes,
Mika


2016-04-21 16:56 GMT+08:00 席智勇 :

> That's true for me too.
> You can disable them via set in the conf file.
>
> #ceph.conf
> rbd_default_features = 3
> #meens only enable layering and striping
>
> 2016-04-21 16:00 GMT+08:00 Mika c :
>
>> Hi cephers,
>> Had the same issue too. But the command "rbd feature disable" not
>> working to me.
>> Any comment will be appreciated.
>>
>> $sudo rbd feature disable timg1 deep-flatten fast-diff object-map
>> exclusive-lock
>> rbd: failed to update image features: (22) Invalid argument
>> 2016-04-21 15:53:10.260671 7f95ff5d9d80 -1 librbd: failed to update
>> features: (22) Invalid argument
>>
>>
>>
>> Best wishes,
>> Mika
>>
>>
>> 2016-04-19 18:44 GMT+08:00 Ilya Dryomov :
>>
>>> On Mon, Apr 18, 2016 at 11:58 AM, Tim Bishop 
>>> wrote:
>>> > I had the same issue when testing on Ubuntu xenial beta. That has 4.4,
>>> > so should be fine? I had to create images without the new RBD features
>>> > to make it works.
>>>
>>> None of the "new" features are currently supported by krbd.  4.7 will
>>> support exclusive-lock with most of the rest following in 4.8.
>>>
>>> You don't have to recreate images: while those features are enabled in
>>> jewel by default, you should be able to dynamically disable them with
>>> "rbd feature disable imagename deep-flatten fast-diff object-map
>>> exclusive-lock".
>>>
>>> Thanks,
>>>
>>> Ilya
>>> ___
>>> ceph-users mailing list
>>> ceph-users@lists.ceph.com
>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>>
>>
>>
>> ___
>> ceph-users mailing list
>> ceph-users@lists.ceph.com
>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>
>>
>
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] krbd map on Jewel, sysfs write failed when rbd map

2016-04-21 Thread 席智勇 
That's true for me too.
You can disable them via set in the conf file.

#ceph.conf
rbd_default_features = 3
#meens only enable layering and striping

2016-04-21 16:00 GMT+08:00 Mika c :

> Hi cephers,
> Had the same issue too. But the command "rbd feature disable" not
> working to me.
> Any comment will be appreciated.
>
> $sudo rbd feature disable timg1 deep-flatten fast-diff object-map
> exclusive-lock
> rbd: failed to update image features: (22) Invalid argument
> 2016-04-21 15:53:10.260671 7f95ff5d9d80 -1 librbd: failed to update
> features: (22) Invalid argument
>
>
>
> Best wishes,
> Mika
>
>
> 2016-04-19 18:44 GMT+08:00 Ilya Dryomov :
>
>> On Mon, Apr 18, 2016 at 11:58 AM, Tim Bishop 
>> wrote:
>> > I had the same issue when testing on Ubuntu xenial beta. That has 4.4,
>> > so should be fine? I had to create images without the new RBD features
>> > to make it works.
>>
>> None of the "new" features are currently supported by krbd.  4.7 will
>> support exclusive-lock with most of the rest following in 4.8.
>>
>> You don't have to recreate images: while those features are enabled in
>> jewel by default, you should be able to dynamically disable them with
>> "rbd feature disable imagename deep-flatten fast-diff object-map
>> exclusive-lock".
>>
>> Thanks,
>>
>> Ilya
>> ___
>> ceph-users mailing list
>> ceph-users@lists.ceph.com
>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>
>
>
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
>
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] krbd map on Jewel, sysfs write failed when rbd map

2016-04-21 Thread Mika c 
Hi cephers,
Had the same issue too. But the command "rbd feature disable" not
working to me.
Any comment will be appreciated.

$sudo rbd feature disable timg1 deep-flatten fast-diff object-map
exclusive-lock
rbd: failed to update image features: (22) Invalid argument
2016-04-21 15:53:10.260671 7f95ff5d9d80 -1 librbd: failed to update
features: (22) Invalid argument



Best wishes,
Mika


2016-04-19 18:44 GMT+08:00 Ilya Dryomov :

> On Mon, Apr 18, 2016 at 11:58 AM, Tim Bishop 
> wrote:
> > I had the same issue when testing on Ubuntu xenial beta. That has 4.4,
> > so should be fine? I had to create images without the new RBD features
> > to make it works.
>
> None of the "new" features are currently supported by krbd.  4.7 will
> support exclusive-lock with most of the rest following in 4.8.
>
> You don't have to recreate images: while those features are enabled in
> jewel by default, you should be able to dynamically disable them with
> "rbd feature disable imagename deep-flatten fast-diff object-map
> exclusive-lock".
>
> Thanks,
>
> Ilya
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] krbd map on Jewel, sysfs write failed when rbd map

2016-04-19 Thread Ilya Dryomov 
On Mon, Apr 18, 2016 at 11:58 AM, Tim Bishop  wrote:
> I had the same issue when testing on Ubuntu xenial beta. That has 4.4,
> so should be fine? I had to create images without the new RBD features
> to make it works.

None of the "new" features are currently supported by krbd.  4.7 will
support exclusive-lock with most of the rest following in 4.8.

You don't have to recreate images: while those features are enabled in
jewel by default, you should be able to dynamically disable them with
"rbd feature disable imagename deep-flatten fast-diff object-map
exclusive-lock".

Thanks,

Ilya
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] krbd map on Jewel, sysfs write failed when rbd map

2016-04-18 Thread Tim Bishop 
I had the same issue when testing on Ubuntu xenial beta. That has 4.4,
so should be fine? I had to create images without the new RBD features
to make it works.

% ceph -v
ceph version 10.1.2 (4a2a6f72640d6b74a3bbd92798bb913ed380dcd4)

% modinfo rbd
filename:   /lib/modules/4.4.0-18-generic/kernel/drivers/block/rbd.ko
license:GPL
description:RADOS Block Device (RBD) driver
author: Jeff Garzik 
author: Yehuda Sadeh 
author: Sage Weil 
author: Alex Elder 
srcversion: 9453A7FA5C504B1C95EDA8A
depends:libceph
intree: Y
vermagic:   4.4.0-18-generic SMP mod_unload modversions
parm:   single_major:Use a single major number for all rbd
devices (default: false) (bool)

% uname -a
Linux xtest 4.4.0-18-generic #34-Ubuntu SMP Wed Apr 6 14:01:02 UTC 2016 x86_64 
x86_64 x86_64 GNU/Linux

Tim.

On Mon, Apr 18, 2016 at 09:51:45AM +, Varada Kari wrote:
> Using any kernel >= 4.2 shouldn't have any problem. If you are using
> kernel version < 4.2, disable the recent features except layering.
> Varada
> 
> On Monday 18 April 2016 02:41 PM, $B@JCRM&(B wrote:
> 
> thanks for ur reply~
> I did some search, and found the reason, like the
> mail([1]http://lists.ceph.com/pipermail/ceph-users-ceph.com/2015-Septem
> ber/004928.html) said, that because the krbd still not yet support the
> new RBD features like exclusive-lock.
> 
> 2016-04-18 16:45 GMT+08:00 huang jun <[2]hjwsm1...@gmail.com>:
> 
> Hi, can you post the 'modinfo rbd' and your cluster state 'ceph -s'.
> 
> 2016-04-18 16:35 GMT+08:00 $B@JCRM&(B <[3]xizhiyon...@gmail.com>:
> > hi cephers:
> >
> > I create a rbd volume(image) on Jewel release, when exec rbd map, I
> got the
> > error message as follows.i can not  find any message usage in
> > syslog/kern.log/messages.
> > anyone can share some tips?
> >
> > --my ceph
> > version
> > root@hzbxs-xzy-ceph-dev-mon:~/ceph-cluster# ceph -v
> > ceph version 10.1.2 (4a2a6f72640d6b74a3bbd92798bb913ed380dcd4)
> > -system
> > info
> > root@hzbxs-xzy-ceph-dev-mon:~/ceph-cluster# cat /etc/debian_version
> > 8.4
> > root@hzbxs-xzy-ceph-dev-mon:~/ceph-cluster# uname -a
> > Linux hzbxs-xzy-ceph-dev-mon 3.16.0-4-amd64 #1 SMP Debian
> 3.16.7-ckt25-2
> > (2016-04-08) x86_64 GNU/Linux
> > --my screen
> > snap-
> > root@hzbxs-xzy-ceph-dev-mon:~/ceph-cluster# ceph osd lspools
> > 2016-04-18 16:24:24.691909 7fb08663b700 -1 WARNING: the following
> dangerous
> > and experimental features are enabled: bluestore,rocksdb
> > 2016-04-18 16:24:24.701003 7fb08663b700 -1 WARNING: the following
> dangerous
> > and experimental features are enabled: bluestore,rocksdb
> > 1 rbd,
> > root@hzbxs-xzy-ceph-dev-mon:~/ceph-cluster# rbd --image test_volume
> info
> > --pool rbd
> > 2016-04-18 16:24:27.396490 7f2156ea2d40 -1 WARNING: the following
> dangerous
> > and experimental features are enabled: bluestore,rocksdb
> > 2016-04-18 16:24:27.396551 7f2156ea2d40 -1 WARNING: the following
> dangerous
> > and experimental features are enabled: bluestore,rocksdb
> > 2016-04-18 16:24:27.399508 7f2156ea2d40 -1 WARNING: the following
> dangerous
> > and experimental features are enabled: bluestore,rocksdb
> > rbd image 'test_volume':
> > size 1024 MB in 256 objects
> > order 22 (4096 kB objects)
> > block_name_prefix: rbd_data.371a6b8b4567
> > format: 2
> > features: layering, exclusive-lock, object-map, fast-diff,
> deep-flatten
> > flags:
> > root@hzbxs-xzy-ceph-dev-mon:~/ceph-cluster# rbd map test_volume
> --pool rbd
> > 2016-04-18 16:25:02.547462 7f291c173d40 -1 WARNING: the following
> dangerous
> > and experimental features are enabled: bluestore,rocksdb
> > 2016-04-18 16:25:02.547523 7f291c173d40 -1 WARNING: the following
> dangerous
> > and experimental features are enabled: bluestore,rocksdb
> > 2016-04-18 16:25:02.550352 7f291c173d40 -1 WARNING: the following
> dangerous
> > and experimental features are enabled: bluestore,rocksdb
> > rbd: sysfs write failed
> > rbd: map failed: (6) No such device or address
> > root@hzbxs-xzy-ceph-dev-mon:~/ceph-cluster#
> >
> 
> > ___
> > ceph-users mailing list
> > [4]ceph-users@lists.ceph.com
> > [5]http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
> >
> --
> Thank you!
> HuangJun
> 
> PLEASE NOTE: The information contained in this electronic mail message
> is intended only for the use of the designated recipient(s) named
> above. If the reader of this message is not the intended recipient, you
> are hereby notified that you have received this message in error and
> that any review, dissemination, distribution, or copying of this
> message is strictly prohibited. If you have received this communication
> in error, please

Re: [ceph-users] krbd map on Jewel, sysfs write failed when rbd map

2016-04-18 Thread Varada Kari 
Using any kernel >= 4.2 shouldn't have any problem. If you are using kernel 
version < 4.2, disable the recent features except layering.

Varada

On Monday 18 April 2016 02:41 PM, 席智勇 wrote:
thanks for ur reply~
I did some search, and found the reason, like the 
mail(http://lists.ceph.com/pipermail/ceph-users-ceph.com/2015-September/004928.html)
 said, that because the krbd still not yet support the new RBD features like 
exclusive-lock.

2016-04-18 16:45 GMT+08:00 huang jun 
>:
Hi, can you post the 'modinfo rbd' and your cluster state 'ceph -s'.

2016-04-18 16:35 GMT+08:00 席智勇 
<xizhiyon...@gmail.com>:
> hi cephers:
>
> I create a rbd volume(image) on Jewel release, when exec rbd map, I got the
> error message as follows.i can not  find any message usage in
> syslog/kern.log/messages.
> anyone can share some tips?
>
> --my ceph
> version
> root@hzbxs-xzy-ceph-dev-mon:~/ceph-cluster# ceph -v
> ceph version 10.1.2 (4a2a6f72640d6b74a3bbd92798bb913ed380dcd4)
> -system
> info
> root@hzbxs-xzy-ceph-dev-mon:~/ceph-cluster# cat /etc/debian_version
> 8.4
> root@hzbxs-xzy-ceph-dev-mon:~/ceph-cluster# uname -a
> Linux hzbxs-xzy-ceph-dev-mon 3.16.0-4-amd64 #1 SMP Debian 3.16.7-ckt25-2
> (2016-04-08) x86_64 GNU/Linux
> --my screen
> snap-
> root@hzbxs-xzy-ceph-dev-mon:~/ceph-cluster# ceph osd lspools
> 2016-04-18 16:24:24.691909 7fb08663b700 -1 WARNING: the following dangerous
> and experimental features are enabled: bluestore,rocksdb
> 2016-04-18 16:24:24.701003 7fb08663b700 -1 WARNING: the following dangerous
> and experimental features are enabled: bluestore,rocksdb
> 1 rbd,
> root@hzbxs-xzy-ceph-dev-mon:~/ceph-cluster# rbd --image test_volume info
> --pool rbd
> 2016-04-18 16:24:27.396490 7f2156ea2d40 -1 WARNING: the following dangerous
> and experimental features are enabled: bluestore,rocksdb
> 2016-04-18 16:24:27.396551 7f2156ea2d40 -1 WARNING: the following dangerous
> and experimental features are enabled: bluestore,rocksdb
> 2016-04-18 16:24:27.399508 7f2156ea2d40 -1 WARNING: the following dangerous
> and experimental features are enabled: bluestore,rocksdb
> rbd image 'test_volume':
> size 1024 MB in 256 objects
> order 22 (4096 kB objects)
> block_name_prefix: rbd_data.371a6b8b4567
> format: 2
> features: layering, exclusive-lock, object-map, fast-diff, deep-flatten
> flags:
> root@hzbxs-xzy-ceph-dev-mon:~/ceph-cluster# rbd map test_volume --pool rbd
> 2016-04-18 16:25:02.547462 7f291c173d40 -1 WARNING: the following dangerous
> and experimental features are enabled: bluestore,rocksdb
> 2016-04-18 16:25:02.547523 7f291c173d40 -1 WARNING: the following dangerous
> and experimental features are enabled: bluestore,rocksdb
> 2016-04-18 16:25:02.550352 7f291c173d40 -1 WARNING: the following dangerous
> and experimental features are enabled: bluestore,rocksdb
> rbd: sysfs write failed
> rbd: map failed: (6) No such device or address
> root@hzbxs-xzy-ceph-dev-mon:~/ceph-cluster#
>
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>



--
Thank you!
HuangJun


PLEASE NOTE: The information contained in this electronic mail message is 
intended only for the use of the designated recipient(s) named above. If the 
reader of this message is not the intended recipient, you are hereby notified 
that you have received this message in error and that any review, 
dissemination, distribution, or copying of this message is strictly prohibited. 
If you have received this communication in error, please notify the sender by 
telephone or e-mail (as shown above) immediately and destroy any and all copies 
of this message in your possession (whether hard copies or electronically 
stored copies).
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] krbd map on Jewel, sysfs write failed when rbd map

2016-04-18 Thread 席智勇 
thanks for ur reply~
I did some search, and found the reason, like the mail(
http://lists.ceph.com/pipermail/ceph-users-ceph.com/2015-September/004928.html)
said, that because the krbd still not yet support the new RBD features like
exclusive-lock.

2016-04-18 16:45 GMT+08:00 huang jun :

> Hi, can you post the 'modinfo rbd' and your cluster state 'ceph -s'.
>
> 2016-04-18 16:35 GMT+08:00 席智勇 :
> > hi cephers:
> >
> > I create a rbd volume(image) on Jewel release, when exec rbd map, I got
> the
> > error message as follows.i can not  find any message usage in
> > syslog/kern.log/messages.
> > anyone can share some tips?
> >
> > --my ceph
> > version
> > root@hzbxs-xzy-ceph-dev-mon:~/ceph-cluster# ceph -v
> > ceph version 10.1.2 (4a2a6f72640d6b74a3bbd92798bb913ed380dcd4)
> > -system
> > info
> > root@hzbxs-xzy-ceph-dev-mon:~/ceph-cluster# cat /etc/debian_version
> > 8.4
> > root@hzbxs-xzy-ceph-dev-mon:~/ceph-cluster# uname -a
> > Linux hzbxs-xzy-ceph-dev-mon 3.16.0-4-amd64 #1 SMP Debian 3.16.7-ckt25-2
> > (2016-04-08) x86_64 GNU/Linux
> > --my screen
> > snap-
> > root@hzbxs-xzy-ceph-dev-mon:~/ceph-cluster# ceph osd lspools
> > 2016-04-18 16:24:24.691909 7fb08663b700 -1 WARNING: the following
> dangerous
> > and experimental features are enabled: bluestore,rocksdb
> > 2016-04-18 16:24:24.701003 7fb08663b700 -1 WARNING: the following
> dangerous
> > and experimental features are enabled: bluestore,rocksdb
> > 1 rbd,
> > root@hzbxs-xzy-ceph-dev-mon:~/ceph-cluster# rbd --image test_volume info
> > --pool rbd
> > 2016-04-18 16:24:27.396490 7f2156ea2d40 -1 WARNING: the following
> dangerous
> > and experimental features are enabled: bluestore,rocksdb
> > 2016-04-18 16:24:27.396551 7f2156ea2d40 -1 WARNING: the following
> dangerous
> > and experimental features are enabled: bluestore,rocksdb
> > 2016-04-18 16:24:27.399508 7f2156ea2d40 -1 WARNING: the following
> dangerous
> > and experimental features are enabled: bluestore,rocksdb
> > rbd image 'test_volume':
> > size 1024 MB in 256 objects
> > order 22 (4096 kB objects)
> > block_name_prefix: rbd_data.371a6b8b4567
> > format: 2
> > features: layering, exclusive-lock, object-map, fast-diff, deep-flatten
> > flags:
> > root@hzbxs-xzy-ceph-dev-mon:~/ceph-cluster# rbd map test_volume --pool
> rbd
> > 2016-04-18 16:25:02.547462 7f291c173d40 -1 WARNING: the following
> dangerous
> > and experimental features are enabled: bluestore,rocksdb
> > 2016-04-18 16:25:02.547523 7f291c173d40 -1 WARNING: the following
> dangerous
> > and experimental features are enabled: bluestore,rocksdb
> > 2016-04-18 16:25:02.550352 7f291c173d40 -1 WARNING: the following
> dangerous
> > and experimental features are enabled: bluestore,rocksdb
> > rbd: sysfs write failed
> > rbd: map failed: (6) No such device or address
> > root@hzbxs-xzy-ceph-dev-mon:~/ceph-cluster#
> >
> > ___
> > ceph-users mailing list
> > ceph-users@lists.ceph.com
> > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
> >
>
>
>
> --
> Thank you!
> HuangJun
>
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] krbd map on Jewel, sysfs write failed when rbd map

2016-04-18 Thread huang jun 
Hi, can you post the 'modinfo rbd' and your cluster state 'ceph -s'.

2016-04-18 16:35 GMT+08:00 席智勇 :
> hi cephers:
>
> I create a rbd volume(image) on Jewel release, when exec rbd map, I got the
> error message as follows.i can not  find any message usage in
> syslog/kern.log/messages.
> anyone can share some tips?
>
> --my ceph
> version
> root@hzbxs-xzy-ceph-dev-mon:~/ceph-cluster# ceph -v
> ceph version 10.1.2 (4a2a6f72640d6b74a3bbd92798bb913ed380dcd4)
> -system
> info
> root@hzbxs-xzy-ceph-dev-mon:~/ceph-cluster# cat /etc/debian_version
> 8.4
> root@hzbxs-xzy-ceph-dev-mon:~/ceph-cluster# uname -a
> Linux hzbxs-xzy-ceph-dev-mon 3.16.0-4-amd64 #1 SMP Debian 3.16.7-ckt25-2
> (2016-04-08) x86_64 GNU/Linux
> --my screen
> snap-
> root@hzbxs-xzy-ceph-dev-mon:~/ceph-cluster# ceph osd lspools
> 2016-04-18 16:24:24.691909 7fb08663b700 -1 WARNING: the following dangerous
> and experimental features are enabled: bluestore,rocksdb
> 2016-04-18 16:24:24.701003 7fb08663b700 -1 WARNING: the following dangerous
> and experimental features are enabled: bluestore,rocksdb
> 1 rbd,
> root@hzbxs-xzy-ceph-dev-mon:~/ceph-cluster# rbd --image test_volume info
> --pool rbd
> 2016-04-18 16:24:27.396490 7f2156ea2d40 -1 WARNING: the following dangerous
> and experimental features are enabled: bluestore,rocksdb
> 2016-04-18 16:24:27.396551 7f2156ea2d40 -1 WARNING: the following dangerous
> and experimental features are enabled: bluestore,rocksdb
> 2016-04-18 16:24:27.399508 7f2156ea2d40 -1 WARNING: the following dangerous
> and experimental features are enabled: bluestore,rocksdb
> rbd image 'test_volume':
> size 1024 MB in 256 objects
> order 22 (4096 kB objects)
> block_name_prefix: rbd_data.371a6b8b4567
> format: 2
> features: layering, exclusive-lock, object-map, fast-diff, deep-flatten
> flags:
> root@hzbxs-xzy-ceph-dev-mon:~/ceph-cluster# rbd map test_volume --pool rbd
> 2016-04-18 16:25:02.547462 7f291c173d40 -1 WARNING: the following dangerous
> and experimental features are enabled: bluestore,rocksdb
> 2016-04-18 16:25:02.547523 7f291c173d40 -1 WARNING: the following dangerous
> and experimental features are enabled: bluestore,rocksdb
> 2016-04-18 16:25:02.550352 7f291c173d40 -1 WARNING: the following dangerous
> and experimental features are enabled: bluestore,rocksdb
> rbd: sysfs write failed
> rbd: map failed: (6) No such device or address
> root@hzbxs-xzy-ceph-dev-mon:~/ceph-cluster#
>
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>



-- 
Thank you!
HuangJun
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[ceph-users] krbd map on Jewel, sysfs write failed when rbd map

2016-04-18 Thread 席智勇 
hi cephers:

I create a rbd volume(image) on Jewel release, when exec rbd map, I got the
error message as follows.i can not  find any message usage in
syslog/kern.log/messages.
anyone can share some tips?

--my ceph
version
root@hzbxs-xzy-ceph-dev-mon:~/ceph-cluster# ceph -v
ceph version 10.1.2 (4a2a6f72640d6b74a3bbd92798bb913ed380dcd4)
-system
info
root@hzbxs-xzy-ceph-dev-mon:~/ceph-cluster# cat /etc/debian_version
8.4
root@hzbxs-xzy-ceph-dev-mon:~/ceph-cluster# uname -a
Linux hzbxs-xzy-ceph-dev-mon 3.16.0-4-amd64 #1 SMP Debian 3.16.7-ckt25-2
(2016-04-08) x86_64 GNU/Linux
--my screen
snap-
root@hzbxs-xzy-ceph-dev-mon:~/ceph-cluster# ceph osd lspools
2016-04-18 16:24:24.691909 7fb08663b700 -1 WARNING: the following dangerous
and experimental features are enabled: bluestore,rocksdb
2016-04-18 16:24:24.701003 7fb08663b700 -1 WARNING: the following dangerous
and experimental features are enabled: bluestore,rocksdb
1 rbd,
root@hzbxs-xzy-ceph-dev-mon:~/ceph-cluster# rbd --image test_volume info
--pool rbd
2016-04-18 16:24:27.396490 7f2156ea2d40 -1 WARNING: the following dangerous
and experimental features are enabled: bluestore,rocksdb
2016-04-18 16:24:27.396551 7f2156ea2d40 -1 WARNING: the following dangerous
and experimental features are enabled: bluestore,rocksdb
2016-04-18 16:24:27.399508 7f2156ea2d40 -1 WARNING: the following dangerous
and experimental features are enabled: bluestore,rocksdb
rbd image 'test_volume':
size 1024 MB in 256 objects
order 22 (4096 kB objects)
block_name_prefix: rbd_data.371a6b8b4567
format: 2
features: layering, exclusive-lock, object-map, fast-diff, deep-flatten
flags:
root@hzbxs-xzy-ceph-dev-mon:~/ceph-cluster# rbd map test_volume --pool rbd
2016-04-18 16:25:02.547462 7f291c173d40 -1 WARNING: the following dangerous
and experimental features are enabled: bluestore,rocksdb
2016-04-18 16:25:02.547523 7f291c173d40 -1 WARNING: the following dangerous
and experimental features are enabled: bluestore,rocksdb
2016-04-18 16:25:02.550352 7f291c173d40 -1 WARNING: the following dangerous
and experimental features are enabled: bluestore,rocksdb
rbd: sysfs write failed
rbd: map failed: (6) No such device or address
root@hzbxs-xzy-ceph-dev-mon:~/ceph-cluster#
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com