Re: [ceph-users] Ceph 10.1.1 rbd map fail

2016-06-23 Thread Brad Hubbard 
On Thu, Jun 23, 2016 at 6:38 PM, 王海涛  wrote:
> Hi, Brad:
> This is the output of "ceph osd crush show-tunables -f json-pretty"
> {
> "choose_local_tries": 0,
> "choose_local_fallback_tries": 0,
> "choose_total_tries": 50,
> "chooseleaf_descend_once": 1,
> "chooseleaf_vary_r": 1,
> "chooseleaf_stable": 0,
> "straw_calc_version": 1,
> "allowed_bucket_algs": 22,
> "profile": "firefly",
> "optimal_tunables": 0,
> "legacy_tunables": 0,
> "minimum_required_version": "firefly",
> "require_feature_tunables": 1,
> "require_feature_tunables2": 1,
> "has_v2_rules": 0,
> "require_feature_tunables3": 1,
> "has_v3_rules": 0,
> "has_v4_buckets": 0,
> "require_feature_tunables5": 0,
> "has_v5_rules": 0
> }
>
> The value of "require_feature_tunables3" is 1, I think It need to be 0 to
> make my rbd map success.
> So I set it to 0 by ceph osd crush tool, but it still dosn't work.
> Then I checked the rbd image info:
> rbd image 'myimage':
> size 1024 MB in 256 objects
> order 22 (4096 kB objects)
> block_name_prefix: rbd_data.5e3074b0dc51
> format: 2
> features: layering, exclusive-lock, object-map, fast-diff, deep-flatten
> flags:
>
> It looks like that some of the features are not supported by my rbd kernel
> module.
> Because when I get rid of the last 4 features, and only keep the "layering"
> feature,
> the image seems to be mapped and used rightly.
>
> Thanks for your answer!

yw

>
> Kind Regards,
> Haitao Wang
>
> At 2016-06-23 09:51:02, "Brad Hubbard"  wrote:
>>On Wed, Jun 22, 2016 at 3:20 PM, 王海涛  wrote:
>>> I find this message in dmesg:
>>> [83090.212918] libceph: mon0 192.168.159.128:6789 feature set mismatch,
>>> my
>>> 4a042a42 < server's 2004a042a42, missing 200
>>>
>>> According to
>>>
>>> "http://cephnotes.ksperis.com/blog/2014/01/21/feature-set-mismatch-error-on-ceph-kernel-client;,
>>> this could mean that I need to upgrade kernel client up to 3.15 or
>>> disable
>>> tunable 3 features.
>>> Our cluster is not convenient to upgrade.
>>> Could you tell me how to disable tunable 3 features?
>>
>>Can you show the output of the following command please?
>>
>># ceph osd crush show-tunables -f json-pretty
>>
>>I believe you'll need to use "ceph osd crush tunables " to adjust this.
>>
>>>
>>> Thanks!
>>>
>>> Kind Regards,
>>> Haitao Wang
>>>
>>>
>>> At 2016-06-22 12:33:42, "Brad Hubbard"  wrote:
On Wed, Jun 22, 2016 at 1:35 PM, 王海涛  wrote:
> Hi All
>
> I'm using ceph-10.1.1 to map a rbd image ,but it dosen't work ,the
> error
> messages are:
>
> root@heaven:~#rbd map rbd/myimage --id admin
> 2016-06-22 11:16:34.546623 7fc87ca53d80 -1 WARNING: the following
> dangerous
> and experimental features are enabled: bluestore,rocksdb
> 2016-06-22 11:16:34.547166 7fc87ca53d80 -1 WARNING: the following
> dangerous
> and experimental features are enabled: bluestore,rocksdb
> 2016-06-22 11:16:34.549018 7fc87ca53d80 -1 WARNING: the following
> dangerous
> and experimental features are enabled: bluestore,rocksdb
> rbd: sysfs write failed
> rbd: map failed: (5) Input/output error

Anything in dmesg, or anywhere, about "feature set mismatch" ?

http://cephnotes.ksperis.com/blog/2014/01/21/feature-set-mismatch-error-on-ceph-kernel-client

>
> Could someone tell me what's wrong?
> Thanks!
>
> Kind Regards,
> Haitao Wang
>
>
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>



--
Cheers,
Brad
>>
>>
>>
>>--
>>Cheers,
>>Brad



-- 
Cheers,
Brad
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Ceph 10.1.1 rbd map fail

2016-06-23 Thread 王海涛 
Hi, Brad:
This is the output of "ceph osd crush show-tunables -f json-pretty"
{
"choose_local_tries": 0,
"choose_local_fallback_tries": 0,
"choose_total_tries": 50,
"chooseleaf_descend_once": 1,
"chooseleaf_vary_r": 1,
"chooseleaf_stable": 0,
"straw_calc_version": 1,
"allowed_bucket_algs": 22,
"profile": "firefly",
"optimal_tunables": 0,
"legacy_tunables": 0,
"minimum_required_version": "firefly",
"require_feature_tunables": 1,
"require_feature_tunables2": 1,
"has_v2_rules": 0,
"require_feature_tunables3": 1,
"has_v3_rules": 0,
"has_v4_buckets": 0,
"require_feature_tunables5": 0,
"has_v5_rules": 0
}


The value of "require_feature_tunables3" is 1, I think It need to be 0 to make 
my rbd map success.
So I set it to 0 by ceph osd crush tool, but it still dosn't work.
Then I checked the rbd image info:
rbd image 'myimage':
size 1024 MB in 256 objects
order 22 (4096 kB objects)
block_name_prefix: rbd_data.5e3074b0dc51
format: 2
features: layering, exclusive-lock, object-map, fast-diff, deep-flatten
flags: 


It looks like that some of the features are not supported by my rbd kernel 
module. 
Because when I get rid of the last 4 features, and only keep the "layering" 
feature,
the image seems to be mapped and used rightly.


Thanks for your answer! 


Kind Regards,
Haitao Wang


At 2016-06-23 09:51:02, "Brad Hubbard"  wrote:
>On Wed, Jun 22, 2016 at 3:20 PM, 王海涛  wrote:
>> I find this message in dmesg:
>> [83090.212918] libceph: mon0 192.168.159.128:6789 feature set mismatch, my
>> 4a042a42 < server's 2004a042a42, missing 200
>>
>> According to
>> "http://cephnotes.ksperis.com/blog/2014/01/21/feature-set-mismatch-error-on-ceph-kernel-client;,
>> this could mean that I need to upgrade kernel client up to 3.15 or disable
>> tunable 3 features.
>> Our cluster is not convenient to upgrade.
>> Could you tell me how to disable tunable 3 features?
>
>Can you show the output of the following command please?
>
># ceph osd crush show-tunables -f json-pretty
>
>I believe you'll need to use "ceph osd crush tunables " to adjust this.
>
>>
>> Thanks!
>>
>> Kind Regards,
>> Haitao Wang
>>
>>
>> At 2016-06-22 12:33:42, "Brad Hubbard"  wrote:
>>>On Wed, Jun 22, 2016 at 1:35 PM, 王海涛  wrote:
 Hi All

 I'm using ceph-10.1.1 to map a rbd image ,but it dosen't work ,the error
 messages are:

 root@heaven:~#rbd map rbd/myimage --id admin
 2016-06-22 11:16:34.546623 7fc87ca53d80 -1 WARNING: the following
 dangerous
 and experimental features are enabled: bluestore,rocksdb
 2016-06-22 11:16:34.547166 7fc87ca53d80 -1 WARNING: the following
 dangerous
 and experimental features are enabled: bluestore,rocksdb
 2016-06-22 11:16:34.549018 7fc87ca53d80 -1 WARNING: the following
 dangerous
 and experimental features are enabled: bluestore,rocksdb
 rbd: sysfs write failed
 rbd: map failed: (5) Input/output error
>>>
>>>Anything in dmesg, or anywhere, about "feature set mismatch" ?
>>>
>>>http://cephnotes.ksperis.com/blog/2014/01/21/feature-set-mismatch-error-on-ceph-kernel-client
>>>

 Could someone tell me what's wrong?
 Thanks!

 Kind Regards,
 Haitao Wang


 ___
 ceph-users mailing list
 ceph-users@lists.ceph.com
 http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

>>>
>>>
>>>
>>>--
>>>Cheers,
>>>Brad
>
>
>
>-- 
>Cheers,
>Brad
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Ceph 10.1.1 rbd map fail

2016-06-22 Thread Brad Hubbard 
On Wed, Jun 22, 2016 at 3:20 PM, 王海涛  wrote:
> I find this message in dmesg:
> [83090.212918] libceph: mon0 192.168.159.128:6789 feature set mismatch, my
> 4a042a42 < server's 2004a042a42, missing 200
>
> According to
> "http://cephnotes.ksperis.com/blog/2014/01/21/feature-set-mismatch-error-on-ceph-kernel-client;,
> this could mean that I need to upgrade kernel client up to 3.15 or disable
> tunable 3 features.
> Our cluster is not convenient to upgrade.
> Could you tell me how to disable tunable 3 features?

Can you show the output of the following command please?

# ceph osd crush show-tunables -f json-pretty

I believe you'll need to use "ceph osd crush tunables " to adjust this.

>
> Thanks!
>
> Kind Regards,
> Haitao Wang
>
>
> At 2016-06-22 12:33:42, "Brad Hubbard"  wrote:
>>On Wed, Jun 22, 2016 at 1:35 PM, 王海涛  wrote:
>>> Hi All
>>>
>>> I'm using ceph-10.1.1 to map a rbd image ,but it dosen't work ,the error
>>> messages are:
>>>
>>> root@heaven:~#rbd map rbd/myimage --id admin
>>> 2016-06-22 11:16:34.546623 7fc87ca53d80 -1 WARNING: the following
>>> dangerous
>>> and experimental features are enabled: bluestore,rocksdb
>>> 2016-06-22 11:16:34.547166 7fc87ca53d80 -1 WARNING: the following
>>> dangerous
>>> and experimental features are enabled: bluestore,rocksdb
>>> 2016-06-22 11:16:34.549018 7fc87ca53d80 -1 WARNING: the following
>>> dangerous
>>> and experimental features are enabled: bluestore,rocksdb
>>> rbd: sysfs write failed
>>> rbd: map failed: (5) Input/output error
>>
>>Anything in dmesg, or anywhere, about "feature set mismatch" ?
>>
>>http://cephnotes.ksperis.com/blog/2014/01/21/feature-set-mismatch-error-on-ceph-kernel-client
>>
>>>
>>> Could someone tell me what's wrong?
>>> Thanks!
>>>
>>> Kind Regards,
>>> Haitao Wang
>>>
>>>
>>> ___
>>> ceph-users mailing list
>>> ceph-users@lists.ceph.com
>>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>>
>>
>>
>>
>>--
>>Cheers,
>>Brad



-- 
Cheers,
Brad
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Ceph 10.1.1 rbd map fail

2016-06-21 Thread 王海涛 
I find this message in dmesg:
[83090.212918] libceph: mon0 192.168.159.128:6789 feature set mismatch, my 
4a042a42 < server's 2004a042a42, missing 200


According to 
"http://cephnotes.ksperis.com/blog/2014/01/21/feature-set-mismatch-error-on-ceph-kernel-client;,
this could mean that I need to upgrade kernel client up to 3.15 or disable 
tunable 3 features.
Our cluster is not convenient to upgrade. 
Could you tell me how to disable tunable 3 features?


Thanks!


Kind Regards,
Haitao Wang

At 2016-06-22 12:33:42, "Brad Hubbard"  wrote:
>On Wed, Jun 22, 2016 at 1:35 PM, 王海涛  wrote:
>> Hi All
>>
>> I'm using ceph-10.1.1 to map a rbd image ,but it dosen't work ,the error
>> messages are:
>>
>> root@heaven:~#rbd map rbd/myimage --id admin
>> 2016-06-22 11:16:34.546623 7fc87ca53d80 -1 WARNING: the following dangerous
>> and experimental features are enabled: bluestore,rocksdb
>> 2016-06-22 11:16:34.547166 7fc87ca53d80 -1 WARNING: the following dangerous
>> and experimental features are enabled: bluestore,rocksdb
>> 2016-06-22 11:16:34.549018 7fc87ca53d80 -1 WARNING: the following dangerous
>> and experimental features are enabled: bluestore,rocksdb
>> rbd: sysfs write failed
>> rbd: map failed: (5) Input/output error
>
>Anything in dmesg, or anywhere, about "feature set mismatch" ?
>
>http://cephnotes.ksperis.com/blog/2014/01/21/feature-set-mismatch-error-on-ceph-kernel-client
>
>>
>> Could someone tell me what's wrong?
>> Thanks!
>>
>> Kind Regards,
>> Haitao Wang
>>
>>
>> ___
>> ceph-users mailing list
>> ceph-users@lists.ceph.com
>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>
>
>
>
>-- 
>Cheers,
>Brad
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Ceph 10.1.1 rbd map fail

2016-06-21 Thread Brad Hubbard 
On Wed, Jun 22, 2016 at 1:35 PM, 王海涛  wrote:
> Hi All
>
> I'm using ceph-10.1.1 to map a rbd image ,but it dosen't work ,the error
> messages are:
>
> root@heaven:~#rbd map rbd/myimage --id admin
> 2016-06-22 11:16:34.546623 7fc87ca53d80 -1 WARNING: the following dangerous
> and experimental features are enabled: bluestore,rocksdb
> 2016-06-22 11:16:34.547166 7fc87ca53d80 -1 WARNING: the following dangerous
> and experimental features are enabled: bluestore,rocksdb
> 2016-06-22 11:16:34.549018 7fc87ca53d80 -1 WARNING: the following dangerous
> and experimental features are enabled: bluestore,rocksdb
> rbd: sysfs write failed
> rbd: map failed: (5) Input/output error

Anything in dmesg, or anywhere, about "feature set mismatch" ?

http://cephnotes.ksperis.com/blog/2014/01/21/feature-set-mismatch-error-on-ceph-kernel-client

>
> Could someone tell me what's wrong?
> Thanks!
>
> Kind Regards,
> Haitao Wang
>
>
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>



-- 
Cheers,
Brad
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[ceph-users] Ceph 10.1.1 rbd map fail

2016-06-21 Thread 王海涛 
Hi All

I'm using ceph-10.1.1 to map a rbd image ,but it dosen't work ,the error 
messages are:root@heaven:~#rbd map rbd/myimage --id admin
2016-06-22 11:16:34.546623 7fc87ca53d80 -1 WARNING: the following dangerous and 
experimental features are enabled: bluestore,rocksdb
2016-06-22 11:16:34.547166 7fc87ca53d80 -1 WARNING: the following dangerous and 
experimental features are enabled: bluestore,rocksdb
2016-06-22 11:16:34.549018 7fc87ca53d80 -1 WARNING: the following dangerous and 
experimental features are enabled: bluestore,rocksdb
rbd: sysfs write failed
rbd: map failed: (5) Input/output error
Could someone tell me what's wrong?Thanks!

Kind Regards,
Haitao Wang

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com