Re: [ceph-users] krbd / kcephfs - jewel client features question
Hello llya and paul,
Thanks for your reply. Yes, you are right, 0x7fddff8ee8cbffb is come from
kernel upgrade, it's reported by a docker container
(digitalocean/ceph_exporter) use for ceph monitoring.
Now upmap mode is enabled, client features:
"client": {
"group": {
"features": "0x7010fb86aa42ada",
"release": "jewel",
"num": 6
},
"group": {
"features": "0x3ffddff8eea4fffb",
"release": "luminous",
"num": 6
}
}
Thanks again.
Ilya Dryomov 于2019年10月21日周一 下午6:38写道：
> On Sat, Oct 19, 2019 at 2:00 PM Lei Liu wrote:
> >
> > Hello llya,
> >
> > After updated client kernel version to 3.10.0-862 , ceph features shows:
> >
> > "client": {
> > "group": {
> > "features": "0x7010fb86aa42ada",
> > "release": "jewel",
> > "num": 5
> > },
> > "group": {
> > "features": "0x7fddff8ee8cbffb",
> > "release": "jewel",
> > "num": 1
> > },
> > "group": {
> > "features": "0x3ffddff8eea4fffb",
> > "release": "luminous",
> > "num": 6
> > },
> > "group": {
> > "features": "0x3ffddff8eeacfffb",
> > "release": "luminous",
> > "num": 1
> > }
> > }
> >
> > both 0x7fddff8ee8cbffb and 0x7010fb86aa42ada are reported by new kernel
> client.
> >
> > Is it now possible to force set-require-min-compat-client to be
> luminous, if not how to fix it?
>
> No, you haven't upgraded the one with features 0x7fddff8ee8cbffb (or
> rather it looks like you have upgraded it from 0x7fddff8ee84bffb, but
> to a version that is still too old).
>
> What exactly did you do on that machine? That change doesn't look like
> it came from a kernel upgrade. What is the output of "uname -a" there?
>
> Thanks,
>
> Ilya
>
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] krbd / kcephfs - jewel client features question
On Sat, Oct 19, 2019 at 2:00 PM Lei Liu wrote:
>
> Hello llya,
>
> After updated client kernel version to 3.10.0-862 , ceph features shows:
>
> "client": {
> "group": {
> "features": "0x7010fb86aa42ada",
> "release": "jewel",
> "num": 5
> },
> "group": {
> "features": "0x7fddff8ee8cbffb",
> "release": "jewel",
> "num": 1
> },
> "group": {
> "features": "0x3ffddff8eea4fffb",
> "release": "luminous",
> "num": 6
> },
> "group": {
> "features": "0x3ffddff8eeacfffb",
> "release": "luminous",
> "num": 1
> }
> }
>
> both 0x7fddff8ee8cbffb and 0x7010fb86aa42ada are reported by new kernel
> client.
>
> Is it now possible to force set-require-min-compat-client to be luminous, if
> not how to fix it?
No, you haven't upgraded the one with features 0x7fddff8ee8cbffb (or
rather it looks like you have upgraded it from 0x7fddff8ee84bffb, but
to a version that is still too old).
What exactly did you do on that machine? That change doesn't look like
it came from a kernel upgrade. What is the output of "uname -a" there?
Thanks,
Ilya
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] krbd / kcephfs - jewel client features question
bit 21 indicates whether upmap is supported which is not set in
0x7fddff8ee8cbffb, so no.
Paul
--
Paul Emmerich
Looking for help with your Ceph cluster? Contact us at https://croit.io
croit GmbH
Freseniusstr. 31h
81247 München
www.croit.io
Tel: +49 89 1896585 90
On Sat, Oct 19, 2019 at 2:00 PM Lei Liu wrote:
>
> Hello llya,
>
> After updated client kernel version to 3.10.0-862 , ceph features shows:
>
> "client": {
> "group": {
> "features": "0x7010fb86aa42ada",
> "release": "jewel",
> "num": 5
> },
> "group": {
> "features": "0x7fddff8ee8cbffb",
> "release": "jewel",
> "num": 1
> },
> "group": {
> "features": "0x3ffddff8eea4fffb",
> "release": "luminous",
> "num": 6
> },
> "group": {
> "features": "0x3ffddff8eeacfffb",
> "release": "luminous",
> "num": 1
> }
> }
>
> both 0x7fddff8ee8cbffb and 0x7010fb86aa42ada are reported by new kernel
> client.
>
> Is it now possible to force set-require-min-compat-client to be luminous, if
> not how to fix it?
>
> Thanks
>
> Ilya Dryomov 于2019年10月17日周四 下午9:45写道：
>>
>> On Thu, Oct 17, 2019 at 3:38 PM Lei Liu wrote:
>> >
>> > Hi Cephers,
>> >
>> > We have some ceph clusters in 12.2.x version, now we want to use upmap
>> > balancer，but when i set set-require-min-compat-client to luminous, it's
>> > failed
>> >
>> > # ceph osd set-require-min-compat-client luminous
>> > Error EPERM: cannot set require_min_compat_client to luminous: 6 connected
>> > client(s) look like jewel (missing 0xa20); 1 connected
>> > client(s) look like jewel (missing 0x800); 1 connected
>> > client(s) look like jewel (missing 0x820); add
>> > --yes-i-really-mean-it to do it anyway
>> >
>> > ceph features
>> >
>> > "client": {
>> > "group": {
>> > "features": "0x40106b84a842a52",
>> > "release": "jewel",
>> > "num": 6
>> > },
>> > "group": {
>> > "features": "0x7010fb86aa42ada",
>> > "release": "jewel",
>> > "num": 1
>> > },
>> > "group": {
>> > "features": "0x7fddff8ee84bffb",
>> > "release": "jewel",
>> > "num": 1
>> > },
>> > "group": {
>> > "features": "0x3ffddff8eea4fffb",
>> > "release": "luminous",
>> > "num": 7
>> > }
>> > }
>> >
>> > and sessions
>> >
>> > "MonSession(unknown.0 10.10.100.6:0/1603916368 is open allow *, features
>> > 0x40106b84a842a52 (jewel))",
>> > "MonSession(unknown.0 10.10.100.2:0/2484488531 is open allow *, features
>> > 0x40106b84a842a52 (jewel))",
>> > "MonSession(client.? 10.10.100.6:0/657483412 is open allow *, features
>> > 0x7fddff8ee84bffb (jewel))",
>> > "MonSession(unknown.0 10.10.14.67:0/500706582 is open allow *, features
>> > 0x7010fb86aa42ada (jewel))"
>> >
>> > can i use --yes-i-really-mean-it to force enable it ?
>>
>> No. 0x40106b84a842a52 and 0x7fddff8ee84bffb are too old.
>>
>> Thanks,
>>
>> Ilya
>
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] krbd / kcephfs - jewel client features question
Hello llya,
After updated client kernel version to 3.10.0-862 , ceph features shows:
"client": {
"group": {
"features": "0x7010fb86aa42ada",
"release": "jewel",
"num": 5
},
"group": {
"features": "0x7fddff8ee8cbffb",
"release": "jewel",
"num": 1
},
"group": {
"features": "0x3ffddff8eea4fffb",
"release": "luminous",
"num": 6
},
"group": {
"features": "0x3ffddff8eeacfffb",
"release": "luminous",
"num": 1
}
}
both 0x7fddff8ee8cbffb and 0x7010fb86aa42ada are reported by new kernel
client.
Is it now possible to force set-require-min-compat-client to be luminous,
if not how to fix it?
Thanks
Ilya Dryomov 于2019年10月17日周四 下午9:45写道：
> On Thu, Oct 17, 2019 at 3:38 PM Lei Liu wrote:
> >
> > Hi Cephers,
> >
> > We have some ceph clusters in 12.2.x version, now we want to use upmap
> balancer，but when i set set-require-min-compat-client to luminous, it's
> failed
> >
> > # ceph osd set-require-min-compat-client luminous
> > Error EPERM: cannot set require_min_compat_client to luminous: 6
> connected client(s) look like jewel (missing 0xa20); 1
> connected client(s) look like jewel (missing 0x800); 1
> connected client(s) look like jewel (missing 0x820); add
> --yes-i-really-mean-it to do it anyway
> >
> > ceph features
> >
> > "client": {
> > "group": {
> > "features": "0x40106b84a842a52",
> > "release": "jewel",
> > "num": 6
> > },
> > "group": {
> > "features": "0x7010fb86aa42ada",
> > "release": "jewel",
> > "num": 1
> > },
> > "group": {
> > "features": "0x7fddff8ee84bffb",
> > "release": "jewel",
> > "num": 1
> > },
> > "group": {
> > "features": "0x3ffddff8eea4fffb",
> > "release": "luminous",
> > "num": 7
> > }
> > }
> >
> > and sessions
> >
> > "MonSession(unknown.0 10.10.100.6:0/1603916368 is open allow *,
> features 0x40106b84a842a52 (jewel))",
> > "MonSession(unknown.0 10.10.100.2:0/2484488531 is open allow *,
> features 0x40106b84a842a52 (jewel))",
> > "MonSession(client.? 10.10.100.6:0/657483412 is open allow *, features
> 0x7fddff8ee84bffb (jewel))",
> > "MonSession(unknown.0 10.10.14.67:0/500706582 is open allow *, features
> 0x7010fb86aa42ada (jewel))"
> >
> > can i use --yes-i-really-mean-it to force enable it ?
>
> No. 0x40106b84a842a52 and 0x7fddff8ee84bffb are too old.
>
> Thanks,
>
> Ilya
>
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] krbd / kcephfs - jewel client features question
Well, I know kernel 4.13 is full support with ceph luminous and I know that Redhat backports a lot of things to the 3.10 kernel, So which is the matching version? 3.10-862 or above version ？Thanks 发自我的iPhone-- Original --From: 刘磊 Date: Thu,Oct 17,2019 9:38 PMTo: ceph-users Subject: Re: krbd / kcephfs - jewel client features questionHi Cephers,We have some ceph clusters in 12.2.x version, now we want to use upmap balancer，but when i set set-require-min-compat-client to luminous, it's failed# ceph osd set-require-min-compat-client luminousError EPERM: cannot set require_min_compat_client to luminous: 6 connected client(s) look like jewel (missing 0xa20); 1 connected client(s) look like jewel (missing 0x800); 1 connected client(s) look like jewel (missing 0x820); add --yes-i-really-mean-it to do it anywayceph features"client": { "group": { "features": "0x40106b84a842a52", "release": "jewel", "num": 6 }, "group": { "features": "0x7010fb86aa42ada", "release": "jewel", "num": 1 }, "group": { "features": "0x7fddff8ee84bffb", "release": "jewel", "num": 1 }, "group": { "features": "0x3ffddff8eea4fffb", "release": "luminous", "num": 7 } }and sessions"MonSession(unknown.0 10.10.100.6:0/1603916368 is open allow *, features 0x40106b84a842a52 (jewel))","MonSession(unknown.0 10.10.100.2:0/2484488531 is open allow *, features 0x40106b84a842a52 (jewel))","MonSession(client.? 10.10.100.6:0/657483412 is open allow *, features 0x7fddff8ee84bffb (jewel))","MonSession(unknown.0 10.10.14.67:0/500706582 is open allow *, features 0x7010fb86aa42ada (jewel))"can i use --yes-i-really-mean-it to force enable it ? I know kernel 4.13 is full support with ceph luminous and I know that Redhat backports a lot of things to the 3.10 kernel, So which is the matching version?
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] krbd / kcephfs - jewel client features question
On Thu, Oct 17, 2019 at 3:38 PM Lei Liu wrote:
>
> Hi Cephers,
>
> We have some ceph clusters in 12.2.x version, now we want to use upmap
> balancer，but when i set set-require-min-compat-client to luminous, it's failed
>
> # ceph osd set-require-min-compat-client luminous
> Error EPERM: cannot set require_min_compat_client to luminous: 6 connected
> client(s) look like jewel (missing 0xa20); 1 connected client(s)
> look like jewel (missing 0x800); 1 connected client(s) look like
> jewel (missing 0x820); add --yes-i-really-mean-it to do it anyway
>
> ceph features
>
> "client": {
> "group": {
> "features": "0x40106b84a842a52",
> "release": "jewel",
> "num": 6
> },
> "group": {
> "features": "0x7010fb86aa42ada",
> "release": "jewel",
> "num": 1
> },
> "group": {
> "features": "0x7fddff8ee84bffb",
> "release": "jewel",
> "num": 1
> },
> "group": {
> "features": "0x3ffddff8eea4fffb",
> "release": "luminous",
> "num": 7
> }
> }
>
> and sessions
>
> "MonSession(unknown.0 10.10.100.6:0/1603916368 is open allow *, features
> 0x40106b84a842a52 (jewel))",
> "MonSession(unknown.0 10.10.100.2:0/2484488531 is open allow *, features
> 0x40106b84a842a52 (jewel))",
> "MonSession(client.? 10.10.100.6:0/657483412 is open allow *, features
> 0x7fddff8ee84bffb (jewel))",
> "MonSession(unknown.0 10.10.14.67:0/500706582 is open allow *, features
> 0x7010fb86aa42ada (jewel))"
>
> can i use --yes-i-really-mean-it to force enable it ?
No. 0x40106b84a842a52 and 0x7fddff8ee84bffb are too old.
Thanks,
Ilya
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[ceph-users] krbd / kcephfs - jewel client features question
Hi Cephers,
We have some ceph clusters in 12.2.x version, now we want to use upmap
balancer，but when i set set-require-min-compat-client to luminous, it's
failed
# ceph osd set-require-min-compat-client luminous
Error EPERM: cannot set require_min_compat_client to luminous: 6 connected
client(s) look like jewel (missing 0xa20); 1 connected
client(s) look like jewel (missing 0x800); 1 connected
client(s) look like jewel (missing 0x820); add
--yes-i-really-mean-it to do it anyway
ceph features
"client": {
"group": {
"features": "0x40106b84a842a52",
"release": "jewel",
"num": 6
},
"group": {
"features": "0x7010fb86aa42ada",
"release": "jewel",
"num": 1
},
"group": {
"features": "0x7fddff8ee84bffb",
"release": "jewel",
"num": 1
},
"group": {
"features": "0x3ffddff8eea4fffb",
"release": "luminous",
"num": 7
}
}
and sessions
"MonSession(unknown.0 10.10.100.6:0/1603916368 is open allow *, features
0x40106b84a842a52 (jewel))",
"MonSession(unknown.0 10.10.100.2:0/2484488531 is open allow *, features
0x40106b84a842a52 (jewel))",
"MonSession(client.? 10.10.100.6:0/657483412 is open allow *, features
0x7fddff8ee84bffb (jewel))",
"MonSession(unknown.0 10.10.14.67:0/500706582 is open allow *, features
0x7010fb86aa42ada (jewel))"
can i use --yes-i-really-mean-it to force enable it ?
I know kernel 4.13 is full support with ceph luminous and I know that
Redhat backports a lot of things to the 3.10 kernel, So which is the
matching version?
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
