Re: [ceph-users] MGR Dashboard

[Lenz Grimmer]

Hi Ashley,

On 11/29/18 11:41 AM, Ashley Merrick wrote:

> Managed to fix the issue with some googling from the error above.
> 
> There is a bug with urllib3 1.24.1 which breaks the module ordered_dict (1)

Good spotting!

> I rolled back to a working version "pip install urllib3==1.23" and
> restarted the mgr service and all is now working.

Glad to hear you got it working again. Thanks for the update!

> (1)https://github.com/urllib3/urllib3/issues/1456

Lenz

-- 
SUSE Linux GmbH - Maxfeldstr. 5 - 90409 Nuernberg (Germany)
GF:Felix Imendörffer,Jane Smithard,Graham Norton,HRB 21284 (AG Nürnberg)



signature.asc
Description: OpenPGP digital signature
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] MGR Dashboard

[Lenz Grimmer]

On 11/29/18 11:29 AM, Ashley Merrick wrote:

> Yeah had a few OS updates, but not related directly to CEPH.

But they seem to be the root cause of the issue you're facing. Thanks
for sharing the entire log entry.

> The full error log after a reboot is :
> 
> 2018-11-29 11:24:22.494 7faf046a1700  1 mgr[restful] server not running:
> no certificate configured
> 2018-11-29 11:24:22.586 7faf05ee4700 -1 log_channel(cluster) log [ERR] :
> Unhandled exception from module 'dashboard' while running on
> mgr.ceph-m01: No module named ordered_dict
> 2018-11-29 11:24:22.586 7faf05ee4700 -1 dashboard.serve:
> 2018-11-29 11:24:22.586 7faf05ee4700 -1 Traceback (most recent call last):
>   File "/usr/lib/ceph/mgr/dashboard/module.py", line 276, in serve
>     mapper = generate_routes(self.url_prefix)
>   File "/usr/lib/ceph/mgr/dashboard/controllers/__init__.py", line 118,
> in generate_routes
>     ctrls = load_controllers()
>   File "/usr/lib/ceph/mgr/dashboard/controllers/__init__.py", line 73,
> in load_controllers
>     package='dashboard')
>   File "/usr/lib/python2.7/importlib/__init__.py", line 37, in import_module
>     __import__(name)
>   File "/usr/lib/ceph/mgr/dashboard/controllers/rgw.py", line 10, in
> 
>     from ..services.rgw_client import RgwClient
>   File "/usr/lib/ceph/mgr/dashboard/services/rgw_client.py", line 5, in
> 
>     from ..awsauth import S3Auth
>   File "/usr/lib/ceph/mgr/dashboard/awsauth.py", line 49, in 
>     from requests.auth import AuthBase
>   File "/usr/lib/python2.7/dist-packages/requests/__init__.py", line 97,
> in 
>     from . import utils
>   File "/usr/lib/python2.7/dist-packages/requests/utils.py", line 26, in
> 
>     from ._internal_utils import to_native_string
>   File "/usr/lib/python2.7/dist-packages/requests/_internal_utils.py",
> line 11, in 
>     from .compat import is_py2, builtin_str, str
>   File "/usr/lib/python2.7/dist-packages/requests/compat.py", line 47,
> in 
>     from urllib3.packages.ordered_dict import OrderedDict
> ImportError: No module named ordered_dict
> 
> I have tried "ceph mgr module enable dashboard" and it says already
> enabled, I tried a disable restart and enable and get the same error above.

Try re-installing the following packages: "python-urllib3" and
"python-requests" via apt - somehow Python fails to import a method from
the former library.

Lenz

-- 
SUSE Linux GmbH - Maxfeldstr. 5 - 90409 Nuernberg (Germany)
GF:Felix Imendörffer,Jane Smithard,Graham Norton,HRB 21284 (AG Nürnberg)



signature.asc
Description: OpenPGP digital signature
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] MGR Dashboard

[Ashley Merrick]

Managed to fix the issue with some googling from the error above.

There is a bug with urllib3 1.24.1 which breaks the module ordered_dict (1)

I rolled back to a working version "pip install urllib3==1.23" and
restarted the mgr service and all is now working.

Thanks,
Ashley

(1)https://github.com/urllib3/urllib3/issues/1456

On Thu, Nov 29, 2018 at 6:29 PM Ashley Merrick 
wrote:

> Yeah had a few OS updates, but not related directly to CEPH.
>
> The full error log after a reboot is :
>
> 2018-11-29 11:24:22.494 7faf046a1700  1 mgr[restful] server not running:
> no certificate configured
> 2018-11-29 11:24:22.586 7faf05ee4700 -1 log_channel(cluster) log [ERR] :
> Unhandled exception from module 'dashboard' while running on mgr.ceph-m01:
> No module named ordered_dict
> 2018-11-29 11:24:22.586 7faf05ee4700 -1 dashboard.serve:
> 2018-11-29 11:24:22.586 7faf05ee4700 -1 Traceback (most recent call last):
>   File "/usr/lib/ceph/mgr/dashboard/module.py", line 276, in serve
> mapper = generate_routes(self.url_prefix)
>   File "/usr/lib/ceph/mgr/dashboard/controllers/__init__.py", line 118, in
> generate_routes
> ctrls = load_controllers()
>   File "/usr/lib/ceph/mgr/dashboard/controllers/__init__.py", line 73, in
> load_controllers
> package='dashboard')
>   File "/usr/lib/python2.7/importlib/__init__.py", line 37, in
> import_module
> __import__(name)
>   File "/usr/lib/ceph/mgr/dashboard/controllers/rgw.py", line 10, in
> 
> from ..services.rgw_client import RgwClient
>   File "/usr/lib/ceph/mgr/dashboard/services/rgw_client.py", line 5, in
> 
> from ..awsauth import S3Auth
>   File "/usr/lib/ceph/mgr/dashboard/awsauth.py", line 49, in 
> from requests.auth import AuthBase
>   File "/usr/lib/python2.7/dist-packages/requests/__init__.py", line 97,
> in 
> from . import utils
>   File "/usr/lib/python2.7/dist-packages/requests/utils.py", line 26, in
> 
> from ._internal_utils import to_native_string
>   File "/usr/lib/python2.7/dist-packages/requests/_internal_utils.py",
> line 11, in 
> from .compat import is_py2, builtin_str, str
>   File "/usr/lib/python2.7/dist-packages/requests/compat.py", line 47, in
> 
> from urllib3.packages.ordered_dict import OrderedDict
> ImportError: No module named ordered_dict
>
>
> I have tried "ceph mgr module enable dashboard" and it says already
> enabled, I tried a disable restart and enable and get the same error above.
>
> ,Ashley
>
> On Thu, Nov 29, 2018 at 6:23 PM Lenz Grimmer  wrote:
>
>> On 11/29/18 10:28 AM, Ashley Merrick wrote:
>>
>> > Sorry missed the basic info!!
>> >
>> > Latest Mimic 13.2.2
>> >
>> > Ubuntu 18.04
>>
>> Thanks. So it worked before the reboot and did not afterwards? What
>> changed? Did you perform an OS update?
>>
>> Would it be possible for you to paste the entire mgr log file messages
>> that are printed after the manager restarted? Have you tried to
>> explicitly enable the dashboard by running "ceph mgr module enable
>> dashboard"?
>>
>> Lenz
>>
>> --
>> SUSE Linux GmbH - Maxfeldstr. 5 - 90409 Nuernberg (Germany)
>> GF:Felix Imendörffer,Jane Smithard,Graham Norton,HRB 21284 (AG Nürnberg)
>>
>>
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] MGR Dashboard

[Ashley Merrick]

Yeah had a few OS updates, but not related directly to CEPH.

The full error log after a reboot is :

2018-11-29 11:24:22.494 7faf046a1700  1 mgr[restful] server not running: no
certificate configured
2018-11-29 11:24:22.586 7faf05ee4700 -1 log_channel(cluster) log [ERR] :
Unhandled exception from module 'dashboard' while running on mgr.ceph-m01:
No module named ordered_dict
2018-11-29 11:24:22.586 7faf05ee4700 -1 dashboard.serve:
2018-11-29 11:24:22.586 7faf05ee4700 -1 Traceback (most recent call last):
  File "/usr/lib/ceph/mgr/dashboard/module.py", line 276, in serve
mapper = generate_routes(self.url_prefix)
  File "/usr/lib/ceph/mgr/dashboard/controllers/__init__.py", line 118, in
generate_routes
ctrls = load_controllers()
  File "/usr/lib/ceph/mgr/dashboard/controllers/__init__.py", line 73, in
load_controllers
package='dashboard')
  File "/usr/lib/python2.7/importlib/__init__.py", line 37, in import_module
__import__(name)
  File "/usr/lib/ceph/mgr/dashboard/controllers/rgw.py", line 10, in

from ..services.rgw_client import RgwClient
  File "/usr/lib/ceph/mgr/dashboard/services/rgw_client.py", line 5, in

from ..awsauth import S3Auth
  File "/usr/lib/ceph/mgr/dashboard/awsauth.py", line 49, in 
from requests.auth import AuthBase
  File "/usr/lib/python2.7/dist-packages/requests/__init__.py", line 97, in

from . import utils
  File "/usr/lib/python2.7/dist-packages/requests/utils.py", line 26, in

from ._internal_utils import to_native_string
  File "/usr/lib/python2.7/dist-packages/requests/_internal_utils.py", line
11, in 
from .compat import is_py2, builtin_str, str
  File "/usr/lib/python2.7/dist-packages/requests/compat.py", line 47, in

from urllib3.packages.ordered_dict import OrderedDict
ImportError: No module named ordered_dict


I have tried "ceph mgr module enable dashboard" and it says already
enabled, I tried a disable restart and enable and get the same error above.

,Ashley

On Thu, Nov 29, 2018 at 6:23 PM Lenz Grimmer  wrote:

> On 11/29/18 10:28 AM, Ashley Merrick wrote:
>
> > Sorry missed the basic info!!
> >
> > Latest Mimic 13.2.2
> >
> > Ubuntu 18.04
>
> Thanks. So it worked before the reboot and did not afterwards? What
> changed? Did you perform an OS update?
>
> Would it be possible for you to paste the entire mgr log file messages
> that are printed after the manager restarted? Have you tried to
> explicitly enable the dashboard by running "ceph mgr module enable
> dashboard"?
>
> Lenz
>
> --
> SUSE Linux GmbH - Maxfeldstr. 5 - 90409 Nuernberg (Germany)
> GF:Felix Imendörffer,Jane Smithard,Graham Norton,HRB 21284 (AG Nürnberg)
>
>
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] MGR Dashboard

[Lenz Grimmer]

On 11/29/18 10:28 AM, Ashley Merrick wrote:

> Sorry missed the basic info!!
> 
> Latest Mimic 13.2.2
> 
> Ubuntu 18.04

Thanks. So it worked before the reboot and did not afterwards? What
changed? Did you perform an OS update?

Would it be possible for you to paste the entire mgr log file messages
that are printed after the manager restarted? Have you tried to
explicitly enable the dashboard by running "ceph mgr module enable
dashboard"?

Lenz

-- 
SUSE Linux GmbH - Maxfeldstr. 5 - 90409 Nuernberg (Germany)
GF:Felix Imendörffer,Jane Smithard,Graham Norton,HRB 21284 (AG Nürnberg)



signature.asc
Description: OpenPGP digital signature
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] MGR Dashboard

[Ashley Merrick]

Hey,

Sorry missed the basic info!!

Latest Mimic 13.2.2

Ubuntu 18.04

,Ashley

On Thu, 29 Nov 2018 at 5:26 PM, Lenz Grimmer  wrote:

> Hi Ashley,
>
> On 11/29/18 7:16 AM, Ashley Merrick wrote:
>
> > After rebooting a server that hosts the MGR Dashboard I am now unable to
> > get the dashboard module to run.
> >
> > Upon restarting the mgr service I see the following :
> >
> > ImportError: No module named ordered_dict
> > Nov 29 07:13:14 ceph-m01 ceph-mgr[12486]: [29/Nov/2018:07:13:14] ENGINE
> > Serving on http://:::9283
> > Nov 29 07:13:14 ceph-m01 ceph-mgr[12486]: [29/Nov/2018:07:13:14] ENGINE
> > Bus STARTED
> >
> > I have checked using pip install ordereddict and it states the module is
> > already installed.
>
> What version of Ceph is this? What OS?
>
> Lenz
>
> --
> SUSE Linux GmbH - Maxfeldstr. 5 - 90409 Nuernberg (Germany)
> GF:Felix Imendörffer,Jane Smithard,Graham Norton,HRB 21284 (AG Nürnberg)
>
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] MGR Dashboard

[Lenz Grimmer]

Hi Ashley,

On 11/29/18 7:16 AM, Ashley Merrick wrote:

> After rebooting a server that hosts the MGR Dashboard I am now unable to
> get the dashboard module to run.
> 
> Upon restarting the mgr service I see the following :
> 
> ImportError: No module named ordered_dict
> Nov 29 07:13:14 ceph-m01 ceph-mgr[12486]: [29/Nov/2018:07:13:14] ENGINE
> Serving on http://:::9283
> Nov 29 07:13:14 ceph-m01 ceph-mgr[12486]: [29/Nov/2018:07:13:14] ENGINE
> Bus STARTED
> 
> I have checked using pip install ordereddict and it states the module is
> already installed.

What version of Ceph is this? What OS?

Lenz

-- 
SUSE Linux GmbH - Maxfeldstr. 5 - 90409 Nuernberg (Germany)
GF:Felix Imendörffer,Jane Smithard,Graham Norton,HRB 21284 (AG Nürnberg)



signature.asc
Description: OpenPGP digital signature
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] MGR Dashboard

[Jos Collin]

http://tracker.ceph.com/issues/19913

On 29/11/18 11:46 AM, Ashley Merrick wrote:
> Hey,
>
> After rebooting a server that hosts the MGR Dashboard I am now unable
> to get the dashboard module to run.
>
> Upon restarting the mgr service I see the following :
>
> ImportError: No module named ordered_dict
> Nov 29 07:13:14 ceph-m01 ceph-mgr[12486]: [29/Nov/2018:07:13:14]
> ENGINE Serving on http://:::9283
> Nov 29 07:13:14 ceph-m01 ceph-mgr[12486]: [29/Nov/2018:07:13:14]
> ENGINE Bus STARTED
>
>
> I have checked using pip install ordereddict and it states the module
> is already installed.
>
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[ceph-users] MGR Dashboard

[Ashley Merrick]

Hey,

After rebooting a server that hosts the MGR Dashboard I am now unable to
get the dashboard module to run.

Upon restarting the mgr service I see the following :

ImportError: No module named ordered_dict
Nov 29 07:13:14 ceph-m01 ceph-mgr[12486]: [29/Nov/2018:07:13:14] ENGINE
Serving on http://:::9283
Nov 29 07:13:14 ceph-m01 ceph-mgr[12486]: [29/Nov/2018:07:13:14] ENGINE Bus
STARTED


I have checked using pip install ordereddict and it states the module is
already installed.
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] mgr/dashboard: Community branding & styling

[Ernesto Puerta]

Thanks for the feedback, Erwan, John! We may follow up on the tracker issues.

Kind Regards,
Ernesto


On Thu, Sep 6, 2018 at 3:54 PM Erwan Velu  wrote:
>
> Cool stuff.
> Feed the tickets to report my comments.
>
> Cheers,
>
> - Mail original -
> De: "Ernesto Puerta" 
> À: ceph-de...@vger.kernel.org, ceph-users@lists.ceph.com
> Cc: "Michael Celedonia" , "Ju Lim" 
> Envoyé: Mercredi 5 Septembre 2018 13:49:41
> Objet: mgr/dashboard: Community branding & styling
>
> Hi dashboard devels & users,
>
> You may find below a link to a PDF with the recommendations from
> Michael Celedonia & Ju Lim (in CC) on top of the current community
> branding, but just to summarize changes
> (http://tracker.ceph.com/issues/35688):
>
> - Login screen (http://tracker.ceph.com/issues/35689).
> - Masthead (http://tracker.ceph.com/issues/35690).
> - Landing screen (http://tracker.ceph.com/issues/35691).
> - About modal window (http://tracker.ceph.com/issues/35693).
> - Ceph brand gray (#47545C), and switch all shades of gray (sorry,
> npi) according to that hue (e.g: a dark bluish gray - #333E46)
> (http://tracker.ceph.com/issues/35692).
>
> Please, feel free to provide your feedback and suggestions on these
> proposals, either here or, even better, in those tickets.
>
> [ PDF: 
> https://gist.github.com/epuertat/7aa01770e47dbb6d99ba35b8cd3f9391/raw/aa26f4d0a3f351be0bcf3ed87e1acfd45a702145/ceph-dashboard-community-branding-styling.pdf
> ]
>
> Kind Regards,
> Ernesto
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[ceph-users] mgr/dashboard: Community branding & styling

[Ernesto Puerta]

Hi dashboard devels & users,

You may find below a link to a PDF with the recommendations from
Michael Celedonia & Ju Lim (in CC) on top of the current community
branding, but just to summarize changes
(http://tracker.ceph.com/issues/35688):

- Login screen (http://tracker.ceph.com/issues/35689).
- Masthead (http://tracker.ceph.com/issues/35690).
- Landing screen (http://tracker.ceph.com/issues/35691).
- About modal window (http://tracker.ceph.com/issues/35693).
- Ceph brand gray (#47545C), and switch all shades of gray (sorry,
npi) according to that hue (e.g: a dark bluish gray - #333E46)
(http://tracker.ceph.com/issues/35692).

Please, feel free to provide your feedback and suggestions on these
proposals, either here or, even better, in those tickets.

[ PDF: 
https://gist.github.com/epuertat/7aa01770e47dbb6d99ba35b8cd3f9391/raw/aa26f4d0a3f351be0bcf3ed87e1acfd45a702145/ceph-dashboard-community-branding-styling.pdf
]

Kind Regards,
Ernesto
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] mgr/dashboard: backporting Ceph Dashboard v2 to Luminous

[Willem Jan Withagen]

On 23/08/2018 12:47, Ernesto Puerta wrote:


@Willem, given your comments come from a technical ground, let's
address those technically. As you say, dashboard_v2 is already in
Mimic and will be soon in Nautilus when released, so for FreeBSD the
issue will anyhow be there. Let's look for a technical solution (both
short and long-term): shall we have meeting to handle the FreeBSD
specifics?


I have bit more time than that...
Usually I start makeing a port once the release is stable, so in this 
case 14.2.x. Becaue the FreeBSD users that like to live dangerously 
usually can also build their own source from the repo.


But you right, one day I need to bite the bullit.

ATM I'm contemplating all kinds of scenarios to make it workable for all 
participants: devs, porters, users. And I haven't really found the 
golden egg.

So yes, lets take it private and talk.

--WjW
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] mgr/dashboard: backporting Ceph Dashboard v2 to Luminous

[Ernesto Puerta]

Thanks all for sharing your views, and thanks to Lenz & Kai for the
clarifications.

For those, like David, not familiar with dashboard_v2 (or even with
dashboard_v1), you may check this short clip
(https://youtu.be/m5i3x4eR6k4), which goes through the dashboard_v2 as
per this first backport (feature par with v1).

As Lenz said, the improvement in operability this brings in to
Luminous largely exceed its cost (doable yet tough) and risks (limited
as long as dashboard_v2 is a ceph-mgr python module), and makes this
move worthwhile for both new and existing Ceph users.

@Willem, given your comments come from a technical ground, let's
address those technically. As you say, dashboard_v2 is already in
Mimic and will be soon in Nautilus when released, so for FreeBSD the
issue will anyhow be there. Let's look for a technical solution (both
short and long-term): shall we have meeting to handle the FreeBSD
specifics?

Kind Regards,
Ernesto
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] mgr/dashboard: backporting Ceph Dashboard v2 to Luminous

[Willem Jan Withagen]

On 23/08/2018 11:22, Lenz Grimmer wrote:

On 08/22/2018 08:57 PM, David Turner wrote:


My initial reaction to this PR/backport was questioning why such a
major update would happen on a dot release of Luminous.  Your
reaction to keeping both dashboards viable goes to support that.
Should we really be backporting features into a dot release that
force people to change how they use the software?  That seems more of
the purpose of having new releases.


This is indeed an unusual case. But considering that the Dashboard does
not really change any of the Ceph core functionality but adds a lot of
value by improving the usability and manageability of Ceph, we agreed
with Sage on making an exception here.


I haven't really used either dashboard though.  Other than adding
admin functionality, does it remove any functionality of the previous
dashboard?


Like Kai wrote, our initial goal was to reach feature parity with
Dashboard v1, in order to not introduce a regression when replacing it.

In the meanwhile, Dashboard v2 is way beyond that and we have added a
lot of additional functionality, e.g. RBD and RGW management.

With backporting this to Luminous, we also hope to reach a larger
audience of users that have not updated to Mimic yet.


Wierd approach question

Is there still some "logic" separation between the v1 and v2 stuff?
And is it possible to build what is used to be v1 without importing the 
npm stuff? That way I can "easily" package and distribute that piece.


ATM this plan really cripples my possibilities to package a bit of 
dashboard... where L and M did have something workable.


Just keeping it in the tree as "dead wood" for the time being would help 
me get people a taste of what is there. Just ripping it out does not 
help. And I'll try to work out a solution before the release of 
Nautilus, or accept that it will be gone and has to be v2.


--WjW
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] mgr/dashboard: backporting Ceph Dashboard v2 to Luminous

[Willem Jan Withagen]

On 22/08/2018 19:42, Ernesto Puerta wrote:

Thanks for your feedback, Willem!


The old dashboard does not need any package fetch while
building/installing. Something that is not very handy when building
FreeBSD packages. And I haven't gotten around to determining how to > get 
around that.


I thought that https://github.com/ceph/ceph/pull/22562 fixed make-dist
issues on FreeBSD. Is that not working yet? Let us know if that's the
case!


Eh, yes and no
The PR allows me to build dashboard in tree. All the guarding with 
nodeenv and such are not there. So that is already less clean than it 
should be, but it works for testing.


Now building a FreeBSD package is a totally different cookie.
That does not work with the way it is now designed.
FreeBSD package building does not allow data to be fetch half way thru 
the build process!!! So calling something like npm during building is taboo.


There is a fetch stage, where al the sources and submodules are fetched.
And I have 2 make targets: pre_fetch and post_fetch where I can get 
extra sources that are required.

Problem is also that the sources are only unpacked AFTER post_fetch, so
even running a part of the Cmake code in post_fetch does not work, 
because the tree is not there.


And it hard to track what npm is al installing, because it seems it is 
pulling in a complete forrest of new dependancies.


So my way out at the moment is probably going to be:
offline build the tree,
take all the dashboard resulting source.
including what gets installed in /usr/local. :(
put it in a blob
put the blob in a FreeBSD port where I fetch the blob
make a package from that.
and then we have net/ceph-dashboard. :(
I did not mention that I need to do this for 2-3 releases 8-|


Suggest renaming it to simpledash or dashboard_v1 and keep it in the
tree.


Unfortunately, keeping v1 is not as simple as moving the dashboard to
a separate directory (unless we leave it hanging as dead code).
Dashboard_v2 completely replaces dashboard_v1, and that also means
unit test, QA suites, and references in common files (install-deps.sh,
CMakeLists.txt, ceph.spec.in, debian/*, do_freebsd.sh, vstart.sh,
etc.).

My concern is that properly keeping both ones would go beyond a
long-but-mostly-clean cherry-picking. It'd involve Luminous actively
diverging from master, which might burden other backports with
manual/creative conflict-solving.


Yes, I understand the concerns. But mine are not less complicated.
And especially if all the parts of v1 are also in v2, it requires "just" 
a smart division of tests ao. So that v1 can be tested as a subset.

I know easier said then done.

--WjW


KR,

Ernesto

On Wed, Aug 22, 2018 at 12:43 PM Willem Jan Withagen  wrote:


On 22/08/2018 12:16, Ernesto Puerta wrote:

[sent both to ceph-devel and ceph-users lists, as it might be of
interest for both audiences]

Hi all,

This e-mail is just to announce the WIP on backporting dashboard_v2
(http://docs.ceph.com/docs/master/mgr/dashboard/) from master to
Luminous release.

The ultimate goal for this backport is to replace dashboard_v1 in
Luminous and provide, **as much as possible**, (see note below) a
level of functionality on a par with master's (i. e.: RBD and RGW
management, HTTPS support, User Management, Role Based Access Control,
Grafana integration, SSO, etc.).


If done so, I would prefer to also keep the old "simple" Dashboard.
Reason for that is the ease of portability.

The old dashboard does not need any package fetch while
building/installing. Something that is not very handy when building
FreeBSD packages. And I haven't gotten around to determining how to get
around that.

Next to that: that dashboard is "simple". Something I really like, but
that is perhaps personal.

Suggest renaming it to simpledash or dashboard_v1 and keep it in the tree.

Thanx,
--WjW



___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] mgr/dashboard: backporting Ceph Dashboard v2 to Luminous

[Lenz Grimmer]

On 08/22/2018 08:57 PM, David Turner wrote:

> My initial reaction to this PR/backport was questioning why such a
> major update would happen on a dot release of Luminous.  Your
> reaction to keeping both dashboards viable goes to support that.
> Should we really be backporting features into a dot release that
> force people to change how they use the software?  That seems more of
> the purpose of having new releases.

This is indeed an unusual case. But considering that the Dashboard does
not really change any of the Ceph core functionality but adds a lot of
value by improving the usability and manageability of Ceph, we agreed
with Sage on making an exception here.

> I haven't really used either dashboard though.  Other than adding
> admin functionality, does it remove any functionality of the previous
> dashboard?

Like Kai wrote, our initial goal was to reach feature parity with
Dashboard v1, in order to not introduce a regression when replacing it.

In the meanwhile, Dashboard v2 is way beyond that and we have added a
lot of additional functionality, e.g. RBD and RGW management.

With backporting this to Luminous, we also hope to reach a larger
audience of users that have not updated to Mimic yet.

Lenz

-- 
SUSE Linux GmbH - Maxfeldstr. 5 - 90409 Nuernberg (Germany)
GF:Felix Imendörffer,Jane Smithard,Graham Norton,HRB 21284 (AG Nürnberg)



signature.asc
Description: OpenPGP digital signature
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] mgr/dashboard: backporting Ceph Dashboard v2 to Luminous

[Kai Wagner]

On 22.08.2018 20:57, David Turner wrote:
> does it remove any functionality of the previous dashboard?
No it doesn't. All dashboard_v1 features are integrate and part of the
dashboard_v2 as well.

-- 
SUSE Linux GmbH, GF: Felix Imendörffer, Jane Smithard, Graham Norton, HRB 21284 
(AG Nürnberg)




signature.asc
Description: OpenPGP digital signature
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] mgr/dashboard: backporting Ceph Dashboard v2 to Luminous

[David Turner]

My initial reaction to this PR/backport was questioning why such a major
update would happen on a dot release of Luminous.  Your reaction to keeping
both dashboards viable goes to support that.  Should we really be
backporting features into a dot release that force people to change how
they use the software?  That seems more of the purpose of having new
releases.

I haven't really used either dashboard though.  Other than adding admin
functionality, does it remove any functionality of the previous dashboard?

On Wed, Aug 22, 2018 at 1:43 PM Ernesto Puerta  wrote:

> Thanks for your feedback, Willem!
>
> > The old dashboard does not need any package fetch while
> > building/installing. Something that is not very handy when building
> > FreeBSD packages. And I haven't gotten around to determining how to >
> get around that.
>
> I thought that https://github.com/ceph/ceph/pull/22562 fixed make-dist
> issues on FreeBSD. Is that not working yet? Let us know if that's the
> case!
>
> > Suggest renaming it to simpledash or dashboard_v1 and keep it in the
> > tree.
>
> Unfortunately, keeping v1 is not as simple as moving the dashboard to
> a separate directory (unless we leave it hanging as dead code).
> Dashboard_v2 completely replaces dashboard_v1, and that also means
> unit test, QA suites, and references in common files (install-deps.sh,
> CMakeLists.txt, ceph.spec.in, debian/*, do_freebsd.sh, vstart.sh,
> etc.).
>
> My concern is that properly keeping both ones would go beyond a
> long-but-mostly-clean cherry-picking. It'd involve Luminous actively
> diverging from master, which might burden other backports with
> manual/creative conflict-solving.
>
> KR,
>
> Ernesto
>
> On Wed, Aug 22, 2018 at 12:43 PM Willem Jan Withagen 
> wrote:
> >
> > On 22/08/2018 12:16, Ernesto Puerta wrote:
> > > [sent both to ceph-devel and ceph-users lists, as it might be of
> > > interest for both audiences]
> > >
> > > Hi all,
> > >
> > > This e-mail is just to announce the WIP on backporting dashboard_v2
> > > (http://docs.ceph.com/docs/master/mgr/dashboard/) from master to
> > > Luminous release.
> > >
> > > The ultimate goal for this backport is to replace dashboard_v1 in
> > > Luminous and provide, **as much as possible**, (see note below) a
> > > level of functionality on a par with master's (i. e.: RBD and RGW
> > > management, HTTPS support, User Management, Role Based Access Control,
> > > Grafana integration, SSO, etc.).
> >
> > If done so, I would prefer to also keep the old "simple" Dashboard.
> > Reason for that is the ease of portability.
> >
> > The old dashboard does not need any package fetch while
> > building/installing. Something that is not very handy when building
> > FreeBSD packages. And I haven't gotten around to determining how to get
> > around that.
> >
> > Next to that: that dashboard is "simple". Something I really like, but
> > that is perhaps personal.
> >
> > Suggest renaming it to simpledash or dashboard_v1 and keep it in the
> tree.
> >
> > Thanx,
> > --WjW
> >
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] mgr/dashboard: backporting Ceph Dashboard v2 to Luminous

[Ernesto Puerta]

Thanks for your feedback, Willem!

> The old dashboard does not need any package fetch while
> building/installing. Something that is not very handy when building
> FreeBSD packages. And I haven't gotten around to determining how to > get 
> around that.

I thought that https://github.com/ceph/ceph/pull/22562 fixed make-dist
issues on FreeBSD. Is that not working yet? Let us know if that's the
case!

> Suggest renaming it to simpledash or dashboard_v1 and keep it in the
> tree.

Unfortunately, keeping v1 is not as simple as moving the dashboard to
a separate directory (unless we leave it hanging as dead code).
Dashboard_v2 completely replaces dashboard_v1, and that also means
unit test, QA suites, and references in common files (install-deps.sh,
CMakeLists.txt, ceph.spec.in, debian/*, do_freebsd.sh, vstart.sh,
etc.).

My concern is that properly keeping both ones would go beyond a
long-but-mostly-clean cherry-picking. It'd involve Luminous actively
diverging from master, which might burden other backports with
manual/creative conflict-solving.

KR,

Ernesto

On Wed, Aug 22, 2018 at 12:43 PM Willem Jan Withagen  wrote:
>
> On 22/08/2018 12:16, Ernesto Puerta wrote:
> > [sent both to ceph-devel and ceph-users lists, as it might be of
> > interest for both audiences]
> >
> > Hi all,
> >
> > This e-mail is just to announce the WIP on backporting dashboard_v2
> > (http://docs.ceph.com/docs/master/mgr/dashboard/) from master to
> > Luminous release.
> >
> > The ultimate goal for this backport is to replace dashboard_v1 in
> > Luminous and provide, **as much as possible**, (see note below) a
> > level of functionality on a par with master's (i. e.: RBD and RGW
> > management, HTTPS support, User Management, Role Based Access Control,
> > Grafana integration, SSO, etc.).
>
> If done so, I would prefer to also keep the old "simple" Dashboard.
> Reason for that is the ease of portability.
>
> The old dashboard does not need any package fetch while
> building/installing. Something that is not very handy when building
> FreeBSD packages. And I haven't gotten around to determining how to get
> around that.
>
> Next to that: that dashboard is "simple". Something I really like, but
> that is perhaps personal.
>
> Suggest renaming it to simpledash or dashboard_v1 and keep it in the tree.
>
> Thanx,
> --WjW
>
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] mgr/dashboard: backporting Ceph Dashboard v2 to Luminous

[Willem Jan Withagen]

On 22/08/2018 12:16, Ernesto Puerta wrote:

[sent both to ceph-devel and ceph-users lists, as it might be of
interest for both audiences]

Hi all,

This e-mail is just to announce the WIP on backporting dashboard_v2
(http://docs.ceph.com/docs/master/mgr/dashboard/) from master to
Luminous release.

The ultimate goal for this backport is to replace dashboard_v1 in
Luminous and provide, **as much as possible**, (see note below) a
level of functionality on a par with master's (i. e.: RBD and RGW
management, HTTPS support, User Management, Role Based Access Control,
Grafana integration, SSO, etc.).


If done so, I would prefer to also keep the old "simple" Dashboard.
Reason for that is the ease of portability.

The old dashboard does not need any package fetch while 
building/installing. Something that is not very handy when building 
FreeBSD packages. And I haven't gotten around to determining how to get 
around that.


Next to that: that dashboard is "simple". Something I really like, but 
that is perhaps personal.


Suggest renaming it to simpledash or dashboard_v1 and keep it in the tree.

Thanx,
--WjW

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[ceph-users] mgr/dashboard: backporting Ceph Dashboard v2 to Luminous

[Ernesto Puerta]

[sent both to ceph-devel and ceph-users lists, as it might be of
interest for both audiences]

Hi all,

This e-mail is just to announce the WIP on backporting dashboard_v2
(http://docs.ceph.com/docs/master/mgr/dashboard/) from master to
Luminous release.

The ultimate goal for this backport is to replace dashboard_v1 in
Luminous and provide, **as much as possible**, (see note below) a
level of functionality on a par with master's (i. e.: RBD and RGW
management, HTTPS support, User Management, Role Based Access Control,
Grafana integration, SSO, etc.).

NOTE: This will be mostly driven as a best-effort (currently one-army
man) task, as long as Luminous is N-2 and backports to Mimic (N-1)
have officially ceased. Besides, Luminous lacks some features that
Ceph Dashboard v2 exposes. Therefore, the policy to follow for this
backport will be:

1.- Backport by cherry-picking individual commits, except for merge
(PR) commits that comprise a large amount of commits (e.g.: PR #23271
with 163 commits).

2.A- Do not bring any new functionality from master to Luminous other
than dashboard_v2 (commit subject: {mgr,doc,test}/dashboard{,_v2},
paths: {src/pybind/mgr/dashboard, qa/suites/rados/mgr/tasks/dashboard}
+ building/testing {CMakeLists.txt, ceph.spec.in, vstart.sh,
debian/rules, etc.})

2.B- When dashboard_v2 exposes or relies on some master-only
functionality, modify dashboard code in the most minimal way to handle
that (e.g.: disable RBD OPERATIONS FEATURE,
https://github.com/ceph/ceph/commit/8479a91c4fa45b39ef5cf24a857751de3a5c630f)

3. Add the necessary 'glue' commits to ensure cherry-picked pieces of
code work smoothly (e.g.: due to different toolchain versions or
supported idioms, like the case of C++17, or other non-functional
deps).

The first chunk of this backporting is already in PR ready status
(https://ceph.com/planet/the-ceph-dashboard-v2-pull-request-is-ready-for-review/,
https://github.com/ceph/ceph/pull/23271,
http://tracker.ceph.com/issues/24788).

If anyone else wants to contribute either on the dev side, or as test
user (I may point you to the corresponding shaman builds), don't
hesitate to contact me (Github/IRC user: epuertat). For tracking the
progress of this activity or any further questions/suggestions, etc.,
you are welcome to show up at dashboard daily stand-ups or biweekly
sync meetings.

Kind Regards,

Ernesto
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] mgr dashboard differs from ceph status

[Tracy Reed]

On Mon, May 07, 2018 at 12:13:00AM PDT, Janne Johansson spake thusly:
> > mgr: ceph01(active), standbys: ceph-ceph07, ceph03
> 
> Don't know if it matters, but the naming seems different even though I guess
> you are running mgr's on the same nodes as the mons, but ceph07 is called
> "ceph-ceph07" in the mgr list.

Yes, I did make a mistake when I started the manager on that one and
provided it with an inconsistent name. That has been corrected. I have
also since restarted all of the managers but the problem persists. But
I'm not in a position to do any debugging on it right now but will try
to look into it more in the morning.

Thanks for the feedback!

-- 
Tracy Reed
http://tracyreed.org
Digital signature attached for your safety.


signature.asc
Description: PGP signature
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] mgr dashboard differs from ceph status

[Janne Johansson]

2018-05-04 8:21 GMT+02:00 Tracy Reed :

>
>   services:
> mon: 3 daemons, quorum ceph01,ceph03,ceph07
> mgr: ceph01(active), standbys: ceph-ceph07, ceph03
> osd: 78 osds: 78 up, 78 in
>

Don't know if it matters, but the naming seems different even though I guess
you are running mgr's on the same nodes as the mons, but ceph07 is called
"ceph-ceph07" in the mgr list.

-- 
May the most significant bit of your life be positive.
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] mgr dashboard differs from ceph status

[Gregory Farnum]

On Fri, May 4, 2018 at 1:59 AM John Spray  wrote:

> On Fri, May 4, 2018 at 7:21 AM, Tracy Reed  wrote:
> > My ceph status says:
> >
> >   cluster:
> > id: b2b00aae-f00d-41b4-a29b-58859aa41375
> > health: HEALTH_OK
> >
> >   services:
> > mon: 3 daemons, quorum ceph01,ceph03,ceph07
> > mgr: ceph01(active), standbys: ceph-ceph07, ceph03
> > osd: 78 osds: 78 up, 78 in
> >
> >   data:
> > pools:   4 pools, 3240 pgs
> > objects: 4384k objects, 17533 GB
> > usage:   53141 GB used, 27311 GB / 80452 GB avail
> > pgs: 3240 active+clean
> >
> >   io:
> > client:   4108 kB/s rd, 10071 kB/s wr, 27 op/s rd, 331 op/s wr
> >
> > but my mgr dashboard web interface says:
> >
> >
> > Health
> > Overall status: HEALTH_WARN
> >
> > PG_AVAILABILITY: Reduced data availability: 2563 pgs inactive
> >
> >
> > Anyone know why the discrepency? Hopefully the dashboard is very
> > mistaken! Everything seems to be operating normally. If I had 2/3 of my
> > pgs inactive I'm sure all of my rbd backing my VMs would be blocked etc.
>
> A situation like this probably indicates that something is going wrong
> with the mon->mgr synchronisation of health state (it's all calculated
> in one place and the mon updates the mgr every few seconds).
>
> 1. Look for errors in your monitor logs
> 2. You'll probably find that everything gets back in sync if you
> restart a mgr daemon
>
> John
>

Isn't that the wrong direction for sync issues, though? I mean, the manager
is where the PG reports actually go. So if the cluster's still running, the
monitor says it's active+clean, and the *dashboard* says the PGs are
inactive, it sounds like the monitor has the correct view and something has
gone wrong between the rest of the manager guts and the dashboard display.
-Greg


>
> > I'm running ceph-12.2.4-0.el7.x86_64 on CentOS 7. Almost all filestore
> > except for one OSD which recently had to be replaced which I made
> > bluestore. I plan to slowly migrate everything over to bluestore over
> > the course of the next month.
> >
> > Thanks!
> >
> > --
> > Tracy Reed
> > http://tracyreed.org
> > Digital signature attached for your safety.
> >
> > ___
> > ceph-users mailing list
> > ceph-users@lists.ceph.com
> > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
> >
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] mgr dashboard differs from ceph status

[Sean Purdy]

I get this too, since I last rebooted a server (one of three).

ceph -s says:

  cluster:
id: a8c34694-a172-4418-a7dd-dd8a642eb545
health: HEALTH_OK

  services:
mon: 3 daemons, quorum box1,box2,box3
mgr: box3(active), standbys: box1, box2
osd: N osds: N up, N in
rgw: 3 daemons active

mgr dashboard says:

Overall status: HEALTH_WARN

MON_DOWN: 1/3 mons down, quorum box1,box3

I wasn't going to worry too much.  I'll check logs and restart an mgr then.

Sean

On Fri,  4 May 2018, John Spray said:
> On Fri, May 4, 2018 at 7:21 AM, Tracy Reed  wrote:
> > My ceph status says:
> >
> >   cluster:
> > id: b2b00aae-f00d-41b4-a29b-58859aa41375
> > health: HEALTH_OK
> >
> >   services:
> > mon: 3 daemons, quorum ceph01,ceph03,ceph07
> > mgr: ceph01(active), standbys: ceph-ceph07, ceph03
> > osd: 78 osds: 78 up, 78 in
> >
> >   data:
> > pools:   4 pools, 3240 pgs
> > objects: 4384k objects, 17533 GB
> > usage:   53141 GB used, 27311 GB / 80452 GB avail
> > pgs: 3240 active+clean
> >
> >   io:
> > client:   4108 kB/s rd, 10071 kB/s wr, 27 op/s rd, 331 op/s wr
> >
> > but my mgr dashboard web interface says:
> >
> >
> > Health
> > Overall status: HEALTH_WARN
> >
> > PG_AVAILABILITY: Reduced data availability: 2563 pgs inactive
> >
> >
> > Anyone know why the discrepency? Hopefully the dashboard is very
> > mistaken! Everything seems to be operating normally. If I had 2/3 of my
> > pgs inactive I'm sure all of my rbd backing my VMs would be blocked etc.
> 
> A situation like this probably indicates that something is going wrong
> with the mon->mgr synchronisation of health state (it's all calculated
> in one place and the mon updates the mgr every few seconds).
> 
> 1. Look for errors in your monitor logs
> 2. You'll probably find that everything gets back in sync if you
> restart a mgr daemon
> 
> John
> 
> > I'm running ceph-12.2.4-0.el7.x86_64 on CentOS 7. Almost all filestore
> > except for one OSD which recently had to be replaced which I made
> > bluestore. I plan to slowly migrate everything over to bluestore over
> > the course of the next month.
> >
> > Thanks!
> >
> > --
> > Tracy Reed
> > http://tracyreed.org
> > Digital signature attached for your safety.
> >
> > ___
> > ceph-users mailing list
> > ceph-users@lists.ceph.com
> > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
> >
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] mgr dashboard differs from ceph status

[John Spray]

On Fri, May 4, 2018 at 7:21 AM, Tracy Reed  wrote:
> My ceph status says:
>
>   cluster:
> id: b2b00aae-f00d-41b4-a29b-58859aa41375
> health: HEALTH_OK
>
>   services:
> mon: 3 daemons, quorum ceph01,ceph03,ceph07
> mgr: ceph01(active), standbys: ceph-ceph07, ceph03
> osd: 78 osds: 78 up, 78 in
>
>   data:
> pools:   4 pools, 3240 pgs
> objects: 4384k objects, 17533 GB
> usage:   53141 GB used, 27311 GB / 80452 GB avail
> pgs: 3240 active+clean
>
>   io:
> client:   4108 kB/s rd, 10071 kB/s wr, 27 op/s rd, 331 op/s wr
>
> but my mgr dashboard web interface says:
>
>
> Health
> Overall status: HEALTH_WARN
>
> PG_AVAILABILITY: Reduced data availability: 2563 pgs inactive
>
>
> Anyone know why the discrepency? Hopefully the dashboard is very
> mistaken! Everything seems to be operating normally. If I had 2/3 of my
> pgs inactive I'm sure all of my rbd backing my VMs would be blocked etc.

A situation like this probably indicates that something is going wrong
with the mon->mgr synchronisation of health state (it's all calculated
in one place and the mon updates the mgr every few seconds).

1. Look for errors in your monitor logs
2. You'll probably find that everything gets back in sync if you
restart a mgr daemon

John

> I'm running ceph-12.2.4-0.el7.x86_64 on CentOS 7. Almost all filestore
> except for one OSD which recently had to be replaced which I made
> bluestore. I plan to slowly migrate everything over to bluestore over
> the course of the next month.
>
> Thanks!
>
> --
> Tracy Reed
> http://tracyreed.org
> Digital signature attached for your safety.
>
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[ceph-users] mgr dashboard differs from ceph status

[Tracy Reed]

My ceph status says:

  cluster:
id: b2b00aae-f00d-41b4-a29b-58859aa41375
health: HEALTH_OK
 
  services:
mon: 3 daemons, quorum ceph01,ceph03,ceph07
mgr: ceph01(active), standbys: ceph-ceph07, ceph03
osd: 78 osds: 78 up, 78 in
 
  data:
pools:   4 pools, 3240 pgs
objects: 4384k objects, 17533 GB
usage:   53141 GB used, 27311 GB / 80452 GB avail
pgs: 3240 active+clean
 
  io:
client:   4108 kB/s rd, 10071 kB/s wr, 27 op/s rd, 331 op/s wr

but my mgr dashboard web interface says:


Health
Overall status: HEALTH_WARN

PG_AVAILABILITY: Reduced data availability: 2563 pgs inactive


Anyone know why the discrepency? Hopefully the dashboard is very
mistaken! Everything seems to be operating normally. If I had 2/3 of my
pgs inactive I'm sure all of my rbd backing my VMs would be blocked etc.

I'm running ceph-12.2.4-0.el7.x86_64 on CentOS 7. Almost all filestore
except for one OSD which recently had to be replaced which I made
bluestore. I plan to slowly migrate everything over to bluestore over
the course of the next month.

Thanks!

-- 
Tracy Reed
http://tracyreed.org
Digital signature attached for your safety.


signature.asc
Description: PGP signature
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[ceph-users] mgr dashboard and cull Removing data for x

[Dan Van Der Ster]

Hi all,

I'm playing with the dashboard module in 12.2.2 (and it's very cool!) but I 
noticed that some OSDs do not have metadata, e.g. this page:

http://xxx:7000/osd/perf/74

Has empty metadata. I *am* able to see all the info with `ceph osd metadata 74`.

I noticed in the mgr log we have:

2017-12-11 12:22:19.072613 7fb12df95700  4 mgr cull Removing data for 74
2017-12-11 12:22:19.072629 7fb12df95700  4 mgr cull Removing data for 75
2017-12-11 12:22:19.072640 7fb12df95700  4 mgr cull Removing data for 77
2017-12-11 12:22:19.072653 7fb12df95700  4 mgr cull Removing data for 78
...

This seems like a random set of OSDs from across the cluster. I restarted 
osd.74 and it doesn't change.

Does anyone have a clue what's happening here?

Cheers, Dan
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com