Re: [ceph-users] Proxmox 4.4, Ceph hammer, OSD cache link...

2019-02-12 Thread Marco Gaiarin
Mandi! Michel Raabe
  In chel di` si favelave...

> Have you changed/add the journal_uuid from the old partition?
> https://ceph.com/geen-categorie/ceph-recover-osds-after-ssd-journal-failure/

 root@blackpanther:~# ls -la /var/lib/ceph/osd/ceph-15
 totale 56
 drwxr-xr-x   3 root root  199 nov 21 23:08 .
 drwxr-xr-x   6 root root 4096 nov 21 23:08 ..
 -rw-r--r--   1 root root  903 nov 21 23:08 activate.monmap
 -rw-r--r--   1 root root3 nov 21 23:08 active
 -rw-r--r--   1 root root   37 nov 21 23:08 ceph_fsid
 drwxr-xr-x 292 root root 8192 dic  9 15:02 current
 -rw-r--r--   1 root root   37 nov 21 23:08 fsid
 lrwxrwxrwx   1 root root9 nov 21 23:08 journal -> /dev/sda8
 -rw---   1 root root   57 nov 21 23:08 keyring
 -rw-r--r--   1 root root   21 nov 21 23:08 magic
 -rw-r--r--   1 root root6 nov 21 23:08 ready
 -rw-r--r--   1 root root4 nov 21 23:08 store_version
 -rw-r--r--   1 root root   53 nov 21 23:08 superblock
 -rw-r--r--   1 root root0 nov 21 23:08 sysvinit
 -rw-r--r--   1 root root3 nov 21 23:08 whoami

Ahem, i've no 'journal_uuid' file on OSD...

-- 
dott. Marco Gaiarin GNUPG Key ID: 240A3D66
  Associazione ``La Nostra Famiglia''  http://www.lanostrafamiglia.it/
  Polo FVG   -   Via della Bontà, 7 - 33078   -   San Vito al Tagliamento (PN)
  marco.gaiarin(at)lanostrafamiglia.it   t +39-0434-842711   f +39-0434-842797

Dona il 5 PER MILLE a LA NOSTRA FAMIGLIA!
  http://www.lanostrafamiglia.it/index.php/it/sostienici/5x1000
(cf 00307430132, categoria ONLUS oppure RICERCA SANITARIA)
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


Re: [ceph-users] Proxmox 4.4, Ceph hammer, OSD cache link...

2019-02-06 Thread Marco Gaiarin


I come back here.

> I've recently added a host to my ceph cluster, using proxmox 'helpers'
> to add OSD, eg:
> 
>   pveceph createosd /dev/sdb -journal_dev /dev/sda5
> 
> and now i've:
> 
>  root@blackpanther:~# ls -la /var/lib/ceph/osd/ceph-12
>  totale 60
>  drwxr-xr-x   3 root root   199 nov 21 17:02 .
>  drwxr-xr-x   6 root root  4096 nov 21 23:08 ..
>  -rw-r--r--   1 root root   903 nov 21 17:02 activate.monmap
>  -rw-r--r--   1 root root 3 nov 21 17:02 active
>  -rw-r--r--   1 root root37 nov 21 17:02 ceph_fsid
>  drwxr-xr-x 432 root root 12288 dic  1 18:21 current
>  -rw-r--r--   1 root root37 nov 21 17:02 fsid
>  lrwxrwxrwx   1 root root 9 nov 21 17:02 journal -> /dev/sda5
>  -rw---   1 root root57 nov 21 17:02 keyring
>  -rw-r--r--   1 root root21 nov 21 17:02 magic
>  -rw-r--r--   1 root root 6 nov 21 17:02 ready
>  -rw-r--r--   1 root root 4 nov 21 17:02 store_version
>  -rw-r--r--   1 root root53 nov 21 17:02 superblock
>  -rw-r--r--   1 root root 0 nov 21 17:02 sysvinit
>  -rw-r--r--   1 root root 3 nov 21 17:02 whoami
> 
> and all works as expected, only i suposed to find as a journal not the
> device (/dev/sda5) but the uuid (/dev/disk/by-uuid/).
> 
> But seems that the cache partition does not have an UUID associated:
> 
>   root@blackpanther:~# ls -la /dev/disk/by-uuid/ | grep sda5
>   root@blackpanther:~# blkid /dev/sda5
>   /dev/sda5: PARTUUID="a222c6bf-05"
> 
> I'm a but ''puzzled'' because if i've to add a disk ''before'' sda, all
> device name will change with, i suppose, unexpected result.
> 
> I'm missing something? Thanks.

I was forced to change some journal, using some partition (MBR); i've
stopped osd, flushed old journal, changed symplink and then do a
'journal format':

 root@deadpool:/var/lib/ceph/osd/ceph-6# ls -la
 totale 64
 drwxr-xr-x   3 root root   199 feb  6 17:45 .
 drwxr-xr-x   6 root root  4096 dic 14  2016 ..
 -rw-r--r--   1 root root   751 dic 14  2016 activate.monmap
 -rw-r--r--   1 root root 3 dic 14  2016 active
 -rw-r--r--   1 root root37 dic 14  2016 ceph_fsid
 drwxr-xr-x 378 root root 20480 feb  6 17:12 current
 -rw-r--r--   1 root root37 dic 14  2016 fsid
 lrwxrwxrwx   1 root root 9 feb  6 17:45 journal -> /dev/sda5
 -rw---   1 root root56 dic 14  2016 keyring
 -rw-r--r--   1 root root21 dic 14  2016 magic
 -rw-r--r--   1 root root 6 dic 14  2016 ready
 -rw-r--r--   1 root root 4 dic 14  2016 store_version
 -rw-r--r--   1 root root53 dic 14  2016 superblock
 -rw-r--r--   1 root root 0 feb  6 17:10 sysvinit
 -rw-r--r--   1 root root 2 dic 14  2016 whoami
 root@deadpool:/var/lib/ceph/osd/ceph-6# ceph-osd -i 6 --mkjournal
 2019-02-06 17:45:35.030359 7ff679c24880 -1 journal check: ondisk fsid 
---- doesn't match expected 
70357923-3227-4d57-980f-92b8c853dc76, invalid (someone else's?) journal
 2019-02-06 17:45:35.038522 7ff679c24880 -1 created new journal 
/var/lib/ceph/osd/ceph-6/journal for object store /var/lib/ceph/osd/ceph-6

Clearly i've changed the journal partition by hand (eg, direct link) so
i'm expecting that link is 'direct to partition'; but, and see the
warning about fsid, still there's no 'id' associated to that partition
(eg, no link in /dev/disk/by-*/).


If i rerun the 'mkjournal':

 root@deadpool:/var/lib/ceph/osd/ceph-6# ceph-osd -i 6 --mkjournal
 2019-02-06 17:45:37.621855 7f3391377880 -1 created new journal 
/var/lib/ceph/osd/ceph-6/journal for object store /var/lib/ceph/osd/ceph-6

So seems that effectively journal partition get 'tagged' in someway.


But i'm still confused... using ID link in journal partitions works
only for GPO partitioning?


Thanks.

-- 
dott. Marco Gaiarin GNUPG Key ID: 240A3D66
  Associazione ``La Nostra Famiglia''  http://www.lanostrafamiglia.it/
  Polo FVG   -   Via della Bontà, 7 - 33078   -   San Vito al Tagliamento (PN)
  marco.gaiarin(at)lanostrafamiglia.it   t +39-0434-842711   f +39-0434-842797

Dona il 5 PER MILLE a LA NOSTRA FAMIGLIA!
  http://www.lanostrafamiglia.it/index.php/it/sostienici/5x1000
(cf 00307430132, categoria ONLUS oppure RICERCA SANITARIA)
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


[ceph-users] Proxmox 4.4, Ceph hammer, OSD cache link...

2018-12-03 Thread Marco Gaiarin


I've recently added a host to my ceph cluster, using proxmox 'helpers'
to add OSD, eg:

pveceph createosd /dev/sdb -journal_dev /dev/sda5

and now i've:

 root@blackpanther:~# ls -la /var/lib/ceph/osd/ceph-12
 totale 60
 drwxr-xr-x   3 root root   199 nov 21 17:02 .
 drwxr-xr-x   6 root root  4096 nov 21 23:08 ..
 -rw-r--r--   1 root root   903 nov 21 17:02 activate.monmap
 -rw-r--r--   1 root root 3 nov 21 17:02 active
 -rw-r--r--   1 root root37 nov 21 17:02 ceph_fsid
 drwxr-xr-x 432 root root 12288 dic  1 18:21 current
 -rw-r--r--   1 root root37 nov 21 17:02 fsid
 lrwxrwxrwx   1 root root 9 nov 21 17:02 journal -> /dev/sda5
 -rw---   1 root root57 nov 21 17:02 keyring
 -rw-r--r--   1 root root21 nov 21 17:02 magic
 -rw-r--r--   1 root root 6 nov 21 17:02 ready
 -rw-r--r--   1 root root 4 nov 21 17:02 store_version
 -rw-r--r--   1 root root53 nov 21 17:02 superblock
 -rw-r--r--   1 root root 0 nov 21 17:02 sysvinit
 -rw-r--r--   1 root root 3 nov 21 17:02 whoami

and all works as expected, only i suposed to find as a journal not the
device (/dev/sda5) but the uuid (/dev/disk/by-uuid/).

But seems that the cache partition does not have an UUID associated:

  root@blackpanther:~# ls -la /dev/disk/by-uuid/ | grep sda5
  root@blackpanther:~# blkid /dev/sda5
  /dev/sda5: PARTUUID="a222c6bf-05"

I'm a but ''puzzled'' because if i've to add a disk ''before'' sda, all
device name will change with, i suppose, unexpected result.


I'm missing something? Thanks.

-- 
dott. Marco Gaiarin GNUPG Key ID: 240A3D66
  Associazione ``La Nostra Famiglia''  http://www.lanostrafamiglia.it/
  Polo FVG   -   Via della Bontà, 7 - 33078   -   San Vito al Tagliamento (PN)
  marco.gaiarin(at)lanostrafamiglia.it   t +39-0434-842711   f +39-0434-842797

Dona il 5 PER MILLE a LA NOSTRA FAMIGLIA!
  http://www.lanostrafamiglia.it/index.php/it/sostienici/5x1000
(cf 00307430132, categoria ONLUS oppure RICERCA SANITARIA)
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com