Re: [ceph-users] Replacing a failed OSD

2016-09-15 Thread Jim Kilborn
s@lists.ceph.com<mailto:ceph-users@lists.ceph.com> Subject: RE: [ceph-users] Replacing a failed OSD > -Original Message- > From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of Jim > Kilborn > Sent: 14 September 2016 20:30 > To: Reed Dier >

Re: [ceph-users] Replacing a failed OSD

2016-09-15 Thread Dennis Kramer (DBS)
inkId=550986> for Windows 10 > > > > From: Reed Dier<mailto:reed.d...@focusvq.com> > Sent: Wednesday, September 14, 2016 1:39 PM > To: Jim Kilborn<mailto:j...@kilborns.com> > Cc: ceph-users@lists.ceph.com<mailto:ceph-users@lists.ceph.com> > Subject:

Re: [ceph-users] Replacing a failed OSD

2016-09-15 Thread Nick Fisk
> -Original Message- > From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of Jim > Kilborn > Sent: 14 September 2016 20:30 > To: Reed Dier > Cc: ceph-users@lists.ceph.com > Subject: Re: [ceph-users] Replacing a failed OSD > > Reed, > &

Re: [ceph-users] Replacing a failed OSD

2016-09-14 Thread Jim Kilborn
ceph.com> Subject: Re: [ceph-users] Replacing a failed OSD Hi Jim, This is pretty fresh in my mind so hopefully I can help you out here. Firstly, the crush map will back fill any holes in the enumeration that are existing. So assuming only one drive has been removed from the crush map, it

Re: [ceph-users] Replacing a failed OSD

2016-09-14 Thread Reed Dier
Hi Jim, This is pretty fresh in my mind so hopefully I can help you out here. Firstly, the crush map will back fill any holes in the enumeration that are existing. So assuming only one drive has been removed from the crush map, it will repopulate the same OSD number. My steps for removing an O

[ceph-users] Replacing a failed OSD

2016-09-14 Thread Jim Kilborn
I am finishing testing our new cephfs cluster and wanted to document a failed osd procedure. I noticed that when I pulled a drive, to simulate a failure, and run through the replacement steps, the osd has to be removed from the crushmap in order to initialize the new drive as the same osd number

Re: [ceph-users] Replacing a failed OSD disk drive (or replace XFS with BTRFS)

2015-03-21 Thread Robert LeBlanc
When you reformat the drive, it generates a new UUID so to Ceph it is as if it was a brand new drive. This does seem heavy handed, but ceph was designed for things to fail and it is not unusual to do things this way. Ceph is not RAID so you usually have to do some unthinking. You could probably ke

[ceph-users] Replacing a failed OSD disk drive (or replace XFS with BTRFS)

2015-03-21 Thread Datatone Lists
I have been experimenting with Ceph, and have some OSDs with drives containing XFS filesystems which I want to change to BTRFS. (I started with BTRFS, then started again from scratch with XFS [currently recommended] in order to eleminate that as a potential cause of some issues, now with further ex