Re: Rolling upgrades possible?

2012-06-22 Thread Sage Weil
A rolling upgrade to 0.48 will be possible, provided the old version is 
reasonably recent (0.45ish or later; I need to confirm that).

The upgrade will be a bit awkward because of teh disk format upgrade, 
however.  Each ceph-osd will need to do a conversion on startup which can 
take a while, so you will want to restart them on a per-host basis or 
per-rack basis (depending on how your CRUSH map is structured).

The monitors are also doing an ncoding change, but will only make the 
transition after all members of the quorum run the new code.  If you start 
the upgrade with a degraded cluster and have another failure, you'll need 
to make sure the recovering node(s) run new code.

The goal is to make all future upgrades possible using rolling upgrades.  
It will be tricky with some of the OSD changes coming, but that is the 
goal.

sage


On Fri, 22 Jun 2012, John Axel Eriksson wrote:

> I guess this has been asked before, I'm just new to the list and
> wondered whether it's possible to do
> rolling upgrades of mons, osds and radosgw? We will soon be in the
> process of migrating from our current
> storage solution to Ceph/RGW. We will only use the object storage,
> actually mainly the S3-interface radosgw
> supplies.
> 
> Right now we have a very small test-installation - 1 mon, 2 osds where
> the mon also runs rgw. Next week I've
> heard that 0.48 might be released, if we upgrade to that, do we have
> to shut down the cluster during the upgrade
> or can we do a rolling upgrade while still responding to PUTs and
> GETs? If not possible yet, is this in the pipeline?
> 
> Best,
> John
> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
> the body of a message to majord...@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
> 
> 
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html


Re: Rolling upgrades possible?

2012-06-22 Thread Andrey Korolyov
On Fri, Jun 22, 2012 at 1:23 PM, John Axel Eriksson  wrote:
> I guess this has been asked before, I'm just new to the list and
> wondered whether it's possible to do
> rolling upgrades of mons, osds and radosgw? We will soon be in the
> process of migrating from our current
> storage solution to Ceph/RGW. We will only use the object storage,
> actually mainly the S3-interface radosgw
> supplies.
>
> Right now we have a very small test-installation - 1 mon, 2 osds where
> the mon also runs rgw. Next week I've
> heard that 0.48 might be released, if we upgrade to that, do we have
> to shut down the cluster during the upgrade
> or can we do a rolling upgrade while still responding to PUTs and
> GETs? If not possible yet, is this in the pipeline?
>
> Best,
> John

Should not be possible with only one mon, you need at least three for
continuous operation, so you can add them right now and then try to
upgrade cluster nodes one by one.

By the way, does recent upgrade of osd` on-disk content means near
stabilization of data format(which means theoretically flawless
per-node upgrade)? If so, is there any approximate times? About one
and half months ago some in-list discussion mentioned such
stabilization as very soon(tm), so I`ll be happy on more exact
timeline before pushing ceph-based infrastructure into production.

> --
> To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
> the body of a message to majord...@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html


Re: Rolling upgrades possible?

2012-06-22 Thread Wido den Hollander

On 06/22/2012 11:23 AM, John Axel Eriksson wrote:

I guess this has been asked before, I'm just new to the list and
wondered whether it's possible to do
rolling upgrades of mons, osds and radosgw? We will soon be in the
process of migrating from our current
storage solution to Ceph/RGW. We will only use the object storage,
actually mainly the S3-interface radosgw
supplies.

Right now we have a very small test-installation - 1 mon, 2 osds where
the mon also runs rgw. Next week I've
heard that 0.48 might be released, if we upgrade to that, do we have
to shut down the cluster during the upgrade
or can we do a rolling upgrade while still responding to PUTs and
GETs? If not possible yet, is this in the pipeline?


Currently there is no guarantee that rolling upgrades will work, I 
however suspect that with 0.48 this will become a priority.


With 0.48 there will be a on-disk format change, but I don't know if the 
protocol between the daemons will change.


Towards 0.48 I wouldn't bet on a rolling upgrade, but you can always try 
with a test cluster :)


Wido



Best,
John
--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html


--
To unsubscribe from this list: send the line "unsubscribe ceph-devel" in
the body of a message to majord...@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html