Re: Forcing Ceph into mapping all objects to a single PG

2014-07-30 Thread Daniel Hofmann
Follow up: I wrote a small Python script for evaluating the object to placement mapping's quality. I'm using a Chi-Squared statistical hypothesis test. Here is the script and also an example output for a few rados benchmark writes: > https://gist.github.com/daniel-j-h/d7d87dfe5de3c5bbfd0f Maybe

Re: Forcing Ceph into mapping all objects to a single PG

2014-07-25 Thread Alex Elsayed
Sage Weil wrote: > On Fri, 25 Jul 2014, Daniel Hofmann wrote: >> The main issue however is not the hash's strength, but the fact that >> once pre-computed, I'm able to use preimages on **every Ceph cluster out >> there**. (As the hash functions's output is a deterministic function of >> the object

Re: Forcing Ceph into mapping all objects to a single PG

2014-07-25 Thread Sage Weil
On Fri, 25 Jul 2014, Daniel Hofmann wrote: > The main issue however is not the hash's strength, but the fact that > once pre-computed, I'm able to use preimages on **every Ceph cluster out > there**. (As the hash functions's output is a deterministic function of > the object's name only) > > I agr

Re: Forcing Ceph into mapping all objects to a single PG

2014-07-25 Thread Daniel Hofmann
The main issue however is not the hash's strength, but the fact that once pre-computed, I'm able to use preimages on **every Ceph cluster out there**. (As the hash functions's output is a deterministic function of the object's name only) I agree in that the general issue is inherent in hash-placem

Re: Forcing Ceph into mapping all objects to a single PG

2014-07-22 Thread Alex Elsayed
Gah, typed "fletcher4" when I meant "rjenkins" - still, the same applies. -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: Forcing Ceph into mapping all objects to a single PG

2014-07-22 Thread Alex Elsayed
Gregory Farnum wrote: > On Mon, Jul 21, 2014 at 3:27 PM, Daniel Hofmann wrote: >> Preamble: you might want to read the decent formatted version of this >> mail at: >>> https://gist.github.com/daniel-j-h/2daae2237bb21596c97d >> --- >> >> Ceph's object mapping depends on the rjenkins hash func

Re: Forcing Ceph into mapping all objects to a single PG

2014-07-21 Thread Gregory Farnum
On Mon, Jul 21, 2014 at 3:27 PM, Daniel Hofmann wrote: > Preamble: you might want to read the decent formatted version of this > mail at: >> https://gist.github.com/daniel-j-h/2daae2237bb21596c97d > > > Motivation > -- > > Recently I was wondering how Ceph (i.e. Rados in particular) maps o

Forcing Ceph into mapping all objects to a single PG

2014-07-21 Thread Daniel Hofmann
Preamble: you might want to read the decent formatted version of this mail at: > https://gist.github.com/daniel-j-h/2daae2237bb21596c97d Motivation -- Recently I was wondering how Ceph (i.e. Rados in particular) maps object to Placement Groups (PGs). It basically works like the followin