e same OSD be pretty low?
Regards,
Chaitanya
-Original Message-
From: Allen Samuels
Sent: Friday, August 21, 2015 9:07 AM
To: Haomai Wang
Cc: Chaitanya Huilgol; James (Fei) Liu-SSI; ceph-devel
Subject: RE: Inline dedup/compression
XFS shouldn't have any trouble with the "ho
CA 95134
T: +1 408 801 7030| M: +1 408 780 6416
allen.samu...@sandisk.com
-Original Message-
From: Chaitanya Huilgol
Sent: Thursday, August 20, 2015 9:43 PM
To: Allen Samuels; Haomai Wang
Cc: James (Fei) Liu-SSI; ceph-devel
Subject: RE: Inline dedup/compression
Hi,
The original idea of
ust 20, 2015 8:01 PM
To: Allen Samuels
Cc: Chaitanya Huilgol; James (Fei) Liu-SSI; ceph-devel
Subject: Re: Inline dedup/compression
sorry, should be this
blog(http://mysqlserverteam.com/innodb-transparent-page-compression/)
On Fri, Aug 21, 2015 at 10:51 AM, Haomai Wang wrote:
> I found a
> blog(h
;> allen.samu...@sandisk.com
>>
>>
>> -----Original Message-
>> From: Chaitanya Huilgol
>> Sent: Thursday, July 02, 2015 3:50 AM
>> To: James (Fei) Liu-SSI; Allen Samuels; Haomai Wang
>> Cc: ceph-devel
>> Subject: RE: Inline dedup/compression
>
030| M: +1 408 780 6416
> allen.samu...@sandisk.com
>
>
> -Original Message-
> From: Chaitanya Huilgol
> Sent: Thursday, July 02, 2015 3:50 AM
> To: James (Fei) Liu-SSI; Allen Samuels; Haomai Wang
> Cc: ceph-devel
> Subject: RE: Inline dedup/compression
>
&g
lpitas, CA 95134
T: +1 408 801 7030| M: +1 408 780 6416
allen.samu...@sandisk.com
-Original Message-
From: Chaitanya Huilgol
Sent: Thursday, July 02, 2015 3:50 AM
To: James (Fei) Liu-SSI; Allen Samuels; Haomai Wang
Cc: ceph-devel
Subject: RE: Inline dedup/compression
Hi James et.al ,
, July 02, 2015 9:05 PM
To: Chaitanya Huilgol
Cc: ceph-devel; James (Fei) Liu-SSI; Allen Samuels; Haomai Wang
Subject: Re: Inline dedup/compression
Hi Chaitanya,
Have you ruled out variants using fixed chunksize? (Arguments for/against
fingerprinting elided.)
Matt
- "Chaitanya Huilgol&qu
> Chaitanya
>
> -Original Message-
> From: James (Fei) Liu-SSI [mailto:james@ssi.samsung.com]
> Sent: Wednesday, July 01, 2015 4:00 AM
> To: Chaitanya Huilgol; Allen Samuels; Haomai Wang
> Cc: ceph-devel
> Subject: RE: Inline dedup/compression
>
> Hi Chaitan
com]
Sent: Wednesday, July 01, 2015 4:00 AM
To: Chaitanya Huilgol; Allen Samuels; Haomai Wang
Cc: ceph-devel
Subject: RE: Inline dedup/compression
Hi Chaitanya,
Very interesting thoughts. I am not sure whether I get all of them or now.
Here are several questions for the solution you provided,
For compression, I prefer to implement it in ECpool, it is much easier
because objects in ECpool are already striped, which is what we have
already finished now(and in testing). And the only Append write
operation is allowed in EC, which is also lead us to implement it
conveniently. Moreover, as is
nt: Tuesday, June 30, 2015 8:50 AM
To: Allen Samuels; James (Fei) Liu-SSI; Haomai Wang
Cc: ceph-devel
Subject: RE: Inline dedup/compression
- Reference count has to be maintained as an attribute of the object
- As mentioned in the write workflow, duplicate segment writes increment the
referen
-devel
Subject: RE: Inline dedup/compression
Below is an alternative idea at a very high level around dedup with ceph
without a need of centralized hash index,
- Dedupe is set as a pool property
Write:
- Write arrives at the primary OSD/pg
- Data is segmented (rabin/static) and secure hash
: ceph-devel
Subject: RE: Inline dedup/compression
Below is an alternative idea at a very high level around dedup with ceph
without a need of centralized hash index,
- Dedupe is set as a pool property
Write:
- Write arrives at the primary OSD/pg
- Data is segmented (rabin/static) and secure hash
James (Fei) Liu-SSI" , "ceph-devel"
Envoyé: Mardi 30 Juin 2015 08:20:47
Objet: Re: Inline dedup/compression
On 30 June 2015 at 16:03, Haomai Wang wrote:
> On Tue, Jun 30, 2015 at 4:55 AM, James (Fei) Liu-SSI
> wrote:
>> Hi Haomai,
>> Thanks for moving the
> -Original Message-
> From: ceph-devel-ow...@vger.kernel.org [mailto:ceph-devel-
> ow...@vger.kernel.org] On Behalf Of James (Fei) Liu-SSI
> Sent: Friday, June 26, 2015 12:01 AM
>
> Hi Cephers,
> It is not easy to ask when Ceph is going to support inline
>
the network
Regards,
Chaitanya
-Original Message-
From: ceph-devel-ow...@vger.kernel.org
[mailto:ceph-devel-ow...@vger.kernel.org] On Behalf Of James (Fei) Liu-SSI
Sent: Tuesday, June 30, 2015 2:25 AM
To: Haomai Wang
Cc: ceph-devel
Subject: RE: Inline dedup/compression
Hi Haomai,
Thank
On 30 June 2015 at 16:03, Haomai Wang wrote:
> On Tue, Jun 30, 2015 at 4:55 AM, James (Fei) Liu-SSI
> wrote:
>> Hi Haomai,
>> Thanks for moving the idea forward. Regarding to the compression.
>> However, if we do compression on the client level, it is not global. And
>> the compression was
. Let me think
> more about it.
>
> Regards,
> James
>
> -Original Message-
> From: Haomai Wang [mailto:haomaiw...@gmail.com]
> Sent: Friday, June 26, 2015 8:55 PM
> To: James (Fei) Liu-SSI
> Cc: ceph-devel
> Subject: Re: Inline dedup/compression
>
> On Sat
: Inline dedup/compression
On Sat, Jun 27, 2015 at 2:03 AM, James (Fei) Liu-SSI
wrote:
> Hi Haomai,
> Thanks for your response as always. I agree compression is comparable
> easier task but still very challenge in terms of implementation no matter
> where we should implement . Clie
ssion. It is not
> apple to apple comparison. But it is good reference. The datacenters
> need cost effective solution.
> >
> > Regards,
> > James
> >
> >
> >
> > -Original Message-
> > From: Haomai Wang [mailto:haomaiw...@gmail.com]
&
world. But everybody want to save
space/cost as data grows.
Regards,
James
-Original Message-
From: Gregory Farnum [mailto:g...@gregs42.com]
Sent: Monday, June 29, 2015 4:01 AM
To: James (Fei) Liu-SSI
Cc: Haomai Wang; ceph-devel
Subject: Re: Inline dedup/compression
We discuss this periodical
m: Haomai Wang [mailto:haomaiw...@gmail.com]
> Sent: Thursday, June 25, 2015 8:08 PM
> To: James (Fei) Liu-SSI
> Cc: ceph-devel
> Subject: Re: Inline dedup/compression
>
> On Fri, Jun 26, 2015 at 6:01 AM, James (Fei) Liu-SSI
> wrote:
>> Hi Cephers,
>> It is not
iw...@gmail.com]
> Sent: Thursday, June 25, 2015 8:08 PM
> To: James (Fei) Liu-SSI
> Cc: ceph-devel
> Subject: Re: Inline dedup/compression
>
> On Fri, Jun 26, 2015 at 6:01 AM, James (Fei) Liu-SSI
> wrote:
>> Hi Cephers,
>> It is not easy to ask when Ceph is
ssage-
From: ceph-devel-ow...@vger.kernel.org
[mailto:ceph-devel-ow...@vger.kernel.org] On Behalf Of James (Fei) Liu-SSI
Sent: Friday, June 26, 2015 1:03 PM
To: Haomai Wang
Cc: ceph-devel
Subject: RE: Inline dedup/compression
Hi Haomai,
Thanks for your response as always. I agree compressio
/compression
On Fri, Jun 26, 2015 at 6:01 AM, James (Fei) Liu-SSI
wrote:
> Hi Cephers,
> It is not easy to ask when Ceph is going to support inline
> dedup/compression across OSDs in RADOS because it is not easy task and
> answered. Ceph is providing replication and EC for performance
On Fri, Jun 26, 2015 at 6:01 AM, James (Fei) Liu-SSI
wrote:
> Hi Cephers,
> It is not easy to ask when Ceph is going to support inline
> dedup/compression across OSDs in RADOS because it is not easy task and
> answered. Ceph is providing replication and EC for performance
Le Ven 26 juin 2015, à 00:01, James (Fei) Liu-SSI a écrit :
> Hi Cephers,
> It is not easy to ask when Ceph is going to support inline
> dedup/compression across OSDs in RADOS.
disclamer: I am not a Cepher.
This would mean some kind of distributed key value store that is fa
Hi Cephers,
It is not easy to ask when Ceph is going to support inline
dedup/compression across OSDs in RADOS because it is not easy task and
answered. Ceph is providing replication and EC for performance and failure
recovery. But we also lose the efficiency of storage store and cost
28 matches
Mail list logo
