Re: [ceph-users] how to compute Ceph durability?

2015-04-15 Thread ghislain.chevalier 
Thanks Mark
Loic also gave me this link

It would be a good start for sure

Best regards

-Message d'origine-
De : ceph-users [mailto:ceph-users-boun...@lists.ceph.com] De la part de Mark 
Nelson
Envoyé : mardi 14 avril 2015 14:11
À : ceph-users@lists.ceph.com
Objet : Re: [ceph-users] how to compute Ceph durability?

Hi Ghislain,

Mark Kampe was working on durability models a couple of years ago, but I'm not 
sure if they ever were completed or if anyone has reviewed them. 
  The source code is available here:

https://github.com/ceph/ceph-tools/tree/master/models/reliability

This was before EC was in Ceph, so I'm guessing new models would need to be 
created for that, but this may at least be a good place to start.

Mark

On 04/14/2015 07:04 AM, ghislain.cheval...@orange.com wrote:
> Hi All,
>
> Am I alone to have this need ?
>
> *De :*ceph-users [mailto:ceph-users-boun...@lists.ceph.com] *De la 
> part
> de* ghislain.cheval...@orange.com
> *Envoyé :* vendredi 20 mars 2015 11:47 *À :* ceph-users *Objet :* 
> [ceph-users] how to compute Ceph durability?
>
> Hi all,
>
> I would like to compute the durability of data stored in a  ceph 
> environment according to the cluster topology (failure domains) and 
> the data resiliency (replication/erasure coding).
>
> Does a tool exist ?
>
> Best regards
>
> *- - - - - - - - - - - - - - - - -*
> *Ghislain Chevalier ORANGE*
> +33299124432
>
> +33788624370
> ghislain.cheval...@orange.com
> <mailto:ghislain.cheval...@orange-ftgroup.com>
>
> __
> ___
>
>
>
> Ce message et ses pieces jointes peuvent contenir des informations 
> confidentielles ou privilegiees et ne doivent donc
>
> pas etre diffuses, exploites ou copies sans autorisation. Si vous avez 
> recu ce message par erreur, veuillez le signaler
>
> a l'expediteur et le detruire ainsi que les pieces jointes. Les 
> messages electroniques etant susceptibles d'alteration,
>
> Orange decline toute responsabilite si ce message a ete altere, deforme ou 
> falsifie. Merci.
>
>
>
> This message and its attachments may contain confidential or 
> privileged information that may be protected by law;
>
> they should not be distributed, used or copied without authorisation.
>
> If you have received this email in error, please notify the sender and delete 
> this message and its attachments.
>
> As emails may be altered, Orange is not liable for messages that have been 
> modified, changed or falsified.
>
> Thank you.
>
> __
> ___
>
> Ce message et ses pieces jointes peuvent contenir des informations 
> confidentielles ou privilegiees et ne doivent donc pas etre diffuses, 
> exploites ou copies sans autorisation. Si vous avez recu ce message 
> par erreur, veuillez le signaler a l'expediteur et le detruire ainsi que les 
> pieces jointes. Les messages electroniques etant susceptibles d'alteration, 
> Orange decline toute responsabilite si ce message a ete altere, deforme ou 
> falsifie. Merci.
>
> This message and its attachments may contain confidential or 
> privileged information that may be protected by law; they should not be 
> distributed, used or copied without authorisation.
> If you have received this email in error, please notify the sender and delete 
> this message and its attachments.
> As emails may be altered, Orange is not liable for messages that have been 
> modified, changed or falsified.
> Thank you.
>
>
>
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisatio

Re: [ceph-users] how to compute Ceph durability?

2015-04-14 Thread Christian Balzer 

Hello,

On Tue, 14 Apr 2015 12:04:35 + ghislain.cheval...@orange.com wrote:

> Hi All,
> 
> Am I alone to have this need ?
>
No, but for starters, there have been a number of threads about that topic
in this ML, for example the "Failure probability with largish deployments"
one nearly 1.5 years ago.

The tool Mark pointed out would indeed be a good start, but it lacked
several bits as you can gleam from the thread above and others.

With something like normal 3 way replication, fast replication links and
overall decent HW, ignoring failure domains outside the disk scope, the
odds are indeed quite good.

But of course a fully complete model will lower those odds a bit.

Then you finally get to enter the maybe biggest factor in the calculation,
the good ole human error.
I've witnessed not once but twice in the last few years people confidently
pulling the wrong HDD out of a RAID6, thinking it was the failed one and
only the fact that there was another backup saved their bacon. ^.^
 
Christian

> De : ceph-users [mailto:ceph-users-boun...@lists.ceph.com] De la part de
> ghislain.cheval...@orange.com Envoyé : vendredi 20 mars 2015 11:47
> À : ceph-users
> Objet : [ceph-users] how to compute Ceph durability?
> 
> Hi all,
> 
> I would like to compute the durability of data stored in a  ceph
> environment according to the cluster topology (failure domains) and the
> data resiliency (replication/erasure coding).
> 
> Does a tool exist ?
> 
> Best regards
> 
> - - - - - - - - - - - - - - - - -
> Ghislain Chevalier ORANGE
> +33299124432
> +33788624370
> ghislain.cheval...@orange.com
> 
> _
> 
> 
> 
> Ce message et ses pieces jointes peuvent contenir des informations
> confidentielles ou privilegiees et ne doivent donc
> 
> pas etre diffuses, exploites ou copies sans autorisation. Si vous avez
> recu ce message par erreur, veuillez le signaler
> 
> a l'expediteur et le detruire ainsi que les pieces jointes. Les messages
> electroniques etant susceptibles d'alteration,
> 
> Orange decline toute responsabilite si ce message a ete altere, deforme
> ou falsifie. Merci.
> 
> 
> 
> This message and its attachments may contain confidential or privileged
> information that may be protected by law;
> 
> they should not be distributed, used or copied without authorisation.
> 
> If you have received this email in error, please notify the sender and
> delete this message and its attachments.
> 
> As emails may be altered, Orange is not liable for messages that have
> been modified, changed or falsified.
> 
> Thank you.
> 
> _
> 
> Ce message et ses pieces jointes peuvent contenir des informations
> confidentielles ou privilegiees et ne doivent donc pas etre diffuses,
> exploites ou copies sans autorisation. Si vous avez recu ce message par
> erreur, veuillez le signaler a l'expediteur et le detruire ainsi que les
> pieces jointes. Les messages electroniques etant susceptibles
> d'alteration, Orange decline toute responsabilite si ce message a ete
> altere, deforme ou falsifie. Merci.
> 
> This message and its attachments may contain confidential or privileged
> information that may be protected by law; they should not be
> distributed, used or copied without authorisation. If you have received
> this email in error, please notify the sender and delete this message
> and its attachments. As emails may be altered, Orange is not liable for
> messages that have been modified, changed or falsified. Thank you.
> 


-- 
Christian BalzerNetwork/Systems Engineer
ch...@gol.com   Global OnLine Japan/Fusion Communications
http://www.gol.com/
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] how to compute Ceph durability?

2015-04-14 Thread Mark Nelson 

Hi Ghislain,

Mark Kampe was working on durability models a couple of years ago, but 
I'm not sure if they ever were completed or if anyone has reviewed them. 
 The source code is available here:


https://github.com/ceph/ceph-tools/tree/master/models/reliability

This was before EC was in Ceph, so I'm guessing new models would need to 
be created for that, but this may at least be a good place to start.


Mark

On 04/14/2015 07:04 AM, ghislain.cheval...@orange.com wrote:

Hi All,

Am I alone to have this need ?

*De :*ceph-users [mailto:ceph-users-boun...@lists.ceph.com] *De la part
de* ghislain.cheval...@orange.com
*Envoyé :* vendredi 20 mars 2015 11:47
*À :* ceph-users
*Objet :* [ceph-users] how to compute Ceph durability?

Hi all,

I would like to compute the durability of data stored in a  ceph
environment according to the cluster topology (failure domains) and the
data resiliency (replication/erasure coding).

Does a tool exist ?

Best regards

*- - - - - - - - - - - - - - - - -*
*Ghislain Chevalier ORANGE*
+33299124432

+33788624370
ghislain.cheval...@orange.com


_



Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc

pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler

a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,

Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.



This message and its attachments may contain confidential or privileged 
information that may be protected by law;

they should not be distributed, used or copied without authorisation.

If you have received this email in error, please notify the sender and delete 
this message and its attachments.

As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.

Thank you.

_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.



___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] how to compute Ceph durability?

2015-04-14 Thread ghislain.chevalier 
Hi All,

Am I alone to have this need ?

De : ceph-users [mailto:ceph-users-boun...@lists.ceph.com] De la part de 
ghislain.cheval...@orange.com
Envoyé : vendredi 20 mars 2015 11:47
À : ceph-users
Objet : [ceph-users] how to compute Ceph durability?

Hi all,

I would like to compute the durability of data stored in a  ceph environment 
according to the cluster topology (failure domains) and the data resiliency 
(replication/erasure coding).

Does a tool exist ?

Best regards

- - - - - - - - - - - - - - - - -
Ghislain Chevalier ORANGE
+33299124432
+33788624370
ghislain.cheval...@orange.com

_



Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc

pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler

a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,

Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.



This message and its attachments may contain confidential or privileged 
information that may be protected by law;

they should not be distributed, used or copied without authorisation.

If you have received this email in error, please notify the sender and delete 
this message and its attachments.

As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.

Thank you.

_

Ce message et ses pieces jointes peuvent contenir des informations 
confidentielles ou privilegiees et ne doivent donc
pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce 
message par erreur, veuillez le signaler
a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
electroniques etant susceptibles d'alteration,
Orange decline toute responsabilite si ce message a ete altere, deforme ou 
falsifie. Merci.

This message and its attachments may contain confidential or privileged 
information that may be protected by law;
they should not be distributed, used or copied without authorisation.
If you have received this email in error, please notify the sender and delete 
this message and its attachments.
As emails may be altered, Orange is not liable for messages that have been 
modified, changed or falsified.
Thank you.

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] how to compute Ceph durability?

2015-03-20 Thread Loic Dachary 
(that's what happens when typing Control-Enter V instead of Control-V enter ;-)

On 20/03/2015 11:50, Loic Dachary wrote:
> Hi Ghislain,
> 
> You will find more information about tools and methods at

https://wiki.ceph.com/Development/Reliability_model/Final_report

Enjoy !

> 
> 
> On 20/03/2015 11:47, ghislain.cheval...@orange.com wrote:
>> Hi all,
>>
>>  
>>
>> I would like to compute the durability of data stored in a  ceph environment 
>> according to the cluster topology (failure domains) and the data resiliency 
>> (replication/erasure coding).
>>
>>  
>>
>> Does a tool exist ?
>>
>>  
>>
>> Best regards
>>
>>  
>>
>> *- - - - - - - - - - - - - - - - -*
>> *Ghislain Chevalier ORANGE*
>> +33299124432
>>
>> +33788624370
>> ghislain.cheval...@orange.com 
>>
>> _
>>
>> Ce message et ses pieces jointes peuvent contenir des informations 
>> confidentielles ou privilegiees et ne doivent donc
>> pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu 
>> ce message par erreur, veuillez le signaler
>> a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
>> electroniques etant susceptibles d'alteration,
>> Orange decline toute responsabilite si ce message a ete altere, deforme ou 
>> falsifie. Merci.
>>
>> This message and its attachments may contain confidential or privileged 
>> information that may be protected by law;
>> they should not be distributed, used or copied without authorisation.
>> If you have received this email in error, please notify the sender and 
>> delete this message and its attachments.
>> As emails may be altered, Orange is not liable for messages that have been 
>> modified, changed or falsified.
>> Thank you.
>>
>>
>>
>> ___
>> ceph-users mailing list
>> ceph-users@lists.ceph.com
>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>
> 

-- 
Loïc Dachary, Artisan Logiciel Libre



signature.asc
Description: OpenPGP digital signature
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] how to compute Ceph durability?

2015-03-20 Thread Loic Dachary 
Hi Ghislain,

You will find more information about tools and methods at


On 20/03/2015 11:47, ghislain.cheval...@orange.com wrote:
> Hi all,
> 
>  
> 
> I would like to compute the durability of data stored in a  ceph environment 
> according to the cluster topology (failure domains) and the data resiliency 
> (replication/erasure coding).
> 
>  
> 
> Does a tool exist ?
> 
>  
> 
> Best regards
> 
>  
> 
> *- - - - - - - - - - - - - - - - -*
> *Ghislain Chevalier ORANGE*
> +33299124432
> 
> +33788624370
> ghislain.cheval...@orange.com 
> 
> _
> 
> Ce message et ses pieces jointes peuvent contenir des informations 
> confidentielles ou privilegiees et ne doivent donc
> pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu 
> ce message par erreur, veuillez le signaler
> a l'expediteur et le detruire ainsi que les pieces jointes. Les messages 
> electroniques etant susceptibles d'alteration,
> Orange decline toute responsabilite si ce message a ete altere, deforme ou 
> falsifie. Merci.
> 
> This message and its attachments may contain confidential or privileged 
> information that may be protected by law;
> they should not be distributed, used or copied without authorisation.
> If you have received this email in error, please notify the sender and delete 
> this message and its attachments.
> As emails may be altered, Orange is not liable for messages that have been 
> modified, changed or falsified.
> Thank you.
> 
> 
> 
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
> 

-- 
Loïc Dachary, Artisan Logiciel Libre



signature.asc
Description: OpenPGP digital signature
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com