Re: Jerasure 1.2A plugin for Ceph
[cc'ing the devel mailing list] Hi James, Thanks for the positive feedback :-) I found the API fairly straightforward and I don't see what could be improved. However, I've learnt about erasure code and designed the Ceph plugin abstract API mostly by studying jerasure. I'm probably biased : let hear what others have to suggest. Cheers On 11/09/2013 17:04, James Plank wrote: Hi Loic -- I took a scan, and it looks like a nice usage of the library. Here's a question -- for the next revision of jerasure, are there any functionalities that you would like to see, that would make your life as a developer easier? Thanks! Jim -- On Aug 30, 2013, at 4:20 AM, Loic Dachary wrote: Hi James, The first version of the jerasure 1.2A plugin for Ceph is complete at https://github.com/ceph/ceph/pull/538#commits-pushed-763275e This commit introduces the main part: ErasureCodeJerasure: base class for jerasure ErasureCodeInterface https://github.com/dachary/ceph/commit/76d2842358465e560a4929d60131762f8c93804f and each technique is derived from it in six successive commits, starting from here ErasureCodeJerasure: define technique ReedSolomonVandermonde It would be great if you could take a look and let us know if you see anything odd. Cheers -- Loïc Dachary, Artisan Logiciel Libre All that is necessary for the triumph of evil is that good people do nothing. -- Loïc Dachary, Artisan Logiciel Libre All that is necessary for the triumph of evil is that good people do nothing. signature.asc Description: OpenPGP digital signature
Re: Jerasure 1.2A plugin for Ceph
On Wed, 11 Sep 2013, Loic Dachary wrote: [cc'ing the devel mailing list] Hi James, Thanks for the positive feedback :-) I found the API fairly straightforward and I don't see what could be improved. However, I've learnt about erasure code and designed the Ceph plugin abstract API mostly by studying jerasure. I'm probably biased : let hear what others have to suggest. Cheers On 11/09/2013 17:04, James Plank wrote: Hi Loic -- I took a scan, and it looks like a nice usage of the library. Here's a question -- for the next revision of jerasure, are there any functionalities that you would like to see, that would make your life as a developer easier? Thanks! Jim -- Hi James- Late to this discussion, and this may have already been covered, but: there is a bunch of Intel-optimized code floating around for various erasure codes. I would love to see this incorporated into jerasure (with automatic arch and CPU feature detection) so that users can transparently take advantage of it. sage On Aug 30, 2013, at 4:20 AM, Loic Dachary wrote: Hi James, The first version of the jerasure 1.2A plugin for Ceph is complete at https://github.com/ceph/ceph/pull/538#commits-pushed-763275e This commit introduces the main part: ErasureCodeJerasure: base class for jerasure ErasureCodeInterface https://github.com/dachary/ceph/commit/76d2842358465e560a4929d60131762f8c93804f and each technique is derived from it in six successive commits, starting from here ErasureCodeJerasure: define technique ReedSolomonVandermonde It would be great if you could take a look and let us know if you see anything odd. Cheers -- Lo?c Dachary, Artisan Logiciel Libre All that is necessary for the triumph of evil is that good people do nothing. -- Lo?c Dachary, Artisan Logiciel Libre All that is necessary for the triumph of evil is that good people do nothing. -- To unsubscribe from this list: send the line unsubscribe ceph-devel in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html
Re: Jerasure 1.2A plugin for Ceph
On 09/11/2013 11:29 AM, Sage Weil wrote: On Wed, 11 Sep 2013, Loic Dachary wrote: [cc'ing the devel mailing list] Hi James, Thanks for the positive feedback :-) I found the API fairly straightforward and I don't see what could be improved. However, I've learnt about erasure code and designed the Ceph plugin abstract API mostly by studying jerasure. I'm probably biased : let hear what others have to suggest. Cheers On 11/09/2013 17:04, James Plank wrote: Hi Loic -- I took a scan, and it looks like a nice usage of the library. Here's a question -- for the next revision of jerasure, are there any functionalities that you would like to see, that would make your life as a developer easier? Thanks! Jim -- Hi James- Late to this discussion, and this may have already been covered, but: there is a bunch of Intel-optimized code floating around for various erasure codes. I would love to see this incorporated into jerasure (with automatic arch and CPU feature detection) so that users can transparently take advantage of it. sage +1. Same for ARM down the road. :D Mark On Aug 30, 2013, at 4:20 AM, Loic Dachary wrote: Hi James, The first version of the jerasure 1.2A plugin for Ceph is complete at https://github.com/ceph/ceph/pull/538#commits-pushed-763275e This commit introduces the main part: ErasureCodeJerasure: base class for jerasure ErasureCodeInterface https://github.com/dachary/ceph/commit/76d2842358465e560a4929d60131762f8c93804f and each technique is derived from it in six successive commits, starting from here ErasureCodeJerasure: define technique ReedSolomonVandermonde It would be great if you could take a look and let us know if you see anything odd. Cheers -- Lo?c Dachary, Artisan Logiciel Libre All that is necessary for the triumph of evil is that good people do nothing. -- Lo?c Dachary, Artisan Logiciel Libre All that is necessary for the triumph of evil is that good people do nothing. -- To unsubscribe from this list: send the line unsubscribe ceph-devel in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html -- To unsubscribe from this list: send the line unsubscribe ceph-devel in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html
Re: Jerasure 1.2A plugin for Ceph
That's definitely down the road, once I get gf_complete, well, complete. Thanks for the feedback -- Jim -- On Sep 11, 2013, at 12:32 PM, Mark Nelson wrote: On 09/11/2013 11:29 AM, Sage Weil wrote: On Wed, 11 Sep 2013, Loic Dachary wrote: [cc'ing the devel mailing list] Hi James, Thanks for the positive feedback :-) I found the API fairly straightforward and I don't see what could be improved. However, I've learnt about erasure code and designed the Ceph plugin abstract API mostly by studying jerasure. I'm probably biased : let hear what others have to suggest. Cheers On 11/09/2013 17:04, James Plank wrote: Hi Loic -- I took a scan, and it looks like a nice usage of the library. Here's a question -- for the next revision of jerasure, are there any functionalities that you would like to see, that would make your life as a developer easier? Thanks! Jim -- Hi James- Late to this discussion, and this may have already been covered, but: there is a bunch of Intel-optimized code floating around for various erasure codes. I would love to see this incorporated into jerasure (with automatic arch and CPU feature detection) so that users can transparently take advantage of it. sage +1. Same for ARM down the road. :D Mark On Aug 30, 2013, at 4:20 AM, Loic Dachary wrote: Hi James, The first version of the jerasure 1.2A plugin for Ceph is complete at https://github.com/ceph/ceph/pull/538#commits-pushed-763275e This commit introduces the main part: ErasureCodeJerasure: base class for jerasure ErasureCodeInterface https://github.com/dachary/ceph/commit/76d2842358465e560a4929d60131762f8c93804f and each technique is derived from it in six successive commits, starting from here ErasureCodeJerasure: define technique ReedSolomonVandermonde It would be great if you could take a look and let us know if you see anything odd. Cheers -- Lo?c Dachary, Artisan Logiciel Libre All that is necessary for the triumph of evil is that good people do nothing. -- Lo?c Dachary, Artisan Logiciel Libre All that is necessary for the triumph of evil is that good people do nothing. -- To unsubscribe from this list: send the line unsubscribe ceph-devel in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html -- To unsubscribe from this list: send the line unsubscribe ceph-devel in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html
Jerasure 1.2A plugin for Ceph
Hi James, The first version of the jerasure 1.2A plugin for Ceph is complete at https://github.com/ceph/ceph/pull/538#commits-pushed-763275e This commit introduces the main part: ErasureCodeJerasure: base class for jerasure ErasureCodeInterface https://github.com/dachary/ceph/commit/76d2842358465e560a4929d60131762f8c93804f and each technique is derived from it in six successive commits, starting from here ErasureCodeJerasure: define technique ReedSolomonVandermonde It would be great if you could take a look and let us know if you see anything odd. Cheers -- Loïc Dachary, Artisan Logiciel Libre All that is necessary for the triumph of evil is that good people do nothing. signature.asc Description: OpenPGP digital signature
