RE: Hadoop encryption module as Apache Chimera incubator project

2016-02-11 Thread Chen, Haifeng
Thanks all the folks participating this discussion and providing valuable suggestions and options. I suggest we take it forward to make a proposal in Apache Commons community. Thanks, Haifeng -Original Message- From: Chen, Haifeng [mailto:haifeng.c...@intel.com] Sent: Friday

RE: Hadoop encryption module as Apache Chimera incubator project

2016-02-04 Thread Chen, Haifeng
but this instance seems reasonable to me. -C [1] https://apr.apache.org/ > On 2/3/16, 6:46 PM, "Chen, Haifeng" wrote: > >>Thanks Chris. >> >>>> I went through the repository, and now understand the reasoning >>>>that would locate this code

RE: Hadoop encryption module as Apache Chimera incubator project

2016-02-03 Thread Chen, Haifeng
cessful as an independent project or stalls, >>>> Hadoop and/or Spark and/or $project will have to reabsorb it as >>>> maintainers. Projects have high mortality in early life, and a >>>> fight over inheritance/maintenance is something we'd like to avoid. &g

RE: Hadoop encryption module as Apache Chimera incubator project

2016-02-03 Thread Chen, Haifeng
Thanks Allen for your questioning. >> Why is this discussion taking place on hdfs-dev when other parts of Hadoop >> use encryption code? That alone makes me uncomfortable moving this code >> outside of the Hadoop umbrella. Let me explain in this way. Hadoop common implements the crypto stuff

RE: Hadoop encryption module as Apache Chimera incubator project

2016-02-03 Thread Chen, Haifeng
gt; >>>Colin > >>> > >>>On Tue, Feb 2, 2016 at 12:29 AM, Chris Douglas > >>> > >>>wrote: > >>>> As a subproject of Hadoop, Chimera could maintain its own cadence. > >>>> There's also no reason why it should maintain

RE: Hadoop encryption module as Apache Chimera incubator project

2016-02-03 Thread Chen, Haifeng
plicated pedigree. If Chimera > eventually becomes a TLP, it seems fair to include those who work on > it while it is a subproject. Declared upfront, that criterion is > fairer than any post hoc justification, and will lead to a more > accurate account of its community than a subs

RE: Hadoop encryption module as Apache Chimera incubator project

2016-02-01 Thread Chen, Haifeng
Thanks to all folks providing feedbacks and participating the discussions. @Owen, do you still have any concerns on going forward in the direction of Apache Commons (or other options, TLP)? Thanks, Haifeng -Original Message- From: Chen, Haifeng [mailto:haifeng.c...@intel.com] Sent

RE: Hadoop encryption module as Apache Chimera incubator project

2016-01-29 Thread Chen, Haifeng
>> I believe encryption is becoming a core part of Hadoop. I think that >> moving core components out of Hadoop is bad from a project management >> perspective. > Although it's certainly true that encryption capabilities (in HDFS, YARN, > etc.) are becoming core to Hadoop, I don't think that sh

RE: Hadoop encryption module as Apache Chimera incubator project

2016-01-26 Thread Chen, Haifeng
Thanks all folks for providing valuable feedbacks. Uma, would you help a proposal to Apache Commons for Chimera to join as a module, mentioning that Hadoop and Spark are both on board to depend on this? Thanks, Haifeng -Original Message- From: Chen, Haifeng [mailto:haifeng.c

RE: Hadoop encryption module as Apache Chimera incubator project

2016-01-23 Thread Chen, Haifeng
> [Kai] So far I saw it's mainly about AES-256. I suggest the scope can be > expanded a little bit, perhaps a dedicated high performance encryption > library, then we would have quite much to contribute to it, like other > ciphers, MACs, PRNGs and so on. Then both Hadoop and Spark can benefit fr

RE: Hadoop encryption module as Apache Chimera incubator project

2016-01-20 Thread Chen, Haifeng
Agree that if making Chimera part of Apache commons is the desire, it would be better to be a standalone component in commons with its own release traces. >From apache commons project web (https://commons.apache.org/), we see there is >already a long list of components in its Apache Commons Prope