riday, February 5, 2016 10:06 AM
>To: hdfs-dev@hadoop.apache.org; common-...@hadoop.apache.org
>Subject: RE: Hadoop encryption module as Apache Chimera incubator project
>
>> [Chirs] Yes, but even if the artifact is widely consumed, as a TLP it
>>would need to sustain a community. If th
, February 5, 2016 10:06 AM
To: hdfs-dev@hadoop.apache.org; common-...@hadoop.apache.org
Subject: RE: Hadoop encryption module as Apache Chimera incubator project
> [Chirs] Yes, but even if the artifact is widely consumed, as a TLP it would
> need to sustain a community. If the scope is too narrow, t
rom: Chris Douglas [mailto:cdoug...@apache.org]
Sent: Friday, February 5, 2016 6:28 AM
To: common-...@hadoop.apache.org
Cc: hdfs-dev@hadoop.apache.org
Subject: Re: Hadoop encryption module as Apache Chimera incubator project
On Thu, Feb 4, 2016 at 12:06 PM, Gangumalla, Uma
wrote:
> [UMA] Ok. Great. You
te project.
>>Yes. Just mentioned above, the library will be positioned in
>>cryptographic.
>>
>>
>>Thanks,
>>
>>-Original Message-
>>From: Chris Douglas [mailto:cdoug...@apache.org]
>>Sent: Thursday, February 4, 2016 7:26 AM
>>T
ly ones you're interested in
>>>pulling out, then Apache Commons does seem like a better target than a
>>>separate project.
>Yes. Just mentioned above, the library will be positioned in
>cryptographic.
>
>
>Thanks,
>
>-Original Message-
>From: C
rary will be positioned in cryptographic.
Thanks,
-Original Message-
From: Chris Douglas [mailto:cdoug...@apache.org]
Sent: Thursday, February 4, 2016 7:26 AM
To: hdfs-dev@hadoop.apache.org
Subject: Re: Hadoop encryption module as Apache Chimera incubator project
I went through the reposi
. Yes at
the beginning, only the encryption thing.
Regards,
Kai
-Original Message-
From: Chen, Haifeng [mailto:haifeng.c...@intel.com]
Sent: Thursday, February 04, 2016 10:30 AM
To: hdfs-dev@hadoop.apache.org
Subject: RE: Hadoop encryption module as Apache Chimera incubator project
discussion happens in hdfs-dev.
Regards,
Haifeng
-Original Message-
From: Allen Wittenauer [mailto:a...@altiscale.com]
Sent: Wednesday, February 3, 2016 11:59 PM
To: hdfs-dev@hadoop.apache.org
Subject: Re: Hadoop encryption module as Apache Chimera incubator project
Why is this
apache.org
Subject: Re: Hadoop encryption module as Apache Chimera incubator project
Let's do one step at a time. There is a clear need for common encryption, and
let's focus on making that happen.
On Wed, Feb 3, 2016 at 4:48 PM, Zheng, Kai wrote:
> I thought this discuss
t; -Original Message-
> From: Chris Douglas [mailto:cdoug...@apache.org]
> Sent: Thursday, February 04, 2016 7:26 AM
> To: hdfs-dev@hadoop.apache.org
> Subject: Re: Hadoop encryption module as Apache Chimera incubator project
>
> I went through the repository, and now
fit and impact even more broad scope than Hadoop itself.
Regards,
Kai
-Original Message-
From: Chris Douglas [mailto:cdoug...@apache.org]
Sent: Thursday, February 04, 2016 7:26 AM
To: hdfs-dev@hadoop.apache.org
Subject: Re: Hadoop encryption module as Apache Chimera incubator project
d prefer (updated) libraries from the environment, if
> configured. Otherwise it's a pain (or impossible) for ops to patch
> security bugs. -C
>
>>>-Original Message-
>>>From: Colin P. McCabe [mailto:cmcc...@apache.org]
>>>Sent: Wednesday, February 3, 20
Why is this discussion taking place on hdfs-dev when other parts of
Hadoop use encryption code? That alone makes me uncomfortable moving this code
outside of the Hadoop umbrella.
Also, since Yetus was invoked, it’s worthwhile pointing out that we had
_many_ projects, inside
> On 3 Feb 2016, at 08:07, Chen, Haifeng wrote:
>
>>> [Colin] I do think there will be some challenges splitting this
>>> functionality out into a separate jar, because of the way our CLASSPATH
>>> works right now.
> Yes, this challenges are common for shared libraries in Java. Just as you
>
(updated) libraries from the environment, if
configured. Otherwise it's a pain (or impossible) for ops to patch
security bugs. -C
>>-Original Message-
>>From: Colin P. McCabe [mailto:cmcc...@apache.org]
>>Sent: Wednesday, February 3, 2016 4:56 AM
>>To: hdfs-dev@
ate project outside hadoop or inside.
So, I feel this point would not really influence to judge the discussion.
>
>
>Regards,
>Haifeng
>
>-Original Message-
>From: Colin P. McCabe [mailto:cmcc...@apache.org]
>Sent: Wednesday, February 3, 2016 4:56 AM
>To: hdfs-dev
>> Apache Commons (or other options, TLP)?
>>
>> Thanks,
>> Haifeng
>>
>> -Original Message-
>> From: Chen, Haifeng [mailto:haifeng.c...@intel.com]
>> Sent: Saturday, January 30, 2016 10:52 AM
>> To: hdfs-dev@hadoop.apache.org
>> Su
>> as libhadoop.so problem). Frankly speaking, I think it is not the best
>> option we can try. I also expect that an independent release project within
>> Hadoop core will also complicate the existing release ideology of Hadoop
>> release.
>>
>> Thanks,
&g
riginal Message-
> From: Chen, Haifeng [mailto:haifeng.c...@intel.com]
> Sent: Saturday, January 30, 2016 10:52 AM
> To: hdfs-dev@hadoop.apache.org
> Subject: RE: Hadoop encryption module as Apache Chimera incubator project
>
>>> I believe encryption is becoming a core part of Ha
: Saturday, January 30, 2016 10:52 AM
To: hdfs-dev@hadoop.apache.org
Subject: RE: Hadoop encryption module as Apache Chimera incubator project
>> I believe encryption is becoming a core part of Hadoop. I think that
>> moving core components out of Hadoop is bad from a projec
endent release project within Hadoop core
will also complicate the existing release ideology of Hadoop release.
Thanks,
Haifeng
-Original Message-
From: Aaron T. Myers [mailto:a...@cloudera.com]
Sent: Friday, January 29, 2016 9:51 AM
To: hdfs-dev@hadoop.apache.org
Subject: Re: Hadoop encrypti
On Wed, Jan 27, 2016 at 11:31 AM, Owen O'Malley wrote:
> I believe encryption is becoming a core part of Hadoop. I think that moving
> core components out of Hadoop is bad from a project management perspective.
>
Although it's certainly true that encryption capabilities (in HDFS, YARN,
etc.) are
Give the forgotten reference:
[1] https://github.com/apache/directory-kerby
-Original Message-
From: Zheng, Kai [mailto:kai.zh...@intel.com]
Sent: Friday, January 29, 2016 9:10 AM
To: hdfs-dev@hadoop.apache.org
Subject: RE: Hadoop encryption module as Apache Chimera incubator project
iginal Message-
From: Gangumalla, Uma [mailto:uma.ganguma...@intel.com]
Sent: Thursday, January 28, 2016 4:08 AM
To: hdfs-dev@hadoop.apache.org
Subject: Re: Hadoop encryption module as Apache Chimera incubator project
Thanks for the inputs Owen.
On 1/27/16, 11:31 AM, "Owen O'Malley&qu
Thanks for the inputs Owen.
On 1/27/16, 11:31 AM, "Owen O'Malley" wrote:
>On Wed, Jan 27, 2016 at 9:59 AM, Gangumalla, Uma
>
>wrote:
>
>> I think Chimera goal is to enhance even for other use cases.
>
>
>Naturally.
>
>
>> For Hadoop, CTR mode should be enough today,
>
>
>This isn't true. Hadoop
On Wed, Jan 27, 2016 at 9:59 AM, Gangumalla, Uma
wrote:
> I think Chimera goal is to enhance even for other use cases.
Naturally.
> For Hadoop, CTR mode should be enough today,
This isn't true. Hadoop should use better encryption for RPC and shuffle,
both of which should not use CTR.
> I
I think Chimera goal is to enhance even for other use cases. For Hadoop,
CTR mode should be enough today, but when we want to support other modes
for other users(ex:While a lot of encryption such as network encryption or
data transfer encryption over the wire doesn't necessarily CTR, other
modes su
Sorry to be coming in to this discussion late. Rather than pull the code
out of Hadoop, may I suggest instead making it a separate subproject within
Hadoop itself? I'd suggest letting it release independently of Hadoop,
since it will need a much faster cadence that Hadoop proper does. It should
als
...@intel.com]
Sent: Sunday, January 24, 2016 10:42 AM
To: hdfs-dev@hadoop.apache.org
Subject: RE: Hadoop encryption module as Apache Chimera incubator project
> [Kai] So far I saw it's mainly about AES-256. I suggest the scope can be
> expanded a little bit, perhaps a dedicated high performance
onsider in the future roadmap.
Thanks,
Haifeng
-Original Message-
From: Zheng, Kai [mailto:kai.zh...@intel.com]
Sent: Friday, January 22, 2016 9:11 AM
To: hdfs-dev@hadoop.apache.org
Subject: RE: Hadoop encryption module as Apache Chimera incubator project
Thanks Chris for the pointer and Uma f
gards,
Kai
-Original Message-
From: Gangumalla, Uma [mailto:uma.ganguma...@intel.com]
Sent: Friday, January 22, 2016 8:38 AM
To: hdfs-dev@hadoop.apache.org
Subject: Re: Hadoop encryption module as Apache Chimera incubator project
>Uma and everyone, thank you for the proposal. +1 to pr
h clients. It may also be helpful for development, because
>>sometimes when run unit tests that involve native codes, some error may
>>happen and complain no place to find libhadoop.so. Thanks.
>>
>>Regards,
>>Kai
>>
>>-Original Message-
>>From:
n and complain no place to find libhadoop.so. Thanks.
>
>Regards,
>Kai
>
>-Original Message-
>From: Gangumalla, Uma [mailto:uma.ganguma...@intel.com]
>Sent: Thursday, January 21, 2016 11:20 AM
>To: hdfs-dev@hadoop.apache.org
>Subject: Re: Hadoop encryption modul
ibhadoop.so. Thanks.
Regards,
Kai
-Original Message-
From: Gangumalla, Uma [mailto:uma.ganguma...@intel.com]
Sent: Thursday, January 21, 2016 11:20 AM
To: hdfs-dev@hadoop.apache.org
Subject: Re: Hadoop encryption module as Apache Chimera incubator project
Hi All,
Thanks Andrew, ATM, Yi, Kai,
Hi All,
Thanks Andrew, ATM, Yi, Kai, Larry. Thanks Haifeng on clarifying release
stuff.
Please find my responses below.
Andrew wrote:
If it becomes part of Apache Commons, could we make Chimera a separate
JAR? We have real difficulties bumping dependency versions right now, so
ideally we don't n
Chen, Haifeng [mailto:haifeng.c...@intel.com]
Sent: Thursday, January 21, 2016 10:53 AM
To: hdfs-dev@hadoop.apache.org
Subject: RE: Hadoop encryption module as Apache Chimera incubator project
Agree that if making Chimera part of Apache commons is the desire, it would be
better to be a stand
Subject: Re: Hadoop encryption module as Apache Chimera incubator project
That's a good point, Kai.
If what we are looking for is some level of autonomy then it would need to be a
module with its own release train - or at least be able to.
On Jan 20, 2016, at 9:18 PM, Zheng, Kai wrote:
1, 2016 9:44 AM
> To: hdfs-dev@hadoop.apache.org
> Subject: Re: Hadoop encryption module as Apache Chimera incubator project
>
> +1 for Hadoop depending upon Chimera, assuming Chimera can get
> hosted/released under some Apache project umbrella. If that's Apache Commons
> (
.apache.org
> Subject: Re: Hadoop encryption module as Apache Chimera incubator project
>
> +1 for Hadoop depending upon Chimera, assuming Chimera can get
> hosted/released under some Apache project umbrella. If that's Apache
> Commons (which makes a lot of sense to me) then I
...@cloudera.com]
Sent: Thursday, January 21, 2016 9:44 AM
To: hdfs-dev@hadoop.apache.org
Subject: Re: Hadoop encryption module as Apache Chimera incubator project
+1 for Hadoop depending upon Chimera, assuming Chimera can get
hosted/released under some Apache project umbrella. If that's Apache Co
+1 for Hadoop depending upon Chimera, assuming Chimera can get
hosted/released under some Apache project umbrella. If that's Apache
Commons (which makes a lot of sense to me) then I'm also a big +1 on
Andrew's suggestion that we make it a separate module.
Uma, would you be up for approaching the A
Thanks Uma for putting together this proposal. Overall sounds good to me,
+1 for these improvements. A few comments/questions:
* If it becomes part of Apache Commons, could we make Chimera a separate
JAR? We have real difficulties bumping dependency versions right now, so
ideally we don't need to
Hi Devs,
Some of our Hadoop developers working with Spark community to implement the
shuffle encryption. While implementing that, they realized some/most of the
code in Hadoop encryption code and their implemention code have to be
duplicated. This leads to an idea to create separate library,
43 matches
Mail list logo
