Thanks Tsuyoshi for opening the discussion. One benefit of the
dependency/classpath isolation work is that it can open up a possibility of
having diverging dependencies in a safe manner so that upgrading libraries
may have less impact. I'll spend some more time on HADOOP-13070 to make
some progress
thanks for bringing this up! big +1 on upgrading dependencies for 3.0.
I have an updated patch for HADOOP-11804 ready to post this week. I've
been updating HBase's master branch to try to make use of it, but
could use some other reviews.
On Thu, Jul 21, 2016 at 4:30 AM, Tsuyoshi Ozawa wrote:
> H
Does any of this work actually help processes that sit outside of YARN?
> On Jul 21, 2016, at 12:29 PM, Sean Busbey wrote:
>
> thanks for bringing this up! big +1 on upgrading dependencies for 3.0.
>
> I have an updated patch for HADOOP-11804 ready to post this week. I've
> been updating HBase
My work on HADOOP-11804 *only* helps processes that sit outside of YARN. :)
On Fri, Jul 22, 2016 at 10:48 AM, Allen Wittenauer
wrote:
>
> Does any of this work actually help processes that sit outside of YARN?
>
>> On Jul 21, 2016, at 12:29 PM, Sean Busbey wrote:
>>
>> thanks for bringing this u
The work on HADOOP-13070 and the ApplicationClassLoader are generic and go
beyond YARN. It can be used in any JVM that uses hadoop. The current use
cases are MR containers, hadoop's RunJar (as in "hadoop jar"), and the YARN
node manager auxiliary services. I'm not sure if that's what you were
askin
But if I don't use ApplicationClassLoader, my java app is basically screwed
then, right?
Also: right now, the non-Linux and/or non-x86 platforms have to supply their
own leveldbjni jar (or at least the C level library?) in order to make YARN
even functional. How is that going to work with th
ey ; common-dev@hadoop.apache.org;
yarn-...@hadoop.apache.org; hdfs-...@hadoop.apache.org;
mapreduce-...@hadoop.apache.org
Subject: Re: [DISCUSS] The order of classpath isolation work and
updating/shading dependencies on trunk
But if I don't use ApplicationClassLoader, my java app is basically screwed
> On Jul 22, 2016, at 5:47 PM, Zheng, Kai wrote:
>
> For the leveldb thing, wouldn't we have an alternative option in Java for the
> platforms where leveldb isn't supported yet due to whatever reasons. IMO,
> native library would be best to be used for optimization and production for
> perfor
On Fri, Jul 22, 2016 at 5:15 PM, Allen Wittenauer
wrote:
>
> But if I don't use ApplicationClassLoader, my java app is basically
> screwed then, right?
>
If we start upgrading the libraries aggressively, then it would also mean
that the ApplicationClassLoader should be more of the default than t
> On Jul 25, 2016, at 1:16 PM, Sangjin Lee wrote:
>
> Also: right now, the non-Linux and/or non-x86 platforms have to supply their
> own leveldbjni jar (or at least the C level library?) in order to make YARN
> even functional. How is that going to work with the class path manipulation?
>
>
10 matches
Mail list logo