03#U37803
>
> On Wed, Feb 24, 2016 at 3:40 PM, Liping Zhang
> wrote:
>
>> Is there any example about how to add external jar into oozie when
>> running spark action in oozie?
>>
>> On Wed, Feb 24, 2016 at 3:37 PM, Liping Zhang
>> wrote:
>>
>>
Is there any example about how to add external jar into oozie when running
spark action in oozie?
On Wed, Feb 24, 2016 at 3:37 PM, Liping Zhang wrote:
> Actually I'm still a little confued about the 4 ways mentioned in "One
> Last Thing" in
> http://blog.cloudera.com/blo
#x27;t
work.
Could you please give any suggestion? Thanks very much for any of your
help! I appreciated!
On Wed, Feb 24, 2016 at 3:13 PM, Liping Zhang wrote:
> Thanks Robert!
>
> I tried the way 1, 2, 4 introduced in
> http://blog.cloudera.com/blog/2014/05/how-to-use-the-sharelib-in-
ssing-and-Workflow/how-to-add-external-guava-16-0-1-jar-in-CDH-oozie-classpath/m-p/37803#U37803
Can you give an detailed example with commands steps? Thanks!
On Wed, Feb 24, 2016 at 2:21 PM, Liping Zhang wrote:
> Thanks very much Robert for you quick answer!
>
> I upload the guava-1
ttp://blog.cloudera.com/blog/2014/05/how-to-use-the-sharelib-in-apache-oozie-cdh-5/
>
> - Robert
>
> On Wed, Feb 24, 2016 at 11:40 AM, Liping Zhang
> wrote:
>
> > Thanks Jaydeep for you quick response!
> >
> > After adding oozie.action.sharelib.for.spark = spark,
what's in the Spark
> sharelib directory already. If you simply put Guava 16.0.1 in there, you
> may run into other problems.
>
>
> - Robert
>
> On Wed, Feb 24, 2016 at 12:34 PM, Liping Zhang
> wrote:
>
> > I added guava-16.0.1.jar into
> > HDFS /user/oo
2
Appreciated if any help!
On Wed, Feb 24, 2016 at 12:34 PM, Liping Zhang
wrote:
> Dear,
>
> We used CDH5.5.0 Hue Oozie to run Spark action, and in the spark job
> action, the job used spark-cassandra-connector_2.10-1.5.0-M2.jar.
>
> The job can run successfully with
Dear,
We used CDH5.5.0 Hue Oozie to run Spark action, and in the spark job
action, the job used spark-cassandra-connector_2.10-1.5.0-M2.jar.
The job can run successfully with spark-submit command, but it was failed
to run in oozie.
It said oozie can not find guava-16.0.1.jar(guava-16.0.1.jar is
ndra.main(TestCassandra.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
On Wed, Feb 24, 2016 at 5:00 AM, Jaydeep Vishwakarma <
jaydeep.vishwaka...@inmobi.com> wrote:
> Add spark sharelib in oozie setup it will work.
>
> Regards,
> Jaydep
>
> On Wed,
Dear oozie user and dev,
I set following values in job.properties and in action properties in CDH
5.5.0 Hue oozie:
oozie.use.system.libpath=true
oozie.libpath=hdfs://ip-10-0-4-248.us-west-1.compute.internal:8020/user/oozie/share/lib/lib_20151201085935
oozie.action.sharelib.for.spark=hdfs://ip-10-0
launcher's memory? Thanks very much for your answers!
**
*
oozie.launcher.mapreduce.map.memory.mb*
*6144 *
**
On Tue, Feb 9, 2016 at 12:45 PM, Liping Zhang wrote:
> Thanks Serega for your answers!
>
&g
cVariable.scala:57)
at akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136)
On Thu, Feb 4, 2016 at 11:10 PM, Serega Sheypak
wrote:
> probably you need to increase mem for oozie launcher itself?
>
> 2016-02-04 20:57 GMT+01:00 Liping Zhang :
>
>> Dear Oozie user and dev,
>>
>
12 matches
Mail list logo
