Re: Spark 2.3 in oozie

2018-05-16 Thread Peter Cseh
gt; > > Thanks peter, > > > > > > > > > > > > I have tried changing Dspark.version to 2.3.0 and compiled oozie > > I’m > > > > > > getting below error from oozie examples > > > > > > > > > > > > > &

Re: Spark 2.3 in oozie

2018-05-16 Thread purna pradeep
> > *ERROR] Failed to execute goal on project oozie-examples: Could not > > > > resolve > > > > > dependencies for project org.apache.oozie:oozie-examples:jar:5.0.0: > > > Could > > > > > not find artifact org.apache.spark:sp

Re: Spark 2.3 in oozie

2018-05-16 Thread Peter Cseh
gt; On Tue, May 15, 2018 at 11:14 AM Peter Cseh <gezap...@cloudera.com> > > > wrote: > > > > > > > > > Oozie has a spark-2 profile that is currently hard-coded to Spark > > 2.1: > > > > > https://github.com/apache/

Re: Spark 2.3 in oozie

2018-05-15 Thread purna pradeep
wrote: > > > > > > > Oozie has a spark-2 profile that is currently hard-coded to Spark > 2.1: > > > > https://github.com/apache/oozie/blob/master/pom.xml#L1983 > > > > I'm sure if you overwrite the -Dspark.version and compile Oozie that > > way > > >

Re: Spark 2.3 in oozie

2018-05-15 Thread Peter Cseh
that > way > > it > > > will work. > > > gp > > > > > > > > > On Tue, May 15, 2018 at 5:07 PM, purna pradeep < > purna2prad...@gmail.com> > > > wrote: > > > > > > > Hello, > > > > > > > >

Re: Spark 2.3 in oozie

2018-05-15 Thread Artem Ervits
; will work. > > gp > > > > > > On Tue, May 15, 2018 at 5:07 PM, purna pradeep <purna2prad...@gmail.com> > > wrote: > > > > > Hello, > > > > > > Does oozie supports spark 2.3? Or will it even care of the spark > version > > &

Re: Spark 2.3 in oozie

2018-05-15 Thread purna pradeep
f you overwrite the -Dspark.version and compile Oozie that way it > will work. > gp > > > On Tue, May 15, 2018 at 5:07 PM, purna pradeep <purna2prad...@gmail.com> > wrote: > > > Hello, > > > > Does oozie supports spark 2.3? Or will it even care of the spark versi

Re: Spark 2.3 in oozie

2018-05-15 Thread Peter Cseh
com> wrote: > Hello, > > Does oozie supports spark 2.3? Or will it even care of the spark version > > I want to use spark action > > > > Thanks, > Purna > -- *Peter Cseh *| Software Engineer cloudera.com <https://www.cloudera.com> [image: Cloudera]

Spark 2.3 in oozie

2018-05-15 Thread purna pradeep
Hello, Does oozie supports spark 2.3? Or will it even care of the spark version I want to use spark action Thanks, Purna