Re: Oozie 5.1.0 release and plans for the year

2018-06-19 Thread Artem Ervits
+1 on the plans, I won't get to the jiras I'm assigned to until next week. Don't want to be a blocker. On Tue, Jun 19, 2018, 4:48 AM Andras Piros wrote: > Good idea Gp! > > Thanks for volunteering as the release manager for 5.1.0. I can see *a few > blockers > < >

Re: Oozie for spark jobs without Hadoop

2018-05-16 Thread Artem Ervits
Here's some related info https://docs.hortonworks.com/HDPDocuments/HDCloudAWS/HDCloudAWS-1.8.0/bk_hdcloud-aws/content/s3-trouble/index.html https://github.com/apache/hadoop/blob/trunk/hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/index.md On Wed, May 16, 2018, 3:45 PM purna

Re: Spark 2.3 in oozie

2018-05-15 Thread Artem Ervits
Did you run mvn clean install first on the parent directory? On Tue, May 15, 2018, 11:35 AM purna pradeep wrote: > Thanks peter, > > I have tried changing Dspark.version to 2.3.0 and compiled oozie I’m > getting below error from oozie examples > > > *ERROR] Failed to

Re: oozie job action fails with JA017

2018-02-16 Thread Artem Ervits
What version of Spark is it? Why not take advantage of the Spark action directly? I highly recommend asking vendor specific questions in the associated forums. On Feb 16, 2018 4:54 AM, "Malathi Thangarajan" wrote: > Hi, > > I have a oozie shell action that executes a

Re: Welcoming new Oozie PMC members: Attila Sasvari, Peter Cseh, and Peter Bacsko

2018-01-31 Thread Artem Ervits
Well deserved, congratulations guys!! On Jan 31, 2018 6:27 PM, "Robert Kanter" wrote: > Hello Oozie community, > > It's my pleasure to announce that Attila Sasvari, Peter Cseh, and Peter > Bascko > have become the newest additions to the Oozie PMC. > > Please join me

Re: Oozie coordinator and kafka

2017-12-19 Thread Artem Ervits
исал(а): > > > > Don't push NiFi :) Please don't :) > > > > 2017-12-19 16:16 GMT+01:00 Artem Ervits <artemerv...@gmail.com>: > > > >> you're probably better off using Apache Nifi at that point, Kafka Nifi > is > >> better integrated today than Oo

Re: Oozie coordinator and kafka

2017-12-19 Thread Artem Ervits
you're probably better off using Apache Nifi at that point, Kafka Nifi is better integrated today than Oozie and Kafka. Probably wrong mailing list to push Nifi but it's a common use case in that realm. Thanks On Mon, Dec 18, 2017 at 7:04 PM, Serega Sheypak wrote: >

Re: Welcoming new Oozie PMC member Satish Saley

2017-12-11 Thread Artem Ervits
Well deserved, congratulations Satish! On Dec 11, 2017 2:49 PM, "Robert Kanter" wrote: > Hello Oozie community, > > It's my pleasure to announce that Satish Saley has become the newest > addition to the Oozie PMC. > > Please join me congratulating him. > Congrats! > > > -

Re: Welcome new Oozie Committer - Attila Sasvari

2017-07-20 Thread Artem Ervits
congratulations Attila! On Thu, Jul 20, 2017 at 12:03 PM, Andras Piros wrote: > Yy! Great job, well done, Sasi! > > Congrats! > > Andras > > On Thu, Jul 20, 2017 at 6:01 PM, Robert Kanter wrote: > > > Hi everyone, > > > > It is my pleasure to

Re: SLA alerts on running actions

2017-05-26 Thread Artem Ervits
You can access SLA information via JMS or REST in case you need that info prior to job completion. Also check the following page, there is some tuning available to make processing of SLA events faster https://oozie.apache.org/docs/4.0.0/AG_Install.html#Notifications_Configuration On May 24, 2017

Re: Immutable vs mutable parameters in Oozie 4.2.0

2017-04-05 Thread Artem Ervits
Toby, your 2.5 release doesn't seem right. Latest 2.5 release is 2.5.3. here are the changes for Oozie in 2.5 http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_release-notes/content/patch_oozie.html And

Re: Extended attributes

2017-01-23 Thread Artem Ervits
ozie 1770. > Feel free to open an issue to bump the default hadoop version and add a > patch to it. > I'm sure it will be submitted earlier. > Go > > > On Jan 17, 2017 17:07, "Artem Ervits" <artemerv...@gmail.com> wrote: > > > do you know if it's a long wait? I

Re: Extended attributes

2017-01-17 Thread Artem Ervits
n to 2.6.0. > We're working on getting it to the master branch. > > gp > > > On Mon, Jan 16, 2017 at 2:37 AM, Artem Ervits <dbis...@gmail.com> wrote: > > > Hello all, I'm trying to extend FS action functionality to extended > > attributes and I realized that this f

Extended attributes

2017-01-15 Thread Artem Ervits
Hello all, I'm trying to extend FS action functionality to extended attributes and I realized that this functionality is not exposed in Hadoop 2.4. All major distros moved to 2.6.1 at the least, what are the plans to migrate these libraries?

RE: create a dir with timestamp for sqoop import

2013-03-05 Thread Artem Ervits
the previous day's data. The output dataset instance provides the path I need based on the uri-template, and the EL functions coord:formatTime(), coord:dateOffset() and cood:nominalTime() build the formatted date string. Hope that helps. Paul -Original Message- From: Artem Ervits [mailto:are9

RE: Oozie uses different M/R than the one specified in jar

2013-03-04 Thread Artem Ervits
package name and class name somewhere in the classpath? You should try removing the duplicate Regards, Rohini On Sat, Mar 2, 2013 at 6:05 AM, Artem Ervits are9...@nyp.org wrote: Hello all, I'm trying to write a M/R workflow. It simply counts the records in a SequenceFile. When I execute

default MapReduce class

2013-03-04 Thread Artem Ervits
Hello all, Where does Oozie grab the default mapreduce mapper/reducer classes to execute? I am trying to specify explicitly the mapper and reducer classes, as well as input and output format classes and Oozie completely ignores them. This electronic message is intended

RE: Oozie uses different M/R than the one specified in jar

2013-03-04 Thread Artem Ervits
some other jar containing file with same package name and class name somewhere in the classpath? You should try removing the duplicate Regards, Rohini On Sat, Mar 2, 2013 at 6:05 AM, Artem Ervits are9...@nyp.org wrote: Hello all, I'm trying to write a M/R workflow. It simply counts