[jira] Subscription: Oozie Patch Available
Issue Subscription Filter: Oozie Patch Available (93 issues) Subscriber: ooziedaily Key Summary OOZIE-3306 Make it possible to override maven dependency plugin version number https://issues.apache.org/jira/browse/OOZIE-3306 OOZIE-3301 Update NOTICE file https://issues.apache.org/jira/browse/OOZIE-3301 OOZIE-3298 OYA: external ID is not filled properly and failing MR job is treated as SUCCEEDED https://issues.apache.org/jira/browse/OOZIE-3298 OOZIE-3274 Remove slf4j https://issues.apache.org/jira/browse/OOZIE-3274 OOZIE-3265 properties RERUN_FAIL_NODES and RERUN_SKIP_NODES should be able to appear together https://issues.apache.org/jira/browse/OOZIE-3265 OOZIE-3256 refactor OozieCLI class https://issues.apache.org/jira/browse/OOZIE-3256 OOZIE-3249 [tools] Instrumentation log parser https://issues.apache.org/jira/browse/OOZIE-3249 OOZIE-3218 Oozie Sqoop action with command splits the select clause into multiple parts due to delimiter being space https://issues.apache.org/jira/browse/OOZIE-3218 OOZIE-3199 Let system property restriction configurable https://issues.apache.org/jira/browse/OOZIE-3199 OOZIE-3196 Authorization: restrict world readability by user https://issues.apache.org/jira/browse/OOZIE-3196 OOZIE-3194 Oozie should set proper permissions to sharelib after upload https://issues.apache.org/jira/browse/OOZIE-3194 OOZIE-3193 Applications are not killed when submitted via subworkflow https://issues.apache.org/jira/browse/OOZIE-3193 OOZIE-3186 Oozie is unable to use configuration linked using jceks://file/... https://issues.apache.org/jira/browse/OOZIE-3186 OOZIE-3179 Adding a configurable config-default.xml location to a workflow https://issues.apache.org/jira/browse/OOZIE-3179 OOZIE-3170 Oozie Diagnostic Bundle tool fails with NPE due to missing service class https://issues.apache.org/jira/browse/OOZIE-3170 OOZIE-3160 PriorityDelayQueue put()/take() can cause significant CPU load due to busy waiting https://issues.apache.org/jira/browse/OOZIE-3160 OOZIE-3135 Configure log4j2 in SqoopMain https://issues.apache.org/jira/browse/OOZIE-3135 OOZIE-3091 Oozie Sqoop Avro Import fails with "java.lang.NoClassDefFoundError: org/apache/avro/mapred/AvroWrapper" https://issues.apache.org/jira/browse/OOZIE-3091 OOZIE-3071 Oozie 4.3 Spark sharelib ueses a different version of commons-lang3 than Spark 2.2.0 https://issues.apache.org/jira/browse/OOZIE-3071 OOZIE-3063 Sanitizing variables that are part of openjpa.ConnectionProperties https://issues.apache.org/jira/browse/OOZIE-3063 OOZIE-3062 Set HADOOP_CONF_DIR for spark action https://issues.apache.org/jira/browse/OOZIE-3062 OOZIE-3061 Kill only those child jobs which are not already killed https://issues.apache.org/jira/browse/OOZIE-3061 OOZIE-2952 Fix Findbugs warnings in oozie-sharelib-oozie https://issues.apache.org/jira/browse/OOZIE-2952 OOZIE-2949 Escape quotes whitespaces in Sqoop field https://issues.apache.org/jira/browse/OOZIE-2949 OOZIE-2942 [examples] Fix Findbugs warnings https://issues.apache.org/jira/browse/OOZIE-2942 OOZIE-2927 Append new line character for Hive2 query using query tag https://issues.apache.org/jira/browse/OOZIE-2927 OOZIE-2877 Oozie Git Action https://issues.apache.org/jira/browse/OOZIE-2877 OOZIE-2834 ParameterVerifier logging non-useful warning for workflow definition https://issues.apache.org/jira/browse/OOZIE-2834 OOZIE-2833 when using uber mode the regex pattern used in the extractHeapSizeMB method does not allow heap sizes specified in bytes. https://issues.apache.org/jira/browse/OOZIE-2833 OOZIE-2829 Improve sharelib upload to accept multiple source folders https://issues.apache.org/jira/browse/OOZIE-2829 OOZIE-2812 SparkConfigurationService should support loading configurations from multiple Spark versions https://issues.apache.org/jira/browse/OOZIE-2812 OOZIE-2795 Create lib directory or symlink for Oozie CLI during packaging https://issues.apache.org/jira/browse/OOZIE-2795 OOZIE-2784 Include WEEK as a parameter in the Coordinator Expression Language Evaulator https://issues.apache.org/jira/browse/OOZIE-2784 OOZIE-2779 Mask Hive2 action Beeline JDBC password https://issues.apache.org/jira/browse/OOZIE-2779 OOZIE-2736 Reduce the number of threads during test execution https://issues.apache.org/jira/browse/OOZIE-2736 OOZIE-2718 Improve -dryrun for bundles https://issues.apache.org/jira/browse/OOZIE-2718 OOZIE-2714 Detect conflicting resources during class loading https://issues.apache.org/jira/browse/OOZIE-2714 OOZIE-2694 Add logging
[jira] [Commented] (OOZIE-3306) Make it possible to override maven dependency plugin version number
[ https://issues.apache.org/jira/browse/OOZIE-3306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16548287#comment-16548287 ] Hadoop QA commented on OOZIE-3306: -- Testing JIRA OOZIE-3306 Cleaning local git workspace {color:green}+1 PATCH_APPLIES{color} {color:green}+1 CLEAN{color} {color:red}-1 RAW_PATCH_ANALYSIS{color} .{color:green}+1{color} the patch does not introduce any @author tags .{color:red}-1{color} the patch contains 1 line(s) with tabs .{color:red}-1{color} the patch contains 1 line(s) with trailing spaces .{color:red}-1{color} the patch contains 1 line(s) longer than 132 characters .{color:red}-1{color} the patch does not add/modify any testcase {color:green}+1 RAT{color} .{color:green}+1{color} the patch does not seem to introduce new RAT warnings {color:green}+1 JAVADOC{color} {color:green}+1 JAVADOC{color} .{color:green}+1{color} the patch does not seem to introduce new Javadoc warning(s) .{color:red}WARNING{color}: the current HEAD has 100 Javadoc warning(s) .{color:green}+1{color} the patch does not seem to introduce new Javadoc error(s) {color:green}+1 COMPILE{color} .{color:green}+1{color} HEAD compiles .{color:green}+1{color} patch compiles .{color:green}+1{color} the patch does not seem to introduce new javac warnings {color:green}+1{color} There are no new bugs found in total. . {color:green}+1{color} There are no new bugs found in [examples]. . {color:green}+1{color} There are no new bugs found in [webapp]. . {color:green}+1{color} There are no new bugs found in [core]. . {color:green}+1{color} There are no new bugs found in [tools]. . {color:green}+1{color} There are no new bugs found in [fluent-job/fluent-job-api]. . {color:green}+1{color} There are no new bugs found in [server]. . {color:green}+1{color} There are no new bugs found in [docs]. . {color:green}+1{color} There are no new bugs found in [sharelib/hive2]. . {color:green}+1{color} There are no new bugs found in [sharelib/pig]. . {color:green}+1{color} There are no new bugs found in [sharelib/streaming]. . {color:green}+1{color} There are no new bugs found in [sharelib/hive]. . {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog]. . {color:green}+1{color} There are no new bugs found in [sharelib/sqoop]. . {color:green}+1{color} There are no new bugs found in [sharelib/oozie]. . {color:green}+1{color} There are no new bugs found in [sharelib/distcp]. . {color:green}+1{color} There are no new bugs found in [sharelib/spark]. . {color:green}+1{color} There are no new bugs found in [client]. {color:green}+1 BACKWARDS_COMPATIBILITY{color} .{color:green}+1{color} the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations .{color:green}+1{color} the patch does not modify JPA files {color:green}+1 TESTS{color} .Tests run: 2908 {color:green}+1 DISTRO{color} .{color:green}+1{color} distro tarball builds with the patch {color:red}*-1 Overall result, please check the reported -1(s)*{color} {color:red}. There is at least one warning, please check{color} The full output of the test-patch run is available at . https://builds.apache.org/job/PreCommit-OOZIE-Build/672/ > Make it possible to override maven dependency plugin version number > --- > > Key: OOZIE-3306 > URL: https://issues.apache.org/jira/browse/OOZIE-3306 > Project: Oozie > Issue Type: Improvement > Components: build >Affects Versions: 5.1.0 > Environment: Mac OS X > Java 8 u171 >Reporter: Andras Salamon >Assignee: Andras Salamon >Priority: Minor > Fix For: 5.1.0 > > Attachments: OOZIE-3306-1.patch > > > I wanted to speed up unit testing using > [dist_test|https://github.com/cloudera/dist_test] framework and > [grind|https://github.com/cloudera/dist_test/blob/master/docs/grind.md] > frontend, and it does not work correctly with the hardwired maven dependency > plugin version 3.0.2: > {noformat} > ... > [ERROR] Failed to execute goal > org.apache.maven.plugins:maven-dependency-plugin:3.0.2:copy-dependencies > (default-cli) on project oozie-fluent-job-api: Some problems were encountered > while processing the POMs: > [ERROR] [ERROR] 'distributionManagement.status' must not be specified. @ line > 39, column 13: 1 problem was encountered while building the effective model > for xml-apis:xml-apis-ext:1.3.04 > [ERROR] [ERROR] 'distributionManagement.status' must not be specified. @ line > 39, column 13 > [ERROR] -> [Help 1] > [ERROR] > [ERROR] To see the full stack trace of the errors, re-run Maven with the -e > switch. > [ERROR] Re-run Maven using the -X switch to enable full debug logging. > [ERROR] > [ERROR] For more
Failed: OOZIE-3306 PreCommit Build #672
Jira: https://issues.apache.org/jira/browse/OOZIE-3306 Build: https://builds.apache.org/job/PreCommit-OOZIE-Build/672/ ### ## LAST 100 LINES OF THE CONSOLE ### [...truncated 1.73 MB...] [TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts [DEBUG] There are no new bugs found in [sharelib/hive]. [TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts [DEBUG] There are no new bugs found in [sharelib/hcatalog]. [TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts [DEBUG] There are no new bugs found in [sharelib/sqoop]. [TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts [DEBUG] There are no new bugs found in [sharelib/oozie]. [TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts [DEBUG] There are no new bugs found in [sharelib/distcp]. [TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts [DEBUG] There are no new bugs found in [sharelib/spark]. [TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts [DEBUG] There are no new bugs found in [client]. [INFO] There are no new bugs found totally]. [TRACE] FindBugs diffs checked and reports created [TRACE] Summary file size is 2455 bytes [TRACE] Full summary file size is 1399 bytes [TRACE] File [/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/test-patch/tmp/FINDBUGS_DIFF/diff/findbugs-diff-0.1.0-all.jar] removed [TRACE] File [/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/test-patch/tmp/FINDBUGS_DIFF/diff/findbugs-diff-0.1.0-all.jar.md5sum] removed Running test-patch task BACKWARDS_COMPATIBILITY Running test-patch task TESTS Running test-patch task DISTRO Testing JIRA OOZIE-3306 Cleaning local git workspace +1 PATCH_APPLIES +1 CLEAN -1 RAW_PATCH_ANALYSIS +1 the patch does not introduce any @author tags -1 the patch contains 1 line(s) with tabs -1 the patch contains 1 line(s) with trailing spaces -1 the patch contains 1 line(s) longer than 132 characters -1 the patch does not add/modify any testcase +1 RAT +1 the patch does not seem to introduce new RAT warnings +1 JAVADOC +1 JAVADOC +1 the patch does not seem to introduce new Javadoc warning(s) WARNING: the current HEAD has 100 Javadoc warning(s) +1 the patch does not seem to introduce new Javadoc error(s) +1 COMPILE +1 HEAD compiles +1 patch compiles +1 the patch does not seem to introduce new javac warnings +1 There are no new bugs found in total. +1 There are no new bugs found in [examples]. +1 There are no new bugs found in [webapp]. +1 There are no new bugs found in [core]. +1 There are no new bugs found in [tools]. +1 There are no new bugs found in [fluent-job/fluent-job-api]. +1 There are no new bugs found in [server]. +1 There are no new bugs found in [docs]. +1 There are no new bugs found in [sharelib/hive2]. +1 There are no new bugs found in [sharelib/pig]. +1 There are no new bugs found in [sharelib/streaming]. +1 There are no new bugs found in [sharelib/hive]. +1 There are no new bugs found in [sharelib/hcatalog]. +1 There are no new bugs found in [sharelib/sqoop]. +1 There are no new bugs found in [sharelib/oozie]. +1 There are no new bugs found in [sharelib/distcp]. +1 There are no new bugs found in [sharelib/spark]. +1 There are no new bugs found in [client]. +1 BACKWARDS_COMPATIBILITY +1 the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations +1 the patch does not modify JPA files +1 TESTS Tests run: 2908 +1 DISTRO +1 distro tarball builds with the patch -1 Overall result, please check the reported -1(s) There is at least one warning, please check The full output of the test-patch run is available at https://builds.apache.org/job/PreCommit-OOZIE-Build/672/ Adding comment to JIRA % Total% Received % Xferd Average Speed TimeTime Time Current Dload Upload Total SpentLeft Speed 0 00 00 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 00 00 0 0 0 --:--:-- --:--:-- --:--:-- 0{"self":"https://issues.apache.org/jira/rest/api/2/issue/13172665/comment/16548287","id":"16548287","author":{"self":"https://issues.apache.org/jira/rest/api/2/user?username=hadoopqa","name":"hadoopqa","key":"hadoopqa","avatarUrls":{"48x48":"https://issues.apache.org/jira/secure/useravatar?ownerId=hadoopqa&avatarId=10393","24x24":"https://issues.apache.org/jira/secure/useravatar?size=small&ownerId=hadoopqa&avatarId=10393","16x16":"https://issues.apache.org/jira/secure/useravatar?size=xsmall&ownerId=hadoopqa&avatarId=10393","32x32":"https://issues.apache.org/jira/secure/useravatar?size=medium&owner
[jira] [Commented] (OOZIE-3306) Make it possible to override maven dependency plugin version number
[ https://issues.apache.org/jira/browse/OOZIE-3306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16548153#comment-16548153 ] Hadoop QA commented on OOZIE-3306: -- PreCommit-OOZIE-Build started > Make it possible to override maven dependency plugin version number > --- > > Key: OOZIE-3306 > URL: https://issues.apache.org/jira/browse/OOZIE-3306 > Project: Oozie > Issue Type: Improvement > Components: build >Affects Versions: 5.1.0 > Environment: Mac OS X > Java 8 u171 >Reporter: Andras Salamon >Assignee: Andras Salamon >Priority: Minor > Fix For: 5.1.0 > > Attachments: OOZIE-3306-1.patch > > > I wanted to speed up unit testing using > [dist_test|https://github.com/cloudera/dist_test] framework and > [grind|https://github.com/cloudera/dist_test/blob/master/docs/grind.md] > frontend, and it does not work correctly with the hardwired maven dependency > plugin version 3.0.2: > {noformat} > ... > [ERROR] Failed to execute goal > org.apache.maven.plugins:maven-dependency-plugin:3.0.2:copy-dependencies > (default-cli) on project oozie-fluent-job-api: Some problems were encountered > while processing the POMs: > [ERROR] [ERROR] 'distributionManagement.status' must not be specified. @ line > 39, column 13: 1 problem was encountered while building the effective model > for xml-apis:xml-apis-ext:1.3.04 > [ERROR] [ERROR] 'distributionManagement.status' must not be specified. @ line > 39, column 13 > [ERROR] -> [Help 1] > [ERROR] > [ERROR] To see the full stack trace of the errors, re-run Maven with the -e > switch. > [ERROR] Re-run Maven using the -X switch to enable full debug logging. > [ERROR] > [ERROR] For more information about the errors and possible solutions, please > read the following articles: > [ERROR] [Help 1] > http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException > [ERROR] > [ERROR] After correcting the problems, you can resume the build with the > command > [ERROR] mvn -rf :oozie-fluent-job-api > ... > {noformat} > Downgrading to version 2.10 solves the problem but it requires manually > modify the version number in pom.xml file: > {noformat} > > org.apache.maven.plugins > maven-dependency-plugin > 2.10 > > {noformat} > It would be great to be able to customize the version number without > modifying the pom.xml file. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-1624) Exclusion pattern for sharelib JARs
[ https://issues.apache.org/jira/browse/OOZIE-1624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16547602#comment-16547602 ] Andras Piros commented on OOZIE-1624: - :) [~matijhs] looking forward to the new patch, thanks so much! > Exclusion pattern for sharelib JARs > --- > > Key: OOZIE-1624 > URL: https://issues.apache.org/jira/browse/OOZIE-1624 > Project: Oozie > Issue Type: Sub-task >Affects Versions: 4.3.1 >Reporter: Purshotam Shah >Assignee: Mate Juhasz >Priority: Major > Attachments: OOZIE-1624-V2.patch, OOZIE-1624-V3.patch, > OOZIE-1624-V4.patch, OOZIE-1624-v1.patch > > > Sharelib may bring some jar which might conflict with user jars. > Ex. Sharelib hive has json-2..jar, where as some of the user use-case > need higher version of json jar. > He should be able to exclude sharelib json jar and bring his own version. > > oozie.action.sharelib.for.hive.exclusion > json-\*.jar|abc-*.jar > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-1624) Exclusion pattern for sharelib JARs
[ https://issues.apache.org/jira/browse/OOZIE-1624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16547578#comment-16547578 ] Mate Juhasz commented on OOZIE-1624: Ignore my previous comment, I just realized how wonderful is the JavaActionBuilder class... :) I create a new patch for the review board, thanks! > Exclusion pattern for sharelib JARs > --- > > Key: OOZIE-1624 > URL: https://issues.apache.org/jira/browse/OOZIE-1624 > Project: Oozie > Issue Type: Sub-task >Affects Versions: 4.3.1 >Reporter: Purshotam Shah >Assignee: Mate Juhasz >Priority: Major > Attachments: OOZIE-1624-V2.patch, OOZIE-1624-V3.patch, > OOZIE-1624-V4.patch, OOZIE-1624-v1.patch > > > Sharelib may bring some jar which might conflict with user jars. > Ex. Sharelib hive has json-2..jar, where as some of the user use-case > need higher version of json jar. > He should be able to exclude sharelib json jar and bring his own version. > > oozie.action.sharelib.for.hive.exclusion > json-\*.jar|abc-*.jar > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-1624) Exclusion pattern for sharelib JARs
[ https://issues.apache.org/jira/browse/OOZIE-1624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16547557#comment-16547557 ] Mate Juhasz commented on OOZIE-1624: Thanks [~andras.piros], I left the xml builder related issues open only, because I think that could be resolved in a separate Jira. What do you think? > Exclusion pattern for sharelib JARs > --- > > Key: OOZIE-1624 > URL: https://issues.apache.org/jira/browse/OOZIE-1624 > Project: Oozie > Issue Type: Sub-task >Affects Versions: 4.3.1 >Reporter: Purshotam Shah >Assignee: Mate Juhasz >Priority: Major > Attachments: OOZIE-1624-V2.patch, OOZIE-1624-V3.patch, > OOZIE-1624-V4.patch, OOZIE-1624-v1.patch > > > Sharelib may bring some jar which might conflict with user jars. > Ex. Sharelib hive has json-2..jar, where as some of the user use-case > need higher version of json jar. > He should be able to exclude sharelib json jar and bring his own version. > > oozie.action.sharelib.for.hive.exclusion > json-\*.jar|abc-*.jar > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (OOZIE-3304) Parsing sharelib timestamps is not threadsafe
[ https://issues.apache.org/jira/browse/OOZIE-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16547520#comment-16547520 ] Zsombor Gegesy commented on OOZIE-3304: --- Creating new SimpleDateFormat object is perfectly fine, unless you want to create millions of objects in seconds. However, there are already replacements for SimpleDateFormat developed, for example in commons-lang the [FastDateFormat|http://commons.apache.org/proper/commons-lang/apidocs/org/apache/commons/lang3/time/FastDateFormat.html] or in JDK 8 the [DateTimeFormatter|https://docs.oracle.com/javase/8/docs/api/java/time/format/DateTimeFormatter.html] > Parsing sharelib timestamps is not threadsafe > - > > Key: OOZIE-3304 > URL: https://issues.apache.org/jira/browse/OOZIE-3304 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: 5.0.0b1, 4.3.1 >Reporter: Denes Bodo >Assignee: Denes Bodo >Priority: Critical > Labels: usability > > In rare cases the following Exception can be read in log files when an action > fails: > {code:java} > org.apache.oozie.action.ActionExecutorException: NumberFormatException: > multiple points > at > org.apache.oozie.action.ActionExecutor.convertException(ActionExecutor.java:446) > at > org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:1271) > at > org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1472) > at > org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:234) > at > org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:65) > at org.apache.oozie.command.XCommand.call(XCommand.java:287) > at > org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:332) > at > org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:261) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:179) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > at java.lang.Thread.run(Thread.java:748) > Caused by: java.lang.NumberFormatException: multiple points > at > sun.misc.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1890) > at sun.misc.FloatingDecimal.parseDouble(FloatingDecimal.java:110) > at java.lang.Double.parseDouble(Double.java:538) > at java.text.DigitList.getDouble(DigitList.java:169) > at java.text.DecimalFormat.parse(DecimalFormat.java:2056) > at java.text.SimpleDateFormat.subParse(SimpleDateFormat.java:2160) > at java.text.SimpleDateFormat.parse(SimpleDateFormat.java:1514) > at java.text.DateFormat.parse(DateFormat.java:364) > at > org.apache.oozie.service.ShareLibService.getLatestLibPath(ShareLibService.java:727) > at > org.apache.oozie.service.ShareLibService.getShareLibRootPath(ShareLibService.java:595) > at > org.apache.oozie.action.hadoop.JavaActionExecutor.getSharelibRoot(JavaActionExecutor.java:1297) > at > org.apache.oozie.action.hadoop.JavaActionExecutor.initShareLibExcluder(JavaActionExecutor.java:858) > at > org.apache.oozie.action.hadoop.JavaActionExecutor.setLibFilesArchives(JavaActionExecutor.java:866) > at > org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:1156) > ... 11 more > {code} > or > {code:java} > 2018-07-12 04:48:52,649 WARN ForkedActionStartXCommand:523 - > SERVER[ctr-e138-1518143905142-410551-01-03.hwx.site] USER[user] GROUP[-] > TOKEN[] APP[demo-wf] JOB[023-180712043119670-oozie-oozi-W] > ACTION[023-180712043119670-oozie-oozi-W@streaming-node] Error starting > action [streaming-node]. ErrorType [ERROR], ErrorCode > [NumberFormatException], Message [NumberFormatException: For input string: ""] > org.apache.oozie.action.ActionExecutorException: NumberFormatException: For > input string: "" > at > org.apache.oozie.action.ActionExecutor.convertException(ActionExecutor.java:446) > at > org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:1271) > at > org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1472) > at > org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:234) > at > org.apache.oozie.command.wf.ForkedActionStartXCommand.execute(ForkedActionStartXCommand.java:41) > at > org.apache.oozie.command.wf.ForkedActionStart
[jira] [Commented] (OOZIE-3306) Make it possible to override maven dependency plugin version number
[ https://issues.apache.org/jira/browse/OOZIE-3306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16547500#comment-16547500 ] Andras Salamon commented on OOZIE-3306: --- I've created a patch which makes it possible to specify the maven dependency plugin version using -Dmaven-dependency-plugin.version=2.10 . For grind it is possible to set it using GRIND_MAVEN_FLAGS: {noformat} export GRIND_MAVEN_FLAGS=-Dmaven-dependency-plugin.version=2.10 {noformat} > Make it possible to override maven dependency plugin version number > --- > > Key: OOZIE-3306 > URL: https://issues.apache.org/jira/browse/OOZIE-3306 > Project: Oozie > Issue Type: Improvement > Components: build >Affects Versions: 5.1.0 > Environment: Mac OS X > Java 8 u171 >Reporter: Andras Salamon >Assignee: Andras Salamon >Priority: Minor > Attachments: OOZIE-3306-1.patch > > > I wanted to speed up unit testing using > [dist_test|https://github.com/cloudera/dist_test] framework and > [grind|https://github.com/cloudera/dist_test/blob/master/docs/grind.md] > frontend, and it does not work correctly with the hardwired maven dependency > plugin version 3.0.2: > {noformat} > ... > [ERROR] Failed to execute goal > org.apache.maven.plugins:maven-dependency-plugin:3.0.2:copy-dependencies > (default-cli) on project oozie-fluent-job-api: Some problems were encountered > while processing the POMs: > [ERROR] [ERROR] 'distributionManagement.status' must not be specified. @ line > 39, column 13: 1 problem was encountered while building the effective model > for xml-apis:xml-apis-ext:1.3.04 > [ERROR] [ERROR] 'distributionManagement.status' must not be specified. @ line > 39, column 13 > [ERROR] -> [Help 1] > [ERROR] > [ERROR] To see the full stack trace of the errors, re-run Maven with the -e > switch. > [ERROR] Re-run Maven using the -X switch to enable full debug logging. > [ERROR] > [ERROR] For more information about the errors and possible solutions, please > read the following articles: > [ERROR] [Help 1] > http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException > [ERROR] > [ERROR] After correcting the problems, you can resume the build with the > command > [ERROR] mvn -rf :oozie-fluent-job-api > ... > {noformat} > Downgrading to version 2.10 solves the problem but it requires manually > modify the version number in pom.xml file: > {noformat} > > org.apache.maven.plugins > maven-dependency-plugin > 2.10 > > {noformat} > It would be great to be able to customize the version number without > modifying the pom.xml file. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (OOZIE-3306) Make it possible to override maven dependency plugin version number
[ https://issues.apache.org/jira/browse/OOZIE-3306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Salamon updated OOZIE-3306: -- Attachment: OOZIE-3306-1.patch > Make it possible to override maven dependency plugin version number > --- > > Key: OOZIE-3306 > URL: https://issues.apache.org/jira/browse/OOZIE-3306 > Project: Oozie > Issue Type: Improvement > Components: build >Affects Versions: 5.1.0 > Environment: Mac OS X > Java 8 u171 >Reporter: Andras Salamon >Assignee: Andras Salamon >Priority: Minor > Attachments: OOZIE-3306-1.patch > > > I wanted to speed up unit testing using > [dist_test|https://github.com/cloudera/dist_test] framework and > [grind|https://github.com/cloudera/dist_test/blob/master/docs/grind.md] > frontend, and it does not work correctly with the hardwired maven dependency > plugin version 3.0.2: > {noformat} > ... > [ERROR] Failed to execute goal > org.apache.maven.plugins:maven-dependency-plugin:3.0.2:copy-dependencies > (default-cli) on project oozie-fluent-job-api: Some problems were encountered > while processing the POMs: > [ERROR] [ERROR] 'distributionManagement.status' must not be specified. @ line > 39, column 13: 1 problem was encountered while building the effective model > for xml-apis:xml-apis-ext:1.3.04 > [ERROR] [ERROR] 'distributionManagement.status' must not be specified. @ line > 39, column 13 > [ERROR] -> [Help 1] > [ERROR] > [ERROR] To see the full stack trace of the errors, re-run Maven with the -e > switch. > [ERROR] Re-run Maven using the -X switch to enable full debug logging. > [ERROR] > [ERROR] For more information about the errors and possible solutions, please > read the following articles: > [ERROR] [Help 1] > http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException > [ERROR] > [ERROR] After correcting the problems, you can resume the build with the > command > [ERROR] mvn -rf :oozie-fluent-job-api > ... > {noformat} > Downgrading to version 2.10 solves the problem but it requires manually > modify the version number in pom.xml file: > {noformat} > > org.apache.maven.plugins > maven-dependency-plugin > 2.10 > > {noformat} > It would be great to be able to customize the version number without > modifying the pom.xml file. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (OOZIE-2718) Improve -dryrun for bundles
[ https://issues.apache.org/jira/browse/OOZIE-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Salamon reassigned OOZIE-2718: - Assignee: Andras Salamon (was: Xiaobin Zheng) > Improve -dryrun for bundles > --- > > Key: OOZIE-2718 > URL: https://issues.apache.org/jira/browse/OOZIE-2718 > Project: Oozie > Issue Type: Bug >Reporter: Peter Cseh >Assignee: Andras Salamon >Priority: Major > Attachments: OOZIE-2718-1.patch, OOZIE-2718-2.patch, > OOZIE-2718-3.patch, OOZIE-2718-4.patch, OOZIE-2718-5.patch, OOZIE-2718-6.patch > > > When trying to do a -dryrun for Oozie: > {code} > error: > Error: E1310 : E1310: Bundle Job submission Error: [null] > {code} > The > [documentation|https://oozie.apache.org/docs/4.2.0/DG_CommandLineTool.html#Dryrun_of_Coordinator_Job] > states that dryruns are working for workflows and coordinators. > {quote} > "Dryrun a workflow (since 3.3.2) or coordinator (since 2.0) job without > actually executing it" > {quote} > The easy fix is to document that it does not work and create an appropriate > error message for it. It's also possible to add support for bundle dryruns. -- This message was sent by Atlassian JIRA (v7.6.3#76005)