[jira] [Commented] (OOZIE-2952) Fix Findbugs warnings in oozie-sharelib-oozie

2019-04-01 Thread duan xiong (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-2952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16806497#comment-16806497
 ] 

duan xiong commented on OOZIE-2952:
---

Hi,[~Jan Hentschel],If you don't mind I will take over it.If you have any 
concern please let me know.

> Fix Findbugs warnings in oozie-sharelib-oozie
> -
>
> Key: OOZIE-2952
> URL: https://issues.apache.org/jira/browse/OOZIE-2952
> Project: Oozie
>  Issue Type: Sub-task
>  Components: build
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
>Priority: Major
> Attachments: OOZIE-2952-1.patch
>
>
> Currently Findbugs complains about the following warnings in the 
> *oozie-sharelib-oozie* module:
> {code}
> [INFO] The class org.apache.oozie.action.hadoop.HdfsOperations$2 could be 
> refactored into a named _static_ inner class 
> [org.apache.oozie.action.hadoop.HdfsOperations] At HdfsOperations.java:[line 
> 80]
> [INFO] The class org.apache.oozie.action.hadoop.HdfsOperations$3 could be 
> refactored into a named _static_ inner class 
> [org.apache.oozie.action.hadoop.HdfsOperations] At HdfsOperations.java:[line 
> 91]
> [INFO] The class org.apache.oozie.action.hadoop.HdfsOperations$4 could be 
> refactored into a named _static_ inner class 
> [org.apache.oozie.action.hadoop.HdfsOperations] At HdfsOperations.java:[line 
> 105]
> [INFO] Use of non-localized String.toUpperCase() or String.toLowerCase() in 
> org.apache.oozie.action.hadoop.LauncherMain.printArgs(String, String[]) 
> [org.apache.oozie.action.hadoop.LauncherMain] At LauncherMain.java:[line 416]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.LauncherMain.getHadoopJobIds(String, 
> Pattern[]): new java.io.FileReader(String) 
> [org.apache.oozie.action.hadoop.LauncherMain] At LauncherMain.java:[line 139]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.LauncherMain.writeExternalChildIDs(String, 
> Pattern[], String): String.getBytes() 
> [org.apache.oozie.action.hadoop.LauncherMain] At LauncherMain.java:[line 175]
> [INFO] org.apache.oozie.action.hadoop.LauncherMain.HADOOP_SITE_FILES should 
> be both final and package protected 
> [org.apache.oozie.action.hadoop.LauncherMain] At LauncherMain.java:[line 76]
> [INFO] Exceptional return value of java.io.File.mkdirs() ignored in 
> org.apache.oozie.action.hadoop.LauncherMain.writeHadoopConfig(String, File) 
> [org.apache.oozie.action.hadoop.LauncherMain] At LauncherMain.java:[line 394]
> [INFO] Use of non-localized String.toUpperCase() or String.toLowerCase() in 
> org.apache.oozie.action.hadoop.LauncherMapper.printArgs(String, String[]) 
> [org.apache.oozie.action.hadoop.LauncherMapper] At LauncherMapper.java:[line 
> 660]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.LauncherMapper.getLocalFileContentStr(File, 
> String, int): new java.io.FileReader(File) 
> [org.apache.oozie.action.hadoop.LauncherMapper] At LauncherMapper.java:[line 
> 407]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.LauncherMapper.propagateToHadoopConf(): new 
> java.io.FileWriter(String) [org.apache.oozie.action.hadoop.LauncherMapper] At 
> LauncherMapper.java:[line 355]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.LauncherMapper.propagateToHadoopConf(): new 
> java.io.OutputStreamWriter(OutputStream) 
> [org.apache.oozie.action.hadoop.LauncherMapper] At LauncherMapper.java:[line 
> 356]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.LauncherMapper.setRecoveryId(Configuration, 
> Path, String): new java.io.InputStreamReader(InputStream) 
> [org.apache.oozie.action.hadoop.LauncherMapper] At LauncherMapper.java:[line 
> 107]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.LauncherMapper.setRecoveryId(Configuration, 
> Path, String): new java.io.OutputStreamWriter(OutputStream) 
> [org.apache.oozie.action.hadoop.LauncherMapper] At LauncherMapper.java:[line 
> 97]
> [INFO] 
> org.apache.oozie.action.hadoop.LauncherMapper.getLocalFileContentStr(File, 
> String, int) may fail to clean up java.io.Reader on checked exception 
> [org.apache.oozie.action.hadoop.LauncherMapper, 
> org.apache.oozie.action.hadoop.LauncherMapper, 
> org.apache.oozie.action.hadoop.LauncherMapper, 
> org.apache.oozie.action.hadoop.LauncherMapper] Obligation to clean up 
> resource created at LauncherMapper.java:[line 407] is not dischargedPath 
> continues at LauncherMapper.java:[line 408]Path continues at 
> LauncherMapper.java:[line 410]Path continues at LauncherMapper.java:[line 411]
> [INFO] org.apache.oozie.action.hadoop.LauncherMapper.propagateToHadoopConf() 
> may fail to clean up java.io.Writer on checked exception 
> [org.apache

[jira] [Commented] (OOZIE-2952) Fix Findbugs warnings in oozie-sharelib-oozie

2019-04-01 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-2952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16806507#comment-16806507
 ] 

Hadoop QA commented on OOZIE-2952:
--

PreCommit-OOZIE-Build started


> Fix Findbugs warnings in oozie-sharelib-oozie
> -
>
> Key: OOZIE-2952
> URL: https://issues.apache.org/jira/browse/OOZIE-2952
> Project: Oozie
>  Issue Type: Sub-task
>  Components: build
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
>Priority: Major
> Attachments: OOZIE-2952-1.patch
>
>
> Currently Findbugs complains about the following warnings in the 
> *oozie-sharelib-oozie* module:
> {code}
> [INFO] The class org.apache.oozie.action.hadoop.HdfsOperations$2 could be 
> refactored into a named _static_ inner class 
> [org.apache.oozie.action.hadoop.HdfsOperations] At HdfsOperations.java:[line 
> 80]
> [INFO] The class org.apache.oozie.action.hadoop.HdfsOperations$3 could be 
> refactored into a named _static_ inner class 
> [org.apache.oozie.action.hadoop.HdfsOperations] At HdfsOperations.java:[line 
> 91]
> [INFO] The class org.apache.oozie.action.hadoop.HdfsOperations$4 could be 
> refactored into a named _static_ inner class 
> [org.apache.oozie.action.hadoop.HdfsOperations] At HdfsOperations.java:[line 
> 105]
> [INFO] Use of non-localized String.toUpperCase() or String.toLowerCase() in 
> org.apache.oozie.action.hadoop.LauncherMain.printArgs(String, String[]) 
> [org.apache.oozie.action.hadoop.LauncherMain] At LauncherMain.java:[line 416]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.LauncherMain.getHadoopJobIds(String, 
> Pattern[]): new java.io.FileReader(String) 
> [org.apache.oozie.action.hadoop.LauncherMain] At LauncherMain.java:[line 139]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.LauncherMain.writeExternalChildIDs(String, 
> Pattern[], String): String.getBytes() 
> [org.apache.oozie.action.hadoop.LauncherMain] At LauncherMain.java:[line 175]
> [INFO] org.apache.oozie.action.hadoop.LauncherMain.HADOOP_SITE_FILES should 
> be both final and package protected 
> [org.apache.oozie.action.hadoop.LauncherMain] At LauncherMain.java:[line 76]
> [INFO] Exceptional return value of java.io.File.mkdirs() ignored in 
> org.apache.oozie.action.hadoop.LauncherMain.writeHadoopConfig(String, File) 
> [org.apache.oozie.action.hadoop.LauncherMain] At LauncherMain.java:[line 394]
> [INFO] Use of non-localized String.toUpperCase() or String.toLowerCase() in 
> org.apache.oozie.action.hadoop.LauncherMapper.printArgs(String, String[]) 
> [org.apache.oozie.action.hadoop.LauncherMapper] At LauncherMapper.java:[line 
> 660]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.LauncherMapper.getLocalFileContentStr(File, 
> String, int): new java.io.FileReader(File) 
> [org.apache.oozie.action.hadoop.LauncherMapper] At LauncherMapper.java:[line 
> 407]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.LauncherMapper.propagateToHadoopConf(): new 
> java.io.FileWriter(String) [org.apache.oozie.action.hadoop.LauncherMapper] At 
> LauncherMapper.java:[line 355]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.LauncherMapper.propagateToHadoopConf(): new 
> java.io.OutputStreamWriter(OutputStream) 
> [org.apache.oozie.action.hadoop.LauncherMapper] At LauncherMapper.java:[line 
> 356]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.LauncherMapper.setRecoveryId(Configuration, 
> Path, String): new java.io.InputStreamReader(InputStream) 
> [org.apache.oozie.action.hadoop.LauncherMapper] At LauncherMapper.java:[line 
> 107]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.LauncherMapper.setRecoveryId(Configuration, 
> Path, String): new java.io.OutputStreamWriter(OutputStream) 
> [org.apache.oozie.action.hadoop.LauncherMapper] At LauncherMapper.java:[line 
> 97]
> [INFO] 
> org.apache.oozie.action.hadoop.LauncherMapper.getLocalFileContentStr(File, 
> String, int) may fail to clean up java.io.Reader on checked exception 
> [org.apache.oozie.action.hadoop.LauncherMapper, 
> org.apache.oozie.action.hadoop.LauncherMapper, 
> org.apache.oozie.action.hadoop.LauncherMapper, 
> org.apache.oozie.action.hadoop.LauncherMapper] Obligation to clean up 
> resource created at LauncherMapper.java:[line 407] is not dischargedPath 
> continues at LauncherMapper.java:[line 408]Path continues at 
> LauncherMapper.java:[line 410]Path continues at LauncherMapper.java:[line 411]
> [INFO] org.apache.oozie.action.hadoop.LauncherMapper.propagateToHadoopConf() 
> may fail to clean up java.io.Writer on checked exception 
> [org.apache.oozie.action.hadoop.LauncherMapper] Obligation to clean up 
> resource cr

Failed: OOZIE-2952 PreCommit Build #1069

2019-04-01 Thread Apache Jenkins Server
Jira: https://issues.apache.org/jira/browse/OOZIE-2952
Build: https://builds.apache.org/job/PreCommit-OOZIE-Build/1069/

###
## LAST 100 LINES OF THE CONSOLE 
###
[...truncated 804.91 KB...]
[INFO] <<< spotbugs-maven-plugin:3.1.11:check (default-cli) < :spotbugs @ 
oozie-zookeeper-security-tests <<<
[INFO] 
[INFO] 
[INFO] --- spotbugs-maven-plugin:3.1.11:check (default-cli) @ 
oozie-zookeeper-security-tests ---
[INFO] 
[INFO] Reactor Summary for Apache Oozie Main 5.2.0-SNAPSHOT:
[INFO] 
[INFO] Apache Oozie Main .. SUCCESS [  1.958 s]
[INFO] Apache Oozie Fluent Job  SUCCESS [  0.094 s]
[INFO] Apache Oozie Fluent Job API  SUCCESS [ 26.502 s]
[INFO] Apache Oozie Client  SUCCESS [ 15.834 s]
[INFO] Apache Oozie Share Lib Oozie ... SUCCESS [ 12.537 s]
[INFO] Apache Oozie Share Lib HCatalog  SUCCESS [  6.562 s]
[INFO] Apache Oozie Share Lib Distcp .. SUCCESS [  5.389 s]
[INFO] Apache Oozie Core .. SUCCESS [01:25 min]
[INFO] Apache Oozie Share Lib Streaming ... SUCCESS [  7.556 s]
[INFO] Apache Oozie Share Lib Pig . SUCCESS [  7.455 s]
[INFO] Apache Oozie Share Lib Git . SUCCESS [ 10.972 s]
[INFO] Apache Oozie Share Lib Hive  SUCCESS [  8.061 s]
[INFO] Apache Oozie Share Lib Hive 2 .. SUCCESS [  9.341 s]
[INFO] Apache Oozie Share Lib Sqoop ... SUCCESS [  6.235 s]
[INFO] Apache Oozie Examples .. SUCCESS [  9.535 s]
[INFO] Apache Oozie Share Lib Spark ... SUCCESS [ 11.121 s]
[INFO] Apache Oozie Share Lib . SUCCESS [  0.026 s]
[INFO] Apache Oozie Docs .. SUCCESS [  3.110 s]
[INFO] Apache Oozie WebApp  SUCCESS [  8.922 s]
[INFO] Apache Oozie Tools . SUCCESS [ 13.842 s]
[INFO] Apache Oozie MiniOozie . SUCCESS [  1.823 s]
[INFO] Apache Oozie Fluent Job Client . SUCCESS [  0.467 s]
[INFO] Apache Oozie Server  SUCCESS [ 10.634 s]
[INFO] Apache Oozie Distro  SUCCESS [  2.379 s]
[INFO] Apache Oozie ZooKeeper Security Tests .. SUCCESS [  3.477 s]
[INFO] 
[INFO] BUILD SUCCESS
[INFO] 
[INFO] Total time:  04:30 min
[INFO] Finished at: 2019-04-01T08:18:24Z
[INFO] 
[TRACE] SpotBugs output in HEAD verified and saved
  Running test-patch task BACKWARDS_COMPATIBILITY
  Running test-patch task TESTS
  Running test-patch task DISTRO

Applying patch

Checking patch a/findbugs-filter.xml => b/findbugs-filter.xml...
error: a/findbugs-filter.xml: No such file or directory
Checking patch 
a/sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/LauncherMain.java 
=> 
b/sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/LauncherMain.java...
error: 
a/sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/LauncherMain.java:
 No such file or directory
Checking patch 
a/sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/MapReduceMain.java
 => 
b/sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/MapReduceMain.java...
error: 
a/sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/MapReduceMain.java:
 No such file or directory
Checking patch 
a/sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/PasswordMasker.java
 => 
b/sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/PasswordMasker.java...
error: 
a/sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/PasswordMasker.java:
 No such file or directory
Checking patch 
a/sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/ShellMain.java => 
b/sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/ShellMain.java...
error: 
a/sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/ShellMain.java: 
No such file or directory
Checking patch findbugs-filter.xml...
error: findbugs-filter.xml: No such file or directory
Checking patch 
sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/LauncherMain.java...
error: while searching for:
import java.io.File;
import java.io.FileInputStream;
import java.io.FileOutputStream;
import java.io.FileReader;
import java.io.IOException;
import java.io.InputStream;
import java.io.OutputStream;
import java.io.StringWriter;
import java.net.URL;

error:

[jira] [Commented] (OOZIE-2952) Fix Findbugs warnings in oozie-sharelib-oozie

2019-04-01 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-2952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16806511#comment-16806511
 ] 

Hadoop QA commented on OOZIE-2952:
--


Testing JIRA OOZIE-2952

Cleaning local git workspace



{color:red}-1{color} Patch failed to apply to head of branch




> Fix Findbugs warnings in oozie-sharelib-oozie
> -
>
> Key: OOZIE-2952
> URL: https://issues.apache.org/jira/browse/OOZIE-2952
> Project: Oozie
>  Issue Type: Sub-task
>  Components: build
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
>Priority: Major
> Attachments: OOZIE-2952-1.patch
>
>
> Currently Findbugs complains about the following warnings in the 
> *oozie-sharelib-oozie* module:
> {code}
> [INFO] The class org.apache.oozie.action.hadoop.HdfsOperations$2 could be 
> refactored into a named _static_ inner class 
> [org.apache.oozie.action.hadoop.HdfsOperations] At HdfsOperations.java:[line 
> 80]
> [INFO] The class org.apache.oozie.action.hadoop.HdfsOperations$3 could be 
> refactored into a named _static_ inner class 
> [org.apache.oozie.action.hadoop.HdfsOperations] At HdfsOperations.java:[line 
> 91]
> [INFO] The class org.apache.oozie.action.hadoop.HdfsOperations$4 could be 
> refactored into a named _static_ inner class 
> [org.apache.oozie.action.hadoop.HdfsOperations] At HdfsOperations.java:[line 
> 105]
> [INFO] Use of non-localized String.toUpperCase() or String.toLowerCase() in 
> org.apache.oozie.action.hadoop.LauncherMain.printArgs(String, String[]) 
> [org.apache.oozie.action.hadoop.LauncherMain] At LauncherMain.java:[line 416]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.LauncherMain.getHadoopJobIds(String, 
> Pattern[]): new java.io.FileReader(String) 
> [org.apache.oozie.action.hadoop.LauncherMain] At LauncherMain.java:[line 139]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.LauncherMain.writeExternalChildIDs(String, 
> Pattern[], String): String.getBytes() 
> [org.apache.oozie.action.hadoop.LauncherMain] At LauncherMain.java:[line 175]
> [INFO] org.apache.oozie.action.hadoop.LauncherMain.HADOOP_SITE_FILES should 
> be both final and package protected 
> [org.apache.oozie.action.hadoop.LauncherMain] At LauncherMain.java:[line 76]
> [INFO] Exceptional return value of java.io.File.mkdirs() ignored in 
> org.apache.oozie.action.hadoop.LauncherMain.writeHadoopConfig(String, File) 
> [org.apache.oozie.action.hadoop.LauncherMain] At LauncherMain.java:[line 394]
> [INFO] Use of non-localized String.toUpperCase() or String.toLowerCase() in 
> org.apache.oozie.action.hadoop.LauncherMapper.printArgs(String, String[]) 
> [org.apache.oozie.action.hadoop.LauncherMapper] At LauncherMapper.java:[line 
> 660]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.LauncherMapper.getLocalFileContentStr(File, 
> String, int): new java.io.FileReader(File) 
> [org.apache.oozie.action.hadoop.LauncherMapper] At LauncherMapper.java:[line 
> 407]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.LauncherMapper.propagateToHadoopConf(): new 
> java.io.FileWriter(String) [org.apache.oozie.action.hadoop.LauncherMapper] At 
> LauncherMapper.java:[line 355]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.LauncherMapper.propagateToHadoopConf(): new 
> java.io.OutputStreamWriter(OutputStream) 
> [org.apache.oozie.action.hadoop.LauncherMapper] At LauncherMapper.java:[line 
> 356]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.LauncherMapper.setRecoveryId(Configuration, 
> Path, String): new java.io.InputStreamReader(InputStream) 
> [org.apache.oozie.action.hadoop.LauncherMapper] At LauncherMapper.java:[line 
> 107]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.LauncherMapper.setRecoveryId(Configuration, 
> Path, String): new java.io.OutputStreamWriter(OutputStream) 
> [org.apache.oozie.action.hadoop.LauncherMapper] At LauncherMapper.java:[line 
> 97]
> [INFO] 
> org.apache.oozie.action.hadoop.LauncherMapper.getLocalFileContentStr(File, 
> String, int) may fail to clean up java.io.Reader on checked exception 
> [org.apache.oozie.action.hadoop.LauncherMapper, 
> org.apache.oozie.action.hadoop.LauncherMapper, 
> org.apache.oozie.action.hadoop.LauncherMapper, 
> org.apache.oozie.action.hadoop.LauncherMapper] Obligation to clean up 
> resource created at LauncherMapper.java:[line 407] is not dischargedPath 
> continues at LauncherMapper.java:[line 408]Path continues at 
> LauncherMapper.java:[line 410]Path continues at LauncherMapper.java:[line 411]
> [INFO] org.apache.oozie.action.hadoop.LauncherMapper.propagateToHadoopConf() 

[jira] [Created] (OOZIE-3460) Remove apache-curator pom files from Oozie hive sharelib

2019-04-01 Thread Andras Salamon (JIRA)
Andras Salamon created OOZIE-3460:
-

 Summary: Remove apache-curator pom files from Oozie hive sharelib
 Key: OOZIE-3460
 URL: https://issues.apache.org/jira/browse/OOZIE-3460
 Project: Oozie
  Issue Type: Bug
Affects Versions: trunk
Reporter: Andras Salamon


Oozie hive sharelib contain not only jar files but also a pom file 
({{apache-curator-2.12.0.pom}}). We don't need this file in the sharelibs, we 
should remove it.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


Re: Review Request 65636: OOZIE-3179 - Adding a configurable config-default.xml location to a workflow

2019-04-01 Thread Andras Salamon

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/65636/#review214235
---




core/src/main/java/org/apache/oozie/command/wf/SubmitXCommand.java
Line 138 (original), 138 (patched)


We could use the diamond operator here.



core/src/main/java/org/apache/oozie/command/wf/SubmitXCommand.java
Lines 146 (patched)


foreach would be nicer



core/src/main/java/org/apache/oozie/command/wf/SubmitXCommand.java
Lines 162-164 (patched)


for (Path configDefaultFile : configDefaults) would be nicer.



core/src/main/java/org/apache/oozie/command/wf/SubmitXCommand.java
Lines 168 (patched)


Why is it System.out instead of LOG?



core/src/main/java/org/apache/oozie/command/wf/SubmitXCommand.java
Line 156 (original), 177 (patched)


I think it would be useful to add configDefaultFile to the error message.



core/src/main/java/org/apache/oozie/command/wf/SubmitXCommand.java
Line 159 (original), 180 (patched)


As far as I understand in the following scenario:

i=0 and fs.exists(configDefaultFile) == true: we create a new defaultConfigs

i=1 and fs.exists(configDefaultFile) == false: we skip the if in line 167 
and we don't create a new defaultConfigs.

In this case the if in line 180 will refer to the old defaultConfigs and 
call copy again using the old data.

Could you please check this scenario and fix it.



core/src/test/java/org/apache/oozie/command/wf/TestSubmitXCommand.java
Lines 506-516 (patched)


Please add assert messages to the assertEquals.


- Andras Salamon


On March 29, 2019, 1 p.m., Jason Phelps wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/65636/
> ---
> 
> (Updated March 29, 2019, 1 p.m.)
> 
> 
> Review request for oozie.
> 
> 
> Repository: oozie-git
> 
> 
> Description
> ---
> 
> Added another client property: `oozie.default.configuration.path` which 
> allows for a comma seperated list of HDFS XML property files to be applied to 
> the job. This is useful if multiple workflows have shared properties (i.e. 
> database names, table names for Sqoop or Hive, spark arguments, etc). This is 
> similar to the `oozie.libpath` property which allows user's to define common 
> paths workflows to load jars.
> 
> 
> Diffs
> -
> 
>   client/src/main/java/org/apache/oozie/client/OozieClient.java 2862d33f 
>   core/src/main/java/org/apache/oozie/command/wf/SubmitXCommand.java 70b9adc1 
>   core/src/test/java/org/apache/oozie/command/wf/TestSubmitXCommand.java 
> 2bc0baa4 
> 
> 
> Diff: https://reviews.apache.org/r/65636/diff/3/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Jason Phelps
> 
>



[jira] [Commented] (OOZIE-3179) Adding a configurable config-default.xml location to a workflow

2019-04-01 Thread Andras Salamon (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-3179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16806520#comment-16806520
 ] 

Andras Salamon commented on OOZIE-3179:
---

[~jphelps] I left a few comments in the ReviewBoard. Mostly small code cleanups.

> Adding a configurable config-default.xml location to a workflow
> ---
>
> Key: OOZIE-3179
> URL: https://issues.apache.org/jira/browse/OOZIE-3179
> Project: Oozie
>  Issue Type: Improvement
>Reporter: Jason Phelps
>Assignee: Jason Phelps
>Priority: Major
> Attachments: OOZIE-3179-1.patch, OOZIE-3179-2.patch, 
> OOZIE-3179-3.patch, OOZIE-3179-4.patch
>
>
> Recently a customer requested a way to include several job.properties 
> variables to every workflow in their cluster.
> Normally the config-default.xml file would be the best way to include a set 
> of variables, but it does not scale very well if that file needs to be 
> updated, as it would require it to be updated in every workflow application 
> path.
> What I am requesting is another job.properties variable that can point to a 
> config-default.xml file, or a comma separated list of config-default.xml 
> files that will all be applied to the workflow.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (OOZIE-3450) Investigate and clean git sharelib

2019-04-01 Thread Andras Salamon (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-3450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16806691#comment-16806691
 ] 

Andras Salamon commented on OOZIE-3450:
---

I was able to execute the git test successfully.

Thanks for the contribution, +1, committed to master.

> Investigate and clean git sharelib
> --
>
> Key: OOZIE-3450
> URL: https://issues.apache.org/jira/browse/OOZIE-3450
> Project: Oozie
>  Issue Type: Improvement
>Affects Versions: trunk
>Reporter: Andras Salamon
>Assignee: Mate Juhasz
>Priority: Major
> Attachments: OOZIE-3450-v2.patch, OOZIE-3540-v1.patch
>
>
> I've checked the number of jars in the Oozie sharelibs and realized that git 
> sharelib contains the highest number of jars (203), it's much more than the 
> hive (85), pig (67). Not to mention that we have really small sharelibs like 
> distcp (3).
> I don't really understand the reason for this, we need to check if we really 
> need all the jars here. The huge number of jars make it slower and it's more 
> likely that we get strange errors because of jar conflicts.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (OOZIE-3459) Oozie cannot be built using Java 11

2019-04-01 Thread Denes Bodo (JIRA)


 [ 
https://issues.apache.org/jira/browse/OOZIE-3459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Denes Bodo updated OOZIE-3459:
--
Description: 
Using OpenJDK 11 I am not able to build Oozie using {{mvn clean install}}.

I found two issues:
 * Fluent job API build fails due to Jaxb2 maven plugin.
 * No {{com.sun.tools.}} package is available so *TestMetricsInstrumentation* 
will not work.
 * Maven surefire plugin has to be updated. It works with 3.0.0-M3

  was:
Using OpenJDK 11 I am not able to build Oozie using {{mvn clean install}}.

I found two issues:
 * Fluent job API build fails due to Jaxb2 maven plugin.
 * No {{com.sun.tools.}} package is available so *TestMetricsInstrumentation* 
will not work.


> Oozie cannot be built using Java 11
> ---
>
> Key: OOZIE-3459
> URL: https://issues.apache.org/jira/browse/OOZIE-3459
> Project: Oozie
>  Issue Type: Bug
>  Components: core, fluent-job
>Affects Versions: 5.1.0
>Reporter: Denes Bodo
>Priority: Major
>
> Using OpenJDK 11 I am not able to build Oozie using {{mvn clean install}}.
> I found two issues:
>  * Fluent job API build fails due to Jaxb2 maven plugin.
>  * No {{com.sun.tools.}} package is available so *TestMetricsInstrumentation* 
> will not work.
>  * Maven surefire plugin has to be updated. It works with 3.0.0-M3



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (OOZIE-3459) Oozie cannot be built using Java 11

2019-04-01 Thread Denes Bodo (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-3459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16806797#comment-16806797
 ] 

Denes Bodo commented on OOZIE-3459:
---

[~nobigo] I think JDK11 is good with OpenJPA, according to Unit Tests. However, 
I tried Oozie 4.3.1 with setting JAVA_HOME to 11 I got the following:
{noformat}
Error: Could not connect to the database: 
org.apache.oozie.service.ServiceException: E0100: Could not initialize service 
[org.apache.oozie.service.HadoopAccessorService], failure to login: for 
principal: oozie/ctr-e139-1542663976389-92586-01-02.hwx.s...@example.com 
from keytab /etc/security/keytabs/oozie.service.keytab 
javax.security.auth.login.LoginException: Message stream modified (41)

Stack trace for the error was (for debug purposes):
--
java.lang.Exception: Could not connect to the database: 
org.apache.oozie.service.ServiceException: E0100: Could not initialize service 
[org.apache.oozie.service.HadoopAccessorService], failure to login: for 
principal: oozie/ctr-e139-1542663976389-92586-01-02.hwx.s...@example.com 
from keytab /etc/security/keytabs/oozie.service.keytab 
javax.security.auth.login.LoginException: Message stream modified (41)
at 
org.apache.oozie.tools.OozieDBCLI.validateConnection(OozieDBCLI.java:968)
at org.apache.oozie.tools.OozieDBCLI.createDB(OozieDBCLI.java:193)
at org.apache.oozie.tools.OozieDBCLI.run(OozieDBCLI.java:131)
at org.apache.oozie.tools.OozieDBCLI.main(OozieDBCLI.java:79)
Caused by: org.apache.oozie.service.ServiceException: E0100: Could not 
initialize service [org.apache.oozie.service.HadoopAccessorService], failure to 
login: for principal: 
oozie/ctr-e139-1542663976389-92586-01-02.hwx.s...@example.com from keytab 
/etc/security/keytabs/oozie.service.keytab 
javax.security.auth.login.LoginException: Message stream modified (41)
at 
org.apache.oozie.service.HadoopAccessorService.kerberosInit(HadoopAccessorService.java:244)
at 
org.apache.oozie.service.HadoopAccessorService.init(HadoopAccessorService.java:143)
at 
org.apache.oozie.service.HadoopAccessorService.init(HadoopAccessorService.java:114)
at 
org.apache.oozie.service.Services.setServiceInternal(Services.java:386)
at org.apache.oozie.service.Services.setService(Services.java:372)
at org.apache.oozie.service.Services.loadServices(Services.java:305)
at org.apache.oozie.service.Services.init(Services.java:213)
at org.apache.oozie.tools.OozieDBCLI.getJdbcConf(OozieDBCLI.java:180)
at 
org.apache.oozie.tools.OozieDBCLI.createConnection(OozieDBCLI.java:956)
at 
org.apache.oozie.tools.OozieDBCLI.validateConnection(OozieDBCLI.java:964)
... 3 more
Caused by: org.apache.hadoop.security.KerberosAuthException: failure to login: 
for principal: 
oozie/ctr-e139-1542663976389-92586-01-02.hwx.s...@example.com from keytab 
/etc/security/keytabs/oozie.service.keytab 
javax.security.auth.login.LoginException: Message stream modified (41)
at 
org.apache.hadoop.security.UserGroupInformation.doSubjectLogin(UserGroupInformation.java:1847)
at 
org.apache.hadoop.security.UserGroupInformation.loginUserFromKeytabAndReturnUGI(UserGroupInformation.java:1215)
at 
org.apache.hadoop.security.UserGroupInformation.loginUserFromKeytab(UserGroupInformation.java:1008)
at 
org.apache.oozie.service.HadoopAccessorService.kerberosInit(HadoopAccessorService.java:236)
... 12 more
Caused by: javax.security.auth.login.LoginException: Message stream modified 
(41)
at 
jdk.security.auth/com.sun.security.auth.module.Krb5LoginModule.attemptAuthentication(Krb5LoginModule.java:781)
at 
jdk.security.auth/com.sun.security.auth.module.Krb5LoginModule.login(Krb5LoginModule.java:592)
at 
java.base/javax.security.auth.login.LoginContext.invoke(LoginContext.java:726)
at 
java.base/javax.security.auth.login.LoginContext$4.run(LoginContext.java:665)
at 
java.base/javax.security.auth.login.LoginContext$4.run(LoginContext.java:663)
at java.base/java.security.AccessController.doPrivileged(Native Method)
at 
java.base/javax.security.auth.login.LoginContext.invokePriv(LoginContext.java:663)
at 
java.base/javax.security.auth.login.LoginContext.login(LoginContext.java:574)
at 
org.apache.hadoop.security.UserGroupInformation$HadoopLoginContext.login(UserGroupInformation.java:1926)
at 
org.apache.hadoop.security.UserGroupInformation.doSubjectLogin(UserGroupInformation.java:1837)
... 15 more
Caused by: KrbException: Message stream modified (41)
at 
java.security.jgss/sun.security.krb5.KrbKdcRep.check(KrbKdcRep.java:83)
at 
java.security.jgss/sun.security.krb5.KrbAsRep.decrypt(KrbAsRep.java:158)
at 
java.security.jgss/sun.security.krb5.KrbAsRep.decryptUsi

[jira] [Commented] (OOZIE-2952) Fix Findbugs warnings in oozie-sharelib-oozie

2019-04-01 Thread Jan Hentschel (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-2952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16806838#comment-16806838
 ] 

Jan Hentschel commented on OOZIE-2952:
--

[~nobigo] Sure, go ahead.

> Fix Findbugs warnings in oozie-sharelib-oozie
> -
>
> Key: OOZIE-2952
> URL: https://issues.apache.org/jira/browse/OOZIE-2952
> Project: Oozie
>  Issue Type: Sub-task
>  Components: build
>Reporter: Jan Hentschel
>Assignee: Jan Hentschel
>Priority: Major
> Attachments: OOZIE-2952-1.patch
>
>
> Currently Findbugs complains about the following warnings in the 
> *oozie-sharelib-oozie* module:
> {code}
> [INFO] The class org.apache.oozie.action.hadoop.HdfsOperations$2 could be 
> refactored into a named _static_ inner class 
> [org.apache.oozie.action.hadoop.HdfsOperations] At HdfsOperations.java:[line 
> 80]
> [INFO] The class org.apache.oozie.action.hadoop.HdfsOperations$3 could be 
> refactored into a named _static_ inner class 
> [org.apache.oozie.action.hadoop.HdfsOperations] At HdfsOperations.java:[line 
> 91]
> [INFO] The class org.apache.oozie.action.hadoop.HdfsOperations$4 could be 
> refactored into a named _static_ inner class 
> [org.apache.oozie.action.hadoop.HdfsOperations] At HdfsOperations.java:[line 
> 105]
> [INFO] Use of non-localized String.toUpperCase() or String.toLowerCase() in 
> org.apache.oozie.action.hadoop.LauncherMain.printArgs(String, String[]) 
> [org.apache.oozie.action.hadoop.LauncherMain] At LauncherMain.java:[line 416]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.LauncherMain.getHadoopJobIds(String, 
> Pattern[]): new java.io.FileReader(String) 
> [org.apache.oozie.action.hadoop.LauncherMain] At LauncherMain.java:[line 139]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.LauncherMain.writeExternalChildIDs(String, 
> Pattern[], String): String.getBytes() 
> [org.apache.oozie.action.hadoop.LauncherMain] At LauncherMain.java:[line 175]
> [INFO] org.apache.oozie.action.hadoop.LauncherMain.HADOOP_SITE_FILES should 
> be both final and package protected 
> [org.apache.oozie.action.hadoop.LauncherMain] At LauncherMain.java:[line 76]
> [INFO] Exceptional return value of java.io.File.mkdirs() ignored in 
> org.apache.oozie.action.hadoop.LauncherMain.writeHadoopConfig(String, File) 
> [org.apache.oozie.action.hadoop.LauncherMain] At LauncherMain.java:[line 394]
> [INFO] Use of non-localized String.toUpperCase() or String.toLowerCase() in 
> org.apache.oozie.action.hadoop.LauncherMapper.printArgs(String, String[]) 
> [org.apache.oozie.action.hadoop.LauncherMapper] At LauncherMapper.java:[line 
> 660]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.LauncherMapper.getLocalFileContentStr(File, 
> String, int): new java.io.FileReader(File) 
> [org.apache.oozie.action.hadoop.LauncherMapper] At LauncherMapper.java:[line 
> 407]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.LauncherMapper.propagateToHadoopConf(): new 
> java.io.FileWriter(String) [org.apache.oozie.action.hadoop.LauncherMapper] At 
> LauncherMapper.java:[line 355]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.LauncherMapper.propagateToHadoopConf(): new 
> java.io.OutputStreamWriter(OutputStream) 
> [org.apache.oozie.action.hadoop.LauncherMapper] At LauncherMapper.java:[line 
> 356]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.LauncherMapper.setRecoveryId(Configuration, 
> Path, String): new java.io.InputStreamReader(InputStream) 
> [org.apache.oozie.action.hadoop.LauncherMapper] At LauncherMapper.java:[line 
> 107]
> [INFO] Found reliance on default encoding in 
> org.apache.oozie.action.hadoop.LauncherMapper.setRecoveryId(Configuration, 
> Path, String): new java.io.OutputStreamWriter(OutputStream) 
> [org.apache.oozie.action.hadoop.LauncherMapper] At LauncherMapper.java:[line 
> 97]
> [INFO] 
> org.apache.oozie.action.hadoop.LauncherMapper.getLocalFileContentStr(File, 
> String, int) may fail to clean up java.io.Reader on checked exception 
> [org.apache.oozie.action.hadoop.LauncherMapper, 
> org.apache.oozie.action.hadoop.LauncherMapper, 
> org.apache.oozie.action.hadoop.LauncherMapper, 
> org.apache.oozie.action.hadoop.LauncherMapper] Obligation to clean up 
> resource created at LauncherMapper.java:[line 407] is not dischargedPath 
> continues at LauncherMapper.java:[line 408]Path continues at 
> LauncherMapper.java:[line 410]Path continues at LauncherMapper.java:[line 411]
> [INFO] org.apache.oozie.action.hadoop.LauncherMapper.propagateToHadoopConf() 
> may fail to clean up java.io.Writer on checked exception 
> [org.apache.oozie.action.hadoop.LauncherMapper] Obligation to clean up 
> resource

[jira] [Created] (OOZIE-3461) CoordMaterializeTriggerService code cleanup

2019-04-01 Thread Andras Salamon (JIRA)
Andras Salamon created OOZIE-3461:
-

 Summary: CoordMaterializeTriggerService code cleanup
 Key: OOZIE-3461
 URL: https://issues.apache.org/jira/browse/OOZIE-3461
 Project: Oozie
  Issue Type: Task
Reporter: Andras Salamon


It seems to me don't really use the {{delayedCallables}} and {{delay}} 
variables in {{CoordMaterializeTriggerService.CoordMaterializeTriggerRunnable}} 
class. We only add items to {{callables}} and not to {{delayedCallables}}. We 
could remove this part of the class.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Assigned] (OOZIE-3460) Remove apache-curator pom files from Oozie hive sharelib

2019-04-01 Thread duan xiong (JIRA)


 [ 
https://issues.apache.org/jira/browse/OOZIE-3460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

duan xiong reassigned OOZIE-3460:
-

Assignee: duan xiong

> Remove apache-curator pom files from Oozie hive sharelib
> 
>
> Key: OOZIE-3460
> URL: https://issues.apache.org/jira/browse/OOZIE-3460
> Project: Oozie
>  Issue Type: Bug
>Affects Versions: trunk
>Reporter: Andras Salamon
>Assignee: duan xiong
>Priority: Minor
>
> Oozie hive sharelib contain not only jar files but also a pom file 
> ({{apache-curator-2.12.0.pom}}). We don't need this file in the sharelibs, we 
> should remove it.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Assigned] (OOZIE-3461) CoordMaterializeTriggerService code cleanup

2019-04-01 Thread duan xiong (JIRA)


 [ 
https://issues.apache.org/jira/browse/OOZIE-3461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

duan xiong reassigned OOZIE-3461:
-

Assignee: duan xiong

> CoordMaterializeTriggerService code cleanup
> ---
>
> Key: OOZIE-3461
> URL: https://issues.apache.org/jira/browse/OOZIE-3461
> Project: Oozie
>  Issue Type: Task
>Reporter: Andras Salamon
>Assignee: duan xiong
>Priority: Minor
>
> It seems to me don't really use the {{delayedCallables}} and {{delay}} 
> variables in 
> {{CoordMaterializeTriggerService.CoordMaterializeTriggerRunnable}} class. We 
> only add items to {{callables}} and not to {{delayedCallables}}. We could 
> remove this part of the class.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (OOZIE-3459) Oozie cannot be built using Java 11

2019-04-01 Thread duan xiong (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-3459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16807332#comment-16807332
 ] 

duan xiong commented on OOZIE-3459:
---

Hi,[~dionusos]. Sorry ,I use the openJdk11.So maybe that's different. 

> Oozie cannot be built using Java 11
> ---
>
> Key: OOZIE-3459
> URL: https://issues.apache.org/jira/browse/OOZIE-3459
> Project: Oozie
>  Issue Type: Bug
>  Components: core, fluent-job
>Affects Versions: 5.1.0
>Reporter: Denes Bodo
>Priority: Major
>
> Using OpenJDK 11 I am not able to build Oozie using {{mvn clean install}}.
> I found two issues:
>  * Fluent job API build fails due to Jaxb2 maven plugin.
>  * No {{com.sun.tools.}} package is available so *TestMetricsInstrumentation* 
> will not work.
>  * Maven surefire plugin has to be updated. It works with 3.0.0-M3



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Comment Edited] (OOZIE-3459) Oozie cannot be built using Java 11

2019-04-01 Thread duan xiong (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-3459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16807332#comment-16807332
 ] 

duan xiong edited comment on OOZIE-3459 at 4/2/19 1:05 AM:
---

Hi,[~dionusos]. Sorry ,I use the openJdk11.So maybe that's different.

Do you try change this java version  to 11? 

```

1.8

1.8

1.8

```


was (Author: nobigo):
Hi,[~dionusos]. Sorry ,I use the openJdk11.So maybe that's different. 

> Oozie cannot be built using Java 11
> ---
>
> Key: OOZIE-3459
> URL: https://issues.apache.org/jira/browse/OOZIE-3459
> Project: Oozie
>  Issue Type: Bug
>  Components: core, fluent-job
>Affects Versions: 5.1.0
>Reporter: Denes Bodo
>Priority: Major
>
> Using OpenJDK 11 I am not able to build Oozie using {{mvn clean install}}.
> I found two issues:
>  * Fluent job API build fails due to Jaxb2 maven plugin.
>  * No {{com.sun.tools.}} package is available so *TestMetricsInstrumentation* 
> will not work.
>  * Maven surefire plugin has to be updated. It works with 3.0.0-M3



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] Subscription: Oozie Patch Available

2019-04-01 Thread jira
Issue Subscription
Filter: Oozie Patch Available (89 issues)

Subscriber: ooziedaily

Key Summary
OOZIE-3455  Inconsistent CoordMaterializeTransitionXCommand logging 
https://issues.apache.org/jira/browse/OOZIE-3455
OOZIE-3449  Make spark-2 as the default profile
https://issues.apache.org/jira/browse/OOZIE-3449
OOZIE-3447  Run test case in local : It shows oozie-hsqldb-orm.xml exception
https://issues.apache.org/jira/browse/OOZIE-3447
OOZIE-3418  Upgrade to Guava 27
https://issues.apache.org/jira/browse/OOZIE-3418
OOZIE-3404  The env variable of SPARK_HOME needs to be set when running pySpark
https://issues.apache.org/jira/browse/OOZIE-3404
OOZIE-3375  Can't use empty  in coordinator
https://issues.apache.org/jira/browse/OOZIE-3375
OOZIE-3367  Using && in EL expressions in oozie bundle.xml files generates 
parse errors
https://issues.apache.org/jira/browse/OOZIE-3367
OOZIE-3366  Update workflow status and subworkflow status on suspend command
https://issues.apache.org/jira/browse/OOZIE-3366
OOZIE-3364  Rerunning Oozie bundle jobs starts the coordinators in 
indeterminate order
https://issues.apache.org/jira/browse/OOZIE-3364
OOZIE-3362  When killed, SSH action should kill the spawned processes on target 
host
https://issues.apache.org/jira/browse/OOZIE-3362
OOZIE-3335  Cleanup parseFilter methods
https://issues.apache.org/jira/browse/OOZIE-3335
OOZIE-3320  Oozie ShellAction should support absolute bash file path
https://issues.apache.org/jira/browse/OOZIE-3320
OOZIE-3319  Log SSH action callback error output
https://issues.apache.org/jira/browse/OOZIE-3319
OOZIE-3301  Update NOTICE file
https://issues.apache.org/jira/browse/OOZIE-3301
OOZIE-3274  Remove slf4j
https://issues.apache.org/jira/browse/OOZIE-3274
OOZIE-3266  Coord action rerun support RERUN_SKIP_NODES option
https://issues.apache.org/jira/browse/OOZIE-3266
OOZIE-3265  properties RERUN_FAIL_NODES and RERUN_SKIP_NODES should be able to 
appear together
https://issues.apache.org/jira/browse/OOZIE-3265
OOZIE-3256  refactor OozieCLI class
https://issues.apache.org/jira/browse/OOZIE-3256
OOZIE-3249  [tools] Instrumentation log parser
https://issues.apache.org/jira/browse/OOZIE-3249
OOZIE-3199  Let system property restriction configurable
https://issues.apache.org/jira/browse/OOZIE-3199
OOZIE-3196  Authorization: restrict world readability by user
https://issues.apache.org/jira/browse/OOZIE-3196
OOZIE-3179  Adding a configurable config-default.xml location to a workflow
https://issues.apache.org/jira/browse/OOZIE-3179
OOZIE-3170  Oozie Diagnostic Bundle tool fails with NPE due to missing service 
class
https://issues.apache.org/jira/browse/OOZIE-3170
OOZIE-3137  Add support for log4j2 in HiveMain
https://issues.apache.org/jira/browse/OOZIE-3137
OOZIE-3135  Configure log4j2 in SqoopMain
https://issues.apache.org/jira/browse/OOZIE-3135
OOZIE-3091  Oozie Sqoop Avro Import fails with "java.lang.NoClassDefFoundError: 
org/apache/avro/mapred/AvroWrapper"
https://issues.apache.org/jira/browse/OOZIE-3091
OOZIE-3071  Oozie 4.3 Spark sharelib ueses a different version of commons-lang3 
than Spark 2.2.0
https://issues.apache.org/jira/browse/OOZIE-3071
OOZIE-3063  Sanitizing variables that are part of openjpa.ConnectionProperties
https://issues.apache.org/jira/browse/OOZIE-3063
OOZIE-3062  Set HADOOP_CONF_DIR for spark action
https://issues.apache.org/jira/browse/OOZIE-3062
OOZIE-2952  Fix Findbugs warnings in oozie-sharelib-oozie
https://issues.apache.org/jira/browse/OOZIE-2952
OOZIE-2927  Append new line character for Hive2 query using query tag
https://issues.apache.org/jira/browse/OOZIE-2927
OOZIE-2834  ParameterVerifier logging non-useful warning for workflow definition
https://issues.apache.org/jira/browse/OOZIE-2834
OOZIE-2833  when using uber mode the regex pattern used in the 
extractHeapSizeMB method does not allow heap sizes specified in bytes.
https://issues.apache.org/jira/browse/OOZIE-2833
OOZIE-2812  SparkConfigurationService should support loading configurations 
from multiple Spark versions
https://issues.apache.org/jira/browse/OOZIE-2812
OOZIE-2795  Create lib directory or symlink for Oozie CLI during packaging
https://issues.apache.org/jira/browse/OOZIE-2795
OOZIE-2784  Include WEEK as a parameter in the Coordinator Expression Language 
Evaulator
https://issues.apache.org/jira/browse/OOZIE-2784
OOZIE-2779  Mask Hive2 action Beeline JDBC password
https://issues.apache.org/jira/browse/OOZIE-2779
OOZIE-2736  Reduce the number of threads during test execution
https://issues.apache.org/jira/brow