Jenkins build is back to normal : oozie-trunk-find-patches-available #154602

2017-03-25 Thread Apache Jenkins Server 
See

Build failed in Jenkins: oozie-trunk-find-patches-available #154601

2017-03-25 Thread Apache Jenkins Server 
See 


--
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on H1 (Hadoop) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url 
 > https://git-wip-us.apache.org/repos/asf/oozie.git # timeout=10
Fetching upstream changes from https://git-wip-us.apache.org/repos/asf/oozie.git
 > git --version # timeout=10
 > git fetch --tags --progress 
 > https://git-wip-us.apache.org/repos/asf/oozie.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
Checking out Revision 1392eeaf8397a6c6814607cf61cb962403df1447 
(refs/remotes/origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 1392eeaf8397a6c6814607cf61cb962403df1447
 > git rev-list 1392eeaf8397a6c6814607cf61cb962403df1447 # timeout=10
[oozie-trunk-find-patches-available] $ /bin/bash 
/tmp/hudson7930853811835659318.sh
mkdir: cannot create directory 
':
 File exists
  % Total% Received % Xferd  Average Speed   TimeTime Time  Current
 Dload  Upload   Total   SpentLeft  Speed
  0 00 00 0  0  0 --:--:-- --:--:-- --:--:-- 0  
0 00 00 0  0  0 --:--:-- --:--:-- --:--:-- 0100 
 255k0  255k0 0   251k  0 --:--:--  0:00:01 --:--:--  251k100 
1031k0 1031k0 0   514k  0 --:--:--  0:00:02 --:--:--  513k100 
1383k0 1383k0 0   503k  0 --:--:--  0:00:02 --:--:--  503k
curl: (18) transfer closed with outstanding read data remaining
Could not retrieve available patches from JIRA
Build step 'Execute shell' marked build as failure

Re: Review Request 54705: OOZIE-1770: Create Oozie Application Master for YARN

2017-03-25 Thread Rohini Palaniswamy 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/54705/#review170061
---



Reviews for Pages 1-3 except JavaActionExecutor

Note: On a time crunch and doing review of couple of pages at a time to avoid 
postponing this for too long. Have also not had time to go through history of 
previous review comments from others. So there might be duplicates.


core/src/main/java/org/apache/oozie/action/hadoop/CredentialsProviderFactory.java
Lines 34 (patched)


If you are calling this a factory, you should look into removing the 
constructor by type and making it a true Factory. Cache the credential type and 
the corresponding Class. createCredentialsProvider() will then become 
createCredentialsProvider(String type) which will just look up the cache and 
return a new instance of the Class. 

Parsing ConfigurationService.getStrings(CRED_KEY) and loading the class 
everytime is a lot of waste.



core/src/main/java/org/apache/oozie/action/hadoop/LauncherMapperHelper.java
Lines 54 (patched)


You could just call it LauncherHelper.



core/src/main/java/org/apache/oozie/action/hadoop/MapReduceActionExecutor.java
Lines 319 (patched)


Typo. original



core/src/main/java/org/apache/oozie/action/hadoop/MapReduceActionExecutor.java
Lines 370 (patched)


Remove this warn and add e to the next warning logging.



core/src/main/java/org/apache/oozie/action/hadoop/MapReduceActionExecutor.java
Lines 406-407 (patched)


1) Can we kill directly if externalChild id is not empty (MR job already 
launched) else call  LauncherMainHadoopUtils.killChildYarnJobs? If it is empty 
we have to call killChildYarnJobs as the launcher AM could have just launched 
the mapreduce job before kill reached it.
2) Why are we duplicating the killChildYarnJobs code here?



core/src/main/java/org/apache/oozie/action/hadoop/SparkActionExecutor.java
Lines 112-114 (original)


You can't remove this. Will breaking existing users. Since it starts with 
oozie.launcher, config deprecation will not handle it. Basically any 
oozie.launcher hadoop 1.x settings cannot be removed because of that.



core/src/main/java/org/apache/oozie/action/hadoop/SqoopActionExecutor.java
Line 89 (original), 87 (patched)


Revert back to old code. Just remove the final instead of creating another 
temporary list.



core/src/main/java/org/apache/oozie/action/hadoop/SqoopActionExecutor.java
Lines 109-111 (original)


Why is this condition not necessary any more?



core/src/main/java/org/apache/oozie/action/ssh/SshActionExecutor.java
Line 69 (original), 69 (patched)


Revert. UNKNOWN_ERROR is correct



core/src/main/java/org/apache/oozie/command/PurgeXCommand.java
Line 410 (original), 410 (patched)


Why remove entity key?



core/src/main/java/org/apache/oozie/command/PurgeXCommand.java
Line 418 (original), 418 (patched)


Why is lock not required anymore?



core/src/main/java/org/apache/oozie/dependency/HCatURIHandler.java
Line 182 (original)


Why is support for dropping table being removed?



core/src/main/java/org/apache/oozie/dependency/HCatURIHandler.java
Line 345 (original)


Why is support for checking exists on a table being removed?



core/src/main/java/org/apache/oozie/service/HadoopAccessorService.java
Lines 776-777 (patched)


This is going to fill up the temp disk space pretty quickly. Please avoid 
creating the local file and write directly to the FSDataOutputStream after 
creating the file in HDFS.



core/src/main/java/org/apache/oozie/service/Services.java
Lines 308-309 (patched)


log.fatal("Runtime Exception during Services Load. Check your list of '{0}' 
or '{1}'", CONF_SERVICE_CLASSES, CONF_SERVICE_EXT_CLASSES, rex);



core/src/main/java/org/apache/oozie/servlet/BaseAdminServlet.java
Lines 86-87 (original), 71 (patched)


You should retain the code of checking the resource name and throwing error 
here which is currently commented out instead of doing it in setOozieMode()

[jira] [Commented] (OOZIE-2845) Replace reflection-based code which sets variable in HiveConf

2017-03-25 Thread Andras Piros (JIRA) 

[ 
https://issues.apache.org/jira/browse/OOZIE-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15941862#comment-15941862
 ] 

Andras Piros commented on OOZIE-2845:
-

+1 on the idea [~pbacsko]! We really should resort to reflection in case all 
other means are exhausted.

> Replace reflection-based code which sets variable in HiveConf
> -
>
> Key: OOZIE-2845
> URL: https://issues.apache.org/jira/browse/OOZIE-2845
> Project: Oozie
>  Issue Type: Improvement
>  Components: core
>Reporter: Peter Bacsko
>Assignee: Peter Bacsko
>
> In different places, we use the following reflection-based code to reset a 
> variable inside {{HiveConf.java}}
> {code}
> public static void resetHiveConfStaticVariables() throws Exception {
> // HiveConf initializes location of hive-site.xml in static block.
> // So this is needed so that tests like TestHiveMain that create 
> hive-site.xml don't fail.
> Field declaredField = HiveConf.class.getDeclaredField("hiveSiteURL");
> declaredField.setAccessible(true);
> declaredField.set(null, 
> HiveConf.class.getClassLoader().getResource("hive-site.xml"));
> }
> {code}
> Note that HiveConf has supported setting {{hiveSiteURL}} for a long time. 
> Even version 0.13.0 has the static setter method:
> https://github.com/apache/hive/blob/branch-0.13/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java#L1493-L1495
> Therefore reflection-based solution should be modified.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (OOZIE-2681) fix javadoc to compile on JDK8 again

2017-03-25 Thread Hadoop QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/OOZIE-2681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15941817#comment-15941817
 ] 

Hadoop QA commented on OOZIE-2681:
--

Testing JIRA OOZIE-2681

Cleaning local git workspace



{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than 
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT 
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc 
warnings
{color:green}+1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:green}+1{color} the patch does not seem to introduce new javac 
warnings
{color:green}+1{color} There are no new bugs found in total.
.{color:green}+1{color} There are no new bugs found in [server].
.{color:green}+1{color} There are no new bugs found in [client].
.{color:green}+1{color} There are no new bugs found in [docs].
.{color:green}+1{color} There are no new bugs found in [sharelib/hive].
.{color:green}+1{color} There are no new bugs found in [sharelib/spark].
.{color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
.{color:green}+1{color} There are no new bugs found in [sharelib/hive2].
.{color:green}+1{color} There are no new bugs found in [sharelib/streaming].
.{color:green}+1{color} There are no new bugs found in [sharelib/pig].
.{color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
.{color:green}+1{color} There are no new bugs found in [sharelib/distcp].
.{color:green}+1{color} There are no new bugs found in [sharelib/oozie].
.{color:green}+1{color} There are no new bugs found in 
[hadooplibs/hadoop-utils-2].
.{color:green}+1{color} There are no new bugs found in [core].
.{color:green}+1{color} There are no new bugs found in [tools].
.{color:green}+1{color} There are no new bugs found in [examples].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA 
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color}
.Tests run: 1906
.Tests failed: 0
.Tests errors: 1

.The patch failed the following testcases:

.  

.Tests failing with errors:
.  testJMXInstrumentation(org.apache.oozie.util.TestMetricsInstrumentation)

{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch 


{color:red}*-1 Overall result, please check the reported -1(s)*{color}


The full output of the test-patch run is available at

.   https://builds.apache.org/job/oozie-trunk-precommit-build/3734/

> fix javadoc to compile on JDK8 again
> 
>
> Key: OOZIE-2681
> URL: https://issues.apache.org/jira/browse/OOZIE-2681
> Project: Oozie
>  Issue Type: Bug
>  Components: build
>Affects Versions: 4.3.0
>Reporter: Robert Kanter
>Assignee: Abhishek Bafna
>Priority: Critical
> Fix For: 5.0.0
>
> Attachments: OOZIE-2681-00.patch, OOZIE-2681-01.patch, 
> OOZIE-2681-02.patch, OOZIE-2681-03.patch
>
>
> We have a lot of Javadoc build failures, which causes Oozie to fail to build 
> on Java 8, which is more strict than Java 6 or 7 was.  OOZIE-2178 fixed all 
> of these that existed at that time, but we've since introduced a lot more.  
> OOZIE-2487 made a workaround to prevent this from causing the build to fail, 
> but we should fix these (again) and remove the OOZIE-2487 workaround.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Build failed in Jenkins: oozie-trunk-precommit-build #3734

2017-03-25 Thread Apache Jenkins Server 
See 


--
[...truncated 1.28 MB...]
[INFO] org.ow2.asm:asm:jar:5.0.1 already exists in destination.
[INFO] org.apache.openjpa:openjpa-lib:jar:2.4.1 already exists in destination.
[INFO] net.sf.opencsv:opencsv:jar:2.3 already exists in destination.
[INFO] tomcat:jasper-runtime:jar:5.5.23 already exists in destination.
[INFO] org.apache.curator:curator-client:jar:2.5.0 already exists in 
destination.
[INFO] org.eclipse.jetty:jetty-annotations:jar:9.2.19.v20160908 already exists 
in destination.
[INFO] com.sun.jersey:jersey-server:jar:1.9 already exists in destination.
[INFO] com.fasterxml.jackson.core:jackson-core:jar:2.2.2 already exists in 
destination.
[INFO] 
[INFO] --- maven-assembly-plugin:2.2.1:single (default-cli) @ oozie-server ---
[INFO] Reading assembly descriptor: ../src/main/assemblies/empty.xml
[INFO] 
[INFO] 
[INFO] Building Apache Oozie Distro 4.4.0-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ oozie-distro 
---
[INFO] 
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ 
oozie-distro ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ oozie-distro 
---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ 
oozie-distro ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ 
oozie-distro ---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-surefire-plugin:2.12.2:test (default-test) @ oozie-distro ---
[INFO] Tests are skipped.
[INFO] 
[INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ oozie-distro ---
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-site-plugin:2.0-beta-6:attach-descriptor (attach-descriptor) @ 
oozie-distro ---
[INFO] 
[INFO] --- maven-assembly-plugin:2.2.1:single (default-cli) @ oozie-distro ---
[INFO] Reading assembly descriptor: ../src/main/assemblies/distro.xml
[INFO] Copying files to 

[WARNING] Assembly file: 

 is not a regular file (it may be a directory). It cannot be attached to the 
project build for installation or deployment.
[INFO] Building tar : 

[INFO] 
[INFO] 
[INFO] Building Apache Oozie ZooKeeper Security Tests 4.4.0-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ 
oozie-zookeeper-security-tests ---
[INFO] 
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ 
oozie-zookeeper-security-tests ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ 
oozie-zookeeper-security-tests ---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ 
oozie-zookeeper-security-tests ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ 
oozie-zookeeper-security-tests ---
[INFO] Nothing to compile - all classes are up to date
[INFO] 
[INFO] --- maven-surefire-plugin:2.12.2:test (default-test) @ 
oozie-zookeeper-security-tests ---
[INFO] Tests are

Jenkins build is back to normal : oozie-trunk-find-patches-available #154533

2017-03-25 Thread Apache Jenkins Server 
See

Build failed in Jenkins: oozie-trunk-find-patches-available #154532

2017-03-25 Thread Apache Jenkins Server 
See 


--
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on H1 (Hadoop) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url 
 > https://git-wip-us.apache.org/repos/asf/oozie.git # timeout=10
Fetching upstream changes from https://git-wip-us.apache.org/repos/asf/oozie.git
 > git --version # timeout=10
 > git fetch --tags --progress 
 > https://git-wip-us.apache.org/repos/asf/oozie.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
Checking out Revision 1392eeaf8397a6c6814607cf61cb962403df1447 
(refs/remotes/origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 1392eeaf8397a6c6814607cf61cb962403df1447
 > git rev-list 1392eeaf8397a6c6814607cf61cb962403df1447 # timeout=10
[oozie-trunk-find-patches-available] $ /bin/bash 
/tmp/hudson2423197949859802415.sh
mkdir: cannot create directory 
':
 File exists
  % Total% Received % Xferd  Average Speed   TimeTime Time  Current
 Dload  Upload   Total   SpentLeft  Speed
  0 00 00 0  0  0 --:--:-- --:--:-- --:--:-- 
0100 901120 901120 0   114k  0 --:--:-- --:--:-- --:--:--  
114k100  687k0  687k0 0   392k  0 --:--:--  0:00:01 --:--:--  
392k100 1175k0 1175k0 0   424k  0 --:--:--  0:00:02 --:--:--  
424k100 1471k0 1471k0 0   392k  0 --:--:--  0:00:03 --:--:--  
392k100 1807k0 1807k0 0   386k  0 --:--:--  0:00:04 --:--:--  
386k
curl: (18) transfer closed with outstanding read data remaining
Could not retrieve available patches from JIRA
Build step 'Execute shell' marked build as failure

[jira] Subscription: Oozie Patch Available

2017-03-25 Thread jira 
Issue Subscription
Filter: Oozie Patch Available (0 issues)

Subscriber: ooziedaily

You may edit this subscription at:
https://issues.apache.org/jira/secure/FilterSubscription!default.jspa?subId=16327=12325939

[jira] [Commented] (OOZIE-2701) Oozie to support Multiple HCatalog URIs

2017-03-25 Thread Hadoop QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/OOZIE-2701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15941764#comment-15941764
 ] 

Hadoop QA commented on OOZIE-2701:
--

Testing JIRA OOZIE-2701

Cleaning local git workspace



{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:green}+1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than 
132
.{color:green}+1{color} the patch does adds/modifies 2 testcase(s)
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT 
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc 
warnings
{color:green}+1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:green}+1{color} the patch does not seem to introduce new javac 
warnings
{color:green}+1{color} There are no new bugs found in total.
.{color:green}+1{color} There are no new bugs found in [server].
.{color:green}+1{color} There are no new bugs found in [client].
.{color:green}+1{color} There are no new bugs found in [core].
.{color:green}+1{color} There are no new bugs found in [docs].
.{color:green}+1{color} There are no new bugs found in 
[hadooplibs/hadoop-utils-2].
.{color:green}+1{color} There are no new bugs found in [tools].
.{color:green}+1{color} There are no new bugs found in [examples].
.{color:green}+1{color} There are no new bugs found in [sharelib/streaming].
.{color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
.{color:green}+1{color} There are no new bugs found in [sharelib/distcp].
.{color:green}+1{color} There are no new bugs found in [sharelib/oozie].
.{color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
.{color:green}+1{color} There are no new bugs found in [sharelib/hive].
.{color:green}+1{color} There are no new bugs found in [sharelib/hive2].
.{color:green}+1{color} There are no new bugs found in [sharelib/pig].
.{color:green}+1{color} There are no new bugs found in [sharelib/spark].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA 
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:green}+1 TESTS{color}
.Tests run: 1912
.Tests rerun: 15
.Tests failed at first run: org.apache.oozie.jms.TestJMSJobEventListener,
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch 


{color:green}*+1 Overall result, good!, no -1s*{color}


The full output of the test-patch run is available at

.   https://builds.apache.org/job/oozie-trunk-precommit-build/3733/

> Oozie to support Multiple HCatalog URIs
> ---
>
> Key: OOZIE-2701
> URL: https://issues.apache.org/jira/browse/OOZIE-2701
> Project: Oozie
>  Issue Type: New Feature
>  Components: core
>Reporter: Abhishek Bafna
>Assignee: Abhishek Bafna
> Fix For: 5.0.0
>
> Attachments: OOZIE-2701-00.patch, OOZIE-2701-01.patch, 
> OOZIE-2701-02.patch, OOZIE-2701-03.patch, OOZIE-2701-04.patch, 
> OOZIE-2701-05.patch, OOZIE-2701-06.patch, OOZIE-2701-07.patch, 
> OOZIE-2701-08.patch, OOZIE-2701-09.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Jenkins build is back to normal : oozie-trunk-precommit-build #3733

2017-03-25 Thread Apache Jenkins Server 
See

[jira] [Updated] (OOZIE-2845) Replace reflection-based code which sets variable in HiveConf

2017-03-25 Thread Peter Bacsko (JIRA) 

 [ 
https://issues.apache.org/jira/browse/OOZIE-2845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Bacsko updated OOZIE-2845:

Description: 
In different places, we use the following reflection-based code to reset a 
variable inside {{HiveConf.java}}

{code}
public static void resetHiveConfStaticVariables() throws Exception {
// HiveConf initializes location of hive-site.xml in static block.
// So this is needed so that tests like TestHiveMain that create 
hive-site.xml don't fail.
Field declaredField = HiveConf.class.getDeclaredField("hiveSiteURL");
declaredField.setAccessible(true);
declaredField.set(null, 
HiveConf.class.getClassLoader().getResource("hive-site.xml"));
}
{code}

Note that HiveConf has supported setting {{hiveSiteURL}} for a long time. Even 
version 0.13.0 has the static setter method:

https://github.com/apache/hive/blob/branch-0.13/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java#L1493-L1495

Therefore reflection-based solution should be modified.

  was:
In different places, we use the following reflection-based code, to reset a 
variable inside {{HiveConf.java}}

{code}
public static void resetHiveConfStaticVariables() throws Exception {
// HiveConf initializes location of hive-site.xml in static block.
// So this is needed so that tests like TestHiveMain that create 
hive-site.xml don't fail.
Field declaredField = HiveConf.class.getDeclaredField("hiveSiteURL");
declaredField.setAccessible(true);
declaredField.set(null, 
HiveConf.class.getClassLoader().getResource("hive-site.xml"));
}
{code}

Note that HiveConf has supported setting {{hiveSiteURL}} for a long time. Even 
version 0.13.0 has the static setter method:

https://github.com/apache/hive/blob/branch-0.13/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java#L1493-L1495

Therefore reflection-based solution should be modified.


> Replace reflection-based code which sets variable in HiveConf
> -
>
> Key: OOZIE-2845
> URL: https://issues.apache.org/jira/browse/OOZIE-2845
> Project: Oozie
>  Issue Type: Improvement
>  Components: core
>Reporter: Peter Bacsko
>Assignee: Peter Bacsko
>
> In different places, we use the following reflection-based code to reset a 
> variable inside {{HiveConf.java}}
> {code}
> public static void resetHiveConfStaticVariables() throws Exception {
> // HiveConf initializes location of hive-site.xml in static block.
> // So this is needed so that tests like TestHiveMain that create 
> hive-site.xml don't fail.
> Field declaredField = HiveConf.class.getDeclaredField("hiveSiteURL");
> declaredField.setAccessible(true);
> declaredField.set(null, 
> HiveConf.class.getClassLoader().getResource("hive-site.xml"));
> }
> {code}
> Note that HiveConf has supported setting {{hiveSiteURL}} for a long time. 
> Even version 0.13.0 has the static setter method:
> https://github.com/apache/hive/blob/branch-0.13/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java#L1493-L1495
> Therefore reflection-based solution should be modified.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Created] (OOZIE-2845) Replace reflection-based code which sets variable in HiveConf

2017-03-25 Thread Peter Bacsko (JIRA) 
Peter Bacsko created OOZIE-2845:
---

 Summary: Replace reflection-based code which sets variable in 
HiveConf
 Key: OOZIE-2845
 URL: https://issues.apache.org/jira/browse/OOZIE-2845
 Project: Oozie
  Issue Type: Improvement
  Components: core
Reporter: Peter Bacsko
Assignee: Peter Bacsko


In different places, we use the following reflection-based code, to reset a 
variable inside {{HiveConf.java}}

{code}
public static void resetHiveConfStaticVariables() throws Exception {
// HiveConf initializes location of hive-site.xml in static block.
// So this is needed so that tests like TestHiveMain that create 
hive-site.xml don't fail.
Field declaredField = HiveConf.class.getDeclaredField("hiveSiteURL");
declaredField.setAccessible(true);
declaredField.set(null, 
HiveConf.class.getClassLoader().getResource("hive-site.xml"));
}
{code}

Note that HiveConf has supported setting {{hiveSiteURL}} for a long time. Even 
version 0.13.0 has the static setter method:

https://github.com/apache/hive/blob/branch-0.13/common/src/java/org/apache/hadoop/hive/conf/HiveConf.java#L1493-L1495

Therefore reflection-based solution should be modified.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (OOZIE-2701) Oozie to support Multiple HCatalog URIs

2017-03-25 Thread Abhishek Bafna (JIRA) 

 [ 
https://issues.apache.org/jira/browse/OOZIE-2701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Abhishek Bafna updated OOZIE-2701:
--
Attachment: OOZIE-2701-09.patch

> Oozie to support Multiple HCatalog URIs
> ---
>
> Key: OOZIE-2701
> URL: https://issues.apache.org/jira/browse/OOZIE-2701
> Project: Oozie
>  Issue Type: New Feature
>  Components: core
>Reporter: Abhishek Bafna
>Assignee: Abhishek Bafna
> Fix For: 5.0.0
>
> Attachments: OOZIE-2701-00.patch, OOZIE-2701-01.patch, 
> OOZIE-2701-02.patch, OOZIE-2701-03.patch, OOZIE-2701-04.patch, 
> OOZIE-2701-05.patch, OOZIE-2701-06.patch, OOZIE-2701-07.patch, 
> OOZIE-2701-08.patch, OOZIE-2701-09.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] Subscription: Oozie Patch Available

2017-03-25 Thread jira 
Issue Subscription
Filter: Oozie Patch Available (95 issues)

Subscriber: ooziedaily

Key Summary
OOZIE-2843  Enhance logging inside ZKLocksService and MemoryLocksService
https://issues.apache.org/jira/browse/OOZIE-2843
OOZIE-2841  Limit FindBugs diff errors in JIRA comments
https://issues.apache.org/jira/browse/OOZIE-2841
OOZIE-2834  ParameterVerifier logging non-useful warning for workflow definition
https://issues.apache.org/jira/browse/OOZIE-2834
OOZIE-2833  when using uber mode the regex pattern used in the 
extractHeapSizeMB method does not allow heap sizes specified in bytes.
https://issues.apache.org/jira/browse/OOZIE-2833
OOZIE-2831  Update maven-project-info-reports-plugin to 2.9
https://issues.apache.org/jira/browse/OOZIE-2831
OOZIE-2827  More directly view of the coordinator’s history from perspective of 
workflow action.
https://issues.apache.org/jira/browse/OOZIE-2827
OOZIE-2825  Custom Authentication doc page is not well formatted
https://issues.apache.org/jira/browse/OOZIE-2825
OOZIE-2824  Fix typos in documentation
https://issues.apache.org/jira/browse/OOZIE-2824
OOZIE-2812  SparkConfigurationService should support loading configurations 
from multiple Spark versions
https://issues.apache.org/jira/browse/OOZIE-2812
OOZIE-2796  oozie.action.keep.action.dir not getting noticed
https://issues.apache.org/jira/browse/OOZIE-2796
OOZIE-2795  Create lib directory or symlink for Oozie CLI during packaging
https://issues.apache.org/jira/browse/OOZIE-2795
OOZIE-2791  ShareLib installation may fail on busy Hadoop clusters
https://issues.apache.org/jira/browse/OOZIE-2791
OOZIE-2785  Master is not compiling with hadoop-1 profile
https://issues.apache.org/jira/browse/OOZIE-2785
OOZIE-2784  Include WEEK as a parameter in the Coordinator Expression Language 
Evaulator
https://issues.apache.org/jira/browse/OOZIE-2784
OOZIE-2780  Upgrade hadoop-common version to 2.6.0
https://issues.apache.org/jira/browse/OOZIE-2780
OOZIE-2779  Mask Hive2 action Beeline JDBC password
https://issues.apache.org/jira/browse/OOZIE-2779
OOZIE-2769  Extend FS action to allow setrep on a file
https://issues.apache.org/jira/browse/OOZIE-2769
OOZIE-2753  Update Docs for Jetty Tomcat changes
https://issues.apache.org/jira/browse/OOZIE-2753
OOZIE-2751  LocalOozieClient is missing methods from OozieClient
https://issues.apache.org/jira/browse/OOZIE-2751
OOZIE-2746  Several tests failure in TestV2ValidateServlet.java
https://issues.apache.org/jira/browse/OOZIE-2746
OOZIE-2736  Reduce the number of threads during test execution
https://issues.apache.org/jira/browse/OOZIE-2736
OOZIE-2733  change org.apache.hadoop.fs.permission.AccessControlException to 
org.apache.hadoop.security.AccessControlException
https://issues.apache.org/jira/browse/OOZIE-2733
OOZIE-2726  Flaky test due to daylight saving changes
https://issues.apache.org/jira/browse/OOZIE-2726
OOZIE-2718  Improve -dryrun for bundles
https://issues.apache.org/jira/browse/OOZIE-2718
OOZIE-2713  Provide an option to log out contents of the localized jar files
https://issues.apache.org/jira/browse/OOZIE-2713
OOZIE-2701  Oozie to support Multiple HCatalog URIs
https://issues.apache.org/jira/browse/OOZIE-2701
OOZIE-2694  Add logging for FsActionExecutor 
https://issues.apache.org/jira/browse/OOZIE-2694
OOZIE-2693  SimpleHCatDependencyCache.removeMissingDependency can throw NPE
https://issues.apache.org/jira/browse/OOZIE-2693
OOZIE-2692  Oozie job submit doesn't report error message to user if there is 
any issue with job conf
https://issues.apache.org/jira/browse/OOZIE-2692
OOZIE-2684  Bad database schema error for WF_ACTIONS table
https://issues.apache.org/jira/browse/OOZIE-2684
OOZIE-2681  fix javadoc to compile on JDK8 again
https://issues.apache.org/jira/browse/OOZIE-2681
OOZIE-2670  Upgrade Hbase to 1.2
https://issues.apache.org/jira/browse/OOZIE-2670
OOZIE-2668  Status update and recovery problems when coord action and its 
children not in sync
https://issues.apache.org/jira/browse/OOZIE-2668
OOZIE-2662  DB migration fails if DB is too big
https://issues.apache.org/jira/browse/OOZIE-2662
OOZIE-2652  Skip trash while deleting hive table partition
https://issues.apache.org/jira/browse/OOZIE-2652
OOZIE-2651  Set javax.xml.parsers.DocumentBuilderFactory sys prop to make XML 
handling faster
https://issues.apache.org/jira/browse/OOZIE-2651
OOZIE-2650  Retry coord start on database exceptions
https://issues.apache.org/jira/browse/OOZIE-2650
OOZIE-2644  Skip queuing Notification Commands when there's nothing to notify