date:20161018

Jenkins build is back to normal : oozie-trunk-find-patches-available #136815

2016-10-18 Thread Apache Jenkins Server

See

Build failed in Jenkins: oozie-trunk-find-patches-available #136814

2016-10-18 Thread Apache Jenkins Server

See 

--
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on H1 (yahoo-not-h2 Hadoop Mapreduce Hdfs Pig) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url 
 > https://git-wip-us.apache.org/repos/asf/oozie.git # timeout=10
Fetching upstream changes from https://git-wip-us.apache.org/repos/asf/oozie.git
 > git --version # timeout=10
 > git -c core.askpass=true fetch --tags --progress 
 > https://git-wip-us.apache.org/repos/asf/oozie.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
Checking out Revision 51920be8480c80638e11faff20ad089b02a7f5fb 
(refs/remotes/origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 51920be8480c80638e11faff20ad089b02a7f5fb
 > git rev-list 51920be8480c80638e11faff20ad089b02a7f5fb # timeout=10
[oozie-trunk-find-patches-available] $ /bin/bash 
/tmp/hudson3159503146698649553.sh
mkdir: cannot create directory 
':
 File exists
  % Total% Received % Xferd  Average Speed   TimeTime Time  Current
 Dload  Upload   Total   SpentLeft  Speed

  0 00 00 0  0  0 --:--:-- --:--:-- --:--:-- 0
  0 00 00 0  0  0 --:--:-- --:--:-- --:--:-- 0
curl: (35) Unknown SSL protocol error in connection to issues.apache.org:443 
Could not retrieve available patches from JIRA
Build step 'Execute shell' marked build as failure

[jira] [Commented] (OOZIE-1986) Add FindBugs report to pre-commit build

2016-10-18 Thread Robert Kanter (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587302#comment-15587302
 ] 

Robert Kanter commented on OOZIE-1986:
--

Oh, I see.  It doesn't have the new {{test-patch-11-findbugs-diff}} file until 
after it's determined which tasks to run.

> Add FindBugs report to pre-commit build
> ---
>
> Key: OOZIE-1986
> URL: https://issues.apache.org/jira/browse/OOZIE-1986
> Project: Oozie
>  Issue Type: Bug
>  Components: tests
>Reporter: Robert Kanter
>Assignee: Andras Piros
> Fix For: 5.0.0
>
> Attachments: OOZIE-1986.001.patch, OOZIE-1986.002.patch, 
> OOZIE-1986.003.patch, OOZIE-1986.004.patch, OOZIE-1986.005.patch, 
> OOZIE-1986.006.patch, OOZIE-1986.007.patch, OOZIE-1986.008.patch, 
> OOZIE-1986.009.patch, OOZIE-1986.010.patch, summary.txt
>
>
> Now that we have OOZIE-1793, it will be really useful to have the pre-commit 
> build generate a findbugs report.  It should probably before and after the 
> patch and only complain it there are more after.  And it should link to the 
> report.  Ideally, this would do some kind of diff (like Hadoop does) so it's 
> easy to identify the new findbugs items.
> You can generate the findbugs reports by running:
> {noformat}
> mvn verify -DskipTests
> {noformat}
> This also runs checkstyle



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (OOZIE-2705) Oozie Spark action ignores spark.executor.extraJavaOptions and spark.driver.extraJavaOptions

2016-10-18 Thread Robert Kanter (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-2705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587297#comment-15587297
 ] 

Robert Kanter commented on OOZIE-2705:
--

That seems reasonable.  One last question then: {{addedLog4jSettings}} gets set 
to {{true}} if either {{EXECUTOR_EXTRA_JAVA_OPTIONS}} or 
{{DRIVER_EXTRA_JAVA_OPTIONS}} is set by the user.  So if the user only sets one 
of those, Oozie won't set the other.  We probably want to set one if we can, 
right?

> Oozie Spark action ignores spark.executor.extraJavaOptions and 
> spark.driver.extraJavaOptions
> 
>
> Key: OOZIE-2705
> URL: https://issues.apache.org/jira/browse/OOZIE-2705
> Project: Oozie
>  Issue Type: Bug
>  Components: action
>Affects Versions: 4.3.0
> Environment: CentOS 6.6
>Reporter: Prabhu Joseph
>Assignee: Peter Cseh
>Priority: Blocker
> Fix For: 4.3.0
>
> Attachments: OOZIE-2705.001.patch, OOZIE-2705.002.patch
>
>
> Oozie Spark Action with spark-opts "spark.executor.extraJavaOptions and 
> spark.driver.extraJavaOptions" are ignored.
> --executor-memory 1G --driver-java-options "-verbose -Xms750m 
> -XX:+PrintGCDetails -XX:+PrintGCTimeStamps" --conf 
> "spark.executor.extraJavaOptions=-XX:+PrintGCDetails 
> -XX:+PrintGCTimeStamps" 
> Suspect the OOZIE-2503 fix is overriding them. The configs are reflected 
> after removing the fix of OOZIE-2503.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (OOZIE-2666) Support embedding Jetty into Oozie

2016-10-18 Thread Attila Sasvari (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586782#comment-15586782
 ] 

Attila Sasvari commented on OOZIE-2666:
---

I just re-tested the latest patch again on a Kerberized Hadoop cluster (using 
CDH) that it I can submit & execute workflows:
tested with a simple mapreduce demo workflow and also with shell actions (with 
one that fails on purpose and also with another one that succeeds).   

[~jaydeepvishwakarma], [~rohini] could you please also have a quick look at the 
patch on ReviewBoard? I am wondering if you can spot functionality that is 
missing (i.e. additional jetty capabilities that can be important to configure 
and / or additional relevant HTTP / HTTPS settings) or some problems with the 
packaging part /approach (that is an area that I think still needs 
improvements). I tried to move a number Oozie configuration variables that are 
currently required to be passed via system properties to 
oozie-site/oozie-default.xml, but there are some that needs more refactoring. 



> Support embedding Jetty into Oozie
> --
>
> Key: OOZIE-2666
> URL: https://issues.apache.org/jira/browse/OOZIE-2666
> Project: Oozie
>  Issue Type: Sub-task
>  Components: core
>Reporter: Attila Sasvari
>Assignee: Attila Sasvari
> Attachments: OOZIE-2666.PATCH-01.patch, OOZIE-2666.PATCH-02.patch, 
> OOZIE-2666.PATCH-03.patch, OOZIE-2666.PATCH-05.patch, 
> OOZIE-2666.PATCH-06.patch, OOZIE-2666.PATCH-07.patch, 
> OOZIE-2666.PATCH-09.patch, OOZIE-2666.PATCH-10.patch, 
> OOZIE-2666.PATCH-11.patch, OOZIE-2666.PATCH-12.patch, 
> OOZIE-2666.PATCH-13.patch, OOZIE-2666.PATCH-14.patch, 
> OOZIE-2666.PATCH-15.patch, OOZIE-2666.PATCH-16.patch, 
> OOZIE-2666.PATCH-17.patch, OOZIE-2666.PATCH-18.patch, 
> OOZIE-2666.PATCH-19.patch
>
>
> The purpose of this task is to allow Oozie to run as a standalone application 
> rather than being deployed to a container inside a WAR file.
> - Build embedded jetty enabled Oozie by default
> - Allow building Tomcat based Oozie by specifying the 'tomcat' profile
> - Starting Oozie with oozied.sh detect webserver type based on the build info
> - Oozie Web UI is working with JDK 8 if using embedded jetty 
> - If using Jetty, allow the user to configure the following settings via 
> oozie-default / oozie-site xml:
> -- request / response header size
> -- allowed HTTPS protocols
> -- excluded / weak cipher suites
> -- threadpool size



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Review Request 52227: OOZIE-2225 Add wild card filter for gathering jobs

2016-10-18 Thread Sai Chirravuri


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/52227/#review153170
---



Any comments please ?

- Sai Chirravuri


On Oct. 14, 2016, 6:45 p.m., Sai Chirravuri wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/52227/
> ---
> 
> (Updated Oct. 14, 2016, 6:45 p.m.)
> 
> 
> Review request for oozie and Robert Kanter.
> 
> 
> Bugs: OOZIE-2225
> https://issues.apache.org/jira/browse/OOZIE-2225
> 
> 
> Repository: oozie-git
> 
> 
> Description
> ---
> 
> commit 05c108f61f4c3da437d826b73251e92662a4518b
> Author: krish 
> Date:   Fri Sep 23 13:50:24 2016 -0700
> 
> OOZIE-2225 Add wild card filter for gathering jobs
> 
> :100644 100644 f1d0f2b... f10de36... M  
> client/src/main/java/org/apache/oozie/cli/OozieCLI.java
> :100644 100644 a882cab... 53a6ecf... M  
> client/src/main/java/org/apache/oozie/client/OozieClient.java
> :100644 100644 01aeddf... 7597142... M  
> core/src/main/java/org/apache/oozie/DagEngine.java
> :100644 100644 3c03267... 275aabf... M  
> core/src/main/java/org/apache/oozie/executor/jpa/WorkflowsJobGetJPAExecutor.java
> :100644 100644 fb1db29... 80f0756... M  
> core/src/main/java/org/apache/oozie/store/StoreStatusFilter.java
> :00 100644 000... dd1e943... A  
> core/src/main/java/org/apache/oozie/util/db/JPAUtils.java
> :100644 100644 0b1f644... 87fccd6... M  
> core/src/test/java/org/apache/oozie/executor/jpa/TestBundleJobInfoGetJPAExecutor.java
> :100644 100644 7d468f1... 4378286... M  
> core/src/test/java/org/apache/oozie/executor/jpa/TestCoordJobInfoGetJPAExecutor.java
> :100644 100644 ddb5506... 12cb16b... M  
> core/src/test/java/org/apache/oozie/executor/jpa/TestWorkflowsJobGetJPAExecutor.java
> :100644 100644 ea778bd... 2fed1f8... M  
> core/src/test/java/org/apache/oozie/test/XDataTestCase.java
> :100644 100644 567e260... 3daf38a... M  
> docs/src/site/twiki/DG_CommandLineTool.twiki
> :100644 100644 13e1691... a66e564... M  
> docs/src/site/twiki/WebServicesAPI.twiki
> 
> 
> Diffs
> -
> 
>   client/src/main/java/org/apache/oozie/cli/OozieCLI.java 
> f1d0f2b7442e04e01bea93622cf378fc92934497 
>   client/src/main/java/org/apache/oozie/client/OozieClient.java 
> a882cab95c4b75c3fc641fb8e5511357d482eeff 
>   core/src/main/java/org/apache/oozie/CoordinatorEngine.java 
> cec6347905233d9a5fe0eb0e2fa27336a6a967a9 
>   core/src/main/java/org/apache/oozie/DagEngine.java 
> 01aeddfc282261d9ad396565a9d3d30efec2dc59 
>   
> core/src/main/java/org/apache/oozie/executor/jpa/WorkflowsJobGetJPAExecutor.java
>  3c032678d06641ae7bb2f2a9c0631948190ea662 
>   core/src/main/java/org/apache/oozie/store/StoreStatusFilter.java 
> fb1db29cdfe1dbe37c8e2176079f39f841232ee3 
>   core/src/main/java/org/apache/oozie/util/JobsFilterUtils.java 
> 18df836713918a2864566b56646f711dd84a5f97 
>   
> core/src/test/java/org/apache/oozie/executor/jpa/TestBundleJobInfoGetJPAExecutor.java
>  0b1f644c1ff74ce24b78eadf0ed7c0cbc87e93a3 
>   
> core/src/test/java/org/apache/oozie/executor/jpa/TestCoordJobInfoGetJPAExecutor.java
>  7d468f16981710d96473155df25b8de0d5ef322b 
>   
> core/src/test/java/org/apache/oozie/executor/jpa/TestWorkflowsJobGetJPAExecutor.java
>  ddb5506de90ae32d760657f8a867ab46599f1a86 
>   docs/src/site/twiki/DG_CommandLineTool.twiki 
> 567e260dd3e05c7619d957520ed49882b0cf37f2 
>   docs/src/site/twiki/WebServicesAPI.twiki 
> 13e1691c3497bed94957ef959e16e788d1196c67 
> 
> Diff: https://reviews.apache.org/r/52227/diff/
> 
> 
> Testing
> ---
> 
> CLI manual testing looks good and unit tests passed
> 
> 
> Thanks,
> 
> Sai Chirravuri
> 
>

[jira] [Commented] (OOZIE-2710) Oozie HCatalog example workflow fails

2016-10-18 Thread Peter Cseh (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-2710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586570#comment-15586570
 ] 

Peter Cseh commented on OOZIE-2710:
---

Thanks for taking the time to test out the examples!
+1 non-binding for the patch.
I've tested it with hadoop-1 and it compiles with that profile as well.

> Oozie HCatalog example workflow fails
> -
>
> Key: OOZIE-2710
> URL: https://issues.apache.org/jira/browse/OOZIE-2710
> Project: Oozie
>  Issue Type: Bug
>  Components: core
>Reporter: Abhishek Bafna
>Assignee: Abhishek Bafna
>Priority: Blocker
> Fix For: 4.3.0
>
> Attachments: OOZIE-2710-00.patch
>
>
> Oozie HCatalog example workflow fails with the below exception:
> {noformat}
> 2016-10-12 10:33:37,260 [uber-SubtaskRunner] ERROR org.apache.pig.PigServer  
> - exception during parsing: Error during parsing. Could not resolve 
> org.apache.hive.hcatalog.pig.HCatLoader using imports: [, java.lang., 
> org.apache.pig.builtin., org.apache.pig.impl.builtin.]
> Failed to parse: Pig script failed to parse: 
>  pig script failed to validate: 
> org.apache.pig.backend.executionengine.ExecException: ERROR 1070: Could not 
> resolve org.apache.hive.hcatalog.pig.HCatLoader using imports: [, java.lang., 
> org.apache.pig.builtin., org.apache.pig.impl.builtin.]
>   at 
> org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:199)
>   at org.apache.pig.PigServer$Graph.parseQuery(PigServer.java:1819)
>   at org.apache.pig.PigServer$Graph.access$000(PigServer.java:1527)
>   at org.apache.pig.PigServer.parseAndBuild(PigServer.java:460)
>   at org.apache.pig.PigServer.executeBatch(PigServer.java:485)
>   at org.apache.pig.PigServer.executeBatch(PigServer.java:471)
>   at 
> org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:172)
>   at 
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:235)
>   at 
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:206)
>   at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81)
>   at org.apache.pig.Main.run(Main.java:501)
>   at org.apache.pig.PigRunner.run(PigRunner.java:49)
>   at org.apache.oozie.action.hadoop.PigMain.runPigJob(PigMain.java:290)
>   at org.apache.oozie.action.hadoop.PigMain.run(PigMain.java:233)
>   at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:60)
>   at org.apache.oozie.action.hadoop.PigMain.main(PigMain.java:73)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.lang.reflect.Method.invoke(Method.java:497)
>   at 
> org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:232)
>   at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
>   at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:453)
>   at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
>   at 
> org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runSubtask(LocalContainerLauncher.java:380)
>   at 
> org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.runTask(LocalContainerLauncher.java:301)
>   at 
> org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler.access$200(LocalContainerLauncher.java:187)
>   at 
> org.apache.hadoop.mapred.LocalContainerLauncher$EventHandler$1.run(LocalContainerLauncher.java:230)
>   at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>   at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>   at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>   at java.lang.Thread.run(Thread.java:745)
> Caused by: 
>  pig script failed to validate: 
> org.apache.pig.backend.executionengine.ExecException: ERROR 1070: Could not 
> resolve org.apache.hive.hcatalog.pig.HCatLoader using imports: [, java.lang., 
> org.apache.pig.builtin., org.apache.pig.impl.builtin.]
>   at 
> org.apache.pig.parser.LogicalPlanBuilder.validateFuncSpec(LogicalPlanBuilder.java:1339)
>   at 
> org.apache.pig.parser.LogicalPlanBuilder.buildFuncSpec(LogicalPlanBuilder.java:1324)
>   at 
> org.apache.pig.parser.LogicalPlanGenerator.func_clause(LogicalPlanGenerator.java:5184)
>   at 
> org.apache.pig.parser.LogicalPlanGenerator.load_clause(LogicalPlanGenerator.java:3515)
>   at 
> org.apache.pig.parser.LogicalPlanGenerator.op_clause(LogicalPlanGenerator.java:1625)
>   at 
>

Jenkins build is back to normal : oozie-trunk-find-patches-available #136764

2016-10-18 Thread Apache Jenkins Server

See

Build failed in Jenkins: oozie-trunk-find-patches-available #136763

2016-10-18 Thread Apache Jenkins Server

See 

--
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on H1 (yahoo-not-h2 Hadoop Mapreduce Hdfs Pig) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url 
 > https://git-wip-us.apache.org/repos/asf/oozie.git # timeout=10
Fetching upstream changes from https://git-wip-us.apache.org/repos/asf/oozie.git
 > git --version # timeout=10
 > git -c core.askpass=true fetch --tags --progress 
 > https://git-wip-us.apache.org/repos/asf/oozie.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
Checking out Revision bd54452808335cbadc48d4aacd0bd23374bed928 
(refs/remotes/origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f bd54452808335cbadc48d4aacd0bd23374bed928
 > git rev-list bd54452808335cbadc48d4aacd0bd23374bed928 # timeout=10
[oozie-trunk-find-patches-available] $ /bin/bash 
/tmp/hudson8525624149477816048.sh
mkdir: cannot create directory 
':
 File exists
  % Total% Received % Xferd  Average Speed   TimeTime Time  Current
 Dload  Upload   Total   SpentLeft  Speed

  0 00 00 0  0  0 --:--:-- --:--:-- --:--:-- 0
  0 00 00 0  0  0 --:--:-- --:--:-- --:--:-- 0
100  264k0  264k0 0   243k  0 --:--:--  0:00:01 --:--:--  243k
100  544k0  544k0 0   267k  0 --:--:--  0:00:02 --:--:--  267k
100  808k0  808k0 0   241k  0 --:--:--  0:00:03 --:--:--  241k
100  912k0  912k0 0   244k  0 --:--:--  0:00:03 --:--:--  244k
curl: (18) transfer closed with outstanding read data remaining
Could not retrieve available patches from JIRA
Build step 'Execute shell' marked build as failure

[jira] [Updated] (OOZIE-2712) Merge Spark opts with two possible options

2016-10-18 Thread Peter Cseh (JIRA)


 [ 
https://issues.apache.org/jira/browse/OOZIE-2712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Cseh updated OOZIE-2712:
--
Attachment: OOZIE-2712.001.patch

Attaching the first version to fix this. 
It simplifies the code at some places, but I really don't like the number of 
HashMaps involved.
I will probably work refactor this a bit soon. 
Until then, [~satishsaley], [~abhishekbafna], [~andras.piros], [~pbacsko], 
[~asasvari], what do you think about the direction?

> Merge Spark opts with two possible options 
> ---
>
> Key: OOZIE-2712
> URL: https://issues.apache.org/jira/browse/OOZIE-2712
> Project: Oozie
>  Issue Type: Bug
>Reporter: Peter Cseh
>Assignee: Peter Cseh
> Attachments: OOZIE-2712.001.patch
>
>
> Issues like OOZIE-2658 can happen with more properties.
> || --conf ||  overwritten by ||
> |spark.driver.memory | --driver-memory |
> |spark.driver.extraJavaOptions | --driver-java-options|
> |spark.driver.extraLibraryPath|--driver-library-path |
> |spark.executor.instances|--num-executors|
> We should make sure that one is converted to the other (the current pattern 
> is to use --conf versions of these) so we don't run into issues where the 
> log4j properties are overwritten. (OOZIE-2705 can be affected by this)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Jenkins build is back to normal : oozie-trunk-find-patches-available #136756

2016-10-18 Thread Apache Jenkins Server

See

Build failed in Jenkins: oozie-trunk-find-patches-available #136755

2016-10-18 Thread Apache Jenkins Server

See 

--
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on H1 (yahoo-not-h2 Hadoop Mapreduce Hdfs Pig) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url 
 > https://git-wip-us.apache.org/repos/asf/oozie.git # timeout=10
Fetching upstream changes from https://git-wip-us.apache.org/repos/asf/oozie.git
 > git --version # timeout=10
 > git -c core.askpass=true fetch --tags --progress 
 > https://git-wip-us.apache.org/repos/asf/oozie.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
Checking out Revision bd54452808335cbadc48d4aacd0bd23374bed928 
(refs/remotes/origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f bd54452808335cbadc48d4aacd0bd23374bed928
 > git rev-list bd54452808335cbadc48d4aacd0bd23374bed928 # timeout=10
[oozie-trunk-find-patches-available] $ /bin/bash 
/tmp/hudson636866137080227.sh
mkdir: cannot create directory 
':
 File exists
  % Total% Received % Xferd  Average Speed   TimeTime Time  Current
 Dload  Upload   Total   SpentLeft  Speed

  0 00 00 0  0  0 --:--:-- --:--:-- --:--:-- 0
  0 00 00 0  0  0 --:--:-- --:--:-- --:--:-- 0
curl: (52) Empty reply from server
Could not retrieve available patches from JIRA
Build step 'Execute shell' marked build as failure

Build failed in Jenkins: oozie-trunk-find-patches-available #136754

2016-10-18 Thread Apache Jenkins Server

See 

--
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on H1 (yahoo-not-h2 Hadoop Mapreduce Hdfs Pig) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url 
 > https://git-wip-us.apache.org/repos/asf/oozie.git # timeout=10
Fetching upstream changes from https://git-wip-us.apache.org/repos/asf/oozie.git
 > git --version # timeout=10
 > git -c core.askpass=true fetch --tags --progress 
 > https://git-wip-us.apache.org/repos/asf/oozie.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
Checking out Revision bd54452808335cbadc48d4aacd0bd23374bed928 
(refs/remotes/origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f bd54452808335cbadc48d4aacd0bd23374bed928
 > git rev-list bd54452808335cbadc48d4aacd0bd23374bed928 # timeout=10
[oozie-trunk-find-patches-available] $ /bin/bash 
/tmp/hudson1046302321195983081.sh
mkdir: cannot create directory 
':
 File exists
  % Total% Received % Xferd  Average Speed   TimeTime Time  Current
 Dload  Upload   Total   SpentLeft  Speed

  0 00 00 0  0  0 --:--:-- --:--:-- --:--:-- 0
100  113k0  113k0 0   146k  0 --:--:-- --:--:-- --:--:--  146k
100  464k0  464k0 0   259k  0 --:--:--  0:00:01 --:--:--  259k
100  736k0  736k0 0   266k  0 --:--:--  0:00:02 --:--:--  266k
100  851k0  851k0 0   255k  0 --:--:--  0:00:03 --:--:--  255k
curl: (18) transfer closed with outstanding read data remaining
Could not retrieve available patches from JIRA
Build step 'Execute shell' marked build as failure

Build failed in Jenkins: oozie-trunk-find-patches-available #136749

2016-10-18 Thread Apache Jenkins Server

See 

--
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on H1 (yahoo-not-h2 Hadoop Mapreduce Hdfs Pig) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url 
 > https://git-wip-us.apache.org/repos/asf/oozie.git # timeout=10
Fetching upstream changes from https://git-wip-us.apache.org/repos/asf/oozie.git
 > git --version # timeout=10
 > git -c core.askpass=true fetch --tags --progress 
 > https://git-wip-us.apache.org/repos/asf/oozie.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
Checking out Revision bd54452808335cbadc48d4aacd0bd23374bed928 
(refs/remotes/origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f bd54452808335cbadc48d4aacd0bd23374bed928
 > git rev-list bd54452808335cbadc48d4aacd0bd23374bed928 # timeout=10
[oozie-trunk-find-patches-available] $ /bin/bash 
/tmp/hudson4251991076250204946.sh
mkdir: cannot create directory 
':
 File exists
  % Total% Received % Xferd  Average Speed   TimeTime Time  Current
 Dload  Upload   Total   SpentLeft  Speed

  0 00 00 0  0  0 --:--:-- --:--:-- --:--:-- 0
100 353880 353880 0  65628  0 --:--:-- --:--:-- --:--:-- 65533
100  368k0  368k0 0   244k  0 --:--:--  0:00:01 --:--:--  244k
100  482k0  482k0 0   194k  0 --:--:--  0:00:02 --:--:--  194k
100  675k0  675k0 0   200k  0 --:--:--  0:00:03 --:--:--  200k
curl: (18) transfer closed with outstanding read data remaining
Could not retrieve available patches from JIRA
Build step 'Execute shell' marked build as failure

Build failed in Jenkins: oozie-trunk-precommit-build #3397

2016-10-18 Thread Apache Jenkins Server

See 

--
[...truncated 8141 lines...]
[INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ oozie-tools 
---
[INFO] Nothing to compile - all classes are up to date
[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ 
oozie-tools ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 11 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ 
oozie-tools ---
[INFO] Nothing to compile - all classes are up to date
[INFO] 
[INFO] --- maven-surefire-plugin:2.12.2:test (default-test) @ oozie-tools ---
[INFO] Tests are skipped.
[INFO] 
[INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ oozie-tools ---
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-site-plugin:2.0-beta-6:attach-descriptor (attach-descriptor) @ 
oozie-tools ---
[INFO] 
[INFO] --- maven-assembly-plugin:2.2.1:single (default-cli) @ oozie-tools ---
[INFO] Reading assembly descriptor: ../src/main/assemblies/tools.xml
[WARNING] The following patterns were never triggered in this artifact 
exclusion filter:
o  '*:*:pom:*'

[INFO] Copying files to 

[WARNING] Assembly file: 

 is not a regular file (it may be a directory). It cannot be attached to the 
project build for installation or deployment.
[INFO] 
[INFO] 
[INFO] Building Apache Oozie MiniOozie 4.4.0-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ oozie-mini ---
[INFO] 
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ 
oozie-mini ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ oozie-mini 
---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ 
oozie-mini ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 3 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ 
oozie-mini ---
[INFO] Nothing to compile - all classes are up to date
[INFO] 
[INFO] --- maven-surefire-plugin:2.12.2:test (default-test) @ oozie-mini ---
[INFO] Tests are skipped.
[INFO] 
[INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ oozie-mini ---
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-site-plugin:2.0-beta-6:attach-descriptor (attach-descriptor) @ 
oozie-mini ---
[INFO] 
[INFO] --- maven-assembly-plugin:2.2.1:single (default-cli) @ oozie-mini ---
[INFO] Reading assembly descriptor: src/main/assemblies/empty.xml
[INFO] 
[INFO] 
[INFO] Building Apache Oozie Distro 4.4.0-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ oozie-distro 
---
[INFO] 
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ 
oozie-distro ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ oozie-distro 
---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ 
oozie-distro ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ 
oozie-distro ---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-surefire-plugin:2.12.2:test (default-test) @ oozie-distro ---

[jira] [Commented] (OOZIE-2705) Oozie Spark action ignores spark.executor.extraJavaOptions and spark.driver.extraJavaOptions

2016-10-18 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-2705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15585147#comment-15585147
 ] 

Hadoop QA commented on OOZIE-2705:
--

Testing JIRA OOZIE-2705

Cleaning local git workspace



{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than 
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT 
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc 
warnings
{color:green}+1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:green}+1{color} the patch does not seem to introduce new javac 
warnings
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA 
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:green}+1 TESTS{color}
.Tests run: 1815
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch 


{color:red}*-1 Overall result, please check the reported -1(s)*{color}


The full output of the test-patch run is available at

.   https://builds.apache.org/job/oozie-trunk-precommit-build/3396/

> Oozie Spark action ignores spark.executor.extraJavaOptions and 
> spark.driver.extraJavaOptions
> 
>
> Key: OOZIE-2705
> URL: https://issues.apache.org/jira/browse/OOZIE-2705
> Project: Oozie
>  Issue Type: Bug
>  Components: action
>Affects Versions: 4.3.0
> Environment: CentOS 6.6
>Reporter: Prabhu Joseph
>Assignee: Peter Cseh
>Priority: Blocker
> Fix For: 4.3.0
>
> Attachments: OOZIE-2705.001.patch, OOZIE-2705.002.patch
>
>
> Oozie Spark Action with spark-opts "spark.executor.extraJavaOptions and 
> spark.driver.extraJavaOptions" are ignored.
> --executor-memory 1G --driver-java-options "-verbose -Xms750m 
> -XX:+PrintGCDetails -XX:+PrintGCTimeStamps" --conf 
> "spark.executor.extraJavaOptions=-XX:+PrintGCDetails 
> -XX:+PrintGCTimeStamps" 
> Suspect the OOZIE-2503 fix is overriding them. The configs are reflected 
> after removing the fix of OOZIE-2503.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Build failed in Jenkins: oozie-trunk-precommit-build #3396

2016-10-18 Thread Apache Jenkins Server

See 

--
[...truncated 5867 lines...]
[INFO] Nothing to compile - all classes are up to date
[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ 
oozie-tools ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 11 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ 
oozie-tools ---
[INFO] Nothing to compile - all classes are up to date
[INFO] 
[INFO] --- maven-surefire-plugin:2.12.2:test (default-test) @ oozie-tools ---
[INFO] Tests are skipped.
[INFO] 
[INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ oozie-tools ---
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-site-plugin:2.0-beta-6:attach-descriptor (attach-descriptor) @ 
oozie-tools ---
[INFO] 
[INFO] --- maven-assembly-plugin:2.2.1:single (default-cli) @ oozie-tools ---
[INFO] Reading assembly descriptor: ../src/main/assemblies/tools.xml
[WARNING] The following patterns were never triggered in this artifact 
exclusion filter:
o  '*:*:pom:*'

[INFO] Copying files to 

[WARNING] Assembly file: 

 is not a regular file (it may be a directory). It cannot be attached to the 
project build for installation or deployment.
[INFO] 
[INFO] 
[INFO] Building Apache Oozie MiniOozie 4.4.0-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ oozie-mini ---
[INFO] 
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ 
oozie-mini ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ oozie-mini 
---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ 
oozie-mini ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 3 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ 
oozie-mini ---
[INFO] Nothing to compile - all classes are up to date
[INFO] 
[INFO] --- maven-surefire-plugin:2.12.2:test (default-test) @ oozie-mini ---
[INFO] Tests are skipped.
[INFO] 
[INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ oozie-mini ---
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-site-plugin:2.0-beta-6:attach-descriptor (attach-descriptor) @ 
oozie-mini ---
[INFO] 
[INFO] --- maven-assembly-plugin:2.2.1:single (default-cli) @ oozie-mini ---
[INFO] Reading assembly descriptor: src/main/assemblies/empty.xml
[INFO] 
[INFO] 
[INFO] Building Apache Oozie Distro 4.4.0-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ oozie-distro 
---
[INFO] 
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ 
oozie-distro ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ oozie-distro 
---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ 
oozie-distro ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ 
oozie-distro ---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-surefire-plugin:2.12.2:test (default-test) @ oozie-distro ---
[INFO] Tests are skipped.
[INFO] 
[INFO] --- maven-jar-plugin:2.3.1:jar (default-jar)

[jira] [Commented] (OOZIE-2621) Use hive-exec--core instead of hive-exec in oozie-core

2016-10-18 Thread Attila Sasvari (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-2621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15585116#comment-15585116
 ] 

Attila Sasvari commented on OOZIE-2621:
---

{{hive-exec-core}} is available since {{Hive 1.0.0}} that requires 
{{hadoop-2}}. That's is why it does not compile with {{hadoop-1}} profile.

> Use hive-exec--core instead of hive-exec in oozie-core
> ---
>
> Key: OOZIE-2621
> URL: https://issues.apache.org/jira/browse/OOZIE-2621
> Project: Oozie
>  Issue Type: Bug
>Reporter: Peter Cseh
>Assignee: Peter Cseh
> Attachments: OOZIE-2621.001.patch, OOZIE-2621.002.patch, 
> OOZIE-2621.003.patch
>
>
> hive-exec.jar contains the dependencies of Hive and they can cause issues on 
> the classpath: HIVE-1640, HIVE-5733
> We've ran into and issue when Oozie won't start because of different Jackson 
> versions.
> We should use hive-exec-core.jar (HIVE-7423) instead of hive-exec.jar which 
> is a thin version of hive-exec.jar 
> Pig is already using hive-exec-core: 
> https://github.com/apache/pig/blob/spark/ivy.xml#L423



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (OOZIE-2621) Use hive-exec--core instead of hive-exec in oozie-core

2016-10-18 Thread Peter Cseh (JIRA)


 [ 
https://issues.apache.org/jira/browse/OOZIE-2621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Cseh updated OOZIE-2621:
--
Attachment: OOZIE-2621.003.patch

Thanks for pointing it out [~abhishekbafna]!
I've introduced a {{hive.classifier}} which is empty for hadoop-1 as there is 
no hive-exec.jar with core classifier in hive 0.13.
Attaching fix

> Use hive-exec--core instead of hive-exec in oozie-core
> ---
>
> Key: OOZIE-2621
> URL: https://issues.apache.org/jira/browse/OOZIE-2621
> Project: Oozie
>  Issue Type: Bug
>Reporter: Peter Cseh
>Assignee: Peter Cseh
> Attachments: OOZIE-2621.001.patch, OOZIE-2621.002.patch, 
> OOZIE-2621.003.patch
>
>
> hive-exec.jar contains the dependencies of Hive and they can cause issues on 
> the classpath: HIVE-1640, HIVE-5733
> We've ran into and issue when Oozie won't start because of different Jackson 
> versions.
> We should use hive-exec-core.jar (HIVE-7423) instead of hive-exec.jar which 
> is a thin version of hive-exec.jar 
> Pig is already using hive-exec-core: 
> https://github.com/apache/pig/blob/spark/ivy.xml#L423



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (OOZIE-2621) Use hive-exec--core instead of hive-exec in oozie-core

2016-10-18 Thread Abhishek Bafna (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-2621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15584940#comment-15584940
 ] 

Abhishek Bafna commented on OOZIE-2621:
---

[~gezapeti] I am also not able to re-produce the issue. I guess, we can submit 
the Jenkins job again or submit the same patch again. Thanks.

> Use hive-exec--core instead of hive-exec in oozie-core
> ---
>
> Key: OOZIE-2621
> URL: https://issues.apache.org/jira/browse/OOZIE-2621
> Project: Oozie
>  Issue Type: Bug
>Reporter: Peter Cseh
>Assignee: Peter Cseh
> Attachments: OOZIE-2621.001.patch, OOZIE-2621.002.patch
>
>
> hive-exec.jar contains the dependencies of Hive and they can cause issues on 
> the classpath: HIVE-1640, HIVE-5733
> We've ran into and issue when Oozie won't start because of different Jackson 
> versions.
> We should use hive-exec-core.jar (HIVE-7423) instead of hive-exec.jar which 
> is a thin version of hive-exec.jar 
> Pig is already using hive-exec-core: 
> https://github.com/apache/pig/blob/spark/ivy.xml#L423



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (OOZIE-2705) Oozie Spark action ignores spark.executor.extraJavaOptions and spark.driver.extraJavaOptions

2016-10-18 Thread Peter Cseh (JIRA)


 [ 
https://issues.apache.org/jira/browse/OOZIE-2705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Cseh updated OOZIE-2705:
--
Attachment: OOZIE-2705.002.patch

Thanks for the review [~rkanter]!
1) fixed
2) I think we should allow overwriting these settings. I've added a warning 
when this happens.

> Oozie Spark action ignores spark.executor.extraJavaOptions and 
> spark.driver.extraJavaOptions
> 
>
> Key: OOZIE-2705
> URL: https://issues.apache.org/jira/browse/OOZIE-2705
> Project: Oozie
>  Issue Type: Bug
>  Components: action
>Affects Versions: 4.3.0
> Environment: CentOS 6.6
>Reporter: Prabhu Joseph
>Assignee: Peter Cseh
>Priority: Blocker
> Fix For: 4.3.0
>
> Attachments: OOZIE-2705.001.patch, OOZIE-2705.002.patch
>
>
> Oozie Spark Action with spark-opts "spark.executor.extraJavaOptions and 
> spark.driver.extraJavaOptions" are ignored.
> --executor-memory 1G --driver-java-options "-verbose -Xms750m 
> -XX:+PrintGCDetails -XX:+PrintGCTimeStamps" --conf 
> "spark.executor.extraJavaOptions=-XX:+PrintGCDetails 
> -XX:+PrintGCTimeStamps" 
> Suspect the OOZIE-2503 fix is overriding them. The configs are reflected 
> after removing the fix of OOZIE-2503.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (OOZIE-2621) Use hive-exec--core instead of hive-exec in oozie-core

2016-10-18 Thread Peter Cseh (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-2621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15584873#comment-15584873
 ] 

Peter Cseh commented on OOZIE-2621:
---

Thank you for the information [~rkanter]!
I can't reproduce the timeout error in the report on my environment.
[~pbacsko], [~andras.piros], [~asasvari] can one of you take a look at this?


> Use hive-exec--core instead of hive-exec in oozie-core
> ---
>
> Key: OOZIE-2621
> URL: https://issues.apache.org/jira/browse/OOZIE-2621
> Project: Oozie
>  Issue Type: Bug
>Reporter: Peter Cseh
>Assignee: Peter Cseh
> Attachments: OOZIE-2621.001.patch, OOZIE-2621.002.patch
>
>
> hive-exec.jar contains the dependencies of Hive and they can cause issues on 
> the classpath: HIVE-1640, HIVE-5733
> We've ran into and issue when Oozie won't start because of different Jackson 
> versions.
> We should use hive-exec-core.jar (HIVE-7423) instead of hive-exec.jar which 
> is a thin version of hive-exec.jar 
> Pig is already using hive-exec-core: 
> https://github.com/apache/pig/blob/spark/ivy.xml#L423



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (OOZIE-1986) Add FindBugs report to pre-commit build

2016-10-18 Thread Andras Piros (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15584767#comment-15584767
 ] 

Andras Piros commented on OOZIE-1986:
-

It still doesn't come because the patch, and thus 
{{bin/test-patch-11-findbugs-diff}}, is still not present in the repository. It 
will be run automatically once it's part of the sources.

See {{bin/test.patch#getAllTasks()}}.

> Add FindBugs report to pre-commit build
> ---
>
> Key: OOZIE-1986
> URL: https://issues.apache.org/jira/browse/OOZIE-1986
> Project: Oozie
>  Issue Type: Bug
>  Components: tests
>Reporter: Robert Kanter
>Assignee: Andras Piros
> Fix For: 5.0.0
>
> Attachments: OOZIE-1986.001.patch, OOZIE-1986.002.patch, 
> OOZIE-1986.003.patch, OOZIE-1986.004.patch, OOZIE-1986.005.patch, 
> OOZIE-1986.006.patch, OOZIE-1986.007.patch, OOZIE-1986.008.patch, 
> OOZIE-1986.009.patch, OOZIE-1986.010.patch, summary.txt
>
>
> Now that we have OOZIE-1793, it will be really useful to have the pre-commit 
> build generate a findbugs report.  It should probably before and after the 
> patch and only complain it there are more after.  And it should link to the 
> report.  Ideally, this would do some kind of diff (like Hadoop does) so it's 
> easy to identify the new findbugs items.
> You can generate the findbugs reports by running:
> {noformat}
> mvn verify -DskipTests
> {noformat}
> This also runs checkstyle



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] Subscription: Oozie Patch Available

2016-10-18 Thread jira

Issue Subscription
Filter: Oozie Patch Available (86 issues)

Subscriber: ooziedaily

Key Summary
OOZIE-2619  Make  Hive action defaults to match hive defaults when running from 
command line
https://issues-test.apache.org/jira/browse/OOZIE-2619
OOZIE-2618  Include hive-common in hive-beeline as compile component for 
hive-server2 (hive2 action)
https://issues-test.apache.org/jira/browse/OOZIE-2618
OOZIE-2617  Read properties files in action configurations
https://issues-test.apache.org/jira/browse/OOZIE-2617
OOZIE-2616  Add Tez profile for Hive and Pig sharelibs
https://issues-test.apache.org/jira/browse/OOZIE-2616
OOZIE-2606  Set spark.yarn.jars to fix Spark 2.0 with Oozie
https://issues-test.apache.org/jira/browse/OOZIE-2606
OOZIE-2589  CompletedActionXCommand priority param is of no effect
https://issues-test.apache.org/jira/browse/OOZIE-2589
OOZIE-2588  Support getting credentials for same cluster hcat when credentials 
config is empty
https://issues-test.apache.org/jira/browse/OOZIE-2588
OOZIE-2585  Disable or remove test case 
TestPartitionDependencyManagerEhcache.testMemoryUsageAndSpeedOverflowToDisk and 
testMemoryUsageAndSpeed
https://issues-test.apache.org/jira/browse/OOZIE-2585
OOZIE-2584  Eliminate Thread.sleep() calls in TestMemoryLocks
https://issues-test.apache.org/jira/browse/OOZIE-2584
OOZIE-2583  oozie throws EL Exception when reference variable name containing 
dot
https://issues-test.apache.org/jira/browse/OOZIE-2583
OOZIE-2582  Populating external child Ids for action failures
https://issues-test.apache.org/jira/browse/OOZIE-2582
OOZIE-2573  dataset url  which contains spaces can not be handled rightly
https://issues-test.apache.org/jira/browse/OOZIE-2573
OOZIE-2572  SLA DURATION miss not shown when job is running for longer than 
expected time
https://issues-test.apache.org/jira/browse/OOZIE-2572
OOZIE-2571  Add scala.binary.version Maven property so that Scala 2.11 can be 
used
https://issues-test.apache.org/jira/browse/OOZIE-2571
OOZIE-2569  Adding yarn-site, core-site, hdfs-site and mapred-site into spark 
launcher 
https://issues-test.apache.org/jira/browse/OOZIE-2569
OOZIE-2568  SSH  action pretends to retry automaticly when it failed
https://issues-test.apache.org/jira/browse/OOZIE-2568
OOZIE-2564  Create new log4j config for unit tests so that logged messages 
contain threads
https://issues-test.apache.org/jira/browse/OOZIE-2564
OOZIE-2552  Update ActiveMQ version for security and other fixes
https://issues-test.apache.org/jira/browse/OOZIE-2552
OOZIE-2538  Update HttpClient versions to close security vulnerabilities
https://issues-test.apache.org/jira/browse/OOZIE-2538
OOZIE-2534  Versioned action libs (similar to how SharedLibs works)
https://issues-test.apache.org/jira/browse/OOZIE-2534
OOZIE-2530  Remove jline from parent and sharelib pig pom
https://issues-test.apache.org/jira/browse/OOZIE-2530
OOZIE-2528  Print out environment variables in LauncherMapper
https://issues-test.apache.org/jira/browse/OOZIE-2528
OOZIE-2521  Filter options are case sensitive for jobtye=bundle
https://issues-test.apache.org/jira/browse/OOZIE-2521
OOZIE-2518  Oozie is creating many files and directories in /tmp per day
https://issues-test.apache.org/jira/browse/OOZIE-2518
OOZIE-2517  Add support for startCreatedTime and endCreatedTime filters for 
coord and bundles
https://issues-test.apache.org/jira/browse/OOZIE-2517
OOZIE-2513  log.scan.duration should not be used for error and audit logs
https://issues-test.apache.org/jira/browse/OOZIE-2513
OOZIE-2512  ShareLibservice returns incorrect path for jar
https://issues-test.apache.org/jira/browse/OOZIE-2512
OOZIE-2508  Documentation change for Coord action rerun [OOZIE-1735]
https://issues-test.apache.org/jira/browse/OOZIE-2508
OOZIE-2501  ZK reentrant lock doesn't work for few cases
https://issues-test.apache.org/jira/browse/OOZIE-2501
OOZIE-2500  -DtestJarSimple option mentioned in minioozie doc does not work
https://issues-test.apache.org/jira/browse/OOZIE-2500
OOZIE-2499  map-reduce launcher does not need distributed files, archives 
except  jar of input/outputformat class
https://issues-test.apache.org/jira/browse/OOZIE-2499
OOZIE-2498  Oozie CallerId configuration for downstream components 
https://issues-test.apache.org/jira/browse/OOZIE-2498
OOZIE-2495  change action status from  ErrorType.NON_TRANSIENT to TRANSIENT 
when SSH action occurs AUTH_FAILED occasionally
https://issues-test.apache.org/jira/browse/OOZIE-2495
OOZIE-2491  oozie acl cannot specify group,it does`t work
https://issues-test.apache.org/jira/browse/OOZIE-2491

[jira] Subscription: Oozie Patch Available

2016-10-18 Thread jira

Issue Subscription
Filter: Oozie Patch Available (80 issues)

Subscriber: ooziedaily

Key Summary
OOZIE-2710  Oozie HCatalog example workflow fails
https://issues.apache.org/jira/browse/OOZIE-2710
OOZIE-2709  Log the substituted pig script by expanding macros
https://issues.apache.org/jira/browse/OOZIE-2709
OOZIE-2705  Oozie Spark action ignores spark.executor.extraJavaOptions and 
spark.driver.extraJavaOptions
https://issues.apache.org/jira/browse/OOZIE-2705
OOZIE-2694  Add logging for FsActionExecutor 
https://issues.apache.org/jira/browse/OOZIE-2694
OOZIE-2693  SimpleHCatDependencyCache.removeMissingDependency can throw NPE
https://issues.apache.org/jira/browse/OOZIE-2693
OOZIE-2692  Oozie job submit doesn't report error message to user if there is 
any issue with job conf
https://issues.apache.org/jira/browse/OOZIE-2692
OOZIE-2691  Show workflow action retry count to UI
https://issues.apache.org/jira/browse/OOZIE-2691
OOZIE-2690  OOZIE NPE while executing kill()
https://issues.apache.org/jira/browse/OOZIE-2690
OOZIE-2684  Bad database schema error for WF_ACTIONS table
https://issues.apache.org/jira/browse/OOZIE-2684
OOZIE-2674  Improve oozie commads documentation
https://issues.apache.org/jira/browse/OOZIE-2674
OOZIE-2670  Upgrade Hbase to 1.2
https://issues.apache.org/jira/browse/OOZIE-2670
OOZIE-2668  Status update and recovery problems when coord action and its 
children not in sync
https://issues.apache.org/jira/browse/OOZIE-2668
OOZIE-2666  Support embedding Jetty into Oozie
https://issues.apache.org/jira/browse/OOZIE-2666
OOZIE-2662  DB migration fails if DB is too big
https://issues.apache.org/jira/browse/OOZIE-2662
OOZIE-2654  Zookeeper dependent services should not depend on Connectionstate 
to be valid before cleaning up
https://issues.apache.org/jira/browse/OOZIE-2654
OOZIE-2652  Skip trash while deleting hive table partition
https://issues.apache.org/jira/browse/OOZIE-2652
OOZIE-2650  Retry coord start on database exceptions
https://issues.apache.org/jira/browse/OOZIE-2650
OOZIE-2644  Skip queuing Notification Commands when there's nothing to notify
https://issues.apache.org/jira/browse/OOZIE-2644
OOZIE-2641  rerunning an oozie coordinator job stucks on waiting
https://issues.apache.org/jira/browse/OOZIE-2641
OOZIE-2630  Oozie Coordinator EL Functions to get first day of the week/month
https://issues.apache.org/jira/browse/OOZIE-2630
OOZIE-2621  Use hive-exec--core instead of hive-exec in oozie-core
https://issues.apache.org/jira/browse/OOZIE-2621
OOZIE-2619  Make  Hive action defaults to match hive defaults when running from 
command line
https://issues.apache.org/jira/browse/OOZIE-2619
OOZIE-2618  Include hive-common in hive-beeline as compile component for 
hive-server2 (hive2 action)
https://issues.apache.org/jira/browse/OOZIE-2618
OOZIE-2616  Add Tez profile for Hive and Pig sharelibs
https://issues.apache.org/jira/browse/OOZIE-2616
OOZIE-2585  Disable or remove test case 
TestPartitionDependencyManagerEhcache.testMemoryUsageAndSpeedOverflowToDisk and 
testMemoryUsageAndSpeed
https://issues.apache.org/jira/browse/OOZIE-2585
OOZIE-2573  dataset url  which contains spaces can not be handled rightly
https://issues.apache.org/jira/browse/OOZIE-2573
OOZIE-2568  SSH  action pretends to retry automaticly when it failed
https://issues.apache.org/jira/browse/OOZIE-2568
OOZIE-2564  Create new log4j config for unit tests so that logged messages 
contain threads
https://issues.apache.org/jira/browse/OOZIE-2564
OOZIE-2534  Versioned action libs (similar to how SharedLibs works)
https://issues.apache.org/jira/browse/OOZIE-2534
OOZIE-2528  Print out environment variables in LauncherMapper
https://issues.apache.org/jira/browse/OOZIE-2528
OOZIE-2518  Oozie is creating many files and directories in /tmp per day
https://issues.apache.org/jira/browse/OOZIE-2518
OOZIE-2513  log.scan.duration should not be used for error and audit logs
https://issues.apache.org/jira/browse/OOZIE-2513
OOZIE-2499  map-reduce launcher does not need distributed files, archives 
except  jar of input/outputformat class
https://issues.apache.org/jira/browse/OOZIE-2499
OOZIE-2495  change action status from  ErrorType.NON_TRANSIENT to TRANSIENT 
when SSH action occurs AUTH_FAILED occasionally
https://issues.apache.org/jira/browse/OOZIE-2495
OOZIE-2473  Connection pool for SMTP connection
https://issues.apache.org/jira/browse/OOZIE-2473
OOZIE-2461  Workflow, Coordinator and Bundle job querying should have last 
modified filter
https://issues.apache.org/jira/browse/OOZIE-2461
OOZIE-2457  Oozie log

Jenkins build is back to normal : oozie-trunk-find-patches-available #136815

Build failed in Jenkins: oozie-trunk-find-patches-available #136814

[jira] [Commented] (OOZIE-1986) Add FindBugs report to pre-commit build

[jira] [Commented] (OOZIE-2705) Oozie Spark action ignores spark.executor.extraJavaOptions and spark.driver.extraJavaOptions

[jira] [Commented] (OOZIE-2666) Support embedding Jetty into Oozie

Re: Review Request 52227: OOZIE-2225 Add wild card filter for gathering jobs

[jira] [Commented] (OOZIE-2710) Oozie HCatalog example workflow fails

Jenkins build is back to normal : oozie-trunk-find-patches-available #136764

Build failed in Jenkins: oozie-trunk-find-patches-available #136763

[jira] [Updated] (OOZIE-2712) Merge Spark opts with two possible options

Jenkins build is back to normal : oozie-trunk-find-patches-available #136756

Build failed in Jenkins: oozie-trunk-find-patches-available #136755

Build failed in Jenkins: oozie-trunk-find-patches-available #136754

Build failed in Jenkins: oozie-trunk-find-patches-available #136749

Build failed in Jenkins: oozie-trunk-precommit-build #3397

[jira] [Commented] (OOZIE-2705) Oozie Spark action ignores spark.executor.extraJavaOptions and spark.driver.extraJavaOptions

Build failed in Jenkins: oozie-trunk-precommit-build #3396

[jira] [Commented] (OOZIE-2621) Use hive-exec--core instead of hive-exec in oozie-core

[jira] [Updated] (OOZIE-2621) Use hive-exec--core instead of hive-exec in oozie-core

[jira] [Commented] (OOZIE-2621) Use hive-exec--core instead of hive-exec in oozie-core

[jira] [Updated] (OOZIE-2705) Oozie Spark action ignores spark.executor.extraJavaOptions and spark.driver.extraJavaOptions

[jira] [Commented] (OOZIE-2621) Use hive-exec--core instead of hive-exec in oozie-core

[jira] [Commented] (OOZIE-1986) Add FindBugs report to pre-commit build

[jira] Subscription: Oozie Patch Available

[jira] Subscription: Oozie Patch Available

25 matches

Site Navigation

Mail list logo

Footer information