date:20160818

Jenkins build is back to normal : oozie-trunk-find-patches-available #130150

2016-08-18 Thread Apache Jenkins Server

See

Build failed in Jenkins: oozie-trunk-find-patches-available #130149

2016-08-18 Thread Apache Jenkins Server

See 

--
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on H1 (yahoo-not-h2 Hadoop Mapreduce Hdfs Pig) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url 
 > https://git-wip-us.apache.org/repos/asf/oozie.git # timeout=10
Fetching upstream changes from https://git-wip-us.apache.org/repos/asf/oozie.git
 > git --version # timeout=10
 > git -c core.askpass=true fetch --tags --progress 
 > https://git-wip-us.apache.org/repos/asf/oozie.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
Checking out Revision 1b46fd92f10c561d14839c5a53da12d3afb46bb8 
(refs/remotes/origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 1b46fd92f10c561d14839c5a53da12d3afb46bb8
 > git rev-list 1b46fd92f10c561d14839c5a53da12d3afb46bb8 # timeout=10
[oozie-trunk-find-patches-available] $ /bin/bash 
/tmp/hudson655853137769414263.sh
mkdir: cannot create directory 
':
 File exists
  % Total% Received % Xferd  Average Speed   TimeTime Time  Current
 Dload  Upload   Total   SpentLeft  Speed

  0 00 00 0  0  0 --:--:-- --:--:-- --:--:-- 0
  0 00 00 0  0  0 --:--:-- --:--:-- --:--:-- 0
100  184k0  184k0 0   133k  0 --:--:--  0:00:01 --:--:--  133k
100  306k0  306k0 0   160k  0 --:--:--  0:00:01 --:--:--  160k
curl: (18) transfer closed with outstanding read data remaining
Could not retrieve available patches from JIRA
Build step 'Execute shell' marked build as failure

[jira] [Created] (OOZIE-2645) Drop Instrumentation in favor of Metrics

2016-08-18 Thread Robert Kanter (JIRA)

Robert Kanter created OOZIE-2645:


 Summary: Drop Instrumentation in favor of Metrics
 Key: OOZIE-2645
 URL: https://issues.apache.org/jira/browse/OOZIE-2645
 Project: Oozie
  Issue Type: Improvement
  Components: monitoring
Affects Versions: trunk
Reporter: Robert Kanter


OOZIE-1817 added the option to use DropWizard Metrics instead of our homegrown 
Instrumentation.  We left the Instrumentation as the default for compatibility; 
in Oozie 5, we should drop Instrumentation and only have Metrics.

We can also use this opportunity to clean up the code interface for Metrics, 
which currently has to conform to Instrumentation for pluggability.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (OOZIE-2644) Skip queuing Notification Commands when there's nothing to notify

2016-08-18 Thread Robert Kanter (JIRA)

Robert Kanter created OOZIE-2644:


 Summary: Skip queuing Notification Commands when there's nothing 
to notify
 Key: OOZIE-2644
 URL: https://issues.apache.org/jira/browse/OOZIE-2644
 Project: Oozie
  Issue Type: Improvement
Affects Versions: 3.1.3
Reporter: Robert Kanter
 Fix For: 4.4.0


When you use the 
[Workflow|https://oozie.apache.org/docs/4.2.0/WorkflowFunctionalSpec.html#a5_Workflow_Notifications]
 or 
[Coordinator|https://oozie.apache.org/docs/4.2.0/CoordinatorFunctionalSpec.html#a15._Coordinator_Notifications]
 Notification features, Oozie can end up queuing up a lot of 
{{WorkflowNotificationXCommand}} and {{CoordActionNotificationXCommand}}.  This 
happens even if there's no notification configured on the job (which I imagine 
is most of the time); in this case, the {{execute}} method simply does nothing. 
 This is wasteful and clogs the queue up.  

We should change the code so that it doesn't queue up one of these Commands 
unless there's actually a URL to notify.

It would also be nice if we could combine the code more between the two, but 
that might be tricky because of the parenting.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (OOZIE-2589) CompletedActionXCommand is hardcoded to wrong priority

2016-08-18 Thread Robert Kanter (JIRA)


 [ 
https://issues.apache.org/jira/browse/OOZIE-2589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Robert Kanter updated OOZIE-2589:
-
Assignee: Linflytang

> CompletedActionXCommand is hardcoded to wrong priority
> --
>
> Key: OOZIE-2589
> URL: https://issues.apache.org/jira/browse/OOZIE-2589
> Project: Oozie
>  Issue Type: Bug
>  Components: core
>Affects Versions: trunk
>Reporter: Linflytang
>Assignee: Linflytang
>  Labels: patch
> Fix For: 4.4.0
>
> Attachments: 0001-Fixed-CompletedActionXCommand-priority-param.patch
>
>
> CompletedActionXCommand priority param is hard coding with 1, but create the 
> action with 2 (HIGH_PRIORITY).
> patch:https://github.com/apache/oozie/pull/20/files



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (OOZIE-2589) CompletedActionXCommand is hardcoded to wrong priority

2016-08-18 Thread Robert Kanter (JIRA)


 [ 
https://issues.apache.org/jira/browse/OOZIE-2589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Robert Kanter updated OOZIE-2589:
-
Summary: CompletedActionXCommand is hardcoded to wrong priority  (was: 
CompletedActionXCommand priority param is of no effect)

> CompletedActionXCommand is hardcoded to wrong priority
> --
>
> Key: OOZIE-2589
> URL: https://issues.apache.org/jira/browse/OOZIE-2589
> Project: Oozie
>  Issue Type: Bug
>  Components: core
>Affects Versions: trunk
>Reporter: Linflytang
>  Labels: patch
> Fix For: 4.4.0
>
> Attachments: 0001-Fixed-CompletedActionXCommand-priority-param.patch
>
>
> CompletedActionXCommand priority param is hard coding with 1, but create the 
> action with 2 (HIGH_PRIORITY).
> patch:https://github.com/apache/oozie/pull/20/files



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (OOZIE-2589) CompletedActionXCommand priority param is of no effect

2016-08-18 Thread Robert Kanter (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-2589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426972#comment-15426972
 ] 

Robert Kanter commented on OOZIE-2589:
--

I looked into this some more.  This is actually a big problem because the 
callbacks can be delayed quite a while in a really really busy Oozie Server.  
The original priority was 2, but OOZIE-2126 accidentally changed it to 1.  The 
3 argument constructor is fine as-is (it doesn't take a priority so the middle 
priority is fine) and seems to only be used by tests anyway.

> CompletedActionXCommand priority param is of no effect
> --
>
> Key: OOZIE-2589
> URL: https://issues.apache.org/jira/browse/OOZIE-2589
> Project: Oozie
>  Issue Type: Bug
>  Components: core
>Affects Versions: trunk
>Reporter: Linflytang
>  Labels: patch
> Fix For: 4.4.0
>
> Attachments: 0001-Fixed-CompletedActionXCommand-priority-param.patch
>
>
> CompletedActionXCommand priority param is hard coding with 1, but create the 
> action with 2 (HIGH_PRIORITY).
> patch:https://github.com/apache/oozie/pull/20/files



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (OOZIE-2589) CompletedActionXCommand priority param is of no effect

2016-08-18 Thread Robert Kanter (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-2589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426973#comment-15426973
 ] 

Robert Kanter commented on OOZIE-2589:
--

+1

> CompletedActionXCommand priority param is of no effect
> --
>
> Key: OOZIE-2589
> URL: https://issues.apache.org/jira/browse/OOZIE-2589
> Project: Oozie
>  Issue Type: Bug
>  Components: core
>Affects Versions: trunk
>Reporter: Linflytang
>  Labels: patch
> Fix For: 4.4.0
>
> Attachments: 0001-Fixed-CompletedActionXCommand-priority-param.patch
>
>
> CompletedActionXCommand priority param is hard coding with 1, but create the 
> action with 2 (HIGH_PRIORITY).
> patch:https://github.com/apache/oozie/pull/20/files



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Jenkins build is back to normal : oozie-trunk-find-patches-available #130091

2016-08-18 Thread Apache Jenkins Server

See

Build failed in Jenkins: oozie-trunk-find-patches-available #130090

2016-08-18 Thread Apache Jenkins Server

See 

--
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on H1 (yahoo-not-h2 Hadoop Mapreduce Hdfs Pig) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url 
 > https://git-wip-us.apache.org/repos/asf/oozie.git # timeout=10
Fetching upstream changes from https://git-wip-us.apache.org/repos/asf/oozie.git
 > git --version # timeout=10
 > git -c core.askpass=true fetch --tags --progress 
 > https://git-wip-us.apache.org/repos/asf/oozie.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
Checking out Revision 568041dc878683f33e916fbf0f4ccb5811640b61 
(refs/remotes/origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 568041dc878683f33e916fbf0f4ccb5811640b61
 > git rev-list 568041dc878683f33e916fbf0f4ccb5811640b61 # timeout=10
[oozie-trunk-find-patches-available] $ /bin/bash 
/tmp/hudson7238346497100552021.sh
mkdir: cannot create directory 
':
 File exists
  % Total% Received % Xferd  Average Speed   TimeTime Time  Current
 Dload  Upload   Total   SpentLeft  Speed

  0 00 00 0  0  0 --:--:-- --:--:-- --:--:-- 0
100 533700 533700 0  83216  0 --:--:-- --:--:-- --:--:-- 83130
100  385k0  385k0 0   237k  0 --:--:--  0:00:01 --:--:--  237k
100  736k0  736k0 0   282k  0 --:--:--  0:00:02 --:--:--  282k
100 1123k0 1123k0 0   305k  0 --:--:--  0:00:03 --:--:--  305k
100 1474k0 1474k0 0   319k  0 --:--:--  0:00:04 --:--:--  319k
100 1764k0 1764k0 0   284k  0 --:--:--  0:00:06 --:--:--  307k
100 1904k0 1904k0 0   286k  0 --:--:--  0:00:06 --:--:--  302k
100 1939k0 1939k0 0   281k  0 --:--:--  0:00:06 --:--:--  281k
curl: (18) transfer closed with outstanding read data remaining
Could not retrieve available patches from JIRA
Build step 'Execute shell' marked build as failure

[jira] [Commented] (OOZIE-2642) Extend TestSubWorkflowActionExecutor to the test if subworkflow action's parameter is properly set

2016-08-18 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-2642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426736#comment-15426736
 ] 

Hadoop QA commented on OOZIE-2642:
--

Testing JIRA OOZIE-2642

Cleaning local git workspace



{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:green}+1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than 
132
.{color:green}+1{color} the patch does adds/modifies 1 testcase(s)
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT 
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc 
warnings
{color:green}+1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:green}+1{color} the patch does not seem to introduce new javac 
warnings
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA 
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:green}+1 TESTS{color}
.Tests run: 1793
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch 


{color:green}*+1 Overall result, good!, no -1s*{color}


The full output of the test-patch run is available at

.   https://builds.apache.org/job/oozie-trunk-precommit-build/3233/

> Extend TestSubWorkflowActionExecutor to the test if subworkflow action's 
> parameter is properly set
> --
>
> Key: OOZIE-2642
> URL: https://issues.apache.org/jira/browse/OOZIE-2642
> Project: Oozie
>  Issue Type: Test
>Affects Versions: trunk
>Reporter: Attila Sasvari
>Assignee: Attila Sasvari
>Priority: Trivial
> Attachments: OOZIE-2642-01.patch
>
>
> Currently not test exercises whether a configuration property that was set in 
> a parent workflow is properly overriden by the configuration property in the 
> subworkflow's action. Now, what is checked is that global config properties 
> are handled as expected (i.e. subworkflow can override). 
> We need to check if config property defined in a subworkflow's action is 
> overrided.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Jenkins build is back to normal : oozie-trunk-precommit-build #3233

2016-08-18 Thread Apache Jenkins Server

See

[jira] [Commented] (OOZIE-2613) Upgrade hive version from 0.13.1 to 1.2.0

2016-08-18 Thread Attila Sasvari (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-2613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426674#comment-15426674
 ] 

Attila Sasvari commented on OOZIE-2613:
---

[~abhishekbafna] Can you maybe impersonate the test user or adjust some 
FSPermission-s?

I am also fine with not updating hive version for hadoop-1 for now (mainly 
because this profile will be removed sooner or later; it is not really used by 
a the community as far as I understand).

> Upgrade hive version from 0.13.1 to 1.2.0
> -
>
> Key: OOZIE-2613
> URL: https://issues.apache.org/jira/browse/OOZIE-2613
> Project: Oozie
>  Issue Type: Bug
>  Components: core
>Reporter: Abhishek Bafna
>Assignee: Abhishek Bafna
> Fix For: 4.3.0
>
> Attachments: OOZIE-2613-00.patch, OOZIE-2613-01.patch, 
> OOZIE-2613-02.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (OOZIE-2642) Extend TestSubWorkflowActionExecutor to the test if subworkflow action's parameter is properly set

2016-08-18 Thread Attila Sasvari (JIRA)


 [ 
https://issues.apache.org/jira/browse/OOZIE-2642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Attila Sasvari updated OOZIE-2642:
--
Attachment: OOZIE-2642-01.patch

> Extend TestSubWorkflowActionExecutor to the test if subworkflow action's 
> parameter is properly set
> --
>
> Key: OOZIE-2642
> URL: https://issues.apache.org/jira/browse/OOZIE-2642
> Project: Oozie
>  Issue Type: Test
>Affects Versions: trunk
>Reporter: Attila Sasvari
>Assignee: Attila Sasvari
>Priority: Trivial
> Attachments: OOZIE-2642-01.patch
>
>
> Currently not test exercises whether a configuration property that was set in 
> a parent workflow is properly overriden by the configuration property in the 
> subworkflow's action. Now, what is checked is that global config properties 
> are handled as expected (i.e. subworkflow can override). 
> We need to check if config property defined in a subworkflow's action is 
> overrided.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (OOZIE-2642) Extend TestSubWorkflowActionExecutor to the test if subworkflow action's parameter is properly set

2016-08-18 Thread Attila Sasvari (JIRA)


 [ 
https://issues.apache.org/jira/browse/OOZIE-2642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Attila Sasvari updated OOZIE-2642:
--
Affects Version/s: trunk

> Extend TestSubWorkflowActionExecutor to the test if subworkflow action's 
> parameter is properly set
> --
>
> Key: OOZIE-2642
> URL: https://issues.apache.org/jira/browse/OOZIE-2642
> Project: Oozie
>  Issue Type: Test
>Affects Versions: trunk
>Reporter: Attila Sasvari
>Assignee: Attila Sasvari
>Priority: Trivial
> Attachments: OOZIE-2642-01.patch
>
>
> Currently not test exercises whether a configuration property that was set in 
> a parent workflow is properly overriden by the configuration property in the 
> subworkflow's action. Now, what is checked is that global config properties 
> are handled as expected (i.e. subworkflow can override). 
> We need to check if config property defined in a subworkflow's action is 
> overrided.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (OOZIE-2643) Hive on Tez via Oozie fails with ClassNotFound Exception against tables with Hcatalog Json Serde

2016-08-18 Thread Georgi Ivanov (JIRA)


 [ 
https://issues.apache.org/jira/browse/OOZIE-2643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Georgi Ivanov updated OOZIE-2643:
-
Affects Version/s: 4.2.0

> Hive on Tez via Oozie fails with ClassNotFound Exception against tables with 
> Hcatalog Json Serde
> 
>
> Key: OOZIE-2643
> URL: https://issues.apache.org/jira/browse/OOZIE-2643
> Project: Oozie
>  Issue Type: Bug
>Affects Versions: 4.2.0
>Reporter: Georgi Ivanov
>
> If we create an oozie workflow that has a hive action using tez execution 
> engine and we reference a table with hcatalog json serde, oozie does not 
> localize properly the sharelib jars for the tez session. It localizes them 
> for the Hive Action but they do not propagate to Tez. Using Hive on MR works 
> fine. This problem is only present with Oozie and Tez. The workflow throws 
> ClassNotFound Exception.
> 2016-08-18 08:35:00,337 [ERROR] [TezChild] |tez.TezProcessor|: 
> java.lang.RuntimeException: Map operator initialization failed
> at 
> org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:265)
> at 
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:149)
> at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:139)
> at 
> org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:344)
> at 
> org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:181)
> at 
> org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:172)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1709)
> at 
> org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:172)
> at 
> org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:168)
> at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: 
> java.lang.ClassNotFoundException: Class 
> org.apache.hive.hcatalog.data.JsonSerDe not found
> at 
> org.apache.hadoop.hive.ql.exec.MapOperator.getConvertedOI(MapOperator.java:347)
> at 
> org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:382)
> at 
> org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:227)
> ... 15 more
> Caused by: java.lang.ClassNotFoundException: Class 
> org.apache.hive.hcatalog.data.JsonSerDe not found
> at 
> org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2101)
> at 
> org.apache.hadoop.hive.ql.plan.PartitionDesc.getDeserializer(PartitionDesc.java:143)
> at 
> org.apache.hadoop.hive.ql.exec.MapOperator.getConvertedOI(MapOperator.java:313)
> ... 17 more
> The only workaround that I've found so far is to add the hcatalog sharelib to 
> tez.aux.uris as a configuration parameter inside the workflow.xml
> 
> tez.aux.uris
> ${nameNode}/user/oozie/share/lib/hcatalog/
> 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (OOZIE-2643) Hive on Tez via Oozie fails with ClassNotFound Exception against tables with Hcatalog Json Serde

2016-08-18 Thread Georgi Ivanov (JIRA)


 [ 
https://issues.apache.org/jira/browse/OOZIE-2643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Georgi Ivanov updated OOZIE-2643:
-
Summary: Hive on Tez via Oozie fails with ClassNotFound Exception against 
tables with Hcatalog Json Serde  (was: Hive on Tez vai Oozie fails with 
ClassNotFound Exception against tables with Hcatalog Json Serde)

> Hive on Tez via Oozie fails with ClassNotFound Exception against tables with 
> Hcatalog Json Serde
> 
>
> Key: OOZIE-2643
> URL: https://issues.apache.org/jira/browse/OOZIE-2643
> Project: Oozie
>  Issue Type: Bug
>Reporter: Georgi Ivanov
>
> If we create an oozie workflow that has a hive action using tez execution 
> engine and we reference a table with hcatalog json serde, oozie does not 
> localize properly the sharelib jars for the tez session. It localizes them 
> for the Hive Action but they do not propagate to Tez. Using Hive on MR works 
> fine. This problem is only present with Oozie and Tez. The workflow throws 
> ClassNotFound Exception.
> 2016-08-18 08:35:00,337 [ERROR] [TezChild] |tez.TezProcessor|: 
> java.lang.RuntimeException: Map operator initialization failed
> at 
> org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:265)
> at 
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:149)
> at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:139)
> at 
> org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:344)
> at 
> org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:181)
> at 
> org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:172)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1709)
> at 
> org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:172)
> at 
> org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:168)
> at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: 
> java.lang.ClassNotFoundException: Class 
> org.apache.hive.hcatalog.data.JsonSerDe not found
> at 
> org.apache.hadoop.hive.ql.exec.MapOperator.getConvertedOI(MapOperator.java:347)
> at 
> org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:382)
> at 
> org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:227)
> ... 15 more
> Caused by: java.lang.ClassNotFoundException: Class 
> org.apache.hive.hcatalog.data.JsonSerDe not found
> at 
> org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2101)
> at 
> org.apache.hadoop.hive.ql.plan.PartitionDesc.getDeserializer(PartitionDesc.java:143)
> at 
> org.apache.hadoop.hive.ql.exec.MapOperator.getConvertedOI(MapOperator.java:313)
> ... 17 more
> The only workaround that I've found so far is to add the hcatalog sharelib to 
> tez.aux.uris as a configuration parameter inside the workflow.xml
> 
> tez.aux.uris
> ${nameNode}/user/oozie/share/lib/hcatalog/
> 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (OOZIE-2643) Hive on Tez vai Oozie fails with ClassNotFound Exception against tables with Hcatalog Json Serde

2016-08-18 Thread Georgi Ivanov (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-2643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426513#comment-15426513
 ] 

Georgi Ivanov commented on OOZIE-2643:
--

Repro:

# create test table
create table test_json_serde (a string) ROW FORMAT SERDE 
'org.apache.hive.hcatalog.data.JsonSerDe';

# sample query
$ cat query.hql
select count(*) from default.test_json_serde;

# sample workflow




${jobTracker}
${nameNode}
/user/oozie/share/conf/hive-site.xml


mapred.job.queue.name
${queueName}


oozie.use.system.libpath
true
  

oozie.action.sharelib.for.hive
hive,hcatalog


hive.execution.engine
tez

 
/user/givanov/json-serde/query.hql
/user/oozie/share/conf/tez-site.xml





Action failed, error 
message[${wf:errorMessage(wf:lastErrorNode())}]





hive-site.xml and tez-site.xml are the standard global ones.

# a sample job.properties
nameNode=
jobTracker=
oozie.wf.application.path=/user/givanov/json-serde
oozie.use.system.libpath=true
queueName=default

when we run it:
oozie job -config job.properties -run

Hive action starts successfully but tez session fails with the abovementioned 
classnotfound error. Using MR works fine.
It looks like oozie does not localize the jars for the tez session.

> Hive on Tez vai Oozie fails with ClassNotFound Exception against tables with 
> Hcatalog Json Serde
> 
>
> Key: OOZIE-2643
> URL: https://issues.apache.org/jira/browse/OOZIE-2643
> Project: Oozie
>  Issue Type: Bug
>Reporter: Georgi Ivanov
>
> If we create an oozie workflow that has a hive action using tez execution 
> engine and we reference a table with hcatalog json serde, oozie does not 
> localize properly the sharelib jars for the tez session. It localizes them 
> for the Hive Action but they do not propagate to Tez. Using Hive on MR works 
> fine. This problem is only present with Oozie and Tez. The workflow throws 
> ClassNotFound Exception.
> 2016-08-18 08:35:00,337 [ERROR] [TezChild] |tez.TezProcessor|: 
> java.lang.RuntimeException: Map operator initialization failed
> at 
> org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:265)
> at 
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:149)
> at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:139)
> at 
> org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:344)
> at 
> org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:181)
> at 
> org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:172)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1709)
> at 
> org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:172)
> at 
> org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:168)
> at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: 
> java.lang.ClassNotFoundException: Class 
> org.apache.hive.hcatalog.data.JsonSerDe not found
> at 
> org.apache.hadoop.hive.ql.exec.MapOperator.getConvertedOI(MapOperator.java:347)
> at 
> org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:382)
> at 
> org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:227)
> ... 15 more
> Caused by: java.lang.ClassNotFoundException: Class 
> org.apache.hive.hcatalog.data.JsonSerDe not found
> at 
> org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2101)
> at 
> org.apache.hadoop.hive.ql.plan.PartitionDesc.getDeserializer(PartitionDesc.java:143)
> at 
> org.apache.hadoop.hive.ql.exec.MapOperator.getConvertedOI(MapOperator.java:313)
> ... 17 more
> The only workaround that I've found so far is to add the hcatalog sharelib to 
> tez.aux.uris as a configuration parameter inside the

Jenkins build is back to normal : oozie-trunk-find-patches-available #130075

2016-08-18 Thread Apache Jenkins Server

See

[jira] [Created] (OOZIE-2643) Hive on Tez vai Oozie fails with ClassNotFound Exception against tables with Hcatalog Json Serde

2016-08-18 Thread Georgi Ivanov (JIRA)

Georgi Ivanov created OOZIE-2643:


 Summary: Hive on Tez vai Oozie fails with ClassNotFound Exception 
against tables with Hcatalog Json Serde
 Key: OOZIE-2643
 URL: https://issues.apache.org/jira/browse/OOZIE-2643
 Project: Oozie
  Issue Type: Bug
Reporter: Georgi Ivanov


If we create an oozie workflow that has a hive action using tez execution 
engine and we reference a table with hcatalog json serde, oozie does not 
localize properly the sharelib jars for the tez session. It localizes them for 
the Hive Action but they do not propagate to Tez. Using Hive on MR works fine. 
This problem is only present with Oozie and Tez. The workflow throws 
ClassNotFound Exception.

2016-08-18 08:35:00,337 [ERROR] [TezChild] |tez.TezProcessor|: 
java.lang.RuntimeException: Map operator initialization failed
at 
org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:265)
at 
org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:149)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:139)
at 
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:344)
at 
org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:181)
at 
org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:172)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1709)
at 
org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:172)
at 
org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:168)
at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: 
java.lang.ClassNotFoundException: Class org.apache.hive.hcatalog.data.JsonSerDe 
not found
at 
org.apache.hadoop.hive.ql.exec.MapOperator.getConvertedOI(MapOperator.java:347)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:382)
at 
org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:227)
... 15 more
Caused by: java.lang.ClassNotFoundException: Class 
org.apache.hive.hcatalog.data.JsonSerDe not found
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2101)
at 
org.apache.hadoop.hive.ql.plan.PartitionDesc.getDeserializer(PartitionDesc.java:143)
at 
org.apache.hadoop.hive.ql.exec.MapOperator.getConvertedOI(MapOperator.java:313)
... 17 more

The only workaround that I've found so far is to add the hcatalog sharelib to 
tez.aux.uris as a configuration parameter inside the workflow.xml


tez.aux.uris
${nameNode}/user/oozie/share/lib/hcatalog/




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (OOZIE-2642) Extend TestSubWorkflowActionExecutor to the test if subworkflow action's parameter is properly set

2016-08-18 Thread Attila Sasvari (JIRA)

Attila Sasvari created OOZIE-2642:
-

 Summary: Extend TestSubWorkflowActionExecutor to the test if 
subworkflow action's parameter is properly set
 Key: OOZIE-2642
 URL: https://issues.apache.org/jira/browse/OOZIE-2642
 Project: Oozie
  Issue Type: Test
Reporter: Attila Sasvari
Assignee: Attila Sasvari
Priority: Trivial


Currently not test exercises whether a configuration property that was set in a 
parent workflow is properly overriden by the configuration property in the 
subworkflow's action. Now, what is checked is that global config properties are 
handled as expected (i.e. subworkflow can override). 

We need to check if config property defined in a subworkflow's action is 
overrided.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Build failed in Jenkins: oozie-trunk-find-patches-available #130074

2016-08-18 Thread Apache Jenkins Server

See 

--
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on H1 (yahoo-not-h2 Hadoop Mapreduce Hdfs Pig) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url 
 > https://git-wip-us.apache.org/repos/asf/oozie.git # timeout=10
Fetching upstream changes from https://git-wip-us.apache.org/repos/asf/oozie.git
 > git --version # timeout=10
 > git -c core.askpass=true fetch --tags --progress 
 > https://git-wip-us.apache.org/repos/asf/oozie.git 
 > +refs/heads/*:refs/remotes/origin/*
 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
 > git rev-parse refs/remotes/origin/origin/master^{commit} # timeout=10
Checking out Revision 568041dc878683f33e916fbf0f4ccb5811640b61 
(refs/remotes/origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 568041dc878683f33e916fbf0f4ccb5811640b61
 > git rev-list 568041dc878683f33e916fbf0f4ccb5811640b61 # timeout=10
[oozie-trunk-find-patches-available] $ /bin/bash 
/tmp/hudson5022105667437187078.sh
mkdir: cannot create directory 
':
 File exists
  % Total% Received % Xferd  Average Speed   TimeTime Time  Current
 Dload  Upload   Total   SpentLeft  Speed

  0 00 00 0  0  0 --:--:-- --:--:-- --:--:-- 0
100 983220 983220 0   153k  0 --:--:-- --:--:-- --:--:--  153k
100  440k0  440k0 0   264k  0 --:--:--  0:00:01 --:--:--  264k
100  816k0  816k0 0   302k  0 --:--:--  0:00:02 --:--:--  302k
100 1160k0 1160k0 0   319k  0 --:--:--  0:00:03 --:--:--  319k
100 1509k0 1509k0 0   323k  0 --:--:--  0:00:04 --:--:--  322k
100 1781k0 1781k0 0   319k  0 --:--:--  0:00:05 --:--:--  340k
curl: (18) transfer closed with outstanding read data remaining
Could not retrieve available patches from JIRA
Build step 'Execute shell' marked build as failure

[jira] [Commented] (OOZIE-2613) Upgrade hive version from 0.13.1 to 1.2.0

2016-08-18 Thread Abhishek Bafna (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-2613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426216#comment-15426216
 ] 

Abhishek Bafna commented on OOZIE-2613:
---

I am not able to get these two testcases working. I can use some help/feedback 
from the fellow developers in the community.

{noformat}
org.apache.oozie.action.hadoop.TestJavaActionExecutor.testACLModifyJob
org.apache.oozie.action.hadoop.TestHiveMain.testMain
{noformat}

{{TestJavaActionExecutor.testACLModifyJob}} is failing because FileSystem is 
initialized with the {{test}} user and launcher job is launched with 
{{user.name}} (due to {{XHCatTestCase#getTestUser}}, added into this patch).

The Hive testcase works fine with hadoop-2 profile, but fails with hadoop-1 
profile.

{noformat}
2016-08-18 14:43:47,507 [main] ERROR org.apache.hadoop.hive.ql.exec.Task  - 
Failed with exception Unable to rename: 
hdfs://localhost:56649/user/test/95bd1a4c-2629-47bd-a347-f3901b757832/output/.hive-staging_hive_2016-08-18_14-41-58_397_1680638062022362363-1/-ext-1
 to: /user/test/95bd1a4c-2629-47bd-a347-f3901b757832/output
org.apache.hadoop.hive.ql.metadata.HiveException: Unable to rename: 
hdfs://localhost:56649/user/test/95bd1a4c-2629-47bd-a347-f3901b757832/output/.hive-staging_hive_2016-08-18_14-41-58_397_1680638062022362363-1/-ext-1
 to: /user/test/95bd1a4c-2629-47bd-a347-f3901b757832/output
at org.apache.hadoop.hive.ql.exec.MoveTask.moveFile(MoveTask.java:114)
at org.apache.hadoop.hive.ql.exec.MoveTask.execute(MoveTask.java:222)
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160)
at 
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:88)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1650)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1409)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1192)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049)
at 
org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:311)
at 
org.apache.hadoop.hive.cli.CliDriver.processReader(CliDriver.java:409)
at org.apache.hadoop.hive.cli.CliDriver.processFile(CliDriver.java:425)
at 
org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:714)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621)
at org.apache.oozie.action.hadoop.HiveMain.runHive(HiveMain.java:334)
at org.apache.oozie.action.hadoop.HiveMain.run(HiveMain.java:311)
at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:49)
at org.apache.oozie.action.hadoop.HiveMain.main(HiveMain.java:69)
at 
org.apache.oozie.action.hadoop.TestHiveMain.call(TestHiveMain.java:138)
at 
org.apache.oozie.action.hadoop.TestHiveMain.call(TestHiveMain.java:34)
at 
org.apache.oozie.action.hadoop.MainTestCase$1.run(MainTestCase.java:33)
at 
org.apache.oozie.action.hadoop.MainTestCase$1.run(MainTestCase.java:31)
at java.security.AccessController.doPrivileged(Native Method)
{noformat}

For the hadoop-1, would it be a good idea to keep the hive version same as 
{{hive-0.13.1}}.

cc: [~rkanter] [~jaydeepvishwakarma] [~puru] [~rohini] [~asasvari] [~gezapeti] 
[~satishsaley]

> Upgrade hive version from 0.13.1 to 1.2.0
> -
>
> Key: OOZIE-2613
> URL: https://issues.apache.org/jira/browse/OOZIE-2613
> Project: Oozie
>  Issue Type: Bug
>  Components: core
>Reporter: Abhishek Bafna
>Assignee: Abhishek Bafna
> Fix For: 4.3.0
>
> Attachments: OOZIE-2613-00.patch, OOZIE-2613-01.patch, 
> OOZIE-2613-02.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (OOZIE-2231) Upgrade curator to latest version 2.11.0

2016-08-18 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-2231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426146#comment-15426146
 ] 

Hadoop QA commented on OOZIE-2231:
--

Testing JIRA OOZIE-2231

Cleaning local git workspace



{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than 
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT 
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc 
warnings
{color:green}+1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:green}+1{color} the patch does not seem to introduce new javac 
warnings
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA 
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:green}+1 TESTS{color}
.Tests run: 1793
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch 


{color:red}*-1 Overall result, please check the reported -1(s)*{color}


The full output of the test-patch run is available at

.   https://builds.apache.org/job/oozie-trunk-precommit-build/3232/

> Upgrade curator to latest version 2.11.0
> 
>
> Key: OOZIE-2231
> URL: https://issues.apache.org/jira/browse/OOZIE-2231
> Project: Oozie
>  Issue Type: Bug
>  Components: HA
>Reporter: Purshotam Shah
>Assignee: Abhishek Bafna
> Fix For: 4.3.0
>
> Attachments: OOZIE-2231-00.patch, OOZIE-2231-01.patch, 
> OOZIE-2231-02.patch, OOZIE-2231-02.patch, OOZIE-2231-03.patch
>
>
> It have some fix related to InterProcessReadWriteLock, ChildReaper, 
> LeaderSelector which we use.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Build failed in Jenkins: oozie-trunk-precommit-build #3232

2016-08-18 Thread Apache Jenkins Server

See 

--
[...truncated 6460 lines...]
[INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ oozie-tools 
---
[INFO] Nothing to compile - all classes are up to date
[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ 
oozie-tools ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 2 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ 
oozie-tools ---
[INFO] Nothing to compile - all classes are up to date
[INFO] 
[INFO] --- maven-surefire-plugin:2.12.2:test (default-test) @ oozie-tools ---
[INFO] Tests are skipped.
[INFO] 
[INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ oozie-tools ---
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-site-plugin:2.0-beta-6:attach-descriptor (attach-descriptor) @ 
oozie-tools ---
[INFO] 
[INFO] --- maven-assembly-plugin:2.2.1:single (default-cli) @ oozie-tools ---
[INFO] Reading assembly descriptor: ../src/main/assemblies/tools.xml
[WARNING] The following patterns were never triggered in this artifact 
exclusion filter:
o  '*:*:pom:*'

[INFO] Copying files to 

[WARNING] Assembly file: 

 is not a regular file (it may be a directory). It cannot be attached to the 
project build for installation or deployment.
[INFO] 
[INFO] 
[INFO] Building Apache Oozie MiniOozie 4.3.0-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ oozie-mini ---
[INFO] 
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ 
oozie-mini ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ oozie-mini 
---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ 
oozie-mini ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 3 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ 
oozie-mini ---
[INFO] Nothing to compile - all classes are up to date
[INFO] 
[INFO] --- maven-surefire-plugin:2.12.2:test (default-test) @ oozie-mini ---
[INFO] Tests are skipped.
[INFO] 
[INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ oozie-mini ---
[INFO] Building jar: 

[INFO] 
[INFO] --- maven-site-plugin:2.0-beta-6:attach-descriptor (attach-descriptor) @ 
oozie-mini ---
[INFO] 
[INFO] --- maven-assembly-plugin:2.2.1:single (default-cli) @ oozie-mini ---
[INFO] Reading assembly descriptor: src/main/assemblies/empty.xml
[INFO] 
[INFO] 
[INFO] Building Apache Oozie Distro 4.3.0-SNAPSHOT
[INFO] 
[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (default) @ oozie-distro 
---
[INFO] 
[INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ 
oozie-distro ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ oozie-distro 
---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ 
oozie-distro ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 

[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ 
oozie-distro ---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-surefire-plugin:2.12.2:test (default-test) @ oozie-distro ---

[jira] [Updated] (OOZIE-2231) Upgrade curator to latest version 2.11.0

2016-08-18 Thread Abhishek Bafna (JIRA)


 [ 
https://issues.apache.org/jira/browse/OOZIE-2231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Abhishek Bafna updated OOZIE-2231:
--
Attachment: OOZIE-2231-03.patch

[~rkanter], Uploading a patch with {{curator-2.11.0}} and {{guava-16.0.1}}.

1. The {{Stopwatch#elapsedMillis()}} is not available in guava-16. Updated 
Stopwatch initialization instead of a deprecated constructor to static method 
{{Stopwatch.createStarted()}}.
2. Indentation fixed. Refactored the indentation for property section of the 
main {{pom.xml}}.
3. Defined a global {{}}.
4. This should not be a problem. I was able to execute Oozie example workflows 
without any issue. This is how lib's look like with patch.

{noformat}
$find . -name guava*
./share/lib/hive/guava-16.0.1.jar
./share/lib/spark/guava-14.0.1.jar
./share/lib/pig/guava-11.0.2.jar
./oozie-client/lib/guava-16.0.1.jar
./lib/guava-16.0.1.jar
./oozie-server/webapps/oozie/WEB-INF/lib/guava-16.0.1.jar
{noformat}

[~puru], [~rohini] Please have a look and let me know your feedback. Thanks.

> Upgrade curator to latest version 2.11.0
> 
>
> Key: OOZIE-2231
> URL: https://issues.apache.org/jira/browse/OOZIE-2231
> Project: Oozie
>  Issue Type: Bug
>  Components: HA
>Reporter: Purshotam Shah
>Assignee: Abhishek Bafna
> Fix For: 4.3.0
>
> Attachments: OOZIE-2231-00.patch, OOZIE-2231-01.patch, 
> OOZIE-2231-02.patch, OOZIE-2231-02.patch, OOZIE-2231-03.patch
>
>
> It have some fix related to InterProcessReadWriteLock, ChildReaper, 
> LeaderSelector which we use.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] Subscription: Oozie Patch Available

2016-08-18 Thread jira

Issue Subscription
Filter: Oozie Patch Available (90 issues)

Subscriber: ooziedaily

Key Summary
OOZIE-2641  rerunning an oozie coordinator job stucks on waiting
https://issues.apache.org/jira/browse/OOZIE-2641
OOZIE-2635  TimeZone.getTimeZone has performance issue.
https://issues.apache.org/jira/browse/OOZIE-2635
OOZIE-2632  Provide database dump/load functionality to make database migration 
easier
https://issues.apache.org/jira/browse/OOZIE-2632
OOZIE-2630  Oozie Coordinator EL Functions to get first day of the week/month
https://issues.apache.org/jira/browse/OOZIE-2630
OOZIE-2619  Make  Hive action defaults to match hive defaults when running from 
command line
https://issues.apache.org/jira/browse/OOZIE-2619
OOZIE-2618  Include hive-common in hive-beeline as compile component for 
hive-server2 (hive2 action)
https://issues.apache.org/jira/browse/OOZIE-2618
OOZIE-2617  Read properties files in action configurations
https://issues.apache.org/jira/browse/OOZIE-2617
OOZIE-2616  Add Tez profile for Hive and Pig sharelibs
https://issues.apache.org/jira/browse/OOZIE-2616
OOZIE-2613  Upgrade hive version from 0.13.1 to 1.2.0
https://issues.apache.org/jira/browse/OOZIE-2613
OOZIE-2606  Set spark.yarn.jars to fix Spark 2.0 with Oozie
https://issues.apache.org/jira/browse/OOZIE-2606
OOZIE-2589  CompletedActionXCommand priority param is of no effect
https://issues.apache.org/jira/browse/OOZIE-2589
OOZIE-2588  Support getting credentials for same cluster hcat when credentials 
config is empty
https://issues.apache.org/jira/browse/OOZIE-2588
OOZIE-2585  Disable or remove test case 
TestPartitionDependencyManagerEhcache.testMemoryUsageAndSpeedOverflowToDisk and 
testMemoryUsageAndSpeed
https://issues.apache.org/jira/browse/OOZIE-2585
OOZIE-2584  Eliminate Thread.sleep() calls in TestMemoryLocks
https://issues.apache.org/jira/browse/OOZIE-2584
OOZIE-2583  oozie throws EL Exception when reference variable name containing 
dot
https://issues.apache.org/jira/browse/OOZIE-2583
OOZIE-2582  Populating external child Ids for action failures
https://issues.apache.org/jira/browse/OOZIE-2582
OOZIE-2573  dataset url  which contains spaces can not be handled rightly
https://issues.apache.org/jira/browse/OOZIE-2573
OOZIE-2572  SLA DURATION miss not shown when job is running for longer than 
expected time
https://issues.apache.org/jira/browse/OOZIE-2572
OOZIE-2571  Add scala.binary.version Maven property so that Scala 2.11 can be 
used
https://issues.apache.org/jira/browse/OOZIE-2571
OOZIE-2569  Adding yarn-site, core-site, hdfs-site and mapred-site into spark 
launcher 
https://issues.apache.org/jira/browse/OOZIE-2569
OOZIE-2568  SSH  action pretends to retry automaticly when it failed
https://issues.apache.org/jira/browse/OOZIE-2568
OOZIE-2564  Create new log4j config for unit tests so that logged messages 
contain threads
https://issues.apache.org/jira/browse/OOZIE-2564
OOZIE-2552  Update ActiveMQ version for security and other fixes
https://issues.apache.org/jira/browse/OOZIE-2552
OOZIE-2538  Update HttpClient versions to close security vulnerabilities
https://issues.apache.org/jira/browse/OOZIE-2538
OOZIE-2534  Versioned action libs (similar to how SharedLibs works)
https://issues.apache.org/jira/browse/OOZIE-2534
OOZIE-2530  Remove jline from parent and sharelib pig pom
https://issues.apache.org/jira/browse/OOZIE-2530
OOZIE-2528  Print out environment variables in LauncherMapper
https://issues.apache.org/jira/browse/OOZIE-2528
OOZIE-2525  SchemaChecker fails with NPE
https://issues.apache.org/jira/browse/OOZIE-2525
OOZIE-2521  Filter options are case sensitive for jobtye=bundle
https://issues.apache.org/jira/browse/OOZIE-2521
OOZIE-2518  Oozie is creating many files and directories in /tmp per day
https://issues.apache.org/jira/browse/OOZIE-2518
OOZIE-2517  Add support for startCreatedTime and endCreatedTime filters for 
coord and bundles
https://issues.apache.org/jira/browse/OOZIE-2517
OOZIE-2513  log.scan.duration should not be used for error and audit logs
https://issues.apache.org/jira/browse/OOZIE-2513
OOZIE-2501  ZK reentrant lock doesn't work for few cases
https://issues.apache.org/jira/browse/OOZIE-2501
OOZIE-2500  -DtestJarSimple option mentioned in minioozie doc does not work
https://issues.apache.org/jira/browse/OOZIE-2500
OOZIE-2499  map-reduce launcher does not need distributed files, archives 
except  jar of input/outputformat class
https://issues.apache.org/jira/browse/OOZIE-2499
OOZIE-2498  Oozie CallerId configuration for downstream components

Jenkins build is back to normal : oozie-trunk-find-patches-available #130150

Build failed in Jenkins: oozie-trunk-find-patches-available #130149

[jira] [Created] (OOZIE-2645) Drop Instrumentation in favor of Metrics

[jira] [Created] (OOZIE-2644) Skip queuing Notification Commands when there's nothing to notify

[jira] [Updated] (OOZIE-2589) CompletedActionXCommand is hardcoded to wrong priority

[jira] [Updated] (OOZIE-2589) CompletedActionXCommand is hardcoded to wrong priority

[jira] [Commented] (OOZIE-2589) CompletedActionXCommand priority param is of no effect

[jira] [Commented] (OOZIE-2589) CompletedActionXCommand priority param is of no effect

Jenkins build is back to normal : oozie-trunk-find-patches-available #130091

Build failed in Jenkins: oozie-trunk-find-patches-available #130090

[jira] [Commented] (OOZIE-2642) Extend TestSubWorkflowActionExecutor to the test if subworkflow action's parameter is properly set

Jenkins build is back to normal : oozie-trunk-precommit-build #3233

[jira] [Commented] (OOZIE-2613) Upgrade hive version from 0.13.1 to 1.2.0

[jira] [Updated] (OOZIE-2642) Extend TestSubWorkflowActionExecutor to the test if subworkflow action's parameter is properly set

[jira] [Updated] (OOZIE-2642) Extend TestSubWorkflowActionExecutor to the test if subworkflow action's parameter is properly set

[jira] [Updated] (OOZIE-2643) Hive on Tez via Oozie fails with ClassNotFound Exception against tables with Hcatalog Json Serde

[jira] [Updated] (OOZIE-2643) Hive on Tez via Oozie fails with ClassNotFound Exception against tables with Hcatalog Json Serde

[jira] [Commented] (OOZIE-2643) Hive on Tez vai Oozie fails with ClassNotFound Exception against tables with Hcatalog Json Serde

Jenkins build is back to normal : oozie-trunk-find-patches-available #130075

[jira] [Created] (OOZIE-2643) Hive on Tez vai Oozie fails with ClassNotFound Exception against tables with Hcatalog Json Serde

[jira] [Created] (OOZIE-2642) Extend TestSubWorkflowActionExecutor to the test if subworkflow action's parameter is properly set

Build failed in Jenkins: oozie-trunk-find-patches-available #130074

[jira] [Commented] (OOZIE-2613) Upgrade hive version from 0.13.1 to 1.2.0

[jira] [Commented] (OOZIE-2231) Upgrade curator to latest version 2.11.0

Build failed in Jenkins: oozie-trunk-precommit-build #3232

[jira] [Updated] (OOZIE-2231) Upgrade curator to latest version 2.11.0

[jira] Subscription: Oozie Patch Available

27 matches

Site Navigation

Mail list logo

Footer information