date:20180129

[jira] [Commented] (OOZIE-3168) Remove -secure option from DG_QuickStart.twiki and from oozie-setup.sh

2018-01-29 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-3168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344638#comment-16344638
 ] 

Hadoop QA commented on OOZIE-3168:
--

PreCommit-OOZIE-Build started


> Remove -secure option from DG_QuickStart.twiki and from oozie-setup.sh 
> ---
>
> Key: OOZIE-3168
> URL: https://issues.apache.org/jira/browse/OOZIE-3168
> Project: Oozie
>  Issue Type: Bug
>  Components: docs, scripts
>Affects Versions: trunk
>Reporter: Julia Kinga Marton
>Assignee: Julia Kinga Marton
>Priority: Major
> Attachments: OOZIE-3168-001.patch, OOZIE-3168-002.patch
>
>
> The DG_QuickStart.twiki still contains reference to the -secure option from 
> DG_QuickStart.twiki: 
> [https://github.com/apache/oozie/blob/master/docs/src/site/twiki/DG_QuickStart.twiki#L149-L150]
> This is a valid option in the oozie-setup.sh, but is not used anymore.
> oozie-setup.ps1 also contains reference to -prepare-war and -secure options:
> [https://github.com/apache/oozie/blob/master/distro/src/main/bin/oozie-setup.ps1#L26]
>  
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (OOZIE-3168) Remove -secure option from DG_QuickStart.twiki and from oozie-setup.sh

2018-01-29 Thread Julia Kinga Marton (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-3168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344637#comment-16344637
 ] 

Julia Kinga Marton commented on OOZIE-3168:
---

Thank you [~gezapeti], I have uploaded the new patch, which is applying to the 
master.

> Remove -secure option from DG_QuickStart.twiki and from oozie-setup.sh 
> ---
>
> Key: OOZIE-3168
> URL: https://issues.apache.org/jira/browse/OOZIE-3168
> Project: Oozie
>  Issue Type: Bug
>  Components: docs, scripts
>Affects Versions: trunk
>Reporter: Julia Kinga Marton
>Assignee: Julia Kinga Marton
>Priority: Major
> Attachments: OOZIE-3168-001.patch, OOZIE-3168-002.patch
>
>
> The DG_QuickStart.twiki still contains reference to the -secure option from 
> DG_QuickStart.twiki: 
> [https://github.com/apache/oozie/blob/master/docs/src/site/twiki/DG_QuickStart.twiki#L149-L150]
> This is a valid option in the oozie-setup.sh, but is not used anymore.
> oozie-setup.ps1 also contains reference to -prepare-war and -secure options:
> [https://github.com/apache/oozie/blob/master/distro/src/main/bin/oozie-setup.ps1#L26]
>  
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (OOZIE-3168) Remove -secure option from DG_QuickStart.twiki and from oozie-setup.sh

2018-01-29 Thread Julia Kinga Marton (JIRA)


 [ 
https://issues.apache.org/jira/browse/OOZIE-3168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julia Kinga Marton updated OOZIE-3168:
--
Attachment: OOZIE-3168-002.patch

> Remove -secure option from DG_QuickStart.twiki and from oozie-setup.sh 
> ---
>
> Key: OOZIE-3168
> URL: https://issues.apache.org/jira/browse/OOZIE-3168
> Project: Oozie
>  Issue Type: Bug
>  Components: docs, scripts
>Affects Versions: trunk
>Reporter: Julia Kinga Marton
>Assignee: Julia Kinga Marton
>Priority: Major
> Attachments: OOZIE-3168-001.patch, OOZIE-3168-002.patch
>
>
> The DG_QuickStart.twiki still contains reference to the -secure option from 
> DG_QuickStart.twiki: 
> [https://github.com/apache/oozie/blob/master/docs/src/site/twiki/DG_QuickStart.twiki#L149-L150]
> This is a valid option in the oozie-setup.sh, but is not used anymore.
> oozie-setup.ps1 also contains reference to -prepare-war and -secure options:
> [https://github.com/apache/oozie/blob/master/distro/src/main/bin/oozie-setup.ps1#L26]
>  
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] Subscription: Oozie Patch Available

2018-01-29 Thread jira

Issue Subscription
Filter: Oozie Patch Available (111 issues)

Subscriber: ooziedaily

Key Summary
OOZIE-3129  Fix test TestConfigurationService.testOozieConfig
https://issues-test.apache.org/jira/browse/OOZIE-3129
OOZIE-3127  Remove redundant check for user
https://issues-test.apache.org/jira/browse/OOZIE-3127
OOZIE-3126  Add option to allow list of users to access system config
https://issues-test.apache.org/jira/browse/OOZIE-3126
OOZIE-3121  bump all maven plugins to latest versions
https://issues-test.apache.org/jira/browse/OOZIE-3121
OOZIE-3118  fix for error: self-closing element not allowed
https://issues-test.apache.org/jira/browse/OOZIE-3118
OOZIE-3117  fix for warning: no @throws for
https://issues-test.apache.org/jira/browse/OOZIE-3117
OOZIE-3116  fix for warning: no description for @throws
https://issues-test.apache.org/jira/browse/OOZIE-3116
OOZIE-3115  fix for javadoc warning: empty  tag
https://issues-test.apache.org/jira/browse/OOZIE-3115
OOZIE-3113  Retry for ZK lock release
https://issues-test.apache.org/jira/browse/OOZIE-3113
OOZIE-3112  SparkConfigrationService overwrites properties provided via 
--properties-file option in SparkAction
https://issues-test.apache.org/jira/browse/OOZIE-3112
OOZIE-3105  testJMXInstrumentation from the 
org.apache.oozie.util.TestMetricsInstrumentation class is flaky
https://issues-test.apache.org/jira/browse/OOZIE-3105
OOZIE-3094  fix for grammar mistake
https://issues-test.apache.org/jira/browse/OOZIE-3094
OOZIE-3091  Oozie Sqoop Avro Import fails with "java.lang.NoClassDefFoundError: 
org/apache/avro/mapred/AvroWrapper"
https://issues-test.apache.org/jira/browse/OOZIE-3091
OOZIE-3083  Make improved version Info backward compatible
https://issues-test.apache.org/jira/browse/OOZIE-3083
OOZIE-3071  Oozie 4.3 Spark sharelib ueses a different version of commons-lang3 
than Spark 2.2.0
https://issues-test.apache.org/jira/browse/OOZIE-3071
OOZIE-3063  Sanitizing variables that are part of openjpa.ConnectionProperties
https://issues-test.apache.org/jira/browse/OOZIE-3063
OOZIE-3062  Set HADOOP_CONF_DIR for spark action
https://issues-test.apache.org/jira/browse/OOZIE-3062
OOZIE-3002  address findbugs errors in client lib
https://issues-test.apache.org/jira/browse/OOZIE-3002
OOZIE-2975  code clean up in pig sharelib, replace Exception with more 
explicit, add try with resources, StringBuilder instead of StringBuffer
https://issues-test.apache.org/jira/browse/OOZIE-2975
OOZIE-2973  Make sure Oozie works with Hadoop 3 
https://issues-test.apache.org/jira/browse/OOZIE-2973
OOZIE-2969  Drop support for Java 1.7
https://issues-test.apache.org/jira/browse/OOZIE-2969
OOZIE-2957  Documentation states that starting a coordinator is possible
https://issues-test.apache.org/jira/browse/OOZIE-2957
OOZIE-2956  Fix Findbugs warnings related to reliance on default encoding in 
oozie-core
https://issues-test.apache.org/jira/browse/OOZIE-2956
OOZIE-2955  Fix Findbugs warnings related to reliance on default encoding in 
oozie-client
https://issues-test.apache.org/jira/browse/OOZIE-2955
OOZIE-2954  Fix Checkstyle issues in oozie-client
https://issues-test.apache.org/jira/browse/OOZIE-2954
OOZIE-2953  Fix Checkstyle issues in oozie-tools
https://issues-test.apache.org/jira/browse/OOZIE-2953
OOZIE-2952  Fix Findbugs warnings in oozie-sharelib-oozie
https://issues-test.apache.org/jira/browse/OOZIE-2952
OOZIE-2949  Escape quotes whitespaces in Sqoop  field
https://issues-test.apache.org/jira/browse/OOZIE-2949
OOZIE-2942  Fix Findbugs warnings in oozie-examples
https://issues-test.apache.org/jira/browse/OOZIE-2942
OOZIE-2937  Remove redundant groupId from the child pom's
https://issues-test.apache.org/jira/browse/OOZIE-2937
OOZIE-2934  Fix "Exceptional return value of java.io.File.mkdirs() ignored" 
Findbugs error in oozie-sharelib-spark
https://issues-test.apache.org/jira/browse/OOZIE-2934
OOZIE-2927  Append new line character for Hive2 query using query tag
https://issues-test.apache.org/jira/browse/OOZIE-2927
OOZIE-2914  Consolidate Trim 
https://issues-test.apache.org/jira/browse/OOZIE-2914
OOZIE-2883  OOZIE throw the error "Missing 
[oozie.service.ProxyUserService.proxyuser.oozie.service.ProxyUserService.proxyuser.mr.groups]
 property"
https://issues-test.apache.org/jira/browse/OOZIE-2883
OOZIE-2877  Oozie Git Action
https://issues-test.apache.org/jira/browse/OOZIE-2877
OOZIE-2867  Timezone handling for Coordinators: emphasize "Continent/City" 
format
https://issues-test.apache.org/jira/browse/OOZIE-2867
OOZIE-2834  ParameterVerifier logging

[jira] Subscription: Oozie Patch Available

2018-01-29 Thread jira

Issue Subscription
Filter: Oozie Patch Available (104 issues)

Subscriber: ooziedaily

Key Summary
OOZIE-3172  Upgrade non-transitive Jackson dependencies from 
org.codehaus.jackson to com.fasterxml.jackson
https://issues.apache.org/jira/browse/OOZIE-3172
OOZIE-3171  Revert OOZIE-2771 commit on branch-4.3
https://issues.apache.org/jira/browse/OOZIE-3171
OOZIE-3168  Remove -secure option from DG_QuickStart.twiki and from 
oozie-setup.sh 
https://issues.apache.org/jira/browse/OOZIE-3168
OOZIE-3163  improve documentation rendering: use fluido skin and better config
https://issues.apache.org/jira/browse/OOZIE-3163
OOZIE-3135  Configure log4j2 in SqoopMain
https://issues.apache.org/jira/browse/OOZIE-3135
OOZIE-3121  bump all maven plugins to latest versions
https://issues.apache.org/jira/browse/OOZIE-3121
OOZIE-3105  testJMXInstrumentation from the 
org.apache.oozie.util.TestMetricsInstrumentation class is flaky
https://issues.apache.org/jira/browse/OOZIE-3105
OOZIE-3094  fix for grammar mistake
https://issues.apache.org/jira/browse/OOZIE-3094
OOZIE-3091  Oozie Sqoop Avro Import fails with "java.lang.NoClassDefFoundError: 
org/apache/avro/mapred/AvroWrapper"
https://issues.apache.org/jira/browse/OOZIE-3091
OOZIE-3071  Oozie 4.3 Spark sharelib ueses a different version of commons-lang3 
than Spark 2.2.0
https://issues.apache.org/jira/browse/OOZIE-3071
OOZIE-3063  Sanitizing variables that are part of openjpa.ConnectionProperties
https://issues.apache.org/jira/browse/OOZIE-3063
OOZIE-3062  Set HADOOP_CONF_DIR for spark action
https://issues.apache.org/jira/browse/OOZIE-3062
OOZIE-3002  address findbugs errors in client lib
https://issues.apache.org/jira/browse/OOZIE-3002
OOZIE-2975  code clean up in pig sharelib, replace Exception with more 
explicit, add try with resources, StringBuilder instead of StringBuffer
https://issues.apache.org/jira/browse/OOZIE-2975
OOZIE-2957  Documentation states that starting a coordinator is possible
https://issues.apache.org/jira/browse/OOZIE-2957
OOZIE-2956  Fix Findbugs warnings related to reliance on default encoding in 
oozie-core
https://issues.apache.org/jira/browse/OOZIE-2956
OOZIE-2955  Fix Findbugs warnings related to reliance on default encoding in 
oozie-client
https://issues.apache.org/jira/browse/OOZIE-2955
OOZIE-2954  Fix Checkstyle issues in oozie-client
https://issues.apache.org/jira/browse/OOZIE-2954
OOZIE-2953  Fix Checkstyle issues in oozie-tools
https://issues.apache.org/jira/browse/OOZIE-2953
OOZIE-2952  Fix Findbugs warnings in oozie-sharelib-oozie
https://issues.apache.org/jira/browse/OOZIE-2952
OOZIE-2949  Escape quotes whitespaces in Sqoop  field
https://issues.apache.org/jira/browse/OOZIE-2949
OOZIE-2942  Fix Findbugs warnings in oozie-examples
https://issues.apache.org/jira/browse/OOZIE-2942
OOZIE-2937  Remove redundant groupId from the child pom's
https://issues.apache.org/jira/browse/OOZIE-2937
OOZIE-2934  Fix "Exceptional return value of java.io.File.mkdirs() ignored" 
Findbugs error in oozie-sharelib-spark
https://issues.apache.org/jira/browse/OOZIE-2934
OOZIE-2927  Append new line character for Hive2 query using query tag
https://issues.apache.org/jira/browse/OOZIE-2927
OOZIE-2914  Consolidate Trim 
https://issues.apache.org/jira/browse/OOZIE-2914
OOZIE-2883  OOZIE throw the error "Missing 
[oozie.service.ProxyUserService.proxyuser.oozie.service.ProxyUserService.proxyuser.mr.groups]
 property"
https://issues.apache.org/jira/browse/OOZIE-2883
OOZIE-2877  Oozie Git Action
https://issues.apache.org/jira/browse/OOZIE-2877
OOZIE-2867  Timezone handling for Coordinators: emphasize "Continent/City" 
format
https://issues.apache.org/jira/browse/OOZIE-2867
OOZIE-2834  ParameterVerifier logging non-useful warning for workflow definition
https://issues.apache.org/jira/browse/OOZIE-2834
OOZIE-2833  when using uber mode the regex pattern used in the 
extractHeapSizeMB method does not allow heap sizes specified in bytes.
https://issues.apache.org/jira/browse/OOZIE-2833
OOZIE-2829  Improve sharelib upload to accept multiple source folders
https://issues.apache.org/jira/browse/OOZIE-2829
OOZIE-2826  Falcon feed fails to aws s3; Oozie joda time version does not meet 
required jar version 2.2 or later
https://issues.apache.org/jira/browse/OOZIE-2826
OOZIE-2812  SparkConfigurationService should support loading configurations 
from multiple Spark versions
https://issues.apache.org/jira/browse/OOZIE-2812
OOZIE-2795  Create lib directory or symlink for Oozie CLI during packaging
https://issues.apache.org/jira/browse/OOZIE-2795
OOZIE-2791  ShareLib

Re: [VOTE] Release Oozie 4.3.1 (candidate 3)

2018-01-29 Thread Artem Ervits

the server directory is missing altogether now.

On Mon, Jan 29, 2018 at 6:59 AM, Attila Sasvari 
wrote:

> +1 (non-binding)
>
> - Verified hash, signature files, rat report
> - Built Oozie distro with hadoop.version set to 2.6.0 using the uber,
> hadoop-2, spark-1 profiles
> - Submitted example workflows/coordinators/bundles (except hive related
> ones) on a hadoop 2.6.0 in pseudo distributed mode
> - Verified Tomcat version was 6.0.53
> - Clicked through the web UI, log retrieval worked, job DAG-s were
> rendered, version was correct.
> - Verified instrumentation, SLA pages; they are now HTML based as expected
> (OOZIE-2533). However, json2.js is referenced by webapp/index.html and it
> is not found (not a blocker in my opinion).
> - Enabled SLA, re-submitted sla coordinator example, and retrieved SLA
> details for the "one-op-wf" application, graph was displayed properly.
>
> I used JDK 1.8.0_121
>
> On Sun, Jan 28, 2018 at 7:09 AM, Satish Saley 
> wrote:
>
> > Hi,
> >
> > I have created a build for Oozie 4.3.1, candidate 3.
> >
> > It includes all the changes decided earlier except OOZIE-3018, OOZIE-2771
> > and
> > OOZIE-3072. OOZIE-3018 makes changes to SchemaCheckerService which we are
> > not picking.
> > OOZIE-2771 makes changes to file created in OOZIE-2666.
> > OOZIE-3072 makes changes to files created in OOZIE-1770.
> >
> >
> > Keys to verify the signature of the release artifact are available at
> >   http://www.apache.org/dist/oozie/KEYS
> >
> > Please download, test, and try it out:
> >
> > http://people.apache.org/~satishsaley/oozie-4.3.1-rc3/
> >
> >
> > The release, md5 signature, gpg signature, and rat report can be found at
> > the above address.
> >
> > Vote closes on 01/31/2018 11:59 PM PT.
> >
>
>
>
> --
> --
> Attila Sasvari
> Software Engineer
> 
>

[jira] [Commented] (OOZIE-3057) Custom Partitioner not working in Oozie Mapreduce action

2018-01-29 Thread Peter Cseh (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-3057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343910#comment-16343910
 ] 

Peter Cseh commented on OOZIE-3057:
---

Can you provide some logs and the exact workflow.xml - maybe also the 
partitioner code so we can help you debug this issue?



> Custom Partitioner not working in Oozie Mapreduce action
> 
>
> Key: OOZIE-3057
> URL: https://issues.apache.org/jira/browse/OOZIE-3057
> Project: Oozie
>  Issue Type: Bug
>  Components: action, workflow
>Affects Versions: 4.1.0
> Environment: Red Hat Enterprise Linux Server release 7.2 (Maipo)
> Linux version 3.10.0-327.10.1.el7.x86_64 
> (mockbu...@x86-021.build.eng.bos.redhat.com) (gcc version 4.8.5 20150623 (Red 
> Hat 4.8.5-4) (GCC) ) #1 SMP Sat Jan 23 04:54:55 EST 2016
> oozie version - 4.1.0
> cdh version - 5.10.1
> Hue™ 3.11 - The Hadoop UI
>Reporter: Raghavi Ravi
>Priority: Critical
>
> I implemented secondary sort in mapreduce using old API 
> (org.apache.hadoop.mapred.*) and trying to execute it using Oozie (From Hue).
> Though I have set the partitioner class in the properties, the partitioner is 
> not being executed. So, I'm not getting output as expected.
> The same code runs fine when run using hadoop command from CLI.
> And here is my workflow.xml
> 
> 
> 
> Action failed, error 
> message[${wf:errorMessage(wf:lastErrorNode())}]
> 
> 
> 
> ${jobTracker}
> ${nameNode}
> 
> 
> mapred.output.dir
> /test_1109_3
> 
> 
> mapred.input.dir
> 
> /apps/hive/warehouse/7360_0609_rx/day=06-09-2017/hour=13/quarter=2/,/apps/hive/warehouse/7360_0609_tx/day=06-09-2017/hour=13/quarter=2/,/apps/hive/warehouse/7360_0509_util/day=05-09-2017/hour=16/quarter=1/
> 
> 
> mapred.input.format.class
> org.apache.hadoop.hive.ql.io.RCFileInputFormat
> 
> 
> mapred.mapper.class
> PonRankMapper
> 
> 
> mapred.reducer.class
> PonRankReducer
> 
> 
> mapred.output.value.comparator.class
> PonRankGroupingComparator
> 
> 
> mapred.mapoutput.key.class
> PonRankPair
> 
> 
> mapred.mapoutput.value.class
> org.apache.hadoop.io.Text
> 
> 
> mapred.reduce.output.key.class
> org.apache.hadoop.io.NullWritable
> 
> 
> mapred.reduce.output.value.class
> org.apache.hadoop.io.Text
> 
> 
> mapred.reduce.tasks
> 1
> 
> 
> mapred.partitioner.class
> PonRankPartitioner
> 
> 
> mapred.mapper.new-api
> False
> 
> 
> 
> 
> 
> 
> 
> When running using hadoop jar command, I set the partitioner class using 
> JobConf.setPartitionerClass API.
>  Partitioner is not executed when using old API . Inspite of adding the 
> property.
> 
> mapred.partitioner.class
> PonRankPartitioner
> 
> Executed the same logic using new API's (org.apache.hadoop.mapreduce) and 
> added mapreduce.partitioner.class property in workflow.
> Partitioner was executed and desired outcome was seen.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (OOZIE-3061) Kill only those child jobs which are not already killed

2018-01-29 Thread Peter Cseh (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-3061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343905#comment-16343905
 ] 

Peter Cseh commented on OOZIE-3061:
---

Welcome [~matijhs]! I've added you to the contributor list and assigned this 
issue to you!

Your approach seems fine at first glance, but please submit a patch as 
described 
[here|https://cwiki.apache.org/confluence/display/OOZIE/How+To+Contribute]. 
Thanks in advance for the contribution!

> Kill only those child jobs which are not already killed
> ---
>
> Key: OOZIE-3061
> URL: https://issues.apache.org/jira/browse/OOZIE-3061
> Project: Oozie
>  Issue Type: Bug
>Reporter: Satish Subhashrao Saley
>Assignee: Mate Juhasz
>Priority: Trivial
>  Labels: newbie, newbiee
>
> Here we kill all child jobs. 
> https://github.com/apache/oozie/blob/master/sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/LauncherMain.java#L265
> We should check before killing for already killed application.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Assigned] (OOZIE-3061) Kill only those child jobs which are not already killed

2018-01-29 Thread Peter Cseh (JIRA)


 [ 
https://issues.apache.org/jira/browse/OOZIE-3061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Cseh reassigned OOZIE-3061:
-

Assignee: Mate Juhasz

> Kill only those child jobs which are not already killed
> ---
>
> Key: OOZIE-3061
> URL: https://issues.apache.org/jira/browse/OOZIE-3061
> Project: Oozie
>  Issue Type: Bug
>Reporter: Satish Subhashrao Saley
>Assignee: Mate Juhasz
>Priority: Trivial
>  Labels: newbie, newbiee
>
> Here we kill all child jobs. 
> https://github.com/apache/oozie/blob/master/sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/LauncherMain.java#L265
> We should check before killing for already killed application.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: Review Request 65385: OOZIE-1717 add indices to speed up db queries

2018-01-29 Thread Robert Kanter via Review Board


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/65385/#review196444
---




tools/src/main/java/org/apache/oozie/tools/OozieDBCLI.java
Line 64 (original), 64 (patched)


It looks like we started using DB version 3 in Oozie 4.1.  Instead of 
DB_VERSION_PRE_5_0, let's rename this to DB_VERSION_FOR_4_1.  

Also, why are these two not private?



tools/src/main/java/org/apache/oozie/tools/OozieDBCLI.java
Lines 750 (patched)


Shouldn't we write the statements to a file in this case?


- Robert Kanter


On Jan. 29, 2018, 3:04 p.m., Attila Sasvari wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/65385/
> ---
> 
> (Updated Jan. 29, 2018, 3:04 p.m.)
> 
> 
> Review request for oozie.
> 
> 
> Repository: oozie-git
> 
> 
> Description
> ---
> 
> Add indices to speed up SELECT operations.
> 
> 
> Index user_name column
> 
> for purge service OOZIE-1803:
> CREATE INDEX "OOZIEDB"."BUNDLE_JOBS_END_TIME_IDX" ON "BUNDLE_JOBS" 
> ("END_TIME");
> CREATE INDEX "OOZIEDB"."COORD_JOBS_END_TIME_IDX" ON "COORD_JOBS" ("END_TIME");
> CREATE INDEX "OOZIEDB"."WF_JOBS_END_TIME_IDX" ON "WF_JOBS" ("END_TIME");
> CREATE INDEX "OOZIEDB"."COORD_ACTIONS_JOB_ID_IDX" ON "COORD_ACTIONS" 
> ("JOB_ID");
> CREATE INDEX "OOZIEDB"."COORD_JOBS_BUNDLE_ID_IDX" ON "COORD_JOBS" 
> ("BUNDLE_ID");
> CREATE INDEX "OOZIEDB"."WF_ACTIONS_WF_ID_IDX" ON "WF_ACTIONS" ("WF_ID");
> CREATE INDEX "OOZIEDB"."WF_JOBS_PARENT_ID_IDX" ON "WF_JOBS" ("PARENT_ID");
> CREATE INDEX "OOZIEDB"."BUNDLE_ACTIONS_BUNDLE_ID_IDX" ON "BUNDLE_ACTIONS" 
> ("BUNDLE_ID");
> 
> Composite indices to speed up operations on the web UI
> 
> 
> Diffs
> -
> 
>   core/src/main/java/org/apache/oozie/BundleJobBean.java 
> b42f12841c2f9cb6d508cd2ac2f393e6407d1cf0 
>   core/src/main/java/org/apache/oozie/CoordinatorJobBean.java 
> 99c7d3c474d9e1e22e2f5a927c03d71b9292b663 
>   core/src/main/java/org/apache/oozie/WorkflowJobBean.java 
> cd9a6df42e552a0607606a244b81978747d89b41 
>   tools/src/main/java/org/apache/oozie/tools/OozieDBCLI.java 
> a8b2234966c967f9ad9d722628bd486012b14bd3 
> 
> 
> Diff: https://reviews.apache.org/r/65385/diff/2/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Attila Sasvari
> 
>

[jira] [Commented] (OOZIE-1717) Index user_name column

2018-01-29 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-1717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343682#comment-16343682
 ] 

Hadoop QA commented on OOZIE-1717:
--


Testing JIRA OOZIE-1717

Cleaning local git workspace



{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than 
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT 
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc 
warnings
.{color:red}WARNING{color}: the current HEAD has 100 Javadoc warning(s)
{color:green}+1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:green}+1{color} the patch does not seem to introduce new javac 
warnings
{color:red}-1{color} There are [7] new bugs found below threshold in total that 
must be fixed.
. {color:green}+1{color} There are no new bugs found in [docs].
. {color:green}+1{color} There are no new bugs found in [sharelib/pig].
. {color:green}+1{color} There are no new bugs found in [sharelib/oozie].
. {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive2].
. {color:green}+1{color} There are no new bugs found in [sharelib/distcp].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive].
. {color:green}+1{color} There are no new bugs found in [sharelib/spark].
. {color:green}+1{color} There are no new bugs found in [sharelib/streaming].
. {color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
. {color:green}+1{color} There are no new bugs found in [examples].
. {color:green}+1{color} There are no new bugs found in [client].
. {color:red}-1{color} There are [7] new bugs found below threshold in [tools] 
that must be fixed, listing only the first [5] ones.
. You can find the FindBugs diff here (look for the red and orange ones): 
tools/findbugs-new.html
. The top [5] most important FindBugs errors are:
. At OozieDBCLI.java:[line 756]: Found reliance on default encoding in 
org.apache.oozie.tools.OozieDBCLI.ddlTweaksFor50(String, boolean): new 
java.io.FileWriter(String, boolean)
. At OozieDBCLI.java:[line 725]: Found reliance on default encoding in 
org.apache.oozie.tools.OozieDBCLI.ddlTweaksForPre50(String, boolean, String): 
new java.io.FileWriter(String, boolean)
. Obligation to clean up resource created at OozieDBCLI.java:[line 734] is not 
discharged: org.apache.oozie.tools.OozieDBCLI.ddlTweaksForPre50(String, 
boolean, String) may fail to clean up java.sql.Statement
. Path continues at OozieDBCLI.java:[line 741]: Path continues at 
OozieDBCLI.java:[line 735]
. Path continues at OozieDBCLI.java:[line 743]: Path continues at 
OozieDBCLI.java:[line 742]
. {color:green}+1{color} There are no new bugs found in [server].
. {color:green}+1{color} There are no new bugs found in [core].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA 
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color}
.Tests run: 2088
.Tests failed: 21
.Tests errors: 18

.The patch failed the following testcases:

testOozieSharelibCLICreate(org.apache.oozie.tools.TestOozieSharelibCLI)
testOozieSharelibCLICreateConcurrent(org.apache.oozie.tools.TestOozieSharelibCLI)
testPartitionDependency(org.apache.oozie.service.TestPartitionDependencyManagerService)
testConnectionContext(org.apache.oozie.service.TestJMSAccessorService)
testCoordActionRecoveryServiceForWaitingRegisterPartition(org.apache.oozie.service.TestRecoveryService)
testPartitionDependency(org.apache.oozie.service.TestPartitionDependencyManagerEhcache)
testCoordinatorActionSelectors(org.apache.oozie.jms.TestJMSJobEventListener)
testCoordinatorActionSelectorsNegative(org.apache.oozie.jms.TestJMSJobEventListener)
testWorkflowJobSelectors(org.apache.oozie.jms.TestJMSJobEventListener)
testOnCoordinatorJobSuccessEvent(org.apache.oozie.jms.TestJMSJobEventListener)
testOnWorkflowJobSuspendEvent(org.apache.oozie.jms.TestJMSJobEventListener)
testWorkflowJobSelectorsAnd(org.apache.oozie.jms.TestJMSJobEventListener)
testOnCoordinatorJobFailureEvent(org.apache.oozie.jms.TestJMSJobEventListener)
testConnectionDrop(org.apache.oozie.jms.TestJMSJobEventListener)
testWorkflowJobSelectorsNegative(org.apache.oozie.jms.TestJMSJobEventListener)

Failed: OOZIE-1717 PreCommit Build #358

2018-01-29 Thread Apache Jenkins Server

Jira: https://issues.apache.org/jira/browse/OOZIE-1717
Build: https://builds.apache.org/job/PreCommit-OOZIE-Build/358/

###
## LAST 100 LINES OF THE CONSOLE 
###
[...truncated 1.73 MB...]
 +1 There are no new bugs found in [sharelib/distcp].
 +1 There are no new bugs found in [sharelib/hive].
 +1 There are no new bugs found in [sharelib/spark].
 +1 There are no new bugs found in [sharelib/streaming].
 +1 There are no new bugs found in [sharelib/sqoop].
 +1 There are no new bugs found in [examples].
 +1 There are no new bugs found in [client].
 -1 There are [7] new bugs found below threshold in [tools] that must be fixed, 
listing only the first [5] ones.
 You can find the FindBugs diff here (look for the red and orange ones): 
tools/findbugs-new.html
 The top [5] most important FindBugs errors are:
 At OozieDBCLI.java:[line 756]: Found reliance on default encoding in 
org.apache.oozie.tools.OozieDBCLI.ddlTweaksFor50(String, boolean): new 
java.io.FileWriter(String, boolean)
 At OozieDBCLI.java:[line 725]: Found reliance on default encoding in 
org.apache.oozie.tools.OozieDBCLI.ddlTweaksForPre50(String, boolean, String): 
new java.io.FileWriter(String, boolean)
 Obligation to clean up resource created at OozieDBCLI.java:[line 734] is not 
discharged: org.apache.oozie.tools.OozieDBCLI.ddlTweaksForPre50(String, 
boolean, String) may fail to clean up java.sql.Statement
 Path continues at OozieDBCLI.java:[line 741]: Path continues at 
OozieDBCLI.java:[line 735]
 Path continues at OozieDBCLI.java:[line 743]: Path continues at 
OozieDBCLI.java:[line 742]
 +1 There are no new bugs found in [server].
 +1 There are no new bugs found in [core].
+1 BACKWARDS_COMPATIBILITY
+1 the patch does not change any JPA Entity/Colum/Basic/Lob/Transient 
annotations
+1 the patch does not modify JPA files
-1 TESTS
Tests run: 2088
Tests failed: 21
Tests errors: 18

The patch failed the following testcases:

testOozieSharelibCLICreate(org.apache.oozie.tools.TestOozieSharelibCLI)
testOozieSharelibCLICreateConcurrent(org.apache.oozie.tools.TestOozieSharelibCLI)
testPartitionDependency(org.apache.oozie.service.TestPartitionDependencyManagerService)
testConnectionContext(org.apache.oozie.service.TestJMSAccessorService)
testCoordActionRecoveryServiceForWaitingRegisterPartition(org.apache.oozie.service.TestRecoveryService)
testPartitionDependency(org.apache.oozie.service.TestPartitionDependencyManagerEhcache)
testCoordinatorActionSelectors(org.apache.oozie.jms.TestJMSJobEventListener)
testCoordinatorActionSelectorsNegative(org.apache.oozie.jms.TestJMSJobEventListener)
testWorkflowJobSelectors(org.apache.oozie.jms.TestJMSJobEventListener)
testOnCoordinatorJobSuccessEvent(org.apache.oozie.jms.TestJMSJobEventListener)
testOnWorkflowJobSuspendEvent(org.apache.oozie.jms.TestJMSJobEventListener)
testWorkflowJobSelectorsAnd(org.apache.oozie.jms.TestJMSJobEventListener)
testOnCoordinatorJobFailureEvent(org.apache.oozie.jms.TestJMSJobEventListener)
testConnectionDrop(org.apache.oozie.jms.TestJMSJobEventListener)
testWorkflowJobSelectorsNegative(org.apache.oozie.jms.TestJMSJobEventListener)
testWorkflowJobSelectorsOr(org.apache.oozie.jms.TestJMSJobEventListener)
testOnWorkflowJobSuccessEvent(org.apache.oozie.jms.TestJMSJobEventListener)
testOnCoordinatorActionWaitingEvent(org.apache.oozie.jms.TestJMSJobEventListener)
testOnWorkflowJobFailureEvent(org.apache.oozie.jms.TestJMSJobEventListener)
testOnCoordinatorActionStartEvent(org.apache.oozie.jms.TestJMSJobEventListener)
testOnWorkflowJobStartedEvent(org.apache.oozie.jms.TestJMSJobEventListener)

Tests failing with errors:
testImportTablesOverflowBatchSize(org.apache.oozie.tools.TestDBLoadDump)
testImportToNonExistingTablesSucceedsOnHsqldb(org.apache.oozie.tools.TestDBLoadDump)
testImportInvalidDataLeavesTablesEmpty(org.apache.oozie.tools.TestDBLoadDump)
testImportToNonEmptyTablesCausesPrematureExit(org.apache.oozie.tools.TestDBLoadDump)
testImportedDBIsExportedCorrectly(org.apache.oozie.tools.TestDBLoadDump)
testThreadLocalSession(org.apache.oozie.jms.TestDefaultConnectionContext)
testDropEventTypeMessage(org.apache.oozie.jms.TestHCatMessageHandler)
testCacheUpdateByMessage(org.apache.oozie.jms.TestHCatMessageHandler)
testConnectionRetryExceptionListener(org.apache.oozie.service.TestJMSAccessorService)
testConnectionRetry(org.apache.oozie.service.TestJMSAccessorService)
testOnSLADurationMetEvent(org.apache.oozie.jms.TestJMSSLAEventListener)
testOnSLAStartMetEvent(org.apache.oozie.jms.TestJMSSLAEventListener)
testSLAJobSelectorsNegative(org.apache.oozie.jms.TestJMSSLAEventListener)
testOnSLAEndMetEvent(org.apache.oozie.jms.TestJMSSLAEventListener)
testOnSLAStartMissEvent(org.apache.oozie.jms.TestJMSSLAEventListener)
testSLAJobSelectors(org.apache.oozie.jms.TestJMSSLAEventListener)

Failed: OOZIE-1717 PreCommit Build #357

2018-01-29 Thread Apache Jenkins Server

Jira: https://issues.apache.org/jira/browse/OOZIE-1717
Build: https://builds.apache.org/job/PreCommit-OOZIE-Build/357/

###
## LAST 100 LINES OF THE CONSOLE 
###
[...truncated 1.58 MB...]
[TRACE] Full summary file size is 3190 bytes
[TRACE] File 
[/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/test-patch/tmp/FINDBUGS_DIFF/diff/findbugs-diff-0.1.0-all.jar]
 removed
[TRACE] File 
[/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/test-patch/tmp/FINDBUGS_DIFF/diff/findbugs-diff-0.1.0-all.jar.md5sum]
 removed
  Running test-patch task BACKWARDS_COMPATIBILITY
  Running test-patch task TESTS
  Running test-patch task DISTRO


Testing JIRA OOZIE-1717

Cleaning local git workspace



+1 PATCH_APPLIES
+1 CLEAN
-1 RAW_PATCH_ANALYSIS
+1 the patch does not introduce any @author tags
+1 the patch does not introduce any tabs
+1 the patch does not introduce any trailing spaces
+1 the patch does not introduce any line longer than 132
-1 the patch does not add/modify any testcase
+1 RAT
+1 the patch does not seem to introduce new RAT warnings
+1 JAVADOC
+1 the patch does not seem to introduce new Javadoc warnings
WARNING: the current HEAD has 100 Javadoc warning(s)
+1 COMPILE
+1 HEAD compiles
+1 patch compiles
+1 the patch does not seem to introduce new javac warnings
-1 There are [7] new bugs found below threshold in total that must be fixed.
 +1 There are no new bugs found in [client].
 +1 There are no new bugs found in [sharelib/hive].
 +1 There are no new bugs found in [sharelib/sqoop].
 +1 There are no new bugs found in [sharelib/spark].
 +1 There are no new bugs found in [sharelib/streaming].
 +1 There are no new bugs found in [sharelib/hive2].
 +1 There are no new bugs found in [sharelib/oozie].
 +1 There are no new bugs found in [sharelib/hcatalog].
 +1 There are no new bugs found in [sharelib/pig].
 +1 There are no new bugs found in [sharelib/distcp].
 +1 There are no new bugs found in [docs].
 +1 There are no new bugs found in [server].
 +1 There are no new bugs found in [core].
 +1 There are no new bugs found in [examples].
 -1 There are [7] new bugs found below threshold in [tools] that must be fixed, 
listing only the first [5] ones.
 You can find the FindBugs diff here (look for the red and orange ones): 
tools/findbugs-new.html
 The top [5] most important FindBugs errors are:
 At OozieDBCLI.java:[line 755]: Found reliance on default encoding in 
org.apache.oozie.tools.OozieDBCLI.ddlTweaksFor50(String, boolean): new 
java.io.FileWriter(String, boolean)
 At OozieDBCLI.java:[line 725]: Found reliance on default encoding in 
org.apache.oozie.tools.OozieDBCLI.ddlTweaksForPre50(String, boolean, String): 
new java.io.FileWriter(String, boolean)
 Obligation to clean up resource created at OozieDBCLI.java:[line 734] is not 
discharged: org.apache.oozie.tools.OozieDBCLI.ddlTweaksForPre50(String, 
boolean, String) may fail to clean up java.sql.Statement
 Path continues at OozieDBCLI.java:[line 741]: Path continues at 
OozieDBCLI.java:[line 735]
 Path continues at OozieDBCLI.java:[line 743]: Path continues at 
OozieDBCLI.java:[line 742]
+1 BACKWARDS_COMPATIBILITY
+1 the patch does not change any JPA Entity/Colum/Basic/Lob/Transient 
annotations
+1 the patch does not modify JPA files
-1 TESTS
Tests run: 2088
Tests failed: 1
Tests errors: 0

The patch failed the following testcases:

testOozieDBCLI(org.apache.oozie.tools.TestOozieDBCLI)

Tests failing with errors:


Tests failed at first run:
TestCoordActionInputCheckXCommandNonUTC>TestCoordActionInputCheckXCommand#testNone
TestMetricsInstrumentation#testJMXInstrumentation
For the complete list of flaky tests, see TEST-SUMMARY-FULL files.
+1 DISTRO
+1 distro tarball builds with the patch 


-1 Overall result, please check the reported -1(s)

 There is at least one warning, please check

The full output of the test-patch run is available at

 https://builds.apache.org/job/PreCommit-OOZIE-Build/357/

Adding comment to JIRA
  % Total% Received % Xferd  Average Speed   TimeTime Time  Current
 Dload  Upload   Total   SpentLeft  Speed
  0 00 00 0  0  0 --:--:-- --:--:-- --:--:-- 
0{"self":"https://issues.apache.org/jira/rest/api/2/issue/12697804/comment/16343626","id":"16343626","author":{"self":"https://issues.apache.org/jira/rest/api/2/user?username=hadoopqa","name":"hadoopqa","key":"hadoopqa","emailAddress":"blackhole
 at hadoop dot apache dot

[jira] [Commented] (OOZIE-1717) Index user_name column

2018-01-29 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-1717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343626#comment-16343626
 ] 

Hadoop QA commented on OOZIE-1717:
--


Testing JIRA OOZIE-1717

Cleaning local git workspace



{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than 
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT 
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc 
warnings
.{color:red}WARNING{color}: the current HEAD has 100 Javadoc warning(s)
{color:green}+1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:green}+1{color} the patch does not seem to introduce new javac 
warnings
{color:red}-1{color} There are [7] new bugs found below threshold in total that 
must be fixed.
. {color:green}+1{color} There are no new bugs found in [client].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive].
. {color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
. {color:green}+1{color} There are no new bugs found in [sharelib/spark].
. {color:green}+1{color} There are no new bugs found in [sharelib/streaming].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive2].
. {color:green}+1{color} There are no new bugs found in [sharelib/oozie].
. {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
. {color:green}+1{color} There are no new bugs found in [sharelib/pig].
. {color:green}+1{color} There are no new bugs found in [sharelib/distcp].
. {color:green}+1{color} There are no new bugs found in [docs].
. {color:green}+1{color} There are no new bugs found in [server].
. {color:green}+1{color} There are no new bugs found in [core].
. {color:green}+1{color} There are no new bugs found in [examples].
. {color:red}-1{color} There are [7] new bugs found below threshold in [tools] 
that must be fixed, listing only the first [5] ones.
. You can find the FindBugs diff here (look for the red and orange ones): 
tools/findbugs-new.html
. The top [5] most important FindBugs errors are:
. At OozieDBCLI.java:[line 755]: Found reliance on default encoding in 
org.apache.oozie.tools.OozieDBCLI.ddlTweaksFor50(String, boolean): new 
java.io.FileWriter(String, boolean)
. At OozieDBCLI.java:[line 725]: Found reliance on default encoding in 
org.apache.oozie.tools.OozieDBCLI.ddlTweaksForPre50(String, boolean, String): 
new java.io.FileWriter(String, boolean)
. Obligation to clean up resource created at OozieDBCLI.java:[line 734] is not 
discharged: org.apache.oozie.tools.OozieDBCLI.ddlTweaksForPre50(String, 
boolean, String) may fail to clean up java.sql.Statement
. Path continues at OozieDBCLI.java:[line 741]: Path continues at 
OozieDBCLI.java:[line 735]
. Path continues at OozieDBCLI.java:[line 743]: Path continues at 
OozieDBCLI.java:[line 742]
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA 
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color}
.Tests run: 2088
.Tests failed: 1
.Tests errors: 0

.The patch failed the following testcases:

testOozieDBCLI(org.apache.oozie.tools.TestOozieDBCLI)

.Tests failing with errors:


.{color:orange}Tests failed at first run:{color}
TestCoordActionInputCheckXCommandNonUTC>TestCoordActionInputCheckXCommand#testNone
TestMetricsInstrumentation#testJMXInstrumentation
.For the complete list of flaky tests, see TEST-SUMMARY-FULL files.
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch 


{color:red}*-1 Overall result, please check the reported -1(s)*{color}

{color:red}. There is at least one warning, please check{color}

The full output of the test-patch run is available at

. https://builds.apache.org/job/PreCommit-OOZIE-Build/357/



> Index user_name column
> --
>
> Key: OOZIE-1717
> URL: https://issues.apache.org/jira/browse/OOZIE-1717
> Project: Oozie
>  Issue Type: Bug
>Reporter: Purshotam Shah
>Assignee: Attila Sasvari
>Priority: Minor
> Attachments: OOZIE-1717-00.patch, OOZIE-1717-002.patch, 
> OOZIE-1717-003.patch, OOZIE-1717-01.patch
>
>
> User_name is one of the frequently

[jira] [Commented] (OOZIE-3172) Upgrade non-transitive Jackson dependencies from org.codehaus.jackson to com.fasterxml.jackson

2018-01-29 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-3172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343543#comment-16343543
 ] 

Hadoop QA commented on OOZIE-3172:
--


Testing JIRA OOZIE-3172

Cleaning local git workspace



{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:green}+1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than 
132
.{color:green}+1{color} the patch adds/modifies 2 testcase(s)
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT 
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc 
warnings
.{color:red}WARNING{color}: the current HEAD has 100 Javadoc warning(s)
{color:green}+1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:green}+1{color} the patch does not seem to introduce new javac 
warnings
{color:green}+1{color} There are no new bugs found in total.
. {color:green}+1{color} There are no new bugs found in [docs].
. {color:green}+1{color} There are no new bugs found in [sharelib/distcp].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive].
. {color:green}+1{color} There are no new bugs found in [sharelib/spark].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive2].
. {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
. {color:green}+1{color} There are no new bugs found in [sharelib/streaming].
. {color:green}+1{color} There are no new bugs found in [sharelib/pig].
. {color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
. {color:green}+1{color} There are no new bugs found in [sharelib/oozie].
. {color:green}+1{color} There are no new bugs found in [examples].
. {color:green}+1{color} There are no new bugs found in [client].
. {color:green}+1{color} There are no new bugs found in [core].
. {color:green}+1{color} There are no new bugs found in [tools].
. {color:green}+1{color} There are no new bugs found in [server].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA 
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color}
.Tests run: 2088
.Tests failed: 6
.Tests errors: 2

.The patch failed the following testcases:

testSparkAction(org.apache.oozie.action.hadoop.TestSparkActionExecutor)
testSparkAction(org.apache.oozie.action.hadoop.TestSparkActionExecutor)
testPyspark(org.apache.oozie.action.hadoop.TestPyspark)
testPartitionDependency(org.apache.oozie.service.TestPartitionDependencyManagerService)
testCoordActionRecoveryServiceForWaitingRegisterPartition(org.apache.oozie.service.TestRecoveryService)
testConnectionDrop(org.apache.oozie.jms.TestJMSJobEventListener)
testPartitionDependency(org.apache.oozie.service.TestPartitionDependencyManagerEhcache)

.Tests failing with errors:
testMain(org.apache.oozie.action.hadoop.TestSparkMain)
testConnectionRetry(org.apache.oozie.service.TestJMSAccessorService)

.{color:orange}Tests failed at first run:{color}
TestJavaActionExecutor#testCredentialsSkip
.For the complete list of flaky tests, see TEST-SUMMARY-FULL files.
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch 


{color:red}*-1 Overall result, please check the reported -1(s)*{color}

{color:red}. There is at least one warning, please check{color}

The full output of the test-patch run is available at

. https://builds.apache.org/job/PreCommit-OOZIE-Build/354/



> Upgrade non-transitive Jackson dependencies from org.codehaus.jackson to 
> com.fasterxml.jackson
> --
>
> Key: OOZIE-3172
> URL: https://issues.apache.org/jira/browse/OOZIE-3172
> Project: Oozie
>  Issue Type: Improvement
>  Components: core
>Affects Versions: 5.0.0b1
>Reporter: Andras Piros
>Assignee: Andras Piros
>Priority: Major
> Attachments: OOZIE-3172.001.patch
>
>
> Jackson 1.9.3 is way too old, and has several security vulnerabilities as 
> well. Jackson 2.9.2 covers most of these.
> Let's switch from {{org.codehaus.jackson}} to {{com.fasterxml.jackson}} in 
> Oozie's direct (non-transitive) dependencies.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Failed: OOZIE-3172 PreCommit Build #354

2018-01-29 Thread Apache Jenkins Server

Jira: https://issues.apache.org/jira/browse/OOZIE-3172
Build: https://builds.apache.org/job/PreCommit-OOZIE-Build/354/

###
## LAST 100 LINES OF THE CONSOLE 
###
[...truncated 1.59 MB...]
./sharelib/spark/target/surefire-reports/TEST-org.apache.oozie.action.hadoop.TestSparkActionExecutor.xml:92:
 parser error : Premature end of data in tag testcase line 88
./sharelib/spark/target/surefire-reports/TEST-org.apache.oozie.action.hadoop.TestSparkActionExecutor.xml:92:
 parser error : Premature end of data in tag testsuite line 2
./sharelib/spark/target/surefire-reports/TEST-org.apache.oozie.action.hadoop.TestSparkActionExecutor.xml:92:
 parser error : Unregistered error message
./sharelib/spark/target/surefire-reports/TEST-org.apache.oozie.action.hadoop.TestSparkActionExecutor.xml:92:
 parser error : Premature end of data in tag system-out line 92
./sharelib/spark/target/surefire-reports/TEST-org.apache.oozie.action.hadoop.TestSparkActionExecutor.xml:92:
 parser error : Premature end of data in tag testcase line 88
./sharelib/spark/target/surefire-reports/TEST-org.apache.oozie.action.hadoop.TestSparkActionExecutor.xml:92:
 parser error : Premature end of data in tag testsuite line 2
  Running test-patch task DISTRO


Testing JIRA OOZIE-3172

Cleaning local git workspace



+1 PATCH_APPLIES
+1 CLEAN
+1 RAW_PATCH_ANALYSIS
+1 the patch does not introduce any @author tags
+1 the patch does not introduce any tabs
+1 the patch does not introduce any trailing spaces
+1 the patch does not introduce any line longer than 132
+1 the patch adds/modifies 2 testcase(s)
+1 RAT
+1 the patch does not seem to introduce new RAT warnings
+1 JAVADOC
+1 the patch does not seem to introduce new Javadoc warnings
WARNING: the current HEAD has 100 Javadoc warning(s)
+1 COMPILE
+1 HEAD compiles
+1 patch compiles
+1 the patch does not seem to introduce new javac warnings
+1 There are no new bugs found in total.
 +1 There are no new bugs found in [docs].
 +1 There are no new bugs found in [sharelib/distcp].
 +1 There are no new bugs found in [sharelib/hive].
 +1 There are no new bugs found in [sharelib/spark].
 +1 There are no new bugs found in [sharelib/hive2].
 +1 There are no new bugs found in [sharelib/hcatalog].
 +1 There are no new bugs found in [sharelib/streaming].
 +1 There are no new bugs found in [sharelib/pig].
 +1 There are no new bugs found in [sharelib/sqoop].
 +1 There are no new bugs found in [sharelib/oozie].
 +1 There are no new bugs found in [examples].
 +1 There are no new bugs found in [client].
 +1 There are no new bugs found in [core].
 +1 There are no new bugs found in [tools].
 +1 There are no new bugs found in [server].
+1 BACKWARDS_COMPATIBILITY
+1 the patch does not change any JPA Entity/Colum/Basic/Lob/Transient 
annotations
+1 the patch does not modify JPA files
-1 TESTS
Tests run: 2088
Tests failed: 6
Tests errors: 2

The patch failed the following testcases:

testSparkAction(org.apache.oozie.action.hadoop.TestSparkActionExecutor)
testSparkAction(org.apache.oozie.action.hadoop.TestSparkActionExecutor)
testPyspark(org.apache.oozie.action.hadoop.TestPyspark)
testPartitionDependency(org.apache.oozie.service.TestPartitionDependencyManagerService)
testCoordActionRecoveryServiceForWaitingRegisterPartition(org.apache.oozie.service.TestRecoveryService)
testConnectionDrop(org.apache.oozie.jms.TestJMSJobEventListener)
testPartitionDependency(org.apache.oozie.service.TestPartitionDependencyManagerEhcache)

Tests failing with errors:
testMain(org.apache.oozie.action.hadoop.TestSparkMain)
testConnectionRetry(org.apache.oozie.service.TestJMSAccessorService)

Tests failed at first run:
TestJavaActionExecutor#testCredentialsSkip
For the complete list of flaky tests, see TEST-SUMMARY-FULL files.
+1 DISTRO
+1 distro tarball builds with the patch 


-1 Overall result, please check the reported -1(s)

 There is at least one warning, please check

The full output of the test-patch run is available at

 https://builds.apache.org/job/PreCommit-OOZIE-Build/354/

Adding comment to JIRA
  % Total% Received % Xferd  Average Speed   TimeTime Time  Current
 Dload  Upload   Total   SpentLeft  Speed
  0 00 00 0  0  0 --:--:-- --:--:-- --:--:-- 
0{"self":"https://issues.apache.org/jira/rest/api/2/issue/13134446/comment/16343543","id":"16343543","author":{"self":"https://issues.apache.org/jira/rest/api/2/user?username=hadoopqa","name":"hadoopqa","key":"hadoopqa","emailAddress":"blackhole
 at hadoop dot apache dot

[jira] [Commented] (OOZIE-1717) Index user_name column

2018-01-29 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-1717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343493#comment-16343493
 ] 

Hadoop QA commented on OOZIE-1717:
--

PreCommit-OOZIE-Build started


> Index user_name column
> --
>
> Key: OOZIE-1717
> URL: https://issues.apache.org/jira/browse/OOZIE-1717
> Project: Oozie
>  Issue Type: Bug
>Reporter: Purshotam Shah
>Assignee: Attila Sasvari
>Priority: Minor
> Attachments: OOZIE-1717-00.patch, OOZIE-1717-002.patch, 
> OOZIE-1717-003.patch, OOZIE-1717-01.patch
>
>
> User_name is one of the frequently used filter. Adding index should avoid  
> full db scan.
> Index need to be done for BUNDLE_JOBS,COORD_JOBS and WF_JOBS.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (OOZIE-1717) Index user_name column

2018-01-29 Thread Attila Sasvari (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-1717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343484#comment-16343484
 ] 

Attila Sasvari commented on OOZIE-1717:
---

OpenJPA 2.4.2 does not support JPA 2.1, so I had to add the following composite 
indices with {{java.sql.Statement's execUpdate()}}:
{code:java}
CREATE INDEX I_WF_JOBS_STATUS_CREATED_TIME ON WF_JOBS (status, created_time)

CREATE INDEX I_COORD_ACTIONS_JOB_ID_STATUS ON COORD_ACTIONS (job_id, status)

CREATE INDEX I_COORD_JOBS_STATUS_CREATED_TIME ON COORD_JOBS (status, 
created_time)
CREATE INDEX I_COORD_JOBS_STATUS_LAST_MODIFIED_TIME ON COORD_JOBS (status, 
last_modified_time)
CREATE INDEX I_COORD_JOBS_PENDING_DONE_MATERIALIZATION_LAST_MODIFIED_TIME ON 
COORD_JOBS (pending, done_materialization, last_modified_time)
"CREATE INDEX I_COORD_JOBS_PENDING_LAST_MODIFIED_TIME ON COORD_JOBS (pending, 
last_modified_time)

CREATE INDEX I_BUNLDE_JOBS_STATUS_CREATED_TIME ON BUNDLE_JOBS (status, 
created_time)
CREATE INDEX I_BUNLDE_JOBS_STATUS_LAST_MODIFIED_TIME ON BUNDLE_JOBS (status, 
last_modified_time)

CREATE INDEX I_BUNLDE_ACTIONS_PENDING_LAST_MODIFIED_TIME ON BUNDLE_ACTIONS 
(pending, last_modified_time){code}
After the change, the following indices are present in the oozie database:
{code:java}
> SELECT DISTINCT     TABLE_NAME, COLUMN_NAME,    INDEX_NAME FROM 
> INFORMATION_SCHEMA.STATISTICS WHERE TABLE_SCHEMA = 'oozie';

++--+--+

| TABLE_NAME             | COLUMN_NAME          | INDEX_NAME                    
                               |

++--+--+

| BUNDLE_ACTIONS         | bundle_action_id     | PRIMARY                       
                               |

| BUNDLE_ACTIONS         | bundle_id            | I_BNDLTNS_BUNDLE_ID           
                               |

| BUNDLE_ACTIONS         | pending              | 
I_BUNLDE_ACTIONS_PENDING_LAST_MODIFIED_TIME                  |

| BUNDLE_ACTIONS         | last_modified_time   | 
I_BUNLDE_ACTIONS_PENDING_LAST_MODIFIED_TIME                  |

| BUNDLE_JOBS            | id                   | PRIMARY                       
                               |

| BUNDLE_JOBS            | created_time         | I_BNDLJBS_CREATED_TIME        
                               |

| BUNDLE_JOBS            | end_time             | I_BNDLJBS_END_TIME            
                               |

| BUNDLE_JOBS            | last_modified_time   | I_BNDLJBS_LAST_MODIFIED_TIME  
                               |

| BUNDLE_JOBS            | status               | I_BNDLJBS_STATUS              
                               |

| BUNDLE_JOBS            | suspended_time       | I_BNDLJBS_SUSPENDED_TIME      
                               |

| BUNDLE_JOBS            | user_name            | I_BNDLJBS_USER_NAME           
                               |

| BUNDLE_JOBS            | status               | 
I_BUNLDE_JOBS_STATUS_CREATED_TIME                            |

| BUNDLE_JOBS            | created_time         | 
I_BUNLDE_JOBS_STATUS_CREATED_TIME                            |

| BUNDLE_JOBS            | status               | 
I_BUNLDE_JOBS_STATUS_LAST_MODIFIED_TIME                      |

| BUNDLE_JOBS            | last_modified_time   | 
I_BUNLDE_JOBS_STATUS_LAST_MODIFIED_TIME                      |

| COORD_ACTIONS          | id                   | PRIMARY                       
                               |

| COORD_ACTIONS          | created_time         | I_CRD_TNS_CREATED_TIME        
                               |

| COORD_ACTIONS          | external_id          | I_CRD_TNS_EXTERNAL_ID         
                               |

| COORD_ACTIONS          | job_id               | I_CRD_TNS_JOB_ID              
                               |

| COORD_ACTIONS          | last_modified_time   | I_CRD_TNS_LAST_MODIFIED_TIME  
                               |

| COORD_ACTIONS          | nominal_time         | I_CRD_TNS_NOMINAL_TIME        
                               |

| COORD_ACTIONS          | rerun_time           | I_CRD_TNS_RERUN_TIME          
                               |

| COORD_ACTIONS          | status               | I_CRD_TNS_STATUS              
                               |

| COORD_ACTIONS          | job_id               | I_COORD_ACTIONS_JOB_ID_STATUS 
                               |

| COORD_ACTIONS          | status               | I_COORD_ACTIONS_JOB_ID_STATUS 
                               |

| COORD_JOBS             | id                   | PRIMARY                       
                               |

| COORD_JOBS             | bundle_id            | I_CRD_JBS_BUNDLE_ID           
                               |

| COORD_JOBS             | created_time         | I_CRD_JBS_CREATED_TIME

[jira] [Updated] (OOZIE-1717) Index user_name column

2018-01-29 Thread Attila Sasvari (JIRA)


 [ 
https://issues.apache.org/jira/browse/OOZIE-1717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Attila Sasvari updated OOZIE-1717:
--
Attachment: OOZIE-1717-003.patch

> Index user_name column
> --
>
> Key: OOZIE-1717
> URL: https://issues.apache.org/jira/browse/OOZIE-1717
> Project: Oozie
>  Issue Type: Bug
>Reporter: Purshotam Shah
>Assignee: Attila Sasvari
>Priority: Minor
> Attachments: OOZIE-1717-00.patch, OOZIE-1717-002.patch, 
> OOZIE-1717-003.patch, OOZIE-1717-01.patch
>
>
> User_name is one of the frequently used filter. Adding index should avoid  
> full db scan.
> Index need to be done for BUNDLE_JOBS,COORD_JOBS and WF_JOBS.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: Review Request 65385: OOZIE-1717 add indices to speed up db queries

2018-01-29 Thread András Piros via Review Board


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/65385/#review196432
---




tools/src/main/java/org/apache/oozie/tools/OozieDBCLI.java
Lines 756 (patched)


I think you should never have `null` as `stmt`. This will cause subsequent 
errors.

I'd rather fail when `conn` is `null`.



tools/src/main/java/org/apache/oozie/tools/OozieDBCLI.java
Lines 1156 (patched)


Any ideas how to check automatically which indices have been created?


- András Piros


On Jan. 29, 2018, 3:04 p.m., Attila Sasvari wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/65385/
> ---
> 
> (Updated Jan. 29, 2018, 3:04 p.m.)
> 
> 
> Review request for oozie.
> 
> 
> Repository: oozie-git
> 
> 
> Description
> ---
> 
> Add indices to speed up SELECT operations.
> 
> 
> Index user_name column
> 
> for purge service OOZIE-1803:
> CREATE INDEX "OOZIEDB"."BUNDLE_JOBS_END_TIME_IDX" ON "BUNDLE_JOBS" 
> ("END_TIME");
> CREATE INDEX "OOZIEDB"."COORD_JOBS_END_TIME_IDX" ON "COORD_JOBS" ("END_TIME");
> CREATE INDEX "OOZIEDB"."WF_JOBS_END_TIME_IDX" ON "WF_JOBS" ("END_TIME");
> CREATE INDEX "OOZIEDB"."COORD_ACTIONS_JOB_ID_IDX" ON "COORD_ACTIONS" 
> ("JOB_ID");
> CREATE INDEX "OOZIEDB"."COORD_JOBS_BUNDLE_ID_IDX" ON "COORD_JOBS" 
> ("BUNDLE_ID");
> CREATE INDEX "OOZIEDB"."WF_ACTIONS_WF_ID_IDX" ON "WF_ACTIONS" ("WF_ID");
> CREATE INDEX "OOZIEDB"."WF_JOBS_PARENT_ID_IDX" ON "WF_JOBS" ("PARENT_ID");
> CREATE INDEX "OOZIEDB"."BUNDLE_ACTIONS_BUNDLE_ID_IDX" ON "BUNDLE_ACTIONS" 
> ("BUNDLE_ID");
> 
> Composite indices to speed up operations on the web UI
> 
> 
> Diffs
> -
> 
>   core/src/main/java/org/apache/oozie/BundleJobBean.java 
> b42f12841c2f9cb6d508cd2ac2f393e6407d1cf0 
>   core/src/main/java/org/apache/oozie/CoordinatorJobBean.java 
> 99c7d3c474d9e1e22e2f5a927c03d71b9292b663 
>   core/src/main/java/org/apache/oozie/WorkflowJobBean.java 
> cd9a6df42e552a0607606a244b81978747d89b41 
>   tools/src/main/java/org/apache/oozie/tools/OozieDBCLI.java 
> a8b2234966c967f9ad9d722628bd486012b14bd3 
> 
> 
> Diff: https://reviews.apache.org/r/65385/diff/1/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Attila Sasvari
> 
>

[jira] [Commented] (OOZIE-1717) Index user_name column

2018-01-29 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-1717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343463#comment-16343463
 ] 

Hadoop QA commented on OOZIE-1717:
--

PreCommit-OOZIE-Build started


> Index user_name column
> --
>
> Key: OOZIE-1717
> URL: https://issues.apache.org/jira/browse/OOZIE-1717
> Project: Oozie
>  Issue Type: Bug
>Reporter: Purshotam Shah
>Assignee: Attila Sasvari
>Priority: Minor
> Attachments: OOZIE-1717-00.patch, OOZIE-1717-002.patch, 
> OOZIE-1717-01.patch
>
>
> User_name is one of the frequently used filter. Adding index should avoid  
> full db scan.
> Index need to be done for BUNDLE_JOBS,COORD_JOBS and WF_JOBS.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Review Request 65385: OOZIE-1717 add indices to speed up db queries

2018-01-29 Thread Attila Sasvari via Review Board


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/65385/
---

Review request for oozie.


Repository: oozie-git


Description
---

Add indices to speed up SELECT operations.


Index user_name column

for purge service OOZIE-1803:
CREATE INDEX "OOZIEDB"."BUNDLE_JOBS_END_TIME_IDX" ON "BUNDLE_JOBS" ("END_TIME");
CREATE INDEX "OOZIEDB"."COORD_JOBS_END_TIME_IDX" ON "COORD_JOBS" ("END_TIME");
CREATE INDEX "OOZIEDB"."WF_JOBS_END_TIME_IDX" ON "WF_JOBS" ("END_TIME");
CREATE INDEX "OOZIEDB"."COORD_ACTIONS_JOB_ID_IDX" ON "COORD_ACTIONS" ("JOB_ID");
CREATE INDEX "OOZIEDB"."COORD_JOBS_BUNDLE_ID_IDX" ON "COORD_JOBS" ("BUNDLE_ID");
CREATE INDEX "OOZIEDB"."WF_ACTIONS_WF_ID_IDX" ON "WF_ACTIONS" ("WF_ID");
CREATE INDEX "OOZIEDB"."WF_JOBS_PARENT_ID_IDX" ON "WF_JOBS" ("PARENT_ID");
CREATE INDEX "OOZIEDB"."BUNDLE_ACTIONS_BUNDLE_ID_IDX" ON "BUNDLE_ACTIONS" 
("BUNDLE_ID");

Composite indices to speed up operations on the web UI


Diffs
-

  core/src/main/java/org/apache/oozie/BundleJobBean.java 
b42f12841c2f9cb6d508cd2ac2f393e6407d1cf0 
  core/src/main/java/org/apache/oozie/CoordinatorJobBean.java 
99c7d3c474d9e1e22e2f5a927c03d71b9292b663 
  core/src/main/java/org/apache/oozie/WorkflowJobBean.java 
cd9a6df42e552a0607606a244b81978747d89b41 
  tools/src/main/java/org/apache/oozie/tools/OozieDBCLI.java 
a8b2234966c967f9ad9d722628bd486012b14bd3 


Diff: https://reviews.apache.org/r/65385/diff/1/


Testing
---


Thanks,

Attila Sasvari

[jira] [Updated] (OOZIE-1717) Index user_name column

2018-01-29 Thread Attila Sasvari (JIRA)


 [ 
https://issues.apache.org/jira/browse/OOZIE-1717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Attila Sasvari updated OOZIE-1717:
--
Attachment: OOZIE-1717-002.patch

> Index user_name column
> --
>
> Key: OOZIE-1717
> URL: https://issues.apache.org/jira/browse/OOZIE-1717
> Project: Oozie
>  Issue Type: Bug
>Reporter: Purshotam Shah
>Assignee: Attila Sasvari
>Priority: Minor
> Attachments: OOZIE-1717-00.patch, OOZIE-1717-002.patch, 
> OOZIE-1717-01.patch
>
>
> User_name is one of the frequently used filter. Adding index should avoid  
> full db scan.
> Index need to be done for BUNDLE_JOBS,COORD_JOBS and WF_JOBS.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Failed: OOZIE-3121 PreCommit Build #356

2018-01-29 Thread Apache Jenkins Server

Jira: https://issues.apache.org/jira/browse/OOZIE-3121
Build: https://builds.apache.org/job/PreCommit-OOZIE-Build/356/

###
## LAST 100 LINES OF THE CONSOLE 
###
[...truncated 693.34 KB...]
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 
/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/zookeeper-security-tests/src/main/resources
[INFO] Copying 3 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ 
oozie-zookeeper-security-tests ---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ 
oozie-zookeeper-security-tests ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 
/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/zookeeper-security-tests/src/test/resources
[INFO] Copying 3 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ 
oozie-zookeeper-security-tests ---
[INFO] Compiling 2 source files to 
/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/zookeeper-security-tests/target/test-classes
[INFO] 
[INFO] >>> findbugs-maven-plugin:3.0.1:check (default-cli) > :findbugs @ 
oozie-zookeeper-security-tests >>>
[INFO] 
[INFO] --- findbugs-maven-plugin:3.0.1:findbugs (findbugs) @ 
oozie-zookeeper-security-tests ---
[INFO] 
[INFO] <<< findbugs-maven-plugin:3.0.1:check (default-cli) < :findbugs @ 
oozie-zookeeper-security-tests <<<
[INFO] 
[INFO] 
[INFO] --- findbugs-maven-plugin:3.0.1:check (default-cli) @ 
oozie-zookeeper-security-tests ---
[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Oozie Main .. SUCCESS [  1.992 s]
[INFO] Apache Oozie Client  SUCCESS [ 19.553 s]
[INFO] Apache Oozie Share Lib Oozie ... SUCCESS [ 15.170 s]
[INFO] Apache Oozie Share Lib HCatalog  SUCCESS [  8.275 s]
[INFO] Apache Oozie Share Lib Distcp .. SUCCESS [  6.047 s]
[INFO] Apache Oozie Core .. SUCCESS [01:23 min]
[INFO] Apache Oozie Share Lib Streaming ... SUCCESS [ 10.006 s]
[INFO] Apache Oozie Share Lib Pig . SUCCESS [  9.744 s]
[INFO] Apache Oozie Share Lib Hive  SUCCESS [ 10.290 s]
[INFO] Apache Oozie Share Lib Hive 2 .. SUCCESS [ 10.891 s]
[INFO] Apache Oozie Share Lib Sqoop ... SUCCESS [  7.616 s]
[INFO] Apache Oozie Examples .. SUCCESS [ 10.576 s]
[INFO] Apache Oozie Share Lib Spark ... SUCCESS [ 13.899 s]
[INFO] Apache Oozie Share Lib . SUCCESS [  0.019 s]
[INFO] Apache Oozie Docs .. SUCCESS [  3.644 s]
[INFO] Apache Oozie WebApp  SUCCESS [  3.577 s]
[INFO] Apache Oozie Tools . SUCCESS [ 16.079 s]
[INFO] Apache Oozie MiniOozie . SUCCESS [  2.749 s]
[INFO] Apache Oozie Server  SUCCESS [ 12.997 s]
[INFO] Apache Oozie Distro  SUCCESS [  2.454 s]
[INFO] Apache Oozie ZooKeeper Security Tests .. SUCCESS [  4.416 s]
[INFO] 
[INFO] BUILD SUCCESS
[INFO] 
[INFO] Total time: 04:14 min
[INFO] Finished at: 2018-01-29T14:57:46Z
[INFO] Final Memory: 654M/1835M
[INFO] 
[TRACE] FindBugs output in HEAD verified and saved
  Running test-patch task BACKWARDS_COMPATIBILITY
  Running test-patch task TESTS
  Running test-patch task DISTRO

Applying patch

Checking patch pom.xml...
error: while searching for:

org.apache.maven.plugins
maven-enforcer-plugin
1.0


org.apache.maven.plugins
maven-compiler-plugin
2.3.2


org.apache.maven.plugins

error: patch failed: pom.xml:1592
error: pom.xml: patch does not apply
fatal: git diff header lacks filename information when removing 1 leading 
pathname component (line 5)
Patch failed to apply to head of branch

Adding comment to JIRA
  % Total% Received % Xferd  Average Speed   TimeTime Time  Current
 Dload  Upload   Total   SpentLeft  Speed
  0 0

[jira] [Commented] (OOZIE-3121) bump all maven plugins to latest versions

2018-01-29 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-3121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343441#comment-16343441
 ] 

Hadoop QA commented on OOZIE-3121:
--


Testing JIRA OOZIE-3121

Cleaning local git workspace



{color:red}-1{color} Patch failed to apply to head of branch




> bump all maven plugins to latest versions
> -
>
> Key: OOZIE-3121
> URL: https://issues.apache.org/jira/browse/OOZIE-3121
> Project: Oozie
>  Issue Type: Improvement
>Affects Versions: 4.3.0
>Reporter: Artem Ervits
>Assignee: Artem Ervits
>Priority: Major
> Fix For: 5.0.0
>
> Attachments: OOZIE-3121.patch
>
>
> bump all maven plugins to latest



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Failed: OOZIE-3121 PreCommit Build #355

2018-01-29 Thread Apache Jenkins Server

Jira: https://issues.apache.org/jira/browse/OOZIE-3121
Build: https://builds.apache.org/job/PreCommit-OOZIE-Build/355/

###
## LAST 100 LINES OF THE CONSOLE 
###
[...truncated 693.68 KB...]
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 
/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/zookeeper-security-tests/src/main/resources
[INFO] Copying 3 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ 
oozie-zookeeper-security-tests ---
[INFO] No sources to compile
[INFO] 
[INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ 
oozie-zookeeper-security-tests ---
[debug] execute contextualize
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory 
/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/zookeeper-security-tests/src/test/resources
[INFO] Copying 3 resources
[INFO] Copying 3 resources
[INFO] 
[INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ 
oozie-zookeeper-security-tests ---
[INFO] Compiling 2 source files to 
/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/zookeeper-security-tests/target/test-classes
[INFO] 
[INFO] >>> findbugs-maven-plugin:3.0.1:check (default-cli) > :findbugs @ 
oozie-zookeeper-security-tests >>>
[INFO] 
[INFO] --- findbugs-maven-plugin:3.0.1:findbugs (findbugs) @ 
oozie-zookeeper-security-tests ---
[INFO] 
[INFO] <<< findbugs-maven-plugin:3.0.1:check (default-cli) < :findbugs @ 
oozie-zookeeper-security-tests <<<
[INFO] 
[INFO] 
[INFO] --- findbugs-maven-plugin:3.0.1:check (default-cli) @ 
oozie-zookeeper-security-tests ---
[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Oozie Main .. SUCCESS [  1.890 s]
[INFO] Apache Oozie Client  SUCCESS [ 16.946 s]
[INFO] Apache Oozie Share Lib Oozie ... SUCCESS [ 13.528 s]
[INFO] Apache Oozie Share Lib HCatalog  SUCCESS [  6.884 s]
[INFO] Apache Oozie Share Lib Distcp .. SUCCESS [  5.166 s]
[INFO] Apache Oozie Core .. SUCCESS [01:15 min]
[INFO] Apache Oozie Share Lib Streaming ... SUCCESS [  8.849 s]
[INFO] Apache Oozie Share Lib Pig . SUCCESS [  9.247 s]
[INFO] Apache Oozie Share Lib Hive  SUCCESS [  9.030 s]
[INFO] Apache Oozie Share Lib Hive 2 .. SUCCESS [  9.958 s]
[INFO] Apache Oozie Share Lib Sqoop ... SUCCESS [  6.658 s]
[INFO] Apache Oozie Examples .. SUCCESS [  9.630 s]
[INFO] Apache Oozie Share Lib Spark ... SUCCESS [ 12.654 s]
[INFO] Apache Oozie Share Lib . SUCCESS [  0.018 s]
[INFO] Apache Oozie Docs .. SUCCESS [  3.407 s]
[INFO] Apache Oozie WebApp  SUCCESS [  3.205 s]
[INFO] Apache Oozie Tools . SUCCESS [ 14.705 s]
[INFO] Apache Oozie MiniOozie . SUCCESS [  2.613 s]
[INFO] Apache Oozie Server  SUCCESS [ 11.955 s]
[INFO] Apache Oozie Distro  SUCCESS [  2.158 s]
[INFO] Apache Oozie ZooKeeper Security Tests .. SUCCESS [  4.084 s]
[INFO] 
[INFO] BUILD SUCCESS
[INFO] 
[INFO] Total time: 03:49 min
[INFO] Finished at: 2018-01-29T14:52:42Z
[INFO] Final Memory: 654M/1845M
[INFO] 
[TRACE] FindBugs output in HEAD verified and saved
  Running test-patch task BACKWARDS_COMPATIBILITY
  Running test-patch task TESTS
  Running test-patch task DISTRO

Applying patch

Checking patch pom.xml...
error: while searching for:

org.apache.maven.plugins
maven-enforcer-plugin
1.0


org.apache.maven.plugins
maven-compiler-plugin
2.3.2


org.apache.maven.plugins

error: patch failed: pom.xml:1592
error: pom.xml: patch does not apply
fatal: git diff header lacks filename information when removing 1 leading 
pathname component (line 5)
Patch failed to apply to head of branch

Adding comment to JIRA
  % Total% Received % Xferd  Average Speed   TimeTime Time  Current
 Dload  Upload   Total   SpentLeft  Speed
  0 0

[jira] [Commented] (OOZIE-3121) bump all maven plugins to latest versions

2018-01-29 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-3121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343434#comment-16343434
 ] 

Hadoop QA commented on OOZIE-3121:
--


Testing JIRA OOZIE-3121

Cleaning local git workspace



{color:red}-1{color} Patch failed to apply to head of branch




> bump all maven plugins to latest versions
> -
>
> Key: OOZIE-3121
> URL: https://issues.apache.org/jira/browse/OOZIE-3121
> Project: Oozie
>  Issue Type: Improvement
>Affects Versions: 4.3.0
>Reporter: Artem Ervits
>Assignee: Artem Ervits
>Priority: Major
> Fix For: 5.0.0
>
> Attachments: OOZIE-3121.patch
>
>
> bump all maven plugins to latest



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (OOZIE-3121) bump all maven plugins to latest versions

2018-01-29 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-3121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343433#comment-16343433
 ] 

Hadoop QA commented on OOZIE-3121:
--

PreCommit-OOZIE-Build started


> bump all maven plugins to latest versions
> -
>
> Key: OOZIE-3121
> URL: https://issues.apache.org/jira/browse/OOZIE-3121
> Project: Oozie
>  Issue Type: Improvement
>Affects Versions: 4.3.0
>Reporter: Artem Ervits
>Assignee: Artem Ervits
>Priority: Major
> Fix For: 5.0.0
>
> Attachments: OOZIE-3121.patch
>
>
> bump all maven plugins to latest



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Comment Edited] (OOZIE-3168) Remove -secure option from DG_QuickStart.twiki and from oozie-setup.sh

2018-01-29 Thread Peter Cseh (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-3168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343421#comment-16343421
 ] 

Peter Cseh edited comment on OOZIE-3168 at 1/29/18 2:45 PM:


[~kmarton], could you rebase the patch? It's not applying to master anymore.


was (Author: gezapeti):
+1

> Remove -secure option from DG_QuickStart.twiki and from oozie-setup.sh 
> ---
>
> Key: OOZIE-3168
> URL: https://issues.apache.org/jira/browse/OOZIE-3168
> Project: Oozie
>  Issue Type: Bug
>  Components: docs, scripts
>Affects Versions: trunk
>Reporter: Julia Kinga Marton
>Assignee: Julia Kinga Marton
>Priority: Major
> Attachments: OOZIE-3168-001.patch
>
>
> The DG_QuickStart.twiki still contains reference to the -secure option from 
> DG_QuickStart.twiki: 
> [https://github.com/apache/oozie/blob/master/docs/src/site/twiki/DG_QuickStart.twiki#L149-L150]
> This is a valid option in the oozie-setup.sh, but is not used anymore.
> oozie-setup.ps1 also contains reference to -prepare-war and -secure options:
> [https://github.com/apache/oozie/blob/master/distro/src/main/bin/oozie-setup.ps1#L26]
>  
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (OOZIE-3168) Remove -secure option from DG_QuickStart.twiki and from oozie-setup.sh

2018-01-29 Thread Peter Cseh (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-3168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343421#comment-16343421
 ] 

Peter Cseh commented on OOZIE-3168:
---

+1

> Remove -secure option from DG_QuickStart.twiki and from oozie-setup.sh 
> ---
>
> Key: OOZIE-3168
> URL: https://issues.apache.org/jira/browse/OOZIE-3168
> Project: Oozie
>  Issue Type: Bug
>  Components: docs, scripts
>Affects Versions: trunk
>Reporter: Julia Kinga Marton
>Assignee: Julia Kinga Marton
>Priority: Major
> Attachments: OOZIE-3168-001.patch
>
>
> The DG_QuickStart.twiki still contains reference to the -secure option from 
> DG_QuickStart.twiki: 
> [https://github.com/apache/oozie/blob/master/docs/src/site/twiki/DG_QuickStart.twiki#L149-L150]
> This is a valid option in the oozie-setup.sh, but is not used anymore.
> oozie-setup.ps1 also contains reference to -prepare-war and -secure options:
> [https://github.com/apache/oozie/blob/master/distro/src/main/bin/oozie-setup.ps1#L26]
>  
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (OOZIE-3172) Upgrade non-transitive Jackson dependencies from org.codehaus.jackson to com.fasterxml.jackson

2018-01-29 Thread Hadoop QA (JIRA)


[ 
https://issues.apache.org/jira/browse/OOZIE-3172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343408#comment-16343408
 ] 

Hadoop QA commented on OOZIE-3172:
--

PreCommit-OOZIE-Build started


> Upgrade non-transitive Jackson dependencies from org.codehaus.jackson to 
> com.fasterxml.jackson
> --
>
> Key: OOZIE-3172
> URL: https://issues.apache.org/jira/browse/OOZIE-3172
> Project: Oozie
>  Issue Type: Improvement
>  Components: core
>Affects Versions: 5.0.0b1
>Reporter: Andras Piros
>Assignee: Andras Piros
>Priority: Major
> Attachments: OOZIE-3172.001.patch
>
>
> Jackson 1.9.3 is way too old, and has several security vulnerabilities as 
> well. Jackson 2.9.2 covers most of these.
> Let's switch from {{org.codehaus.jackson}} to {{com.fasterxml.jackson}} in 
> Oozie's direct (non-transitive) dependencies.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (OOZIE-3172) Upgrade non-transitive Jackson dependencies from org.codehaus.jackson to com.fasterxml.jackson

2018-01-29 Thread Andras Piros (JIRA)


 [ 
https://issues.apache.org/jira/browse/OOZIE-3172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andras Piros updated OOZIE-3172:

Attachment: OOZIE-3172.001.patch

> Upgrade non-transitive Jackson dependencies from org.codehaus.jackson to 
> com.fasterxml.jackson
> --
>
> Key: OOZIE-3172
> URL: https://issues.apache.org/jira/browse/OOZIE-3172
> Project: Oozie
>  Issue Type: Improvement
>  Components: core
>Affects Versions: 5.0.0b1
>Reporter: Andras Piros
>Assignee: Andras Piros
>Priority: Major
> Attachments: OOZIE-3172.001.patch
>
>
> Jackson 1.9.3 is way too old, and has several security vulnerabilities as 
> well. Jackson 2.9.2 covers most of these.
> Let's switch from {{org.codehaus.jackson}} to {{com.fasterxml.jackson}} in 
> Oozie's direct (non-transitive) dependencies.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (OOZIE-3172) Upgrade non-transitive Jackson dependencies from org.codehaus.jackson to com.fasterxml.jackson

2018-01-29 Thread Andras Piros (JIRA)

Andras Piros created OOZIE-3172:
---

 Summary: Upgrade non-transitive Jackson dependencies from 
org.codehaus.jackson to com.fasterxml.jackson
 Key: OOZIE-3172
 URL: https://issues.apache.org/jira/browse/OOZIE-3172
 Project: Oozie
  Issue Type: Improvement
  Components: core
Affects Versions: 5.0.0b1
Reporter: Andras Piros
Assignee: Andras Piros


Jackson 1.9.3 is way too old, and has several security vulnerabilities as well. 
Jackson 2.9.2 covers most of these.

Let's switch from {{org.codehaus.jackson}} to {{com.fasterxml.jackson}} in 
Oozie's direct (non-transitive) dependencies.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: [VOTE] Release Oozie 4.3.1 (candidate 3)

2018-01-29 Thread Attila Sasvari

+1 (non-binding)

- Verified hash, signature files, rat report
- Built Oozie distro with hadoop.version set to 2.6.0 using the uber,
hadoop-2, spark-1 profiles
- Submitted example workflows/coordinators/bundles (except hive related
ones) on a hadoop 2.6.0 in pseudo distributed mode
- Verified Tomcat version was 6.0.53
- Clicked through the web UI, log retrieval worked, job DAG-s were
rendered, version was correct.
- Verified instrumentation, SLA pages; they are now HTML based as expected
(OOZIE-2533). However, json2.js is referenced by webapp/index.html and it
is not found (not a blocker in my opinion).
- Enabled SLA, re-submitted sla coordinator example, and retrieved SLA
details for the "one-op-wf" application, graph was displayed properly.

I used JDK 1.8.0_121

On Sun, Jan 28, 2018 at 7:09 AM, Satish Saley 
wrote:

> Hi,
>
> I have created a build for Oozie 4.3.1, candidate 3.
>
> It includes all the changes decided earlier except OOZIE-3018, OOZIE-2771
> and
> OOZIE-3072. OOZIE-3018 makes changes to SchemaCheckerService which we are
> not picking.
> OOZIE-2771 makes changes to file created in OOZIE-2666.
> OOZIE-3072 makes changes to files created in OOZIE-1770.
>
>
> Keys to verify the signature of the release artifact are available at
>   http://www.apache.org/dist/oozie/KEYS
>
> Please download, test, and try it out:
>
> http://people.apache.org/~satishsaley/oozie-4.3.1-rc3/
>
>
> The release, md5 signature, gpg signature, and rat report can be found at
> the above address.
>
> Vote closes on 01/31/2018 11:59 PM PT.
>



-- 
-- 
Attila Sasvari
Software Engineer

[jira] [Commented] (OOZIE-3168) Remove -secure option from DG_QuickStart.twiki and from oozie-setup.sh

[jira] [Commented] (OOZIE-3168) Remove -secure option from DG_QuickStart.twiki and from oozie-setup.sh

[jira] [Updated] (OOZIE-3168) Remove -secure option from DG_QuickStart.twiki and from oozie-setup.sh

[jira] Subscription: Oozie Patch Available

[jira] Subscription: Oozie Patch Available

Re: [VOTE] Release Oozie 4.3.1 (candidate 3)

[jira] [Commented] (OOZIE-3057) Custom Partitioner not working in Oozie Mapreduce action

[jira] [Commented] (OOZIE-3061) Kill only those child jobs which are not already killed

[jira] [Assigned] (OOZIE-3061) Kill only those child jobs which are not already killed

Re: Review Request 65385: OOZIE-1717 add indices to speed up db queries

[jira] [Commented] (OOZIE-1717) Index user_name column

Failed: OOZIE-1717 PreCommit Build #358

Failed: OOZIE-1717 PreCommit Build #357

[jira] [Commented] (OOZIE-1717) Index user_name column

[jira] [Commented] (OOZIE-3172) Upgrade non-transitive Jackson dependencies from org.codehaus.jackson to com.fasterxml.jackson

Failed: OOZIE-3172 PreCommit Build #354

[jira] [Commented] (OOZIE-1717) Index user_name column

[jira] [Commented] (OOZIE-1717) Index user_name column

[jira] [Updated] (OOZIE-1717) Index user_name column

Re: Review Request 65385: OOZIE-1717 add indices to speed up db queries

[jira] [Commented] (OOZIE-1717) Index user_name column

Review Request 65385: OOZIE-1717 add indices to speed up db queries

[jira] [Updated] (OOZIE-1717) Index user_name column

Failed: OOZIE-3121 PreCommit Build #356

[jira] [Commented] (OOZIE-3121) bump all maven plugins to latest versions

Failed: OOZIE-3121 PreCommit Build #355

[jira] [Commented] (OOZIE-3121) bump all maven plugins to latest versions

[jira] [Commented] (OOZIE-3121) bump all maven plugins to latest versions

[jira] [Comment Edited] (OOZIE-3168) Remove -secure option from DG_QuickStart.twiki and from oozie-setup.sh

[jira] [Commented] (OOZIE-3168) Remove -secure option from DG_QuickStart.twiki and from oozie-setup.sh

[jira] [Commented] (OOZIE-3172) Upgrade non-transitive Jackson dependencies from org.codehaus.jackson to com.fasterxml.jackson

[jira] [Updated] (OOZIE-3172) Upgrade non-transitive Jackson dependencies from org.codehaus.jackson to com.fasterxml.jackson

[jira] [Created] (OOZIE-3172) Upgrade non-transitive Jackson dependencies from org.codehaus.jackson to com.fasterxml.jackson

Re: [VOTE] Release Oozie 4.3.1 (candidate 3)

34 matches

Site Navigation

Mail list logo

Footer information