Re: Review Request 21312: OOZIE-1830 Change hadoop-1 profile to use 1.2.1
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/21312/ --- (Updated June 2, 2014, 6 a.m.) Review request for oozie. Changes --- The new patch adds oozie-hadoop-auth modules to specify hadoop-auth dependency. * oozie-hadoop-auth-0.23 : hadoop-auth-0.23 * oozie-hadoop-auth-1 : hadoop-core-1.2.1 * oozie-hadoop-auth-2 : hadoop-auth-2.3.0 Bugs: OOZIE-1830 https://issues.apache.org/jira/browse/OOZIE-1830 Repository: oozie-git Description --- We should change the hadoop-1 profile to use 1.2.1 instead of 1.1.1. Diffs (updated) - client/pom.xml 486a4ec hadooplibs/hadoop-1/pom.xml 30a5996 hadooplibs/hadoop-auth-0.23/pom.xml PRE-CREATION hadooplibs/hadoop-auth-1/pom.xml PRE-CREATION hadooplibs/hadoop-auth-2/pom.xml PRE-CREATION hadooplibs/hadoop-distcp-1/pom.xml fa21703 hadooplibs/hadoop-test-1/pom.xml 3d4b409 hadooplibs/hadoop-utils-1/pom.xml 0d10e7a hadooplibs/pom.xml 788788c pom.xml b5e0e4e tools/pom.xml 487783d Diff: https://reviews.apache.org/r/21312/diff/ Testing --- Thanks, Azrael Park
[jira] [Commented] (OOZIE-1830) Change hadoop-1 profile to use 1.2.1
[
https://issues.apache.org/jira/browse/OOZIE-1830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14015198#comment-14015198
]
Hadoop QA commented on OOZIE-1830:
--
Testing JIRA OOZIE-1830
Cleaning local git workspace
{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc
warnings
{color:red}-1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:red}-1{color} the patch seems to introduce 11 new javac warning(s)
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color} - patch does not compile, cannot run testcases
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch
{color:red}*-1 Overall result, please check the reported -1(s)*{color}
The full output of the test-patch run is available at
. https://builds.apache.org/job/oozie-trunk-precommit-build/1285/
Change hadoop-1 profile to use 1.2.1
Key: OOZIE-1830
URL: https://issues.apache.org/jira/browse/OOZIE-1830
Project: Oozie
Issue Type: Improvement
Affects Versions: trunk, 4.0.1
Reporter: Azrael
Priority: Minor
Attachments: OOZIE-1830.1.patch, OOZIE-1830.2.patch
We should change the hadoop-1 profile to use 1.2.1 instead of 1.1.1.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
Build failed in Jenkins: oozie-trunk-precommit-build #1285
See https://builds.apache.org/job/oozie-trunk-precommit-build/1285/changes Changes: [rkanter] OOZIE-1724 Make it easier to specify the HCat hive-site.xml for the Oozie Server (rkanter) [rkanter] OOZIE-1828 Introduce counters JobStatus terminal states metrics (rkanter) -- [...truncated 10081 lines...] [INFO] share/lib already added, skipping [INFO] already added, skipping [INFO] share already added, skipping [INFO] share/lib already added, skipping [INFO] Building tar : https://builds.apache.org/job/oozie-trunk-precommit-build/ws/sharelib/target/oozie-sharelib-4.1.0-SNAPSHOT.tar.gz [INFO] already added, skipping [INFO] share already added, skipping [INFO] share/lib already added, skipping [INFO] already added, skipping [INFO] share already added, skipping [INFO] share/lib already added, skipping [INFO] already added, skipping [INFO] share already added, skipping [INFO] share/lib already added, skipping [INFO] already added, skipping [INFO] share already added, skipping [INFO] share/lib already added, skipping [INFO] already added, skipping [INFO] share already added, skipping [INFO] share/lib already added, skipping [INFO] already added, skipping [INFO] share already added, skipping [INFO] share/lib already added, skipping [INFO] [INFO] [INFO] Building Apache Oozie Tools 4.1.0-SNAPSHOT [INFO] [WARNING] Could not transfer metadata asm:asm/maven-metadata.xml from/to local.repository (file:../../local.repository/trunk): No connector available to access repository local.repository (file:../../local.repository/trunk) of type legacy using the available factories WagonRepositoryConnectorFactory [WARNING] Could not transfer metadata asm:asm/maven-metadata.xml from/to local.repository (file:../../local.repository/trunk): No connector available to access repository local.repository (file:../../local.repository/trunk) of type legacy using the available factories WagonRepositoryConnectorFactory [INFO] [INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ oozie-tools --- [debug] execute contextualize [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory https://builds.apache.org/job/oozie-trunk-precommit-build/ws/tools/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ oozie-tools --- [INFO] Nothing to compile - all classes are up to date [INFO] [INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ oozie-tools --- [debug] execute contextualize [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 2 resources [INFO] [INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ oozie-tools --- [INFO] Nothing to compile - all classes are up to date [INFO] [INFO] --- maven-surefire-plugin:2.12:test (default-test) @ oozie-tools --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ oozie-tools --- [INFO] Building jar: https://builds.apache.org/job/oozie-trunk-precommit-build/ws/tools/target/oozie-tools-4.1.0-SNAPSHOT.jar [INFO] [INFO] --- maven-assembly-plugin:2.2.1:single (default-cli) @ oozie-tools --- [INFO] Reading assembly descriptor: ../src/main/assemblies/tools.xml [WARNING] The following patterns were never triggered in this artifact exclusion filter: o '*:*:pom:*' [INFO] Copying files to https://builds.apache.org/job/oozie-trunk-precommit-build/ws/tools/target/oozie-tools-4.1.0-SNAPSHOT-tools [WARNING] Assembly file: https://builds.apache.org/job/oozie-trunk-precommit-build/ws/tools/target/oozie-tools-4.1.0-SNAPSHOT-tools is not a regular file (it may be a directory). It cannot be attached to the project build for installation or deployment. [INFO] [INFO] [INFO] Building Apache Oozie MiniOozie 4.1.0-SNAPSHOT [INFO] [INFO] [INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ oozie-mini --- [debug] execute contextualize [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory https://builds.apache.org/job/oozie-trunk-precommit-build/ws/minitest/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ oozie-mini --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ oozie-mini --- [debug] execute contextualize [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 3 resources [INFO] [INFO] --- maven-compiler-plugin:2.3.2:testCompile
[jira] [Created] (OOZIE-1867) specifying wrong jobtracker port hangs oozie job in setup process
Manish Nema created OOZIE-1867: -- Summary: specifying wrong jobtracker port hangs oozie job in setup process Key: OOZIE-1867 URL: https://issues.apache.org/jira/browse/OOZIE-1867 Project: Oozie Issue Type: Improvement Components: workflow Affects Versions: 3.3.2 Environment: Hortonworks HDP 1.3 Reporter: Manish Nema When specify any working port which is not default jobtracker IPC port. Oozie submits workflow and remain in setup at MapReduce state forever. Instead it should time out and tell the unable to submit the job at the cluster. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (OOZIE-1740) Add a new function hadoop:conf() that can be invoked from the workflow.xml and will return a hadoop configuration option
[
https://issues.apache.org/jira/browse/OOZIE-1740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14015466#comment-14015466
]
sam liu commented on OOZIE-1740:
Hi Robert,
Sorry for responsing so late. According your comments, I tried
'Services.get().get(HadoopAccessorService.class).createJobConf(hostPort)' and
it really works well to current EL function. Now my function looks like:
public static String hadoop_conf(String hadoopConfHostPort, String
propName) {
Configuration conf =
Services.get().get(HadoopAccessorService.class).createJobConf(hadoopConfHostPort);
String prop = conf.get(propName);
if(prop == null || prop.equals()){
conf = new Configuration();
prop = conf.get(propName);
}
return conf.get(propName);
}
And in the workflow.xml, we should invoke the EL function like:
property
namemapreduce.map.java.opts/name
value${hadoop:conf('jobtracker.host:9001',
'mapreduce.map.java.opts')} -Xss512k /value
/property
I did some tests and this could return expected results.
Now I am studying how to implement regarding coordinator EL functions. Will let
you know if have any progress.
Please let me know if any comments/suggestions. Thanks a lot!
Add a new function hadoop:conf() that can be invoked from the workflow.xml
and will return a hadoop configuration option
Key: OOZIE-1740
URL: https://issues.apache.org/jira/browse/OOZIE-1740
Project: Oozie
Issue Type: Improvement
Components: workflow
Affects Versions: trunk, 3.3.2
Reporter: sam liu
Assignee: sam liu
Attachments: OOZIE-1740.patch, OOZIE-1740.patch
--
This message was sent by Atlassian JIRA
(v6.2#6252)
Re: Review Request 18754: OOZIE-1492 HA support for HCat
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/18754/#review44510 --- core/src/main/java/org/apache/oozie/service/PartitionDependencyManagerService.java https://reviews.apache.org/r/18754/#comment78913 should be outside if block core/src/main/java/org/apache/oozie/dependency/hcat/SimpleHCatDependencyCache.java https://reviews.apache.org/r/18754/#comment78914 putIfAbsent and if existing not null then that should be used core/src/main/java/org/apache/oozie/dependency/hcat/SimpleHCatDependencyCache.java https://reviews.apache.org/r/18754/#comment78915 Remove actionID from actionPartitionMap if partitionMap is empty core/src/main/java/org/apache/oozie/dependency/hcat/SimpleHCatDependencyCache.java https://reviews.apache.org/r/18754/#comment78922 Can directly remove without adding to a list - Rohini Palaniswamy On May 29, 2014, 9:46 p.m., Ryota Egashira wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/18754/ --- (Updated May 29, 2014, 9:46 p.m.) Review request for oozie. Bugs: OOZIE-1492 https://issues.apache.org/jira/browse/OOZIE-1492 Repository: oozie-git Description --- https://issues.apache.org/jira/browse/OOZIE-1492 Diffs - core/src/main/java/org/apache/oozie/CoordinatorActionBean.java 43d5103 core/src/main/java/org/apache/oozie/command/coord/CoordPushDependencyCheckXCommand.java 2e5cd47 core/src/main/java/org/apache/oozie/dependency/hcat/EhcacheHCatDependencyCache.java 6f127c4 core/src/main/java/org/apache/oozie/dependency/hcat/HCatDependencyCache.java df3afd3 core/src/main/java/org/apache/oozie/dependency/hcat/SimpleHCatDependencyCache.java e8e3ebc core/src/main/java/org/apache/oozie/executor/jpa/CoordActionQueryExecutor.java f5304ca core/src/main/java/org/apache/oozie/service/JobsConcurrencyService.java 27c97e6 core/src/main/java/org/apache/oozie/service/PartitionDependencyManagerService.java 985dcab core/src/main/java/org/apache/oozie/service/ZKJobsConcurrencyService.java 611b74c core/src/test/java/org/apache/oozie/command/coord/TestCoordPushDependencyCheckXCommand.java da09727 core/src/test/java/org/apache/oozie/service/TestHAPartitionDependencyManagerEhCache.java PRE-CREATION core/src/test/java/org/apache/oozie/service/TestHAPartitionDependencyManagerService.java PRE-CREATION core/src/test/java/org/apache/oozie/service/TestPartitionDependencyManagerEhcache.java cfdfbd1 core/src/test/java/org/apache/oozie/service/TestPartitionDependencyManagerService.java ef71fb0 core/src/test/java/org/apache/oozie/test/XTestCase.java 1536927 core/src/test/java/org/apache/oozie/test/ZKXTestCase.java 7bebaf0 Diff: https://reviews.apache.org/r/18754/diff/ Testing --- Thanks, Ryota Egashira
Build failed in Jenkins: oozie-trunk-precommit-build #1286
See https://builds.apache.org/job/oozie-trunk-precommit-build/1286/ -- [...truncated 2836 lines...] [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory https://builds.apache.org/job/oozie-trunk-precommit-build/ws/examples/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ oozie-examples --- [INFO] Compiling 11 source files to https://builds.apache.org/job/oozie-trunk-precommit-build/ws/examples/target/classes [INFO] [INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ oozie-examples --- [debug] execute contextualize [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 7 resources [INFO] [INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ oozie-examples --- [INFO] Compiling 1 source file to https://builds.apache.org/job/oozie-trunk-precommit-build/ws/examples/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.12:test (default-test) @ oozie-examples --- [INFO] Tests are skipped. [INFO] [INFO] [INFO] Building Apache Oozie Share Lib 4.1.0-SNAPSHOT [INFO] [INFO] [INFO] --- maven-clean-plugin:2.4.1:clean (default-clean) @ oozie-sharelib --- [INFO] Deleting https://builds.apache.org/job/oozie-trunk-precommit-build/ws/sharelib/target [INFO] [INFO] [INFO] Building Apache Oozie Tools 4.1.0-SNAPSHOT [INFO] [WARNING] Failure to transfer asm:asm/maven-metadata.xml from file:../../local.repository/trunk was cached in the local repository, resolution will not be reattempted until the update interval of local.repository has elapsed or updates are forced. Original error: Could not transfer metadata asm:asm/maven-metadata.xml from/to local.repository (file:../../local.repository/trunk): No connector available to access repository local.repository (file:../../local.repository/trunk) of type legacy using the available factories WagonRepositoryConnectorFactory [WARNING] Failure to transfer asm:asm/maven-metadata.xml from file:../../local.repository/trunk was cached in the local repository, resolution will not be reattempted until the update interval of local.repository has elapsed or updates are forced. Original error: Could not transfer metadata asm:asm/maven-metadata.xml from/to local.repository (file:../../local.repository/trunk): No connector available to access repository local.repository (file:../../local.repository/trunk) of type legacy using the available factories WagonRepositoryConnectorFactory [WARNING] Failure to transfer asm:asm/maven-metadata.xml from file:../../local.repository/trunk was cached in the local repository, resolution will not be reattempted until the update interval of local.repository has elapsed or updates are forced. Original error: Could not transfer metadata asm:asm/maven-metadata.xml from/to local.repository (file:../../local.repository/trunk): No connector available to access repository local.repository (file:../../local.repository/trunk) of type legacy using the available factories WagonRepositoryConnectorFactory [INFO] [INFO] --- maven-clean-plugin:2.4.1:clean (default-clean) @ oozie-tools --- [INFO] Deleting https://builds.apache.org/job/oozie-trunk-precommit-build/ws/tools/target [INFO] [INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ oozie-tools --- [debug] execute contextualize [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory https://builds.apache.org/job/oozie-trunk-precommit-build/ws/tools/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ oozie-tools --- [INFO] Compiling 2 source files to https://builds.apache.org/job/oozie-trunk-precommit-build/ws/tools/target/classes [INFO] [INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ oozie-tools --- [debug] execute contextualize [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 2 resources [INFO] [INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ oozie-tools --- [INFO] Compiling 6 source files to https://builds.apache.org/job/oozie-trunk-precommit-build/ws/tools/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.12:test (default-test) @ oozie-tools --- [INFO] Tests are skipped. [INFO] [INFO] [INFO] Building Apache
[jira] [Commented] (OOZIE-1804) Improve documentation for Coordinator Specification
[
https://issues.apache.org/jira/browse/OOZIE-1804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14015616#comment-14015616
]
Hadoop QA commented on OOZIE-1804:
--
Testing JIRA OOZIE-1804
Cleaning local git workspace
{color:red}-1{color} Patch failed to apply to head of branch
Improve documentation for Coordinator Specification
---
Key: OOZIE-1804
URL: https://issues.apache.org/jira/browse/OOZIE-1804
Project: Oozie
Issue Type: Improvement
Components: docs
Reporter: Lars Francke
Assignee: Lars Francke
Priority: Trivial
Attachments: OOZIE-1804.1.patch, OOZIE-1804.2.patch,
OOZIE-1804.3.patch
The description of the done-flag is confusing and partially wrong.
In addition I've fixed a couple of small typos and removed extra whitespace.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Updated] (OOZIE-1532) Purging should remove completed children job for long running coordinator jobs
[ https://issues.apache.org/jira/browse/OOZIE-1532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bowen Zhang updated OOZIE-1532: --- Attachment: oozie-1532.patch Purging should remove completed children job for long running coordinator jobs -- Key: OOZIE-1532 URL: https://issues.apache.org/jira/browse/OOZIE-1532 Project: Oozie Issue Type: New Feature Reporter: Srikanth Sundarrajan Assignee: Bowen Zhang Attachments: oozie-1532.patch, oozie-1532.patch Specifically, this is for long running coordinator jobs with high frequency. all child workflows are never purged as the coord job is still running. Oozie server configuration that indicates how many coordinator actions frequency ticks to keep. By doing this it would be possible to purge running coord jobs. By default this would not be enabled and the current logic would remain. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (OOZIE-1804) Improve documentation for Coordinator Specification
[ https://issues.apache.org/jira/browse/OOZIE-1804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Francke updated OOZIE-1804: Attachment: OOZIE-1804.4.patch The previous patch included non-patch related things and I forgot to rebase to latest master. Improve documentation for Coordinator Specification --- Key: OOZIE-1804 URL: https://issues.apache.org/jira/browse/OOZIE-1804 Project: Oozie Issue Type: Improvement Components: docs Reporter: Lars Francke Assignee: Lars Francke Priority: Trivial Attachments: OOZIE-1804.1.patch, OOZIE-1804.2.patch, OOZIE-1804.3.patch, OOZIE-1804.4.patch The description of the done-flag is confusing and partially wrong. In addition I've fixed a couple of small typos and removed extra whitespace. -- This message was sent by Atlassian JIRA (v6.2#6252)
Build failed in Jenkins: oozie-trunk-precommit-build #1287
See https://builds.apache.org/job/oozie-trunk-precommit-build/1287/ -- [...truncated 9622 lines...] [INFO] share already added, skipping [INFO] share/lib already added, skipping [INFO] already added, skipping [INFO] share already added, skipping [INFO] share/lib already added, skipping [INFO] already added, skipping [INFO] share already added, skipping [INFO] share/lib already added, skipping [INFO] already added, skipping [INFO] share already added, skipping [INFO] share/lib already added, skipping [INFO] already added, skipping [INFO] share already added, skipping [INFO] share/lib already added, skipping [INFO] already added, skipping [INFO] share already added, skipping [INFO] share/lib already added, skipping [INFO] [INFO] [INFO] Building Apache Oozie Tools 4.1.0-SNAPSHOT [INFO] [WARNING] Failure to transfer asm:asm/maven-metadata.xml from file:../../local.repository/trunk was cached in the local repository, resolution will not be reattempted until the update interval of local.repository has elapsed or updates are forced. Original error: Could not transfer metadata asm:asm/maven-metadata.xml from/to local.repository (file:../../local.repository/trunk): No connector available to access repository local.repository (file:../../local.repository/trunk) of type legacy using the available factories WagonRepositoryConnectorFactory [WARNING] Failure to transfer asm:asm/maven-metadata.xml from file:../../local.repository/trunk was cached in the local repository, resolution will not be reattempted until the update interval of local.repository has elapsed or updates are forced. Original error: Could not transfer metadata asm:asm/maven-metadata.xml from/to local.repository (file:../../local.repository/trunk): No connector available to access repository local.repository (file:../../local.repository/trunk) of type legacy using the available factories WagonRepositoryConnectorFactory [INFO] [INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ oozie-tools --- [debug] execute contextualize [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory https://builds.apache.org/job/oozie-trunk-precommit-build/ws/tools/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ oozie-tools --- [INFO] Nothing to compile - all classes are up to date [INFO] [INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ oozie-tools --- [debug] execute contextualize [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 2 resources [INFO] [INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ oozie-tools --- [INFO] Nothing to compile - all classes are up to date [INFO] [INFO] --- maven-surefire-plugin:2.12:test (default-test) @ oozie-tools --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ oozie-tools --- [INFO] Building jar: https://builds.apache.org/job/oozie-trunk-precommit-build/ws/tools/target/oozie-tools-4.1.0-SNAPSHOT.jar [INFO] [INFO] --- maven-assembly-plugin:2.2.1:single (default-cli) @ oozie-tools --- [INFO] Reading assembly descriptor: ../src/main/assemblies/tools.xml [WARNING] The following patterns were never triggered in this artifact exclusion filter: o '*:*:pom:*' [INFO] Copying files to https://builds.apache.org/job/oozie-trunk-precommit-build/ws/tools/target/oozie-tools-4.1.0-SNAPSHOT-tools [WARNING] Assembly file: https://builds.apache.org/job/oozie-trunk-precommit-build/ws/tools/target/oozie-tools-4.1.0-SNAPSHOT-tools is not a regular file (it may be a directory). It cannot be attached to the project build for installation or deployment. [INFO] [INFO] [INFO] Building Apache Oozie MiniOozie 4.1.0-SNAPSHOT [INFO] [INFO] [INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ oozie-mini --- [debug] execute contextualize [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory https://builds.apache.org/job/oozie-trunk-precommit-build/ws/minitest/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ oozie-mini --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ oozie-mini --- [debug] execute contextualize [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 3 resources [INFO] [INFO] --- maven-compiler-plugin:2.3.2:testCompile
[jira] [Commented] (OOZIE-1532) Purging should remove completed children job for long running coordinator jobs
[
https://issues.apache.org/jira/browse/OOZIE-1532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14015836#comment-14015836
]
Hadoop QA commented on OOZIE-1532:
--
Testing JIRA OOZIE-1532
Cleaning local git workspace
{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:red}-1{color} the patch contains 2 line(s) longer than 132
characters
.{color:green}+1{color} the patch does adds/modifies 3 testcase(s)
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc
warnings
{color:green}+1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:green}+1{color} the patch does not seem to introduce new javac
warnings
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color}
.Tests run: 1464
.Tests failed: 2
.Tests errors: 1
.The patch failed the following testcases:
.
testBundleEngineKill(org.apache.oozie.servlet.TestV1JobServletBundleEngine)
.
testActionInputCheckLatestActionCreationTime(org.apache.oozie.command.coord.TestCoordActionInputCheckXCommand)
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch
{color:red}*-1 Overall result, please check the reported -1(s)*{color}
The full output of the test-patch run is available at
. https://builds.apache.org/job/oozie-trunk-precommit-build/1287/
Purging should remove completed children job for long running coordinator jobs
--
Key: OOZIE-1532
URL: https://issues.apache.org/jira/browse/OOZIE-1532
Project: Oozie
Issue Type: New Feature
Reporter: Srikanth Sundarrajan
Assignee: Bowen Zhang
Attachments: oozie-1532.patch, oozie-1532.patch
Specifically, this is for long running coordinator jobs with high frequency.
all child workflows are never purged as the coord job is still running.
Oozie server configuration that indicates how many coordinator actions
frequency ticks to keep. By doing this it would be possible to purge running
coord jobs. By default this would not be enabled and the current logic would
remain.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
Re: Review Request 21046: OOZIE-1715 Distributed ID sequence for HA
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/21046/#review44575 --- Ship it! Ship It! - Robert Kanter On May 20, 2014, 12:47 a.m., Purshotam Shah wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/21046/ --- (Updated May 20, 2014, 12:47 a.m.) Review request for oozie. Bugs: OOZIE-1715 https://issues.apache.org/jira/browse/OOZIE-1715 Repository: oozie-git Description --- OOZIE-1715 Distributed ID sequence for HA Diffs - core/src/main/java/org/apache/oozie/service/DistributedUUIDService.java e69de29 core/src/main/java/org/apache/oozie/service/UUIDService.java 836815d core/src/main/java/org/apache/oozie/service/ZKUUIDService.java e69de29 core/src/main/java/org/apache/oozie/util/ZKUtils.java 56055b8 core/src/main/resources/oozie-default.xml 9788daf core/src/test/java/org/apache/oozie/service/TestDistributedUUIDService.java e69de29 core/src/test/java/org/apache/oozie/service/TestZKUUIDService.java e69de29 docs/src/site/twiki/AG_Install.twiki e343d7e Diff: https://reviews.apache.org/r/21046/diff/ Testing --- UTC Thanks, Purshotam Shah
[jira] [Commented] (OOZIE-1715) Distributed ID sequence for HA
[ https://issues.apache.org/jira/browse/OOZIE-1715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14016052#comment-14016052 ] Robert Kanter commented on OOZIE-1715: -- +1 on the latest patch on RB (pending Jenkins) Distributed ID sequence for HA -- Key: OOZIE-1715 URL: https://issues.apache.org/jira/browse/OOZIE-1715 Project: Oozie Issue Type: Bug Components: HA Reporter: Purshotam Shah Assignee: Purshotam Shah Attachments: OOZIE-1715-V1.patch, OOZIE-1715-V2.patch Currently each host maintains their own sequencing. In case of HA, this will not work. We need to have distributed sequence generator. All server in HA will use it to get incremental sequence. One good option is to use ZK PERSISTENT_SEQUENTIAL, other options is to use Database sequence generator (not sure if all DB provides). There are few other discussed @ http://srinathsview.blogspot.com/2012/04/generating-distributed-sequence-number.html http://stackoverflow.com/questions/2671858/distributed-sequence-number-generation/5685869 Suggestion? -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Updated] (OOZIE-1586) upgrade oozie to hive 13.1 (including hcatalog)
[ https://issues.apache.org/jira/browse/OOZIE-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated OOZIE-1586: Attachment: OOZIE-1586.3.patch Hi Robert! Sorry for the delay, but here is the latest patch on trunk. Its using Hive 0.13.1 (whose RC3 was released today), so until its artifacts are pushed to the maven repository, this patch will probably fail. I'd also missed a change in the assemblies pom.xml which caused the failure you pointed out. I've fixed it in this patch. Thanks upgrade oozie to hive 13.1 (including hcatalog) --- Key: OOZIE-1586 URL: https://issues.apache.org/jira/browse/OOZIE-1586 Project: Oozie Issue Type: Improvement Reporter: Bowen Zhang Assignee: Ravi Prakash Attachments: OOZIE-1586.1.patch, OOZIE-1586.2.patch, OOZIE-1586.3.patch, OOZIE-1586.patch -- This message was sent by Atlassian JIRA (v6.2#6252)
Re: Review Request 21423: OOZIE-1813 Add service to report/kill rogue bundles and coordinator jobs
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/21423/#review44577 --- Ship it! Ship It! - Robert Kanter On May 30, 2014, 7:41 p.m., Purshotam Shah wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/21423/ --- (Updated May 30, 2014, 7:41 p.m.) Review request for oozie. Bugs: OOZIE-1813 https://issues.apache.org/jira/browse/OOZIE-1813 Repository: oozie-git Description --- Report will be sent in html format, where each job is clickable and will take you to job info. Coordinator id Coordinator nameUser name Group Kill Status 000-140513184018277-oozie-puru-C COORD-TEST test testg Coord kill is disabled 001-140513184018277-oozie-puru-C COORD-TEST test testg Coord kill is disabled Diffs - core/src/main/java/org/apache/oozie/CoordinatorJobBean.java b77082c core/src/main/java/org/apache/oozie/action/email/EmailActionExecutor.java 332d02c core/src/main/java/org/apache/oozie/command/wf/JobXCommand.java 1d7ca82 core/src/main/java/org/apache/oozie/executor/jpa/CoordJobQueryExecutor.java 1a6ded7 core/src/main/java/org/apache/oozie/service/AbandonedCoordCheckerService.java e69de29 core/src/test/java/org/apache/oozie/command/coord/TestAbandonedCoordChecker.java e69de29 Diff: https://reviews.apache.org/r/21423/diff/ Testing --- UTC Thanks, Purshotam Shah
Re: Review Request 21423: OOZIE-1813 Add service to report/kill rogue bundles and coordinator jobs
On June 2, 2014, 11:54 p.m., Robert Kanter wrote: Ship It! With the individual log messages added in r8, I suppose we don't need to log the actual report - Robert --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/21423/#review44577 --- On May 30, 2014, 7:41 p.m., Purshotam Shah wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/21423/ --- (Updated May 30, 2014, 7:41 p.m.) Review request for oozie. Bugs: OOZIE-1813 https://issues.apache.org/jira/browse/OOZIE-1813 Repository: oozie-git Description --- Report will be sent in html format, where each job is clickable and will take you to job info. Coordinator id Coordinator nameUser name Group Kill Status 000-140513184018277-oozie-puru-C COORD-TEST test testg Coord kill is disabled 001-140513184018277-oozie-puru-C COORD-TEST test testg Coord kill is disabled Diffs - core/src/main/java/org/apache/oozie/CoordinatorJobBean.java b77082c core/src/main/java/org/apache/oozie/action/email/EmailActionExecutor.java 332d02c core/src/main/java/org/apache/oozie/command/wf/JobXCommand.java 1d7ca82 core/src/main/java/org/apache/oozie/executor/jpa/CoordJobQueryExecutor.java 1a6ded7 core/src/main/java/org/apache/oozie/service/AbandonedCoordCheckerService.java e69de29 core/src/test/java/org/apache/oozie/command/coord/TestAbandonedCoordChecker.java e69de29 Diff: https://reviews.apache.org/r/21423/diff/ Testing --- UTC Thanks, Purshotam Shah
[jira] [Commented] (OOZIE-1813) Add service to report/kill rogue bundles and coordinator jobs
[ https://issues.apache.org/jira/browse/OOZIE-1813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14016059#comment-14016059 ] Robert Kanter commented on OOZIE-1813: -- +1 on the latest patch on RB (pending Jenkins) Add service to report/kill rogue bundles and coordinator jobs - Key: OOZIE-1813 URL: https://issues.apache.org/jira/browse/OOZIE-1813 Project: Oozie Issue Type: Bug Reporter: Purshotam Shah Assignee: Purshotam Shah Attachments: OOZIE-1813-V2.patch, OOZIE-1813-V3.patch, OOZIE-1813-V4.patch, OOZIE-1813-V5.patch, OOZIE-1813-V6.patch, OOZIE-1813-V7.patch People leave their test coordinator and bundle jobs without ever killing them and they just eat up resources heavily. We should have a service which periodically check for abandoned coords and report/kill them. We can add multiple logic to this like ( number of consecutive failed/timedout action, total number of failed/timedout action). To start with if number of coord action with failed/timedout status defined value, then coord is considered to be rogue. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (OOZIE-1813) Add service to report/kill rogue bundles and coordinator jobs
[ https://issues.apache.org/jira/browse/OOZIE-1813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14016063#comment-14016063 ] Robert Kanter commented on OOZIE-1813: -- Actually, on the final patch, can you add the new config properties to oozie-default.xml? Add service to report/kill rogue bundles and coordinator jobs - Key: OOZIE-1813 URL: https://issues.apache.org/jira/browse/OOZIE-1813 Project: Oozie Issue Type: Bug Reporter: Purshotam Shah Assignee: Purshotam Shah Attachments: OOZIE-1813-V2.patch, OOZIE-1813-V3.patch, OOZIE-1813-V4.patch, OOZIE-1813-V5.patch, OOZIE-1813-V6.patch, OOZIE-1813-V7.patch People leave their test coordinator and bundle jobs without ever killing them and they just eat up resources heavily. We should have a service which periodically check for abandoned coords and report/kill them. We can add multiple logic to this like ( number of consecutive failed/timedout action, total number of failed/timedout action). To start with if number of coord action with failed/timedout status defined value, then coord is considered to be rogue. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (OOZIE-1830) Change hadoop-1 profile to use 1.2.1
[ https://issues.apache.org/jira/browse/OOZIE-1830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14016064#comment-14016064 ] Azrael commented on OOZIE-1830: --- Precommit build is weird. The changes don't include this patch. Change hadoop-1 profile to use 1.2.1 Key: OOZIE-1830 URL: https://issues.apache.org/jira/browse/OOZIE-1830 Project: Oozie Issue Type: Improvement Affects Versions: trunk, 4.0.1 Reporter: Azrael Priority: Minor Attachments: OOZIE-1830.1.patch, OOZIE-1830.2.patch We should change the hadoop-1 profile to use 1.2.1 instead of 1.1.1. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (OOZIE-1830) Change hadoop-1 profile to use 1.2.1
[ https://issues.apache.org/jira/browse/OOZIE-1830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14016080#comment-14016080 ] Azrael commented on OOZIE-1830: --- I am a little confused about pre-commit build result. In the APPLY-PATCH.txt I can find the changed files and DISTO succeed. However, The TEST-SUMMERY says bq. -1 TESTS - patch does not compile, cannot run testcases is this why the patch does not include test case changes? Change hadoop-1 profile to use 1.2.1 Key: OOZIE-1830 URL: https://issues.apache.org/jira/browse/OOZIE-1830 Project: Oozie Issue Type: Improvement Affects Versions: trunk, 4.0.1 Reporter: Azrael Priority: Minor Attachments: OOZIE-1830.1.patch, OOZIE-1830.2.patch We should change the hadoop-1 profile to use 1.2.1 instead of 1.1.1. -- This message was sent by Atlassian JIRA (v6.2#6252)
Build failed in Jenkins: oozie-trunk-precommit-build #1289
See https://builds.apache.org/job/oozie-trunk-precommit-build/1289/ -- [...truncated 6403 lines...] [INFO] [INFO] --- maven-assembly-plugin:2.2.1:single (default-cli) @ oozie-hadoop-test --- [INFO] Reading assembly descriptor: ../../src/main/assemblies/empty.xml [INFO] [INFO] [INFO] Building Apache Oozie Hadoop Distcp 0.23.5.oozie-4.1.0-SNAPSHOT 0.23.5.oozie-4.1.0-SNAPSHOT [INFO] [INFO] [INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ oozie-hadoop-distcp --- [debug] execute contextualize [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory https://builds.apache.org/job/oozie-trunk-precommit-build/ws/hadooplibs/hadoop-distcp-0.23/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ oozie-hadoop-distcp --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ oozie-hadoop-distcp --- [debug] execute contextualize [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory https://builds.apache.org/job/oozie-trunk-precommit-build/ws/hadooplibs/hadoop-distcp-0.23/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ oozie-hadoop-distcp --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.12:test (default-test) @ oozie-hadoop-distcp --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ oozie-hadoop-distcp --- [WARNING] JAR will be empty - no content was marked for inclusion! [INFO] Building jar: https://builds.apache.org/job/oozie-trunk-precommit-build/ws/hadooplibs/hadoop-distcp-0.23/target/oozie-hadoop-distcp-0.23.5.oozie-4.1.0-SNAPSHOT.jar [INFO] [INFO] --- maven-assembly-plugin:2.2.1:single (default-cli) @ oozie-hadoop-distcp --- [INFO] Reading assembly descriptor: src/main/assemblies/empty.xml [INFO] [INFO] [INFO] Building Apache Oozie Hadoop Utils 0.23.5.oozie-4.1.0-SNAPSHOT 0.23.5.oozie-4.1.0-SNAPSHOT [INFO] [INFO] [INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ oozie-hadoop-utils --- [debug] execute contextualize [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory https://builds.apache.org/job/oozie-trunk-precommit-build/ws/hadooplibs/hadoop-utils-0.23/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ oozie-hadoop-utils --- [INFO] Nothing to compile - all classes are up to date [INFO] [INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ oozie-hadoop-utils --- [debug] execute contextualize [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory https://builds.apache.org/job/oozie-trunk-precommit-build/ws/hadooplibs/hadoop-utils-0.23/src/test/resources [INFO] [INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ oozie-hadoop-utils --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.12:test (default-test) @ oozie-hadoop-utils --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ oozie-hadoop-utils --- [INFO] Building jar: https://builds.apache.org/job/oozie-trunk-precommit-build/ws/hadooplibs/hadoop-utils-0.23/target/oozie-hadoop-utils-0.23.5.oozie-4.1.0-SNAPSHOT.jar [INFO] [INFO] --- maven-assembly-plugin:2.2.1:single (default-cli) @ oozie-hadoop-utils --- [INFO] Reading assembly descriptor: src/main/assemblies/empty.xml [INFO] [INFO] [INFO] Building Apache Oozie Hadoop Libs 4.1.0-SNAPSHOT [INFO] [INFO] [INFO] --- maven-assembly-plugin:2.2.1:single (default-cli) @ oozie-hadooplibs --- [INFO] Reading assembly descriptor: ../src/main/assemblies/hadooplibs.xml [INFO] oozie-4.1.0-SNAPSHOT/hadooplibs/ already added, skipping [INFO] Copying files to https://builds.apache.org/job/oozie-trunk-precommit-build/ws/hadooplibs/target/oozie-4.1.0-SNAPSHOT-hadooplibs [INFO] oozie-4.1.0-SNAPSHOT/hadooplibs/ already added, skipping [WARNING] Assembly file: https://builds.apache.org/job/oozie-trunk-precommit-build/ws/hadooplibs/target/oozie-4.1.0-SNAPSHOT-hadooplibs is not a regular file (it may be a directory). It cannot be
[jira] [Commented] (OOZIE-1586) upgrade oozie to hive 13.1 (including hcatalog)
[
https://issues.apache.org/jira/browse/OOZIE-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14016087#comment-14016087
]
Hadoop QA commented on OOZIE-1586:
--
Testing JIRA OOZIE-1586
Cleaning local git workspace
{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc
warnings
{color:red}-1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:red}-1{color} patch does not compile
.{color:green}+1{color} the patch does not seem to introduce new javac
warnings
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color} - patch does not compile, cannot run testcases
{color:red}-1 DISTRO{color}
.{color:red}-1{color} distro tarball fails with the patch
{color:red}*-1 Overall result, please check the reported -1(s)*{color}
The full output of the test-patch run is available at
. https://builds.apache.org/job/oozie-trunk-precommit-build/1289/
upgrade oozie to hive 13.1 (including hcatalog)
---
Key: OOZIE-1586
URL: https://issues.apache.org/jira/browse/OOZIE-1586
Project: Oozie
Issue Type: Improvement
Reporter: Bowen Zhang
Assignee: Ravi Prakash
Attachments: OOZIE-1586.1.patch, OOZIE-1586.2.patch,
OOZIE-1586.3.patch, OOZIE-1586.patch
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] Subscription: Oozie Patch Available
Issue Subscription Filter: Oozie Patch Available (36 issues) Subscriber: ooziedaily Key Summary OOZIE-1860 Oozie job mapper launch fails due to null value returned from action file https://issues.apache.org/jira/browse/OOZIE-1860 OOZIE-1855 TestPriorityDelayQueue#testPoll failed intermittently in Jenkins https://issues.apache.org/jira/browse/OOZIE-1855 OOZIE-1830 Change hadoop-1 profile to use 1.2.1 https://issues.apache.org/jira/browse/OOZIE-1830 OOZIE-1829 URIHandlerService doesn't support URI schemes with query strings but no path segment https://issues.apache.org/jira/browse/OOZIE-1829 OOZIE-1821 Oozie java action fails due to AlreadyBeingCreatedException https://issues.apache.org/jira/browse/OOZIE-1821 OOZIE-1817 Oozie timers are not biased https://issues.apache.org/jira/browse/OOZIE-1817 OOZIE-1816 LogInfo uses action name instead of id https://issues.apache.org/jira/browse/OOZIE-1816 OOZIE-1813 Add service to report/kill rogue bundles and coordinator jobs https://issues.apache.org/jira/browse/OOZIE-1813 OOZIE-1807 Make bundle change command synchronous https://issues.apache.org/jira/browse/OOZIE-1807 OOZIE-1804 Improve documentation for Coordinator Specification https://issues.apache.org/jira/browse/OOZIE-1804 OOZIE-1803 Improvement in Purge service https://issues.apache.org/jira/browse/OOZIE-1803 OOZIE-1802 Support workflow action log https://issues.apache.org/jira/browse/OOZIE-1802 OOZIE-1793 Improve find bugs reporting for Oozie https://issues.apache.org/jira/browse/OOZIE-1793 OOZIE-1782 Workflow path not found is thrown as SC_UNAUTHORIZED https://issues.apache.org/jira/browse/OOZIE-1782 OOZIE-1741 Add new coord EL function to get input partitions value string https://issues.apache.org/jira/browse/OOZIE-1741 OOZIE-1705 Enable gc logs and print thread id in logs https://issues.apache.org/jira/browse/OOZIE-1705 OOZIE-1688 New configuration to specify server-server authentication type. https://issues.apache.org/jira/browse/OOZIE-1688 OOZIE-1686 Typo in DG_CommandLineTool https://issues.apache.org/jira/browse/OOZIE-1686 OOZIE-1685 Oozie doesn’t process correctly workflows with a non-default name node https://issues.apache.org/jira/browse/OOZIE-1685 OOZIE-1659 oozie-site is missing email-action-0.2 schema https://issues.apache.org/jira/browse/OOZIE-1659 OOZIE-1654 Fix typo (inteval to interval) https://issues.apache.org/jira/browse/OOZIE-1654 OOZIE-1638 Action retry does not use default retry max count. https://issues.apache.org/jira/browse/OOZIE-1638 OOZIE-1636 OOZIE_SYS table engine should be innodb https://issues.apache.org/jira/browse/OOZIE-1636 OOZIE-1624 Exclusion pattern for sharelib. https://issues.apache.org/jira/browse/OOZIE-1624 OOZIE-1602 pom.xml should take use of the profiles when building hadooplibs https://issues.apache.org/jira/browse/OOZIE-1602 OOZIE-1586 upgrade oozie to hive 13.1 (including hcatalog) https://issues.apache.org/jira/browse/OOZIE-1586 OOZIE-1579 Add basic HTTP auth to Oozie CLI https://issues.apache.org/jira/browse/OOZIE-1579 OOZIE-1567 Provide a wait tool in Oozie https://issues.apache.org/jira/browse/OOZIE-1567 OOZIE-1533 Coordinator action materialization is too slow due to coarse job level locks https://issues.apache.org/jira/browse/OOZIE-1533 OOZIE-1532 Purging should remove completed children job for long running coordinator jobs https://issues.apache.org/jira/browse/OOZIE-1532 OOZIE-1376 Extending Oozie ACLs like admin groups and proxy users to support both groups and users https://issues.apache.org/jira/browse/OOZIE-1376 OOZIE-1369 OozieDBCLI code should not hardcode the Oozie table filenames https://issues.apache.org/jira/browse/OOZIE-1369 OOZIE-1232 GroupsService should be able to reference Hadoop configurations in Hadoop configuration folder (such as /etc/hadoop/conf) https://issues.apache.org/jira/browse/OOZIE-1232 OOZIE-1074 workflowgenerator does not package a tar.gz file though it seems creating one is the intention https://issues.apache.org/jira/browse/OOZIE-1074 OOZIE-891 Add pagination for all popup panels in Oozie Web UI https://issues.apache.org/jira/browse/OOZIE-891 OOZIE-547 build workflow progress information in Oozie https://issues.apache.org/jira/browse/OOZIE-547 You may edit this subscription at: https://issues.apache.org/jira/secure/FilterSubscription!default.jspa?subId=14721filterId=12325939
[jira] [Updated] (OOZIE-1830) Change hadoop-1 profile to use 1.2.1
[ https://issues.apache.org/jira/browse/OOZIE-1830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Azrael updated OOZIE-1830: -- Attachment: OOZIE-1830.3.patch Add missing codec dependency. Change hadoop-1 profile to use 1.2.1 Key: OOZIE-1830 URL: https://issues.apache.org/jira/browse/OOZIE-1830 Project: Oozie Issue Type: Improvement Affects Versions: trunk, 4.0.1 Reporter: Azrael Priority: Minor Attachments: OOZIE-1830.1.patch, OOZIE-1830.2.patch, OOZIE-1830.3.patch We should change the hadoop-1 profile to use 1.2.1 instead of 1.1.1. -- This message was sent by Atlassian JIRA (v6.2#6252)
Re: Review Request 21312: OOZIE-1830 Change hadoop-1 profile to use 1.2.1
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/21312/ --- (Updated June 3, 2014, 2:01 a.m.) Review request for oozie. Changes --- Add missing codec dependency. Bugs: OOZIE-1830 https://issues.apache.org/jira/browse/OOZIE-1830 Repository: oozie-git Description --- We should change the hadoop-1 profile to use 1.2.1 instead of 1.1.1. Diffs (updated) - client/pom.xml 486a4ec hadooplibs/hadoop-1/pom.xml 30a5996 hadooplibs/hadoop-auth-0.23/pom.xml PRE-CREATION hadooplibs/hadoop-auth-1/pom.xml PRE-CREATION hadooplibs/hadoop-auth-2/pom.xml PRE-CREATION hadooplibs/hadoop-distcp-1/pom.xml fa21703 hadooplibs/hadoop-test-1/pom.xml 3d4b409 hadooplibs/hadoop-utils-1/pom.xml 0d10e7a hadooplibs/pom.xml 788788c pom.xml b5e0e4e tools/pom.xml 487783d Diff: https://reviews.apache.org/r/21312/diff/ Testing --- Thanks, Azrael Park
[jira] [Commented] (OOZIE-1830) Change hadoop-1 profile to use 1.2.1
[
https://issues.apache.org/jira/browse/OOZIE-1830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14016186#comment-14016186
]
Hadoop QA commented on OOZIE-1830:
--
Testing JIRA OOZIE-1830
Cleaning local git workspace
{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc
warnings
{color:red}-1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:red}-1{color} the patch seems to introduce 12 new javac warning(s)
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color}
.Tests run: 1475
.Tests failed: 7
.Tests errors: 1
.The patch failed the following testcases:
.
testActionInputCheckLatestActionCreationTime(org.apache.oozie.command.coord.TestCoordActionInputCheckXCommandNonUTC)
.
testBundleEngineKill(org.apache.oozie.servlet.TestV1JobServletBundleEngine)
.
testParserGlobal(org.apache.oozie.workflow.lite.TestLiteWorkflowAppParser)
.
testParserGlobalJobXML(org.apache.oozie.workflow.lite.TestLiteWorkflowAppParser)
.
testParserGlobalLocalAlreadyExists(org.apache.oozie.workflow.lite.TestLiteWorkflowAppParser)
.
testParserGlobalExtensionActions(org.apache.oozie.workflow.lite.TestLiteWorkflowAppParser)
.
testParserGlobalExtensionActionsLocalAlreadyExists(org.apache.oozie.workflow.lite.TestLiteWorkflowAppParser)
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch
{color:red}*-1 Overall result, please check the reported -1(s)*{color}
The full output of the test-patch run is available at
. https://builds.apache.org/job/oozie-trunk-precommit-build/1290/
Change hadoop-1 profile to use 1.2.1
Key: OOZIE-1830
URL: https://issues.apache.org/jira/browse/OOZIE-1830
Project: Oozie
Issue Type: Improvement
Affects Versions: trunk, 4.0.1
Reporter: Azrael
Priority: Minor
Attachments: OOZIE-1830.1.patch, OOZIE-1830.2.patch,
OOZIE-1830.3.patch
We should change the hadoop-1 profile to use 1.2.1 instead of 1.1.1.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
Build failed in Jenkins: oozie-trunk-precommit-build #1290
See https://builds.apache.org/job/oozie-trunk-precommit-build/1290/ -- [...truncated 10047 lines...] [INFO] already added, skipping [INFO] share already added, skipping [INFO] share/lib already added, skipping [INFO] already added, skipping [INFO] share already added, skipping [INFO] share/lib already added, skipping [INFO] already added, skipping [INFO] share already added, skipping [INFO] share/lib already added, skipping [INFO] [INFO] [INFO] Building Apache Oozie Tools 4.1.0-SNAPSHOT [INFO] [WARNING] Failure to transfer asm:asm/maven-metadata.xml from file:../../local.repository/trunk was cached in the local repository, resolution will not be reattempted until the update interval of local.repository has elapsed or updates are forced. Original error: Could not transfer metadata asm:asm/maven-metadata.xml from/to local.repository (file:../../local.repository/trunk): No connector available to access repository local.repository (file:../../local.repository/trunk) of type legacy using the available factories WagonRepositoryConnectorFactory [WARNING] Failure to transfer asm:asm/maven-metadata.xml from file:../../local.repository/trunk was cached in the local repository, resolution will not be reattempted until the update interval of local.repository has elapsed or updates are forced. Original error: Could not transfer metadata asm:asm/maven-metadata.xml from/to local.repository (file:../../local.repository/trunk): No connector available to access repository local.repository (file:../../local.repository/trunk) of type legacy using the available factories WagonRepositoryConnectorFactory [INFO] [INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ oozie-tools --- [debug] execute contextualize [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory https://builds.apache.org/job/oozie-trunk-precommit-build/ws/tools/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ oozie-tools --- [INFO] Nothing to compile - all classes are up to date [INFO] [INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ oozie-tools --- [debug] execute contextualize [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 2 resources [INFO] [INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ oozie-tools --- [INFO] Nothing to compile - all classes are up to date [INFO] [INFO] --- maven-surefire-plugin:2.12:test (default-test) @ oozie-tools --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ oozie-tools --- [INFO] Building jar: https://builds.apache.org/job/oozie-trunk-precommit-build/ws/tools/target/oozie-tools-4.1.0-SNAPSHOT.jar [INFO] [INFO] --- maven-assembly-plugin:2.2.1:single (default-cli) @ oozie-tools --- [INFO] Reading assembly descriptor: ../src/main/assemblies/tools.xml [WARNING] The following patterns were never triggered in this artifact exclusion filter: o '*:*:pom:*' [INFO] Copying files to https://builds.apache.org/job/oozie-trunk-precommit-build/ws/tools/target/oozie-tools-4.1.0-SNAPSHOT-tools [WARNING] Assembly file: https://builds.apache.org/job/oozie-trunk-precommit-build/ws/tools/target/oozie-tools-4.1.0-SNAPSHOT-tools is not a regular file (it may be a directory). It cannot be attached to the project build for installation or deployment. [INFO] [INFO] [INFO] Building Apache Oozie MiniOozie 4.1.0-SNAPSHOT [INFO] [INFO] [INFO] --- maven-resources-plugin:2.5:resources (default-resources) @ oozie-mini --- [debug] execute contextualize [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory https://builds.apache.org/job/oozie-trunk-precommit-build/ws/minitest/src/main/resources [INFO] [INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ oozie-mini --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.5:testResources (default-testResources) @ oozie-mini --- [debug] execute contextualize [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 3 resources [INFO] [INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ oozie-mini --- [INFO] Nothing to compile - all classes are up to date [INFO] [INFO] --- maven-surefire-plugin:2.12:test (default-test) @ oozie-mini --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ oozie-mini --- [WARNING] JAR will be empty
[jira] [Commented] (OOZIE-1532) Purging should remove completed children job for long running coordinator jobs
[ https://issues.apache.org/jira/browse/OOZIE-1532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14016218#comment-14016218 ] Shwetha G S commented on OOZIE-1532: Since the DB will not contain all actions for the coordinator, CoordJobGetActionsSubsetJPAExecutor which gets the a subset of coord actions with the given start should also be fixed. Purging should remove completed children job for long running coordinator jobs -- Key: OOZIE-1532 URL: https://issues.apache.org/jira/browse/OOZIE-1532 Project: Oozie Issue Type: New Feature Reporter: Srikanth Sundarrajan Assignee: Bowen Zhang Attachments: oozie-1532.patch, oozie-1532.patch Specifically, this is for long running coordinator jobs with high frequency. all child workflows are never purged as the coord job is still running. Oozie server configuration that indicates how many coordinator actions frequency ticks to keep. By doing this it would be possible to purge running coord jobs. By default this would not be enabled and the current logic would remain. -- This message was sent by Atlassian JIRA (v6.2#6252)
