[jira] [Created] (OOZIE-3060) Cache generated workflow PNG files
Andras Piros created OOZIE-3060:
---
Summary: Cache generated workflow PNG files
Key: OOZIE-3060
URL: https://issues.apache.org/jira/browse/OOZIE-3060
Project: Oozie
Issue Type: Improvement
Affects Versions: 4.3.0
Reporter: Andras Piros
Fix For: 5.0.0
After OOZIE-2406 we can generate workflow PNGs w/ an affordable CPU / heap
footprint.
Now it's time to cache:
# PNGs of the workflows already in some end state
# w/ configurable TTL (default: 15 minutes)
# to temp files
# using e.g. Guava's {{LoadingCache}}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Created] (OOZIE-3059) Oozie CLI: serve generated workflow graphs
Andras Piros created OOZIE-3059:
---
Summary: Oozie CLI: serve generated workflow graphs
Key: OOZIE-3059
URL: https://issues.apache.org/jira/browse/OOZIE-3059
Project: Oozie
Issue Type: Improvement
Affects Versions: 4.3.0
Reporter: Andras Piros
Fix For: 5.0.0
After OOZIE-2406 it's possible to serve the generated workflow graph in either
PNG or DOT format, see {{GraphGenerator}} and related source.
We want {{OozieCLI}} to serve the generated workflow graphs much like
{{V1JobServlet}}:
# option to have output format set to PNG or DOT
# option to show kill node or not
# stream the resulting file to {{$\{WORKFLOW_ID\}.png}} or
{{$\{WORKFLOW_ID\}.dot}}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (OOZIE-2406) Completely rewrite GraphGenerator code
[
https://issues.apache.org/jira/browse/OOZIE-2406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169363#comment-16169363
]
Hadoop QA commented on OOZIE-2406:
--
Testing JIRA OOZIE-2406
Cleaning local git workspace
{color:red}-1{color} Patch failed to apply to head of branch
> Completely rewrite GraphGenerator code
> --
>
> Key: OOZIE-2406
> URL: https://issues.apache.org/jira/browse/OOZIE-2406
> Project: Oozie
> Issue Type: New Feature
>Affects Versions: 4.2.0
>Reporter: Robert Kanter
>Assignee: Andras Piros
> Fix For: 5.0.0
>
> Attachments: graphviz-10-action-nodes.png,
> graphviz-25-action-nodes.png, graphviz-50-action-nodes.png,
> graphviz-many-nodes.png, jung-many-nodes.png, OOZIE-2406.004.patch,
> OOZIE-2406.004.patch, OOZIE-2406.005.patch, OOZIE-2406.006.patch
>
>
> The Web UI currently generates a graph of the workflow DAG as a png image
> that it can show to the user ({{GraphGenerator}} class). Unfortunately,
> there are a number of downsides to the current implementation:
> # The image is generated server-side, which doesn't scale well and eats up
> lots of memory
> #- To help combat this issue, we only generate graphs for workflows with less
> than 25 nodes and we disabled the refresh button in the UI
> # It's slow
> # It uses a library ({{net.sf.jung}} from http://jung.sourceforge.net), which
> hasn't been updated since 2010.
> #- This library also has a dependency on a fork of Commons-Collections
> ({{net.sourceforge.collections}} from
> http://sourceforge.net/projects/collections/), which similarly hasn't been
> updated since 2010. This is a problem because we can't update
> Commons-Collections when there are security concerns such as COLLECTIONS-580
> (though Oozie is *not* susceptible to this attack).
> It would be good to do a complete rewrite, using a different library and
> remove Jung and the Commons-Collections fork. Whatever we choose, it should
> an svg which will draw the image on the browser.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
Failed: OOZIE-2406 PreCommit Build #30
Jira: https://issues.apache.org/jira/browse/OOZIE-2406 Build: https://builds.apache.org/job/PreCommit-OOZIE-Build/30/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 670.92 KB...] [INFO] [INFO] Reactor Summary: [INFO] [INFO] Apache Oozie Main .. SUCCESS [ 2.538 s] [INFO] Apache Oozie Client SUCCESS [ 23.389 s] [INFO] Apache Oozie Share Lib Oozie ... SUCCESS [ 18.980 s] [INFO] Apache Oozie Share Lib HCatalog SUCCESS [ 10.311 s] [INFO] Apache Oozie Share Lib Distcp .. SUCCESS [ 7.784 s] [INFO] Apache Oozie Core .. SUCCESS [01:41 min] [INFO] Apache Oozie Share Lib Streaming ... SUCCESS [ 12.419 s] [INFO] Apache Oozie Share Lib Pig . SUCCESS [ 12.331 s] [INFO] Apache Oozie Share Lib Hive SUCCESS [ 12.578 s] [INFO] Apache Oozie Share Lib Hive 2 .. SUCCESS [ 12.710 s] [INFO] Apache Oozie Share Lib Sqoop ... SUCCESS [ 9.492 s] [INFO] Apache Oozie Examples .. SUCCESS [ 12.911 s] [INFO] Apache Oozie Share Lib Spark ... SUCCESS [ 15.447 s] [INFO] Apache Oozie Share Lib . SUCCESS [ 0.029 s] [INFO] Apache Oozie Docs .. SUCCESS [ 5.243 s] [INFO] Apache Oozie WebApp SUCCESS [ 3.774 s] [INFO] Apache Oozie Tools . SUCCESS [ 16.757 s] [INFO] Apache Oozie MiniOozie . SUCCESS [ 3.119 s] [INFO] Apache Oozie Server SUCCESS [ 15.793 s] [INFO] Apache Oozie Distro SUCCESS [ 2.490 s] [INFO] Apache Oozie ZooKeeper Security Tests .. SUCCESS [ 4.689 s] [INFO] [INFO] BUILD SUCCESS [INFO] [INFO] Total time: 05:05 min [INFO] Finished at: 2017-09-17T17:38:14Z [INFO] Final Memory: 621M/1863M [INFO] [TRACE] FindBugs output in HEAD verified and saved Running test-patch task BACKWARDS_COMPATIBILITY Running test-patch task TESTS Running test-patch task DISTRO Applying patch fatal: unrecognized input fatal: unrecognized input Patch failed to apply to head of branch % Total% Received % Xferd Average Speed TimeTime Time Current Dload Upload Total SpentLeft Speed 0 00 00 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 00 00 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 00 00 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 3706k 100 3706k0 0 4554k 0 --:--:-- --:--:-- --:--:-- 4554k Adding comment to JIRA Comment added. test-patch exit code: 1 Build step 'Execute shell' marked build as failure [description-setter] Description set: OOZIE-2406 Archiving artifacts [Fast Archiver] Compressed 834.83 KB of artifacts by 84.3% relative to #29 Recording test results ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error? Email was triggered for: Failure - Any Sending email for trigger: Failure - Any ### ## FAILED TESTS (if any) ## No tests ran.
[jira] [Updated] (OOZIE-2406) Completely rewrite GraphGenerator code
[
https://issues.apache.org/jira/browse/OOZIE-2406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andras Piros updated OOZIE-2406:
Attachment: graphviz-50-action-nodes.png
graphviz-25-action-nodes.png
graphviz-10-action-nodes.png
Different size graphs generated w/ {{GraphvizRenderer}} fitting
{{WebServicesAPI.twiki}}.
> Completely rewrite GraphGenerator code
> --
>
> Key: OOZIE-2406
> URL: https://issues.apache.org/jira/browse/OOZIE-2406
> Project: Oozie
> Issue Type: New Feature
>Affects Versions: 4.2.0
>Reporter: Robert Kanter
>Assignee: Andras Piros
> Fix For: 5.0.0
>
> Attachments: graphviz-10-action-nodes.png,
> graphviz-25-action-nodes.png, graphviz-50-action-nodes.png,
> graphviz-many-nodes.png, jung-many-nodes.png, OOZIE-2406.004.patch,
> OOZIE-2406.004.patch, OOZIE-2406.005.patch, OOZIE-2406.006.patch
>
>
> The Web UI currently generates a graph of the workflow DAG as a png image
> that it can show to the user ({{GraphGenerator}} class). Unfortunately,
> there are a number of downsides to the current implementation:
> # The image is generated server-side, which doesn't scale well and eats up
> lots of memory
> #- To help combat this issue, we only generate graphs for workflows with less
> than 25 nodes and we disabled the refresh button in the UI
> # It's slow
> # It uses a library ({{net.sf.jung}} from http://jung.sourceforge.net), which
> hasn't been updated since 2010.
> #- This library also has a dependency on a fork of Commons-Collections
> ({{net.sourceforge.collections}} from
> http://sourceforge.net/projects/collections/), which similarly hasn't been
> updated since 2010. This is a problem because we can't update
> Commons-Collections when there are security concerns such as COLLECTIONS-580
> (though Oozie is *not* susceptible to this attack).
> It would be good to do a complete rewrite, using a different library and
> remove Jung and the Commons-Collections fork. Whatever we choose, it should
> an svg which will draw the image on the browser.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
Re: Review Request 62352: OOZIE-2406 Completely rewrite GraphGenerator code
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/62352/ --- (Updated Sept. 17, 2017, 5:28 p.m.) Review request for oozie and Robert Kanter. Changes --- Addressing review comments, and extending functionality based on JIRA. Repository: oozie-git Description --- OOZIE-2406 Completely rewrite GraphGenerator code Diffs (updated) - client/src/main/java/org/apache/oozie/client/rest/RestConstants.java 74843dc9a3cbb8cef38e97f81e34731f191d9aab core/pom.xml b0809546d048c2acbcbea8af5f8947eb0eaece9e core/src/main/java/org/apache/oozie/servlet/V1JobServlet.java 10812c675ebc0cc4aefca9f4a85ef2fc26d143e1 core/src/main/java/org/apache/oozie/util/GraphGenerator.java 6ded2c6dc15c9e8453ff800407ff0324be185f41 core/src/main/java/org/apache/oozie/util/graph/GraphGenerator.java PRE-CREATION core/src/main/java/org/apache/oozie/util/graph/GraphRenderer.java PRE-CREATION core/src/main/java/org/apache/oozie/util/graph/GraphvizRenderer.java PRE-CREATION core/src/main/java/org/apache/oozie/util/graph/JungRenderer.java PRE-CREATION core/src/main/java/org/apache/oozie/util/graph/OutputFormat.java PRE-CREATION core/src/main/java/org/apache/oozie/util/graph/WorkflowActionNode.java PRE-CREATION core/src/main/java/org/apache/oozie/util/graph/WorkflowGraphHandler.java PRE-CREATION core/src/test/java/org/apache/oozie/servlet/TestV1JobServlet.java ee9ab556c9b6930c406ca5dcd54065cbbebb86c9 core/src/test/java/org/apache/oozie/util/TestGraphGenerator.java 002e925b57cd830ea6d83a87cea4383165116b80 core/src/test/java/org/apache/oozie/util/graph/TestGraphGenerator.java PRE-CREATION core/src/test/resources/graphWF.xml 6a7b0427a9951835a7533a04b66258ded369d5bf core/src/test/resources/graphWF_26_actions.xml a091be0f3559ede195ccc3339adee4478a8da8c0 core/src/test/resources/graphWF_50_actions.xml PRE-CREATION docs/src/site/twiki/WebServicesAPI.twiki ef3e60242512decd48beb3d8c9ac747b7d128eda pom.xml db18f30814b9b6a73ba872c2cd7946692d0b876b Diff: https://reviews.apache.org/r/62352/diff/2/ Changes: https://reviews.apache.org/r/62352/diff/1-2/ Testing --- `TestGraphGenerator`, `TestV1JobServlet` Thanks, András Piros
[jira] [Updated] (OOZIE-2406) Completely rewrite GraphGenerator code
[
https://issues.apache.org/jira/browse/OOZIE-2406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andras Piros updated OOZIE-2406:
Attachment: OOZIE-2406.006.patch
> Completely rewrite GraphGenerator code
> --
>
> Key: OOZIE-2406
> URL: https://issues.apache.org/jira/browse/OOZIE-2406
> Project: Oozie
> Issue Type: New Feature
>Affects Versions: 4.2.0
>Reporter: Robert Kanter
>Assignee: Andras Piros
> Fix For: 5.0.0
>
> Attachments: graphviz-many-nodes.png, jung-many-nodes.png,
> OOZIE-2406.004.patch, OOZIE-2406.004.patch, OOZIE-2406.005.patch,
> OOZIE-2406.006.patch
>
>
> The Web UI currently generates a graph of the workflow DAG as a png image
> that it can show to the user ({{GraphGenerator}} class). Unfortunately,
> there are a number of downsides to the current implementation:
> # The image is generated server-side, which doesn't scale well and eats up
> lots of memory
> #- To help combat this issue, we only generate graphs for workflows with less
> than 25 nodes and we disabled the refresh button in the UI
> # It's slow
> # It uses a library ({{net.sf.jung}} from http://jung.sourceforge.net), which
> hasn't been updated since 2010.
> #- This library also has a dependency on a fork of Commons-Collections
> ({{net.sourceforge.collections}} from
> http://sourceforge.net/projects/collections/), which similarly hasn't been
> updated since 2010. This is a problem because we can't update
> Commons-Collections when there are security concerns such as COLLECTIONS-580
> (though Oozie is *not* susceptible to this attack).
> It would be good to do a complete rewrite, using a different library and
> remove Jung and the Commons-Collections fork. Whatever we choose, it should
> an svg which will draw the image on the browser.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (OOZIE-2406) Completely rewrite GraphGenerator code
[
https://issues.apache.org/jira/browse/OOZIE-2406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169359#comment-16169359
]
Andras Piros commented on OOZIE-2406:
-
Hi [~rkanter],
thanks for the review!
Addressing your points:
# I'd still wait until we've measured {{GraphvizRenderer}} is not much slower /
consumes not much more CPU or heap than {{JungRenderer}}. In any case, writing
a new {{GraphRenderer}} implementation w/ a new PNG generation library is not
much of a story by now
# I have the test case {{TestGraphGenerator#testSingleThreadedPerformance}}
that does rendering of a 53-node graph 5 times in a row - that takes now about
8 secs. I can extend that to measure performance more, or have a real cluster
w/ real workflows, JMeter set up etc.
# color handling of edges and nodes is modified to fit documentation
{{WebServicesAPI.twiki}}
# yes, filing separate JIRA for temp file based PNG caching
# it's implemented
# filing separate JIRA for extending Oozie CLI w/ graph generation and
downloading
> Completely rewrite GraphGenerator code
> --
>
> Key: OOZIE-2406
> URL: https://issues.apache.org/jira/browse/OOZIE-2406
> Project: Oozie
> Issue Type: New Feature
>Affects Versions: 4.2.0
>Reporter: Robert Kanter
>Assignee: Andras Piros
> Fix For: 5.0.0
>
> Attachments: graphviz-many-nodes.png, jung-many-nodes.png,
> OOZIE-2406.004.patch, OOZIE-2406.004.patch, OOZIE-2406.005.patch
>
>
> The Web UI currently generates a graph of the workflow DAG as a png image
> that it can show to the user ({{GraphGenerator}} class). Unfortunately,
> there are a number of downsides to the current implementation:
> # The image is generated server-side, which doesn't scale well and eats up
> lots of memory
> #- To help combat this issue, we only generate graphs for workflows with less
> than 25 nodes and we disabled the refresh button in the UI
> # It's slow
> # It uses a library ({{net.sf.jung}} from http://jung.sourceforge.net), which
> hasn't been updated since 2010.
> #- This library also has a dependency on a fork of Commons-Collections
> ({{net.sourceforge.collections}} from
> http://sourceforge.net/projects/collections/), which similarly hasn't been
> updated since 2010. This is a problem because we can't update
> Commons-Collections when there are security concerns such as COLLECTIONS-580
> (though Oozie is *not* susceptible to this attack).
> It would be good to do a complete rewrite, using a different library and
> remove Jung and the Commons-Collections fork. Whatever we choose, it should
> an svg which will draw the image on the browser.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
Re: Review Request 62352: OOZIE-2406 Completely rewrite GraphGenerator code
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/62352/ --- (Updated Sept. 17, 2017, 5:17 p.m.) Review request for oozie and Robert Kanter. Repository: oozie-git Description --- OOZIE-2406 Completely rewrite GraphGenerator code Diffs - core/pom.xml b0809546d048c2acbcbea8af5f8947eb0eaece9e core/src/main/java/org/apache/oozie/servlet/V1JobServlet.java 10812c675ebc0cc4aefca9f4a85ef2fc26d143e1 core/src/main/java/org/apache/oozie/util/GraphGenerator.java 6ded2c6dc15c9e8453ff800407ff0324be185f41 core/src/main/java/org/apache/oozie/util/graph/GraphGenerator.java PRE-CREATION core/src/main/java/org/apache/oozie/util/graph/GraphRenderer.java PRE-CREATION core/src/main/java/org/apache/oozie/util/graph/GraphvizRenderer.java PRE-CREATION core/src/main/java/org/apache/oozie/util/graph/JungRenderer.java PRE-CREATION core/src/main/java/org/apache/oozie/util/graph/WorkflowActionNode.java PRE-CREATION core/src/main/java/org/apache/oozie/util/graph/WorkflowGraphHandler.java PRE-CREATION core/src/test/java/org/apache/oozie/util/TestGraphGenerator.java 002e925b57cd830ea6d83a87cea4383165116b80 core/src/test/resources/graph-with-many-nodes.png PRE-CREATION core/src/test/resources/graphWF_100_actions.xml PRE-CREATION pom.xml db18f30814b9b6a73ba872c2cd7946692d0b876b sharelib/oozie/pom.xml c74c06df5313b340e27747dfdf9126b3479674af Diff: https://reviews.apache.org/r/62352/diff/1/ Testing (updated) --- `TestGraphGenerator`, `TestV1JobServlet` Thanks, András Piros
[jira] [Commented] (OOZIE-2909) LauncherAM: rewrite UGI calls
[
https://issues.apache.org/jira/browse/OOZIE-2909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169316#comment-16169316
]
Hadoop QA commented on OOZIE-2909:
--
Testing JIRA OOZIE-2909
Cleaning local git workspace
{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:green}+1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than
132
.{color:green}+1{color} the patch does adds/modifies 7 testcase(s)
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc
warnings
.{color:red}WARNING{color}: the current HEAD has 77 Javadoc warning(s)
{color:green}+1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:green}+1{color} the patch does not seem to introduce new javac
warnings
{color:orange}0{color} There are [6] new bugs found in total that would be nice
to have fixed.
. {color:green}+1{color} There are no new bugs found in [docs].
. {color:green}+1{color} There are no new bugs found in [examples].
. {color:green}+1{color} There are no new bugs found in [tools].
. {color:orange}0{color} There are [3] new bugs found in [core] that would be
nice to have fixed.
. You can find the FindBugs diff here: core/findbugs-new.html
. {color:green}+1{color} There are no new bugs found in [server].
. {color:green}+1{color} There are no new bugs found in [client].
. {color:green}+1{color} There are no new bugs found in [sharelib/distcp].
. {color:orange}0{color} There are [3] new bugs found in [sharelib/oozie] that
would be nice to have fixed.
. You can find the FindBugs diff here: sharelib/oozie/findbugs-new.html
. {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
. {color:green}+1{color} There are no new bugs found in [sharelib/streaming].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive].
. {color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
. {color:green}+1{color} There are no new bugs found in [sharelib/spark].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive2].
. {color:green}+1{color} There are no new bugs found in [sharelib/pig].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:green}+1 TESTS{color}
.Tests run: 2013
.Tests rerun: 113
.Tests failed at first run:
org.apache.oozie.service.TestPartitionDependencyManagerEhcache,org.apache.oozie.jms.TestHCatMessageHandler,org.apache.oozie.command.coord.TestCoordActionsKillXCommand,org.apache.oozie.jms.TestJMSSLAEventListener,org.apache.oozie.command.coord.TestCoordActionInputCheckXCommandNonUTC,org.apache.oozie.service.TestJMSAccessorService,org.apache.oozie.service.TestRecoveryService,org.apache.oozie.jms.TestJMSJobEventListener,org.apache.oozie.jms.TestDefaultConnectionContext,org.apache.oozie.action.hadoop.TestJavaActionExecutor,
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch
{color:green}*+1 Overall result, good!, no -1s*{color}
{color:red}. There is at least one warning, please check{color}
The full output of the test-patch run is available at
. https://builds.apache.org/job/PreCommit-OOZIE-Build/29/
> LauncherAM: rewrite UGI calls
> -
>
> Key: OOZIE-2909
> URL: https://issues.apache.org/jira/browse/OOZIE-2909
> Project: Oozie
> Issue Type: Sub-task
>Reporter: Peter Bacsko
>Assignee: Peter Cseh
>Priority: Blocker
> Attachments: OOZIE-2909-001.patch, OOZIE-2909-002.patch,
> OOZIE-2909-003.patch, OOZIE-2909-004.patch, OOZIE-2909-005.patch,
> OOZIE-2909-006.patch, OOZIE-2909-007.patch
>
>
> There are two problems in LauncherAM:
> 1) In a kerberized cluster, we have to use {{UGI.getLoginUser()}} even though
> a call to {{createRemoteUser()}} should be enough, just like in
> {{MRAppMaster.java}}. Reference code:
> https://github.com/apache/hadoop/blob/3ed3062fe3979ff55a411b730a8eee2b2c96d6b3/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java#L1718-L1726
> 2) It's enough if we wrap the whole LauncherAM logic in a single {{doAs()}}
> call. No need for multiple {{doAs()}}, just makes the whole
Success: OOZIE-2909 PreCommit Build #29
Jira: https://issues.apache.org/jira/browse/OOZIE-2909 Build: https://builds.apache.org/job/PreCommit-OOZIE-Build/29/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 1.60 MB...] +1 JAVADOC +1 the patch does not seem to introduce new Javadoc warnings WARNING: the current HEAD has 77 Javadoc warning(s) +1 COMPILE +1 HEAD compiles +1 patch compiles +1 the patch does not seem to introduce new javac warnings 0 There are [6] new bugs found in total that would be nice to have fixed. +1 There are no new bugs found in [docs]. +1 There are no new bugs found in [examples]. +1 There are no new bugs found in [tools]. 0 There are [3] new bugs found in [core] that would be nice to have fixed. You can find the FindBugs diff here: core/findbugs-new.html +1 There are no new bugs found in [server]. +1 There are no new bugs found in [client]. +1 There are no new bugs found in [sharelib/distcp]. 0 There are [3] new bugs found in [sharelib/oozie] that would be nice to have fixed. You can find the FindBugs diff here: sharelib/oozie/findbugs-new.html +1 There are no new bugs found in [sharelib/hcatalog]. +1 There are no new bugs found in [sharelib/streaming]. +1 There are no new bugs found in [sharelib/hive]. +1 There are no new bugs found in [sharelib/sqoop]. +1 There are no new bugs found in [sharelib/spark]. +1 There are no new bugs found in [sharelib/hive2]. +1 There are no new bugs found in [sharelib/pig]. +1 BACKWARDS_COMPATIBILITY +1 the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations +1 the patch does not modify JPA files +1 TESTS Tests run: 2013 Tests rerun: 113 Tests failed at first run: org.apache.oozie.service.TestPartitionDependencyManagerEhcache,org.apache.oozie.jms.TestHCatMessageHandler,org.apache.oozie.command.coord.TestCoordActionsKillXCommand,org.apache.oozie.jms.TestJMSSLAEventListener,org.apache.oozie.command.coord.TestCoordActionInputCheckXCommandNonUTC,org.apache.oozie.service.TestJMSAccessorService,org.apache.oozie.service.TestRecoveryService,org.apache.oozie.jms.TestJMSJobEventListener,org.apache.oozie.jms.TestDefaultConnectionContext,org.apache.oozie.action.hadoop.TestJavaActionExecutor, +1 DISTRO +1 distro tarball builds with the patch +1 Overall result, good!, no -1s There is at least one warning, please check The full output of the test-patch run is available at https://builds.apache.org/job/PreCommit-OOZIE-Build/29/ % Total% Received % Xferd Average Speed TimeTime Time Current Dload Upload Total SpentLeft Speed 0 00 00 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 00 00 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 3706k0 72400 0 9291 0 0:06:48 --:--:-- 0:06:48 9291100 3706k 100 3706k0 0 3775k 0 --:--:-- --:--:-- --:--:-- 17.8M Adding comment to JIRA Comment added. test-patch exit code: 0 [description-setter] Description set: OOZIE-2909 Archiving artifacts [Fast Archiver] Compressed 1.80 MB of artifacts by 43.5% relative to #25 Recording test results Email was triggered for: Success Sending email for trigger: Success ### ## FAILED TESTS (if any) ## All tests passed
[jira] [Commented] (OOZIE-2909) LauncherAM: rewrite UGI calls
[
https://issues.apache.org/jira/browse/OOZIE-2909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169271#comment-16169271
]
Peter Cseh commented on OOZIE-2909:
---
Tests failed with timeout due to
{code}
*** java.lang.instrument ASSERTION FAILED ***: "!errorOutstanding" with message
can't create byte arrau at JPLISAgent.c line: 813
{code}
I've retriggered the job to see if it goes away.
> LauncherAM: rewrite UGI calls
> -
>
> Key: OOZIE-2909
> URL: https://issues.apache.org/jira/browse/OOZIE-2909
> Project: Oozie
> Issue Type: Sub-task
>Reporter: Peter Bacsko
>Assignee: Peter Cseh
>Priority: Blocker
> Attachments: OOZIE-2909-001.patch, OOZIE-2909-002.patch,
> OOZIE-2909-003.patch, OOZIE-2909-004.patch, OOZIE-2909-005.patch,
> OOZIE-2909-006.patch, OOZIE-2909-007.patch
>
>
> There are two problems in LauncherAM:
> 1) In a kerberized cluster, we have to use {{UGI.getLoginUser()}} even though
> a call to {{createRemoteUser()}} should be enough, just like in
> {{MRAppMaster.java}}. Reference code:
> https://github.com/apache/hadoop/blob/3ed3062fe3979ff55a411b730a8eee2b2c96d6b3/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java#L1718-L1726
> 2) It's enough if we wrap the whole LauncherAM logic in a single {{doAs()}}
> call. No need for multiple {{doAs()}}, just makes the whole thing more
> complicated.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Commented] (OOZIE-2909) LauncherAM: rewrite UGI calls
[
https://issues.apache.org/jira/browse/OOZIE-2909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169247#comment-16169247
]
Hadoop QA commented on OOZIE-2909:
--
Testing JIRA OOZIE-2909
Cleaning local git workspace
{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:green}+1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than
132
.{color:green}+1{color} the patch does adds/modifies 7 testcase(s)
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc
warnings
.{color:red}WARNING{color}: the current HEAD has 77 Javadoc warning(s)
{color:green}+1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:green}+1{color} the patch does not seem to introduce new javac
warnings
{color:orange}0{color} There are [6] new bugs found in total that would be nice
to have fixed.
. {color:green}+1{color} There are no new bugs found in [docs].
. {color:green}+1{color} There are no new bugs found in [examples].
. {color:green}+1{color} There are no new bugs found in [tools].
. {color:orange}0{color} There are [3] new bugs found in [core] that would be
nice to have fixed.
. You can find the FindBugs diff here: core/findbugs-new.html
. {color:green}+1{color} There are no new bugs found in [server].
. {color:green}+1{color} There are no new bugs found in [client].
. {color:green}+1{color} There are no new bugs found in [sharelib/distcp].
. {color:orange}0{color} There are [3] new bugs found in [sharelib/oozie] that
would be nice to have fixed.
. You can find the FindBugs diff here: sharelib/oozie/findbugs-new.html
. {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
. {color:green}+1{color} There are no new bugs found in [sharelib/streaming].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive].
. {color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
. {color:green}+1{color} There are no new bugs found in [sharelib/spark].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive2].
. {color:green}+1{color} There are no new bugs found in [sharelib/pig].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color} - patch does not compile, cannot run testcases
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch
{color:red}*-1 Overall result, please check the reported -1(s)*{color}
{color:red}. There is at least one warning, please check{color}
The full output of the test-patch run is available at
. https://builds.apache.org/job/PreCommit-OOZIE-Build/28/
> LauncherAM: rewrite UGI calls
> -
>
> Key: OOZIE-2909
> URL: https://issues.apache.org/jira/browse/OOZIE-2909
> Project: Oozie
> Issue Type: Sub-task
>Reporter: Peter Bacsko
>Assignee: Peter Cseh
>Priority: Blocker
> Attachments: OOZIE-2909-001.patch, OOZIE-2909-002.patch,
> OOZIE-2909-003.patch, OOZIE-2909-004.patch, OOZIE-2909-005.patch,
> OOZIE-2909-006.patch, OOZIE-2909-007.patch
>
>
> There are two problems in LauncherAM:
> 1) In a kerberized cluster, we have to use {{UGI.getLoginUser()}} even though
> a call to {{createRemoteUser()}} should be enough, just like in
> {{MRAppMaster.java}}. Reference code:
> https://github.com/apache/hadoop/blob/3ed3062fe3979ff55a411b730a8eee2b2c96d6b3/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java#L1718-L1726
> 2) It's enough if we wrap the whole LauncherAM logic in a single {{doAs()}}
> call. No need for multiple {{doAs()}}, just makes the whole thing more
> complicated.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
Failed: OOZIE-2909 PreCommit Build #28
Jira: https://issues.apache.org/jira/browse/OOZIE-2909 Build: https://builds.apache.org/job/PreCommit-OOZIE-Build/28/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 1.54 MB...] +1 RAT +1 the patch does not seem to introduce new RAT warnings +1 JAVADOC +1 the patch does not seem to introduce new Javadoc warnings WARNING: the current HEAD has 77 Javadoc warning(s) +1 COMPILE +1 HEAD compiles +1 patch compiles +1 the patch does not seem to introduce new javac warnings 0 There are [6] new bugs found in total that would be nice to have fixed. +1 There are no new bugs found in [docs]. +1 There are no new bugs found in [examples]. +1 There are no new bugs found in [tools]. 0 There are [3] new bugs found in [core] that would be nice to have fixed. You can find the FindBugs diff here: core/findbugs-new.html +1 There are no new bugs found in [server]. +1 There are no new bugs found in [client]. +1 There are no new bugs found in [sharelib/distcp]. 0 There are [3] new bugs found in [sharelib/oozie] that would be nice to have fixed. You can find the FindBugs diff here: sharelib/oozie/findbugs-new.html +1 There are no new bugs found in [sharelib/hcatalog]. +1 There are no new bugs found in [sharelib/streaming]. +1 There are no new bugs found in [sharelib/hive]. +1 There are no new bugs found in [sharelib/sqoop]. +1 There are no new bugs found in [sharelib/spark]. +1 There are no new bugs found in [sharelib/hive2]. +1 There are no new bugs found in [sharelib/pig]. +1 BACKWARDS_COMPATIBILITY +1 the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations +1 the patch does not modify JPA files -1 TESTS - patch does not compile, cannot run testcases +1 DISTRO +1 distro tarball builds with the patch -1 Overall result, please check the reported -1(s) There is at least one warning, please check The full output of the test-patch run is available at https://builds.apache.org/job/PreCommit-OOZIE-Build/28/ % Total% Received % Xferd Average Speed TimeTime Time Current Dload Upload Total SpentLeft Speed 0 00 00 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 00 00 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 00 00 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 3706k 100 3706k0 0 4661k 0 --:--:-- --:--:-- --:--:-- 4661k Adding comment to JIRA Comment added. test-patch exit code: 1 Build step 'Execute shell' marked build as failure [description-setter] Description set: OOZIE-2909 Archiving artifacts [Fast Archiver] Compressed 1.80 MB of artifacts by 43.5% relative to #25 Recording test results Email was triggered for: Failure - Any Sending email for trigger: Failure - Any ### ## FAILED TESTS (if any) ## All tests passed
[jira] [Commented] (OOZIE-3048) Check El Functions for the coordinator action
[ https://issues.apache.org/jira/browse/OOZIE-3048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169229#comment-16169229 ] Andras Piros commented on OOZIE-3048: - [~satishsaley] thanks for the contribution! Can you please put the patch to ReviewBoard? > Check El Functions for the coordinator action > - > > Key: OOZIE-3048 > URL: https://issues.apache.org/jira/browse/OOZIE-3048 > Project: Oozie > Issue Type: Bug >Reporter: Satish Subhashrao Saley >Assignee: Satish Subhashrao Saley > Attachments: OOZIE-3048-1.patch > > > In OOZIE-2873, we tried introduce check for EL functions before submitting > the coordinator. But this not possible as described > [here|https://issues.apache.org/jira/browse/OOZIE-2873?focusedCommentId=15999124=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15999124]. > Instead, we can do this check in CoordActionInputCheckXCommand when we > resolve coordinator configuration. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (OOZIE-3058) nocleanup option is missing in oozie-coordinator-0.5.xsd
[ https://issues.apache.org/jira/browse/OOZIE-3058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169218#comment-16169218 ] Peter Cseh commented on OOZIE-3058: --- [~satishsaley], can you explain what the ((nocleanup}} option does for input datasets? > nocleanup option is missing in oozie-coordinator-0.5.xsd > > > Key: OOZIE-3058 > URL: https://issues.apache.org/jira/browse/OOZIE-3058 > Project: Oozie > Issue Type: Bug >Reporter: Satish Subhashrao Saley >Assignee: Satish Subhashrao Saley > Attachments: OOZIE-3058-1.patch > > > nocleanup option is missing in oozie-coordinator-0.5.xsd which is there in > [oozie-coordinator-0.4.xsd|https://github.com/apache/oozie/blob/master/client/src/main/resources/oozie-coordinator-0.4.xsd#L119]. > And it is missing in documentation for versions. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
Re: Review Request 61560: OOZIE-2909 LauncherAM: rewrite UGI calls
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/61560/ --- (Updated Sept. 17, 2017, 7:06 a.m.) Review request for oozie, Attila Sasvari, Peter Bacsko, Robert Kanter, and Rohini Palaniswamy. Bugs: OOZIE-2909 https://issues.apache.org/jira/browse/OOZIE-2909 Repository: oozie-git Description --- Changing UGI calls and cleaning up things around requesting tokens. Diffs (updated) - core/src/main/java/org/apache/oozie/ErrorCode.java 662e1edc9c4b23b3606c751bf5ed4b531ee7ac62 core/src/main/java/org/apache/oozie/action/hadoop/CredentialsProperties.java 20f93ce57618a529b1bd83b398add2cd1d96b36e core/src/main/java/org/apache/oozie/action/hadoop/CredentialsProviderFactory.java 5ca8d3e80942840a5bba51a06694350929044042 core/src/main/java/org/apache/oozie/action/hadoop/HCatCredentialHelper.java 9804c7b673a899cd9c778850c9a64731cc642fb3 core/src/main/java/org/apache/oozie/action/hadoop/HCatCredentials.java 52abbf17afa71e702d7871d10a4a190a4d21e47b core/src/main/java/org/apache/oozie/action/hadoop/HDFSCredentials.java PRE-CREATION core/src/main/java/org/apache/oozie/action/hadoop/HadoopTokenHelper.java PRE-CREATION core/src/main/java/org/apache/oozie/action/hadoop/HbaseCredentials.java 4add5f14cb20ab77c755b81eff939335c0c5fddc core/src/main/java/org/apache/oozie/action/hadoop/Hive2Credentials.java 0b495f75842b0033a3337ef6728a334bf5651770 core/src/main/java/org/apache/oozie/action/hadoop/JHSCredentials.java PRE-CREATION core/src/main/java/org/apache/oozie/action/hadoop/JavaActionExecutor.java 49fd4b8560b21aef725c3268f0ec0e7f46a46ee9 core/src/main/java/org/apache/oozie/action/hadoop/YarnRMCredentials.java PRE-CREATION core/src/main/java/org/apache/oozie/service/HadoopAccessorService.java 187cee2290ba4bbe358913d28a052d9c75f2369a core/src/test/java/org/apache/oozie/action/hadoop/TestHadoopTokenHelper.java PRE-CREATION core/src/test/java/org/apache/oozie/action/hadoop/TestJavaActionExecutor.java d1d78fd527a425b076edd7bb23ba56ebdba62664 core/src/test/java/org/apache/oozie/action/hadoop/TestShellMain.java a7d6c18a645b50fc35657515480da9967fa74e2e core/src/test/java/org/apache/oozie/command/wf/TestWorkflowActionKillXCommand.java cf77f18c4bdbe95ea66f63aa115ce6f34c90c855 core/src/test/java/org/apache/oozie/service/TestHadoopAccessorService.java 960c2f9750062c98fdf7a2b456d3668069e07ca5 sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/AMRMClientAsyncFactory.java b4cbb4b1d9b52aaebfb562c02edc91e15a2a9a2e sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/HdfsOperations.java 874d371664ced3ae19a7b5d615c67d4c72e7cfdd sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/LauncherAM.java 6a98d6ef3a09a7a75272f3f0f9a9c2fc5472e76d sharelib/oozie/src/main/java/org/apache/oozie/action/hadoop/ShellMain.java bde7f1daf123d663d47f5d2fb2350cfa1ac33ed8 sharelib/oozie/src/test/java/org/apache/oozie/action/hadoop/TestHdfsOperations.java 68c0f4bafe0322ff0d1007297cd6e8f38c92020a sharelib/oozie/src/test/java/org/apache/oozie/action/hadoop/TestLauncherAM.java 37af3dd9ed43f4504ff3909484237e2d05665c6c Diff: https://reviews.apache.org/r/61560/diff/7/ Changes: https://reviews.apache.org/r/61560/diff/6-7/ Testing --- We're running tests on a Kerberized cluster with these changes. Thanks, Peter Cseh
[jira] [Updated] (OOZIE-2909) LauncherAM: rewrite UGI calls
[
https://issues.apache.org/jira/browse/OOZIE-2909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Peter Cseh updated OOZIE-2909:
--
Attachment: OOZIE-2909-007.patch
break long lines
> LauncherAM: rewrite UGI calls
> -
>
> Key: OOZIE-2909
> URL: https://issues.apache.org/jira/browse/OOZIE-2909
> Project: Oozie
> Issue Type: Sub-task
>Reporter: Peter Bacsko
>Assignee: Peter Cseh
>Priority: Blocker
> Attachments: OOZIE-2909-001.patch, OOZIE-2909-002.patch,
> OOZIE-2909-003.patch, OOZIE-2909-004.patch, OOZIE-2909-005.patch,
> OOZIE-2909-006.patch, OOZIE-2909-007.patch
>
>
> There are two problems in LauncherAM:
> 1) In a kerberized cluster, we have to use {{UGI.getLoginUser()}} even though
> a call to {{createRemoteUser()}} should be enough, just like in
> {{MRAppMaster.java}}. Reference code:
> https://github.com/apache/hadoop/blob/3ed3062fe3979ff55a411b730a8eee2b2c96d6b3/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapreduce/v2/app/MRAppMaster.java#L1718-L1726
> 2) It's enough if we wrap the whole LauncherAM logic in a single {{doAs()}}
> call. No need for multiple {{doAs()}}, just makes the whole thing more
> complicated.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] Subscription: Oozie Patch Available
Issue Subscription Filter: Oozie Patch Available (106 issues) Subscriber: ooziedaily Key Summary OOZIE-3054 Disable erasure coding for sharelib if Oozie runs on Hadoop 3 https://issues-test.apache.org/jira/browse/OOZIE-3054 OOZIE-3031 Coord job with only unresolved dependencies doesn't timeout https://issues-test.apache.org/jira/browse/OOZIE-3031 OOZIE-3022 fix for warning has no file and won't be listed in dependency files details https://issues-test.apache.org/jira/browse/OOZIE-3022 OOZIE-3002 address findbugs errors in client lib https://issues-test.apache.org/jira/browse/OOZIE-3002 OOZIE-3001 core library has many instances of warnings with trailing spaces and lines longer than 132 chars https://issues-test.apache.org/jira/browse/OOZIE-3001 OOZIE-2997 files contain trailing white spaces in client lib https://issues-test.apache.org/jira/browse/OOZIE-2997 OOZIE-2996 add option for -UseGCOverheadLimit to maven opts as sometimes local testing fails https://issues-test.apache.org/jira/browse/OOZIE-2996 OOZIE-2978 Remove code that handles Pig versions before 0.8 https://issues-test.apache.org/jira/browse/OOZIE-2978 OOZIE-2975 code clean up in pig sharelib, replace Exception with more explicit, add try with resources, StringBuilder instead of StringBuffer https://issues-test.apache.org/jira/browse/OOZIE-2975 OOZIE-2969 Drop support for Java 1.7 https://issues-test.apache.org/jira/browse/OOZIE-2969 OOZIE-2964 Add -Xdoclint:none to javadoc opts to avoid warnings https://issues-test.apache.org/jira/browse/OOZIE-2964 OOZIE-2963 getting error in build ArtifactNotFoundException: Could not find artifact org.pentaho:pentaho-aggdesigner-algorithm:jar:5.1.5-jhyde https://issues-test.apache.org/jira/browse/OOZIE-2963 OOZIE-2962 bump maven-javadoc-plugin to 2.10.4 https://issues-test.apache.org/jira/browse/OOZIE-2962 OOZIE-2957 Documentation states that starting a coordinator is possible https://issues-test.apache.org/jira/browse/OOZIE-2957 OOZIE-2956 Fix Findbugs warnings related to reliance on default encoding in oozie-core https://issues-test.apache.org/jira/browse/OOZIE-2956 OOZIE-2955 Fix Findbugs warnings related to reliance on default encoding in oozie-client https://issues-test.apache.org/jira/browse/OOZIE-2955 OOZIE-2954 Fix Checkstyle issues in oozie-client https://issues-test.apache.org/jira/browse/OOZIE-2954 OOZIE-2953 Fix Checkstyle issues in oozie-tools https://issues-test.apache.org/jira/browse/OOZIE-2953 OOZIE-2952 Fix Findbugs warnings in oozie-sharelib-oozie https://issues-test.apache.org/jira/browse/OOZIE-2952 OOZIE-2949 Escape quotes whitespaces in Sqoop field https://issues-test.apache.org/jira/browse/OOZIE-2949 OOZIE-2942 Fix Findbugs warnings in oozie-examples https://issues-test.apache.org/jira/browse/OOZIE-2942 OOZIE-2937 Remove redundant groupId from the child pom's https://issues-test.apache.org/jira/browse/OOZIE-2937 OOZIE-2934 Fix "Exceptional return value of java.io.File.mkdirs() ignored" Findbugs error in oozie-sharelib-spark https://issues-test.apache.org/jira/browse/OOZIE-2934 OOZIE-2927 Append new line character for Hive2 query using query tag https://issues-test.apache.org/jira/browse/OOZIE-2927 OOZIE-2914 Consolidate Trim https://issues-test.apache.org/jira/browse/OOZIE-2914 OOZIE-2909 LauncherAM: rewrite UGI calls https://issues-test.apache.org/jira/browse/OOZIE-2909 OOZIE-2883 OOZIE throw the error "Missing [oozie.service.ProxyUserService.proxyuser.oozie.service.ProxyUserService.proxyuser.mr.groups] property" https://issues-test.apache.org/jira/browse/OOZIE-2883 OOZIE-2877 Oozie Git Action https://issues-test.apache.org/jira/browse/OOZIE-2877 OOZIE-2867 Timezone handling for Coordinators: emphasize "Continent/City" format https://issues-test.apache.org/jira/browse/OOZIE-2867 OOZIE-2834 ParameterVerifier logging non-useful warning for workflow definition https://issues-test.apache.org/jira/browse/OOZIE-2834 OOZIE-2833 when using uber mode the regex pattern used in the extractHeapSizeMB method does not allow heap sizes specified in bytes. https://issues-test.apache.org/jira/browse/OOZIE-2833 OOZIE-2829 Improve sharelib upload to accept multiple source folders https://issues-test.apache.org/jira/browse/OOZIE-2829 OOZIE-2826 Falcon feed fails to aws s3; Oozie joda time version does not meet required jar version 2.2 or later https://issues-test.apache.org/jira/browse/OOZIE-2826 OOZIE-2812 SparkConfigurationService should support loading configurations from multiple Spark versions
[jira] Subscription: Oozie Patch Available
Issue Subscription Filter: Oozie Patch Available (107 issues) Subscriber: ooziedaily Key Summary OOZIE-3054 Disable erasure coding for sharelib if Oozie runs on Hadoop 3 https://issues.apache.org/jira/browse/OOZIE-3054 OOZIE-3048 Check El Functions for the coordinator action https://issues.apache.org/jira/browse/OOZIE-3048 OOZIE-3031 Coord job with only unresolved dependencies doesn't timeout https://issues.apache.org/jira/browse/OOZIE-3031 OOZIE-3022 fix for warning has no file and won't be listed in dependency files details https://issues.apache.org/jira/browse/OOZIE-3022 OOZIE-3002 address findbugs errors in client lib https://issues.apache.org/jira/browse/OOZIE-3002 OOZIE-3001 core library has many instances of warnings with trailing spaces and lines longer than 132 chars https://issues.apache.org/jira/browse/OOZIE-3001 OOZIE-2997 files contain trailing white spaces in client lib https://issues.apache.org/jira/browse/OOZIE-2997 OOZIE-2996 add option for -UseGCOverheadLimit to maven opts as sometimes local testing fails https://issues.apache.org/jira/browse/OOZIE-2996 OOZIE-2978 Remove code that handles Pig versions before 0.8 https://issues.apache.org/jira/browse/OOZIE-2978 OOZIE-2975 code clean up in pig sharelib, replace Exception with more explicit, add try with resources, StringBuilder instead of StringBuffer https://issues.apache.org/jira/browse/OOZIE-2975 OOZIE-2969 Drop support for Java 1.7 https://issues.apache.org/jira/browse/OOZIE-2969 OOZIE-2964 Add -Xdoclint:none to javadoc opts to avoid warnings https://issues.apache.org/jira/browse/OOZIE-2964 OOZIE-2963 getting error in build ArtifactNotFoundException: Could not find artifact org.pentaho:pentaho-aggdesigner-algorithm:jar:5.1.5-jhyde https://issues.apache.org/jira/browse/OOZIE-2963 OOZIE-2962 bump maven-javadoc-plugin to 2.10.4 https://issues.apache.org/jira/browse/OOZIE-2962 OOZIE-2957 Documentation states that starting a coordinator is possible https://issues.apache.org/jira/browse/OOZIE-2957 OOZIE-2956 Fix Findbugs warnings related to reliance on default encoding in oozie-core https://issues.apache.org/jira/browse/OOZIE-2956 OOZIE-2955 Fix Findbugs warnings related to reliance on default encoding in oozie-client https://issues.apache.org/jira/browse/OOZIE-2955 OOZIE-2954 Fix Checkstyle issues in oozie-client https://issues.apache.org/jira/browse/OOZIE-2954 OOZIE-2953 Fix Checkstyle issues in oozie-tools https://issues.apache.org/jira/browse/OOZIE-2953 OOZIE-2952 Fix Findbugs warnings in oozie-sharelib-oozie https://issues.apache.org/jira/browse/OOZIE-2952 OOZIE-2949 Escape quotes whitespaces in Sqoop field https://issues.apache.org/jira/browse/OOZIE-2949 OOZIE-2942 Fix Findbugs warnings in oozie-examples https://issues.apache.org/jira/browse/OOZIE-2942 OOZIE-2937 Remove redundant groupId from the child pom's https://issues.apache.org/jira/browse/OOZIE-2937 OOZIE-2934 Fix "Exceptional return value of java.io.File.mkdirs() ignored" Findbugs error in oozie-sharelib-spark https://issues.apache.org/jira/browse/OOZIE-2934 OOZIE-2927 Append new line character for Hive2 query using query tag https://issues.apache.org/jira/browse/OOZIE-2927 OOZIE-2914 Consolidate Trim https://issues.apache.org/jira/browse/OOZIE-2914 OOZIE-2909 LauncherAM: rewrite UGI calls https://issues.apache.org/jira/browse/OOZIE-2909 OOZIE-2883 OOZIE throw the error "Missing [oozie.service.ProxyUserService.proxyuser.oozie.service.ProxyUserService.proxyuser.mr.groups] property" https://issues.apache.org/jira/browse/OOZIE-2883 OOZIE-2877 Oozie Git Action https://issues.apache.org/jira/browse/OOZIE-2877 OOZIE-2867 Timezone handling for Coordinators: emphasize "Continent/City" format https://issues.apache.org/jira/browse/OOZIE-2867 OOZIE-2834 ParameterVerifier logging non-useful warning for workflow definition https://issues.apache.org/jira/browse/OOZIE-2834 OOZIE-2833 when using uber mode the regex pattern used in the extractHeapSizeMB method does not allow heap sizes specified in bytes. https://issues.apache.org/jira/browse/OOZIE-2833 OOZIE-2829 Improve sharelib upload to accept multiple source folders https://issues.apache.org/jira/browse/OOZIE-2829 OOZIE-2826 Falcon feed fails to aws s3; Oozie joda time version does not meet required jar version 2.2 or later https://issues.apache.org/jira/browse/OOZIE-2826 OOZIE-2812 SparkConfigurationService should support loading configurations from multiple Spark versions https://issues.apache.org/jira/browse/OOZIE-2812 OOZIE-2795 Create lib directory or symlink
