[jira] [Commented] (OOZIE-2339) [fluent-job] Minimum Viable Fluent Job API

[Robert Kanter (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-2339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512962#comment-16512962
 ] 

Robert Kanter commented on OOZIE-2339:
--

+1 on not using {{ImmutableMap}}, etc.  We should be careful to only expose 
standard Java objects and not any third-party library objects (especially 
Guava) to make future compatibility easier.  
+1 on the {{getAsXml()}} method.  That should cover what I was trying to get at 
in my previous comment about a way to get the XML without having to build a 
JAR.  This can be done as a followup though.


> [fluent-job] Minimum Viable Fluent Job API
> --
>
> Key: OOZIE-2339
> URL: https://issues.apache.org/jira/browse/OOZIE-2339
> Project: Oozie
>  Issue Type: New Feature
>  Components: client, core, examples, fluent-job, tests
>Affects Versions: 4.3.0
>Reporter: Robert Kanter
>Assignee: Andras Piros
>Priority: Major
> Fix For: 5.1.0
>
> Attachments: OOZIE-2339.001.patch, OOZIE-2339.002.patch, 
> OOZIE-2339.003.patch, OOZIE-2339.004.patch, OOZIE-2339.005.patch, 
> OOZIE-2339.006.patch, OOZIE-2339.008.patch, OOZIE-2339.010.patch, 
> OOZIE-2339.011.patch, OOZIE-2339.012.patch, OOZIE-2339.013.patch, 
> OOZIE-2339.014.patch, OOZIE-2339.015.patch, OOZIE-2339.016.patch, 
> OOZIE-2339.017.patch, OOZIE-2339.018.patch, OOZIE-2339.019.patch
>
>
> Users often complain about the XML they have to write for Oozie jobs.  It 
> would be nice if they could write them in something like Java, but we don't 
> want to have to maintain a separate Java API for this.  I was looking around 
> and saw that JAXB might be the right thing here.  From what I can tell, it 
> lets you create Java classes from XSD schemas.  So, we should be able to 
> auto-generate a Java API for writing Oozie jobs, without having to really 
> maintain it.
> We should investigate if this is feasible and, if so, implement it.
> Some useful looking links:
> * [JAXB 
> overview|https://en.wikipedia.org/wiki/Java_Architecture_for_XML_Binding]
> * [JAXB description|https://jaxb.java.net/2.2.11/docs/ch03.html]
> * [Maven JAXB plugin|https://java.net/projects/maven-jaxb2-plugin/pages/Home]
> * [Apache Falcon|https://falcon.apache.org]
> Key features:
> * must have:
> ** inside a {{fluent-job-api}} artifact
> ** able to create workflow / coordinator / bundle definitions programmatically
> ** synchronizing each and every XSD change on rebuild
> ** can write {{workflow.xml}}, {{coordinator.xml}}, {{bundle.xml}}, and 
> {{jobs.properties}} artifacts of every XSD version
> ** cloneability of workflow etc. {{Object}} s
> ** perform cross checks, e.g. that the workflow graph is a DAG
> ** only latest XSD versions should be supported as must have
> * nice to have:
> ** XSD version(s) can be provided. When not provided, latest ones are 
> considered as valid
> ** implement a [*fluent API*|https://en.wikipedia.org/wiki/Fluent_interface]
> ** have a Python / Jython / Py4J REPL to make it easy to experiment with also 
> for data engineers / data scientists
> ** create documentation about usage
> ** can read {{workflow.xml}}, {{coordinator.xml}}, {{bundle.xml}}, and 
> {{jobs.properties}} artifacts of every XSD version
> ** can convert between XSD versions
> ** support XSD change on the fly (within REPL)
> ** support HDFS reads / writes
> ** support dry run on an Oozie server to perform checks



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Comment Edited] (OOZIE-2339) [fluent-job] Minimum Viable Fluent Job API

[Peter Bacsko (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-2339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512805#comment-16512805
 ] 

Peter Bacsko edited comment on OOZIE-2339 at 6/14/18 5:38 PM:
--

Just a couple of random thoughts. I'm listing them here, I'm a bit lazy to add 
these to the review :D

* Eliminate unnecessary {{instanceof}} checks
* Use the standard Java interfaces for return & variable types instead of 
{{ImmutableMap}}, {{ImmutableSet}}
* Do we need {{SecureRandom}} ?
* Order of methods: public, protected, private
* {{Workflow}} object could have a method like {{getAsXml()}} for convenience
* Eliminate unnecessary casts if possible. Eg. {{WORKFLOWAPP}} stores JAXB 
nodes in a {{List}} which doesn't look good at first sight. A lot of 
casts necessary in the test methods because of this.
* The method {{getParent()}} seems to belong to {{NodeBase}} as an abstract 
method
* Weird looking comment: {{/* package private */ void close(final Join join)}}
* {{getNodesInTopologicalOrder()}} looks a bit misleading. Not sure what it 
does exactly, but this doesn't seem to care about ordering. 

That's it for now. And one last thing - we should fix this before commit: 
{{WorkflowMarshaller.unmarshal()}} is more like {{marshal()}}, the exact 
opposite.


was (Author: pbacsko):
Just a couple of random thoughts. I'm listing them here, I'm a bit lazy to add 
these to the review :D

* Eliminate unnecessary {{instanceof}} checks
* Use the standard Java interfaces for return & variable types instead of 
{{ImmutableMap}}, {{ImmutableSet}}
* Do we need {{SecureRandom}} ?
* Order of methods: public, protected, private
* {{Workflow}} object could have a method like {{getAsXml()}} for convenience
* Eliminate unnecessary casts if possible. Eg. {{WORKFLOWAPP}} stores JAXB 
nodes in a {{List}} which doesn't look good at first sight. A lot of 
casts necessary in the test methods because of this.
* The method {{getParent()}} seems to belong to {{NodeBase}} as an abstract 
method
* Weird looking comment in : {{/* package private */ void close(final Join 
join)}}
* {{getNodesInTopologicalOrder()}} looks a bit misleading. Not sure what it 
does exactly, but this doesn't seem to care about ordering. 

That's it for now. And one last thing - we should fix this before commit: 
{{WorkflowMarshaller.unmarshal()}} is more like {{marshal()}}, the exact 
opposite.

> [fluent-job] Minimum Viable Fluent Job API
> --
>
> Key: OOZIE-2339
> URL: https://issues.apache.org/jira/browse/OOZIE-2339
> Project: Oozie
>  Issue Type: New Feature
>  Components: client, core, examples, fluent-job, tests
>Affects Versions: 4.3.0
>Reporter: Robert Kanter
>Assignee: Andras Piros
>Priority: Major
> Fix For: 5.1.0
>
> Attachments: OOZIE-2339.001.patch, OOZIE-2339.002.patch, 
> OOZIE-2339.003.patch, OOZIE-2339.004.patch, OOZIE-2339.005.patch, 
> OOZIE-2339.006.patch, OOZIE-2339.008.patch, OOZIE-2339.010.patch, 
> OOZIE-2339.011.patch, OOZIE-2339.012.patch, OOZIE-2339.013.patch, 
> OOZIE-2339.014.patch, OOZIE-2339.015.patch, OOZIE-2339.016.patch, 
> OOZIE-2339.017.patch, OOZIE-2339.018.patch, OOZIE-2339.019.patch
>
>
> Users often complain about the XML they have to write for Oozie jobs.  It 
> would be nice if they could write them in something like Java, but we don't 
> want to have to maintain a separate Java API for this.  I was looking around 
> and saw that JAXB might be the right thing here.  From what I can tell, it 
> lets you create Java classes from XSD schemas.  So, we should be able to 
> auto-generate a Java API for writing Oozie jobs, without having to really 
> maintain it.
> We should investigate if this is feasible and, if so, implement it.
> Some useful looking links:
> * [JAXB 
> overview|https://en.wikipedia.org/wiki/Java_Architecture_for_XML_Binding]
> * [JAXB description|https://jaxb.java.net/2.2.11/docs/ch03.html]
> * [Maven JAXB plugin|https://java.net/projects/maven-jaxb2-plugin/pages/Home]
> * [Apache Falcon|https://falcon.apache.org]
> Key features:
> * must have:
> ** inside a {{fluent-job-api}} artifact
> ** able to create workflow / coordinator / bundle definitions programmatically
> ** synchronizing each and every XSD change on rebuild
> ** can write {{workflow.xml}}, {{coordinator.xml}}, {{bundle.xml}}, and 
> {{jobs.properties}} artifacts of every XSD version
> ** cloneability of workflow etc. {{Object}} s
> ** perform cross checks, e.g. that the workflow graph is a DAG
> ** only latest XSD versions should be supported as must have
> * nice to have:
> ** XSD version(s) can be provided. When not provided, latest ones are 
> considered as valid
> ** implement a [*fluent API*|https://en.wikipedia.org/wiki/Fluent_interface]
> ** have a Python / Jython / Py4J REPL to make it easy 

[jira] [Commented] (OOZIE-2339) [fluent-job] Minimum Viable Fluent Job API

[Peter Bacsko (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-2339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512805#comment-16512805
 ] 

Peter Bacsko commented on OOZIE-2339:
-

Just a couple of random thoughts. I'm listing them here, I'm a bit lazy to add 
these to the review :D

* Eliminate unnecessary {{instanceof}} checks
* Use the standard Java interfaces for return & variable types instead of 
{{ImmutableMap}}, {{ImmutableSet}}
* Do we need {{SecureRandom}} ?
* Order of methods: public, protected, private
* {{Workflow}} object could have a method like {{getAsXml()}} for convenience
* Eliminate unnecessary casts if possible. Eg. {{WORKFLOWAPP}} stores JAXB 
nodes in a {{List}} which doesn't look good at first sight. A lot of 
casts necessary in the test methods because of this.
* The method {{getParent()}} seems to belong to {{NodeBase}} as an abstract 
method
* Weird looking comment in : {{/* package private */ void close(final Join 
join)}}
* {{getNodesInTopologicalOrder()}} looks a bit misleading. Not sure what it 
does exactly, but this doesn't seem to care about ordering. 

That's it for now. And one last thing - we should fix this before commit: 
{{WorkflowMarshaller.unmarshal()}} is more like {{marshal()}}, the exact 
opposite.

> [fluent-job] Minimum Viable Fluent Job API
> --
>
> Key: OOZIE-2339
> URL: https://issues.apache.org/jira/browse/OOZIE-2339
> Project: Oozie
>  Issue Type: New Feature
>  Components: client, core, examples, fluent-job, tests
>Affects Versions: 4.3.0
>Reporter: Robert Kanter
>Assignee: Andras Piros
>Priority: Major
> Fix For: 5.1.0
>
> Attachments: OOZIE-2339.001.patch, OOZIE-2339.002.patch, 
> OOZIE-2339.003.patch, OOZIE-2339.004.patch, OOZIE-2339.005.patch, 
> OOZIE-2339.006.patch, OOZIE-2339.008.patch, OOZIE-2339.010.patch, 
> OOZIE-2339.011.patch, OOZIE-2339.012.patch, OOZIE-2339.013.patch, 
> OOZIE-2339.014.patch, OOZIE-2339.015.patch, OOZIE-2339.016.patch, 
> OOZIE-2339.017.patch, OOZIE-2339.018.patch, OOZIE-2339.019.patch
>
>
> Users often complain about the XML they have to write for Oozie jobs.  It 
> would be nice if they could write them in something like Java, but we don't 
> want to have to maintain a separate Java API for this.  I was looking around 
> and saw that JAXB might be the right thing here.  From what I can tell, it 
> lets you create Java classes from XSD schemas.  So, we should be able to 
> auto-generate a Java API for writing Oozie jobs, without having to really 
> maintain it.
> We should investigate if this is feasible and, if so, implement it.
> Some useful looking links:
> * [JAXB 
> overview|https://en.wikipedia.org/wiki/Java_Architecture_for_XML_Binding]
> * [JAXB description|https://jaxb.java.net/2.2.11/docs/ch03.html]
> * [Maven JAXB plugin|https://java.net/projects/maven-jaxb2-plugin/pages/Home]
> * [Apache Falcon|https://falcon.apache.org]
> Key features:
> * must have:
> ** inside a {{fluent-job-api}} artifact
> ** able to create workflow / coordinator / bundle definitions programmatically
> ** synchronizing each and every XSD change on rebuild
> ** can write {{workflow.xml}}, {{coordinator.xml}}, {{bundle.xml}}, and 
> {{jobs.properties}} artifacts of every XSD version
> ** cloneability of workflow etc. {{Object}} s
> ** perform cross checks, e.g. that the workflow graph is a DAG
> ** only latest XSD versions should be supported as must have
> * nice to have:
> ** XSD version(s) can be provided. When not provided, latest ones are 
> considered as valid
> ** implement a [*fluent API*|https://en.wikipedia.org/wiki/Fluent_interface]
> ** have a Python / Jython / Py4J REPL to make it easy to experiment with also 
> for data engineers / data scientists
> ** create documentation about usage
> ** can read {{workflow.xml}}, {{coordinator.xml}}, {{bundle.xml}}, and 
> {{jobs.properties}} artifacts of every XSD version
> ** can convert between XSD versions
> ** support XSD change on the fly (within REPL)
> ** support HDFS reads / writes
> ** support dry run on an Oozie server to perform checks



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (OOZIE-3283) Prototyping: create React workflow list page

[Robert Kanter (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-3283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512792#comment-16512792
 ] 

Robert Kanter commented on OOZIE-3283:
--

Wow!  
I don't have time to try it out myself at the moment, but just from the 
screenshots, that's so much nicer than the extjs UI.

> Prototyping: create React workflow list page
> 
>
> Key: OOZIE-3283
> URL: https://issues.apache.org/jira/browse/OOZIE-3283
> Project: Oozie
>  Issue Type: Sub-task
>Reporter: Andras Piros
>Assignee: Thai Bui
>Priority: Major
> Attachments: Screen Shot 2018-06-14 at 9.24.46 AM.png, Screen Shot 
> 2018-06-14 at 9.25.42 AM.png
>
>
> Create a [*React*|https://redux.js.org/basics/usage-with-react] / 
> [*Redux*|https://redux.js.org/basics/usage-with-react] prototype of the 
> workflow list page. Don't have to handle authentication / authorization for 
> now.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (OOZIE-2339) [fluent-job] Minimum Viable Fluent Job API

[Peter Bacsko (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-2339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512761#comment-16512761
 ] 

Peter Bacsko commented on OOZIE-2339:
-

I've completed Round #2.

I was thinking about adding some more comments, however, the patch is big and 
the quality is already good enough. Perhaps I'll still add some more comments 
which can be solved in a follow-up JIRA.

> [fluent-job] Minimum Viable Fluent Job API
> --
>
> Key: OOZIE-2339
> URL: https://issues.apache.org/jira/browse/OOZIE-2339
> Project: Oozie
>  Issue Type: New Feature
>  Components: client, core, examples, fluent-job, tests
>Affects Versions: 4.3.0
>Reporter: Robert Kanter
>Assignee: Andras Piros
>Priority: Major
> Fix For: 5.1.0
>
> Attachments: OOZIE-2339.001.patch, OOZIE-2339.002.patch, 
> OOZIE-2339.003.patch, OOZIE-2339.004.patch, OOZIE-2339.005.patch, 
> OOZIE-2339.006.patch, OOZIE-2339.008.patch, OOZIE-2339.010.patch, 
> OOZIE-2339.011.patch, OOZIE-2339.012.patch, OOZIE-2339.013.patch, 
> OOZIE-2339.014.patch, OOZIE-2339.015.patch, OOZIE-2339.016.patch, 
> OOZIE-2339.017.patch, OOZIE-2339.018.patch, OOZIE-2339.019.patch
>
>
> Users often complain about the XML they have to write for Oozie jobs.  It 
> would be nice if they could write them in something like Java, but we don't 
> want to have to maintain a separate Java API for this.  I was looking around 
> and saw that JAXB might be the right thing here.  From what I can tell, it 
> lets you create Java classes from XSD schemas.  So, we should be able to 
> auto-generate a Java API for writing Oozie jobs, without having to really 
> maintain it.
> We should investigate if this is feasible and, if so, implement it.
> Some useful looking links:
> * [JAXB 
> overview|https://en.wikipedia.org/wiki/Java_Architecture_for_XML_Binding]
> * [JAXB description|https://jaxb.java.net/2.2.11/docs/ch03.html]
> * [Maven JAXB plugin|https://java.net/projects/maven-jaxb2-plugin/pages/Home]
> * [Apache Falcon|https://falcon.apache.org]
> Key features:
> * must have:
> ** inside a {{fluent-job-api}} artifact
> ** able to create workflow / coordinator / bundle definitions programmatically
> ** synchronizing each and every XSD change on rebuild
> ** can write {{workflow.xml}}, {{coordinator.xml}}, {{bundle.xml}}, and 
> {{jobs.properties}} artifacts of every XSD version
> ** cloneability of workflow etc. {{Object}} s
> ** perform cross checks, e.g. that the workflow graph is a DAG
> ** only latest XSD versions should be supported as must have
> * nice to have:
> ** XSD version(s) can be provided. When not provided, latest ones are 
> considered as valid
> ** implement a [*fluent API*|https://en.wikipedia.org/wiki/Fluent_interface]
> ** have a Python / Jython / Py4J REPL to make it easy to experiment with also 
> for data engineers / data scientists
> ** create documentation about usage
> ** can read {{workflow.xml}}, {{coordinator.xml}}, {{bundle.xml}}, and 
> {{jobs.properties}} artifacts of every XSD version
> ** can convert between XSD versions
> ** support XSD change on the fly (within REPL)
> ** support HDFS reads / writes
> ** support dry run on an Oozie server to perform checks



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Comment Edited] (OOZIE-3283) Prototyping: create React workflow list page

[Thai Bui (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-3283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512553#comment-16512553
 ] 

Thai Bui edited comment on OOZIE-3283 at 6/14/18 2:42 PM:
--

[~andras.piros] I had some free time yesterday and the day before so I started 
the prototype early, please check it out! 

The React UI components are ready, the Redux store is not implemented yet and 
that's what I will be working on next. See attached screenshots:

!Screen Shot 2018-06-14 at 9.24.46 AM.png|width=600!  

!Screen Shot 2018-06-14 at 9.25.42 AM.png|width=600!

Notable features are:
 * Integrations with [Ant Design|https://ant.design/docs/react/introduce] 
(open-source, MIT licensed, backed by Alibaba Group, one of the most widely 
used project in the React community) for UI components. This allows me to 
prototype this slick UI in 2 days from scratch.
 * Simply layout with collapsible left Sider + Oozie logos
 * Workflow list view inspired by Cloudera Hue Workflow list view with a couple 
of improvements
 ** Multiple select + clear control group for resume/pause/kill/restart 
operations
 ** Color-coded individual control group at the row level
 ** Breadcrumb

Working branch is at 
[https://github.com/thaibui/oozie/tree/OOZIE-3283/ui/oozie-ui] and the current 
diff at [https://github.com/apache/oozie/pull/38]


was (Author: thai.bui):
[~andras.piros] I had some free time yesterday and the day before so I started 
the prototype early, please check it out! 

The React UI components are ready, the Redux store is not implemented yet and 
that's what I will be working on next. See attached screenshots:

!Screen Shot 2018-06-14 at 9.24.46 AM.png|width=300!  

!Screen Shot 2018-06-14 at 9.25.42 AM.png|width=300!

Notable features are:
 * Integrations with [Ant Design|https://ant.design/docs/react/introduce] 
(open-source, MIT licensed, backed by Alibaba Group, one of the most widely 
used project in the React community) for UI components. This allows me to 
prototype this slick UI in 2 days from scratch.
 * Simply layout with collapsible left Sider + Oozie logos
 * Workflow list view inspired by Cloudera Hue Workflow list view with a couple 
of improvements
 ** Multiple select + clear control group for resume/pause/kill/restart 
operations
 ** Color-coded individual control group at the row level
 ** Breadcrumb

Working branch is at 
[https://github.com/thaibui/oozie/tree/OOZIE-3283/ui/oozie-ui] and the current 
diff at [https://github.com/apache/oozie/pull/38]

> Prototyping: create React workflow list page
> 
>
> Key: OOZIE-3283
> URL: https://issues.apache.org/jira/browse/OOZIE-3283
> Project: Oozie
>  Issue Type: Sub-task
>Reporter: Andras Piros
>Assignee: Thai Bui
>Priority: Major
> Attachments: Screen Shot 2018-06-14 at 9.24.46 AM.png, Screen Shot 
> 2018-06-14 at 9.25.42 AM.png
>
>
> Create a [*React*|https://redux.js.org/basics/usage-with-react] / 
> [*Redux*|https://redux.js.org/basics/usage-with-react] prototype of the 
> workflow list page. Don't have to handle authentication / authorization for 
> now.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (OOZIE-3283) Prototyping: create React workflow list page

[Thai Bui (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-3283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512556#comment-16512556
 ] 

Thai Bui commented on OOZIE-3283:
-

The current README has instruction to test the new UI locally 
[https://github.com/thaibui/oozie/tree/OOZIE-3283/ui], all the data is 
randomized for now for UI testing

> Prototyping: create React workflow list page
> 
>
> Key: OOZIE-3283
> URL: https://issues.apache.org/jira/browse/OOZIE-3283
> Project: Oozie
>  Issue Type: Sub-task
>Reporter: Andras Piros
>Assignee: Thai Bui
>Priority: Major
> Attachments: Screen Shot 2018-06-14 at 9.24.46 AM.png, Screen Shot 
> 2018-06-14 at 9.25.42 AM.png
>
>
> Create a [*React*|https://redux.js.org/basics/usage-with-react] / 
> [*Redux*|https://redux.js.org/basics/usage-with-react] prototype of the 
> workflow list page. Don't have to handle authentication / authorization for 
> now.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Comment Edited] (OOZIE-3283) Prototyping: create React workflow list page

[Thai Bui (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-3283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512553#comment-16512553
 ] 

Thai Bui edited comment on OOZIE-3283 at 6/14/18 2:39 PM:
--

[~andras.piros] I had some free time yesterday and the day before so I started 
the prototype early, please check it out! 

The React UI components are ready, the Redux store is not implemented yet and 
that's what I will be working on next. See attached screenshots:

!Screen Shot 2018-06-14 at 9.24.46 AM.png|width=300!  

!Screen Shot 2018-06-14 at 9.25.42 AM.png|width=300!

Notable features are:
 * Integrations with [Ant Design|https://ant.design/docs/react/introduce] 
(open-source, MIT licensed, backed by Alibaba Group, one of the most widely 
used project in the React community) for UI components. This allows me to 
prototype this slick UI in 2 days from scratch.
 * Simply layout with collapsible left Sider + Oozie logos
 * Workflow list view inspired by Cloudera Hue Workflow list view with a couple 
of improvements
 ** Multiple select + clear control group for resume/pause/kill/restart 
operations
 ** Color-coded individual control group at the row level
 ** Breadcrumb

Working branch is at 
[https://github.com/thaibui/oozie/tree/OOZIE-3283/ui/oozie-ui] and the current 
diff at [https://github.com/apache/oozie/pull/38]


was (Author: thai.bui):
[~andras.piros] I had some free time yesterday and the day before to I started 
the prototype early, please check it out! 

The React UI components are ready, the Redux store is not implemented yet and 
that's what I will be working on next. See attached screenshots:

!Screen Shot 2018-06-14 at 9.24.46 AM.png|width=300!  

!Screen Shot 2018-06-14 at 9.25.42 AM.png|width=300!

Notable features are:
 * Integrations with [Ant Design|https://ant.design/docs/react/introduce] 
(open-source, MIT licensed, backed by Alibaba Group, one of the most widely 
used project in the React community) for UI components. This allows me to 
prototype this slick UI in 2 days from scratch.
 * Simply layout with collapsible left Sider + Oozie logos
 * Workflow list view inspired by Cloudera Hue Workflow list view with a couple 
of improvements
 ** Multiple select + clear control group for resume/pause/kill/restart 
operations
 ** Color-coded individual control group at the row level
 ** Breadcrumb

Working branch is at 
[https://github.com/thaibui/oozie/tree/OOZIE-3283/ui/oozie-ui] and the current 
diff at [https://github.com/apache/oozie/pull/38]

> Prototyping: create React workflow list page
> 
>
> Key: OOZIE-3283
> URL: https://issues.apache.org/jira/browse/OOZIE-3283
> Project: Oozie
>  Issue Type: Sub-task
>Reporter: Andras Piros
>Assignee: Thai Bui
>Priority: Major
> Attachments: Screen Shot 2018-06-14 at 9.24.46 AM.png, Screen Shot 
> 2018-06-14 at 9.25.42 AM.png
>
>
> Create a [*React*|https://redux.js.org/basics/usage-with-react] / 
> [*Redux*|https://redux.js.org/basics/usage-with-react] prototype of the 
> workflow list page. Don't have to handle authentication / authorization for 
> now.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (OOZIE-3283) Prototyping: create React workflow list page

[Thai Bui (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-3283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512553#comment-16512553
 ] 

Thai Bui commented on OOZIE-3283:
-

[~andras.piros] I had some free time yesterday and the day before to I started 
the prototype early, please check it out! 

The React UI components are ready, the Redux store is not implemented yet and 
that's what I will be working on next. See attached screenshots:

!Screen Shot 2018-06-14 at 9.24.46 AM.png|width=300!  

!Screen Shot 2018-06-14 at 9.25.42 AM.png|width=300!

Notable features are:
 * Integrations with [Ant Design|https://ant.design/docs/react/introduce] 
(open-source, MIT licensed, backed by Alibaba Group, one of the most widely 
used project in the React community) for UI components. This allows me to 
prototype this slick UI in 2 days from scratch.
 * Simply layout with collapsible left Sider + Oozie logos
 * Workflow list view inspired by Cloudera Hue Workflow list view with a couple 
of improvements
 ** Multiple select + clear control group for resume/pause/kill/restart 
operations
 ** Color-coded individual control group at the row level
 ** Breadcrumb

Working branch is at 
[https://github.com/thaibui/oozie/tree/OOZIE-3283/ui/oozie-ui] and the current 
diff at [https://github.com/apache/oozie/pull/38]

> Prototyping: create React workflow list page
> 
>
> Key: OOZIE-3283
> URL: https://issues.apache.org/jira/browse/OOZIE-3283
> Project: Oozie
>  Issue Type: Sub-task
>Reporter: Andras Piros
>Assignee: Thai Bui
>Priority: Major
> Attachments: Screen Shot 2018-06-14 at 9.24.46 AM.png, Screen Shot 
> 2018-06-14 at 9.25.42 AM.png
>
>
> Create a [*React*|https://redux.js.org/basics/usage-with-react] / 
> [*Redux*|https://redux.js.org/basics/usage-with-react] prototype of the 
> workflow list page. Don't have to handle authentication / authorization for 
> now.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (OOZIE-3283) Prototyping: create React workflow list page

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-3283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512551#comment-16512551
 ] 

ASF GitHub Bot commented on OOZIE-3283:
---

GitHub user thaibui opened a pull request:

https://github.com/apache/oozie/pull/38

OOZIE-3283

for preview only

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/thaibui/oozie OOZIE-3283

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/oozie/pull/38.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #38


commit 63d6ee7543f41de2c3f70569e3e49d5872e47921
Author: Thai Bui 
Date:   2018-06-13T06:31:58Z

wip: prototyping new oozie ui in react + ant design

commit c78bdbe61a065ae270185a9d9979824c850f3a50
Author: Thai Bui 
Date:   2018-06-14T00:09:31Z

complete UI for workflow listing and workflow control

commit 5559ca2993c86716dc7221df9a60ba96387a2a49
Author: Thai Bui 
Date:   2018-06-14T00:16:19Z

renamed main application from App to OozieUI

commit 5ac9157e377583fd1c45b7c0d9d3ad1185c53d6a
Author: Thai Bui 
Date:   2018-06-14T05:30:46Z

add Oozie logos

commit 5809488f38d851a870762feb92dca2b1c3c1e610
Author: Thai Bui 
Date:   2018-06-14T05:39:32Z

add dashboard to the menu

commit ba535970597b4f1f7b575ee5bb19580bc3df1fc5
Author: Thai Bui 
Date:   2018-06-14T14:16:12Z

update README.md




> Prototyping: create React workflow list page
> 
>
> Key: OOZIE-3283
> URL: https://issues.apache.org/jira/browse/OOZIE-3283
> Project: Oozie
>  Issue Type: Sub-task
>Reporter: Andras Piros
>Assignee: Thai Bui
>Priority: Major
> Attachments: Screen Shot 2018-06-14 at 9.24.46 AM.png, Screen Shot 
> 2018-06-14 at 9.25.42 AM.png
>
>
> Create a [*React*|https://redux.js.org/basics/usage-with-react] / 
> [*Redux*|https://redux.js.org/basics/usage-with-react] prototype of the 
> workflow list page. Don't have to handle authentication / authorization for 
> now.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[GitHub] oozie pull request #38: OOZIE-3283

[thaibui]

GitHub user thaibui opened a pull request:

https://github.com/apache/oozie/pull/38

OOZIE-3283

for preview only

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/thaibui/oozie OOZIE-3283

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/oozie/pull/38.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #38


commit 63d6ee7543f41de2c3f70569e3e49d5872e47921
Author: Thai Bui 
Date:   2018-06-13T06:31:58Z

wip: prototyping new oozie ui in react + ant design

commit c78bdbe61a065ae270185a9d9979824c850f3a50
Author: Thai Bui 
Date:   2018-06-14T00:09:31Z

complete UI for workflow listing and workflow control

commit 5559ca2993c86716dc7221df9a60ba96387a2a49
Author: Thai Bui 
Date:   2018-06-14T00:16:19Z

renamed main application from App to OozieUI

commit 5ac9157e377583fd1c45b7c0d9d3ad1185c53d6a
Author: Thai Bui 
Date:   2018-06-14T05:30:46Z

add Oozie logos

commit 5809488f38d851a870762feb92dca2b1c3c1e610
Author: Thai Bui 
Date:   2018-06-14T05:39:32Z

add dashboard to the menu

commit ba535970597b4f1f7b575ee5bb19580bc3df1fc5
Author: Thai Bui 
Date:   2018-06-14T14:16:12Z

update README.md




---

[jira] [Updated] (OOZIE-3283) Prototyping: create React workflow list page

[Thai Bui (JIRA)]

 [ 
https://issues.apache.org/jira/browse/OOZIE-3283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Thai Bui updated OOZIE-3283:

Attachment: (was: Screen Shot 2018-06-14 at 9.24.46 AM.png)

> Prototyping: create React workflow list page
> 
>
> Key: OOZIE-3283
> URL: https://issues.apache.org/jira/browse/OOZIE-3283
> Project: Oozie
>  Issue Type: Sub-task
>Reporter: Andras Piros
>Assignee: Thai Bui
>Priority: Major
> Attachments: Screen Shot 2018-06-14 at 9.24.46 AM.png, Screen Shot 
> 2018-06-14 at 9.25.42 AM.png
>
>
> Create a [*React*|https://redux.js.org/basics/usage-with-react] / 
> [*Redux*|https://redux.js.org/basics/usage-with-react] prototype of the 
> workflow list page. Don't have to handle authentication / authorization for 
> now.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (OOZIE-3283) Prototyping: create React workflow list page

[Thai Bui (JIRA)]

 [ 
https://issues.apache.org/jira/browse/OOZIE-3283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Thai Bui updated OOZIE-3283:

Attachment: Screen Shot 2018-06-14 at 9.25.42 AM.png

> Prototyping: create React workflow list page
> 
>
> Key: OOZIE-3283
> URL: https://issues.apache.org/jira/browse/OOZIE-3283
> Project: Oozie
>  Issue Type: Sub-task
>Reporter: Andras Piros
>Assignee: Thai Bui
>Priority: Major
> Attachments: Screen Shot 2018-06-14 at 9.24.46 AM.png, Screen Shot 
> 2018-06-14 at 9.25.42 AM.png
>
>
> Create a [*React*|https://redux.js.org/basics/usage-with-react] / 
> [*Redux*|https://redux.js.org/basics/usage-with-react] prototype of the 
> workflow list page. Don't have to handle authentication / authorization for 
> now.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (OOZIE-3283) Prototyping: create React workflow list page

[Thai Bui (JIRA)]

 [ 
https://issues.apache.org/jira/browse/OOZIE-3283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Thai Bui updated OOZIE-3283:

Attachment: Screen Shot 2018-06-14 at 9.24.46 AM.png

> Prototyping: create React workflow list page
> 
>
> Key: OOZIE-3283
> URL: https://issues.apache.org/jira/browse/OOZIE-3283
> Project: Oozie
>  Issue Type: Sub-task
>Reporter: Andras Piros
>Assignee: Thai Bui
>Priority: Major
> Attachments: Screen Shot 2018-06-14 at 9.24.46 AM.png, Screen Shot 
> 2018-06-14 at 9.25.42 AM.png
>
>
> Create a [*React*|https://redux.js.org/basics/usage-with-react] / 
> [*Redux*|https://redux.js.org/basics/usage-with-react] prototype of the 
> workflow list page. Don't have to handle authentication / authorization for 
> now.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (OOZIE-3283) Prototyping: create React workflow list page

[Thai Bui (JIRA)]

 [ 
https://issues.apache.org/jira/browse/OOZIE-3283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Thai Bui updated OOZIE-3283:

Attachment: Screen Shot 2018-06-14 at 9.24.46 AM.png

> Prototyping: create React workflow list page
> 
>
> Key: OOZIE-3283
> URL: https://issues.apache.org/jira/browse/OOZIE-3283
> Project: Oozie
>  Issue Type: Sub-task
>Reporter: Andras Piros
>Assignee: Thai Bui
>Priority: Major
> Attachments: Screen Shot 2018-06-14 at 9.24.46 AM.png
>
>
> Create a [*React*|https://redux.js.org/basics/usage-with-react] / 
> [*Redux*|https://redux.js.org/basics/usage-with-react] prototype of the 
> workflow list page. Don't have to handle authentication / authorization for 
> now.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (OOZIE-3224) Upgrade Jetty to 9.3

[Andras Piros (JIRA)]

 [ 
https://issues.apache.org/jira/browse/OOZIE-3224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andras Piros updated OOZIE-3224:

Summary: Upgrade Jetty to 9.3  (was: Upgrade jetty version to 9.3)

> Upgrade Jetty to 9.3
> 
>
> Key: OOZIE-3224
> URL: https://issues.apache.org/jira/browse/OOZIE-3224
> Project: Oozie
>  Issue Type: Task
>Affects Versions: 5.0.0
>Reporter: Attila Sasvari
>Assignee: Julia Kinga Marton
>Priority: Major
> Attachments: OOZIE-3224-001.patch
>
>
> Jetty 9.2 has reached end of life as of Jan 2018
> http://www.eclipse.org/jetty/documentation/current/what-jetty-version.html#d0e203
> Current version used in Oozie 5.0: 9.2.19.v20160908
> Please upgrade to a newer Jetty version 9.3



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: Review Request 64029: OOZIE-2339 Provide an API for writing jobs based on the XSD schemas

[Peter Bacsko via Review Board]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/64029/#review204771
---




fluent-job/fluent-job-api/src/test/java/org/apache/oozie/fluentjob/api/action/TestJavaActionBuilder.java
Lines 52-59 (patched)


Delete this if jobTracker is deprecated



fluent-job/fluent-job-api/src/test/java/org/apache/oozie/fluentjob/api/action/TestMapReduceActionBuilder.java
Lines 53-60 (patched)


Delete this if jobTracker is deprecated



fluent-job/fluent-job-api/src/test/java/org/apache/oozie/fluentjob/api/action/TestNodeBuilderBaseImpl.java
Lines 23 (patched)


Unused import



fluent-job/fluent-job-api/src/test/java/org/apache/oozie/fluentjob/api/action/TestNodeBuilderBaseImpl.java
Lines 33 (patched)


Avoid * imports



fluent-job/fluent-job-api/src/test/java/org/apache/oozie/fluentjob/api/action/TestNodeBuilderBaseImpl.java
Lines 268 (patched)


Change NodeBuilderBaseImpl to NodeBuilderBaseImpl to avoid raw type 
warning



fluent-job/fluent-job-api/src/test/java/org/apache/oozie/fluentjob/api/action/TestNodeBuilderBaseImpl.java
Lines 279 (patched)


Change NodeBuilderBaseImpl to NodeBuilderBaseImpl to avoid raw type 
warning



fluent-job/fluent-job-api/src/test/java/org/apache/oozie/fluentjob/api/action/TestNodeBuilderBaseImpl.java
Lines 290 (patched)


Unused variable



fluent-job/fluent-job-api/src/test/java/org/apache/oozie/fluentjob/api/action/TestNodeBuilderBaseImpl.java
Lines 373 (patched)


Unused variable



fluent-job/fluent-job-api/src/test/java/org/apache/oozie/fluentjob/api/action/TestNodeBuilderBaseImpl.java
Lines 387 (patched)


Unused variable



fluent-job/fluent-job-api/src/test/java/org/apache/oozie/fluentjob/api/action/TestPigActionBuilder.java
Lines 52-59 (patched)


Delete this if jobTracker is deprecated



fluent-job/fluent-job-api/src/test/java/org/apache/oozie/fluentjob/api/action/TestShellActionBuilder.java
Lines 52-59 (patched)


Delete this if jobTracker is deprecated



fluent-job/fluent-job-api/src/test/java/org/apache/oozie/fluentjob/api/action/TestSparkActionBuilder.java
Lines 52-59 (patched)


Delete this if jobTracker is deprecated



fluent-job/fluent-job-api/src/test/java/org/apache/oozie/fluentjob/api/action/TestSqoopActionBuilder.java
Lines 52-59 (patched)


Delete this if jobTracker is deprecated



fluent-job/fluent-job-api/src/test/java/org/apache/oozie/fluentjob/api/action/TestSshActionBuilder.java
Lines 24 (patched)


Unused import



fluent-job/fluent-job-api/src/test/java/org/apache/oozie/fluentjob/api/action/TestSshActionBuilder.java
Lines 26 (patched)


Unused import



fluent-job/fluent-job-api/src/test/java/org/apache/oozie/fluentjob/api/dag/TestDecisionJoin.java
Lines 33 (patched)


Change JoiningNodeBase to JoiningNodeBase to avoid warning



fluent-job/fluent-job-api/src/test/java/org/apache/oozie/fluentjob/api/dag/TestGraph.java
Lines 43 (patched)


There are a LOT of unused variables in this class. Please check with your 
IDE.



fluent-job/fluent-job-api/src/test/java/org/apache/oozie/fluentjob/api/dag/TestJoiningNodeBase.java
Lines 27 (patched)


Use "extends TestNodeBase>" to avoid raw type warning



fluent-job/fluent-job-api/src/test/java/org/apache/oozie/fluentjob/api/dag/TestStart.java
Lines 57 (patched)


Unused variable



fluent-job/fluent-job-api/src/test/java/org/apache/oozie/fluentjob/api/dag/TestStart.java
Lines 65 (patched)


Unused variable



fluent-job/fluent-job-api/src/test/java/org/apache/oozie/fluentjob/api/mapping/TestConfigurationMapping.java
Lines 22-23 (patched)


Double import



fluent-job/fluent-job-api/src/test/java/org/apache/oozie/fluentjob/api/mapping/TestCredentialsMapping.java
Lines 22 (patched)

[jira] [Commented] (OOZIE-3265) properties RERUN_FAIL_NODES and RERUN_SKIP_NODES should be able to appear together

[Peter Cseh (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-3265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512376#comment-16512376
 ] 

Peter Cseh commented on OOZIE-3265:
---

[~txsing]
Thanks for adding the tests! (and sorry for the long review cycle)
Can you please check on the failing test? 
testRerunWithExistingConf(org.apache.oozie.command.wf.TestReRunXCommand)
Also, please update DG_WorkflowReRun.twiki to represent the changes in the code.


> properties RERUN_FAIL_NODES and RERUN_SKIP_NODES should be able to appear 
> together
> --
>
> Key: OOZIE-3265
> URL: https://issues.apache.org/jira/browse/OOZIE-3265
> Project: Oozie
>  Issue Type: Task
>Affects Versions: 5.0.0
>Reporter: TIAN XING
>Assignee: TIAN XING
>Priority: Minor
> Attachments: OOZIE-3265-v1.patch, OOZIE-3265-v2.patch, rerun.patch
>
>
> Currently when you re-run a workflow with property "oozie.wf.rerun.failnodes" 
>  set to true,
> you can no longer re-run it again with "oozie.wf.rerun.skip.nodes" property 
> specified, even if you set "oozie.wf.rerun.failnodes" to false.
> This kind of limitation is not reasonable. There is only one case where 
> "oozie.wf.rerun.failnodes" is true and "oozie.wf.rerun.skip.nodes" is not 
> null or empty, that should be disallowed.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (OOZIE-3224) Upgrade jetty version to 9.3

[Hadoop QA (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-3224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512341#comment-16512341
 ] 

Hadoop QA commented on OOZIE-3224:
--


Testing JIRA OOZIE-3224

Cleaning local git workspace



{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than 
132
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT 
warnings
{color:green}+1 JAVADOC{color}
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc 
warning(s)
.{color:green}+1{color} the patch does not seem to introduce new Javadoc 
error(s)
.{color:red}ERROR{color}: the current HEAD has 2 Javadoc error(s)
{color:green}+1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:green}+1{color} the patch does not seem to introduce new javac 
warnings
{color:green}+1{color} There are no new bugs found in total.
. {color:green}+1{color} There are no new bugs found in [examples].
. {color:green}+1{color} There are no new bugs found in [webapp].
. {color:green}+1{color} There are no new bugs found in [core].
. {color:green}+1{color} There are no new bugs found in [tools].
. {color:green}+1{color} There are no new bugs found in [server].
. {color:green}+1{color} There are no new bugs found in [docs].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive2].
. {color:green}+1{color} There are no new bugs found in [sharelib/pig].
. {color:green}+1{color} There are no new bugs found in [sharelib/streaming].
. {color:green}+1{color} There are no new bugs found in [sharelib/hive].
. {color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
. {color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
. {color:green}+1{color} There are no new bugs found in [sharelib/oozie].
. {color:green}+1{color} There are no new bugs found in [sharelib/distcp].
. {color:green}+1{color} There are no new bugs found in [sharelib/spark].
. {color:green}+1{color} There are no new bugs found in [client].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA 
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:green}+1 TESTS{color}
.Tests run: 2148
.{color:orange}Tests failed at first run:{color}
TestZKLocksService#testRegisterUnregister
.For the complete list of flaky tests, see TEST-SUMMARY-FULL files.
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch 


{color:red}*-1 Overall result, please check the reported -1(s)*{color}


The full output of the test-patch run is available at

. https://builds.apache.org/job/PreCommit-OOZIE-Build/624/



> Upgrade jetty version to 9.3
> 
>
> Key: OOZIE-3224
> URL: https://issues.apache.org/jira/browse/OOZIE-3224
> Project: Oozie
>  Issue Type: Task
>Affects Versions: 5.0.0
>Reporter: Attila Sasvari
>Assignee: Julia Kinga Marton
>Priority: Major
> Attachments: OOZIE-3224-001.patch
>
>
> Jetty 9.2 has reached end of life as of Jan 2018
> http://www.eclipse.org/jetty/documentation/current/what-jetty-version.html#d0e203
> Current version used in Oozie 5.0: 9.2.19.v20160908
> Please upgrade to a newer Jetty version 9.3



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Failed: OOZIE-3224 PreCommit Build #624

[Apache Jenkins Server]

Jira: https://issues.apache.org/jira/browse/OOZIE-3224
Build: https://builds.apache.org/job/PreCommit-OOZIE-Build/624/

###
## LAST 100 LINES OF THE CONSOLE 
###
[...truncated 1.73 MB...]
[DEBUG] There are no new bugs found in [sharelib/hive].
[TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts
[DEBUG] There are no new bugs found in [sharelib/hcatalog].
[TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts
[DEBUG] There are no new bugs found in [sharelib/sqoop].
[TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts
[DEBUG] There are no new bugs found in [sharelib/oozie].
[TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts
[DEBUG] There are no new bugs found in [sharelib/distcp].
[TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts
[DEBUG] There are no new bugs found in [sharelib/spark].
[TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts
[DEBUG] There are no new bugs found in [client].
[INFO] There are no new bugs found totally].
[TRACE] FindBugs diffs checked and reports created
[TRACE] Summary file size is 2366 bytes
[TRACE] Full summary file size is 1314 bytes
[TRACE] File 
[/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/test-patch/tmp/FINDBUGS_DIFF/diff/findbugs-diff-0.1.0-all.jar]
 removed
[TRACE] File 
[/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/test-patch/tmp/FINDBUGS_DIFF/diff/findbugs-diff-0.1.0-all.jar.md5sum]
 removed
  Running test-patch task BACKWARDS_COMPATIBILITY
  Running test-patch task TESTS
  Running test-patch task DISTRO


Testing JIRA OOZIE-3224

Cleaning local git workspace



+1 PATCH_APPLIES
+1 CLEAN
-1 RAW_PATCH_ANALYSIS
+1 the patch does not introduce any @author tags
+1 the patch does not introduce any tabs
+1 the patch does not introduce any trailing spaces
+1 the patch does not introduce any line longer than 132
-1 the patch does not add/modify any testcase
+1 RAT
+1 the patch does not seem to introduce new RAT warnings
+1 JAVADOC
+1 JAVADOC
+1 the patch does not seem to introduce new Javadoc warning(s)
+1 the patch does not seem to introduce new Javadoc error(s)
ERROR: the current HEAD has 2 Javadoc error(s)
+1 COMPILE
+1 HEAD compiles
+1 patch compiles
+1 the patch does not seem to introduce new javac warnings
+1 There are no new bugs found in total.
 +1 There are no new bugs found in [examples].
 +1 There are no new bugs found in [webapp].
 +1 There are no new bugs found in [core].
 +1 There are no new bugs found in [tools].
 +1 There are no new bugs found in [server].
 +1 There are no new bugs found in [docs].
 +1 There are no new bugs found in [sharelib/hive2].
 +1 There are no new bugs found in [sharelib/pig].
 +1 There are no new bugs found in [sharelib/streaming].
 +1 There are no new bugs found in [sharelib/hive].
 +1 There are no new bugs found in [sharelib/hcatalog].
 +1 There are no new bugs found in [sharelib/sqoop].
 +1 There are no new bugs found in [sharelib/oozie].
 +1 There are no new bugs found in [sharelib/distcp].
 +1 There are no new bugs found in [sharelib/spark].
 +1 There are no new bugs found in [client].
+1 BACKWARDS_COMPATIBILITY
+1 the patch does not change any JPA Entity/Colum/Basic/Lob/Transient 
annotations
+1 the patch does not modify JPA files
+1 TESTS
Tests run: 2148
Tests failed at first run:
TestZKLocksService#testRegisterUnregister
For the complete list of flaky tests, see TEST-SUMMARY-FULL files.
+1 DISTRO
+1 distro tarball builds with the patch 


-1 Overall result, please check the reported -1(s)


The full output of the test-patch run is available at

 https://builds.apache.org/job/PreCommit-OOZIE-Build/624/

Adding comment to JIRA
  % Total% Received % Xferd  Average Speed   TimeTime Time  Current
 Dload  Upload   Total   SpentLeft  Speed
  0 00 00 0  0  0 --:--:-- --:--:-- --:--:-- 
0100  31890 0  100  3189  0   3629 --:--:-- --:--:-- --:--:--  
3627{"self":"https://issues.apache.org/jira/rest/api/2/issue/13153461/comment/16512341","id":"16512341","author":{"self":"https://issues.apache.org/jira/rest/api/2/user?username=hadoopqa","name":"hadoopqa","key":"hadoopqa","avatarUrls":{"48x48":"https://issues.apache.org/jira/secure/useravatar?ownerId=hadoopqa=10393","24x24":"https://issues.apache.org/jira/secure/useravatar?size=small=hadoopqa=10393","16x16":"https://issues.apache.org/jira/secure/useravatar?size=xsmall=hadoopqa=10393","32x32":"https://issues.apache.org/jira/secure/useravatar?size=medium=hadoopqa=10393"},"displayName":"Hadoop
 QA","active":true,"timeZone":"Etc/UTC"},"body":"\nTesting JIRA 

[jira] [Commented] (OOZIE-2339) [fluent-job] Minimum Viable Fluent Job API

[Andras Piros (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-2339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512317#comment-16512317
 ] 

Andras Piros commented on OOZIE-2339:
-

Thank you all for your review efforts [~rkanter] [~gezapeti] [~pbacsko]! Once 
[~pbacsko] is ready with all review rounds, going for the final patch(es).

> [fluent-job] Minimum Viable Fluent Job API
> --
>
> Key: OOZIE-2339
> URL: https://issues.apache.org/jira/browse/OOZIE-2339
> Project: Oozie
>  Issue Type: New Feature
>  Components: client, core, examples, fluent-job, tests
>Affects Versions: 4.3.0
>Reporter: Robert Kanter
>Assignee: Andras Piros
>Priority: Major
> Fix For: 5.1.0
>
> Attachments: OOZIE-2339.001.patch, OOZIE-2339.002.patch, 
> OOZIE-2339.003.patch, OOZIE-2339.004.patch, OOZIE-2339.005.patch, 
> OOZIE-2339.006.patch, OOZIE-2339.008.patch, OOZIE-2339.010.patch, 
> OOZIE-2339.011.patch, OOZIE-2339.012.patch, OOZIE-2339.013.patch, 
> OOZIE-2339.014.patch, OOZIE-2339.015.patch, OOZIE-2339.016.patch, 
> OOZIE-2339.017.patch, OOZIE-2339.018.patch, OOZIE-2339.019.patch
>
>
> Users often complain about the XML they have to write for Oozie jobs.  It 
> would be nice if they could write them in something like Java, but we don't 
> want to have to maintain a separate Java API for this.  I was looking around 
> and saw that JAXB might be the right thing here.  From what I can tell, it 
> lets you create Java classes from XSD schemas.  So, we should be able to 
> auto-generate a Java API for writing Oozie jobs, without having to really 
> maintain it.
> We should investigate if this is feasible and, if so, implement it.
> Some useful looking links:
> * [JAXB 
> overview|https://en.wikipedia.org/wiki/Java_Architecture_for_XML_Binding]
> * [JAXB description|https://jaxb.java.net/2.2.11/docs/ch03.html]
> * [Maven JAXB plugin|https://java.net/projects/maven-jaxb2-plugin/pages/Home]
> * [Apache Falcon|https://falcon.apache.org]
> Key features:
> * must have:
> ** inside a {{fluent-job-api}} artifact
> ** able to create workflow / coordinator / bundle definitions programmatically
> ** synchronizing each and every XSD change on rebuild
> ** can write {{workflow.xml}}, {{coordinator.xml}}, {{bundle.xml}}, and 
> {{jobs.properties}} artifacts of every XSD version
> ** cloneability of workflow etc. {{Object}} s
> ** perform cross checks, e.g. that the workflow graph is a DAG
> ** only latest XSD versions should be supported as must have
> * nice to have:
> ** XSD version(s) can be provided. When not provided, latest ones are 
> considered as valid
> ** implement a [*fluent API*|https://en.wikipedia.org/wiki/Fluent_interface]
> ** have a Python / Jython / Py4J REPL to make it easy to experiment with also 
> for data engineers / data scientists
> ** create documentation about usage
> ** can read {{workflow.xml}}, {{coordinator.xml}}, {{bundle.xml}}, and 
> {{jobs.properties}} artifacts of every XSD version
> ** can convert between XSD versions
> ** support XSD change on the fly (within REPL)
> ** support HDFS reads / writes
> ** support dry run on an Oozie server to perform checks



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (OOZIE-3284) Upgrade maven-javadoc-plugin to 3.0.1

[Andras Piros (JIRA)]

 [ 
https://issues.apache.org/jira/browse/OOZIE-3284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andras Piros updated OOZIE-3284:

Summary: Upgrade maven-javadoc-plugin to 3.0.1  (was: mkdistro.sh fails 
with NPE if JAVA_HOME is not set)

> Upgrade maven-javadoc-plugin to 3.0.1
> -
>
> Key: OOZIE-3284
> URL: https://issues.apache.org/jira/browse/OOZIE-3284
> Project: Oozie
>  Issue Type: Improvement
>  Components: build
>Affects Versions: 5.0.0
>Reporter: Julia Kinga Marton
>Assignee: Julia Kinga Marton
>Priority: Minor
> Attachments: OOZIE-3284-001.patch
>
>
> If JAVA_HOME is not set, javadoc-plugin fails with NPE. See: MJAVADOC-504. 
> This bug is fixed in javadoc-plugin v. 3.0.1. Recently we use v. 3.0.0.
> We can avoid this failure by upgrading the plugin to the latest version. (or 
> by setting JAVA_HOME)
> *Used Maven and Java versions:*
> Apache Maven 3.5.2 
> Java version: 1.8.0_151



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (OOZIE-2683) Rewrite the Oozie Web UI

[Andras Piros (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-2683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512305#comment-16512305
 ] 

Andras Piros commented on OOZIE-2683:
-

Yw [~thai.bui]. Added you as a contributor to Oozie, and assigned OOZIE-3283 to 
you. Happy prototyping :)

> Rewrite the Oozie Web UI
> 
>
> Key: OOZIE-2683
> URL: https://issues.apache.org/jira/browse/OOZIE-2683
> Project: Oozie
>  Issue Type: New Feature
>Affects Versions: 5.0.0
>Reporter: Robert Kanter
>Assignee: Andras Piros
>Priority: Major
> Fix For: 5.2.0
>
>
> We're currently relying on a version of ExtJS that's so old, it's not linked 
> on their official website, and is often temporarily deleted.  Looks like it's 
> now been deleted for good (OOZIE-2622).  It also has a GPL license, so we 
> can't include it with Oozie, and users are forced to go and download it 
> themselves.  And finally, it's a really outdated UI that's not very good.
> We should invest in a new Web UI that's more modern and compatibly licensed.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Assigned] (OOZIE-3283) Prototyping: create React workflow list page

[Andras Piros (JIRA)]

 [ 
https://issues.apache.org/jira/browse/OOZIE-3283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andras Piros reassigned OOZIE-3283:
---

Assignee: Thai Bui

> Prototyping: create React workflow list page
> 
>
> Key: OOZIE-3283
> URL: https://issues.apache.org/jira/browse/OOZIE-3283
> Project: Oozie
>  Issue Type: Sub-task
>Reporter: Andras Piros
>Assignee: Thai Bui
>Priority: Major
>
> Create a [*React*|https://redux.js.org/basics/usage-with-react] / 
> [*Redux*|https://redux.js.org/basics/usage-with-react] prototype of the 
> workflow list page. Don't have to handle authentication / authorization for 
> now.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (OOZIE-3224) Upgrade jetty version to 9.3

[Andras Piros (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-3224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512303#comment-16512303
 ] 

Andras Piros commented on OOZIE-3224:
-

Thanks for the contribution [~kmarton]! +1 (pending Jenkins)

> Upgrade jetty version to 9.3
> 
>
> Key: OOZIE-3224
> URL: https://issues.apache.org/jira/browse/OOZIE-3224
> Project: Oozie
>  Issue Type: Task
>Affects Versions: 5.0.0
>Reporter: Attila Sasvari
>Assignee: Julia Kinga Marton
>Priority: Major
> Attachments: OOZIE-3224-001.patch
>
>
> Jetty 9.2 has reached end of life as of Jan 2018
> http://www.eclipse.org/jetty/documentation/current/what-jetty-version.html#d0e203
> Current version used in Oozie 5.0: 9.2.19.v20160908
> Please upgrade to a newer Jetty version 9.3



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (OOZIE-3278) Oozie fails to start with Hadoop 2.6.0

[Andras Piros (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-3278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512289#comment-16512289
 ] 

Andras Piros commented on OOZIE-3278:
-

Thanks for the contribution [~kmarton]! +1

> Oozie fails to start with Hadoop 2.6.0
> --
>
> Key: OOZIE-3278
> URL: https://issues.apache.org/jira/browse/OOZIE-3278
> Project: Oozie
>  Issue Type: Bug
>Affects Versions: 5.0.0
>Reporter: Julia Kinga Marton
>Assignee: Julia Kinga Marton
>Priority: Major
> Attachments: OOZIE-3278-001.patch
>
>
> Oozie is failing to start with Hadoop 2.6.0 with the following error:
>  
> {code:java}
> Validate DB Connection
> Exception in thread "main" java.lang.NoClassDefFoundError: 
> org/apache/hadoop/util/ReflectionUtils
>  at org.apache.oozie.service.Services.setServiceInternal(Services.java:377)
>  at org.apache.oozie.service.Services.(Services.java:111)
>  at org.apache.oozie.tools.OozieDBCLI.getJdbcConf(OozieDBCLI.java:169)
>  at org.apache.oozie.tools.OozieDBCLI.createConnection(OozieDBCLI.java:918)
>  at org.apache.oozie.tools.OozieDBCLI.validateConnection(OozieDBCLI.java:926)
>  at org.apache.oozie.tools.OozieDBCLI.createDB(OozieDBCLI.java:188)
>  at org.apache.oozie.tools.OozieDBCLI.run(OozieDBCLI.java:131)
>  at org.apache.oozie.tools.OozieDBCLI.main(OozieDBCLI.java:79)
> Caused by: java.lang.ClassNotFoundException: 
> org.apache.hadoop.util.ReflectionUtils
>  at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
>  at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>  at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:338)
>  at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> {code}
>  
> The scope of hadoop-common dependency should be changed to compile, if this 
> dependency here is really needed:
> [https://github.com/apache/oozie/blob/master/webapp/pom.xml#L152-L156]
>  
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: Review Request 64029: OOZIE-2339 Provide an API for writing jobs based on the XSD schemas

[Peter Cseh via Review Board]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/64029/#review204766
---




fluent-job/fluent-job-client/src/test/java/org/apache/oozie/jobs/client/minitest/TestJavaAction.java
Lines 80 (patched)


I have checked on this and found that the generated xml is:
 
 
 When there are no credentials set, the "cred" tag should not be generated.


- Peter Cseh


On June 12, 2018, 1:42 p.m., András Piros wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/64029/
> ---
> 
> (Updated June 12, 2018, 1:42 p.m.)
> 
> 
> Review request for oozie, Attila Sasvari, Peter Cseh, and Robert Kanter.
> 
> 
> Repository: oozie-git
> 
> 
> Description
> ---
> 
> OOZIE-2339 Provide an API for writing jobs based on the XSD schemas
> 
> 
> Diffs
> -
> 
>   client/pom.xml 7d36e2d5941e598520a653a9eb4b293c763378e3 
>   client/src/main/java/org/apache/oozie/cli/OozieCLI.java 
> 08e2b91e6d9209278f9e086e23cfb4e555f7bd52 
>   client/src/main/java/org/apache/oozie/client/ApiJarFactory.java 
> PRE-CREATION 
>   client/src/main/java/org/apache/oozie/client/ApiJarLoader.java PRE-CREATION 
>   client/src/main/java/org/apache/oozie/client/OozieClient.java 
> 4c8175628ba5ee346d97ad984532662032b88acc 
>   core/pom.xml 45880a619e70a1643f4eb5ceeb61abb2090551f1 
>   core/src/main/java/org/apache/oozie/BaseLocalOozieClient.java 
> 38fb006980c0acb582b4f91175be1ced8a1afa79 
>   core/src/main/java/org/apache/oozie/local/LocalOozie.java 
> 9ab646cd53223d903e387eb92aa103a7b6577d0f 
>   core/src/main/java/org/apache/oozie/servlet/BaseJobServlet.java 
> e1bd3cf61aabfa4311881b2944fc9f10ffe9145d 
>   core/src/main/java/org/apache/oozie/servlet/BaseJobsServlet.java 
> d4b08711223356c8d4f58a3391b6b87efa0a2b73 
>   core/src/main/java/org/apache/oozie/servlet/ServletUtilities.java 
> 3eb32d50d07687c136fcc0e467a055bdc1e7ec60 
>   core/src/main/java/org/apache/oozie/servlet/V0JobsServlet.java 
> 1d800949cbff34a95f2ae111364eb8cbc6a5f5fb 
>   core/src/main/java/org/apache/oozie/servlet/V1JobsServlet.java 
> c1ca65fd2f8bf0f3e5c618dddcba3bf52eaf5420 
>   core/src/main/java/org/apache/oozie/servlet/V2ValidateServlet.java 
> b86fa6ace43aead115302aad3ae15368b15f1923 
>   core/src/main/resources/oozie-default.xml 
> 8d7465c27bfe0a25b07daf556a36c6ecc2569cb6 
>   core/src/test/java/org/apache/oozie/client/TestOozieCLI.java 
> 3395cc25d27805444ba0b6463357c4ecff977ac1 
>   core/src/test/java/org/apache/oozie/servlet/TestV1JobsServlet.java 
> fb481e367653187a94199069199f1d1b06d1cecf 
>   core/src/test/java/org/apache/oozie/test/MiniOozieTestCase.java 
> 0a030d660f9c545b520afcce458a27ba2a367658 
>   docs/src/site/twiki/DG_CommandLineTool.twiki 
> 9a174596dd78fb15989daf4e88936a9a2b09ef13 
>   docs/src/site/twiki/DG_CustomActionExecutor.twiki 
> 4acbf0d40ae36c441f8510e107243603fa0e001b 
>   docs/src/site/twiki/DG_Examples.twiki 
> 13dfa28c0eecab70321886b2806a791346c46d3b 
>   docs/src/site/twiki/DG_FluentJobAPI.twiki PRE-CREATION 
>   examples/pom.xml c13febc81cf5b26b4af90885787113e247ae7cb8 
>   
> examples/src/main/java/org/apache/oozie/example/fluentjob/CredentialsRetrying.java
>  PRE-CREATION 
>   examples/src/main/java/org/apache/oozie/example/fluentjob/Global.java 
> PRE-CREATION 
>   examples/src/main/java/org/apache/oozie/example/fluentjob/JavaMain.java 
> PRE-CREATION 
>   
> examples/src/main/java/org/apache/oozie/example/fluentjob/MultipleShellActions.java
>  PRE-CREATION 
>   examples/src/main/java/org/apache/oozie/example/fluentjob/Parameters.java 
> PRE-CREATION 
>   examples/src/main/java/org/apache/oozie/example/fluentjob/Shell.java 
> PRE-CREATION 
>   examples/src/main/java/org/apache/oozie/example/fluentjob/Spark.java 
> PRE-CREATION 
>   findbugs-filter.xml 03ee4d103f46487493fd725224cf4912ac7bc7dd 
>   fluent-job/fluent-job-api/pom.xml PRE-CREATION 
>   
> fluent-job/fluent-job-api/src/main/java/org/apache/oozie/fluentjob/api/Condition.java
>  PRE-CREATION 
>   
> fluent-job/fluent-job-api/src/main/java/org/apache/oozie/fluentjob/api/GraphVisualization.java
>  PRE-CREATION 
>   
> fluent-job/fluent-job-api/src/main/java/org/apache/oozie/fluentjob/api/ModifyOnce.java
>  PRE-CREATION 
>   
> fluent-job/fluent-job-api/src/main/java/org/apache/oozie/fluentjob/api/action/ActionAttributes.java
>  PRE-CREATION 
>   
> fluent-job/fluent-job-api/src/main/java/org/apache/oozie/fluentjob/api/action/ActionAttributesBuilder.java
>  PRE-CREATION 
>   
> fluent-job/fluent-job-api/src/main/java/org/apache/oozie/fluentjob/api/action/Builder.java
>  PRE-CREATION 
>   
> fluent-job/fluent-job-api/src/main/java/org/apache/oozie/fluentjob/api/action/ChFSBase.java
>  PRE-CREATION 
>   
> 

[jira] [Commented] (OOZIE-3224) Upgrade jetty version to 9.3

[Hadoop QA (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-3224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512254#comment-16512254
 ] 

Hadoop QA commented on OOZIE-3224:
--

PreCommit-OOZIE-Build started


> Upgrade jetty version to 9.3
> 
>
> Key: OOZIE-3224
> URL: https://issues.apache.org/jira/browse/OOZIE-3224
> Project: Oozie
>  Issue Type: Task
>Affects Versions: 5.0.0
>Reporter: Attila Sasvari
>Assignee: Julia Kinga Marton
>Priority: Major
> Attachments: OOZIE-3224-001.patch
>
>
> Jetty 9.2 has reached end of life as of Jan 2018
> http://www.eclipse.org/jetty/documentation/current/what-jetty-version.html#d0e203
> Current version used in Oozie 5.0: 9.2.19.v20160908
> Please upgrade to a newer Jetty version 9.3



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Assigned] (OOZIE-3282) Prototyping: create Angular 6 workflow list page

[Mate Juhasz (JIRA)]

 [ 
https://issues.apache.org/jira/browse/OOZIE-3282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mate Juhasz reassigned OOZIE-3282:
--

Assignee: Mate Juhasz

> Prototyping: create Angular 6 workflow list page
> 
>
> Key: OOZIE-3282
> URL: https://issues.apache.org/jira/browse/OOZIE-3282
> Project: Oozie
>  Issue Type: Sub-task
>Reporter: Andras Piros
>Assignee: Mate Juhasz
>Priority: Major
>
> Create an [*Angular 6*|https://angular.io/docs] prototype of the workflow 
> list page. Don't have to handle authentication / authorization for now.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (OOZIE-3224) Upgrade jetty version to 9.3

[Julia Kinga Marton (JIRA)]

 [ 
https://issues.apache.org/jira/browse/OOZIE-3224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Julia Kinga Marton updated OOZIE-3224:
--
Attachment: OOZIE-3224-001.patch

> Upgrade jetty version to 9.3
> 
>
> Key: OOZIE-3224
> URL: https://issues.apache.org/jira/browse/OOZIE-3224
> Project: Oozie
>  Issue Type: Task
>Affects Versions: 5.0.0
>Reporter: Attila Sasvari
>Assignee: Julia Kinga Marton
>Priority: Major
> Attachments: OOZIE-3224-001.patch
>
>
> Jetty 9.2 has reached end of life as of Jan 2018
> http://www.eclipse.org/jetty/documentation/current/what-jetty-version.html#d0e203
> Current version used in Oozie 5.0: 9.2.19.v20160908
> Please upgrade to a newer Jetty version 9.3



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Re: Review Request 64029: OOZIE-2339 Provide an API for writing jobs based on the XSD schemas

[Peter Cseh via Review Board]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/64029/#review204762
---



mvn clean install -DskipTests fails for me with a ton of checkstyle errors. The 
strange thing is that ./bin/mkdistro.sh -DskipTests does not. Can you check on 
this as well?

- Peter Cseh


On June 12, 2018, 1:42 p.m., András Piros wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/64029/
> ---
> 
> (Updated June 12, 2018, 1:42 p.m.)
> 
> 
> Review request for oozie, Attila Sasvari, Peter Cseh, and Robert Kanter.
> 
> 
> Repository: oozie-git
> 
> 
> Description
> ---
> 
> OOZIE-2339 Provide an API for writing jobs based on the XSD schemas
> 
> 
> Diffs
> -
> 
>   client/pom.xml 7d36e2d5941e598520a653a9eb4b293c763378e3 
>   client/src/main/java/org/apache/oozie/cli/OozieCLI.java 
> 08e2b91e6d9209278f9e086e23cfb4e555f7bd52 
>   client/src/main/java/org/apache/oozie/client/ApiJarFactory.java 
> PRE-CREATION 
>   client/src/main/java/org/apache/oozie/client/ApiJarLoader.java PRE-CREATION 
>   client/src/main/java/org/apache/oozie/client/OozieClient.java 
> 4c8175628ba5ee346d97ad984532662032b88acc 
>   core/pom.xml 45880a619e70a1643f4eb5ceeb61abb2090551f1 
>   core/src/main/java/org/apache/oozie/BaseLocalOozieClient.java 
> 38fb006980c0acb582b4f91175be1ced8a1afa79 
>   core/src/main/java/org/apache/oozie/local/LocalOozie.java 
> 9ab646cd53223d903e387eb92aa103a7b6577d0f 
>   core/src/main/java/org/apache/oozie/servlet/BaseJobServlet.java 
> e1bd3cf61aabfa4311881b2944fc9f10ffe9145d 
>   core/src/main/java/org/apache/oozie/servlet/BaseJobsServlet.java 
> d4b08711223356c8d4f58a3391b6b87efa0a2b73 
>   core/src/main/java/org/apache/oozie/servlet/ServletUtilities.java 
> 3eb32d50d07687c136fcc0e467a055bdc1e7ec60 
>   core/src/main/java/org/apache/oozie/servlet/V0JobsServlet.java 
> 1d800949cbff34a95f2ae111364eb8cbc6a5f5fb 
>   core/src/main/java/org/apache/oozie/servlet/V1JobsServlet.java 
> c1ca65fd2f8bf0f3e5c618dddcba3bf52eaf5420 
>   core/src/main/java/org/apache/oozie/servlet/V2ValidateServlet.java 
> b86fa6ace43aead115302aad3ae15368b15f1923 
>   core/src/main/resources/oozie-default.xml 
> 8d7465c27bfe0a25b07daf556a36c6ecc2569cb6 
>   core/src/test/java/org/apache/oozie/client/TestOozieCLI.java 
> 3395cc25d27805444ba0b6463357c4ecff977ac1 
>   core/src/test/java/org/apache/oozie/servlet/TestV1JobsServlet.java 
> fb481e367653187a94199069199f1d1b06d1cecf 
>   core/src/test/java/org/apache/oozie/test/MiniOozieTestCase.java 
> 0a030d660f9c545b520afcce458a27ba2a367658 
>   docs/src/site/twiki/DG_CommandLineTool.twiki 
> 9a174596dd78fb15989daf4e88936a9a2b09ef13 
>   docs/src/site/twiki/DG_CustomActionExecutor.twiki 
> 4acbf0d40ae36c441f8510e107243603fa0e001b 
>   docs/src/site/twiki/DG_Examples.twiki 
> 13dfa28c0eecab70321886b2806a791346c46d3b 
>   docs/src/site/twiki/DG_FluentJobAPI.twiki PRE-CREATION 
>   examples/pom.xml c13febc81cf5b26b4af90885787113e247ae7cb8 
>   
> examples/src/main/java/org/apache/oozie/example/fluentjob/CredentialsRetrying.java
>  PRE-CREATION 
>   examples/src/main/java/org/apache/oozie/example/fluentjob/Global.java 
> PRE-CREATION 
>   examples/src/main/java/org/apache/oozie/example/fluentjob/JavaMain.java 
> PRE-CREATION 
>   
> examples/src/main/java/org/apache/oozie/example/fluentjob/MultipleShellActions.java
>  PRE-CREATION 
>   examples/src/main/java/org/apache/oozie/example/fluentjob/Parameters.java 
> PRE-CREATION 
>   examples/src/main/java/org/apache/oozie/example/fluentjob/Shell.java 
> PRE-CREATION 
>   examples/src/main/java/org/apache/oozie/example/fluentjob/Spark.java 
> PRE-CREATION 
>   findbugs-filter.xml 03ee4d103f46487493fd725224cf4912ac7bc7dd 
>   fluent-job/fluent-job-api/pom.xml PRE-CREATION 
>   
> fluent-job/fluent-job-api/src/main/java/org/apache/oozie/fluentjob/api/Condition.java
>  PRE-CREATION 
>   
> fluent-job/fluent-job-api/src/main/java/org/apache/oozie/fluentjob/api/GraphVisualization.java
>  PRE-CREATION 
>   
> fluent-job/fluent-job-api/src/main/java/org/apache/oozie/fluentjob/api/ModifyOnce.java
>  PRE-CREATION 
>   
> fluent-job/fluent-job-api/src/main/java/org/apache/oozie/fluentjob/api/action/ActionAttributes.java
>  PRE-CREATION 
>   
> fluent-job/fluent-job-api/src/main/java/org/apache/oozie/fluentjob/api/action/ActionAttributesBuilder.java
>  PRE-CREATION 
>   
> fluent-job/fluent-job-api/src/main/java/org/apache/oozie/fluentjob/api/action/Builder.java
>  PRE-CREATION 
>   
> fluent-job/fluent-job-api/src/main/java/org/apache/oozie/fluentjob/api/action/ChFSBase.java
>  PRE-CREATION 
>   
> fluent-job/fluent-job-api/src/main/java/org/apache/oozie/fluentjob/api/action/ChFSBaseBuilder.java
>  PRE-CREATION 
>   
> 

Re: Review Request 64029: OOZIE-2339 Provide an API for writing jobs based on the XSD schemas

[Peter Cseh via Review Board]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/64029/#review204761
---




fluent-job/fluent-job-api/src/main/java/org/apache/oozie/fluentjob/api/workflow/Credentials.java
Lines 39-45 (patched)


This should be a map instead of a List.
Credentials then could be referenced by their names.

Or better, this part could be autogenerated based on the credentials every 
action has. Basically we only need a CredentialBuilder to create Credential 
objects and add those to actions. 
The generator part could collect the used credentials in the workflow and 
just put in the  section automatically.


- Peter Cseh


On June 12, 2018, 1:42 p.m., András Piros wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/64029/
> ---
> 
> (Updated June 12, 2018, 1:42 p.m.)
> 
> 
> Review request for oozie, Attila Sasvari, Peter Cseh, and Robert Kanter.
> 
> 
> Repository: oozie-git
> 
> 
> Description
> ---
> 
> OOZIE-2339 Provide an API for writing jobs based on the XSD schemas
> 
> 
> Diffs
> -
> 
>   client/pom.xml 7d36e2d5941e598520a653a9eb4b293c763378e3 
>   client/src/main/java/org/apache/oozie/cli/OozieCLI.java 
> 08e2b91e6d9209278f9e086e23cfb4e555f7bd52 
>   client/src/main/java/org/apache/oozie/client/ApiJarFactory.java 
> PRE-CREATION 
>   client/src/main/java/org/apache/oozie/client/ApiJarLoader.java PRE-CREATION 
>   client/src/main/java/org/apache/oozie/client/OozieClient.java 
> 4c8175628ba5ee346d97ad984532662032b88acc 
>   core/pom.xml 45880a619e70a1643f4eb5ceeb61abb2090551f1 
>   core/src/main/java/org/apache/oozie/BaseLocalOozieClient.java 
> 38fb006980c0acb582b4f91175be1ced8a1afa79 
>   core/src/main/java/org/apache/oozie/local/LocalOozie.java 
> 9ab646cd53223d903e387eb92aa103a7b6577d0f 
>   core/src/main/java/org/apache/oozie/servlet/BaseJobServlet.java 
> e1bd3cf61aabfa4311881b2944fc9f10ffe9145d 
>   core/src/main/java/org/apache/oozie/servlet/BaseJobsServlet.java 
> d4b08711223356c8d4f58a3391b6b87efa0a2b73 
>   core/src/main/java/org/apache/oozie/servlet/ServletUtilities.java 
> 3eb32d50d07687c136fcc0e467a055bdc1e7ec60 
>   core/src/main/java/org/apache/oozie/servlet/V0JobsServlet.java 
> 1d800949cbff34a95f2ae111364eb8cbc6a5f5fb 
>   core/src/main/java/org/apache/oozie/servlet/V1JobsServlet.java 
> c1ca65fd2f8bf0f3e5c618dddcba3bf52eaf5420 
>   core/src/main/java/org/apache/oozie/servlet/V2ValidateServlet.java 
> b86fa6ace43aead115302aad3ae15368b15f1923 
>   core/src/main/resources/oozie-default.xml 
> 8d7465c27bfe0a25b07daf556a36c6ecc2569cb6 
>   core/src/test/java/org/apache/oozie/client/TestOozieCLI.java 
> 3395cc25d27805444ba0b6463357c4ecff977ac1 
>   core/src/test/java/org/apache/oozie/servlet/TestV1JobsServlet.java 
> fb481e367653187a94199069199f1d1b06d1cecf 
>   core/src/test/java/org/apache/oozie/test/MiniOozieTestCase.java 
> 0a030d660f9c545b520afcce458a27ba2a367658 
>   docs/src/site/twiki/DG_CommandLineTool.twiki 
> 9a174596dd78fb15989daf4e88936a9a2b09ef13 
>   docs/src/site/twiki/DG_CustomActionExecutor.twiki 
> 4acbf0d40ae36c441f8510e107243603fa0e001b 
>   docs/src/site/twiki/DG_Examples.twiki 
> 13dfa28c0eecab70321886b2806a791346c46d3b 
>   docs/src/site/twiki/DG_FluentJobAPI.twiki PRE-CREATION 
>   examples/pom.xml c13febc81cf5b26b4af90885787113e247ae7cb8 
>   
> examples/src/main/java/org/apache/oozie/example/fluentjob/CredentialsRetrying.java
>  PRE-CREATION 
>   examples/src/main/java/org/apache/oozie/example/fluentjob/Global.java 
> PRE-CREATION 
>   examples/src/main/java/org/apache/oozie/example/fluentjob/JavaMain.java 
> PRE-CREATION 
>   
> examples/src/main/java/org/apache/oozie/example/fluentjob/MultipleShellActions.java
>  PRE-CREATION 
>   examples/src/main/java/org/apache/oozie/example/fluentjob/Parameters.java 
> PRE-CREATION 
>   examples/src/main/java/org/apache/oozie/example/fluentjob/Shell.java 
> PRE-CREATION 
>   examples/src/main/java/org/apache/oozie/example/fluentjob/Spark.java 
> PRE-CREATION 
>   findbugs-filter.xml 03ee4d103f46487493fd725224cf4912ac7bc7dd 
>   fluent-job/fluent-job-api/pom.xml PRE-CREATION 
>   
> fluent-job/fluent-job-api/src/main/java/org/apache/oozie/fluentjob/api/Condition.java
>  PRE-CREATION 
>   
> fluent-job/fluent-job-api/src/main/java/org/apache/oozie/fluentjob/api/GraphVisualization.java
>  PRE-CREATION 
>   
> fluent-job/fluent-job-api/src/main/java/org/apache/oozie/fluentjob/api/ModifyOnce.java
>  PRE-CREATION 
>   
> fluent-job/fluent-job-api/src/main/java/org/apache/oozie/fluentjob/api/action/ActionAttributes.java
>  PRE-CREATION 
>   
> 

[jira] Subscription: Oozie Patch Available

[jira]

Issue Subscription
Filter: Oozie Patch Available (101 issues)

Subscriber: ooziedaily

Key Summary
OOZIE-3284  mkdistro.sh fails with NPE if JAVA_HOME is not set
https://issues.apache.org/jira/browse/OOZIE-3284
OOZIE-3278  Oozie fails to start with Hadoop 2.6.0
https://issues.apache.org/jira/browse/OOZIE-3278
OOZIE-3275  [docs] Update AG_Install.twiki with Access Control List 
documentation
https://issues.apache.org/jira/browse/OOZIE-3275
OOZIE-3274  Remove slf4j
https://issues.apache.org/jira/browse/OOZIE-3274
OOZIE-3270   Upgrade Derby to 10.14.1.0
https://issues.apache.org/jira/browse/OOZIE-3270
OOZIE-3265  properties RERUN_FAIL_NODES and RERUN_SKIP_NODES should be able to 
appear together
https://issues.apache.org/jira/browse/OOZIE-3265
OOZIE-3256  refactor OozieCLI class
https://issues.apache.org/jira/browse/OOZIE-3256
OOZIE-3249  [tools] Instrumentation log parser
https://issues.apache.org/jira/browse/OOZIE-3249
OOZIE-3218  Oozie Sqoop action with command splits the select clause into 
multiple parts due to delimiter being space
https://issues.apache.org/jira/browse/OOZIE-3218
OOZIE-3199  Let system property restriction configurable
https://issues.apache.org/jira/browse/OOZIE-3199
OOZIE-3196  Authorization: restrict world readability by user
https://issues.apache.org/jira/browse/OOZIE-3196
OOZIE-3194  Oozie should set proper permissions to sharelib after upload
https://issues.apache.org/jira/browse/OOZIE-3194
OOZIE-3193  Applications are not killed when submitted via subworkflow
https://issues.apache.org/jira/browse/OOZIE-3193
OOZIE-3186  Oozie is unable to use configuration linked using jceks://file/...
https://issues.apache.org/jira/browse/OOZIE-3186
OOZIE-3179  Adding a configurable config-default.xml location to a workflow
https://issues.apache.org/jira/browse/OOZIE-3179
OOZIE-3170  Oozie Diagnostic Bundle tool fails with NPE due to missing service 
class
https://issues.apache.org/jira/browse/OOZIE-3170
OOZIE-3160  PriorityDelayQueue put()/take() can cause significant CPU load due 
to busy waiting
https://issues.apache.org/jira/browse/OOZIE-3160
OOZIE-3135  Configure log4j2 in SqoopMain
https://issues.apache.org/jira/browse/OOZIE-3135
OOZIE-3109  Escape log-streaming's HTML-specific characters
https://issues.apache.org/jira/browse/OOZIE-3109
OOZIE-3091  Oozie Sqoop Avro Import fails with "java.lang.NoClassDefFoundError: 
org/apache/avro/mapred/AvroWrapper"
https://issues.apache.org/jira/browse/OOZIE-3091
OOZIE-3071  Oozie 4.3 Spark sharelib ueses a different version of commons-lang3 
than Spark 2.2.0
https://issues.apache.org/jira/browse/OOZIE-3071
OOZIE-3063  Sanitizing variables that are part of openjpa.ConnectionProperties
https://issues.apache.org/jira/browse/OOZIE-3063
OOZIE-3062  Set HADOOP_CONF_DIR for spark action
https://issues.apache.org/jira/browse/OOZIE-3062
OOZIE-3061  Kill only those child jobs which are not already killed
https://issues.apache.org/jira/browse/OOZIE-3061
OOZIE-2956  Fix Findbugs warnings related to reliance on default encoding in 
oozie-core
https://issues.apache.org/jira/browse/OOZIE-2956
OOZIE-2955  Fix Findbugs warnings related to reliance on default encoding in 
oozie-client
https://issues.apache.org/jira/browse/OOZIE-2955
OOZIE-2954  Fix Checkstyle issues in oozie-client
https://issues.apache.org/jira/browse/OOZIE-2954
OOZIE-2953  Fix Checkstyle issues in oozie-tools
https://issues.apache.org/jira/browse/OOZIE-2953
OOZIE-2952  Fix Findbugs warnings in oozie-sharelib-oozie
https://issues.apache.org/jira/browse/OOZIE-2952
OOZIE-2949  Escape quotes whitespaces in Sqoop  field
https://issues.apache.org/jira/browse/OOZIE-2949
OOZIE-2942  [examples] Fix Findbugs warnings
https://issues.apache.org/jira/browse/OOZIE-2942
OOZIE-2927  Append new line character for Hive2 query using query tag
https://issues.apache.org/jira/browse/OOZIE-2927
OOZIE-2877  Oozie Git Action
https://issues.apache.org/jira/browse/OOZIE-2877
OOZIE-2834  ParameterVerifier logging non-useful warning for workflow definition
https://issues.apache.org/jira/browse/OOZIE-2834
OOZIE-2833  when using uber mode the regex pattern used in the 
extractHeapSizeMB method does not allow heap sizes specified in bytes.
https://issues.apache.org/jira/browse/OOZIE-2833
OOZIE-2829  Improve sharelib upload to accept multiple source folders
https://issues.apache.org/jira/browse/OOZIE-2829
OOZIE-2812  SparkConfigurationService should support loading configurations 
from multiple Spark versions
https://issues.apache.org/jira/browse/OOZIE-2812
OOZIE-2795  Create lib directory