[jira] Subscription: Oozie Patch Available

[jira]

Issue Subscription
Filter: Oozie Patch Available (17 issues)

Subscriber: ooziedaily

Key Summary
OOZIE-1675  Adding absolute URI of local cluster to dist cache not working with 
hadoop-1
https://issues.apache.org/jira/browse/OOZIE-1675
OOZIE-1654  Fix typo (inteval to interval)
https://issues.apache.org/jira/browse/OOZIE-1654
OOZIE-1638  Action retry does not use default retry max count.
https://issues.apache.org/jira/browse/OOZIE-1638
OOZIE-1636  OOZIE_SYS table engine should be innodb
https://issues.apache.org/jira/browse/OOZIE-1636
OOZIE-1629  EL function in  is not evaluated properly
https://issues.apache.org/jira/browse/OOZIE-1629
OOZIE-1624  Exclusion pattern for sharelib.
https://issues.apache.org/jira/browse/OOZIE-1624
OOZIE-1618  dryrun should check variable substitution in workflow.xml
https://issues.apache.org/jira/browse/OOZIE-1618
OOZIE-1602  pom.xml should take use of the profiles when building hadooplibs
https://issues.apache.org/jira/browse/OOZIE-1602
OOZIE-1579  Add basic HTTP auth to Oozie CLI
https://issues.apache.org/jira/browse/OOZIE-1579
OOZIE-1552  Bring Windows shell script functionality and structure in line with 
trunk
https://issues.apache.org/jira/browse/OOZIE-1552
OOZIE-1376  Extending Oozie ACLs like admin groups and proxy users to support 
both groups and users
https://issues.apache.org/jira/browse/OOZIE-1376
OOZIE-1369  OozieDBCLI code should not hardcode the Oozie table filenames
https://issues.apache.org/jira/browse/OOZIE-1369
OOZIE-1319  "LAST_ONLY" in execution control for coordinator job still runs all 
the actions
https://issues.apache.org/jira/browse/OOZIE-1319
OOZIE-1232  GroupsService should be able to reference Hadoop configurations in 
Hadoop configuration folder (such as /etc/hadoop/conf)
https://issues.apache.org/jira/browse/OOZIE-1232
OOZIE-1074  workflowgenerator does not package a tar.gz file though it seems 
creating one is the intention
https://issues.apache.org/jira/browse/OOZIE-1074
OOZIE-891   Add pagination for all popup panels in Oozie Web UI
https://issues.apache.org/jira/browse/OOZIE-891
OOZIE-547   build workflow progress information in Oozie
https://issues.apache.org/jira/browse/OOZIE-547

You may edit this subscription at:
https://issues.apache.org/jira/secure/FilterSubscription!default.jspa?subId=14721&filterId=12325939

[jira] [Commented] (OOZIE-1388) Add a admin servlet to show thread stack trace and CPU usage per thread

[Mona Chitnis (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-1388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13888307#comment-13888307
 ] 

Mona Chitnis commented on OOZIE-1388:
-

Rohini, can you do the doc change from the comments, so we can commit this soon?

> Add a admin servlet to show thread stack trace and CPU usage per thread
> ---
>
> Key: OOZIE-1388
> URL: https://issues.apache.org/jira/browse/OOZIE-1388
> Project: Oozie
>  Issue Type: Improvement
>Reporter: Rohini Palaniswamy
>Assignee: Rohini Palaniswamy
> Fix For: trunk
>
> Attachments: OOZIE-1388-1.patch
>
>
> ThreadMXBean can be used to display the stack trace and also CPU usage per 
> thread. The servlet will be very useful for debugging.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

[jira] [Commented] (OOZIE-1675) Adding absolute URI of local cluster to dist cache not working with hadoop-1

[Satish Mittal (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-1675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13888128#comment-13888128
 ] 

Satish Mittal commented on OOZIE-1675:
--

All tests of class org.apache.oozie.service.TestCallableQueueService have 
succeeded with latest trunk on my setup. Seems to be a transient failure.

> Adding absolute URI of local cluster to dist cache not working with hadoop-1
> 
>
> Key: OOZIE-1675
> URL: https://issues.apache.org/jira/browse/OOZIE-1675
> Project: Oozie
>  Issue Type: Bug
>Affects Versions: 4.0.0
>Reporter: Satish Mittal
>Assignee: Satish Mittal
> Attachments: OOZIE-1675.1.patch.txt, OOZIE-1675.2.patch.txt, 
> OOZIE-1675.3.patch.txt
>
>
> On hadoop-1, when oozie adds a file path which is an absoute URI on local 
> cluster (i.e. of form hdfs://NN1-host:port/file-path) to distributed cache, 
> it is not working.
> The issue is that tasks spawned by oozie jobs are not getting these paths 
> added to their classpath and hence failing. In hadoop-1, 
> DistributedCache.addFileToClasspath() appends paths in classpath with 
> path.separator (which is ':' on linux). That won't work if ':' character is 
> present in the path itself, which is true in case of an absolute URI. Till 
> oozie 3.3, absolute paths on local cluster were working because of earlier 
> logic.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

[jira] [Updated] (OOZIE-1624) Exclusion pattern for sharelib.

[purshotam shah (JIRA)]

 [ 
https://issues.apache.org/jira/browse/OOZIE-1624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

purshotam shah updated OOZIE-1624:
--

Description: 
Sharelib may bring some jar which might conflict with user jars.

Ex. Sharelib hive has json-2..jar, where as some of the user use-case need 
higher version of json jar.

He should be able to exclude sharelib json jar and bring his own version.


oozie.action.sharelib.for.hive.exclusion
json-\*.jar,abc-*.jar
 

  was:
Sharelib may bring some jar which might conflict with user jars.

Ex. Sharelib hive has json-2..jar, where as some of the user use-case need 
higher version of json jar.

He should be able to exclude sharelib json jar and bring his own version.


oozie.action.sharelib.for.hive.exclusion
json-*.jar,abc-*.jar
 


> Exclusion pattern for sharelib.
> ---
>
> Key: OOZIE-1624
> URL: https://issues.apache.org/jira/browse/OOZIE-1624
> Project: Oozie
>  Issue Type: Sub-task
>Reporter: purshotam shah
>Assignee: purshotam shah
> Attachments: OOZIE-1624-v1.patch
>
>
> Sharelib may bring some jar which might conflict with user jars.
> Ex. Sharelib hive has json-2..jar, where as some of the user use-case 
> need higher version of json jar.
> He should be able to exclude sharelib json jar and bring his own version.
> 
> oozie.action.sharelib.for.hive.exclusion
> json-\*.jar,abc-*.jar
>  



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

[jira] [Updated] (OOZIE-1624) Exclusion pattern for sharelib.

[purshotam shah (JIRA)]

 [ 
https://issues.apache.org/jira/browse/OOZIE-1624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

purshotam shah updated OOZIE-1624:
--

Description: 
Sharelib may bring some jar which might conflict with user jars.

Ex. Sharelib hive has json-2..jar, where as some of the user use-case need 
higher version of json jar.

He should be able to exclude sharelib json jar and bring his own version.


oozie.action.sharelib.for.hive.exclusion
json-*.jar,abc-*.jar
 

  was:
Sharelib may bring some jar which might conflict with user jars.

Ex. Sharelib hive has json-2..jar, where as some of the user use-case need 
higher version of json jar.

He should be able to exclude sharelib json jar and bring his own version.



oozie.action.sharelib.exclusion
json-*.jar,abc-*.jar
 


> Exclusion pattern for sharelib.
> ---
>
> Key: OOZIE-1624
> URL: https://issues.apache.org/jira/browse/OOZIE-1624
> Project: Oozie
>  Issue Type: Sub-task
>Reporter: purshotam shah
>Assignee: purshotam shah
> Attachments: OOZIE-1624-v1.patch
>
>
> Sharelib may bring some jar which might conflict with user jars.
> Ex. Sharelib hive has json-2..jar, where as some of the user use-case 
> need higher version of json jar.
> He should be able to exclude sharelib json jar and bring his own version.
> 
> oozie.action.sharelib.for.hive.exclusion
> json-*.jar,abc-*.jar
>  



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Re: Review Request 16203: OOZIE-1624 Exclusion pattern for sharelib.

[Purshotam Shah]

> On Jan. 30, 2014, 10:37 p.m., Mona Chitnis wrote:
> > http://svn.apache.org/repos/asf/oozie/trunk/core/src/main/java/org/apache/oozie/action/hadoop/JavaActionExecutor.java,
> >  line 589
> > 
> >
> > the JIRA description mentions "oozie.action.sharelib.exclusion", and 
> > the string differs here. Why do we need exclusion per type?

Currently sharelib is specified as String actionShareLibProperty = 
actionConf.get(ACTION_SHARELIB_FOR + getType());

I think it's better to provide exclusion in similar way.

User can just add suffix (.exclusion) to specify exclusion for sharelib.

Will modify the jira accordingly.


- Purshotam


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/16203/#review33267
---


On Dec. 12, 2013, 6:23 a.m., Purshotam Shah wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/16203/
> ---
> 
> (Updated Dec. 12, 2013, 6:23 a.m.)
> 
> 
> Review request for oozie.
> 
> 
> Bugs: OOZIE-1624
> https://issues.apache.org/jira/browse/OOZIE-1624
> 
> 
> Repository: oozie
> 
> 
> Description
> ---
> 
> OOZIE-1624 Exclusion pattern for sharelib.
> 
> 
> Diffs
> -
> 
>   
> http://svn.apache.org/repos/asf/oozie/trunk/core/src/main/java/org/apache/oozie/action/hadoop/JavaActionExecutor.java
>  1550348 
>   
> http://svn.apache.org/repos/asf/oozie/trunk/core/src/test/java/org/apache/oozie/service/TestShareLibService.java
>  1550348 
>   
> http://svn.apache.org/repos/asf/oozie/trunk/docs/src/site/twiki/WorkflowFunctionalSpec.twiki
>  1550348 
> 
> Diff: https://reviews.apache.org/r/16203/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Purshotam Shah
> 
>

[jira] [Commented] (OOZIE-1675) Adding absolute URI of local cluster to dist cache not working with hadoop-1

[Hadoop QA (JIRA)]

[ 
https://issues.apache.org/jira/browse/OOZIE-1675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13888052#comment-13888052
 ] 

Hadoop QA commented on OOZIE-1675:
--

Testing JIRA OOZIE-1675

Cleaning local git workspace



{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:green}+1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than 
132
.{color:green}+1{color} the patch does adds/modifies 1 testcase(s)
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT 
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc 
warnings
{color:red}-1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:red}-1{color} the patch seems to introduce 1 new javac warning(s)
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA 
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:red}-1 TESTS{color}
.Tests run: 1388
.Tests failed: 1
.Tests errors: 1

.The patch failed the following testcases:

.  
testConcurrencyReachedAndChooseNextEligible(org.apache.oozie.service.TestCallableQueueService)

{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch 


{color:red}*-1 Overall result, please check the reported -1(s)*{color}


The full output of the test-patch run is available at

.   https://builds.apache.org/job/oozie-trunk-precommit-build/1040/

> Adding absolute URI of local cluster to dist cache not working with hadoop-1
> 
>
> Key: OOZIE-1675
> URL: https://issues.apache.org/jira/browse/OOZIE-1675
> Project: Oozie
>  Issue Type: Bug
>Affects Versions: 4.0.0
>Reporter: Satish Mittal
>Assignee: Satish Mittal
> Attachments: OOZIE-1675.1.patch.txt, OOZIE-1675.2.patch.txt, 
> OOZIE-1675.3.patch.txt
>
>
> On hadoop-1, when oozie adds a file path which is an absoute URI on local 
> cluster (i.e. of form hdfs://NN1-host:port/file-path) to distributed cache, 
> it is not working.
> The issue is that tasks spawned by oozie jobs are not getting these paths 
> added to their classpath and hence failing. In hadoop-1, 
> DistributedCache.addFileToClasspath() appends paths in classpath with 
> path.separator (which is ':' on linux). That won't work if ':' character is 
> present in the path itself, which is true in case of an absolute URI. Till 
> oozie 3.3, absolute paths on local cluster were working because of earlier 
> logic.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

[jira] [Updated] (OOZIE-1675) Adding absolute URI of local cluster to dist cache not working with hadoop-1

[Satish Mittal (JIRA)]

 [ 
https://issues.apache.org/jira/browse/OOZIE-1675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Satish Mittal updated OOZIE-1675:
-

Attachment: OOZIE-1675.3.patch.txt

Uploading new patch that checks for host & port existence while comparing URI 
and baseURI.

> Adding absolute URI of local cluster to dist cache not working with hadoop-1
> 
>
> Key: OOZIE-1675
> URL: https://issues.apache.org/jira/browse/OOZIE-1675
> Project: Oozie
>  Issue Type: Bug
>Affects Versions: 4.0.0
>Reporter: Satish Mittal
>Assignee: Satish Mittal
> Attachments: OOZIE-1675.1.patch.txt, OOZIE-1675.2.patch.txt, 
> OOZIE-1675.3.patch.txt
>
>
> On hadoop-1, when oozie adds a file path which is an absoute URI on local 
> cluster (i.e. of form hdfs://NN1-host:port/file-path) to distributed cache, 
> it is not working.
> The issue is that tasks spawned by oozie jobs are not getting these paths 
> added to their classpath and hence failing. In hadoop-1, 
> DistributedCache.addFileToClasspath() appends paths in classpath with 
> path.separator (which is ':' on linux). That won't work if ':' character is 
> present in the path itself, which is true in case of an absolute URI. Till 
> oozie 3.3, absolute paths on local cluster were working because of earlier 
> logic.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Re: Review Request 17371: OOZIE-1675: Adding absolute URI of local cluster to dist cache not working with hadoop-1

[Satish Mittal]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/17371/
---

(Updated Jan. 31, 2014, 5:59 p.m.)


Review request for oozie and Ryota Egashira.


Changes
---

Uploading new patch that checks for host & port existence while comparing uri 
and baseURI.


Repository: oozie-git


Description
---

- Attaching the patch that fixes the issue


Diffs (updated)
-

  core/src/main/java/org/apache/oozie/action/hadoop/JavaActionExecutor.java 
b9d7cc9 
  core/src/test/java/org/apache/oozie/action/hadoop/TestJavaActionExecutor.java 
88af9b5 

Diff: https://reviews.apache.org/r/17371/diff/


Testing
---

- Ran Unit tests; added new unit test
- Tested the functionality with hadoop-1 and oozie-4


Thanks,

Satish Mittal