[ 
https://issues.apache.org/jira/browse/OOZIE-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16163467#comment-16163467
 ] 

Peter Bacsko commented on OOZIE-3054:
-------------------------------------

The test failure was caused by the patch. Will fix that tomorrow.

> Disable erasure coding for sharelib if Oozie runs on Hadoop 3
> -------------------------------------------------------------
>
>                 Key: OOZIE-3054
>                 URL: https://issues.apache.org/jira/browse/OOZIE-3054
>             Project: Oozie
>          Issue Type: Improvement
>          Components: client
>            Reporter: Peter Bacsko
>            Assignee: Peter Bacsko
>         Attachments: OOZIE-3045-001.patch
>
>
> Hadoop 3 will introduce Erasure Coding support for HDFS. This means less disk 
> usage, but increased CPU load for reading/writing.
> The contents of Oozie sharelib are localized every time an asynchronous 
> action is executed. Therefore, to reduce the possible negative performance 
> impact of EC, Oozie sharelib should not utilize it.
> Since we're supporting Hadoop 2 as well, using the EC API will be done with 
> Java reflection. Later, when we drop support for Hadoop 2, this can be 
> rewritten.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to