[ https://issues.apache.org/jira/browse/OOZIE-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Peter Bacsko updated OOZIE-3054: -------------------------------- Attachment: OOZIE-3045-001.patch > Disable erasure coding for sharelib if Oozie runs on Hadoop 3 > ------------------------------------------------------------- > > Key: OOZIE-3054 > URL: https://issues.apache.org/jira/browse/OOZIE-3054 > Project: Oozie > Issue Type: Improvement > Components: client > Reporter: Peter Bacsko > Assignee: Peter Bacsko > Attachments: OOZIE-3045-001.patch > > > Hadoop 3 will introduce Erasure Coding support for HDFS. This means less disk > usage, but increased CPU load for reading/writing. > The contents of Oozie sharelib are localized every time an asynchronous > action is executed. Therefore, to reduce the possible negative performance > impact of EC, Oozie sharelib should not utilize it. > Since we're supporting Hadoop 2 as well, using the EC API will be done with > Java reflection. Later, when we drop support for Hadoop 2, this can be > rewritten. -- This message was sent by Atlassian JIRA (v6.4.14#64029)