[ 
https://issues.apache.org/jira/browse/OOZIE-3728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17912015#comment-17912015
 ] 

Dénes Bodó commented on OOZIE-3728:
-----------------------------------

On Monday I will check the Oozie dependencies' version against Hadoop 2.8.5 
dependencies' version maybe we can upgrade something to solve the remaining 
test failures.

 

In an Ubuntu docker image with Java8 and Maven 3.6.3 Sqoop, Hive and Hive2 
tests pass with the current change. PySpark does not, neither 1.6 nor 2.x. 
Anyway, Spark3 is almost deprecated now.

 

When should we fix the test issues? Should we merge the Hadoop upgrade as-is to 
unblock other other testing or make it 100% now? I vote for merge-now-fix-later.

> Upgrade Hadoop to 2.8.5
> -----------------------
>
>                 Key: OOZIE-3728
>                 URL: https://issues.apache.org/jira/browse/OOZIE-3728
>             Project: Oozie
>          Issue Type: Improvement
>          Components: core
>            Reporter: Dénes Bodó
>            Assignee: Dénes Bodó
>            Priority: Major
>         Attachments: OOZIE-3728-001.patch, OOZIE-3728-002.patch
>
>
> In OOZIE-3725 it turned out that Oozie may be able to build if we upgrade 
> Hadoop to 2.8.5. There will be test failures, as I experienced due to timeout 
> because the underlying MR jobs didn't finish in time.
>  
> Let's see how the build behaves with newer Hadoop 2, and if possible, try to 
> adjust test parameters to make them pass.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to