[
https://issues.apache.org/jira/browse/OOZIE-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16279152#comment-16279152
]
Artem Ervits commented on OOZIE-3071:
-------------------------------------
[~rangu] no I meant 3.5, the concern was that 3.5 would break the Spark action
for Spark 2.2 and only fix for 1.6. I see that branch 1.6 is on 3.3.2
https://github.com/apache/spark/blob/branch-1.6/pom.xml#L179
branch 2.0 is on 3.3.2
https://github.com/apache/spark/blob/branch-2.0/pom.xml#L173
branch 2.1 and 2.2 are on 3.5
https://github.com/apache/spark/blob/branch-2.1/pom.xml#L171 and
https://github.com/apache/spark/blob/branch-2.2/pom.xml#L171 respectively
so we either wait or take risk updating to 3.6.
> Oozie 4.3 Spark sharelib ueses a different version of commons-lang3 than
> Spark 2.2.0
> ------------------------------------------------------------------------------------
>
> Key: OOZIE-3071
> URL: https://issues.apache.org/jira/browse/OOZIE-3071
> Project: Oozie
> Issue Type: Bug
> Components: core
> Affects Versions: 4.3.0
> Reporter: Ran Gu
> Assignee: Artem Ervits
> Labels: patch
> Attachments: OOZIE-3071-1.patch, OOZIE-3071.patch
>
>
> Currently Oozie 4.3.0 uses commons-lang3 version 3.3.2 in Spark sharelib.
> Spark 2.2.0 uses commons-lang3 version 3.5.
> This causes Oozie(/Spark) job failures on EMR-5.8.0 clusters.
> Error message:
> 17/08/22 00:22:43 ERROR ApplicationMaster: User class threw exception:
> java.lang.IllegalArgumentException: Illegal pattern component: XXX
> java.lang.IllegalArgumentException: Illegal pattern component: XXX
> at
> org.apache.commons.lang3.time.FastDatePrinter.parsePattern(FastDatePrinter.java:282)
> at
> org.apache.commons.lang3.time.FastDatePrinter.init(FastDatePrinter.java:149)
> at
> org.apache.commons.lang3.time.FastDatePrinter.<init>(FastDatePrinter.java:142)
> at
> org.apache.commons.lang3.time.FastDateFormat.<init>(FastDateFormat.java:384)
> at
> org.apache.commons.lang3.time.FastDateFormat.<init>(FastDateFormat.java:369)
> at
> org.apache.commons.lang3.time.FastDateFormat$1.createInstance(FastDateFormat.java:91)
> at
> org.apache.commons.lang3.time.FastDateFormat$1.createInstance(FastDateFormat.java:88)
> at org.apache.commons.lang3.time.FormatCache.getInstance(FormatCache.java:82)
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
