[jira] [Commented] (OOZIE-3071) Oozie 4.3 Spark sharelib ueses a different version of commons-lang3 than Spark 2.2.0
[ https://issues.apache.org/jira/browse/OOZIE-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279034#comment-16279034 ] Ran Gu commented on OOZIE-3071: --- [~dbist13]Just to clarify you meant 3.6 not 3.5 right? The patch you attached is using 3.6 > Oozie 4.3 Spark sharelib ueses a different version of commons-lang3 than > Spark 2.2.0 > > > Key: OOZIE-3071 > URL: https://issues.apache.org/jira/browse/OOZIE-3071 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: 4.3.0 >Reporter: Ran Gu > Labels: patch > Attachments: OOZIE-3071-1.patch, OOZIE-3071.patch > > > Currently Oozie 4.3.0 uses commons-lang3 version 3.3.2 in Spark sharelib. > Spark 2.2.0 uses commons-lang3 version 3.5. > This causes Oozie(/Spark) job failures on EMR-5.8.0 clusters. > Error message: > 17/08/22 00:22:43 ERROR ApplicationMaster: User class threw exception: > java.lang.IllegalArgumentException: Illegal pattern component: XXX > java.lang.IllegalArgumentException: Illegal pattern component: XXX > at > org.apache.commons.lang3.time.FastDatePrinter.parsePattern(FastDatePrinter.java:282) > at > org.apache.commons.lang3.time.FastDatePrinter.init(FastDatePrinter.java:149) > at > org.apache.commons.lang3.time.FastDatePrinter.(FastDatePrinter.java:142) > at > org.apache.commons.lang3.time.FastDateFormat.(FastDateFormat.java:384) > at > org.apache.commons.lang3.time.FastDateFormat.(FastDateFormat.java:369) > at > org.apache.commons.lang3.time.FastDateFormat$1.createInstance(FastDateFormat.java:91) > at > org.apache.commons.lang3.time.FastDateFormat$1.createInstance(FastDateFormat.java:88) > at org.apache.commons.lang3.time.FormatCache.getInstance(FormatCache.java:82) -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (OOZIE-3071) Oozie 4.3 Spark sharelib ueses a different version of commons-lang3 than Spark 2.2.0
[ https://issues.apache.org/jira/browse/OOZIE-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16278961#comment-16278961 ] Ran Gu commented on OOZIE-3071: --- Ping > Oozie 4.3 Spark sharelib ueses a different version of commons-lang3 than > Spark 2.2.0 > > > Key: OOZIE-3071 > URL: https://issues.apache.org/jira/browse/OOZIE-3071 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: 4.3.0 >Reporter: Ran Gu > Labels: patch > Attachments: OOZIE-3071-1.patch, OOZIE-3071.patch > > > Currently Oozie 4.3.0 uses commons-lang3 version 3.3.2 in Spark sharelib. > Spark 2.2.0 uses commons-lang3 version 3.5. > This causes Oozie(/Spark) job failures on EMR-5.8.0 clusters. > Error message: > 17/08/22 00:22:43 ERROR ApplicationMaster: User class threw exception: > java.lang.IllegalArgumentException: Illegal pattern component: XXX > java.lang.IllegalArgumentException: Illegal pattern component: XXX > at > org.apache.commons.lang3.time.FastDatePrinter.parsePattern(FastDatePrinter.java:282) > at > org.apache.commons.lang3.time.FastDatePrinter.init(FastDatePrinter.java:149) > at > org.apache.commons.lang3.time.FastDatePrinter.(FastDatePrinter.java:142) > at > org.apache.commons.lang3.time.FastDateFormat.(FastDateFormat.java:384) > at > org.apache.commons.lang3.time.FastDateFormat.(FastDateFormat.java:369) > at > org.apache.commons.lang3.time.FastDateFormat$1.createInstance(FastDateFormat.java:91) > at > org.apache.commons.lang3.time.FastDateFormat$1.createInstance(FastDateFormat.java:88) > at org.apache.commons.lang3.time.FormatCache.getInstance(FormatCache.java:82) -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (OOZIE-3071) Oozie 4.3 Spark sharelib ueses a different version of commons-lang3 than Spark 2.2.0
[ https://issues.apache.org/jira/browse/OOZIE-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16277412#comment-16277412 ] Ran Gu commented on OOZIE-3071: --- Hello, any updates on this? > Oozie 4.3 Spark sharelib ueses a different version of commons-lang3 than > Spark 2.2.0 > > > Key: OOZIE-3071 > URL: https://issues.apache.org/jira/browse/OOZIE-3071 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: 4.3.0 >Reporter: Ran Gu > Labels: patch > Attachments: OOZIE-3071-1.patch, OOZIE-3071.patch > > > Currently Oozie 4.3.0 uses commons-lang3 version 3.3.2 in Spark sharelib. > Spark 2.2.0 uses commons-lang3 version 3.5. > This causes Oozie(/Spark) job failures on EMR-5.8.0 clusters. > Error message: > 17/08/22 00:22:43 ERROR ApplicationMaster: User class threw exception: > java.lang.IllegalArgumentException: Illegal pattern component: XXX > java.lang.IllegalArgumentException: Illegal pattern component: XXX > at > org.apache.commons.lang3.time.FastDatePrinter.parsePattern(FastDatePrinter.java:282) > at > org.apache.commons.lang3.time.FastDatePrinter.init(FastDatePrinter.java:149) > at > org.apache.commons.lang3.time.FastDatePrinter.(FastDatePrinter.java:142) > at > org.apache.commons.lang3.time.FastDateFormat.(FastDateFormat.java:384) > at > org.apache.commons.lang3.time.FastDateFormat.(FastDateFormat.java:369) > at > org.apache.commons.lang3.time.FastDateFormat$1.createInstance(FastDateFormat.java:91) > at > org.apache.commons.lang3.time.FastDateFormat$1.createInstance(FastDateFormat.java:88) > at org.apache.commons.lang3.time.FormatCache.getInstance(FormatCache.java:82) -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (OOZIE-3071) Oozie 4.3 Spark sharelib ueses a different version of commons-lang3 than Spark 2.2.0
[ https://issues.apache.org/jira/browse/OOZIE-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16190159#comment-16190159 ] Ran Gu commented on OOZIE-3071: --- Sorry for the late response. I have verified that updating commons-lang3 version to 3.6 in top level pom.xml worked properly. Are you going to make that change? And will that be included in the next Oozie release? > Oozie 4.3 Spark sharelib ueses a different version of commons-lang3 than > Spark 2.2.0 > > > Key: OOZIE-3071 > URL: https://issues.apache.org/jira/browse/OOZIE-3071 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: 4.3.0 >Reporter: Ran Gu > Labels: patch > Attachments: OOZIE-3071.patch > > > Currently Oozie 4.3.0 uses commons-lang3 version 3.3.2 in Spark sharelib. > Spark 2.2.0 uses commons-lang3 version 3.5. > This causes Oozie(/Spark) job failures on EMR-5.8.0 clusters. > Error message: > 17/08/22 00:22:43 ERROR ApplicationMaster: User class threw exception: > java.lang.IllegalArgumentException: Illegal pattern component: XXX > java.lang.IllegalArgumentException: Illegal pattern component: XXX > at > org.apache.commons.lang3.time.FastDatePrinter.parsePattern(FastDatePrinter.java:282) > at > org.apache.commons.lang3.time.FastDatePrinter.init(FastDatePrinter.java:149) > at > org.apache.commons.lang3.time.FastDatePrinter.(FastDatePrinter.java:142) > at > org.apache.commons.lang3.time.FastDateFormat.(FastDateFormat.java:384) > at > org.apache.commons.lang3.time.FastDateFormat.(FastDateFormat.java:369) > at > org.apache.commons.lang3.time.FastDateFormat$1.createInstance(FastDateFormat.java:91) > at > org.apache.commons.lang3.time.FastDateFormat$1.createInstance(FastDateFormat.java:88) > at org.apache.commons.lang3.time.FormatCache.getInstance(FormatCache.java:82) -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (OOZIE-3071) Oozie 4.3 Spark sharelib ueses a different version of commons-lang3 than Spark 2.2.0
[ https://issues.apache.org/jira/browse/OOZIE-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16185085#comment-16185085 ] Ran Gu commented on OOZIE-3071: --- Not sure why "patch failed to apply to head of branch". Recreated patch against Oozie branch-4.3 > Oozie 4.3 Spark sharelib ueses a different version of commons-lang3 than > Spark 2.2.0 > > > Key: OOZIE-3071 > URL: https://issues.apache.org/jira/browse/OOZIE-3071 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: 4.3.0 >Reporter: Ran Gu > Labels: patch > Attachments: OOZIE-3071.patch > > > Currently Oozie 4.3.0 uses commons-lang3 version 3.3.2 in Spark sharelib. > Spark 2.2.0 uses commons-lang3 version 3.5. > This causes Oozie(/Spark) job failures on EMR-5.8.0 clusters. > Error message: > 17/08/22 00:22:43 ERROR ApplicationMaster: User class threw exception: > java.lang.IllegalArgumentException: Illegal pattern component: XXX > java.lang.IllegalArgumentException: Illegal pattern component: XXX > at > org.apache.commons.lang3.time.FastDatePrinter.parsePattern(FastDatePrinter.java:282) > at > org.apache.commons.lang3.time.FastDatePrinter.init(FastDatePrinter.java:149) > at > org.apache.commons.lang3.time.FastDatePrinter.(FastDatePrinter.java:142) > at > org.apache.commons.lang3.time.FastDateFormat.(FastDateFormat.java:384) > at > org.apache.commons.lang3.time.FastDateFormat.(FastDateFormat.java:369) > at > org.apache.commons.lang3.time.FastDateFormat$1.createInstance(FastDateFormat.java:91) > at > org.apache.commons.lang3.time.FastDateFormat$1.createInstance(FastDateFormat.java:88) > at org.apache.commons.lang3.time.FormatCache.getInstance(FormatCache.java:82) -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (OOZIE-3071) Oozie 4.3 Spark sharelib ueses a different version of commons-lang3 than Spark 2.2.0
[ https://issues.apache.org/jira/browse/OOZIE-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ran Gu updated OOZIE-3071: -- Attachment: (was: OOZIE-3071.patch) > Oozie 4.3 Spark sharelib ueses a different version of commons-lang3 than > Spark 2.2.0 > > > Key: OOZIE-3071 > URL: https://issues.apache.org/jira/browse/OOZIE-3071 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: 4.3.0 >Reporter: Ran Gu > Labels: patch > Attachments: OOZIE-3071.patch > > > Currently Oozie 4.3.0 uses commons-lang3 version 3.3.2 in Spark sharelib. > Spark 2.2.0 uses commons-lang3 version 3.5. > This causes Oozie(/Spark) job failures on EMR-5.8.0 clusters. > Error message: > 17/08/22 00:22:43 ERROR ApplicationMaster: User class threw exception: > java.lang.IllegalArgumentException: Illegal pattern component: XXX > java.lang.IllegalArgumentException: Illegal pattern component: XXX > at > org.apache.commons.lang3.time.FastDatePrinter.parsePattern(FastDatePrinter.java:282) > at > org.apache.commons.lang3.time.FastDatePrinter.init(FastDatePrinter.java:149) > at > org.apache.commons.lang3.time.FastDatePrinter.(FastDatePrinter.java:142) > at > org.apache.commons.lang3.time.FastDateFormat.(FastDateFormat.java:384) > at > org.apache.commons.lang3.time.FastDateFormat.(FastDateFormat.java:369) > at > org.apache.commons.lang3.time.FastDateFormat$1.createInstance(FastDateFormat.java:91) > at > org.apache.commons.lang3.time.FastDateFormat$1.createInstance(FastDateFormat.java:88) > at org.apache.commons.lang3.time.FormatCache.getInstance(FormatCache.java:82) -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (OOZIE-3071) Oozie 4.3 Spark sharelib ueses a different version of commons-lang3 than Spark 2.2.0
[ https://issues.apache.org/jira/browse/OOZIE-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ran Gu updated OOZIE-3071: -- Attachment: OOZIE-3071.patch > Oozie 4.3 Spark sharelib ueses a different version of commons-lang3 than > Spark 2.2.0 > > > Key: OOZIE-3071 > URL: https://issues.apache.org/jira/browse/OOZIE-3071 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: 4.3.0 >Reporter: Ran Gu > Labels: patch > Attachments: OOZIE-3071.patch > > > Currently Oozie 4.3.0 uses commons-lang3 version 3.3.2 in Spark sharelib. > Spark 2.2.0 uses commons-lang3 version 3.5. > This causes Oozie(/Spark) job failures on EMR-5.8.0 clusters. > Error message: > 17/08/22 00:22:43 ERROR ApplicationMaster: User class threw exception: > java.lang.IllegalArgumentException: Illegal pattern component: XXX > java.lang.IllegalArgumentException: Illegal pattern component: XXX > at > org.apache.commons.lang3.time.FastDatePrinter.parsePattern(FastDatePrinter.java:282) > at > org.apache.commons.lang3.time.FastDatePrinter.init(FastDatePrinter.java:149) > at > org.apache.commons.lang3.time.FastDatePrinter.(FastDatePrinter.java:142) > at > org.apache.commons.lang3.time.FastDateFormat.(FastDateFormat.java:384) > at > org.apache.commons.lang3.time.FastDateFormat.(FastDateFormat.java:369) > at > org.apache.commons.lang3.time.FastDateFormat$1.createInstance(FastDateFormat.java:91) > at > org.apache.commons.lang3.time.FastDateFormat$1.createInstance(FastDateFormat.java:88) > at org.apache.commons.lang3.time.FormatCache.getInstance(FormatCache.java:82) -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (OOZIE-3071) Oozie 4.3 Spark sharelib ueses a different version of commons-lang3 than Spark 2.2.0
[ https://issues.apache.org/jira/browse/OOZIE-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16184852#comment-16184852 ] Ran Gu commented on OOZIE-3071: --- [~dbist13] Updating commons-lang3 to 3.5 in Oozie top level pom.xml breaks hive2 (mvn clean install would fail). Seems to me Hive2 is using commons-lang3 version 3.3.2 where Spark is using commons-lang3 version 3.5. > Oozie 4.3 Spark sharelib ueses a different version of commons-lang3 than > Spark 2.2.0 > > > Key: OOZIE-3071 > URL: https://issues.apache.org/jira/browse/OOZIE-3071 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: 4.3.0 >Reporter: Ran Gu > Attachments: OOZIE-3071.patch > > > Currently Oozie 4.3.0 uses commons-lang3 version 3.3.2 in Spark sharelib. > Spark 2.2.0 uses commons-lang3 version 3.5. > This causes Oozie(/Spark) job failures on EMR-5.8.0 clusters. > Error message: > 17/08/22 00:22:43 ERROR ApplicationMaster: User class threw exception: > java.lang.IllegalArgumentException: Illegal pattern component: XXX > java.lang.IllegalArgumentException: Illegal pattern component: XXX > at > org.apache.commons.lang3.time.FastDatePrinter.parsePattern(FastDatePrinter.java:282) > at > org.apache.commons.lang3.time.FastDatePrinter.init(FastDatePrinter.java:149) > at > org.apache.commons.lang3.time.FastDatePrinter.(FastDatePrinter.java:142) > at > org.apache.commons.lang3.time.FastDateFormat.(FastDateFormat.java:384) > at > org.apache.commons.lang3.time.FastDateFormat.(FastDateFormat.java:369) > at > org.apache.commons.lang3.time.FastDateFormat$1.createInstance(FastDateFormat.java:91) > at > org.apache.commons.lang3.time.FastDateFormat$1.createInstance(FastDateFormat.java:88) > at org.apache.commons.lang3.time.FormatCache.getInstance(FormatCache.java:82) -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (OOZIE-3071) Oozie 4.3 Spark sharelib ueses a different version of commons-lang3 than Spark 2.2.0
[ https://issues.apache.org/jira/browse/OOZIE-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ran Gu updated OOZIE-3071: -- Attachment: OOZIE-3071.patch Attached patch for fixing this issue > Oozie 4.3 Spark sharelib ueses a different version of commons-lang3 than > Spark 2.2.0 > > > Key: OOZIE-3071 > URL: https://issues.apache.org/jira/browse/OOZIE-3071 > Project: Oozie > Issue Type: Bug > Components: core >Affects Versions: 4.3.0 >Reporter: Ran Gu > Attachments: OOZIE-3071.patch > > > Currently Oozie 4.3.0 uses commons-lang3 version 3.3.2 in Spark sharelib. > Spark 2.2.0 uses commons-lang3 version 3.5. > This causes Oozie(/Spark) job failures on EMR-5.8.0 clusters. > Error message: > 17/08/22 00:22:43 ERROR ApplicationMaster: User class threw exception: > java.lang.IllegalArgumentException: Illegal pattern component: XXX > java.lang.IllegalArgumentException: Illegal pattern component: XXX > at > org.apache.commons.lang3.time.FastDatePrinter.parsePattern(FastDatePrinter.java:282) > at > org.apache.commons.lang3.time.FastDatePrinter.init(FastDatePrinter.java:149) > at > org.apache.commons.lang3.time.FastDatePrinter.(FastDatePrinter.java:142) > at > org.apache.commons.lang3.time.FastDateFormat.(FastDateFormat.java:384) > at > org.apache.commons.lang3.time.FastDateFormat.(FastDateFormat.java:369) > at > org.apache.commons.lang3.time.FastDateFormat$1.createInstance(FastDateFormat.java:91) > at > org.apache.commons.lang3.time.FastDateFormat$1.createInstance(FastDateFormat.java:88) > at org.apache.commons.lang3.time.FormatCache.getInstance(FormatCache.java:82) -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (OOZIE-3071) Oozie 4.3 Spark sharelib ueses a different version of commons-lang3 than Spark 2.2.0
Ran Gu created OOZIE-3071: - Summary: Oozie 4.3 Spark sharelib ueses a different version of commons-lang3 than Spark 2.2.0 Key: OOZIE-3071 URL: https://issues.apache.org/jira/browse/OOZIE-3071 Project: Oozie Issue Type: Bug Components: core Affects Versions: 4.3.0 Reporter: Ran Gu Currently Oozie 4.3.0 uses commons-lang3 version 3.3.2 in Spark sharelib. Spark 2.2.0 uses commons-lang3 version 3.5. This causes Oozie(/Spark) job failures on EMR-5.8.0 clusters. Error message: 17/08/22 00:22:43 ERROR ApplicationMaster: User class threw exception: java.lang.IllegalArgumentException: Illegal pattern component: XXX java.lang.IllegalArgumentException: Illegal pattern component: XXX at org.apache.commons.lang3.time.FastDatePrinter.parsePattern(FastDatePrinter.java:282) at org.apache.commons.lang3.time.FastDatePrinter.init(FastDatePrinter.java:149) at org.apache.commons.lang3.time.FastDatePrinter.(FastDatePrinter.java:142) at org.apache.commons.lang3.time.FastDateFormat.(FastDateFormat.java:384) at org.apache.commons.lang3.time.FastDateFormat.(FastDateFormat.java:369) at org.apache.commons.lang3.time.FastDateFormat$1.createInstance(FastDateFormat.java:91) at org.apache.commons.lang3.time.FastDateFormat$1.createInstance(FastDateFormat.java:88) at org.apache.commons.lang3.time.FormatCache.getInstance(FormatCache.java:82) -- This message was sent by Atlassian JIRA (v6.4.14#64029)
