[ https://issues.apache.org/jira/browse/OOZIE-2780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16008449#comment-16008449 ]
Artem Ervits commented on OOZIE-2780: ------------------------------------- [~pbacsko] thanks for catching this. I looked at it briefly, specifically testNewUsingACLs(org.apache.oozie.util.TestZKUtilsWithSecurity): org/apache/commons/io/Charsets is due to commons-io version. Both hadoop-2.4 and hadoop 2.6 ship with v. 2.4 and Oozie ships with commons-io 2.1. I was able to reproduce the tests and if I change commons-io to 2.4 tests pass. {noformat} mvn clean -Dtest=org.apache.oozie.util.TestZKUtilsWithSecurity#testNewUsingACLs test -Dhadoop.version=2.4.0 ------------------------------------------------------- T E S T S ------------------------------------------------------- Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m; support was removed in 8.0 Concurrency config is parallel='classes', perCoreThreadCount=false, threadCount=1, useUnlimitedThreads=false objc[37421]: Class JavaLaunchHelper is implemented in both /Library/Java/JavaVirtualMachines/jdk1.8.0_51.jdk/Contents/Home/jre/bin/java (0x10f9dd4c0) and /Library/Java/JavaVirtualMachines/jdk1.8.0_51.jdk/Contents/Home/jre/lib/libinstrument.dylib (0x118ef04e0). One of the two will be used. Which one is undefined. Running org.apache.oozie.util.TestZKUtilsWithSecurity Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 48.103 sec Results : Tests run: 1, Failures: 0, Errors: 0, Skipped: 0 [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Oozie Main .................................. SUCCESS [ 0.561 s] [INFO] Apache Oozie Hadoop Utils hadoop-2-4.4.0-SNAPSHOT .. SUCCESS [ 1.790 s] [INFO] Apache Oozie Hadoop Distcp hadoop-2-4.4.0-SNAPSHOT . SUCCESS [ 0.074 s] [INFO] Apache Oozie Hadoop Auth hadoop-2-4.4.0-SNAPSHOT Test SUCCESS [ 0.141 s] [INFO] Apache Oozie Hadoop Libs ........................... SUCCESS [ 0.018 s] [INFO] Apache Oozie Client ................................ SUCCESS [ 2.707 s] [INFO] Apache Oozie Share Lib Oozie ....................... SUCCESS [ 2.717 s] [INFO] Apache Oozie Share Lib HCatalog .................... SUCCESS [ 2.200 s] [INFO] Apache Oozie Share Lib Distcp ...................... SUCCESS [ 0.731 s] [INFO] Apache Oozie Core .................................. SUCCESS [ 21.682 s] [INFO] Apache Oozie Share Lib Streaming ................... SUCCESS [ 4.871 s] [INFO] Apache Oozie Share Lib Pig ......................... SUCCESS [ 3.887 s] [INFO] Apache Oozie Share Lib Hive ........................ SUCCESS [ 3.992 s] [INFO] Apache Oozie Share Lib Hive 2 ...................... SUCCESS [ 3.684 s] [INFO] Apache Oozie Share Lib Sqoop ....................... SUCCESS [ 2.624 s] [INFO] Apache Oozie Examples .............................. SUCCESS [ 8.485 s] [INFO] Apache Oozie Share Lib Spark ....................... SUCCESS [ 27.002 s] [INFO] Apache Oozie Share Lib ............................. SUCCESS [ 0.017 s] [INFO] Apache Oozie Docs .................................. SUCCESS [ 0.342 s] [INFO] Apache Oozie WebApp ................................ SUCCESS [ 1.809 s] [INFO] Apache Oozie Tools ................................. SUCCESS [ 3.444 s] [INFO] Apache Oozie MiniOozie ............................. SUCCESS [ 1.463 s] [INFO] Apache Oozie Server ................................ SUCCESS [ 4.529 s] [INFO] Apache Oozie Distro ................................ SUCCESS [ 1.836 s] [INFO] Apache Oozie ZooKeeper Security Tests .............. SUCCESS [ 52.087 s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD SUCCESS [INFO] ------------------------------------------------------------------------ [INFO] Total time: 02:33 min [INFO] Finished at: 2017-05-12T13:25:00-04:00 [INFO] Final Memory: 77M/403M {noformat} now changing commons-io to 2.4 {noformat} mvn clean -Dtest=org.apache.oozie.util.TestZKUtilsWithSecurity#testNewUsingACLs test -Dhadoop.version=2.6.0 ------------------------------------------------------- T E S T S ------------------------------------------------------- Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=512m; support was removed in 8.0 Concurrency config is parallel='classes', perCoreThreadCount=false, threadCount=1, useUnlimitedThreads=false objc[37788]: Class JavaLaunchHelper is implemented in both /Library/Java/JavaVirtualMachines/jdk1.8.0_51.jdk/Contents/Home/jre/bin/java (0x1007094c0) and /Library/Java/JavaVirtualMachines/jdk1.8.0_51.jdk/Contents/Home/jre/lib/libinstrument.dylib (0x109dd54e0). One of the two will be used. Which one is undefined. Running org.apache.oozie.util.TestZKUtilsWithSecurity Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 53.012 sec Results : Tests run: 1, Failures: 0, Errors: 0, Skipped: 0 [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Oozie Main .................................. SUCCESS [ 0.571 s] [INFO] Apache Oozie Hadoop Utils hadoop-2-4.4.0-SNAPSHOT .. SUCCESS [ 1.916 s] [INFO] Apache Oozie Hadoop Distcp hadoop-2-4.4.0-SNAPSHOT . SUCCESS [ 0.072 s] [INFO] Apache Oozie Hadoop Auth hadoop-2-4.4.0-SNAPSHOT Test SUCCESS [ 0.297 s] [INFO] Apache Oozie Hadoop Libs ........................... SUCCESS [ 0.016 s] [INFO] Apache Oozie Client ................................ SUCCESS [ 2.874 s] [INFO] Apache Oozie Share Lib Oozie ....................... SUCCESS [ 2.831 s] [INFO] Apache Oozie Share Lib HCatalog .................... SUCCESS [ 2.036 s] [INFO] Apache Oozie Share Lib Distcp ...................... SUCCESS [ 0.605 s] [INFO] Apache Oozie Core .................................. SUCCESS [ 22.656 s] [INFO] Apache Oozie Share Lib Streaming ................... SUCCESS [ 5.421 s] [INFO] Apache Oozie Share Lib Pig ......................... SUCCESS [ 3.797 s] [INFO] Apache Oozie Share Lib Hive ........................ SUCCESS [ 4.016 s] [INFO] Apache Oozie Share Lib Hive 2 ...................... SUCCESS [ 4.117 s] [INFO] Apache Oozie Share Lib Sqoop ....................... SUCCESS [ 4.525 s] [INFO] Apache Oozie Examples .............................. SUCCESS [ 12.379 s] [INFO] Apache Oozie Share Lib Spark ....................... SUCCESS [01:08 min] [INFO] Apache Oozie Share Lib ............................. SUCCESS [ 0.013 s] [INFO] Apache Oozie Docs .................................. SUCCESS [ 1.005 s] [INFO] Apache Oozie WebApp ................................ SUCCESS [ 20.973 s] [INFO] Apache Oozie Tools ................................. SUCCESS [ 9.835 s] [INFO] Apache Oozie MiniOozie ............................. SUCCESS [ 6.192 s] [INFO] Apache Oozie Server ................................ SUCCESS [ 11.923 s] [INFO] Apache Oozie Distro ................................ SUCCESS [ 1.344 s] [INFO] Apache Oozie ZooKeeper Security Tests .............. SUCCESS [ 57.580 s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD SUCCESS [INFO] ------------------------------------------------------------------------ [INFO] Total time: 04:06 min [INFO] Finished at: 2017-05-12T13:34:59-04:00 [INFO] Final Memory: 279M/451M [INFO] ------------------------------------------------------------------------ {noformat} Can we track that in a separate jira? > Upgrade minimum Hadoop version to 2.6.0 > --------------------------------------- > > Key: OOZIE-2780 > URL: https://issues.apache.org/jira/browse/OOZIE-2780 > Project: Oozie > Issue Type: Improvement > Components: core > Affects Versions: 4.3.0 > Reporter: Artem Ervits > Assignee: Artem Ervits > Priority: Minor > Labels: newbie > Fix For: 5.0.0 > > Attachments: OOZIE-2780-0.patch, OOZIE-2780-1.patch, > OOZIE-2780-2.patch > > > I'd like to contribute an fs action enhancement to modify extended attributes > to core but methods to change extended attributes is not available in > hadoop-common < 2.6.0. Currently hadoop-common is at 2.4. I am contributing a > patch to bump to 2.6 but so far I haven't been able to generate a clean test > as tests in core module fail randomly. On the first run, I had a failure on > {code} Failed tests: > testCheckAfterActionDelete(org.apache.oozie.service.TestHAPartitionDependencyManagerService): > Expected: <null> but was: [0000000-170123095541655-oozie-aerv-C@1]{code} > and on second run > {code}Failed tests: testWaitFor(org.apache.oozie.test.TestXTestCase): > expected:<1000.0> but was:<2036.0>{code} > I can't tell whether it is due to my patch? -- This message was sent by Atlassian JIRA (v6.3.15#6346)