Okay, so the cause is that httpcore and httpclient are brought in by hadoop-auth 2.3.0 but not by hadoop-auth 2.0.2-alpha. So if you compile without the hadoop-2 profile, the hadoop-2 hadooplib will be missing those two jars. Once we get OOZIE-1756 in (which has a patch available), it should fix this problem too :)
On Mon, Mar 24, 2014 at 3:50 PM, Robert Kanter <[email protected]> wrote: > I just finished trying with Hadoop 2.3.0 and everything worked fine, > including the pig, sqoop, hive, shell, mapreduce, and streaming examples. > I didn't have to copy any extra jars. > > However, it looks like the hadoop-2 hadooplib is missing httpcore and > httpclient jars when the hadoop-2 profile isn't activated. I'll look into > that and try to figure out why. > > > > > > > > > On Mon, Mar 24, 2014 at 1:59 PM, Robert Kanter <[email protected]>wrote: > >> For the hadoop-auth issue: Mona is right that if you use the profile it >> will be correct. That said, it's a trivial fix to make the correct version >> of the jar to always show up in the hadooplibs. I've created OOZIE-1756 to >> do that. >> >> I'll try out running Oozie against a non-secure Hadoop 2.3 cluster soon. >> >> >> On Mon, Mar 24, 2014 at 12:08 AM, Mohammad Islam <[email protected]>wrote: >> >>> I'm also getting very hard time to make it works with Hadoop 2.3. >>> >>> After copying the hadoop-auth-2.3, i have to copy couple of jars >>> something like http*.jar. >>> I was able to make Oozie running. But MR action example did not not >>> work. >>> >>> Can someone please try it with 2.3 in non-secured and of possibly >>> secured mode also? >>> >>> >>> >>> >>> >>> On Sunday, March 23, 2014 8:36 AM, Mona Chitnis <[email protected]> >>> wrote: >>> >>> Yes. Profile for Hadoop 2 should set same version for >>> Hadoop.auth.version in Pom. It is defaulting to 2.0 >>> >>> Sent from my Yahoo! phone >>> >>> >>> > On Mar 23, 2014, at 12:37 AM, "Mohammad Islam" <[email protected]> >>> wrote: >>> > >>> > I was trying to build and found one potential issue. >>> > I used default options in building using "bin/mkdistro.sh >>> -DskipTests". >>> > I found two hadooplibs directories were created. In 2.3.0 version, i >>> found hadoop-auth-2.0.2-alpha.jar file which is inconsistent with >>> hadoop-2.3.0. All other files are from 2.3.0. >>> > >>> > Exact location of jar file is at: >>> > >>> hadooplibs/target/oozie-4.0.1-hadooplibs/oozie-4.0.1/hadooplibs/hadooplib-2.3.0.oozie-4.0.1/hadoop-auth-2.0.2-alpha.jar >>> > >>> > >>> > Error in Oozie with 2.3.0 is: >>> > java.lang.NoClassDefFoundError: org/apache/hadoop/util/PlatformName >>> > at >>> org.apache.hadoop.security.UserGroupInformation.getOSLoginModuleName(UserGroupInformation.java:337) >>> > at >>> org.apache.hadoop.security.UserGroupInformation.<clinit>(UserGroupInformation.java:382) >>> > at >>> org.apache.oozie.service.HadoopAccessorService.init(HadoopAccessorService.java:132) >>> > >>> > Is it something in pom file? >>> > >>> > Regards, >>> > Mohammad >>> > >>> > >>> > >>> > On Friday, March 21, 2014 4:21 PM, Robert Kanter <[email protected]> >>> wrote: >>> > >>> > Hi, >>> > I have created a build for Oozie 4.0.1, candidate 0. >>> > Oozie 4.0.1 updates the "hadoop-2" profile to use Hadoop 2.3.0 and >>> includes >>> > some misc bug fixes and improvements. You can refer to the >>> release-log.txt >>> > for all the changes. >>> > >>> > Keys to verify the signature of the release artifact are available at >>> > http://www.apache.org/dist/oozie/KEYS >>> > Please download, test, and try it out: >>> > http://people.apache.org/~rkanter/oozie-4.0.1-rc0 >>> > The release, md5 signature, gpg signature, and rat report can allbe >>> found >>> > at the above address. >>> > Vote closes on Wednesday March 26, 2014 at 4pm PST. >>> > - Robert >>> >> >> >
