Posted documentation on my blog. Happy reading. Comments welcome.

https://blog.upala.com/2017/03/04/setting-up-tez-on-cdh-cluster/

On Sat, Mar 4, 2017 at 6:38 AM, Edward Capriolo <edlinuxg...@gmail.com>
wrote:

> Lets continuously open tickets with cloudera to do this simple patching
> for us and ensure things work out of the box.
>
> On Sat, Mar 4, 2017 at 12:22 AM, Manoj Murumkar <manoj.murum...@gmail.com>
> wrote:
>
>> I'll put in my blog next week and share the link.
>> ------------------------------
>> From: Bikas Saha <bi...@apache.org>
>> Sent: ‎3/‎3/‎2017 7:08 PM
>> To: user@tez.apache.org
>> Subject: RE: Enabling Tez-UI on CDH 5.8
>>
>> That’s great!
>>
>>
>>
>> Would it be possible for you to publish this as a wiki article such that
>> others could follow that to make this scenario work for them? With some
>> more details (e.g. exact maven command line or modified pom.xml) that
>> others can follow verbatim.
>>
>>
>>
>> Thanks
>>
>> Bikas
>>
>>
>>
>> *From:* Manoj Murumkar [mailto:manoj.murum...@gmail.com]
>> *Sent:* Friday, March 3, 2017 2:02 PM
>> *To:* user@tez.apache.org
>> *Subject:* Re: Enabling Tez-UI on CDH 5.8
>>
>>
>>
>> UPDATE: Tez UI (using 1.0 storage mechanism) has been successfully
>> enabled on our CDH 5.8.3 cluster. Here's the summary:
>>
>>    - Build Tez against CDH repo (5.8.3 version)
>>    - Build against 1.9.13 versions of jackson jars, listed in the
>>    following:
>>
>>
>>    - jackson-mapper-asl
>>       - jackson-core-asl
>>       - jackson-jaxrs
>>       - jackson-xc
>>
>>
>>    - Set a separate timeline server using Apache 2.7.3 version of cluster
>>    - Setup Tez UI using apache webserver
>>    - Follow instructions on how to setup each of these components (ATS,
>>    CDH cluster to publish events to ATS, CORS etc)
>>
>> Cheers,
>>
>> Manoj
>>
>>
>>
>> On Fri, Feb 24, 2017 at 11:15 AM, Manoj Murumkar <
>> manoj.murum...@gmail.com> wrote:
>>
>> Also, please note that I am using ATS with apache 2.7.3 version.
>>
>> Jan,
>>
>> I looked at the post you had made earlier.
>>
>> we are using Tez 0.8.4 successfully both with Hive and Pig on our
>>
>> > Cloudera CDH 5.7.1 cluster.
>>
>> CDH comes with Pig 0.12 which doesn't have tez as a supported engine. How 
>> did you manage to get that working?
>>
>>
>>
>> On Fri, Feb 24, 2017 at 10:50 AM, Manoj Murumkar <
>> manoj.murum...@gmail.com> wrote:
>>
>> So, I am able to get the metric posting part working (part where tez
>> posts counters to backend). I can see data coming in and without any java
>> exceptions in the run logs of tez sessions. I essentially built tez with
>> 1.9.13 version of jackson libraries.
>>
>>  <dependency>
>>         <groupId>org.codehaus.jackson</groupId>
>>         <artifactId>jackson-mapper-asl</artifactId>
>>         <version>1.9.13</version>
>>       </dependency>
>>       <dependency>
>>         <groupId>org.codehaus.jackson</groupId>
>>         <artifactId>jackson-core-asl</artifactId>
>>         <version>1.9.13</version>
>>       </dependency>
>>       <dependency>
>>         <groupId>org.codehaus.jackson</groupId>
>>         <artifactId>jackson-jaxrs</artifactId>
>>         <version>1.9.13</version>
>>       </dependency>
>>       <dependency>
>>         <groupId>org.codehaus.jackson</groupId>
>>         <artifactId>jackson-xc</artifactId>
>>         <version>1.9.13</version>
>>
>> Now, when I check the timeline server webUI, I see nulls in pretty much
>> everything (see screenshot). Could this be another version incompatibility
>> issue?
>>
>> Thanks,
>>
>> Manoj
>>
>>
>>
>> On Fri, Feb 24, 2017 at 9:43 AM, Edward Capriolo <edlinuxg...@gmail.com>
>> wrote:
>>
>> We should really just force tez into the build of hive. It sooo fin
>> stupid this situation. Just drives people at impala / spark. Im brining it
>> up in hive.
>>
>>
>>
>> On Friday, February 24, 2017, Jan Morlock <jan.morl...@googlemail.com>
>> wrote:
>>
>> Hi Manoj,
>>
>> sorry for the late reply. Your problem appears to be similar to
>>
>>
>> https://issues.apache.org/jira/browse/HIVE-8271
>>
>> So please check whether you have both jackson-1.8 and jackson-1.9
>> somewhere in your classpath.
>>
>> That being said, you should know, that you can make a lot of friends if
>> you succeed in getting the Tez UI running on CDH.
>>
>> I also once tried but didn't pursue further. You can find my post here:
>>
>>
>> http://mail-archives.apache.org/mod_mbox/tez-user/201608.mbo
>> x/%3cCAO25eDBaHYcKaL+pBp2wR0TyXOcaMAsJU+YDvEmFVnYQer6ALg@
>> mail.gmail.com%3e
>>
>> I hope that helps.
>>
>>
>>
>> Cheers
>>
>> Jan
>>
>>
>>
>>
>>
>> 2017-02-17 0:02 GMT+01:00 Manoj Murumkar <manoj.murum...@gmail.com>:
>>
>> Also, hive version that's bundled with CDH5.8 is 1.1.0 which is also
>> bundled with same class. Perhaps that's the one in effect? If that's the
>> case, is there no way to use timeline server for history with this version?
>>
>>
>>
>> On Thu, Feb 16, 2017 at 2:53 PM, Manoj Murumkar <manoj.murum...@gmail.com>
>> wrote:
>>
>> Btw, here's the environment info:
>>
>> Tez: 0.8.4
>>
>> Timeline server: bundled with apache 2.6.5 version
>>
>> I have added following libraries (that are used by timeline server) in
>> the path, so there's no mis-match, but no luck. I am still getting same
>> error.
>>
>> HADOOP_CLASSPATH=/usr/local/tez/client/lib/old/jackson-core-
>> asl-1.9.13.jar:/usr/local/tez/client/lib/old/jackson-mapper-
>> asl-1.9.13.jar:....
>> HADOOP_USER_CLASSPATH_FIRST=true
>>
>>
>>
>>
>>
>> On Thu, Feb 16, 2017 at 12:02 PM, Manoj Murumkar <
>> manoj.murum...@gmail.com> wrote:
>>
>> Hi,
>>
>> Wondering if anyone has successfully enabled Tez-UI (by running ATS from
>> a separate apache installation) on CDH 5.8 cluster. Would appreciate any
>> information on this. We are have trouble with API incompatibility (error
>> pasted below):
>>
>>
>> 2017-02-16 19:40:13,874 [FATAL] [HistoryEventHandlingThread] 
>> |yarn.YarnUncaughtExceptionHandler|: Thread 
>> Thread[HistoryEventHandlingThread,5,main] threw an Error.  Shutting down 
>> now...
>>
>> java.lang.AbstractMethodError: 
>> org.codehaus.jackson.map.AnnotationIntrospector.findSerializer(Lorg/codehaus/jackson/map/introspect/Annotated;)Ljava/lang/Object;
>>
>>   at 
>> org.codehaus.jackson.map.ser.BasicSerializerFactory.findSerializerFromAnnotation(BasicSerializerFactory.java:362)
>>
>>   at 
>> org.codehaus.jackson.map.ser.BeanSerializerFactory.createSerializer(BeanSerializerFactory.java:252)
>>
>>   at 
>> org.codehaus.jackson.map.ser.StdSerializerProvider._createUntypedSerializer(StdSerializerProvider.java:782)
>>
>>   at 
>> org.codehaus.jackson.map.ser.StdSerializerProvider._createAndCacheUntypedSerializer(StdSerializerProvider.java:735)
>>
>>   at 
>> org.codehaus.jackson.map.ser.StdSerializerProvider.findValueSerializer(StdSerializerProvider.java:344)
>>
>>   at 
>> org.codehaus.jackson.map.ser.StdSerializerProvider.findTypedValueSerializer(StdSerializerProvider.java:420)
>>
>>   at 
>> org.codehaus.jackson.map.ser.StdSerializerProvider._serializeValue(StdSerializerProvider.java:601)
>>
>>   at 
>> org.codehaus.jackson.map.ser.StdSerializerProvider.serializeValue(StdSerializerProvider.java:256)
>>
>>   at org.codehaus.jackson.map.ObjectMapper.writeValue(ObjectMapper.java:1604)
>>
>>   at 
>> org.codehaus.jackson.jaxrs.JacksonJsonProvider.writeTo(JacksonJsonProvider.java:527)
>>
>>   at 
>> com.sun.jersey.api.client.RequestWriter.writeRequestEntity(RequestWriter.java:300)
>>
>>   at 
>> com.sun.jersey.client.urlconnection.URLConnectionClientHandler._invoke(URLConnectionClientHandler.java:204)
>>
>>   at 
>> com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:147)
>>
>>   at org.apache.had
>>
>>
>> [The entire original message is not included.]
>>
>
>

Reply via email to