Re: tez 0.7.0 + CDH Hive 1.1 (CDH5.4.1)

2015-10-19 Thread Edward Capriolo
Great. I am actually using clourdera 4.2.something so I will try to build my own version and not whatever differences. This might make a good git repo (cloudera-reality-hacks) :) On Sun, Oct 18, 2015 at 9:55 AM, Aaron Wiebe wrote: > As requested - I believe I've captured all of the required step

Re: tez 0.7.0 + CDH Hive 1.1 (CDH5.4.1)

2015-10-18 Thread Aaron Wiebe
As requested - I believe I've captured all of the required steps to get this working: https://gist.github.com/epiphani/dd37e87acfb2f8c4cbb0 -Aaron On Thu, Oct 15, 2015 at 5:56 PM, Edward Capriolo wrote: > Dude if you can write up your steps to do this it would be awesome! > > On Thu, Oct 15, 20

Re: tez 0.7.0 + CDH Hive 1.1 (CDH5.4.1)

2015-10-15 Thread Edward Capriolo
Dude if you can write up your steps to do this it would be awesome! On Thu, Oct 15, 2015 at 5:49 PM, Aaron Wiebe wrote: > Ok, so it was not TEZ-2563 after all. > > While I was trying to fix the cloudera dependancy issue, I'd added the > classpath manually. I took the depending jar and threw it

Re: tez 0.7.0 + CDH Hive 1.1 (CDH5.4.1)

2015-10-15 Thread Aaron Wiebe
Ok, so it was not TEZ-2563 after all. While I was trying to fix the cloudera dependancy issue, I'd added the classpath manually. I took the depending jar and threw it into /apps/tez-0.7.0 along with everything else, removed that classpath reference, and things are working. Thanks Gopal, I wouldn

Re: tez 0.7.0 + CDH Hive 1.1 (CDH5.4.1)

2015-10-15 Thread Aaron Wiebe
Ok, I may be hitting TEZ-2563. Since I'm added the cloudera jar via tez.cluster.additional.classpath.prefix, the launcher has -classpath to that jar - and nothing else. If I remove that section of the commandline, the container executes. Relevant sections of launch_container.sh: ... export CLA

Re: tez 0.7.0 + CDH Hive 1.1 (CDH5.4.1)

2015-10-15 Thread Gopal Vijayaraghavan
>I'm convinced this is a hive issue, but I'm sending it here because >you folks might have a good idea on what the issue is. It appears >that the tez package from hdfs is not being localized when children >are spun up. The AM does work. I think the AM working + tasks not working needs you to g

tez 0.7.0 + CDH Hive 1.1 (CDH5.4.1)

2015-10-15 Thread Aaron Wiebe
Apologies off the line for this one. This is an annoying one. I'm trying to hack tez into Cloudera's fairly gimped version of hive. Upgrading Hive to 1.2 would fix the problem (I know, I'm running it off to the side), but that would mean metadata changes that would make reverting quite difficult.