Hive with tez engine gets the error

Hive with tez engine can't run. errors: 0: jdbc:hive2://localhost:1/default> select * from people; Error: java.io.IOException: java.io.IOException: com.google.protobuf.ServiceException: java.lang.NoSuchFieldError: PARSER (state=,code=0) Apache Hive (version 2.3.9) Hadoop 3.3.1 Tez

Running commands on Hive on Tez failed with NPE

Hi Tez community, I recently encountered with a problem while running command in Hive on Tez. The command failed with below stack trace Exception in thread "main" java.lang.RuntimeException: java.lang.NullPointerException at org.apache.hadoop.hive.ql.session.SessionS

Re: hive 2.0.0 + tez

thanks as always Gopal. lemme use jdk8 for starters and eliminate that as a possibility. On Wed, Mar 9, 2016 at 10:30 AM, Gopal Vijayaraghavan wrote: > > > ok, thanks. very strange then that i can run hive 1.2.1 and hive 2.0.0 > >m/r jobs against the same hadoop cluster w/o

Re: hive 2.0.0 + tez

> ok, thanks. very strange then that i can run hive 1.2.1 and hive 2.0.0 >m/r jobs against the same hadoop cluster w/o issue > (different HS2, different MetaStore, but same hdfs data) but yet once i >switch to the HS2/2.0.0 tez chokes out - but works fine with the >HS2/1.2.1. It is not

Re: hive 2.0.0 + tez

t; why its not having any part of working under 2.0.0. > > anyway, i'm going to review the tez installation instructions now that i'm > testing hive 2.0.0 (and tez) and probably just start from scratch. > > I'll keep you all posted. > > Cheers, > stephen. > > >

Re: hive 2.0.0 + tez

HIVE_HOME was set to 1.2.1 i'm wondering... that's why its not having any part of working under 2.0.0. anyway, i'm going to review the tez installation instructions now that i'm testing hive 2.0.0 (and tez) and probably just start from scratch. I'll keep you all posted. Cheers, stephen. On Wed

hive 2.0.0 + tez

thinking this is because the tez jars on hdfs have been built (bound to) hive 1.2.1? ie. these jar files in hdfs tez.lib.uris ${fs.defaultFS}/apps/tez-0.8.2,${fs.defaultFS}/apps/tez-0.8.2/lib really should be identified as "tez-0.8.2-hive.1.2.1" and that i should have another

Re: Wrong column is picked in HIVE 2.0.0 + TEZ 0.8.2 left join

g's thinking if you were to set the exec engine to 'mr' >would it still fail? if so, then its not Tez . :) Hive has a a whole set of join algorithms which can only work on Tez, so it's not always that easy. Considering this is on hive-2.0.0, I recommend filing a JIRA on 2.0.0 and markin

RE: Wrong column is picked in HIVE 2.0.0 + TEZ 0.8.2 left join

, 0 confuse_you, 1 b_one, 0 b_zero ) b ON a.key = b.key WARN : Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases. INFO : WARNING: Hive-on-MR is deprecated

Re: Wrong column is picked in HIVE 2.0.0 + TEZ 0.8.2 left join

r we > upgraded to new version at 24th. > > > > > > Previously we’re using HIVE 1.2.0 + TEZ 0.7.0 > > > > > > Thanks! > > > > Chi > > > > *From:* Stephen Sprague [mailto:sprag...@gmail.com] > *Sent:* Tuesday, March 1, 2016 12:31 PM

Re: Wrong column is picked in HIVE 2.0.0 + TEZ 0.8.2 left join

very interesting. so this did work correctly on your previous distribution of these two products? May i ask what they were? On Mon, Feb 29, 2016 at 8:24 PM, GAO Chi <chi@microfun.com> wrote: > Hi all, > > > > We encountered a strange behavior after upgrading to HIV

Fwd: Wrong column is picked in HIVE 2.0.0 + TEZ 0.8.2 left join

+ hive mail list, more likely hive issue. -- Forwarded message -- From: GAO Chi <chi@microfun.com> Date: Tue, Mar 1, 2016 at 12:24 PM Subject: Wrong column is picked in HIVE 2.0.0 + TEZ 0.8.2 left join To: user@tez.apache.org Hi all, We encountered a strange be

Wrong column is picked in HIVE 2.0.0 + TEZ 0.8.2 left join

Hi all, We encountered a strange behavior after upgrading to HIVE 2.0.0 + TEZ 0.8.2. I simplified our query to this: SELECT a.key, a.a_one, b.b_one, a.a_zero, b.b_zero FROM ( SELECT 11 key, 0 confuse_you, 1 a_one, 0 a_zero ) a LEFT

hive on tez serialization and deserialization( custom Serde initialize() just called one time in hive client, when split in AM)

Hello,all:       【My environment versions are ：Hadoop 2.6.0 、hive 1.2.1、tez 0.7.0】 Our term develop a plug-in in hive, its function is similiar to hive-hbase-handler. Now I executed a HQL “select count(*) from h_im;”(h_im is an external table, hbase table) in hive CLI

RE: Hive on TEZ fails on buildSupportsSnappy()Z

h for the library path and try to debug from there about what went wrong. If everything is setup correctly then you should find it set to the location of the snappy native libs. Bikas From: Mich Talebzadeh [mailto:m...@peridale.co.uk] Sent: Thursday, January 7, 2016 1:02 AM To: user@tez.apach

Hive on TEZ fails on buildSupportsSnappy()Z

Have you seen this error by any chance please? 0: jdbc:hive2://rhes564:10010/default> set hive.execution.engine=tez; No rows affected (0.003 seconds) 0: jdbc:hive2://rhes564:10010/default> select count(1) from sales; INFO : Tez session hasn't been created yet. Opening session INFO :

RE: Hive on Tez with Java 8 JRE poor performance

Autio [mailto:juho.au...@rovio.com] Sent: Thursday, December 10, 2015 12:07 AM To: user@tez.apache.org Subject: Re: Hive on Tez with Java 8 JRE poor performance Tez version is 0.7.0. Installing it with the following AWS EMR step: s3://support.elasticmapreduce/tez/bigtop/install-tez-wit

Re: Hive on Tez with Java 8 JRE poor performance

s a pretty basic Hive script with tez engine enabled. With Java 8 it takes twice as long to run as with Java 7. My cluster has 40 m1.large nodes. What I haven't done is configure the tez container size in any way – maybe I would need to, especially for Java 8? I'm looking for kind of "best p

Hive on Tez with Java 8 JRE poor performance

Are people running Hive on Tez with Java 8? I tried that and the Hive job ran about twice as long as with Java 7. Java 8 has some changes in memory management, removal of MaxPermSize for example. Would someone have suggestions for tuning Tez to be run efficiently on Java 8?

Re: Hive on Tez with Java 8 JRE poor performance

Hi Juho, Which version of Java 8 are you using? Some have performance problems with Hadoop on top of issues with kerberos; you should be using a revision strictly greater than u45. Kind regards, JB

Re: Hive on Tez with Java 8 JRE poor performance

Hi, Could you tell us the version of Tez you have been using? - Tsuyoshi On Wed, Dec 9, 2015 at 7:12 AM, Rajesh Balamohan wrote: > Can you provide details on the kind of regression you are seeing with 1.8? > Is it regressing for a specific task or for overall job?. If

Re: Hive on Tez with Java 8 JRE poor performance

Can you provide details on the kind of regression you are seeing with 1.8? Is it regressing for a specific task or for overall job?. If possible, sharing the application logs with 1.7 and 1.8 would be helpful for understanding it better. ~Rajesh.B On Tue, Dec 8, 2015 at 2:34 PM, Jean-Baptiste

Re: Issue: Hive with Tez on CDH-5.4.2

Execution of demo orderedWordCount example got executed > successfully. But hive queries on Tez execution engine is throwing below > error. Any help is appreciated. Thanks!! > > ERROR LOGS: > > hive> set hive.execution.engine=tez; > hive&g

RE: Getting DAG Id from Hive on tez

Thanks Hitesh. I am able to filter out the particular dag, now the only problem is how to get the DAG name. I see from a previous mail on the list[1] that Tez uses Hive queryId + counter as the dag name. I have access to the hive query Id, but how do I know the name from it? Is there a way

Re: Getting DAG Id from Hive on tez

oblem is how to > get the DAG name. I see from a previous mail on the list[1] that Tez uses > Hive queryId + counter as the dag name. I have access to the hive query Id, > but how do I know the name from it? Is there a way to get the name/Id of the > DAG directly ? Just trying out counter

Getting DAG Id from Hive on tez

Hi, I am running Hive on Tez, with timeline server. We have a pre-hook in hive to maintain the statistics of what jobs ran by whom and how much resource it tool etc. that we had been using it with Hive-MR. Now I am trying to port this pre-hook to work with Hive on Tez. I plan to using

Re: Getting DAG Id from Hive on tez

t; I am running Hive on Tez, with timeline server. We have a pre-hook in hive to > maintain the statistics of what jobs ran by whom and how much resource it > tool etc. that we had been using it with Hive-MR. Now I am trying to port > this pre-hook to work with Hive on Tez. > > I

Hive on tez error

I am trying to connect hive database(execution.engine value changed to tez) using Java code... In case of select query its working But in the case of INSERT getting an error: The error looks like. Error while processing statement: FAILED: Execution Error, return code 1 from

when enable hdfs federation hive on tez throw IOException

I fire a jira for this issue. https://issues.apache.org/jira/browse/HIVE-11364

Hive on Tez query failed with “wrong key class

Hi Team, Env: Hive 1.0 on Tez 0.5.3 Query is a simple group-by on top of sequence table. It fails with below error on tez mode: *java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: * *java.io.IOException: java.io.IOException: wrong key class

Re: Hive on Tez query failed with “wrong key class

(HiveContextAwareRecordReader.java:358) ... 21 more ], On Tue, Jul 21, 2015 at 11:26 AM, Bikas Saha bi...@hortonworks.com wrote: A full stack trace would help determine is this is a Tez issue or hive issue. *From:* Jim Green [mailto:openkbi...@gmail.com] *Sent:* Tuesday, July 21

RE: Hive on Tez query failed with “wrong key class

A full stack trace would help determine is this is a Tez issue or hive issue. From: Jim Green [mailto:openkbi...@gmail.com] Sent: Tuesday, July 21, 2015 11:12 AM To: user@tez.apache.org; u...@hive.apache.org Subject: Hive on Tez query failed with “wrong key class Hi Team, Env: Hive 1.0 on Tez

Re: Hive on Tez query failed with ³wrong key class

Query is a simple group-by on top of sequence table. ... java.io.IOException: java.io.IOException: wrong key class: org.apache.hadoop.io.BytesWritable is not class org.apache.hadoop.io.NullWritable I have seen this issue when mixing Sequence files written by PIG with Sequence files written by

hive on tez strange issue

I currently use tez to speed hive exec time. To be clarify first, I am using apache hadoop 2.6.0 (configured with fair_scheduler), tez 0.7.0 built from github repo running on CentOS release 6.6 (Final) * 16. After running some days, a strange issue came up, yarn can accept newly-submitted

hive on tez

i have a small doubt towards tez installation which version of hive is required for apache tez 0.7.0?

Re: hive on tez

You can take the latest version of hive. Lot of steps have been automated in https://github.com/t3rmin4t0r/tez-autobuild ~Rajesh.B On Mon, Jun 22, 2015 at 11:35 AM, Sateesh Karuturi sateesh.karutu...@gmail.com wrote: i have a small doubt towards tez installation which version of hive is

hive on tez error

iam using hive 1.0.0 and tez 0.5.2.. whenever iam trying to open the hive getting following error: Exception in thread main java.lang.RuntimeException: java.io.IOException: Previous writer likely failed to write hdfs://localhost:9000/tmp/hive/hadoop/_tez_session_dir/002dad89-59b6-43c9-92f9

Re: hive on tez error

@tez.apache.org user@tez.apache.orgmailto:user@tez.apache.org Date: Wednesday, June 10, 2015 at 9:09 PM To: user@tez.apache.orgmailto:user@tez.apache.org user@tez.apache.orgmailto:user@tez.apache.org Subject: Re: hive on tez error hadoop_20150610170505_7dbb99e1-1d69-45f0-b1af-87452061bf39 is not yarn app

Re: hive on tez error

10, 2015 at 9:09 PM To: user@tez.apache.org user@tez.apache.org Subject: Re: hive on tez error hadoop_20150610170505_7dbb99e1-1d69-45f0-b1af-87452061bf39 is not yarn app log. It should be something like this format application_1433831838406_0002. Please try to look at the hive log

Re: Re: hive on tez error

-- r7raul1...@163.com *From:* Sateesh Karuturi sateesh.karutu...@gmail.com *Date:* 2015-06-10 17:10 *To:* user user@tez.apache.org *Subject:* Re: Re: hive on tez error configuration property nametez.lib.uris/name value${fs.defaultFS}/tez,${fs.defaultFS}/tez/lib/value /property

Re: Re: How to debug hanging hive on tez job

*To:* user user@tez.apache.org *Subject:* Re: How to debug hanging hive on tez job What is the value of mapreduce.reduce.cpu.vcores? -- r7raul1...@163.com *From:* Thomas Larsson thomas.lars...@klarna.com *Date:* 2015-06-03 16:45 *To:* user user@tez.apache.org

Re: Re: How to debug hanging hive on tez job

Maybe meet https://issues.apache.org/jira/browse/TEZ-704 r7raul1...@163.com From: r7raul1...@163.com Date: 2015-06-03 17:26 To: user Subject: Re: How to debug hanging hive on tez job What is the value of mapreduce.reduce.cpu.vcores? r7raul1...@163.com From: Thomas Larsson Date: 2015-06

How to debug hanging hive on tez job

Hello, I'm not sure if this question belongs to the hive or tez community so bear with me. I am running some hive queries on hive configured with tez in local mode as the execution engine. I am using hive version 0.14 and tez version 0.5.2 (HDP 2.2.4.2). When I run the hive query, the jobs run

回复: Re: hive on tez not convert map join to broadcast join

Thank you! I think this should be well doucumented. r7raul1...@163.com 发件人： Vikram Dixit 发送时间： 2015-05-13 09:38 收件人： user 主题： Re: 回复: Re: hive on tez not convert map join to broadcast join It does not have any effect in tez. From: r7raul1...@163.com r7raul1...@163.com Reply-To: user user

Re: is there way to set map and reducer number for hive on tez manually?

Hello again, Wrong list for this question. Please send your hive specific question to the hive-user list ( u...@hive.apache.org ). thanks — Hitesh On Jan 5, 2015, at 2:23 PM, SkaterXu xxqonl...@gmail.com wrote: is there way to set map and reducer number for hive on tez manually? i want

Re: hive atop tez 0.5.0

Prakash From: Siddharth Seth ss...@apache.org Reply-To: user@tez.apache.org Date: Monday, August 25, 2014 at 11:53 PM To: user@tez.apache.org, Grandl Robert rgra...@yahoo.com Subject: Re: Fw: hive atop tez 0.5.0 Grandl, The Tez branch on Hive should just work. You could change 0.5.0