AppId is missing in the latest hive version (3.1.2)

Hi Folks, I just found that the yarn appId is missing in the beeline log when using hive version (3.1.2) This is very inconvenience for problem shooting. what is the consideration to remove that ? Could you add that back to the beeline log ? -- Best Regards Jeff Zhang

no mr-job execution info in beeline

.logging.operation.level VERBOSE I only see the following log in beeline WARNING: Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions. Consider using a different execution engine (i.e. spark, tez) or using Hive 1.X releases. -- Best Regards Jeff Zhang

Does hive metastore service support proxy user access ?

7) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) -- Best Regards Jeff Zhang

Re: [ANNOUNCE] New Hive Committer - Wei Zheng

gt; >>>> Cc: "d...@hive.apache.org<mailto:d...@hive.apache.org>" < >>>> d...@hive.apache.org<mailto:d...@hive.apache.org>>, "w...@apache.org >>>> <mailto:w...@apache.org>" mailto:w...@apache.org>> >>>> Subject: Re: [ANNOUNCE] New Hive Committer - Wei Zheng >>>> >>>> Congratulations Wei! >>>> >>>> On Wed, Mar 9, 2016 at 5:26 PM, Vikram Dixit K >>> <mailto:vik...@apache.org>> wrote: >>>> The Apache Hive PMC has voted to make Wei Zheng a committer on the >>>> Apache Hive Project. Please join me in congratulating Wei. >>>> >>>> Thanks >>>> Vikram. >>>> >>>> >>>> >>> >> > -- Best Regards Jeff Zhang

Fwd: Wrong column is picked in HIVE 2.0.0 + TEZ 0.8.2 left join

! Chi -- Best Regards Jeff Zhang

Re: Getting dot files for DAGs

Hi James, It is under the working directory of the yarn container (should be the first container which is AM) Best Regard, Jeff Zhang From: James Pirz mailto:james.p...@gmail.com>> Reply-To: "u...@tez.apache.org<mailto:u...@tez.apache.org>" mailto:u...@tez.apach

Bucketing is not leveraged in filter push down ?

ssing file hdfs:// 0.0.0.0:9000/user/hive/warehouse/student_bucketed_2/age=26/05_0 -- Best Regards Jeff Zhang

Re: Hive Compile mode

on TEZ later. > > Thanks > Raajay > -- Best Regards Jeff Zhang

Re: Getting error while performing Insert query

What is your hive sql ? And please check the hive.log which may have more info. (By default hive.log is located in /tmp/${user}/hive.log ) Best Regard, Jeff Zhang From: Sateesh Karuturi mailto:sateesh.karutu...@gmail.com>> Reply-To: "u...@tez.apache.org<mailto:u...@

Re: Is YSmart integrated into Hive on tez ?

+ dev mail list The original correlation optimization might be designed for mr engine. But similar optimization could be applied for tez too. Is there any existing jira to track that ? On Tue, Sep 1, 2015 at 1:58 PM, Jeff Zhang wrote: > Hi Pengcheng, > > Is there reason why the co

Re: Is YSmart integrated into Hive on tez ?

t; > !HiveConf.getBoolVar(hiveConf, HiveConf.ConfVars.HIVEGROUPBYSKEW) > && > > !HiveConf.getBoolVar(hiveConf, HiveConf.ConfVars. > HIVE_OPTIMIZE_SKEWJOIN_COMPILETIME) && > > !isTezExecEngine) { > > transformations.add(new CorrelationOptimizer()); &g

Re: Hive on tez error

Please refer this wiki page https://cwiki.apache.org/confluence/display/TEZ/How+to+Diagnose+Tez+App Best Regard, Jeff Zhang From: Sateesh Karuturi mailto:sateesh.karutu...@gmail.com>> Reply-To: "u...@tez.apache.org<mailto:u...@tez.apache.org>" mailto:u...@tez.apa

Re: tez error

+ hive mail list Might be a hive bug. Best Regard, Jeff Zhang From: "hanked...@emar.com<mailto:hanked...@emar.com>" mailto:hanked...@emar.com>> Reply-To: user mailto:u...@tez.apache.org>> Date: Thursday, August 27, 2015 at 5:51 PM To: user mailto:u...@tez.apache.o

Re: execution error, return code 1 from org.apache.hadoop.hive.ql.exec.tez.teztask error on hive on tez

Please check the hive log for more useful info which is located in /tmp/${user}/hive.log by default. Best Regard, Jeff Zhang From: Sateesh Karuturi mailto:sateesh.karutu...@gmail.com>> Reply-To: "u...@tez.apache.org<mailto:u...@tez.apache.org>" mailto:u...@tez.apache

Re: multiple users for hive access

in my command line. > > > > Now, that is say I have two users: A and B. I would like A and B access > hive tables using hive-cli. > > > > How can I do that? > > > > > > *From:* Jeff Zhang [mailto:zjf...@gmail.com] > *Sent:* Tuesday, 7 July 2015 4:22 PM >

Re: multiple users for hive access

any tutorial or link I can study from? > > > > Best regards, > > Jack > > > -- Best Regards Jeff Zhang

Re: Hive With tez

> I understand this is a very vast topic and cannot be described, however > some quick pointers will be helpful. > > I am currently working on: > Query vectorization and COB with ORC tables. > > Thanks, > Saurabh > -- Best Regards Jeff Zhang

Re: hive -e run tez query error

> > But keeping that client cache disabled when running against trunk > generally kills queries all the time with occasional errors like these. > > Cheers, > Gopal > > > -- Best Regards Jeff Zhang

Is it expected behavior ?

version 2.0.0-SNAPSHOT by Apache Hive beeline> -- Best Regards Jeff Zhang

Re: hive -e run tez query error

82593_252390_2_00 [Map 1] killed/failed due to:null] > DAG failed due to vertex failure. failedVertices:1 killedVertices:0 > FAILED: Execution Error, return code 2 from > org.apache.hadoop.hive.ql.exec.tez.TezTask > > *use hivecli to execute same query ,no exception throw.* > *use hive -e to execute same query on mr ,no exeception throw * > > > > -- > r7raul1...@163.com > > -- Best Regards Jeff Zhang

Re: Hive - Tez error with big join - Container expired.

Tez will hold the idle containers for a while, but it would also expire the container if it reach some threshold. Have you set property tez.am.container.idle.release-timeout-max.millis in tez-site.xml ? And can you attach the yarn app log ? Best Regard, Jeff Zhang From: Daniel Klinger

Re: error on hive insert query

You can refer to the following link to figure out whether this is tez problem https://cwiki.apache.org/confluence/display/TEZ/How+to+Diagnose+Tez+App Best Regard, Jeff Zhang From: Sateesh Karuturi mailto:sateesh.karutu...@gmail.com>> Reply-To: "u...@tez.apache.org<mailto:u...@

Re: hive tez error

Sorry, to make it more clear. The applicationId is the placeholder of your applicationId of your hive session. You can look for it in the RM web UI Best Regard, Jeff Zhang From: Sateesh Karuturi mailto:sateesh.karutu...@gmail.com>> Reply-To: "user@hive.apache.org<mailto:user@h

Re: hive tez error

Could you check the yarn app logs ? By invoking command : "yarn logs -applicationId" Best Regard, Jeff Zhang From: Sateesh Karuturi mailto:sateesh.karutu...@gmail.com>> Reply-To: "user@hive.apache.org<mailto:user@hive.apache.org>" mailto:user@hive.apache.org

Re: drop table command hang

/validating class(es) : Specified key was too long; max key length is 767 bytes On Sat, Mar 14, 2015 at 1:44 PM, Jeff Zhang wrote: > It doesn't matter whether I truncate the table, it always hangs there. > Very werid. > > > > On Wed, Mar 11, 2015 at 3:06 PM, Mich Talebzadeh

Re: drop table command hang

so stated. It is the > responsibility of the recipient to ensure that this email is virus free, > therefore neither Peridale Ltd, its subsidiaries nor their employees accept > any responsibility. > > > > *From:* Jeff Zhang [mailto:zjf...@gmail.com] > *Sent:* 11 March 2015 06:56 >

Re: when start hive could not generate log file

By default, hive.log is located in /tmp/${user}/hive.log Best Regard, Jeff Zhang From: zhangjp mailto:smart...@hotmail.com>> Reply-To: "user@hive.apache.org<mailto:user@hive.apache.org>" mailto:user@hive.apache.org>> Date: Wednesday, March 11, 2015 at 7:12

drop table command hang

ed_s1 2015-03-11 14:48:09,474 INFO [main]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(368)) - ugi=jzhang ip=unknown-ip-addr cmd=drop_table : db=default tbl=student_bucketed_s1 -- Best Regards Jeff Zhang

Any tutorial document about how to use the example data

Hi, I notice there's one folder example which contains sample data and sample queries. But I didn't find any document about how to use these data and queries. Could anyone point it to me ? Thanks

Where does hive do sampling in order by ?

Order by usually invoke 2 steps (sampling job and repartition job) but hive only run one mr job for order by, so wondering when and where does hive do sampling ? client side ? -- Best Regards Jeff Zhang

Re: Hive CLI question

anyone know how to issue a clear screen at the "hive>" prompt? >>> Is this even possible? I am looking for something similar to "system >>> clear" in MySQL. >>> >>> Thank you, Louis. >>> >> >> > -- Best Regards Jeff Zhang

Re: What's official site for howl ?

gt; > > On May 4, 2011, at 7:04 PM, Jeff Zhang wrote: > > >> Hi all, >> >> Sorry for bothering this mail list. But I only this mail list may relate >> with howl. Just wonder what's official site or mail list for howl. I'd like >> to g

What's official site for howl ?

Hi all, Sorry for bothering this mail list. But I only this mail list may relate with howl. Just wonder what's official site or mail list for howl. I'd like to get more information about howl -- Best Regards Jeff Zhang

Find a case that does not make sense in hive

retrieve data in the first case, it should not allow me to import data without specify partition -- Best Regards Jeff Zhang

Re: Does hive have batch processing mode ?

Thanks, it works On Thu, Nov 25, 2010 at 3:49 PM, james warren wrote: > Try the following: > % hive -f myhive.file > > cheers, > -James > On Wed, Nov 24, 2010 at 11:37 PM, Jeff Zhang wrote: >> >> Hi all, >> >> I have a bunch of files, and want to im

Does hive have batch processing mode ?

command. Thanks in advance. -- Best Regards Jeff Zhang

Re: How to generate global unique ID?

t; When I insert data into the table results, i want to generate a unqiue Id, > which is like a sequence in RDBMS. > Regards, > afancy -- Best Regards Jeff Zhang

Re: Can i use hive for real time query?

n is strictly prohibited. If you > have received this e-mail in error, please notify us immediately by return > e-mail and delete this e-mail and all attachments from your system. > > -- Best Regards Jeff Zhang