When use HiveServer2 to execute "write Sql result to LOCAL DIRECTORY " ,it write result to HiveServer2 Host rather than the Hive Client which connects HiveServer2

Unlike Hive CLI , When I connected to HiveServer2 and then execute " insert overwrite LOCAL DIRECTORY "/data/wangmeng/hiveserver2" select * from textfileorders limit 10" . This query will write results to HiveServer2 Host rather than My Hive Client Host. Is there any way can

Re: Is YSmart integrated into Hive on tez ?

Hi Jeff, From code base point of view, YSmart is integrated into Hive on Tez because it is one of the optimization of the current Hive. However, from the execution point of view, it is now disabled when Hive is running on Tez. You may take look at the source code of Hive Optimizer.java,

Serializing dags

Hello, Currently, I am running Hive on Tez. I wish to make some changes to the DAGs generated by HIve before running on Tez/Yarn. Which data structure should i serialize ? DAG or DagPlan ? - Raajay

Re: Hive on Spark

What you described isn't part of the functionality of Hive on Spark. Rather, Spark is used here as a general purpose engine similar to MR but without intemediate stages. It's batch origientated. Keeping 100T data in memory is hardly beneficial unless you know that that dataset is going to be used

Is it possible to set the data schema on a per-partition basis?

I have external hcat structures over lzo-compressed datafiles , data is partitioned by date string Is it possible to handle schema changes by setting diffrent schema(column names & datatypes) per-partition? Thanks, Dominik.

Re: Is it possible to set the data schema on a per-partition basis?

Yes. Specifically the avro ser-de like avro support "evolving schema". On Mon, Aug 31, 2015 at 5:15 PM, Dominik Choma wrote: > I have external hcat structures over lzo-compressed datafiles , data is > partitioned by date string > Is it possible to handle schema changes

Hive User Group Meeting Singapore

Dear Hive users, Hive community is considering a user group meeting during Hadoop World that will be held in Singarpore [1] Dec 1-3, 2015. As I understand, this will be the first time that this meeting ever happens in Asia Pacific even though there is a large user base in that region. As another

Re: Is it possible to set the data schema on a per-partition basis?

thanks for reply Im assuming I can't use avro without reprocess all my stored data(delimited,lzo-compressed text), Am I right ? So I'm wonder if I can use statement *ALTER TABLE xxx PARTITION (**) CHANGE COLUMN (...)* to create diffrent HCatalog schema for parttions based on datafiles with

Re: Reading tables will lock entire database in Hive 0.13

Hi Team, This issue only happens on hive 0.13, not in Hive 0.12. Does anybody know what is the change between 0.12 and 0.13 which caused this issue? Thanks. On Sat, Feb 28, 2015 at 3:47 AM, Chaoyu Tang wrote: > It was fixed for DummyTxnManager. DbTxnManager should not have

Re: Reading tables will lock entire database in Hive 0.13

I found the answer…hive.txn.manager is added starting in hive 0.13. Thanks all. On Mon, Aug 31, 2015 at 3:54 PM, Jim Green wrote: > Hi Team, > > This issue only happens on hive 0.13, not in Hive 0.12. > Does anybody know what is the change between 0.12 and 0.13 which

RE: python libraries to execute or call hive queries

Hi Gopal Have you tried pyhs2 libraryIt has many useful functions to retrieve the data thanksrakesh > Date: Fri, 28 Aug 2015 11:53:20 -0700 > Subject: Re: python libraries to execute or call hive queries > From: gop...@apache.org > To: user@hive.apache.org > > > > Can anyone suggest any python

Re: Serializing dags

Hi Raajay, Regarding how hive build DAG, you can check https://github.com/apache/hive/blob/72f97fc7760134465333983fc40766e9e864e643/ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezTask.java Check method TezTask#build Do you mind share what kind of changes you want to make on DAGs ? On Tue,