Re: [ANNOUNCE] New Hive PMC Member - Xuefu Zhang

Congrats Xuefu! -- Lefty On Fri, Feb 28, 2014 at 2:52 PM, Eric Hanson (BIG DATA) < eric.n.han...@microsoft.com> wrote: > Congratulations Xuefu! > > -Original Message- > From: Remus Rusanu [mailto:rem...@microsoft.com] > Sent: Friday, February 28, 2014 11:43 AM > To: d...@hive.apache.org

Will this UDF always execute on a single reducer ?

Hi, I have written a custom UDF that I want to be executed on a single reducer when I am using it in a query. Following is the the query and I want to confirm whether this would always always execute the UDF on a single reducer (assuming the ORDER BY would send all the rows to a single reducer)

Re: move hive tables from one cluster to another cluster

Hi, just want to give warning about export/import to different hive versions see this bug: https://issues.apache.org/jira/browse/HIVE-5318 Thanks, Brad On Fri, Feb 28, 2014 at 1:55 PM, Edward Capriolo wrote: > Hive also has export import utilities. > > > https://cwiki.apache.org/confluence/disp

Re: move hive tables from one cluster to another cluster

Hive also has export import utilities. https://cwiki.apache.org/confluence/display/Hive/LanguageManual+ImportExport With hive thrift this should be fairly easy to script. On Fri, Feb 28, 2014 at 4:53 PM, Stephen Sprague wrote: > that advice is way over complicating something that is very easy

Re: move hive tables from one cluster to another cluster

that advice is way over complicating something that is very easy. instead, please take this approach. 1. run the ddl to create the table on the new cluster 2. distcp the hdfs data into the appropriate hdfs directory. 3. run "msck repair table " in hive to discover the partitions and populate the m

Re: move hive tables from one cluster to another cluster

If you are using Mysql as a database, you need to take a mysql dump of the metastore database and search/replace the old namenode hostname with the new namenode hostname. Once that is completed, import the metastore database. Thanks On Fri, Feb 28, 2014 at 12:59 AM, shashwat shriparv < dwivedish

RE: [ANNOUNCE] New Hive PMC Member - Xuefu Zhang

Congratulations Xuefu! -Original Message- From: Remus Rusanu [mailto:rem...@microsoft.com] Sent: Friday, February 28, 2014 11:43 AM To: d...@hive.apache.org; user@hive.apache.org Cc: Xuefu Zhang Subject: RE: [ANNOUNCE] New Hive PMC Member - Xuefu Zhang Grats!

RE: [ANNOUNCE] New Hive PMC Member - Xuefu Zhang

Grats! From: Prasanth Jayachandran Sent: Friday, February 28, 2014 9:11 PM To: d...@hive.apache.org Cc: user@hive.apache.org; Xuefu Zhang Subject: Re: [ANNOUNCE] New Hive PMC Member - Xuefu Zhang Congratulations Xuefu! Thanks Prasanth Jayachandran On Feb

Re: Hive + Flume

if you can configure flume to create temporary files that start with an underscore (_) i believe hive will safely ignore them. otherwise you have write a script to move them out. On Fri, Feb 28, 2014 at 11:09 AM, P lva wrote: > Hi, > > I'm have a flume stream that stores data in a directory whi

Re: [ANNOUNCE] New Hive PMC Member - Xuefu Zhang

Congratulations Xuefu! Thanks Prasanth Jayachandran On Feb 28, 2014, at 11:04 AM, Vaibhav Gumashta wrote: > Congrats Xuefu! > > > On Fri, Feb 28, 2014 at 9:20 AM, Prasad Mujumdar wrote: > >> Congratulations Xuefu !! >> >> thanks >> Prasad >> >> >> >> On Fri, Feb 28, 2014 at 1:20 AM, C

Hive + Flume

Hi, I'm have a flume stream that stores data in a directory which is source for an external table in hive. However flume creates tmp file that cannot be read by hive and query breaks. Is there any way to avoid hive reading this tmp file ? Thanks

Loading and partitioning data when root partition value is variable

Hi, I’m using Hive 0.11 on EMR to join data from S3 and write the joined data back to it. The join working fine but I have an issue with the directory structure of the input data. The input directories are structured like: s3://bucket/input_data/id=$ID/tblname=$TBL/dt=DT/hr=$HR This is a prett

Re: [ANNOUNCE] New Hive PMC Member - Xuefu Zhang

Congrats Xuefu! On Fri, Feb 28, 2014 at 9:20 AM, Prasad Mujumdar wrote: >Congratulations Xuefu !! > > thanks > Prasad > > > > On Fri, Feb 28, 2014 at 1:20 AM, Carl Steinbach wrote: > > > I am pleased to announce that Xuefu Zhang has been elected to the Hive > > Project Management Committee.

Re: [ANNOUNCE] New Hive PMC Member - Xuefu Zhang

Congratulations Xuefu !! thanks Prasad On Fri, Feb 28, 2014 at 1:20 AM, Carl Steinbach wrote: > I am pleased to announce that Xuefu Zhang has been elected to the Hive > Project Management Committee. Please join me in congratulating Xuefu! > > Thanks. > > Carl > >

Re: Exception

Hello, The "LOAD DATA LOCAL INPATH ..." will search the file into the local file system of the server where Hive is running, ie computer A for you. "LOAD DATA INPATH" will look for the file into the hadoop file system. More information here : https://cwiki.apache.org/confluence/display/Hive/Lan

Re: move hive tables from one cluster to another cluster

this is a FAQ. see doc on: msck repair table this will scan hdfs and create the corresponding partitions in the metastore. On Fri, Feb 28, 2014 at 12:59 AM, shashwat shriparv < dwivedishash...@gmail.com> wrote: > Where was your meta data in derby or MySql? > > > *Warm Regards_**∞_* > * Shashw

Re: [ANNOUNCE] New Hive PMC Member - Xuefu Zhang

Wow, congratulations Xuefu! Excellent work! Jarcec On Fri, Feb 28, 2014 at 01:20:47AM -0800, Carl Steinbach wrote: > I am pleased to announce that Xuefu Zhang has been elected to the Hive > Project Management Committee. Please join me in congratulating Xuefu! > > Thanks. > > Carl signature.as

Re: [ANNOUNCE] New Hive PMC Member - Xuefu Zhang

Congrats Xuefu! On Fri, Feb 28, 2014 at 3:20 AM, Clark Yang (杨卓荦) wrote: > Congrats, Xuefu! > > Thanks, > Zhuoluo (Clark) Yang > > > 2014-02-28 19:19 GMT+08:00 Lianhui Wang : > > Congrats Xuefu! >> >> >> 2014-02-28 17:49 GMT+08:00 Jason Dere : >> >> > Congrats Xuefu! >> > >> > >> > On Feb 28, 2

Re: [ANNOUNCE] New Hive PMC Member - Xuefu Zhang

Congrats, Xuefu! Thanks, Zhuoluo (Clark) Yang 2014-02-28 19:19 GMT+08:00 Lianhui Wang : > Congrats Xuefu! > > > 2014-02-28 17:49 GMT+08:00 Jason Dere : > > > Congrats Xuefu! > > > > > > On Feb 28, 2014, at 1:43 AM, Biswajit Nayak > > wrote: > > > > > Congrats Xuefu.. > > > > > > With Best Rega

Re: [ANNOUNCE] New Hive PMC Member - Xuefu Zhang

Congrats Xuefu! On Feb 28, 2014, at 1:43 AM, Biswajit Nayak wrote: > Congrats Xuefu.. > > With Best Regards > Biswajit > > ~Biswa > -oThe important thing is not to stop questioning o- > > > On Fri, Feb 28, 2014 at 2:50 PM, Carl Steinbach wrote: > I am pleased to announce that Xuef

Re: [ANNOUNCE] New Hive PMC Member - Xuefu Zhang

Congrats Xuefu.. With Best Regards Biswajit ~Biswa -oThe important thing is not to stop questioning o- On Fri, Feb 28, 2014 at 2:50 PM, Carl Steinbach wrote: > I am pleased to announce that Xuefu Zhang has been elected to the Hive > Project Management Committee. Please join me in cong

Exception

Hi all, I am trying to understand why I receive the following exception; java.sql.SQLException: Error while processing statement: FAILED: SemanticException Line 1:23 Invalid path ''/Users/jonelura/tmp/dual167616209284665.csv'': No files matching path file:/Users/jonelura/tmp/dual167616277

[ANNOUNCE] New Hive PMC Member - Xuefu Zhang

I am pleased to announce that Xuefu Zhang has been elected to the Hive Project Management Committee. Please join me in congratulating Xuefu! Thanks. Carl

Re: move hive tables from one cluster to another cluster

Where was your meta data in derby or MySql? *Warm Regards_**∞_* * Shashwat Shriparv* [image: http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9][image: https://twitter.com/shriparv] [image: https://www