Re: [ANNOUNCE] New Hive PMC Member - Xuefu Zhang

[Lefty Leverenz]

Congrats Xuefu!

-- Lefty


On Fri, Feb 28, 2014 at 2:52 PM, Eric Hanson (BIG DATA) <
eric.n.han...@microsoft.com> wrote:

> Congratulations Xuefu!
>
> -Original Message-
> From: Remus Rusanu [mailto:rem...@microsoft.com]
> Sent: Friday, February 28, 2014 11:43 AM
> To: d...@hive.apache.org; user@hive.apache.org
> Cc: Xuefu Zhang
> Subject: RE: [ANNOUNCE] New Hive PMC Member - Xuefu Zhang
>
> Grats!
> 
> From: Prasanth Jayachandran 
> Sent: Friday, February 28, 2014 9:11 PM
> To: d...@hive.apache.org
> Cc: user@hive.apache.org; Xuefu Zhang
> Subject: Re: [ANNOUNCE] New Hive PMC Member - Xuefu Zhang
>
> Congratulations Xuefu!
>
> Thanks
> Prasanth Jayachandran
>
> On Feb 28, 2014, at 11:04 AM, Vaibhav Gumashta 
> wrote:
>
> > Congrats Xuefu!
> >
> >
> > On Fri, Feb 28, 2014 at 9:20 AM, Prasad Mujumdar  >wrote:
> >
> >>   Congratulations Xuefu !!
> >>
> >> thanks
> >> Prasad
> >>
> >>
> >>
> >> On Fri, Feb 28, 2014 at 1:20 AM, Carl Steinbach  wrote:
> >>
> >>> I am pleased to announce that Xuefu Zhang has been elected to the
> >>> Hive Project Management Committee. Please join me in congratulating
> Xuefu!
> >>>
> >>> Thanks.
> >>>
> >>> Carl
> >>>
> >>>
> >>
> >
> > --
> > CONFIDENTIALITY NOTICE
> > NOTICE: This message is intended for the use of the individual or
> > entity to which it is addressed and may contain information that is
> > confidential, privileged and exempt from disclosure under applicable
> > law. If the reader of this message is not the intended recipient, you
> > are hereby notified that any printing, copying, dissemination,
> > distribution, disclosure or forwarding of this communication is
> > strictly prohibited. If you have received this communication in error,
> > please contact the sender immediately and delete it from your system.
> Thank You.
>
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>

Will this UDF always execute on a single reducer ?

[Vaibhav Jain]

Hi,

I have written a custom UDF that I want to be executed on a single reducer
when I am using it in a query. Following is the the query  and  I want to
confirm whether this would always always execute the UDF on a single
reducer (assuming the ORDER BY would send all the rows  to a single
reducer):


*SELECT UDF() AS alias  from *

*( SELECT  *

*  FROM   TABLESAMPLE (x PERCENT) *

*  ORDER BY  )*

*ORDER BY alias;*


Is it a possibility that the UDF is executed on a mapper?

-- 
Thanks
Vaibhav Jain

Re: move hive tables from one cluster to another cluster

[Brad Ruderman]

Hi, just want to give warning about export/import to different hive
versions see this bug:
https://issues.apache.org/jira/browse/HIVE-5318

Thanks,
Brad


On Fri, Feb 28, 2014 at 1:55 PM, Edward Capriolo wrote:

> Hive also has export import utilities.
>
>
> https://cwiki.apache.org/confluence/display/Hive/LanguageManual+ImportExport
>
> With hive thrift this should be fairly easy to script.
>
>
> On Fri, Feb 28, 2014 at 4:53 PM, Stephen Sprague wrote:
>
>> that advice is way over complicating something that is very easy.
>> instead, please take this approach.
>>
>> 1. run the ddl to create the table on the new cluster
>> 2. distcp the hdfs data into the appropriate hdfs directory.
>> 3. run "msck repair table " in hive to discover the partitions and
>> populate the metastore accordingly.
>>
>>
>>
>>
>>
>>
>>
>>
>> On Fri, Feb 28, 2014 at 1:41 PM, Abdelrahman Shettia <
>> ashet...@hortonworks.com> wrote:
>>
>>> If you are using Mysql as a database, you need to take a mysql dump of
>>> the metastore database and search/replace the old namenode hostname with
>>> the new namenode hostname. Once that is completed, import the metastore
>>> database.
>>>
>>> Thanks
>>>
>>>
>>> On Fri, Feb 28, 2014 at 12:59 AM, shashwat shriparv <
>>> dwivedishash...@gmail.com> wrote:
>>>
 Where was your meta data in derby or MySql?


 *Warm Regards_**∞_*
 * Shashwat Shriparv*
  [image: 
 http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9][image:
 https://twitter.com/shriparv] [image:
 https://www.facebook.com/shriparv] 
 [image:
 http://google.com/+ShashwatShriparv][image:
 http://www.youtube.com/user/sShriparv/videos][image:
 http://profile.yahoo.com/SWXSTW3DVSDTF2HHSRM47AV6DI/]



 On Fri, Feb 28, 2014 at 1:28 PM, soniya B wrote:

> Hi,
>
> I have moved warehouse file to another cluster. but still i didn't see
> the tables on the other cluster. How to rebulid the metadata?
>
> Thanks
> Soniya
>
> On Fri, Feb 28, 2014 at 9:26 AM, Krishnan K wrote:
>
>> 1. you can use distcp to copy the files to the new cluster
>> 2. rebuild metadata
>>
>>
>> On Thu, Feb 27, 2014 at 8:07 PM, soniya B 
>> wrote:
>>
>>> Dear experts,
>>>
>>> I want to move my hive tables from one cluster to another cluster.
>>> how can i do it?
>>>
>>> Thanks
>>> Soniya.
>>>
>>
>>
>

>>>
>>> CONFIDENTIALITY NOTICE
>>> NOTICE: This message is intended for the use of the individual or entity
>>> to which it is addressed and may contain information that is confidential,
>>> privileged and exempt from disclosure under applicable law. If the reader
>>> of this message is not the intended recipient, you are hereby notified that
>>> any printing, copying, dissemination, distribution, disclosure or
>>> forwarding of this communication is strictly prohibited. If you have
>>> received this communication in error, please contact the sender immediately
>>> and delete it from your system. Thank You.
>>
>>
>>
>

Re: move hive tables from one cluster to another cluster

[Edward Capriolo]

Hive also has export import utilities.

https://cwiki.apache.org/confluence/display/Hive/LanguageManual+ImportExport

With hive thrift this should be fairly easy to script.


On Fri, Feb 28, 2014 at 4:53 PM, Stephen Sprague  wrote:

> that advice is way over complicating something that is very easy. instead,
> please take this approach.
>
> 1. run the ddl to create the table on the new cluster
> 2. distcp the hdfs data into the appropriate hdfs directory.
> 3. run "msck repair table " in hive to discover the partitions and
> populate the metastore accordingly.
>
>
>
>
>
>
>
>
> On Fri, Feb 28, 2014 at 1:41 PM, Abdelrahman Shettia <
> ashet...@hortonworks.com> wrote:
>
>> If you are using Mysql as a database, you need to take a mysql dump of
>> the metastore database and search/replace the old namenode hostname with
>> the new namenode hostname. Once that is completed, import the metastore
>> database.
>>
>> Thanks
>>
>>
>> On Fri, Feb 28, 2014 at 12:59 AM, shashwat shriparv <
>> dwivedishash...@gmail.com> wrote:
>>
>>> Where was your meta data in derby or MySql?
>>>
>>>
>>> *Warm Regards_**∞_*
>>> * Shashwat Shriparv*
>>>  [image: 
>>> http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9][image:
>>> https://twitter.com/shriparv] [image:
>>> https://www.facebook.com/shriparv] 
>>> [image:
>>> http://google.com/+ShashwatShriparv][image:
>>> http://www.youtube.com/user/sShriparv/videos][image:
>>> http://profile.yahoo.com/SWXSTW3DVSDTF2HHSRM47AV6DI/]
>>>
>>>
>>>
>>> On Fri, Feb 28, 2014 at 1:28 PM, soniya B wrote:
>>>
 Hi,

 I have moved warehouse file to another cluster. but still i didn't see
 the tables on the other cluster. How to rebulid the metadata?

 Thanks
 Soniya

 On Fri, Feb 28, 2014 at 9:26 AM, Krishnan K wrote:

> 1. you can use distcp to copy the files to the new cluster
> 2. rebuild metadata
>
>
> On Thu, Feb 27, 2014 at 8:07 PM, soniya B wrote:
>
>> Dear experts,
>>
>> I want to move my hive tables from one cluster to another cluster.
>> how can i do it?
>>
>> Thanks
>> Soniya.
>>
>
>

>>>
>>
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity
>> to which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender immediately
>> and delete it from your system. Thank You.
>
>
>

Re: move hive tables from one cluster to another cluster

[Stephen Sprague]

that advice is way over complicating something that is very easy. instead,
please take this approach.

1. run the ddl to create the table on the new cluster
2. distcp the hdfs data into the appropriate hdfs directory.
3. run "msck repair table " in hive to discover the partitions and
populate the metastore accordingly.








On Fri, Feb 28, 2014 at 1:41 PM, Abdelrahman Shettia <
ashet...@hortonworks.com> wrote:

> If you are using Mysql as a database, you need to take a mysql dump of the
> metastore database and search/replace the old namenode hostname with the
> new namenode hostname. Once that is completed, import the metastore
> database.
>
> Thanks
>
>
> On Fri, Feb 28, 2014 at 12:59 AM, shashwat shriparv <
> dwivedishash...@gmail.com> wrote:
>
>> Where was your meta data in derby or MySql?
>>
>>
>> *Warm Regards_**∞_*
>> * Shashwat Shriparv*
>>  [image: 
>> http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9][image:
>> https://twitter.com/shriparv] [image:
>> https://www.facebook.com/shriparv] [image:
>> http://google.com/+ShashwatShriparv][image:
>> http://www.youtube.com/user/sShriparv/videos][image:
>> http://profile.yahoo.com/SWXSTW3DVSDTF2HHSRM47AV6DI/]
>>
>>
>>
>> On Fri, Feb 28, 2014 at 1:28 PM, soniya B wrote:
>>
>>> Hi,
>>>
>>> I have moved warehouse file to another cluster. but still i didn't see
>>> the tables on the other cluster. How to rebulid the metadata?
>>>
>>> Thanks
>>> Soniya
>>>
>>> On Fri, Feb 28, 2014 at 9:26 AM, Krishnan K wrote:
>>>
 1. you can use distcp to copy the files to the new cluster
 2. rebuild metadata


 On Thu, Feb 27, 2014 at 8:07 PM, soniya B wrote:

> Dear experts,
>
> I want to move my hive tables from one cluster to another cluster. how
> can i do it?
>
> Thanks
> Soniya.
>


>>>
>>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.

Re: move hive tables from one cluster to another cluster

[Abdelrahman Shettia]

If you are using Mysql as a database, you need to take a mysql dump of the
metastore database and search/replace the old namenode hostname with the
new namenode hostname. Once that is completed, import the metastore
database.

Thanks


On Fri, Feb 28, 2014 at 12:59 AM, shashwat shriparv <
dwivedishash...@gmail.com> wrote:

> Where was your meta data in derby or MySql?
>
>
> *Warm Regards_**∞_*
> * Shashwat Shriparv*
>  [image: 
> http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9][image:
> https://twitter.com/shriparv] [image:
> https://www.facebook.com/shriparv] [image:
> http://google.com/+ShashwatShriparv] 
> [image:
> http://www.youtube.com/user/sShriparv/videos][image:
> http://profile.yahoo.com/SWXSTW3DVSDTF2HHSRM47AV6DI/] 
>
>
>
> On Fri, Feb 28, 2014 at 1:28 PM, soniya B wrote:
>
>> Hi,
>>
>> I have moved warehouse file to another cluster. but still i didn't see
>> the tables on the other cluster. How to rebulid the metadata?
>>
>> Thanks
>> Soniya
>>
>> On Fri, Feb 28, 2014 at 9:26 AM, Krishnan K wrote:
>>
>>> 1. you can use distcp to copy the files to the new cluster
>>> 2. rebuild metadata
>>>
>>>
>>> On Thu, Feb 27, 2014 at 8:07 PM, soniya B wrote:
>>>
 Dear experts,

 I want to move my hive tables from one cluster to another cluster. how
 can i do it?

 Thanks
 Soniya.

>>>
>>>
>>
>

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

RE: [ANNOUNCE] New Hive PMC Member - Xuefu Zhang

[Eric Hanson (BIG DATA)]

Congratulations Xuefu!

-Original Message-
From: Remus Rusanu [mailto:rem...@microsoft.com] 
Sent: Friday, February 28, 2014 11:43 AM
To: d...@hive.apache.org; user@hive.apache.org
Cc: Xuefu Zhang
Subject: RE: [ANNOUNCE] New Hive PMC Member - Xuefu Zhang

Grats!

From: Prasanth Jayachandran 
Sent: Friday, February 28, 2014 9:11 PM
To: d...@hive.apache.org
Cc: user@hive.apache.org; Xuefu Zhang
Subject: Re: [ANNOUNCE] New Hive PMC Member - Xuefu Zhang

Congratulations Xuefu!

Thanks
Prasanth Jayachandran

On Feb 28, 2014, at 11:04 AM, Vaibhav Gumashta  
wrote:

> Congrats Xuefu!
>
>
> On Fri, Feb 28, 2014 at 9:20 AM, Prasad Mujumdar wrote:
>
>>   Congratulations Xuefu !!
>>
>> thanks
>> Prasad
>>
>>
>>
>> On Fri, Feb 28, 2014 at 1:20 AM, Carl Steinbach  wrote:
>>
>>> I am pleased to announce that Xuefu Zhang has been elected to the 
>>> Hive Project Management Committee. Please join me in congratulating Xuefu!
>>>
>>> Thanks.
>>>
>>> Carl
>>>
>>>
>>
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or 
> entity to which it is addressed and may contain information that is 
> confidential, privileged and exempt from disclosure under applicable 
> law. If the reader of this message is not the intended recipient, you 
> are hereby notified that any printing, copying, dissemination, 
> distribution, disclosure or forwarding of this communication is 
> strictly prohibited. If you have received this communication in error, 
> please contact the sender immediately and delete it from your system. Thank 
> You.


--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader of 
this message is not the intended recipient, you are hereby notified that any 
printing, copying, dissemination, distribution, disclosure or forwarding of 
this communication is strictly prohibited. If you have received this 
communication in error, please contact the sender immediately and delete it 
from your system. Thank You.

RE: [ANNOUNCE] New Hive PMC Member - Xuefu Zhang

[Remus Rusanu]

Grats!

From: Prasanth Jayachandran 
Sent: Friday, February 28, 2014 9:11 PM
To: d...@hive.apache.org
Cc: user@hive.apache.org; Xuefu Zhang
Subject: Re: [ANNOUNCE] New Hive PMC Member - Xuefu Zhang

Congratulations Xuefu!

Thanks
Prasanth Jayachandran

On Feb 28, 2014, at 11:04 AM, Vaibhav Gumashta  
wrote:

> Congrats Xuefu!
>
>
> On Fri, Feb 28, 2014 at 9:20 AM, Prasad Mujumdar wrote:
>
>>   Congratulations Xuefu !!
>>
>> thanks
>> Prasad
>>
>>
>>
>> On Fri, Feb 28, 2014 at 1:20 AM, Carl Steinbach  wrote:
>>
>>> I am pleased to announce that Xuefu Zhang has been elected to the Hive
>>> Project Management Committee. Please join me in congratulating Xuefu!
>>>
>>> Thanks.
>>>
>>> Carl
>>>
>>>
>>
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.


--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.

Re: Hive + Flume

[Stephen Sprague]

if you can configure flume to create temporary files that start with an
underscore (_) i believe hive will safely ignore them. otherwise you have
write a script to move them out.


On Fri, Feb 28, 2014 at 11:09 AM, P lva  wrote:

> Hi,
>
> I'm have a flume stream that stores data in a directory which is source
> for an external table in hive.
> However flume creates tmp file that cannot be read by hive and query
> breaks.
> Is there any way to avoid hive reading this tmp file ?
>
> Thanks
>

Re: [ANNOUNCE] New Hive PMC Member - Xuefu Zhang

[Prasanth Jayachandran]

Congratulations Xuefu!

Thanks
Prasanth Jayachandran

On Feb 28, 2014, at 11:04 AM, Vaibhav Gumashta  
wrote:

> Congrats Xuefu!
> 
> 
> On Fri, Feb 28, 2014 at 9:20 AM, Prasad Mujumdar wrote:
> 
>>   Congratulations Xuefu !!
>> 
>> thanks
>> Prasad
>> 
>> 
>> 
>> On Fri, Feb 28, 2014 at 1:20 AM, Carl Steinbach  wrote:
>> 
>>> I am pleased to announce that Xuefu Zhang has been elected to the Hive
>>> Project Management Committee. Please join me in congratulating Xuefu!
>>> 
>>> Thanks.
>>> 
>>> Carl
>>> 
>>> 
>> 
> 
> -- 
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to 
> which it is addressed and may contain information that is confidential, 
> privileged and exempt from disclosure under applicable law. If the reader 
> of this message is not the intended recipient, you are hereby notified that 
> any printing, copying, dissemination, distribution, disclosure or 
> forwarding of this communication is strictly prohibited. If you have 
> received this communication in error, please contact the sender immediately 
> and delete it from your system. Thank You.


-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Hive + Flume

[P lva]

Hi,

I'm have a flume stream that stores data in a directory which is source for
an external table in hive.
However flume creates tmp file that cannot be read by hive and query
breaks.
Is there any way to avoid hive reading this tmp file ?

Thanks

Loading and partitioning data when root partition value is variable

[Mike Stec]

Hi,

I’m using Hive 0.11 on EMR to join data from S3 and write the joined data back 
to it. The join working fine but I have an issue with the directory structure 
of the input data. The input directories are structured like:

s3://bucket/input_data/id=$ID/tblname=$TBL/dt=DT/hr=$HR

This is a pretty standard use case for partitioning but the issue is that I 
want to load in the data for all IDs but only some of the subdirectories for an 
ID, i.e.

s3://bucket/input_data/id=1/tblname=table/dt=2014-02-28/hr=12
s3://bucket/input_data/id=2/tblname=table/dt=2014-02-28/hr=12
s3://bucket/input_data/id=3/tblname=table/dt=2014-02-28/hr=12
s3://bucket/input_data/id=4/tblname=table/dt=2014-02-28/hr=12

and so on. 

I know that I can’t use dynamic partitioning in this case because according to 
the Hive documentation you can’t do:

INSERT OVERWRITE TABLE table PARTITION(id, tblname=“table”, dt='2014-02-28', 
hr=12)

And if I have PARTITIONED BY (token STRING, tbl STRING, dt STRING, hr INT) in 
my CREATE TABLE statement and do:

ALTER TABLE table ADD PARTITION (tblname=“table”, dt=“2014-02-28”, hr=12)

I get a SemanticException error that says, "Invalid partition spec specified 
table is partitioned but partition spec is not specified or does not fully 
match table partitioning”

Is there a way to deal with this problem in Hive itself or will I have to use a 
script or something else in conjunction with Hive to get around this?

Re: [ANNOUNCE] New Hive PMC Member - Xuefu Zhang

[Vaibhav Gumashta]

Congrats Xuefu!


On Fri, Feb 28, 2014 at 9:20 AM, Prasad Mujumdar wrote:

>Congratulations Xuefu !!
>
> thanks
> Prasad
>
>
>
> On Fri, Feb 28, 2014 at 1:20 AM, Carl Steinbach  wrote:
>
> > I am pleased to announce that Xuefu Zhang has been elected to the Hive
> > Project Management Committee. Please join me in congratulating Xuefu!
> >
> > Thanks.
> >
> > Carl
> >
> >
>

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Re: [ANNOUNCE] New Hive PMC Member - Xuefu Zhang

[Prasad Mujumdar]

   Congratulations Xuefu !!

thanks
Prasad



On Fri, Feb 28, 2014 at 1:20 AM, Carl Steinbach  wrote:

> I am pleased to announce that Xuefu Zhang has been elected to the Hive
> Project Management Committee. Please join me in congratulating Xuefu!
>
> Thanks.
>
> Carl
>
>

Re: Exception

[David Gayou]

Hello,

The "LOAD DATA LOCAL INPATH ..." will search the file into the local file
system of the server where Hive is running, ie computer A for you.

"LOAD DATA INPATH" will look for the file into the hadoop file system.

More information here :

https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DML


And i have no clue how to actually insert the data only through the jdbc
client.


Regards

David




On Fri, Feb 28, 2014 at 10:22 AM, Jone Lura  wrote:

> Hi all,
>
> I am trying to understand why I receive the following exception;
>
> java.sql.SQLException: Error while processing statement: FAILED:
> SemanticException Line 1:23 Invalid path
> ''/Users/jonelura/tmp/dual167616209284665.csv'': No files matching path
> file:/Users/jonelura/tmp/dual167616209284665.csv
> at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:161)
> at org.apache.hive.jdbc.Utils.verifySuccessWithInfo(Utils.java:149)
> at
> org.apache.hive.jdbc.HivePreparedStatement.executeImmediate(HivePreparedStatement.java:187)
> at
> org.apache.hive.jdbc.HivePreparedStatement.execute(HivePreparedStatement.java:137)
> at
> no.ecc.nais.io.storage.HiveSQLStorage.createDualTable(HiveSQLStorage.java:545)
> ...
> ...
>
> I have two computers.
>
> Computer A - Running Hadoop (1.2.1) and Hiveserver (0.11.0) and web
> application myApp, connected to Hive with Hive JDBC driver 0.11.0
>
> Computer B - Running web application myApp connected to Hive with Hive
> JDBC driver 0.11.0
>
> The exception above is thrown on Computer B, whilst Computer A works fine.
>
> The SQL for loading the data is;
>
> LOAD DATA LOCAL INPATH '/Users/jonelura/tmp/dual167616209284665.csv'
> OVERWRITE INTO TABLE dual
>
> For some reason it looks for the
> /Users/jonelura/tmp/dual167616209284665.csv on Computer A (Hive and
> Hadoop), instead of Computer B (where the file exists)
>
> Is there another load syntax I should have used?
>
> Best regards,
>
> Jone
>
>
>

Re: move hive tables from one cluster to another cluster

[Stephen Sprague]

this is a FAQ.  see doc on: msck repair table 

this will scan hdfs and create the corresponding partitions in the
metastore.


On Fri, Feb 28, 2014 at 12:59 AM, shashwat shriparv <
dwivedishash...@gmail.com> wrote:

> Where was your meta data in derby or MySql?
>
>
> *Warm Regards_**∞_*
> * Shashwat Shriparv*
>  [image: 
> http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9][image:
> https://twitter.com/shriparv] [image:
> https://www.facebook.com/shriparv] [image:
> http://google.com/+ShashwatShriparv] 
> [image:
> http://www.youtube.com/user/sShriparv/videos][image:
> http://profile.yahoo.com/SWXSTW3DVSDTF2HHSRM47AV6DI/] 
>
>
>
> On Fri, Feb 28, 2014 at 1:28 PM, soniya B wrote:
>
>> Hi,
>>
>> I have moved warehouse file to another cluster. but still i didn't see
>> the tables on the other cluster. How to rebulid the metadata?
>>
>> Thanks
>> Soniya
>>
>> On Fri, Feb 28, 2014 at 9:26 AM, Krishnan K wrote:
>>
>>> 1. you can use distcp to copy the files to the new cluster
>>> 2. rebuild metadata
>>>
>>>
>>> On Thu, Feb 27, 2014 at 8:07 PM, soniya B wrote:
>>>
 Dear experts,

 I want to move my hive tables from one cluster to another cluster. how
 can i do it?

 Thanks
 Soniya.

>>>
>>>
>>
>

Re: [ANNOUNCE] New Hive PMC Member - Xuefu Zhang

[Jarek Jarcec Cecho]

Wow, congratulations Xuefu! Excellent work!

Jarcec

On Fri, Feb 28, 2014 at 01:20:47AM -0800, Carl Steinbach wrote:
> I am pleased to announce that Xuefu Zhang has been elected to the Hive
> Project Management Committee. Please join me in congratulating Xuefu!
> 
> Thanks.
> 
> Carl


signature.asc
Description: Digital signature

Re: [ANNOUNCE] New Hive PMC Member - Xuefu Zhang

[Thejas Nair]

Congrats Xuefu!



On Fri, Feb 28, 2014 at 3:20 AM, Clark Yang (杨卓荦) wrote:

> Congrats, Xuefu!
>
> Thanks,
> Zhuoluo (Clark) Yang
>
>
> 2014-02-28 19:19 GMT+08:00 Lianhui Wang :
>
> Congrats Xuefu!
>>
>>
>> 2014-02-28 17:49 GMT+08:00 Jason Dere :
>>
>> > Congrats Xuefu!
>> >
>> >
>> > On Feb 28, 2014, at 1:43 AM, Biswajit Nayak 
>> > wrote:
>> >
>> > > Congrats Xuefu..
>> > >
>> > > With Best Regards
>> > > Biswajit
>> > >
>> > > ~Biswa
>> > > -oThe important thing is not to stop questioning o-
>> > >
>> > >
>> > > On Fri, Feb 28, 2014 at 2:50 PM, Carl Steinbach 
>> wrote:
>> > > I am pleased to announce that Xuefu Zhang has been elected to the Hive
>> > Project Management Committee. Please join me in congratulating Xuefu!
>> > >
>> > > Thanks.
>> > >
>> > > Carl
>> > >
>> > >
>> > >
>> > > _
>> > > The information contained in this communication is intended solely for
>> > the use of the individual or entity to whom it is addressed and others
>> > authorized to receive it. It may contain confidential or legally
>> privileged
>> > information. If you are not the intended recipient you are hereby
>> notified
>> > that any disclosure, copying, distribution or taking any action in
>> reliance
>> > on the contents of this information is strictly prohibited and may be
>> > unlawful. If you have received this communication in error, please
>> notify
>> > us immediately by responding to this email and then delete it from your
>> > system. The firm is neither liable for the proper and complete
>> transmission
>> > of the information contained in this communication nor for any delay in
>> its
>> > receipt.
>> >
>> >
>> > --
>> > CONFIDENTIALITY NOTICE
>> > NOTICE: This message is intended for the use of the individual or
>> entity to
>> > which it is addressed and may contain information that is confidential,
>> > privileged and exempt from disclosure under applicable law. If the
>> reader
>> > of this message is not the intended recipient, you are hereby notified
>> that
>> > any printing, copying, dissemination, distribution, disclosure or
>> > forwarding of this communication is strictly prohibited. If you have
>> > received this communication in error, please contact the sender
>> immediately
>> > and delete it from your system. Thank You.
>> >
>>
>>
>>
>> --
>> thanks
>>
>> 王联辉(Lianhui Wang)
>> blog; http://blog.csdn.net/lance_123
>> 兴趣方向：数据库，分布式，数据挖掘，编程语言，互联网技术等
>>
>
>

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Re: [ANNOUNCE] New Hive PMC Member - Xuefu Zhang

[杨卓荦]

Congrats, Xuefu!

Thanks,
Zhuoluo (Clark) Yang


2014-02-28 19:19 GMT+08:00 Lianhui Wang :

> Congrats Xuefu!
>
>
> 2014-02-28 17:49 GMT+08:00 Jason Dere :
>
> > Congrats Xuefu!
> >
> >
> > On Feb 28, 2014, at 1:43 AM, Biswajit Nayak 
> > wrote:
> >
> > > Congrats Xuefu..
> > >
> > > With Best Regards
> > > Biswajit
> > >
> > > ~Biswa
> > > -oThe important thing is not to stop questioning o-
> > >
> > >
> > > On Fri, Feb 28, 2014 at 2:50 PM, Carl Steinbach 
> wrote:
> > > I am pleased to announce that Xuefu Zhang has been elected to the Hive
> > Project Management Committee. Please join me in congratulating Xuefu!
> > >
> > > Thanks.
> > >
> > > Carl
> > >
> > >
> > >
> > > _
> > > The information contained in this communication is intended solely for
> > the use of the individual or entity to whom it is addressed and others
> > authorized to receive it. It may contain confidential or legally
> privileged
> > information. If you are not the intended recipient you are hereby
> notified
> > that any disclosure, copying, distribution or taking any action in
> reliance
> > on the contents of this information is strictly prohibited and may be
> > unlawful. If you have received this communication in error, please notify
> > us immediately by responding to this email and then delete it from your
> > system. The firm is neither liable for the proper and complete
> transmission
> > of the information contained in this communication nor for any delay in
> its
> > receipt.
> >
> >
> > --
> > CONFIDENTIALITY NOTICE
> > NOTICE: This message is intended for the use of the individual or entity
> to
> > which it is addressed and may contain information that is confidential,
> > privileged and exempt from disclosure under applicable law. If the reader
> > of this message is not the intended recipient, you are hereby notified
> that
> > any printing, copying, dissemination, distribution, disclosure or
> > forwarding of this communication is strictly prohibited. If you have
> > received this communication in error, please contact the sender
> immediately
> > and delete it from your system. Thank You.
> >
>
>
>
> --
> thanks
>
> 王联辉(Lianhui Wang)
> blog; http://blog.csdn.net/lance_123
> 兴趣方向：数据库，分布式，数据挖掘，编程语言，互联网技术等
>

Re: [ANNOUNCE] New Hive PMC Member - Xuefu Zhang

[Jason Dere]

Congrats Xuefu!


On Feb 28, 2014, at 1:43 AM, Biswajit Nayak  wrote:

> Congrats Xuefu.. 
> 
> With Best Regards
> Biswajit
> 
> ~Biswa
> -oThe important thing is not to stop questioning o-
> 
> 
> On Fri, Feb 28, 2014 at 2:50 PM, Carl Steinbach  wrote:
> I am pleased to announce that Xuefu Zhang has been elected to the Hive 
> Project Management Committee. Please join me in congratulating Xuefu!
> 
> Thanks.
> 
> Carl
> 
> 
> 
> _
> The information contained in this communication is intended solely for the 
> use of the individual or entity to whom it is addressed and others authorized 
> to receive it. It may contain confidential or legally privileged information. 
> If you are not the intended recipient you are hereby notified that any 
> disclosure, copying, distribution or taking any action in reliance on the 
> contents of this information is strictly prohibited and may be unlawful. If 
> you have received this communication in error, please notify us immediately 
> by responding to this email and then delete it from your system. The firm is 
> neither liable for the proper and complete transmission of the information 
> contained in this communication nor for any delay in its receipt.


-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Re: [ANNOUNCE] New Hive PMC Member - Xuefu Zhang

[Biswajit Nayak]

Congrats Xuefu..

With Best Regards
Biswajit

~Biswa
-oThe important thing is not to stop questioning o-


On Fri, Feb 28, 2014 at 2:50 PM, Carl Steinbach  wrote:

> I am pleased to announce that Xuefu Zhang has been elected to the Hive
> Project Management Committee. Please join me in congratulating Xuefu!
>
> Thanks.
>
> Carl
>
>

-- 
_
The information contained in this communication is intended solely for the 
use of the individual or entity to whom it is addressed and others 
authorized to receive it. It may contain confidential or legally privileged 
information. If you are not the intended recipient you are hereby notified 
that any disclosure, copying, distribution or taking any action in reliance 
on the contents of this information is strictly prohibited and may be 
unlawful. If you have received this communication in error, please notify 
us immediately by responding to this email and then delete it from your 
system. The firm is neither liable for the proper and complete transmission 
of the information contained in this communication nor for any delay in its 
receipt.

Exception

[Jone Lura]

Hi all, 

I am trying to understand why I receive the following exception;

java.sql.SQLException: Error while processing statement: FAILED: 
SemanticException Line 1:23 Invalid path 
''/Users/jonelura/tmp/dual167616209284665.csv'': No files matching path 
file:/Users/jonelura/tmp/dual167616209284665.csv
at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:161)
at org.apache.hive.jdbc.Utils.verifySuccessWithInfo(Utils.java:149)
at 
org.apache.hive.jdbc.HivePreparedStatement.executeImmediate(HivePreparedStatement.java:187)
at 
org.apache.hive.jdbc.HivePreparedStatement.execute(HivePreparedStatement.java:137)
at 
no.ecc.nais.io.storage.HiveSQLStorage.createDualTable(HiveSQLStorage.java:545)
...
...

I have two computers.

Computer A - Running Hadoop (1.2.1) and Hiveserver (0.11.0) and web application 
myApp, connected to Hive with Hive JDBC driver 0.11.0

Computer B - Running web application myApp connected to Hive with Hive JDBC 
driver 0.11.0

The exception above is thrown on Computer B, whilst Computer A works fine.

The SQL for loading the data is;

LOAD DATA LOCAL INPATH '/Users/jonelura/tmp/dual167616209284665.csv' 
OVERWRITE INTO TABLE dual

For some reason it looks for the 
/Users/jonelura/tmp/dual167616209284665.csv on Computer A (Hive and 
Hadoop), instead of Computer B (where the file exists)

Is there another load syntax I should have used?

Best regards,

Jone

[ANNOUNCE] New Hive PMC Member - Xuefu Zhang

[Carl Steinbach]

I am pleased to announce that Xuefu Zhang has been elected to the Hive
Project Management Committee. Please join me in congratulating Xuefu!

Thanks.

Carl

Re: move hive tables from one cluster to another cluster

[shashwat shriparv]

Where was your meta data in derby or MySql?


*Warm Regards_**∞_*
* Shashwat Shriparv*
 [image: 
http://www.linkedin.com/pub/shashwat-shriparv/19/214/2a9][image:
https://twitter.com/shriparv] [image:
https://www.facebook.com/shriparv] [image:
http://google.com/+ShashwatShriparv]
[image:
http://www.youtube.com/user/sShriparv/videos][image:
http://profile.yahoo.com/SWXSTW3DVSDTF2HHSRM47AV6DI/] 



On Fri, Feb 28, 2014 at 1:28 PM, soniya B  wrote:

> Hi,
>
> I have moved warehouse file to another cluster. but still i didn't see the
> tables on the other cluster. How to rebulid the metadata?
>
> Thanks
> Soniya
>
> On Fri, Feb 28, 2014 at 9:26 AM, Krishnan K  wrote:
>
>> 1. you can use distcp to copy the files to the new cluster
>> 2. rebuild metadata
>>
>>
>> On Thu, Feb 27, 2014 at 8:07 PM, soniya B wrote:
>>
>>> Dear experts,
>>>
>>> I want to move my hive tables from one cluster to another cluster. how
>>> can i do it?
>>>
>>> Thanks
>>> Soniya.
>>>
>>
>>
>