describe table issue, hive_system table, set command and version fuction questions

2013-01-31 Thread Todd Wilson
Hello Everyone:

 

I'm using Hive .9.  MapR ODBC driver against Cloudera.  Relatively new to
Hadoop, been looking at it about a week to add it to our query tool.  

 

CREATE DATABASE test;


CREATE TABLE test.table1
  (col1  int);

describe table1;

I'm getting the message "Table table1 does not exist .  I'm trying to get
the columns for this table which is in another database other than default.
I understand version .10 has SHOW COLUMNS sysntax to get columns in any
database, but is there a way to do this on .9. 

 

describe test.table1;
I don't think this is valid syntax so I was expecting an error message.
Give "Table test does not exist".

 

-

What is this hive_system database and hive_system table?  Is this a Cloudera
table?  I can seem to find any information on it anywhere.

A SELECT from this table will give configuration information.

 

-

SET command appears to run like this (not documented in HQL as far as I can
tell).

 

set hive.enforce.bucketing = false;

 

.but the configuration setting doesn't change.  I thought you could override
some of these configuration variable at the session level and I'd like to
learn how to do this.

 

When using set -v through the CLI it doesn't seem to return this
hive.enforce.bucketing configuration setting.

 

-

Finally, a command like SELECT Version() exposed through HQL to show the
current version of hive would be very helpful.  I can get this by querying
this hive_system table and doing some string functions in .NET to get it,
but if there is something like select version that would be great.

 

Thank you for listening.

 

Best Regards,

 

Todd

 

 



Accessing UDF function from hive jdbc

2013-01-31 Thread Venugopal Krishnan
Hi,

I am having issues in accessing the UDF function from the hive queries using 
jdbc. Is it possible to access UDF function from the jdbc? I will explain the 
steps below and also the error which I am getting.

I had copied the jar which has the UDF class file in the directory 
/user/temp/folder on the hadoop cluster

I am registering that jar using the below entry from the java file using spring 
Aspects.

DistributedCache.addFileToClassPath(new Path(hiveLibsPath + "/test.jar"), conf);

I am using the below syntax to create the function

CREATE TEMPORARY FUNCTION  test_123 'com.test.calculate' .  calculate the class 
file . I get the below error

Query returned non-zero code: 9, cause: FAILED: Execution Error, return code 2 
from org.apache.hadoop.hive.ql.exec.MapRedTask

When I checked the jobdetails I get the exception as below.

java.lang.RuntimeException: Error in configuring object
at 
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at 
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at 
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:387)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1157)
at org.apache.hadoop.mapred.Child.main(Child.java:264)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.jav
java.lang.RuntimeException: Error in configuring object
at 
org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at 
org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at 
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:387)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:325)
at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1157)
at org.apache.hadoop.mapred.Child.main(Child.java:264)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.jav
java.lang.RuntimeException: Error in configuring object


Did I miss anything ??

The same is working well in Hive CLI.


Regards,
gopal




http://www.mindtree.com/email/disclaimer.html


Re: DROP TABLE does not respect the IF EXISTS clause

2013-01-31 Thread Mark Grover
Thanks for the update, Marc. Could you please create a Hive JIRA for this?
Thanks!

Harsh, it's most likely the case with your JIRA as well that the error
message is misleading. Thanks for reporting it!

Mark

On Thu, Jan 31, 2013 at 4:58 PM, Marc Limotte  wrote:

> Thanks, Harsh.   My issues seems to be related to the one-user limitation
> of the derby metastore.  Once that issue was resolved the "table not found"
> error went away.  It was just a misleading error message.
>
> Marc
>
>
> On Thu, Jan 31, 2013 at 4:40 PM, Harsh J  wrote:
>
>> Not sure how relevant it is but I faced a similar problem around ALTER
>> TABLE DROP PARTITION IF EXIST.
>>
>> See https://issues.apache.org/jira/browse/HIVE-3576 for the specific
>> issue and my commands to reproduce it, and also try to perhaps set
>> hive.exec.drop.ignorenonexistent to true to see if it changes anything
>> for you?
>>
>> On Fri, Feb 1, 2013 at 3:27 AM, Marc Limotte  wrote:
>> > Hi Mark,
>> >
>> > A table.  But it doesn't seem to matter.  I get this error on the DROP,
>> > before even attempting to create a table.  I get the same thing for any
>> > arbitrary table name.  For example:
>> >
>> > hive> DROP TABLE IF EXISTS kdsjhfkjhds;
>> > FAILED: Error in semantic analysis: Table not found kdsjhfkjhds
>> >
>> >
>> > I think I found something, though.  This install is still using the
>> Derby
>> > metastore, and the hive web service is running, so I'm getting errors
>> like
>> > "A read-only user or a user in a read-only database…".  I'm guessing the
>> > error above is just a consequence of this one-user limitation.  So, the
>> real
>> > issue is that the error message reported by "DROP TABLE IF EXISTS" is
>> > mis-leading and obscures the real problem.
>> >
>> >
>> > thanks,
>> > Marc
>> >
>> > On Thu, Jan 31, 2013 at 11:42 AM, Mark Grover <
>> grover.markgro...@gmail.com>
>> > wrote:
>> >>
>> >> Marc,
>> >> It seemed to work on my installation of Hive 0.9. Is this a table or a
>> >> view you are trying to drop?
>> >> Mind sharing the create table definition?
>> >>
>> >> Mark
>> >>
>> >>
>> >> On Thu, Jan 31, 2013 at 10:42 AM, Marc Limotte 
>> >> wrote:
>> >>>
>> >>> Hi,
>> >>>
>> >>> I'm testing with Hive 0.9.0 (in Amazon EC2, but NOT emr).  I'm
>> >>> experiencing a problem where DROP TABLE does not respect the IF EXISTS
>> >>> clause, so it still throws an error when the table doesn't exist and
>> this
>> >>> causes the script to stop executing.  Here's what it looks like from
>> the
>> >>> hive shell:
>> >>>
>> >>> hive> DROP TABLE IF EXISTS recalc_aggregate_premium;
>> >>> FAILED: Error in semantic analysis: Table not found
>> >>> recalc_aggregate_premium
>> >>>
>> >>>
>> >>> Marc
>> >>>
>> >>>
>> >>
>> >
>>
>>
>>
>> --
>> Harsh J
>>
>
>


Re: DROP TABLE does not respect the IF EXISTS clause

2013-01-31 Thread Marc Limotte
Thanks, Harsh.   My issues seems to be related to the one-user limitation
of the derby metastore.  Once that issue was resolved the "table not found"
error went away.  It was just a misleading error message.

Marc

On Thu, Jan 31, 2013 at 4:40 PM, Harsh J  wrote:

> Not sure how relevant it is but I faced a similar problem around ALTER
> TABLE DROP PARTITION IF EXIST.
>
> See https://issues.apache.org/jira/browse/HIVE-3576 for the specific
> issue and my commands to reproduce it, and also try to perhaps set
> hive.exec.drop.ignorenonexistent to true to see if it changes anything
> for you?
>
> On Fri, Feb 1, 2013 at 3:27 AM, Marc Limotte  wrote:
> > Hi Mark,
> >
> > A table.  But it doesn't seem to matter.  I get this error on the DROP,
> > before even attempting to create a table.  I get the same thing for any
> > arbitrary table name.  For example:
> >
> > hive> DROP TABLE IF EXISTS kdsjhfkjhds;
> > FAILED: Error in semantic analysis: Table not found kdsjhfkjhds
> >
> >
> > I think I found something, though.  This install is still using the Derby
> > metastore, and the hive web service is running, so I'm getting errors
> like
> > "A read-only user or a user in a read-only database…".  I'm guessing the
> > error above is just a consequence of this one-user limitation.  So, the
> real
> > issue is that the error message reported by "DROP TABLE IF EXISTS" is
> > mis-leading and obscures the real problem.
> >
> >
> > thanks,
> > Marc
> >
> > On Thu, Jan 31, 2013 at 11:42 AM, Mark Grover <
> grover.markgro...@gmail.com>
> > wrote:
> >>
> >> Marc,
> >> It seemed to work on my installation of Hive 0.9. Is this a table or a
> >> view you are trying to drop?
> >> Mind sharing the create table definition?
> >>
> >> Mark
> >>
> >>
> >> On Thu, Jan 31, 2013 at 10:42 AM, Marc Limotte 
> >> wrote:
> >>>
> >>> Hi,
> >>>
> >>> I'm testing with Hive 0.9.0 (in Amazon EC2, but NOT emr).  I'm
> >>> experiencing a problem where DROP TABLE does not respect the IF EXISTS
> >>> clause, so it still throws an error when the table doesn't exist and
> this
> >>> causes the script to stop executing.  Here's what it looks like from
> the
> >>> hive shell:
> >>>
> >>> hive> DROP TABLE IF EXISTS recalc_aggregate_premium;
> >>> FAILED: Error in semantic analysis: Table not found
> >>> recalc_aggregate_premium
> >>>
> >>>
> >>> Marc
> >>>
> >>>
> >>
> >
>
>
>
> --
> Harsh J
>


Re: Hive and Hbase integration issue

2013-01-31 Thread kulkarni . swarnim
If you go to /tmp//hive.log you would get a detailed explanation on what 
might be wrong. Can you provide that?

From here atleast, it seems like a classpath issue of hive not being able to 
find the hbase handler jar which can be solved by 'add jar 
hive-hbase-handler-xxx.jar'.

On Jan 31, 2013, at 2:17 PM, Asher Devuyst  wrote:

> I have Hbase running in distributed mode in a 4 node cluster working great.
> Installed Hive today on 5th box and pointed Hive to Mysql and Hbase.
> 
> I start up the hive shell and go to make a table, based on an existing hbase 
> table I get the following exception:
> 
> adev@stg-hive-01:~$ hive
> WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use 
> org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties files.
> Logging initialized using configuration in 
> jar:file:/usr/lib/hive/lib/hive-common-0.8.1-cdh4.0.1.jar!/hive-log4j.properties
> Hive history file=/tmp/adev/hive_job_log_adev_201301312014_839897667.txt
> SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
> SLF4J: Defaulting to no-operation (NOP) logger implementation
> SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further 
> details.
> hive> CREATE EXTERNAL TABLE hbase_raw_data(key string, value string) STORED 
> BY 'org.apache..hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES 
> ("hbase.columns.mapping" = "data:raw") TBLPROPERTIES("hbase.table.name" = 
> "raw_data");
> Failed with exception org.apache.hadoop.hive.ql.metadata.HiveException: Error 
> in loading storage handler.org/apache//hadoop/hive/hbase/HBaseStorageHandler
> FAILED: Execution Error, return code 1 from 
> org.apache.hadoop.hive.ql.exec.DDLTask
> hive> 
> 
> Please advise.
> 
> 
> 


Re: DROP TABLE does not respect the IF EXISTS clause

2013-01-31 Thread Harsh J
Not sure how relevant it is but I faced a similar problem around ALTER
TABLE DROP PARTITION IF EXIST.

See https://issues.apache.org/jira/browse/HIVE-3576 for the specific
issue and my commands to reproduce it, and also try to perhaps set
hive.exec.drop.ignorenonexistent to true to see if it changes anything
for you?

On Fri, Feb 1, 2013 at 3:27 AM, Marc Limotte  wrote:
> Hi Mark,
>
> A table.  But it doesn't seem to matter.  I get this error on the DROP,
> before even attempting to create a table.  I get the same thing for any
> arbitrary table name.  For example:
>
> hive> DROP TABLE IF EXISTS kdsjhfkjhds;
> FAILED: Error in semantic analysis: Table not found kdsjhfkjhds
>
>
> I think I found something, though.  This install is still using the Derby
> metastore, and the hive web service is running, so I'm getting errors like
> "A read-only user or a user in a read-only database…".  I'm guessing the
> error above is just a consequence of this one-user limitation.  So, the real
> issue is that the error message reported by "DROP TABLE IF EXISTS" is
> mis-leading and obscures the real problem.
>
>
> thanks,
> Marc
>
> On Thu, Jan 31, 2013 at 11:42 AM, Mark Grover 
> wrote:
>>
>> Marc,
>> It seemed to work on my installation of Hive 0.9. Is this a table or a
>> view you are trying to drop?
>> Mind sharing the create table definition?
>>
>> Mark
>>
>>
>> On Thu, Jan 31, 2013 at 10:42 AM, Marc Limotte 
>> wrote:
>>>
>>> Hi,
>>>
>>> I'm testing with Hive 0.9.0 (in Amazon EC2, but NOT emr).  I'm
>>> experiencing a problem where DROP TABLE does not respect the IF EXISTS
>>> clause, so it still throws an error when the table doesn't exist and this
>>> causes the script to stop executing.  Here's what it looks like from the
>>> hive shell:
>>>
>>> hive> DROP TABLE IF EXISTS recalc_aggregate_premium;
>>> FAILED: Error in semantic analysis: Table not found
>>> recalc_aggregate_premium
>>>
>>>
>>> Marc
>>>
>>>
>>
>



-- 
Harsh J


Re: Can hive show external table filenames?

2013-01-31 Thread Keith Wiley
Thanks, that seems like a reasonable summary of my options.

Cheers!

On Jan 31, 2013, at 14:38 , Edward Capriolo wrote:

> You can execute dfs commands from inside hive
> 
> hive>dfs -ls
> 
> You can also use virtual columns inside a select
> 
> https://cwiki.apache.org/Hive/languagemanual-virtualcolumns.html
> 
> However there is no direct command in hive to list the files in a
> table/partition.
> 
> On Thu, Jan 31, 2013 at 4:55 PM, Keith Wiley  wrote:
>> Hmmm, that doesn't seem to list the files in the directory.
>> 
>> On Jan 31, 2013, at 12:12 , Edward Capriolo wrote:
>> 
>>> Try
>>> describe extended 
>>> or
>>> describe extended  ()
>>> 
>>> the location is one of the properties
>>> 
>>> Edward
>>> 
>>> 
>>> On Thu, Jan 31, 2013 at 2:37 PM, Keith Wiley  wrote:
 "show tables" shows the HDFS directories which correspond to Hive tables 
 and various select queries show data from inside the files (each row of a 
 file being a row of the overarching table that the entire directory 
 represents)...or so I have convinced myself...but can Hive show the HDFS 
 filenames?  Or is "hadoop fs -ls" the only way to do that?
 
 Thanks.



Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com

"Yet mark his perfect self-contentment, and hence learn his lesson, that to be
self-contented is to be vile and ignorant, and that to aspire is better than to
be blindly and impotently happy."
   --  Edwin A. Abbott, Flatland




Re: Can hive show external table filenames?

2013-01-31 Thread Edward Capriolo
You can execute dfs commands from inside hive

hive>dfs -ls

You can also use virtual columns inside a select

https://cwiki.apache.org/Hive/languagemanual-virtualcolumns.html

However there is no direct command in hive to list the files in a
table/partition.

On Thu, Jan 31, 2013 at 4:55 PM, Keith Wiley  wrote:
> Hmmm, that doesn't seem to list the files in the directory.
>
> On Jan 31, 2013, at 12:12 , Edward Capriolo wrote:
>
>> Try
>> describe extended 
>> or
>> describe extended  ()
>>
>> the location is one of the properties
>>
>> Edward
>>
>>
>> On Thu, Jan 31, 2013 at 2:37 PM, Keith Wiley  wrote:
>>> "show tables" shows the HDFS directories which correspond to Hive tables 
>>> and various select queries show data from inside the files (each row of a 
>>> file being a row of the overarching table that the entire directory 
>>> represents)...or so I have convinced myself...but can Hive show the HDFS 
>>> filenames?  Or is "hadoop fs -ls" the only way to do that?
>>>
>>> Thanks.
>
>
> 
> Keith Wiley kwi...@keithwiley.com keithwiley.com
> music.keithwiley.com
>
> "You can scratch an itch, but you can't itch a scratch. Furthermore, an itch 
> can
> itch but a scratch can't scratch. Finally, a scratch can itch, but an itch 
> can't
> scratch. All together this implies: He scratched the itch from the scratch 
> that
> itched but would never itch the scratch from the itch that scratched."
>--  Keith Wiley
> 
>


Re: [VOTE] Amend Hive Bylaws + Add HCatalog Submodule

2013-01-31 Thread Vinod Kumar Vavilapalli
+1 and +1 non-binding.

Great to see this happen!

Thanks,
+Vinod


On Thu, Jan 31, 2013 at 12:14 AM, Namit Jain  wrote:

> +1 and +1
>
> On 1/30/13 6:53 AM, "Gunther Hagleitner" 
> wrote:
>
> >+1 and +1
> >
> >Thanks,
> >Gunther.
> >
> >
> >On Tue, Jan 29, 2013 at 5:18 PM, Edward Capriolo
> >wrote:
> >
> >> Measure 1: +1
> >> Measure 2: +1
> >>
> >> On Mon, Jan 28, 2013 at 2:47 PM, Carl Steinbach  wrote:
> >>
> >> > I am calling a vote on the following two measures.
> >> >
> >> > Measure 1: Amend Hive Bylaws to Define Submodules and Submodule
> >> Committers
> >> >
> >> > If this measure passes the Apache Hive Project Bylaws will be
> >> > amended with the following changes:
> >> >
> >> >
> >> >
> >>
> >>
> https://cwiki.apache.org/confluence/display/Hive/Proposed+Changes+to+Hive
> >>+Bylaws+for+Submodule+Committers
> >> >
> >> > The motivation for these changes is discussed in the following
> >> > email thread which appeared on the hive-dev and hcatalog-dev
> >> > mailing lists:
> >> >
> >> > http://markmail.org/thread/u5nap7ghvyo7euqa
> >> >
> >> >
> >> > Measure 2: Create HCatalog Submodule and Adopt HCatalog Codebase
> >> >
> >> > This measure provides for 1) the establishment of an HCatalog
> >> > submodule in the Apache Hive Project, 2) the adoption of the
> >> > Apache HCatalog codebase into the Hive HCatalog submodule, and
> >> > 3) adding all currently active HCatalog committers as submodule
> >> > committers on the Hive HCatalog submodule.
> >> >
> >> > Passage of this measure depends on the passage of Measure 1.
> >> >
> >> >
> >> > Voting:
> >> >
> >> > Both measures require +1 votes from 2/3 of active Hive PMC
> >> > members in order to pass. All participants in the Hive project
> >> > are encouraged to vote on these measures, but only votes from
> >> > active Hive PMC members are binding. The voting period
> >> > commences immediately and shall last a minimum of six days.
> >> >
> >> > Voting is carried out by replying to this email thread. You must
> >> > indicate which measure you are voting on in order for your vote
> >> > to be counted.
> >> >
> >> > More details about the voting process can be found in the Apache
> >> > Hive Project Bylaws:
> >> >
> >> > https://cwiki.apache.org/confluence/display/Hive/Bylaws
> >> >
> >> >
> >>
>
>


-- 
+Vinod
Hortonworks Inc.
http://hortonworks.com/


Re: DROP TABLE does not respect the IF EXISTS clause

2013-01-31 Thread Marc Limotte
Hi Mark,

A table.  But it doesn't seem to matter.  I get this error on the DROP,
before even attempting to create a table.  I get the same thing for any
arbitrary table name.  For example:

hive> DROP TABLE IF EXISTS kdsjhfkjhds;
FAILED: Error in semantic analysis: Table not found kdsjhfkjhds


I think I found something, though.  This install is still using the Derby
metastore, and the hive web service is running, so I'm getting errors like
"A read-only user or a user in a read-only database…".  I'm guessing the
error above is just a consequence of this one-user limitation.  So, the
real issue is that the error message reported by "DROP TABLE IF EXISTS" is
mis-leading and obscures the real problem.


thanks,
Marc

On Thu, Jan 31, 2013 at 11:42 AM, Mark Grover
wrote:

> Marc,
> It seemed to work on my installation of Hive 0.9. Is this a table or a
> view you are trying to drop?
> Mind sharing the create table definition?
>
> Mark
>
>
> On Thu, Jan 31, 2013 at 10:42 AM, Marc Limotte wrote:
>
>> Hi,
>>
>> I'm testing with Hive 0.9.0 (in Amazon EC2, but NOT emr).  I'm
>> experiencing a problem where DROP TABLE does not respect the IF EXISTS
>> clause, so it still throws an error when the table doesn't exist and this
>> causes the script to stop executing.  Here's what it looks like from the
>> hive shell:
>>
>> hive> DROP TABLE IF EXISTS recalc_aggregate_premium;
>>
>> FAILED: Error in semantic analysis: Table not found
>> recalc_aggregate_premium
>>
>>
>> Marc
>>
>>
>>
>


Re: Can hive show external table filenames?

2013-01-31 Thread Keith Wiley
Hmmm, that doesn't seem to list the files in the directory.

On Jan 31, 2013, at 12:12 , Edward Capriolo wrote:

> Try
> describe extended 
> or
> describe extended  ()
> 
> the location is one of the properties
> 
> Edward
> 
> 
> On Thu, Jan 31, 2013 at 2:37 PM, Keith Wiley  wrote:
>> "show tables" shows the HDFS directories which correspond to Hive tables and 
>> various select queries show data from inside the files (each row of a file 
>> being a row of the overarching table that the entire directory 
>> represents)...or so I have convinced myself...but can Hive show the HDFS 
>> filenames?  Or is "hadoop fs -ls" the only way to do that?
>> 
>> Thanks.



Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com

"You can scratch an itch, but you can't itch a scratch. Furthermore, an itch can
itch but a scratch can't scratch. Finally, a scratch can itch, but an itch can't
scratch. All together this implies: He scratched the itch from the scratch that
itched but would never itch the scratch from the itch that scratched."
   --  Keith Wiley




Re: Can hive show external table filenames?

2013-01-31 Thread Edward Capriolo
Try
describe extended 
or
describe extended  ()

the location is one of the properties

Edward


On Thu, Jan 31, 2013 at 2:37 PM, Keith Wiley  wrote:
> "show tables" shows the HDFS directories which correspond to Hive tables and 
> various select queries show data from inside the files (each row of a file 
> being a row of the overarching table that the entire directory 
> represents)...or so I have convinced myself...but can Hive show the HDFS 
> filenames?  Or is "hadoop fs -ls" the only way to do that?
>
> Thanks.
>
> 
> Keith Wiley kwi...@keithwiley.com keithwiley.com
> music.keithwiley.com
>
> "The easy confidence with which I know another man's religion is folly teaches
> me to suspect that my own is also."
>--  Mark Twain
> 
>


Re: DROP TABLE does not respect the IF EXISTS clause

2013-01-31 Thread Mark Grover
Marc,
It seemed to work on my installation of Hive 0.9. Is this a table or a view
you are trying to drop?
Mind sharing the create table definition?

Mark

On Thu, Jan 31, 2013 at 10:42 AM, Marc Limotte  wrote:

> Hi,
>
> I'm testing with Hive 0.9.0 (in Amazon EC2, but NOT emr).  I'm
> experiencing a problem where DROP TABLE does not respect the IF EXISTS
> clause, so it still throws an error when the table doesn't exist and this
> causes the script to stop executing.  Here's what it looks like from the
> hive shell:
>
> hive> DROP TABLE IF EXISTS recalc_aggregate_premium;
>
> FAILED: Error in semantic analysis: Table not found
> recalc_aggregate_premium
>
>
> Marc
>
>
>


Can hive show external table filenames?

2013-01-31 Thread Keith Wiley
"show tables" shows the HDFS directories which correspond to Hive tables and 
various select queries show data from inside the files (each row of a file 
being a row of the overarching table that the entire directory represents)...or 
so I have convinced myself...but can Hive show the HDFS filenames?  Or is 
"hadoop fs -ls" the only way to do that?

Thanks.


Keith Wiley kwi...@keithwiley.com keithwiley.commusic.keithwiley.com

"The easy confidence with which I know another man's religion is folly teaches
me to suspect that my own is also."
   --  Mark Twain




DROP TABLE does not respect the IF EXISTS clause

2013-01-31 Thread Marc Limotte
Hi,

I'm testing with Hive 0.9.0 (in Amazon EC2, but NOT emr).  I'm experiencing
a problem where DROP TABLE does not respect the IF EXISTS clause, so it
still throws an error when the table doesn't exist and this causes the
script to stop executing.  Here's what it looks like from the hive shell:

hive> DROP TABLE IF EXISTS recalc_aggregate_premium;

FAILED: Error in semantic analysis: Table not found recalc_aggregate_premium


Marc


Re: [VOTE] Amend Hive Bylaws + Add HCatalog Submodule

2013-01-31 Thread Namit Jain
+1 and +1

On 1/30/13 6:53 AM, "Gunther Hagleitner" 
wrote:

>+1 and +1
>
>Thanks,
>Gunther.
>
>
>On Tue, Jan 29, 2013 at 5:18 PM, Edward Capriolo
>wrote:
>
>> Measure 1: +1
>> Measure 2: +1
>>
>> On Mon, Jan 28, 2013 at 2:47 PM, Carl Steinbach  wrote:
>>
>> > I am calling a vote on the following two measures.
>> >
>> > Measure 1: Amend Hive Bylaws to Define Submodules and Submodule
>> Committers
>> >
>> > If this measure passes the Apache Hive Project Bylaws will be
>> > amended with the following changes:
>> >
>> >
>> >
>> 
>>https://cwiki.apache.org/confluence/display/Hive/Proposed+Changes+to+Hive
>>+Bylaws+for+Submodule+Committers
>> >
>> > The motivation for these changes is discussed in the following
>> > email thread which appeared on the hive-dev and hcatalog-dev
>> > mailing lists:
>> >
>> > http://markmail.org/thread/u5nap7ghvyo7euqa
>> >
>> >
>> > Measure 2: Create HCatalog Submodule and Adopt HCatalog Codebase
>> >
>> > This measure provides for 1) the establishment of an HCatalog
>> > submodule in the Apache Hive Project, 2) the adoption of the
>> > Apache HCatalog codebase into the Hive HCatalog submodule, and
>> > 3) adding all currently active HCatalog committers as submodule
>> > committers on the Hive HCatalog submodule.
>> >
>> > Passage of this measure depends on the passage of Measure 1.
>> >
>> >
>> > Voting:
>> >
>> > Both measures require +1 votes from 2/3 of active Hive PMC
>> > members in order to pass. All participants in the Hive project
>> > are encouraged to vote on these measures, but only votes from
>> > active Hive PMC members are binding. The voting period
>> > commences immediately and shall last a minimum of six days.
>> >
>> > Voting is carried out by replying to this email thread. You must
>> > indicate which measure you are voting on in order for your vote
>> > to be counted.
>> >
>> > More details about the voting process can be found in the Apache
>> > Hive Project Bylaws:
>> >
>> > https://cwiki.apache.org/confluence/display/Hive/Bylaws
>> >
>> >
>>