Hi,
I am trying to use mysql_server-5.1.41.0 as the local db for hive
following instructions at
http://wiki.apache.org/hadoop/Hive/AdminManual/MetastoreAdmin#Local_Meta
store
I get the following exception:
FAILED: Error in metadata: MetaException(message:Got exception:
javax.jdo.JDODataStoreE
y 12, 2010 11:56 AM
To: hive-user@hadoop.apache.org
Subject: Re: Help regarding mysql setup for metastore
On Wed, May 12, 2010 at 2:14 PM, Pradeep Kamath
wrote:
Hi,
I am trying to use mysql_server-5.1.41.0 as the local db for hive
following instructions at
http://wiki.apache.org/hadoop/Hiv
: Re: Help regarding mysql setup for metastore
Hi Pradeep,
Changing the MySQL settings does not change existing tables. You may
need to convert them:
http://dev.mysql.com/doc/refman/5.0/en/charset-conversion.html
On Wed, May 12, 2010 at 4:27 PM, Pradeep Kamath wrote:
> Here are the settings I
Hi,
Can hive metastore be setup with Oracle as backend without any code
changes? Has anyone tried this? Any pointers would be much appreciated.
Thanks,
Pradeep
From: Aaron McCurry [mailto:amccu...@gmail.com]
Sent: Monday, May 24, 2010 1:42 PM
To: hive-user@hadoop.apache.org
Subject: Re: metastore set up with Oracle backend?
I have done it, everything seemed to work just fine.
Aaron
On Mon, May 24, 2010 at 4:37 PM, Pradeep Kamath
wrote
/sonalgoyal
On Tue, May 25, 2010 at 10:00 PM, Pradeep Kamath wrote:
>
> Hi Aaron,
>
> Can you share some details along the lines of what is described in
> http://wiki.apache.org/hadoop/Hive/AdminManual/MetastoreAdmin#Local_Metastore
> for MySQL? (Essentially what changes are ne
ve's classpath (e.g. by referencing it in
HIVE_AUX_JARS_PATH). If this does not work out of the box I recommend
consulting the documentation that comes with your JDBC driver.
Thanks.
Carl
On Tue, May 25, 2010 at 11:12 AM, Pradeep Kamath
wrote:
Hi Sonal,
I want to set up hive
acle thin
JDBC driver (or some other JDBC driver that supports Oracle) and make
sure that it is available in Hive's classpath (e.g. by referencing it
in HIVE_AUX_JARS_PATH). If this does not work out of the box I
recommend consulting the documentation that comes with your JDBC drive
? Oracle allows multiple CLOB fields
on the same table, but only one LONG VARCHAR (legacy crud).
JVS
From: Pradeep Kamath [prade...@yahoo-inc.com]
Sent: Friday, June 04, 2010 9:22 AM
To: hive-user@hadoop.apache.org
Subject: Re: metastore set up with Oracle
Hi,
Are there any logs created when running the metastore using "bin/hive
-service metastore" ? From what I can tell this command generates output
on the screen and runs in the foreground. Would the right way to run
this as a server be "bin/hive -service metstatore > metastore.log 2>&1
&" ? Is t
here a recommended way to identify the metastore server process?
Thanks,
Pradeep
________
From: Pradeep Kamath [mailto:prade...@yahoo-inc.com]
Sent: Wednesday, June 09, 2010 3:10 PM
To: hive-user@hadoop.apache.org
Subject: Logs when running metastore
Hi,
Are t
Hi,
I am trying to create an external table against already existing
data in sequencefile format. However I have written a custom Serde to
interpret the data. I am able to create the table fine but get the
exception shown in the session output below when I try to add partition
- any help would
need to be key-value pairs. partition key `action`
seems missed the value.
Thanks
Yongqiang
On Wed, Jun 16, 2010 at 5:22 PM, Pradeep Kamath
wrote:
Hi,
I am trying to create an external table against already existing
data in sequencefile format. However I have written a custom Serde to
int
ecute(Driver.java:504)
Any help is much appreciated.
Pradeep
From: Ashish Thusoo [mailto:athu...@facebook.com]
Sent: Thursday, June 17, 2010 11:15 AM
To: hive-user@hadoop.apache.org
Subject: RE: alter table add partition error
hmm... Can you send t
.xml and hdfs-default.xml
respectively
Hive history
file=/tmp/pradeepk/hive_job_log_pradeepk_201006181014_598649843.txt
OK
Time taken: 5.849 seconds
Is there some thrift setting I am missing or is this a bug? - If it is
the latter, I can open a jira with the above details.
Thanks,
Pradeep
Hi,
I wanted to implement a UDF which takes the entire row of input as
argument. Unfortunately when I call it using select myudf(*) from my
table, I get :
FAILED: Parse Error: line 1:16 mismatched input '*' expecting ) in
function specification
Is this not allowed?
Thanks,
Pradeep
Hi,
I have data with complex types (map, struct, array of maps) stored as
a text file. I am able to successfully create an external table based on
this data and further build a lateral view on it:
hive -e 'select rownum, bag_item from complex_text LATERAL VIEW
explode(bagofmap) explodedTable
working copy and see if that addresses your problem.
Also feel free to ask questions regarding anything that this patch
provides.
Arvind
On Wed, Jul 7, 2010 at 4:35 PM, Pradeep Kamath
wrote:
Hi,
I wanted to implement a UDF which takes the entire row of input as
argument. Unfortunatel
Any pointers?
Thanks,
Pradeep
From: Pradeep Kamath [mailto:prade...@yahoo-inc.com]
Sent: Wednesday, July 07, 2010 4:47 PM
To: hive-user@hadoop.apache.org
Subject: Complex types, lateral view and RCFile
Hi,
I have data with complex types (map
: RE: Complex types, lateral view and RCFile
This seems like an issue with the column pruner - can you try 'set
hive.optimize.cp=false' and then re-run the query?
From: Pradeep Kamath [mailto:prade...@yahoo-inc.com]
Sent: Thursday, July 08, 2010 3:57 PM
To: hive-user@hadoop.
Hi,
I suspect this is true but wanted to confirm: If I start a thrift
metastore service as user "joe" then all internal tables created will
have directories under the warehouse directory owned by "joe" regardless
of the actual user running the create table statement - is this correct?
There is
al Message-
From: Edward Capriolo [mailto:edlinuxg...@gmail.com]
Sent: Tuesday, July 13, 2010 2:47 PM
To: hive-user@hadoop.apache.org
Subject: Re: Thrift metastore server and dfs file owner
On Tue, Jul 13, 2010 at 5:04 PM, Pradeep Kamath wrote:
> Hi,
>
> I suspect this is true but wa
ue, Jul 13, 2010 at 6:20 PM, Pradeep Kamath wrote:
> I tried:
> hive -e "set user.name=$USER;create table foo2 ( name string);"
>
> My warehouse table dir still got created by "root" (the user my thrift server
> is running as)
> drwxr-xr-x - root supergroup
shish
-Original Message-
From: Pradeep Kamath [mailto:prade...@yahoo-inc.com]
Sent: Wednesday, July 14, 2010 11:14 AM
To: hive-user@hadoop.apache.org
Subject: RE: Thrift metastore server and dfs file owner
dfs.permissions
true
..
dfs.permissions.supergroup
hdfs
You mentioned: "I th
/group
credentials.
Thoughts?
Pradeep
-Original Message-
From: Pradeep Kamath [mailto:prade...@yahoo-inc.com]
Sent: Thursday, July 15, 2010 10:23 AM
To: hive-user@hadoop.apache.org
Subject: RE: Thrift metastore server and dfs file owner
Currently group information is not present in the
scripts that rely on this property for
copying/moving files. Also, table renaming code would need to be
modified as well.
-Original Message-
From: Pradeep Kamath [mailto:prade...@yahoo-inc.com]
Sent: Monday, July 19, 2010 10:24 AM
To: hive-user@hadoop.apache.org
Subject: RE: Thrift
that, then that might be the best option.
From: Pradeep Kamath [mailto:prade...@yahoo-inc.com]
Sent: Monday, July 19, 2010 1:09 PM
To: hive-user@hadoop.apache.org
Subject: RE: Thrift metastore server and dfs file owner
I agree this will be an issue for
is this an acceptable solution - I can then open a jira with this
proposed solution.
Thoughts?
Pradeep
____
From: Pradeep Kamath [mailto:prade...@yahoo-inc.com]
Sent: Tuesday, July 20, 2010 10:10 AM
To: hive-user@hadoop.apache.org
Subject: RE: Thrift metast
Hi,
I am trying to understand the differences between managed Vs external
tables. From
http://wiki.apache.org/hadoop/Hive/StorageHandlers#Terminology:
"A managed table is one for which the definition is primarily managed in
Hive's metastore, and for whose data storage Hive is responsible. An
ex
checks to see if the directory were created by the
metastore call.
From: Pradeep Kamath [mailto:prade...@yahoo-inc.com]
Sent: Wednesday, July 21, 2010 9:07 AM
To: hive-user@hadoop.apache.org
Subject: RE: Thrift metastore server and dfs file owner
I favor the option of a conf variable
Hi,
What value does hive expect in the data for a column to be treated as null?
I tried some permutations on a text data based table but couldn't figure out
what the correct representation was. I tried empty string, the string NULL and
the string null for a string column and in all three case
Hi,
I am trying to insert overwrite into a partitioned table reading data from a
non partitioned table and seeing a failure in the second map reduce job -
wonder if I am doing something wrong - any pointers appreciated (I am using
latest trunk code against hadoop 20 cluster). Details below[1]
Hi,
Any help in debugging the issue I am seeing below will be greatly
appreciated. Unless I am doing something wrong, this seems to be a regression
in trunk.
Thanks,
Pradeep
From: Pradeep Kamath [mailto:prade...@yahoo-inc.com]
Sent: Friday, September 24, 2010
g and see what errors/exceptions are there?
On Sep 27, 2010, at 9:10 AM, Pradeep Kamath wrote:
Hi,
Any help in debugging the issue I am seeing below will be greatly
appreciated. Unless I am doing something wrong, this seems to be a
regression in trunk.
Thanks,
Pradeep
______
Here is some relevant stuff from /tmp/pradeepk/hive.logs - can't make
much out of it:
2010-09-27 17:40:01,081 INFO exec.MapRedTask
(SessionState.java:printInfo(268)) - Starting Job =
job_201009251752_1341, Tracking URL =
http://:50030/jobdetails.jsp?jobid=job_201009251752_1341
2010-09-27 17:
wrote:
Pradeep, you might be hitting HADOOP-5759 and the job is not getting
initialized at all. Look in JobTracker logs for the jobid to confirm
the same.
On 9/28/10 6:28 AM, "Pradeep Kamath" wrote:
Here is some relevant stuff from /tmp/pradeepk/hive.logs - can't
make much
Should I open a jira for this? So far it seems like a regression.
Pradeep
From: Pradeep Kamath [mailto:prade...@yahoo-inc.com]
Sent: Tuesday, September 28, 2010 9:32 AM
To: hive-user@hadoop.apache.org
Subject: Re: Regression in trunk? (RE: Insert overwrite error
ormat with
the Hadoop version you are using. Again, the first thing is to check the task
log through the tracking URL.
Tracking URL =
http://:50030/jobdetails.jsp?jobid=job_201009251752_1341
On Sep 27, 2010, at 5:58 PM, Pradeep Kamath wrote:
Here is some relevant stuff from /tmp/pradeepk
38 matches
Mail list logo
