Re: Data Type Validation in Hive?

2010-06-02 Thread yongqiang he
Right now Hive does not do data validation when loading data into a table. If you load some wrong data which does not conform the table definition, queries on that table may fail or results are meaningless. On Wed, Jun 2, 2010 at 11:09 PM, Pavan wrote: > Dear Hive Community, > I've been trying to

Data Type Validation in Hive?

2010-06-02 Thread Pavan
Dear Hive Community, I've been trying to see if Hive (0.5.0) supports data type validation when loading data into it. My initial experiments show me that if it is of wrong data type (vs the table definition), the values seem to be NULL. Is it correct? Can anyone point to useful resources with res

Re: Error while using Hive JDBC to execute a create temporary UDF

2010-06-02 Thread Ryan LeCompte
Hi Vinithra, Yes, we registered the UDF with the ADD JAR command... and also the commands work fine in the CLI, it's only through the JDBC interface that it doesn't work. Could someone try executing one of these commands via JDBC to see if it's a legitimate bug in 0.5? Thanks! Ryan On Wed, Ju

Re: SerDe and Rows

2010-06-02 Thread Edward Capriolo
On Wed, Jun 2, 2010 at 3:17 PM, Sanjit Jhala wrote: > Thanks, that sounds great ! Would love to come to the meetup. Thanks for > all the work on the Storage Handlers, its really nifty stuff. > I'm getting close on the Hypertable storage handler and will definitely > send out pointers once its rea

Re: Error while using Hive JDBC to execute a create temporary UDF

2010-06-02 Thread Vinithra Varadharajan
Hi Ryan, Did you register the UDF with ADD JAR ? Note that you currently cannot register a jar that is on HDFS (HIVE-1157). In case you've already done the above, have you tried the query from the Hive CLI - do you get the same error? Also, could you attach the detailed logs from /tmp//hive? -V

Re: SerDe and Rows

2010-06-02 Thread Sanjit Jhala
Thanks, that sounds great ! Would love to come to the meetup. Thanks for all the work on the Storage Handlers, its really nifty stuff. I'm getting close on the Hypertable storage handler and will definitely send out pointers once its ready. -Sanjit On Wed, Jun 2, 2010 at 11:56 AM, John Sichi wro

Re: SerDe and Rows

2010-06-02 Thread John Sichi
Based on some recent offline discussions, it looks like CloudEra will be taking the lead on driving the release process for 0.6, so expect to see some initial plans on that here soon. We're thinking of classifying new features and frameworks as stable vs experimental. For 0.6, items like stora

Error while using Hive JDBC to execute a create temporary UDF

2010-06-02 Thread Ryan LeCompte
Hey guys, We have a very simple JDBC client that uses the Hive JDBC driver to execute queries. We are trying to use it to execute a simple "create temporary function ..." statement, but Hive is throwing the following error: Exception in thread "main" java.sql.SQLException: Query returned non-zero

Re: SerDe and Rows

2010-06-02 Thread Sanjit Jhala
Any idea when the next Hive release is scheduled for and whether the Storage Handler code will be included ? Also I'm currently using a snapshot from the trunk at commit: *commit bf7e3b9cc6c6ceced2dec70f0971ecc91fd0dcb3* *Author: Namit Jain Date: Thu May 6 19:05:52 2010 + HIVE-1317. C

How to parse and load file which does not have new line as row delimiter

2010-06-02 Thread Bakshi, Ankita
Hi, I am trying to load a file into hive table, but it is not terminated by new line. I am wondering if this is possible directly through hive inbuilt commands or custom SerDe for it. The line terminator seems to be the date string. My file looks like this: 20 May 2010 16:59:52,329 [http-7280-1

Re: Java transform script

2010-06-02 Thread Vinithra Varadharajan
Hi Fan, Can you give us more information on what you're trying to achieve with this script. Perhaps you could include the relevant portion of your code? -Vinithra On Wed, Jun 2, 2010 at 8:37 AM, Fan Yang wrote: > I was trying to write a transform script in java. I simply used system.inand >

Java transform script

2010-06-02 Thread Fan Yang
I was trying to write a transform script in java. I simply used system.in and system.out, but didn't work out. Does anyone know how to write a java script, or some example? Any suggestions will be much appreciated! Thanks a lot! Fan.