I would take a look into how hive could possibly integrate with
zoo-keeper and/or cascading.I know cascading just added the capability
of working with hbase it its model.
Hi Joydeep,
How can I use Hive's java api to operate data sets stored in Hive? Could
you give me a simple example?
Thanks
Min
--
My research interests are distributed systems, parallel computing and
bytecode based virtual machine.
http://coderplay.javaeye.com
One way to interact with hive is by starting hives thrift server. If
you want to use the raw java API, I stole some code from the Command
Line Interface and made a simple driver program. (I attached it).
You could also take a look at the source hwi folder. That is how we
have multiple hive client
Okay, so our people here looked at this further. In the Hadoop source, the
exception is thrown every time the constructor is called so it means
nothing.
We're in a crunch to get this up and running today and would really
appreciate some help:
*The console hangs with any query that causes a map/re
Hi Huan,
I guess this problem is caused by incompatibility between hadoop 0.17.0 and
0.18.3. Please ignore my previous comments about compiling hive against
0.17.0 and use it on 0.18.3 then.
Can you try this?
*ant clean
ant -Dtarget.dir=/hive -Dhadoop.version='0.18.3' package
*
I took a deeper l
Hi Zheng, thank you for the speedy response!
Yes! that is exactly the problem/answer to that problem... After ant clean,
and rebuild, it ran without exceptions. Later it hung while we ran a query
that went to map reduce...
After some inspection, it was discovered that our hadoop cluster had a rac
Hey guys,
Thanks for all the help. I've posted my howto on my blog:
http://www.cultofgary.com/2009/02/24/making-php-talk-to-hive-through-thrift/
Thanks!
On Mon, Feb 23, 2009 at 2:58 PM, Gary Richardson
wrote:
> Hey guys,
>
> I've pretty much got everything working now with my php setup. Thanks
Hi Gary,
Thanks for putting this together! Please check out the patch for HIVE-299
and let me know if it works for you without having to deal with thrift
directly.
raghu
On 2/24/09 2:18 PM, "Gary Richardson" wrote:
> Hey guys,
>
> Thanks for all the help. I've posted my howto on my blog:
> ht
My bad. I meant that use Hive's java API to do raw mapreduce things, not
drive a sql.
Sorry!
On Wed, Feb 25, 2009 at 12:05 AM, Edward Capriolo wrote:
> One way to interact with hive is by starting hives thrift server. If
> you want to use the raw java API, I stole some code from the Command
> L
Please take a look at:
http://wiki.apache.org/hadoop/Hive/LanguageManual/Transform
You will have to create a string command and pass it to Hive. There is no
way of doing that directly (without creating a string) using Java API.
Zheng
On Tue, Feb 24, 2009 at 5:12 PM, Min Zhou wrote:
> My bad.
We can write a small example program to get files for a table/partition. To
open a table using deserializer and get rows from it etc.
This would help people write java map-reduce on hive tables.
From: Zheng Shao [mailto:zsh...@gmail.com]
Sent: Tuesday, February 2
Thanks you!
On Wed, Feb 25, 2009 at 10:15 AM, Joydeep Sen Sarma wrote:
> We can write a small example program to get files for a table/partition.
> To open a table using deserializer and get rows from it etc.
>
>
>
> This would help people write java map-reduce on hive tables.
>
>
> ---
Ok, just for posterity, I seemed to have gotten this working now. It seems
that specifying it in jpox.properties does not work. That is strange since
when I run it with verbose output, it says that it found jpox.properties but
I guess it doesn't use the values set there. hive-default.xml will work,
I think config values in hive-default.xml override the ones in jpox.properties
so if you had stale or incorrect props in hive-default but correct ones in
jpox.properties then it would be a problem.
From: Ryan Shih
Reply-To:
Date: Tue, 24 Feb 2009 18:35:10 -080
14 matches
Mail list logo
