ov 6, 2019 at 7:09 AM Christine Mathiesen
> wrote:
>
>> Hey again!
>>
>>
>>
>> A quick question on Iceberg and Hive - is there any work going on around
>> integrating the two together so that you can read and write Iceberg tables
>> from Hive? Or
f Spark code and tested it and
it worked.
On Wed, Nov 6, 2019 at 7:09 AM Christine Mathiesen
wrote:
> Hey again!
>
>
>
> A quick question on Iceberg and Hive - is there any work going on around
> integrating the two together so that you can read and write Iceberg tables
> from H
Hey again!
A quick question on Iceberg and Hive - is there any work going on around
integrating the two together so that you can read and write Iceberg tables from
Hive? Or for converting Hive tables to Iceberg?
Thanks!
Christine Mathiesen
Software Development Intern
BDP – Hotels.com
Expedia
rom: *Ryan Blue
> *Reply-To: *"rb...@netflix.com"
> *Date: *Tuesday, January 8, 2019 at 3:13 PM
> *To: *Vladi Feigin
> *Cc: *Arvind Pruthi , "dev@iceberg.apache.org" <
> dev@iceberg.apache.org>, Owen O'Malley , "
> rdb...@netflix.com" , Iceberg
;
, Owen O'Malley ,
"rdb...@netflix.com" , Iceberg Developers
Subject: Re: Iceberg and Hive
> when iceberg-hive will be integrated into Presto and Spark - does it mean
> that an Iceberg table created in Spark or Presto will be recorded in HMS and
> visible to other e
> when iceberg-hive will be integrated into Presto and Spark - does it mean
that an Iceberg table created in Spark or Presto will be recorded in HMS
and visible to other engines
These tables are visible to any HMS client, but not readable. An engine
needs Iceberg support to read and write Iceberg
Vladi,
We have similarities to what you describe.
While I agree that what Owen mentioned about an implementation of Hive's
Rawstore API will be really useful, I don't believe it fully answers Vladi's
question. I think the main concern here is smooth migration of existing clients
to iceberg tab
Vladi,
I'll add a little to Owen's answer for context. Owen was right that using
an Iceberg table in Hive will require some work implementing the RawStore
API. But the `iceberg-hive` module will currently use the Hive Metastore to
keep track of Iceberg metadata.
An Iceberg table isn't a Hive tabl
The group has moved to the Apache infrastructure, so we should use
dev@iceberg.apache.org .
What is required, but not started, is for someone to implement Hive's
RawStore API with an Iceberg backend. That would let you use Hive SQL
commands to manipulate the Iceberg tables.
.. Owen
On Mon, Jan
