Re: S3 example in Java

Correct. You should just need to set the warehouse path so that the new table is created in S3. You can also create a table with a specific path. On Wed, Jun 24, 2020 at 11:39 AM Chen Song wrote: > Thanks Ryan/Edgar. > > I understand that I need to create a table via HiveCatalog. I already > suc

Re: S3 example in Java

Thanks Ryan/Edgar. I understand that I need to create a table via HiveCatalog. I already successfully set up a hive megastore for this and successfully created an Iceberg with that. I meant to create an Iceberg backed by data files created on S3. Sorry if my question was unclear. It seems like tha

Re: S3 example in Java

Chen, We have a getting started page that covers creating a table using the HiveCatalog: https://iceberg.apache.org/getting-started/#creating-a-table I agree with Edgar that you probably want to start with a HiveCatalog table. By default, tables are created under your warehouse path. If that's an

Re: S3 example in Java

Hi Chen, Since S3 does not have atomic rename operation, for create/write/read of tables in S3 currently the only way to do it is via the HiveCatalog implementation which requires a Hive metastore with Lock support to provide the atomic commit required by Iceberg. You can alternatively write your

S3 example in Java

Hi Are there any Java examples to create/write/read tables backed by S3? I tried to search in the documentation and github but did not find anything. Thanks Chen