Re: Can I get started with a plain java app?

2024-05-17 Thread Jean-Baptiste Onofré
Hi, I'm working on a Camel Component that use purely java to ingest data (and also scan table): https://github.com/jbonofre/iceberg/blob/CAMEL/camel/camel-iceberg/src/main/java/org/apache/iceberg/camel/IcebergProducer.java NB: it's still a WIP, I'm working on it and I will share a proposal on

Re: Can I get started with a plain java app?

2024-05-16 Thread Steven Wu
Iceberg has a Java library, which is the most complete implementation of the spec (compared to other languages like Python, Rust) at the moment. You can certainly use the Java library directly to write and commit data to Iceberg. But you will likely need to implement quite a bit of code for things

Can I get started with a plain java app?

2024-05-16 Thread John D. Ament
Completely naive question since I'm not familiar at all with the technologies. I wanted to demonstrate using Iceberg files as a way to ingest lots of data and persist it to S3. It seems like it can do this, but I have a feeling I need tools like Spark to do it. is that true? or can I hook it up