Re: Re: Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-19 Thread Martijn Visser
Hi Abid, We should have a FLIP as this would be a code contribution. If you provide your Confluence user name, we can grant you access to create one. Is there also something from an Iceberg point of view needed to agree with the code contribution? Best regards, Martijn Op wo 19 okt. 2022 om

RE: Re: Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-19 Thread abmo . work
Thanks Martijn! Thanks for all the support and positive responses. I will start a vote thread and send it out to the dev list. Also, we need help with creation of a new repo for the Iceberg Connector. Can someone help with the creation of a repo? Please let me know if I need to create an

Re: Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-19 Thread Martijn Visser
Hi all, Thanks for the info and also thanks Peter and Steven for offering to volunteer. I think that's a great idea and a necessity. Overall +1 given the current ideas to make this contribution happen. BTW congrats on reaching Iceberg 1.0, a great accomplishment :) Thanks, Martijn On Tue,

Re: Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-17 Thread Steven Wu
I was one of the maintainers for the Flink Iceberg connector in Iceberg repo. I can volunteer as one of the initial maintainers if we decide to move forward. On Mon, Oct 17, 2022 at 3:26 PM wrote: > Hi Martijn, > > Yes, It is considered a connector in Flink terms. > > We wanted to join the

RE: Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-17 Thread abmo . work
Hi Martijn, Yes, It is considered a connector in Flink terms. We wanted to join the Flink connector externalization effort so that we can bring the Iceberg connector closer to the Flink community. We are hoping any issues with the APIs for Iceberg connector will surface sooner and get more

Re: Re: Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-12 Thread Martijn Visser
Hi, Just to double check: while I believe most Iceberg content refers to Iceberg as a format, it's considered as a connector in Flink terms, right? So there is no 'format' option to specify. And one more question: is there a specific goal or reason why you would want to contribute this to Flink

Re: Re: Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-12 Thread Danny Cranmer
+1 from me, let's open a VOTE thread to make this official. On Wed, Oct 12, 2022 at 1:37 PM Hang Ruan wrote: > +1, I have used the iceberg connector and catalog before. It is easy to > use. > > Márton Balassi 于2022年10月12日周三 16:38写道: > > > +1 from me, thanks for the clarification. > > > > On

Re: Re: Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-12 Thread Hang Ruan
+1, I have used the iceberg connector and catalog before. It is easy to use. Márton Balassi 于2022年10月12日周三 16:38写道: > +1 from me, thanks for the clarification. > > On Wed, Oct 12, 2022 at 7:57 AM Péter Váry > wrote: > > > Thanks Abid, > > > > Count me in, and drop a note, if I can help in any

Re: Re: Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-12 Thread Márton Balassi
+1 from me, thanks for the clarification. On Wed, Oct 12, 2022 at 7:57 AM Péter Váry wrote: > Thanks Abid, > > Count me in, and drop a note, if I can help in any way. > > Thanks, > Peter > > On Tue, Oct 11, 2022, 20:13 wrote: > > > Hi Martijn, > > > > Yes catalog integration exists and

Re: Re: Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-11 Thread Péter Váry
Thanks Abid, Count me in, and drop a note, if I can help in any way. Thanks, Peter On Tue, Oct 11, 2022, 20:13 wrote: > Hi Martijn, > > Yes catalog integration exists and catalogs can be created using Flink > SQL. > >

RE: Re: Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-11 Thread abmo . work
Hi Martijn, Yes catalog integration exists and catalogs can be created using Flink SQL. https://iceberg.apache.org/docs/latest/flink/#creating-catalogs-and-using-catalogs has more details. We may need some discussion within Iceberg community but based on the current iceberg-flink code

Re: Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-11 Thread Martijn Visser
Hi Abid, Thanks for the FLIP. I have a question about Iceberg's Catalog: has that integration between Flink and Iceberg been created already and are you looking to externalize that as well? Thanks, Martijn On Tue, Oct 11, 2022 at 12:14 AM wrote: > Hi Marton, > > Yes, we are initiating this

RE: Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-10 Thread abmo . work
Hi Marton, Yes, we are initiating this as part of the Externalize Flink Connectors effort. Plan is to externalize the existing Flink connector from Iceberg repo into a separate repo under the Flink umbrella. Sorry about the doc permissions! I was able to create a FLIP-267: