Thanks Abid for driving.
+1 for this.
Can you open the permissions for
https://docs.google.com/document/d/1WC8xkPiVdwtsKL2VSPAUgzm9EjrPs8ZRjEtcwv93ISI/edit?usp=sharing
?
Best,
Jingsong
On Mon, Oct 10, 2022 at 9:22 AM Abid Mohammed
wrote:
>
> Hi,
>
> I would like to start a discussion about con
Hi Abid,
Just to clarify does your suggestion mean that the Iceberg community would
like to remove the iceberg-flink connector from the Iceberg codebase and
maintain it under Flink instead? A new separate repo under the Flink
project umbrella given the current existing effort to extract connectors
+1, thanks to drive it
Abid Mohammed 于2022年10月10日周一 09:22写道：
> Hi,
>
> I would like to start a discussion about contributing Iceberg Flink
> Connector to Flink.
>
> I created a doc <
> https://docs.google.com/document/d/1WC8xkPiVdwtsKL2VSPAUgzm9EjrPs8ZRjEtcwv93ISI/edit?usp=sharing>
> with all th
+1. Thanks for driving it. Hope I can find some chances to take part in the
future development of Iceberg Flink Connector.
Best regards,
Yuxia
- 原始邮件 -
发件人: "Zheng Yu Chen"
收件人: "dev"
发送时间: 星期四, 2022年 10 月 13日 上午 11:26:29
主题: Re: [Discuss]- Donate Iceberg Flink C
> Best regards,
> Yuxia
>
> - 原始邮件 -
> 发件人: "Zheng Yu Chen"
> 收件人: "dev"
> 发送时间: 星期四, 2022年 10 月 13日 上午 11:26:29
> 主题: Re: [Discuss]- Donate Iceberg Flink Connector
>
> +1, thanks to drive it
>
> Abid Mohammed 于2022年10月10日周一 09:22写道：
> > 发件人: "Zheng Yu Chen"
> > 收件人: "dev"
> > 发送时间: 星期四, 2022年 10 月 13日 上午 11:26:29
> > 主题: Re: [Discuss]- Donate Iceberg Flink Connector
> >
> > +1, thanks to drive it
> >
> > Abid Mohammed 于2022年10月10日周一 09:22写道：
> >
&g
gt;> I'm also fine with maintaining it under the Flink project.
>>>>>> But I'm also interested in the response to Martijn's question.
>>>>>>
>>>>>> Besides, once the code is moved to the Flink project, are ther
;
收件人: "dev"
发送时间: 星期四, 2022年 10 月 20日 上午 6:33:40
主题: Re: [Discuss]- Donate Iceberg Flink Connector
Hi Martijn,
I created a FLIP for this, its FLIP 267: Iceberg Connector
<https://cwiki.apache.org/confluence/display/FLINK/FLIP+267:+Iceberg+Connector>
Please let me know if an
> Thanks everyone for all your responses! Looking forward to the next
> >>>> steps.
> >>>>>
> >>>>> Thanks
> >>>>> Abid
> >>>>>
> >>>>> On 2022/10/14 03:37:09 Jark Wu wrote:
> >>>>&g
t;
> > Feel sorry for raising a different voice in this dicussion, but I think
> it
> > deserves a further dicussion in dev mail list, at least it will help to
> get
> > Flink developer's attention to Iceberg.
> >
> > Best regards,
> > Yuxia
> >
connector in Flink terms.
> > > >>>>>
> > > >>>>> We wanted to join the Flink connector externalization effort so
> > that
> > > >> we
> > > >>>>> can bring the Iceberg connector closer to the Flink com
w features. For users, they may need
> > to
> > > > wait a much longer time before enjoying the new features of Icberg by
> > > using
> > > > Flink.
> > > >
> > > > 2: If we move it to a sepreate repositoy, I'm afrad of it'll l
omminuty to Flink community.
>> > > >
>> > > > But I have some concerns for moving the connector from Icberg
>> > repository
>> > > > to a separate connector under Flink umbrella:
>> > > >
>> > > > 1: If Iceberg
; >
> >> > > > Personaly, as a Flink contributor and main maintainer of Hive
> Flink
> >> > > > connector, I'm really glad to take part in Iceberg community for
> the
> >> > > > maintenance and future development of Icberg Flink con
gt; > > > Best regards,
>> >> > > > >
>> >> > > > > Martijn
>> >> > > > >
>> >> > > > > Op wo 19 okt. 2022 om 19:11 schreef
>>
>> >> > > > >
>> >> > > > >
Hi Marton,
Yes, we are initiating this as part of the Externalize Flink Connectors effort.
Plan is to externalize the existing Flink connector from Iceberg repo into a
separate repo under the Flink umbrella.
Sorry about the doc permissions! I was able to create a FLIP-267:
https://cwiki.apache
Hi Abid,
Thanks for the FLIP. I have a question about Iceberg's Catalog: has that
integration between Flink and Iceberg been created already and are you
looking to externalize that as well?
Thanks,
Martijn
On Tue, Oct 11, 2022 at 12:14 AM wrote:
> Hi Marton,
>
> Yes, we are initiating this as
rote:
>
> > +1. Thanks for driving it. Hope I can find some chances to take part in
> > the future development of Iceberg Flink Connector.
> >
> > Best regards,
> > Yuxia
> >
> > - 原始邮件 -
> > 发件人: "Zheng Yu Chen"
> > 收件人: "
t; > On Thu, 13 Oct 2022 at 17:52, yuxia wrote:
> >
> > > +1. Thanks for driving it. Hope I can find some chances to take part in
> > > the future development of Iceberg Flink Connector.
> > >
> > > Best regards,
> > > Yuxia
> > >
gt; > >
> > > > +1. Thanks for driving it. Hope I can find some chances to take part
> in
> > > > the future development of Iceberg Flink Connector.
> > > >
> > > > Best regards,
> > > > Yuxia
> > > >
> >
Hi Martijn,
Yes catalog integration exists and catalogs can be created using Flink SQL.
https://iceberg.apache.org/docs/latest/flink/#creating-catalogs-and-using-catalogs
has more details.
We may need some discussion within Iceberg community but based on the current
iceberg-flink code structure
Thanks Abid,
Count me in, and drop a note, if I can help in any way.
Thanks,
Peter
On Tue, Oct 11, 2022, 20:13 wrote:
> Hi Martijn,
>
> Yes catalog integration exists and catalogs can be created using Flink
> SQL.
>
> https://iceberg.apache.org/docs/latest/flink/#creating-catalogs-and-using-ca
+1 from me, thanks for the clarification.
On Wed, Oct 12, 2022 at 7:57 AM Péter Váry
wrote:
> Thanks Abid,
>
> Count me in, and drop a note, if I can help in any way.
>
> Thanks,
> Peter
>
> On Tue, Oct 11, 2022, 20:13 wrote:
>
> > Hi Martijn,
> >
> > Yes catalog integration exists and catalogs
+1, I have used the iceberg connector and catalog before. It is easy to use.
Márton Balassi 于2022年10月12日周三 16:38写道：
> +1 from me, thanks for the clarification.
>
> On Wed, Oct 12, 2022 at 7:57 AM Péter Váry
> wrote:
>
> > Thanks Abid,
> >
> > Count me in, and drop a note, if I can help in any w
+1 from me, let's open a VOTE thread to make this official.
On Wed, Oct 12, 2022 at 1:37 PM Hang Ruan wrote:
> +1, I have used the iceberg connector and catalog before. It is easy to
> use.
>
> Márton Balassi 于2022年10月12日周三 16:38写道：
>
> > +1 from me, thanks for the clarification.
> >
> > On Wed
Hi,
Just to double check: while I believe most Iceberg content refers to
Iceberg as a format, it's considered as a connector in Flink terms, right?
So there is no 'format' option to specify.
And one more question: is there a specific goal or reason why you would
want to contribute this to Flink i
st/flink/ ?
> > > >
> > > > Best,
> > > > Jark
> > > >
> > > >
> > > > On Thu, 13 Oct 2022 at 17:52, yuxia wrote:
> > > >
> > > > > +1. Thanks for driving it. Hope I can find some chances to take part
> > > > > Besides, once the code is moved to the Flink project, are there any
> > > > initial
> > > > > maintainers for the connector we can find?
> > > > > In addition, do we still maintain documentation under Iceberg
> > > > &
28 matches
Mail list logo
