Re: [VOTE] Apache Flink Table Store 0.1.0, release candidate #2

+1 ( non-binding) for the release. I agree with Konstantin that we can add more materials about the table-store for the voting. 1. Download the source tarball, signature (.asc), and checksum (.sha512): OK 2. Import gpg keys: download KEYS and run gpg --import /path/to/downloaded/KEY

Re: [ANNOUNCE] Apache Flink 1.15.0 released

Great! Will install it on the cluster asap! :) One thing I noticed: the linked release notes in the blog announcement under "Upgrade Notes" result in a 404 ( https://nightlies.apache.org/flink/flink-docs-release-1.15/release-notes/flink-1.15/ ) They are also not linked on the main page: https://

Re: [VOTE] FLIP-225: Implement standalone mode support in the kubernetes operator

+1 (binding) Best, Yang Danny Cranmer 于2022年5月4日周三 20:54写道： > +1 (binding) > > Thanks, > Danny > > On Wed, May 4, 2022 at 1:34 PM Gyula Fóra wrote: > > > +1 > > > > Gyula > > > > On Wed, May 4, 2022 at 2:32 PM Jassat, Usamah > > > wrote: > > > > > Hi everyone, > > > > > > Thanks for the feedb

Re: [ANNOUNCE] Apache Flink 1.15.0 released

Hi, Yun Great job! Thank you very much for your efforts to release Flink-1.15 during this time. Thanks also to all the contributors who worked on this release! Best, Guowei On Thu, May 5, 2022 at 3:24 PM Peter Schrott wrote: > Great! > > Will install it on the cluster asap! :) > > One thing I

Re: [DISCUSS] FLIP-217 Support watermark alignment of source splits

Hi, We know that in the case of Bounded input Flink supports the Batch execution mode. Currently in Batch execution mode, flink is executed on a stage-by-stage basis. In this way, perhaps watermark alignment might not gain much. So my question is: Is watermark alignment the default behavior(for i

Re: [DISCUSS] FLIP-224: Blacklist Mechanism

Hi everyone, Thanks for your feedback. There's one detail that I'd like to re-emphasize here because it can affect the value and design of the blocklist mechanism (perhaps I should highlight it in the FLIP). We propose two actions in FLIP: 1) MARK_BLOCKLISTED: Just mark the task manager or node

Re: [ANNOUNCE] Apache Flink 1.15.0 released

Congratulations~! Thank the release managers, and thank all who contributed to this release. Thank you~ Xintong Song On Thu, May 5, 2022 at 3:45 PM Guowei Ma wrote: > Hi, Yun > > Great job! > Thank you very much for your efforts to release Flink-1.15 during this > time. > Thanks also to all

Re: [ANNOUNCE] Apache Flink 1.15.0 released

Congratulations to everyone! Thanks to Yun Gao, Joe Moser & Till Rohrmann for managing this release. It's done :) Am Do., 5. Mai 2022 um 09:57 Uhr schrieb Xintong Song : > Congratulations~! > > Thank the release managers, and thank all who contributed to this release. > > Thank you~ > > Xintong

Re: [ANNOUNCE] Apache Flink 1.15.0 released

Cheers! Congratulations! Thank you very much! And thank all who contributed to this release. Best, Jingsong On Thu, May 5, 2022 at 3:57 PM Xintong Song wrote: > > Congratulations~! > > Thank the release managers, and thank all who contributed to this release. > > Thank you~ > > Xintong Song > >

Re: Source alignment for Iceberg

Ok, I see. Thanks to both of you for the explanation. Do we need changes to Apache Flink for this feature? Can it be implemented in the Sources without changes in the framework? I presume source can access min/max watermark from the split, so as long as it also knows exactly which splits have fini

[jira] [Created] (FLINK-27493) Forward all numeric Kafka metrics to Flink's metrics system

Fabian Paul created FLINK-27493: --- Summary: Forward all numeric Kafka metrics to Flink's metrics system Key: FLINK-27493 URL: https://issues.apache.org/jira/browse/FLINK-27493 Project: Flink Is

Re: [DISCUSS] FLIP-217 Support watermark alignment of source splits

Hi Guowei, as Dawid wrote a couple of messages back: > This is covered in the previous FLIP[1] which has been already implemented in 1.15. In short, it must be enabled with the watermark strategy which also configures drift and update interval So by default watermark alignment is disabled, regar

Re: [ANNOUNCE] Apache Flink 1.15.0 released

Congratulations! Thanks Yun Gao, Till and Joe for driving this release and everyone who made this release happen. Best, Yang Jingsong Li 于2022年5月5日周四 16:04写道： > Cheers! Congratulations! > > Thank you very much! And thank all who contributed to this release. > > Best, > Jingsong > > On Thu, M

Re: [DISCUSS] Maintain a Calcite repository for Flink to accelerate the development for Flink SQL features

Hi, Timo & Martijn, Sorry for the late reply, thanks for the feedback. I strongly agree that the best solution would be to cooperate more with the Calcite community and maintain all new features and bug fixes in the Calcite community, without any forking. It is a long-term process. I think it's d

[jira] [Created] (FLINK-27494) Documentation is unavailable

李伟高 created FLINK-27494: --- Summary: Documentation is unavailable Key: FLINK-27494 URL: https://issues.apache.org/jira/browse/FLINK-27494 Project: Flink Issue Type: Bug Components: Documentatio

Re: [DISCUSS] FLIP-227: Support overdraft buffer

Hi again, After sleeping over this, if both versions (reserve and overdraft) have the same complexity, I would also prefer the overdraft. > `Integer.MAX_VALUE` as default value was my idea as well but now, as > Dawid mentioned, I think it is dangerous since it is too implicit for > the user and i

Re: [ANNOUNCE] Apache Flink 1.15.0 released

Congratulations! Thanks Yun Gao, Till and Joe for the great work as our release manager and everyone who involved. Best, Leonard > 2022年5月5日 下午4:30，Yang Wang 写道： > > Congratulations! > > Thanks Yun Gao, Till and Joe for driving this release and everyone who made > this release happen.

Re: [ANNOUNCE] Apache Flink 1.15.0 released

Great! Thanks, Yun Gao, Till, and Joe for driving the release, and thanks to everyone for making this release happen! Best Yuan On Thu, May 5, 2022 at 4:40 PM Leonard Xu wrote: > Congratulations! > > Thanks Yun Gao, Till and Joe for the great work as our release manager and > everyone who invo

Re: [ANNOUNCE] Apache Flink 1.15.0 released

It took a bit longer than usual. But I'm sure the users will love this release. Big thanks to the release managers! Timo Am 05.05.22 um 10:45 schrieb Yuan Mei: Great! Thanks, Yun Gao, Till, and Joe for driving the release, and thanks to everyone for making this release happen! Best Yuan On

Re: [ANNOUNCE] Apache Flink 1.15.0 released

Great news! Thanks for Yun Gao, Till and Joe for driving this release and everyone who ever contributed to this release. Best Yun Tang From: Timo Walther Sent: Thursday, May 5, 2022 17:20 To: dev@flink.apache.org Subject: Re: [ANNOUNCE] Apache Flink 1.15.0 rele

Re: [VOTE] Apache Flink Table Store 0.1.0, release candidate #2

Hi, Konstantin and OpenInx, I have updated https://github.com/apache/flink-web/pull/531 , you can take a review~ Best, Jingsong On Thu, May 5, 2022 at 3:07 PM OpenInx wrote: > > +1 ( non-binding) for the release. I agree with Konstantin that we can add > more materials about the table-store for

Re: [ANNOUNCE] Apache Flink 1.15.0 released

Hooray! Thanks Yun, Till and Joe for driving the release! Cheers, JIangjie (Becket) Qin On Thu, May 5, 2022 at 5:20 PM Timo Walther wrote: > It took a bit longer than usual. But I'm sure the users will love this > release. > > Big thanks to the release managers! > > Timo > > Am 05.05.22 um 10:

Re: [DISCUSS] FLIP-227: Support overdraft buffer

Hi, Thanks a lot for your discussion. After several discussions, I think it's clear now. I updated the "Proposed Changes" of FLIP-227[1]. If I have something missing, please help to add it to FLIP, or add it in the mail and I can add it to FLIP. If everything is OK, I will create a new JIRA for t

Re: [ANNOUNCE] Apache Flink 1.15.0 released

Congratulations~ Thanks Yun, Till and Joe for driving this release and everyone who made this release happen. Best, Godfrey Becket Qin 于2022年5月5日周四 17:39写道： > > Hooray! Thanks Yun, Till and Joe for driving the release! > > Cheers, > > JIangjie (Becket) Qin > > On Thu, May 5, 2022 at 5:20 PM Tim

Re: [ANNOUNCE] Apache Flink 1.15.0 released

Great news! Congratulations! Thanks to the release managers, and everyone involved. On Thu, May 5, 2022 at 11:57 AM godfrey he wrote: > Congratulations~ > > Thanks Yun, Till and Joe for driving this release > and everyone who made this release happen. > > Best, > Godfrey > > Becket Qin 于2022年5月

Re: [DISCUSS] Planning Flink 1.16

Hi everyone, Xingbo, Becket, Chesnay, Martijn, Godfrey and myself briefly talked offline and we would propose that Xingbo, Godfrey, Martijn and Chesnay take on the release management for the next release. Six people seemed like an overkill but having a bit of high availability in both Europe and A

[jira] [Created] (FLINK-27495) Observer should update last savepoint information directly from cluster too

Gyula Fora created FLINK-27495: -- Summary: Observer should update last savepoint information directly from cluster too Key: FLINK-27495 URL: https://issues.apache.org/jira/browse/FLINK-27495 Project: Flin

[jira] [Created] (FLINK-27496) Add test for rollback during application upgrade

Gyula Fora created FLINK-27496: -- Summary: Add test for rollback during application upgrade Key: FLINK-27496 URL: https://issues.apache.org/jira/browse/FLINK-27496 Project: Flink Issue Type: Impr

[jira] [Created] (FLINK-27497) Track terminal job states in the observer

Gyula Fora created FLINK-27497: -- Summary: Track terminal job states in the observer Key: FLINK-27497 URL: https://issues.apache.org/jira/browse/FLINK-27497 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-27498) Add E2E tests to cover Flink 1.15

Gyula Fora created FLINK-27498: -- Summary: Add E2E tests to cover Flink 1.15 Key: FLINK-27498 URL: https://issues.apache.org/jira/browse/FLINK-27498 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-27499) Bump base Flink version to 1.15.0

Gyula Fora created FLINK-27499: -- Summary: Bump base Flink version to 1.15.0 Key: FLINK-27499 URL: https://issues.apache.org/jira/browse/FLINK-27499 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-27501) [JUnit5 Migration] SerializerTestBase

Chesnay Schepler created FLINK-27501: Summary: [JUnit5 Migration] SerializerTestBase Key: FLINK-27501 URL: https://issues.apache.org/jira/browse/FLINK-27501 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-27500) Validation error handling inside controller blocks reconciliation

Gyula Fora created FLINK-27500: -- Summary: Validation error handling inside controller blocks reconciliation Key: FLINK-27500 URL: https://issues.apache.org/jira/browse/FLINK-27500 Project: Flink

Re: [ANNOUNCE] Apache Flink 1.15.0 released

Hurray! Thanks Yun Gao, Till and Joe for all the efforts as our release managers. And thanks all contributors for making this happen! Best Regards, Yu On Thu, 5 May 2022 at 18:01, Sergey Nuyanzin wrote: > Great news! > Congratulations! > Thanks to the release managers, and everyone involved.

[ANNOUNCE] New Flink PMC member: Yang Wang

Hi all, I'm very happy to announce that Yang Wang has joined the Flink PMC! Yang has been consistently contributing to our community, by contributing codes, participating in discussions, mentoring new contributors, answering questions on mailing lists, and giving talks on Flink at various confere

Re: [ANNOUNCE] New Flink PMC member: Yang Wang

Congratulations, Yang! Best, Biao Geng 获取 Outlook for iOS 发件人: Xintong Song 发送时间: Thursday, May 5, 2022 7:18:10 PM 收件人: dev ; Yang Wang 主题: [ANNOUNCE] New Flink PMC member: Yang Wang Hi all, I'm very happy to announce that Yang Wang has j

Re: [ANNOUNCE] New Flink PMC member: Yang Wang

Congratulations Yang! Best, Lijie Xintong Song 于2022年5月5日周四 19:18写道： > Hi all, > > I'm very happy to announce that Yang Wang has joined the Flink PMC! > > Yang has been consistently contributing to our community, by contributing > codes, participating in discussions, mentoring new contributors,

Re: [ANNOUNCE] New Flink PMC member: Yang Wang

Congratulations Yang Wang! On Thu, 5 May 2022 at 13:23, Lijie Wang wrote: > Congratulations Yang! > > Best, > Lijie > > Xintong Song 于2022年5月5日周四 19:18写道： > > > Hi all, > > > > I'm very happy to announce that Yang Wang has joined the Flink PMC! > > > > Yang has been consistently contributing to

Re: [ANNOUNCE] New Flink PMC member: Yang Wang

Congratulations Yang! Best fanrui On Thu, May 5, 2022 at 19:47 Martijn Visser wrote: > Congratulations Yang Wang! > > On Thu, 5 May 2022 at 13:23, Lijie Wang wrote: > > > Congratulations Yang! > > > > Best, > > Lijie > > > > Xintong Song 于2022年5月5日周四 19:18写道： > > > > > Hi all, > > > > > > I'm

Re: [DISCUSS] FLIP-91: Support SQL Client Gateway

Hi Shengkai. Thanks for driving the proposal, it's been silent too long. I have a few questions: about the Architecture > The architecture of the Gateway is in the following graph. Is the TableEnvironment shared for all sessions ? about the REST Endpoint > /v1/sessions Are both local file and re

Re: [DISCUSS] FLIP-221 Abstraction for lookup source cache and metric

Hi everyone! Thanks for driving such a valuable improvement! I do think that single cache implementation would be a nice opportunity for users. And it will break the "FOR SYSTEM_TIME AS OF proc_time" semantics anyway - doesn't matter how it will be implemented. Putting myself in the user's shoes

Re: [ANNOUNCE] New Flink PMC member: Yang Wang

Congrats Yang! -- Best regards, Anton Kalashnikov 05.05.2022 13:53, rui fan пишет: Congratulations Yang! Best fanrui On Thu, May 5, 2022 at 19:47 Martijn Visser wrote: Congratulations Yang Wang! On Thu, 5 May 2022 at 13:23, Lijie Wang wrote: Congratulations Yang! Best, Lijie Xintong

[DISCUSS] Process regarding to new connectors

Hi everyone, I would like to open a discussion on the process regarding new connectors. As you know from previous updates [1] we are making a lot of progress on externalizing connectors that are currently hosted inside in the Flink repository. One topic I would like to bring up for discussion is

Re: [DISCUSS] FLIP-221 Abstraction for lookup source cache and metric

Hi everyone, One question regarding "And Alexander correctly mentioned that filter pushdown still is not implemented for jdbc/hive/hbase." -> Would an alternative solution be to actually implement these filter pushdowns? I can imagine that there are many more benefits to doing that, outside of loo

Re: [ANNOUNCE] New Flink PMC member: Yang Wang

Congrats Yang! Best regards, Nicholas Jiang On 2022/05/05 11:18:10 Xintong Song wrote: > Hi all, > > I'm very happy to announce that Yang Wang has joined the Flink PMC! > > Yang has been consistently contributing to our community, by contributing > codes, participating in discussions, mentoring

Re: [DISCUSS] FLIP-221 Abstraction for lookup source cache and metric

It's a much more complicated activity and lies out of the scope of this improvement. Because such pushdowns should be done for all ScanTableSource implementations (not only for Lookup ones). On Thu, 5 May 2022 at 19:02, Martijn Visser wrote: > Hi everyone, > > One question regarding "And Alexand

Re: [DISCUSS] Process regarding to new connectors

Hi Martijn, Thanks for bringing up this discussion. >From my point of view, Flink Bylaws should also be applied to the connectors. I don't think connectors are just implementations, they provide many APIs for end-users, including DataStream API, and SQL DDL options, SQL metadata columns. There a

Re: [ANNOUNCE] New Flink PMC member: Yang Wang

Congrats and well Deserved, Yang! Best, Yuan On Thu, May 5, 2022 at 8:21 PM Nicholas Jiang wrote: > Congrats Yang! > > Best regards, > Nicholas Jiang > > On 2022/05/05 11:18:10 Xintong Song wrote: > > Hi all, > > > > I'm very happy to announce that Yang Wang has joined the Flink PMC! > > > > Ya

Re: [ANNOUNCE] New Flink PMC member: Yang Wang

Congrats Yang! On Thu, May 5, 2022, 15:29 Yuan Mei wrote: > Congrats and well Deserved, Yang! > > Best, > Yuan > > On Thu, May 5, 2022 at 8:21 PM Nicholas Jiang > wrote: > > > Congrats Yang! > > > > Best regards, > > Nicholas Jiang > > > > On 2022/05/05 11:18:10 Xintong Song wrote: > > > Hi all

Re: [ANNOUNCE] New Flink PMC member: Yang Wang

Congratulations! Best Liu Jiangang Marios Trivyzas 于2022年5月5日周四 20:47写道： > Congrats Yang! > > On Thu, May 5, 2022, 15:29 Yuan Mei wrote: > > > Congrats and well Deserved, Yang! > > > > Best, > > Yuan > > > > On Thu, May 5, 2022 at 8:21 PM Nicholas Jiang > > wrote: > > > > > Congrats Yang! > >

Re: [ANNOUNCE] Apache Flink 1.15.0 released

Congratulations! This version is really helpful for us . We will explore it and help to improve it. Best Jiangang Liu Yu Li 于2022年5月5日周四 18:53写道： > Hurray! > > Thanks Yun Gao, Till and Joe for all the efforts as our release managers. > And thanks all contributors for making this happen! > > Bes

Re: [DISCUSS] FLIP-221 Abstraction for lookup source cache and metric

It's great to see the active discussion! I want to share my ideas: 1) implement the cache in framework vs. connectors base I don't have a strong opinion on this. Both ways should work (e.g., cache pruning, compatibility). The framework way can provide more concise interfaces. The connector base wa

[jira] [Created] (FLINK-27502) Add file Suffix to data files

Jingsong Lee created FLINK-27502: Summary: Add file Suffix to data files Key: FLINK-27502 URL: https://issues.apache.org/jira/browse/FLINK-27502 Project: Flink Issue Type: Improvement

Re: [ANNOUNCE] New Flink PMC member: Yang Wang

Congratulations！ Best, Guowei On Thu, May 5, 2022 at 9:01 PM Jiangang Liu wrote: > Congratulations! > > Best > Liu Jiangang > > Marios Trivyzas 于2022年5月5日周四 20:47写道： > > > Congrats Yang! > > > > On Thu, May 5, 2022, 15:29 Yuan Mei wrote: > > > > > Congrats and well Deserved, Yang! > > > > > >

[jira] [Created] (FLINK-27503) Rename sst file to data file

Jingsong Lee created FLINK-27503: Summary: Rename sst file to data file Key: FLINK-27503 URL: https://issues.apache.org/jira/browse/FLINK-27503 Project: Flink Issue Type: Sub-task C

Re: [DISCUSS] FLIP-91: Support SQL Client Gateway

Hi Martijn, Regarding maintaining Gateway inside or outside Flink code base, I would like to share my thoughts: > I would like to understand why it's complicated to make the upgrades problematic. Is it because of relying on internal interfaces? If so, should we not consider making them public? I

Re: [ANNOUNCE] New Flink PMC member: Yang Wang

Congratulations！ Best, Aitozi Guowei Ma 于2022年5月5日周四 21:51写道： > Congratulations！ > Best, > Guowei > > > On Thu, May 5, 2022 at 9:01 PM Jiangang Liu > wrote: > > > Congratulations! > > > > Best > > Liu Jiangang > > > > Marios Trivyzas 于2022年5月5日周四 20:47写道： > > > > > Congrats Yang! > > > > > >

Re: Source alignment for Iceberg

Piotr, With FLIP-27, Iceberg source already implemented alignment by tracking watermark and holding back split assignment when necessary. The purpose of this discussion is to see if Iceberg source can leverage some of the watermark alignment work from Flink framework. Thanks, Steven On Thu, May

Re: [ANNOUNCE] New Flink PMC member: Yang Wang

Congratulations Yang! Best, Weiqing On Thu, May 5, 2022 at 4:18 AM Xintong Song wrote: > Hi all, > > I'm very happy to announce that Yang Wang has joined the Flink PMC! > > Yang has been consistently contributing to our community, by contributing > codes, participating in discussions, mentoring

Re: [ANNOUNCE] New Flink PMC member: Yang Wang

Congratulations, Yang! Thanks, Zhu Weiqing Yang 于2022年5月5日周四 22:28写道： > > Congratulations Yang! > > Best, > Weiqing > > On Thu, May 5, 2022 at 4:18 AM Xintong Song wrote: > > > Hi all, > > > > I'm very happy to announce that Yang Wang has joined the Flink PMC! > > > > Yang has been consistently

Re: [ANNOUNCE] Apache Flink 1.15.0 released

Thanks Yun, Till and Joe for the great work and thanks everyone who makes this release possible! Cheers, Zhu Jiangang Liu 于2022年5月5日周四 21:09写道： > > Congratulations! This version is really helpful for us . We will explore it > and help to improve it. > > Best > Jiangang Liu > > Yu Li 于2022年5月5日周

[jira] [Created] (FLINK-27504) State compaction not happening with sliding window and incremental RocksDB backend

Alexis Sarda-Espinosa created FLINK-27504: - Summary: State compaction not happening with sliding window and incremental RocksDB backend Key: FLINK-27504 URL: https://issues.apache.org/jira/browse/FLINK-275

Re: [DISCUSS] FLIP-224: Blacklist Mechanism

Thank you for all your feedback! Besides the answers from Lijie, I'd like to share some of my thoughts: 1. Whether to enable automatical blocklist Generally speaking, it is not a goal of FLIP-224. The automatical way should be something built upon the blocklist mechanism and well decoupled. It was

Re: [DISCUSS] FLIP-227: Support overdraft buffer

Hi, Thanks Fanrui, It looks correct for me. I vote for 5 as 'max-overdraft-buffers-per-gate'. If I understand correctly, Legacy source can be detected by the operator which is an instance of StreamSource and it is also can be detected by invokable which is an instance of SourceStreamTask. We

[jira] [Created] (FLINK-27505) Add javadoc comments to AsyncSinkBase

Zichen Liu created FLINK-27505: -- Summary: Add javadoc comments to AsyncSinkBase Key: FLINK-27505 URL: https://issues.apache.org/jira/browse/FLINK-27505 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-27506) update playgrounds for Flink 1.14

David Anderson created FLINK-27506: -- Summary: update playgrounds for Flink 1.14 Key: FLINK-27506 URL: https://issues.apache.org/jira/browse/FLINK-27506 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-27507) Update operations playground for 1.14

David Anderson created FLINK-27507: -- Summary: Update operations playground for 1.14 Key: FLINK-27507 URL: https://issues.apache.org/jira/browse/FLINK-27507 Project: Flink Issue Type: Sub-tas

[jira] [Created] (FLINK-27508) Update pyflink walkthrough playground for 1.14

David Anderson created FLINK-27508: -- Summary: Update pyflink walkthrough playground for 1.14 Key: FLINK-27508 URL: https://issues.apache.org/jira/browse/FLINK-27508 Project: Flink Issue Type

[jira] [Created] (FLINK-27509) Update table walkthrough playground for 1.14

David Anderson created FLINK-27509: -- Summary: Update table walkthrough playground for 1.14 Key: FLINK-27509 URL: https://issues.apache.org/jira/browse/FLINK-27509 Project: Flink Issue Type:

[jira] [Created] (FLINK-27510) update playgrounds for Flink 1.15

David Anderson created FLINK-27510: -- Summary: update playgrounds for Flink 1.15 Key: FLINK-27510 URL: https://issues.apache.org/jira/browse/FLINK-27510 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-27511) Update operations playground for 1.15

David Anderson created FLINK-27511: -- Summary: Update operations playground for 1.15 Key: FLINK-27511 URL: https://issues.apache.org/jira/browse/FLINK-27511 Project: Flink Issue Type: Sub-tas

[jira] [Created] (FLINK-27512) Update pyflink walkthrough playground for 1.15

David Anderson created FLINK-27512: -- Summary: Update pyflink walkthrough playground for 1.15 Key: FLINK-27512 URL: https://issues.apache.org/jira/browse/FLINK-27512 Project: Flink Issue Type

[jira] [Created] (FLINK-27513) Update table walkthrough playground for 1.15

David Anderson created FLINK-27513: -- Summary: Update table walkthrough playground for 1.15 Key: FLINK-27513 URL: https://issues.apache.org/jira/browse/FLINK-27513 Project: Flink Issue Type:

Re: Supporting Collector API in Kinesis Connector

Hello Blake, Sorry for the delay, I have posted a few comments to your PR. Thanks for the contribution! Danny On Fri, Apr 15, 2022 at 6:03 PM Blake Wilson wrote: > Great to know! Thanks for the reference. > > On Fri, Apr 15, 2022 at 6:15 AM Danny Cranmer > wrote: > > > Yes, the Flink Kinesis

Re: [DISCUSS] FLIP-227: Support overdraft buffer

Hi fanrui, > How to identify legacySource? legacy sources are always using the SourceStreamTask class and SourceStreamTask is used only for legacy sources. But I'm not sure how to enable/disable that. Adding `disableOverdraft()` call in SourceStreamTask would be better compared to relying on the

Re: Source alignment for Iceberg

Hi Steven, Ok, thanks for the clarification. I'm not sure how much could be leveraged? Maybe just re-using the watermark alignment configuration? Please correct me if I'm wrong, but I think for the sole purpose of this use case, I don't see a good motivation behind expanding our APIs. Clearly this

Re: Source alignment for Iceberg

It seems that the iceberg source benefits from performing the alignment in the enumerator and holding back the splits until they actually can be processed. That is probably true for any similar source that assigns work in smaller increments as centralizing the "ready to process" decision in the enu

Re: Source alignment for Iceberg

On Wed, May 4, 2022 at 11:03 AM Steven Wu wrote: > Any opinion on different timestamp for source alignment (vs Flink application > watermark)? For Iceberg source, we might want to enforce alignment on kafka > timestamp but Flink application watermark may use event time field from > payload. I

Re: [ANNOUNCE] Apache Flink 1.15.0 released

Thank you to all who contributed for making this release happen! Thomas On Thu, May 5, 2022 at 7:41 AM Zhu Zhu wrote: > > Thanks Yun, Till and Joe for the great work and thanks everyone who > makes this release possible! > > Cheers, > Zhu > > Jiangang Liu 于2022年5月5日周四 21:09写道： > > > > Congratul

Re: [DISCUSS] FLIP-91: Support SQL Client Gateway

Thanks Shengkai for driving. And all for your discussion. > The reason why we introduce the gateway with pluggable endpoints is that many > users has their preferences. For example, the HiveServer2 users prefer to use > the gateway with HiveServer2-style API, which has numerous tools. However,

[jira] [Created] (FLINK-27514) Website links to up-to-date committer and PMC member lists

Xintong Song created FLINK-27514: Summary: Website links to up-to-date committer and PMC member lists Key: FLINK-27514 URL: https://issues.apache.org/jira/browse/FLINK-27514 Project: Flink Is

Re: Source alignment for Iceberg

I think the key point here is essentially what information should Flink expose to the user pluggables. Apparently split / local task watermark is something many user pluggables would be interested in. Right now it is calculated by the Flink framework but not exposed to the users space, i.e. SourceR

Re: [DISCUSS] Keep the Community Member Information Up-to-Date

FYI, I've created FLINK-27514 to add the notice and link. https://issues.apache.org/jira/browse/FLINK-27514 Thank you~ Xintong Song On Thu, May 5, 2022 at 2:51 PM Xintong Song wrote: > Thanks Tison and Yun for sharing your opinions. > > @Tison, > Keep both a potential out-of-date table and

Re: [ANNOUNCE] New Flink PMC member: Yang Wang

Congratulations, Yang! Best regards, Yuxia - 原始邮件 - 发件人: "Zhu Zhu" 收件人: "dev" 抄送: "Yang Wang" 发送时间: 星期四, 2022年 5 月 05日 下午 10:36:19 主题: Re: [ANNOUNCE] New Flink PMC member: Yang Wang Congratulations, Yang! Thanks, Zhu Weiqing Yang 于2022年5月5日周四 22:28写道： > > Congratulations Yang! > >

Re: [ANNOUNCE] New Flink PMC member: Yang Wang

Congratulations, Yang! Best, Jingsong On Fri, May 6, 2022 at 10:04 AM yuxia wrote: > > Congratulations, Yang! > > Best regards, > Yuxia > > - 原始邮件 - > 发件人: "Zhu Zhu" > 收件人: "dev" > 抄送: "Yang Wang" > 发送时间: 星期四, 2022年 5 月 05日 下午 10:36:19 > 主题: Re: [ANNOUNCE] New Flink PMC member: Yang W

Re: [ANNOUNCE] New Flink PMC member: Yang Wang

Congratulations, Yang! Best, Forward Jingsong Li 于2022年5月6日周五 10:07写道： > Congratulations, Yang! > > Best, > Jingsong > > On Fri, May 6, 2022 at 10:04 AM yuxia wrote: > > > > Congratulations, Yang! > > > > Best regards, > > Yuxia > > > > - 原始邮件 - > > 发件人: "Zhu Zhu" > > 收件人: "dev" >

Re: [ANNOUNCE] New Flink PMC member: Yang Wang

Congratulations Yang! Best, Yangze Guo On Fri, May 6, 2022 at 10:11 AM Forward Xu wrote: > > Congratulations, Yang! > > > Best, > > Forward > > Jingsong Li 于2022年5月6日周五 10:07写道： > > > Congratulations, Yang! > > > > Best, > > Jingsong > > > > On Fri, May 6, 2022 at 10:04 AM yuxia wrote: > > > >

Emitting metrics from Flink SQL LookupTableSource

Hi, We are trying to develop Flink SQL connectors in my company for proprietary data-stores. One problem we observed is that the Flink-SQL LookupTablesource/LookupFunction does not seem to have capabilities to emit any metrics(i.e there is no metric group wired into either through LookupSourceCont

[jira] [Created] (FLINK-27515) Support 'ALTER TABLE ... COMPACT' in TableStore

Jane Chan created FLINK-27515: - Summary: Support 'ALTER TABLE ... COMPACT' in TableStore Key: FLINK-27515 URL: https://issues.apache.org/jira/browse/FLINK-27515 Project: Flink Issue Type: New Fea

Re: [ANNOUNCE] New Flink PMC member: Yang Wang

Congratulations, Yang! Best, Godfrey Yangze Guo 于2022年5月6日周五 10:17写道： > > Congratulations Yang! > > Best, > Yangze Guo > > On Fri, May 6, 2022 at 10:11 AM Forward Xu wrote: > > > > Congratulations, Yang! > > > > > > Best, > > > > Forward > > > > Jingsong Li 于2022年5月6日周五 10:07写道： > > > > > Cong

[jira] [Created] (FLINK-27516) The config execution.attached doesn't take effect because it is override by Cli param

Liu created FLINK-27516: --- Summary: The config execution.attached doesn't take effect because it is override by Cli param Key: FLINK-27516 URL: https://issues.apache.org/jira/browse/FLINK-27516 Project: Flink

[DISCUSS] FLIP-229: Introduces Join Hint for Flink SQL Batch Job

Hi, all. I want to start a discussion about the FLIP-229: Introduces Join Hint for Flink SQL Batch Job(The cwiki[1] is not ready completely but you can see the whole details in docs[2]). Join Hint is a common solution in many popular computing engines and DBs to improve the shortcomings of t

Re: [ANNOUNCE] New Flink PMC member: Yang Wang

Congratulations Yang! Best, Leonard > 2022年5月5日 下午10:36，Zhu Zhu 写道： > > Congratulations, Yang! > > Thanks, > Zhu > > Weiqing Yang 于2022年5月5日周四 22:28写道： >> >> Congratulations Yang! >> >> Best, >> Weiqing >> >> On Thu, May 5, 2022 at 4:18 AM Xintong Song wrote: >> >>> Hi all, >>> >>> I'm

Re: [ANNOUNCE] New Flink PMC member: Yang Wang

Congratulations Yang! Best, Weihua

Re:Re: [DISCUSS] FLIP-218: Support SELECT clause in CREATE TABLE(CTAS)

Hi, Yuxia Thanks for your reply! About the question 1, we will not support, FLIP-218[1] is to simplify the complexity of user DDL and make it easier for users to use. I have never encountered this case in a big data. About the question 2, we will provide a public API like below public void clean

[jira] [Created] (FLINK-27517) Introduce rolling file writer to write one record each time for append-only table.

Zheng Hu created FLINK-27517: Summary: Introduce rolling file writer to write one record each time for append-only table. Key: FLINK-27517 URL: https://issues.apache.org/jira/browse/FLINK-27517 Project: F

[jira] [Created] (FLINK-27518) Refactor migration tests to support generate snapshots of new version automatically

Yun Gao created FLINK-27518: --- Summary: Refactor migration tests to support generate snapshots of new version automatically Key: FLINK-27518 URL: https://issues.apache.org/jira/browse/FLINK-27518 Project: Fl

[jira] [Created] (FLINK-27519) Fix duplicates names when there are multiple levels of over window aggregate

jinfeng created FLINK-27519: --- Summary: Fix duplicates names when there are multiple levels of over window aggregate Key: FLINK-27519 URL: https://issues.apache.org/jira/browse/FLINK-27519 Project: Flink

Re: [DISCUSS] DockerHub repository maintainers

It seems to me we at least don't have a consensus on dropping the use of apache namespace, which means we need to decide on a list of maintainers anyway. So maybe we can get the discussion back to the maintainers. We may continue the official-image vs. apache-namespace in a separate thread if neces

Re: [ANNOUNCE] New Flink PMC member: Yang Wang

Congrats Yang! Well deserved! Best, Matyas On Fri, May 6, 2022 at 5:30 AM huweihua wrote: > Congratulations Yang! > > Best, > Weihua > >

  1   2   >