Re: [DISCUSS] FLIP-399: Flink Connector Doris

2024-01-24 Thread Di Wu
Hi all, Previously, we had some discussions about contributing Flink Doris Connector to the Flink community [1]. I want to further promote this work. I hope everyone will help participate in this FLIP discussion and provide more valuable opinions and suggestions. Thanks. [1]

Re: [VOTE] FLIP-406: Reorganize State & Checkpointing & Recovery Configuration

2024-01-24 Thread Yuan Mei
+1 On Thu, Jan 25, 2024 at 10:57 AM Xuannan Su wrote: > +1 (non-binding) > > Best, > Xuannan > > On Thu, Jan 25, 2024 at 10:15 AM Lijie Wang > wrote: > > > > +1 (binding) > > > > Best, > > Lijie > > > > Yanfei Lei 于2024年1月25日周四 10:06写道: > > > > > +1 (binding) > > > > > > Hangxiang Yu

Re: [SUMMARY] Flink 1.19 Release Sync 01/23/2024

2024-01-24 Thread Feng Jin
Hi everyone, Xuyang and I are currently working on FLIP-387[1], which aims to support named parameters for functions and procedures. This will make it more convenient for users to utilize functions and procedures with multiple parameters. We have divided the task into four sub-tasks, and we are

Re: [DISCUSS]FLIP-420: Add API annotations for RocksDB StateBackend user-facing classes

2024-01-24 Thread Jinzhong Li
Hi Zakelly, Thanks for your comments! 1)I agree that almost no user would use "RocksDBStateUploader" and "RocksDBStateDownloader" to do something. It's fine for me to keep them unmarked. 2)Regarding "SingleStateIterator", I think it's acceptable to either leave it unmarked or mark it as

[jira] [Created] (FLINK-34231) Fix typo in doc

2024-01-24 Thread Yang Guo (Jira)
Yang Guo created FLINK-34231: Summary: Fix typo in doc Key: FLINK-34231 URL: https://issues.apache.org/jira/browse/FLINK-34231 Project: Flink Issue Type: Improvement Components:

Re: [VOTE] FLIP-406: Reorganize State & Checkpointing & Recovery Configuration

2024-01-24 Thread Xuannan Su
+1 (non-binding) Best, Xuannan On Thu, Jan 25, 2024 at 10:15 AM Lijie Wang wrote: > > +1 (binding) > > Best, > Lijie > > Yanfei Lei 于2024年1月25日周四 10:06写道: > > > +1 (binding) > > > > Hangxiang Yu 于2024年1月25日周四 10:00写道: > > > > > > +1 (binding) > > > > > > On Thu, Jan 25, 2024 at 8:49 AM Rui

Re: [DISCUSS]FLIP-420: Add API annotations for RocksDB StateBackend user-facing classes

2024-01-24 Thread Hangxiang Yu
Hi Jinzhong. Thanks for driving this! Some suggestions: 1. As RocksDBStateBackend marked as Deprecated, We should also mark RocksDBStateBackendFactory as Deprecated 2. Since 1.19 will be freezed in 1.26. Let's adjust the target version to 1.20 On Wed, Jan 24, 2024 at 11:50 PM Zakelly Lan wrote:

Re: [VOTE] FLIP-406: Reorganize State & Checkpointing & Recovery Configuration

2024-01-24 Thread Lijie Wang
+1 (binding) Best, Lijie Yanfei Lei 于2024年1月25日周四 10:06写道: > +1 (binding) > > Hangxiang Yu 于2024年1月25日周四 10:00写道: > > > > +1 (binding) > > > > On Thu, Jan 25, 2024 at 8:49 AM Rui Fan <1996fan...@gmail.com> wrote: > > > > > +1(binding) > > > > > > Best, > > > Rui > > > > > > On Wed, 24 Jan

Re: [VOTE] FLIP-406: Reorganize State & Checkpointing & Recovery Configuration

2024-01-24 Thread Yanfei Lei
+1 (binding) Hangxiang Yu 于2024年1月25日周四 10:00写道: > > +1 (binding) > > On Thu, Jan 25, 2024 at 8:49 AM Rui Fan <1996fan...@gmail.com> wrote: > > > +1(binding) > > > > Best, > > Rui > > > > On Wed, 24 Jan 2024 at 21:50, Zakelly Lan wrote: > > > > > Hi everyone, > > > > > > I'd like to start a

Re: [VOTE] FLIP-406: Reorganize State & Checkpointing & Recovery Configuration

2024-01-24 Thread Hangxiang Yu
+1 (binding) On Thu, Jan 25, 2024 at 8:49 AM Rui Fan <1996fan...@gmail.com> wrote: > +1(binding) > > Best, > Rui > > On Wed, 24 Jan 2024 at 21:50, Zakelly Lan wrote: > > > Hi everyone, > > > > I'd like to start a vote on the FLIP-406: Reorganize State & > Checkpointing > > & Recovery

Re: [VOTE] FLIP-406: Reorganize State & Checkpointing & Recovery Configuration

2024-01-24 Thread Rui Fan
+1(binding) Best, Rui On Wed, 24 Jan 2024 at 21:50, Zakelly Lan wrote: > Hi everyone, > > I'd like to start a vote on the FLIP-406: Reorganize State & Checkpointing > & Recovery Configuration [1]. The discussion thread is here [2]. > > The vote will be open for at least 72 hours unless there

[jira] [Created] (FLINK-34230) Update flink-docs README: add -Pskip-webui-build to the config doc generation command

2024-01-24 Thread Zhanghao Chen (Jira)
Zhanghao Chen created FLINK-34230: - Summary: Update flink-docs README: add -Pskip-webui-build to the config doc generation command Key: FLINK-34230 URL: https://issues.apache.org/jira/browse/FLINK-34230

Re: [DISCUSS]FLIP-420: Add API annotations for RocksDB StateBackend user-facing classes

2024-01-24 Thread Zakelly Lan
Hi Jinzhong, Thanks for driving this! +1 for fixing the lack of annotation. I'm wondering if we really need to annotate *RocksDBStateUploader* and *RocksDBStateDownloader *with @Internal, as they seem to be ordinary classes without interacting with other modules. Also, I have reservations about

[DISCUSS]FLIP-420: Add API annotations for RocksDB StateBackend user-facing classes

2024-01-24 Thread Jinzhong Li
Hi devs, I’m opening this thread to discuss about FLIP-420: Add API annotations for RocksDB StateBackend user-facing classes[1]. As described in FLINK-18255[2] , several user-facing classes in flink-statebackend-rocksdb module don't have any API annotations, not even @PublicEvolving. This FLIP

[SUMMARY] Flink 1.19 Release Sync 01/23/2024

2024-01-24 Thread Lincoln Lee
Hi devs, I'd like to share some highlights from the release sync on 01/23/2024 *- Feature freeze* *We plan to freeze the feature on Jan 26th. If there's specific need for an extension, please confirm with RMs by replying this mail.* *- Features & issues tracking* So far we've had 15 flips

[VOTE] FLIP-406: Reorganize State & Checkpointing & Recovery Configuration

2024-01-24 Thread Zakelly Lan
Hi everyone, I'd like to start a vote on the FLIP-406: Reorganize State & Checkpointing & Recovery Configuration [1]. The discussion thread is here [2]. The vote will be open for at least 72 hours unless there is an objection or insufficient votes. [1]

[jira] [Created] (FLINK-34229) Duplicate entry in InnerClasses attribute in class file FusionStreamOperator

2024-01-24 Thread xingbe (Jira)
xingbe created FLINK-34229: -- Summary: Duplicate entry in InnerClasses attribute in class file FusionStreamOperator Key: FLINK-34229 URL: https://issues.apache.org/jira/browse/FLINK-34229 Project: Flink

Re:[DISCUSS] FLIP-410: Config, Context and Processing Timer Service of DataStream API V2

2024-01-24 Thread Wencong Liu
Hi Weijie, Regarding FLIP-410, I have the following questions: Q1. In the "Configuration" section, it is mentioned that configurations can be set continuously using the withXXX methods. Are these configuration options the same as those provided by DataStream V1, or might there be different

Re:[DISCUSS] FLIP-409: DataStream V2 Building Blocks: DataStream, Partitioning and ProcessFunction

2024-01-24 Thread Wencong Liu
Hi Weijie, Regarding FLIP-409, I have the following questions: Q1. Other DataStream types are converted into Non-Keyed DataStreams by using a "shuffle" operation to convert Input into output. Does this "shuffle" include the various repartition operations (rebalance/rescale/shuffle) from

Re:[DISCUSS] FLIP-408: [Umbrella] Introduce DataStream API V2

2024-01-24 Thread Wencong Liu
Hi Weijie, Thank you for the effort you've put into the DataStream API ! By reorganizing and redesigning the DataStream API, as well as addressing some of the unreasonable designs within it, we can enhance the efficiency of job development for developers. It also allows developers to design

[jira] [Created] (FLINK-34228) Add long UTF serializer/deserializer

2024-01-24 Thread Peter Vary (Jira)
Peter Vary created FLINK-34228: -- Summary: Add long UTF serializer/deserializer Key: FLINK-34228 URL: https://issues.apache.org/jira/browse/FLINK-34228 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-34227) ResourceRequirements couldn't be matched in WindowDistinctAggregateITCase with AdaptiveScheduler causing a timeout

2024-01-24 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-34227: - Summary: ResourceRequirements couldn't be matched in WindowDistinctAggregateITCase with AdaptiveScheduler causing a timeout Key: FLINK-34227 URL:

Re: [DISCUSS] FLIP-402: Extend ZooKeeper Curator configurations

2024-01-24 Thread Zhu Zhu
@Matthias Thanks for raising the question. AFAIK, there is no guide of this naming convention yet. But +1 to add this naming convention in Flink code style guide. So that new configuration names can follow the guide. However, I tend to not force the configuration name alignment in Flink 2.0. It

[jira] [Created] (FLINK-34226) Add the backoff-multiplier configuration in ExponentialBackoffRetryStrategy

2024-01-24 Thread xiangyu feng (Jira)
xiangyu feng created FLINK-34226: Summary: Add the backoff-multiplier configuration in ExponentialBackoffRetryStrategy Key: FLINK-34226 URL: https://issues.apache.org/jira/browse/FLINK-34226 Project:

[jira] [Created] (FLINK-34225) HybridShuffleITCase.testHybridSelectiveExchangesRestart failed due to RPC issue

2024-01-24 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-34225: - Summary: HybridShuffleITCase.testHybridSelectiveExchangesRestart failed due to RPC issue Key: FLINK-34225 URL: https://issues.apache.org/jira/browse/FLINK-34225