Re: [ANNOUNCE] Release 1.18.0, release candidate #0

2023-09-19 Thread Zakelly Lan
hould be good enough. > > > > Thanks again! > > > > Best > > Yuan > > > > On Tue, Sep 19, 2023 at 4:26 PM Zakelly Lan wrote: > > > > > Hi everyone, > > > > > > I am working on rebuilding the benchmark pipeline and it

[DISCUSS] FLIP-368 Reorganize the exceptions thrown in state interfaces

2023-09-19 Thread Zakelly Lan
Hi everyone, I would like to initiate a discussion on FLIP-368, which focuses on reorganizing the exceptions thrown in state interfaces [1]. Currently, we have identified several problems with the exceptions thrown by state-related interfaces: 1. The exception types thrown by each interface

Re: [ANNOUNCE] Release 1.18.0, release candidate #0

2023-09-19 Thread Zakelly Lan
Hi everyone, I am working on rebuilding the benchmark pipeline and it's almost done. However, due to the change in machines for benchmarking, I will need a few more days to run tests and gather the baseline scores for further comparison. Once the pipeline is fully ready, we will proceed with the

[jira] [Created] (FLINK-33060) Fix the javadoc of ListState.update/addAll about not allowing null value

2023-09-07 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-33060: --- Summary: Fix the javadoc of ListState.update/addAll about not allowing null value Key: FLINK-33060 URL: https://issues.apache.org/jira/browse/FLINK-33060 Project

[jira] [Created] (FLINK-33057) Add options to disable creating job-id subdirectories under the checkpoint directory

2023-09-07 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-33057: --- Summary: Add options to disable creating job-id subdirectories under the checkpoint directory Key: FLINK-33057 URL: https://issues.apache.org/jira/browse/FLINK-33057

Re: [ANNOUNCE] New Apache Flink Committer - Yanfei Lei

2023-08-07 Thread Zakelly Lan
Congratulations, Yanfei! Best regards, Zakelly On Mon, Aug 7, 2023 at 9:04 PM Lincoln Lee wrote: > > Congratulations, Yanfei! > > Best, > Lincoln Lee > > > Weihua Hu 于2023年8月7日周一 20:43写道: > > > Congratulations Yanfei! > > > > Best, > > Weihua > > > > > > On Mon, Aug 7, 2023 at 8:08 PM Feifan

Re: [ANNOUNCE] New Apache Flink Committer - Hangxiang Yu

2023-08-07 Thread Zakelly Lan
Congratulations, Hangxiang! Best regards, Zakelly On Mon, Aug 7, 2023 at 9:03 PM Lincoln Lee wrote: > > Congratulations Hangxiang! > > Best, > Lincoln Lee > > > Feifan Wang 于2023年8月7日周一 20:09写道: > > > Congratulations Hangxiang! :) > > > > > > > > > > > > —— > > Name: Feifan Wang >

[jira] [Created] (FLINK-32753) Print JVM flags on AZP

2023-08-04 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32753: --- Summary: Print JVM flags on AZP Key: FLINK-32753 URL: https://issues.apache.org/jira/browse/FLINK-32753 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-32090) Python API for enabling and configuring file merging snapshot

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32090: --- Summary: Python API for enabling and configuring file merging snapshot Key: FLINK-32090 URL: https://issues.apache.org/jira/browse/FLINK-32090 Project: Flink

[jira] [Created] (FLINK-32091) Add necessary metrics for file-merging

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32091: --- Summary: Add necessary metrics for file-merging Key: FLINK-32091 URL: https://issues.apache.org/jira/browse/FLINK-32091 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-32089) Do fast copy in best-effort during first checkpoint after restoration

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32089: --- Summary: Do fast copy in best-effort during first checkpoint after restoration Key: FLINK-32089 URL: https://issues.apache.org/jira/browse/FLINK-32089 Project: Flink

[jira] [Created] (FLINK-32092) Integrate snapshot file-merging with existing IT cases

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32092: --- Summary: Integrate snapshot file-merging with existing IT cases Key: FLINK-32092 URL: https://issues.apache.org/jira/browse/FLINK-32092 Project: Flink Issue

[jira] [Created] (FLINK-32087) Space amplification statistics of file merging

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32087: --- Summary: Space amplification statistics of file merging Key: FLINK-32087 URL: https://issues.apache.org/jira/browse/FLINK-32087 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-32088) Re-uploading in state file-merging for space amplification control

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32088: --- Summary: Re-uploading in state file-merging for space amplification control Key: FLINK-32088 URL: https://issues.apache.org/jira/browse/FLINK-32088 Project: Flink

[jira] [Created] (FLINK-32086) Cleanup non-reported managed directory on exit of TM

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32086: --- Summary: Cleanup non-reported managed directory on exit of TM Key: FLINK-32086 URL: https://issues.apache.org/jira/browse/FLINK-32086 Project: Flink Issue

[jira] [Created] (FLINK-32084) Migrate current file merging of channel state into the file merging framework

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32084: --- Summary: Migrate current file merging of channel state into the file merging framework Key: FLINK-32084 URL: https://issues.apache.org/jira/browse/FLINK-32084 Project

[jira] [Created] (FLINK-32085) Implement and migrate batch uploading in changelog files into the file merging framework

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32085: --- Summary: Implement and migrate batch uploading in changelog files into the file merging framework Key: FLINK-32085 URL: https://issues.apache.org/jira/browse/FLINK-32085

[jira] [Created] (FLINK-32083) Chinese translation of documentation of checkpoint file-merging

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32083: --- Summary: Chinese translation of documentation of checkpoint file-merging Key: FLINK-32083 URL: https://issues.apache.org/jira/browse/FLINK-32083 Project: Flink

[jira] [Created] (FLINK-32082) Documentation of checkpoint file-merging

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32082: --- Summary: Documentation of checkpoint file-merging Key: FLINK-32082 URL: https://issues.apache.org/jira/browse/FLINK-32082 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-32080) Restoration of FileMergingSnapshotManager

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32080: --- Summary: Restoration of FileMergingSnapshotManager Key: FLINK-32080 URL: https://issues.apache.org/jira/browse/FLINK-32080 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-32081) Compatibility between file-merging on and off across job runs

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32081: --- Summary: Compatibility between file-merging on and off across job runs Key: FLINK-32081 URL: https://issues.apache.org/jira/browse/FLINK-32081 Project: Flink

[jira] [Created] (FLINK-32079) Read/write checkpoint metadata of merged files

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32079: --- Summary: Read/write checkpoint metadata of merged files Key: FLINK-32079 URL: https://issues.apache.org/jira/browse/FLINK-32079 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-32078) Implement private state file merging

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32078: --- Summary: Implement private state file merging Key: FLINK-32078 URL: https://issues.apache.org/jira/browse/FLINK-32078 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-32077) Implement shared state file merging

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32077: --- Summary: Implement shared state file merging Key: FLINK-32077 URL: https://issues.apache.org/jira/browse/FLINK-32077 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-32076) Add file pool for concurrent file reusing

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32076: --- Summary: Add file pool for concurrent file reusing Key: FLINK-32076 URL: https://issues.apache.org/jira/browse/FLINK-32076 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-32075) Delete merged files on checkpoint abort

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32075: --- Summary: Delete merged files on checkpoint abort Key: FLINK-32075 URL: https://issues.apache.org/jira/browse/FLINK-32075 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-32074) Support file merging across checkpoints

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32074: --- Summary: Support file merging across checkpoints Key: FLINK-32074 URL: https://issues.apache.org/jira/browse/FLINK-32074 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-32072) Create and wire FileMergingSnapshotManager with TaskManagerServices

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32072: --- Summary: Create and wire FileMergingSnapshotManager with TaskManagerServices Key: FLINK-32072 URL: https://issues.apache.org/jira/browse/FLINK-32072 Project: Flink

[jira] [Created] (FLINK-32073) Implement file merging in snapshot

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32073: --- Summary: Implement file merging in snapshot Key: FLINK-32073 URL: https://issues.apache.org/jira/browse/FLINK-32073 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-32070) FLIP-306 Unified File Merging Mechanism for Checkpoints

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32070: --- Summary: FLIP-306 Unified File Merging Mechanism for Checkpoints Key: FLINK-32070 URL: https://issues.apache.org/jira/browse/FLINK-32070 Project: Flink Issue

[jira] [Created] (FLINK-32071) Implement the snapshot manager for merged checkpoint files in TM

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32071: --- Summary: Implement the snapshot manager for merged checkpoint files in TM Key: FLINK-32071 URL: https://issues.apache.org/jira/browse/FLINK-32071 Project: Flink

[RESULT][VOTE] FLIP-306: Unified File Merging Mechanism for Checkpoints

2023-05-12 Thread Zakelly Lan
Hi everyone, Happy to announce that FLIP-306[1] has been approved! According to the vote thread[2], there are 7 approving votes, out of which 5 are binding: * Yanfei Lei * Yuan Mei (binding) * Hangxiang Yu * Rui Fan (binding) * Yu Li (binding) * Yun Tang (binding) * Piotr Nowojski (binding) And

Re: [VOTE] FLIP-306: Unified File Merging Mechanism for Checkpoints

2023-05-09 Thread Zakelly Lan
ding time, 72 hours means to open the discussion until May 12th. > > > > Best regards, > > Jing > > > > On Tue, May 9, 2023 at 8:24 PM Zakelly Lan wrote: > > > > > Hi everyone, > > > > > > Thanks for all the feedback for FLIP-306: Unified File

[VOTE] FLIP-306: Unified File Merging Mechanism for Checkpoints

2023-05-09 Thread Zakelly Lan
Hi everyone, Thanks for all the feedback for FLIP-306: Unified File Merging Mechanism for Checkpoints[1] on the discussion thread[2]. I'd like to start a vote for it. The vote will be open for at least 72 hours (until May 11th, 12:00AM GMT) unless there is an objection or an insufficient number

Re: [DISCUSS] FLIP-310:use VARINT and ZIGZAG to encode ROWDATA in state

2023-05-09 Thread Zakelly Lan
Hi Xiaogang Zhou, Thanks for driving this! I'm pretty interested in your verification test, could you please provide more details? AFAIK, the performance is related to the format of user data and the state size of the RocksDB, as well as the memory setup (determines the proportion of IO required

[VOTE] FLIP-306: Unified File Merging Mechanism for Checkpoints

2023-05-09 Thread Zakelly Lan
Hi everyone, (I'm resending this vote since the last email was blocked for some reason.) Thanks for all the feedback for FLIP-306: Unified File Merging Mechanism for Checkpoints[1] on the discussion thread[2]. I'd like to start a vote for it. The vote will be open for at least 72 hours (until

[VOTE] FLIP-306: Unified File Merging Mechanism for Checkpoints

2023-05-09 Thread Zakelly Lan
Hi everyone, Thanks for all the feedback for FLIP-306: Unified File Merging Mechanism for Checkpoints[1] on the discussion thread[2]. I'd like to start a vote for it. The vote will be open for at least 72 hours (until May 12th, 10:00 AM GMT) unless there is an objection or an insufficient

Re: [DISCUSS] FLIP-310:use VARINT and ZIGZAG to encode ROWDATA in state

2023-05-09 Thread Zakelly Lan
Hi Xiaogang Zhou, Thanks for driving this! I'm pretty interested in your verification test, could you please provide more details? AFAIK, the performance is related to the format of user data and the state size of the RocksDB, as well as the memory setup (determines the proportion of IO required

[VOTE] FLIP-306: Unified File Merging Mechanism for Checkpoints - Re-sent

2023-05-09 Thread Zakelly Lan
Hi everyone, (I'm resending this vote since the last email was blocked for some reason.) Thanks for all the feedback for FLIP-306: Unified File Merging Mechanism for Checkpoints[1] on the discussion thread[2]. I'd like to start a vote for it. The vote will be open for at least 72 hours (until

Re: [DISCUSS] FLIP-306: Unified File Merging Mechanism for Checkpoints

2023-05-05 Thread Zakelly Lan
, > > Thanks for the clarification! > > Currently, I understand what you mean, and LGTM. > > Best, > Rui Fan > > On Fri, May 5, 2023 at 12:27 PM Zakelly Lan wrote: > > > Hi all, > > > > @Yun Tang and I have an offline discussion, and we agreed that: > &g

Re: [DISCUSS] FLIP-306: Unified File Merging Mechanism for Checkpoints

2023-05-04 Thread Zakelly Lan
well. 2. There is a corner case that the directory may be left over when the job stops, so I added some content in section 4.8. Best, Zakelly [1] https://docs.google.com/document/d/1NJJQ30P27BmUvD7oa4FChvkYxMEgjRPTVdO1dHLl_9I/edit# On Fri, May 5, 2023 at 11:19 AM Zakelly Lan wrote: > >

Re: [DISCUSS] FLIP-306: Unified File Merging Mechanism for Checkpoints

2023-05-04 Thread Zakelly Lan
r jobs with > many tasks in a TM, it may be useful for file merging. However, > it doesn't work well for jobs with a small number of tasks in a TM. > > I prefer just adding the `max-file-pool-size`, and > the `pool size = number of tasks / max-file-pool-size`. WDYT? > > Maybe

Re: [DISCUSS] FLIP-306: Unified File Merging Mechanism for Checkpoints

2023-04-27 Thread Zakelly Lan
to follow up on this discussion. Best regards, Zakelly On Fri, Apr 28, 2023 at 12:03 AM Zakelly Lan wrote: > > Hi Yuan, > > Thanks for sharing your thoughts. Like you said, the code changes and > complexities are shaded in the newly introduced file management in TM, > while the o

Re: [DISCUSS] FLIP-306: Unified File Merging Mechanism for Checkpoints

2023-04-27 Thread Zakelly Lan
ort in this > direction if this really turns out working well. > > One more thing I want to mention is that the proposed design shaded all the > code changes and complexities in the newly introduced File management in > TM. That says without enabling File merging, the code path of File m

Re: [ANNOUNCE] New Apache Flink PMC Member - Leonard Xu

2023-04-24 Thread Zakelly Lan
Congratulations, Leonard! Best regards, Zakelly On Mon, Apr 24, 2023 at 3:25 PM Jing Ge wrote: > > Congrats! Leonard! > > > > Best regards, > > Jing > > On Mon, Apr 24, 2023 at 5:53 AM Matthias Pohl > wrote: > > > Congrats, Leonard :) > > > > On Mon, Apr 24, 2023, 05:17 Yangze Guo wrote: > >

Re: [ANNOUNCE] New Apache Flink PMC Member - Qingsheng Ren

2023-04-24 Thread Zakelly Lan
Congratulations, Qingsheng! Best regards, Zakelly On Mon, Apr 24, 2023 at 11:52 AM Matthias Pohl wrote: > > Congratulations, Qingsheng! :) > > On Mon, Apr 24, 2023, 05:17 Yangze Guo wrote: > > > Congratulations, Qingsheng! > > > > Best, > > Yangze Guo > > > > On Mon, Apr 24, 2023 at 10:05 AM

Re: [DISCUSS] FLIP-306: Unified File Merging Mechanism for Checkpoints

2023-04-12 Thread Zakelly Lan
r have a comparing table across different options just > like the doc wrote. And we could also list some of them in your Rejected > Alternatives part. > > > Best > Yun Tang > > From: Zakelly Lan > Sent: Tuesday, April 11, 2023 17:57 >

Re: [DISCUSS] FLIP-306: Unified File Merging Mechanism for Checkpoints

2023-04-11 Thread Zakelly Lan
production. Looking forward to its completion and > eventual acceptance by the community. > > [1] > https://github.com/apache/flink/blob/65710b437318364ec19c0369d038acc10498/flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/stre

Re: [DISCUSS] FLIP-306: Unified File Merging Mechanism for Checkpoints

2023-04-07 Thread Zakelly Lan
sts and investigation. Thanks. Best regards, Zakelly On Fri, Apr 7, 2023 at 8:15 PM Zakelly Lan wrote: > > Hi @Piotr and @Jingsong Li > > I have read access to the document, but I'm not sure whether the owner > of this document wants to make it public. Actually, the doc is

Re: [DISCUSS] FLIP-306: Unified File Merging Mechanism for Checkpoints

2023-04-07 Thread Zakelly Lan
Zakelly Lan wrote: > > Hi Piotr, > > Thanks for your comments! > > (1) Sorry for the misleading, let me make it more clear. It is a > concurrent checkpoint senario. Yes, the assumption you said needs to > be followed, but the state handles here refer to the original SST >

Re: [DISCUSS] FLIP-306: Unified File Merging Mechanism for Checkpoints

2023-04-07 Thread Zakelly Lan
erent. I'm not sure if I made myself clear. Thanks! Best regards, Zakelly On Fri, Apr 7, 2023 at 8:08 PM Zakelly Lan wrote: > > Hi Yun, > > Thanks for your suggestions! > > I have read the FLINK-23342 and its design doc as you provided. First > of all the goal of th

Re: [DISCUSS] FLIP-306: Unified File Merging Mechanism for Checkpoints

2023-04-07 Thread Zakelly Lan
we did not take the option-3 or option-5 in the design doc [1] > > > > for > > > > the code complexity when implements the 1st version of changelog > > > > state-backend. > > > > > > > > Could you also compare the current FLIP with the proposals in the design >

Re: [DISCUSS] FLIP-306: Unified File Merging Mechanism for Checkpoints

2023-04-06 Thread Zakelly Lan
gned checkpoint state would have been > merged with the operators state file, so all in all there would be no > regression visible to a user? The limit is that we always have at least a > single file per subtask, but in exchange we are getting a simpler threading > model? > > Bets, >

Re: [DISCUSS] FLIP-306: Unified File Merging Mechanism for Checkpoints

2023-04-04 Thread Zakelly Lan
aults? > > > [1] https://issues.apache.org/jira/browse/FLINK-26590 > > Best, > Yanfei > > Zakelly Lan 于2023年4月3日周一 18:36写道: > > > > > Hi everyone, > > > > I would like to open a discussion on providing a unified file merging > > mechanism f

[DISCUSS] FLIP-306: Unified File Merging Mechanism for Checkpoints

2023-04-03 Thread Zakelly Lan
Hi everyone, I would like to open a discussion on providing a unified file merging mechanism for checkpoints[1]. Currently, many files are uploaded to the DFS during checkpoints, leading to the 'file flood' problem when running intensive workloads in a cluster. To tackle this problem, various

Re: [ANNOUNCE] New Apache Flink PMC Members - Godfrey He, Xingbo Huang

2022-11-22 Thread Zakelly Lan
Congratulations, Godfrey and Xingbo! Best, Zakelly On Wed, Nov 23, 2022 at 2:07 PM yuxia wrote: > > Congrats,Godfrey and Xingbo! > > Best regards, > Yuxia > > - 原始邮件 - > 发件人: "Geng Biao" > 收件人: "dev" > 发送时间: 星期三, 2022年 11 月 23日 下午 12:32:52 > 主题: Re: [ANNOUNCE] New Apache Flink PMC

Re: [ANNOUNCE] Apache Flink 1.16.0 released

2022-10-30 Thread Zakelly Lan
Good to know & Congrats! Thanks everyone involved! Best, Zakelly On Mon, Oct 31, 2022 at 10:40 AM Becket Qin wrote: > > Hooray!! Congratulations to the team! > > Cheers, > > Jiangjie (Becket) Qin > > On Mon, Oct 31, 2022 at 9:57 AM Hang Ruan wrote: > > > Congratulations! > > > > Best, > >

Re: [VOTE] FLIP-263: Improve resolving schema compatibility

2022-10-27 Thread Zakelly Lan
Hi Hangxiang, The current plan looks good to me, +1 (non-binding). Thanks for driving this. Best, Zakelly On Fri, Oct 28, 2022 at 11:18 AM Yuan Mei wrote: > > +1 (binding) > > Thanks for driving this. > > Best > Yuan > > On Fri, Oct 28, 2022 at 11:17 AM yanfei lei wrote: > > > +1(non-binding)

Re: [ANNOUNCE] Performance Daily Monitoring Moved from Ververica to Apache Flink Slack Channel

2022-10-26 Thread Zakelly Lan
Hi yanfei, Thanks for driving this! It's a great help. I would like to join as a maintainer. Best, Zakelly On Wed, Oct 26, 2022 at 11:32 AM yanfei lei wrote: > > Hi everyone, > > As discussed earlier, we plan to create a benchmark channel in Apache Flink > slack[1], but the plan was shelved

Re: [DISCUSS] FLIP-263: Improve resolving schema compatibility

2022-10-14 Thread Zakelly Lan
Hi Hangxiang, I'm ok with your proposed Step 2, but I'm afraid you missed my point. As I described in the option 2, it is unnecessary to call the new and old interface both. Instead of that, replace any use of the old interface with the new interface, and call the old interface in the default

Re: [DISCUSS] FLIP-263: Improve resolving schema compatibility

2022-10-12 Thread Zakelly Lan
Hi Hangxiang, Thanks for driving this. It is reasonable to let the new serializer claim its compatibility with the old serializer. However, I think there is a little confusion as you described in your proposed change 'Step 1'. You mean that we let the new serializer check the compatibility first,

[jira] [Created] (FLINK-29437) The partition of data before and after the Kafka Shuffle are not aligned

2022-09-28 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-29437: --- Summary: The partition of data before and after the Kafka Shuffle are not aligned Key: FLINK-29437 URL: https://issues.apache.org/jira/browse/FLINK-29437 Project

[jira] [Created] (FLINK-29430) Sanity check in InternalKeyContextImpl#setCurrentKeyGroupIndex

2022-09-27 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-29430: --- Summary: Sanity check in InternalKeyContextImpl#setCurrentKeyGroupIndex Key: FLINK-29430 URL: https://issues.apache.org/jira/browse/FLINK-29430 Project: Flink

Re: [DISCUSS] Introduce multi delete API to Flink's FileSystem class

2022-06-30 Thread Zakelly Lan
Hi Yun, Thanks for bringing this into discussion. I'm +1 to this idea. And IIUC, Flink implements the OSS and S3 filesystem based on the hadoop filesystem interface, which does not provide the multi-delete API, it may take some effort to implement this. Best, Zakelly On Thu, Jun 30, 2022 at

Re: [ANNOUNCE] New Apache Flink Committers: Qingsheng Ren, Shengkai Fang

2022-06-20 Thread Zakelly Lan
Congrats, Qingsheng and Shengkai. Best, Zakelly On Mon, Jun 20, 2022 at 4:50 PM Geng Biao wrote: > Congrats to Qingsheng and Shengkai! > Best, > Biao Geng > > 获取 Outlook for iOS > > 发件人: Zhilong Hong > 发送时间: Monday, June 20, 2022 4:05:48

Re: Re: [DISCUSS ] Make state.backend.incremental as true by default

2022-06-16 Thread Zakelly Lan
Thanks for bringing this up. I'm +1 on enabling the incremental checkpoint by default on RocksDB. But I also agree with Yuan about not enabling this on newly implemented incremental checkpoint for hashmap statebackend. I am wondering can we make it behave differently for different state backends

Re: [ANNOUNCE] New Apache Flink PMC Member - Jingsong Lee

2022-06-15 Thread Zakelly Lan
Congrats & well deserved! Best, Zakelly On Thu, Jun 16, 2022 at 10:36 AM Guowei Ma wrote: > Congrats, Jingsong! > > Best, > Guowei > > > On Thu, Jun 16, 2022 at 9:49 AM Hangxiang Yu wrote: > > > Congrats, Jingsong! > > > > Best, > > Hangxiang > > > > On Thu, Jun 16, 2022 at 9:46 AM Aitozi

[jira] [Created] (FLINK-26998) Remove log-related configuration from predefined options in RocksDB state backend

2022-04-01 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-26998: --- Summary: Remove log-related configuration from predefined options in RocksDB state backend Key: FLINK-26998 URL: https://issues.apache.org/jira/browse/FLINK-26998

Re: [ANNOUNCE] New Apache Flink Committer - David Morávek

2022-03-14 Thread Zakelly Lan
Congratulations, David! Best, Zakelly On Mon, Mar 14, 2022 at 4:53 PM Arvid Heise wrote: > Gratz! > > On Mon, Mar 14, 2022 at 9:24 AM Anton Kalashnikov > wrote: > > > Congratulations, David! > > > > -- > > > > Best regards, > > Anton Kalashnikov > > > > 14.03.2022 09:18, Matthias Pohl пишет:

Re: [ANNOUNCE] New PMC member: Yuan Mei

2022-03-14 Thread Zakelly Lan
Congratulations, Yuan! Best, Zakelly On Mon, Mar 14, 2022 at 4:49 PM Johannes Moser wrote: > Congrats Yuan. > > > On 14.03.2022, at 09:45, Arvid Heise wrote: > > > > Congratulations and well deserved! > > > > On Mon, Mar 14, 2022 at 9:30 AM Matthias Pohl wrote: > > > >> Congratulations,

Re: [ANNOUNCE] New Apache Flink Committers: Feng Wang, Zhipeng Zhang

2022-02-16 Thread Zakelly Lan
Congratulations :-D On Thu, Feb 17, 2022 at 12:15 PM Leonard Xu wrote: > Congratulations ! > > > Best, > Leonard > > > 2022年2月17日 上午11:17,Paul Lam 写道: > > > > Congrats! Well deserved! > > > > Best, > > Paul Lam > > > >> 2022年2月16日 21:30,Robert Metzger 写道: > >> > >> Hi everyone, > >> > >> On

Re: [ANNOUNCE] New Apache Flink Committer - Yingjie Cao

2021-11-17 Thread Zakelly Lan
Congratulations, Yiingjie :) Best, Zakelly On Wed, Nov 17, 2021 at 2:58 PM Lincoln Lee wrote: > Congratulations! > > Best, > Lincoln Lee > > > Zhilong Hong 于2021年11月17日周三 下午2:23写道: > > > Congratulations, Yiingjie! > > > > > > Best regards, > > Zhilong > > > > On Wed, Nov 17, 2021 at 2:13 PM

Re: [ANNOUNCE] New Apache Flink Committer - Fabian Paul

2021-11-16 Thread Zakelly Lan
Congratulations, Fabian Best, Zakelly On Tue, Nov 16, 2021 at 11:21 PM liwei li wrote: > Congratulations Fabian :-) > > Piotr Nowojski 于2021年11月16日周二 下午11:16写道: > > > Congratulations :) > > > > wt., 16 lis 2021 o 16:04 Yang Wang napisał(a): > > > > > Congratulations Fabian! > > > > > > Best,

Re: [ANNOUNCE] New Apache Flink Committer - Jing Zhang

2021-11-16 Thread Zakelly Lan
Congratulations, Jing! Best, Zakelly On Tue, Nov 16, 2021 at 11:03 PM Yang Wang wrote: > Congratulations, Jing! > > Best, > Yang > > Benchao Li 于2021年11月16日周二 下午9:31写道: > > > Congratulations Jing~ > > > > OpenInx 于2021年11月16日周二 下午1:58写道: > > > > > Congrats Jing! > > > > > > On Tue, Nov 16,

Re: [ANNOUNCE] New Apache Flink Committer - Leonard Xu

2021-11-12 Thread Zakelly Lan
Congratulations :D Best, Zakelly On Fri, Nov 12, 2021 at 5:03 PM Piotr Nowojski wrote: > Congratulations :) > > Piotrek > > pt., 12 lis 2021 o 09:44 Lincoln Lee napisał(a): > > > Congratulations! > > > > > > Best, > > Lincoln Lee > > > > > > > > Dian Fu 于2021年11月12日周五 下午4:35写道: > > > > >

Re: [ANNOUNCE] New Apache Flink Committer - Yangze Guo

2021-11-11 Thread Zakelly Lan
Congrats & well deserved, Yangze Guo! Best, Zakelly On Fri, Nov 12, 2021 at 10:11 AM Xintong Song wrote: > Hi everyone, > > On behalf of the PMC, I'm very happy to announce Yangze Guo as a new Flink > committer. > > Yangze has been consistently contributing to this project for almost 3 >

Re: [VOTE] FLIP-187: Adaptive Batch Job Scheduler

2021-11-10 Thread Zakelly Lan
+1 (non-binding) It will be a great improvement. Best, Zakelly On Wed, Nov 10, 2021 at 5:24 PM Till Rohrmann wrote: > +1 (binding) > > Cheers, > Till > > On Wed, Nov 10, 2021 at 6:37 AM Zhu Zhu wrote: > > > +1 (binding) > > > > Thanks, > > Zhu > > > > Jingsong Li 于2021年11月9日周二 下午4:01写道: > >

Re: [VOTE] Release 1.12.5, release candidate #3

2021-07-29 Thread Zakelly Lan
+1 (non-binding) * Built from source. * Run wordcount datastream job on yarn * Web UI and checkpoint seem good. * Kill a container to make job failover, everything is good. * Try run job from checkpoint, everything is good. On Thu, Jul 29, 2021 at 2:34 PM Yun Tang wrote: > +1 (non-binding) > >

Re: [VOTE] Release 1.13.2, release candidate #3

2021-07-29 Thread Zakelly Lan
+1 (non-binding) * Built from source. * Run wordcount datastream job on yarn * Web UI and checkpoint seem good. * Kill a container to make job failover, everything is good. * Try run job from checkpoint, everything is good. On Fri, Jul 23, 2021 at 10:04 PM Yun Tang wrote: > Hi everyone, >

Re: [ANNOUNCE] New Apache Flink Committer - Yuan Mei

2021-07-07 Thread Zakelly Lan
Congratulations, Yuan. Best, Zakelly On Thu, Jul 8, 2021 at 10:14 AM Yun Tang wrote: > Congratulations, Yuan > > Best > Yun Tang > > From: Yu Li > Sent: Thursday, July 8, 2021 1:21 > To: dev ; Yuan Mei ; > yuan...@apache.org > Subject: [ANNOUNCE] New Apache

Re: [ANNOUNCE] New Apache Flink Committer - Yang Wang

2021-07-06 Thread Zakelly Lan
Congrats & well deserved, Yang Wang! Best, Zakelly On Wed, Jul 7, 2021 at 10:30 AM 刘建刚 wrote: > Congratulations, Yang Wang. > > Best > Jiangang Liu > > Leonard Xu 于2021年7月7日周三 上午10:27写道: > > > Congratulations! Yang Wang > > > > > > Best, > > Leonard > > > 在 2021年7月7日,10:23,tison 写道: > > > >

Re: [ANNOUNCE] New PMC member: Guowei Ma

2021-07-06 Thread Zakelly Lan
Congratulations, Guowei! Best, Zakelly On Wed, Jul 7, 2021 at 10:24 AM tison wrote: > Congrats! NB. > > Best, > tison. > > > Jark Wu 于2021年7月7日周三 上午10:20写道: > > > Congratulations Guowei! > > > > Best, > > Jark > > > > On Wed, 7 Jul 2021 at 09:54, XING JIN wrote: > > > > > Congratulations,

[jira] [Created] (FLINK-23253) Expose some interfaces of changelog to users

2021-07-05 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-23253: --- Summary: Expose some interfaces of changelog to users Key: FLINK-23253 URL: https://issues.apache.org/jira/browse/FLINK-23253 Project: Flink Issue Type: Sub

Re: [VOTE] Release 1.13.2, release candidate #1

2021-07-05 Thread Zakelly Lan
+1 (non-binding) - built from sources - run streaming job of wordcount - web-ui looks good - checkpoint and restore looks good Best, Zakelly On Mon, Jul 5, 2021 at 2:40 PM Jingsong Li wrote: > +1 (non-binding) > > - Verified checksums and signatures > - Built from sources > - run table

[jira] [Created] (FLINK-23075) Python API for enabling ChangelogStateBackend

2021-06-21 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-23075: --- Summary: Python API for enabling ChangelogStateBackend Key: FLINK-23075 URL: https://issues.apache.org/jira/browse/FLINK-23075 Project: Flink Issue Type

[jira] [Created] (FLINK-17645) REAPER_THREAD in SafetyNetCloseableRegistry start() failed, causing the repeated failover.

2020-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-17645: --- Summary: REAPER_THREAD in SafetyNetCloseableRegistry start() failed, causing the repeated failover. Key: FLINK-17645 URL: https://issues.apache.org/jira/browse/FLINK-17645

<    1   2   3