Jinzhong Li created FLINK-35163:
---
Summary: Utilize ForSt's native MultiGet API to optimize remote
state access
Key: FLINK-35163
URL: https://issues.apache.org/jira/browse/FLINK-35163
Project: Flink
Jinzhong Li created FLINK-35162:
---
Summary: Support grouping state get and put access
Key: FLINK-35162
URL: https://issues.apache.org/jira/browse/FLINK-35162
Project: Flink
Issue Type: Sub-task
Jinzhong Li created FLINK-35161:
---
Summary: Implement StateExecutor for ForStStateBackend
Key: FLINK-35161
URL: https://issues.apache.org/jira/browse/FLINK-35161
Project: Flink
Issue Type: Sub
Jinzhong Li created FLINK-35125:
---
Summary: Implement ValueState for ForStStateBackend
Key: FLINK-35125
URL: https://issues.apache.org/jira/browse/FLINK-35125
Project: Flink
Issue Type: Sub
Congratulations, Zakelly!
Best,
Jinzhong
On Mon, Apr 15, 2024 at 2:56 PM Hangxiang Yu wrote:
> Congratulations, Zakelly!
>
> On Mon, Apr 15, 2024 at 1:58 PM Yun Tang wrote:
>
> > Congratulations, Zakelly!
> >
> > Best
> > Yun Tang
> >
> > From: Yanquan Lv
> >
Congratulations, Jing!
Best,
Jinzhong Li
On Mon, Apr 15, 2024 at 2:56 PM Hangxiang Yu wrote:
> Congratulations, Jing!
>
> On Mon, Apr 15, 2024 at 11:11 AM spoon_lz wrote:
>
> >
> >
> > Congratulations!
> >
> > Best,
> > lz
> >
Congratulations, Lincoln!
Best,
Jinzhong Li
On Mon, Apr 15, 2024 at 2:56 PM Hangxiang Yu wrote:
> Congratulations, Lincoln!
>
> On Mon, Apr 15, 2024 at 10:17 AM Zakelly Lan
> wrote:
>
> > Congratulations, Lincoln!
> >
> >
> > Best,
> > Zakelly
&g
+1 (non binding)
Bests,
Jinzhong
On Thu, Apr 11, 2024 at 7:26 AM Muhammet Orazov
wrote:
> Hey Rui,
>
> +1 (non-binding).
>
> Thanks for driving it!
>
> Best,
> Muhammet
>
> On 2024-04-10 04:36, Rui Fan wrote:
> > Hi devs,
> >
> > Thank you to everyone for the feedback on FLIP-441: Show
> >
Jinzhong Li created FLINK-35069:
---
Summary: ContinuousProcessingTimeTrigger continuously registers
timers in a loop at the end of the window
Key: FLINK-35069
URL: https://issues.apache.org/jira/browse/FLINK-35069
Jinzhong Li created FLINK-34982:
---
Summary: FLIP-428: Fault Tolerance/Rescale Integration for
Disaggregated State
Key: FLINK-34982
URL: https://issues.apache.org/jira/browse/FLINK-34982
Project: Flink
Jinzhong Li created FLINK-34981:
---
Summary: FLIP-426: Grouping Remote State Access
Key: FLINK-34981
URL: https://issues.apache.org/jira/browse/FLINK-34981
Project: Flink
Issue Type: New Feature
/j7015yymmdy9zp9vr3gg7qpmzjw0o7y2
Best,
Jinzhong Li
)
- Yanfei Lei (binding)
- Hangxiang Yu (binding)
There are no disapproving votes. Thanks to everyone who participated
in the discussion and voting.
[1] https://cwiki.apache.org/confluence/x/TYp3EQ
[2] https://lists.apache.org/thread/0yvspwhsf0vyvqkkd7snzg33k95v3jbc
Best,
Jinzhong Li
ould leave the optimization in the future FLIP, however,
> I think we should mention this topic in the current FLIP to make the
> overall design more complete and sophisticated.
>
>
> Best
> Yun Tang
> ____
> From: Jinzhong Li
> Sent: Thursday, March 28
Congratulations!
Best,
Jinzhong Li
On Thu, Mar 28, 2024 at 7:08 PM gongzhongqiang
wrote:
> Congratulations!
>
> Best,
>
> Zhongqiang Gong
>
> Yu Li 于2024年3月28日周四 15:57写道：
>
> > CC the Flink user and dev mailing list.
> >
> > Paimon originated w
sequent
> > flip, I think it is important to maintain the integrity of the current
> > changes. Otherwise we may suffer from wasted DFS space for some time.
> > >Perhaps we only need a simple cleanup strategy at this stage, such as
> > proactive cleanup when TM
M ownership in this FLIP, this
> design seems unnecessary.
> 2. This FLIP forgets to mention the cleanup of the remote working
> directory in case of the taskmanager crushes, even though this is an open
> problem, we can still leave some space for future optimization.
>
> Best,
>
Hi devs,
I'd like to start a vote on the FLIP-428: Fault Tolerance/Rescale
Integration for Disaggregated State [1]. The discussion thread is here [2].
The vote will be open for at least 72 hours unless there is an objection or
insufficient votes.
[1]
Hi devs,
I'd like to start a vote on the FLIP-426: Grouping Remote State Access [1].
The discussion thread is here [2].
The vote will be open for at least 72 hours unless there is an objection or
insufficient votes.
[1] https://cwiki.apache.org/confluence/x/TYp3EQ
[2]
Congratulations! Thanks for the great work!
Best,
Jinzhong
On Wed, Mar 27, 2024 at 10:28 AM Feifan Wang wrote:
> Congratulations !
>
>
> 在 2024-03-22 12:04:39，"Hangxiang Yu" 写道：
> >Congratulations!
> >Thanks for the efforts.
> >
> >On Fri, Mar 22, 2024 at 10:00 AM Yanfei Lei wrote:
> >
> >>
Jinzhong Li created FLINK-34936:
---
Summary: Register shared state files to FileMergingSnapshotManager
Key: FLINK-34936
URL: https://issues.apache.org/jira/browse/FLINK-34936
Project: Flink
rrent and manifest 8, but before asynchronous phase, the manifest
> reached
> > the size threshold and then the CURRENT FILE pointed to the new manifest
> 9,
> > and then uploaded the incorrect CURRENT file ?
> >
> > Jinzhong Li 于2024年3月20日周三 20:13写道：
> >
> > &
as I understand, DB.GetLiveFiles() retrieves the global mutex
> lock. I am wondering if RocksDBs optimistic transactions can be any of help
> in this situation?
>
> Regards,
> Jeyhun
>
> On Wed, Mar 20, 2024 at 1:35 PM Jinzhong Li
> wrote:
>
> > Hi Yue
+1 (non-binding)
Best,
Jinzhong
On Thu, Mar 21, 2024 at 6:15 PM Zakelly Lan wrote:
> +1 non-binding
>
>
> Best,
> Zakelly
>
> On Thu, Mar 21, 2024 at 5:34 PM Gyula Fóra wrote:
>
> > +1 (binding)
> >
> > Gyula
> >
> > On Thu, Mar 21, 2024 at 3:33 AM Rui Fan <1996fan...@gmail.com> wrote:
> >
>
gt; if we support synchronous models in the future
>
> Jinzhong Li 于2024年3月19日周二 20:59写道：
>
> > Hi Yue,
> >
> > Thanks for your feedback!
> >
> > > 1. Does Grouping Remote State Access only support asynchronous
> > interfaces?
> > >--If it is: IIUC,
Hi Yue,
Thanks for your feedback!
> 1. If we choose Option-3 for ForSt , how would we handle Manifest File
> ? Should we take a snapshot of the Manifest during the synchronization
phase?
IIUC, the GetLiveFiles() API in Option-3 can also catch the fileInfo of
Manifest files, and this api also
, 2024 at 8:56 PM Jinzhong Li
wrote:
> Hi Yue,
>
> Thanks for your feedback!
>
> > 1. Does Grouping Remote State Access only support asynchronous
> interfaces?
> >--If it is: IIUC, MultiGet can also greatly improve performance for
> > synchronous access modes. D
at 4:55 PM Jinzhong Li wrote:
> Hi devs,
>
> I'd like to start a discussion on a sub-FLIP of FLIP-423: Disaggregated
> State Storage and Management[1], which is a joint work of Yuan Mei, Zakelly
> Lan, Jinzhong Li, Hangxiang Yu, Yanfei Lei and Feng Wang:
>
> - FLIP-428: Fa
IP426:GroupingRemoteStateAccess-CodeExampleonHowtoAccessStateUsingBatch
Best,
Jinzhong Li
On Tue, Mar 19, 2024 at 5:52 PM yue ma wrote:
> Hi Jinzhong,
>
> Thanks for the FLIP. I have the following questions:
>
> 1. Does Grouping Remote State Access only support asynchronous interfa
SS] FLIP-426: Grouping Remote State Access
>
>
>
> -- Forwarded message -
> From: Jinzhong Li lijinzhong2...@gmail.com>>
> Date: Thu, Mar 7, 2024 at 4:52 PM
> Subject: [DISCUSS] FLIP-426: Grouping Remote State Access
> To: mailto:dev@flink.apache.org&g
Jinzhong Li created FLINK-34670:
---
Summary: Use SynchronousQueue to create asyncOperationsThreadPool
for SubtaskCheckpointCoordinatorImpl
Key: FLINK-34670
URL: https://issues.apache.org/jira/browse/FLINK-34670
-binding)
- Jing Ge (binding)
- Ahmed Hamdy (non-binding)
There are no disapproving votes. Thanks to everyone who participated in
the discussion and voting.
[1] https://cwiki.apache.org/confluence/x/JQs4EQ
[2] https://lists.apache.org/thread/gfgz4j2m15w8ppwhdgm1f3nhsdpvphox
Best,
Jinzhong Li
add more info into the PublicEvolving annotation.
> >
> >
> Fair enough! Thanks for the hint!
>
> Best regards,
> Jing
>
>
>
> On Mon, Mar 11, 2024 at 9:03 AM Jinzhong Li
> wrote:
>
> > Hi Jing.
> >
> > Thanks for your suggestion.
> &g
is
> component? Because AEC receives (potentially many) requests from operators,
> it can easily be a bottleneck to the whole pipeline.
>
> Regards,
> Jeyhun
>
> On Thu, Mar 7, 2024 at 9:53 AM Jinzhong Li
> wrote:
>
> > Hi devs,
> >
> >
> > I'd l
e info into the PublicEvolving
> annotation in order to kick off the graduation process. WDYT?
>
> Best regards,
> Jing
>
> [1]
>
> https://cwiki.apache.org/confluence/display/FLINK/FLIP-197%3A+API+stability+graduation+process
>
> On Mon, Feb 26, 2024 at 2:22 PM Jinzhong
nimal cost?
3. For state TTL, should StateDeclaration also provide interfaces for users
to declare state ttl?
Best,
Jinzhong Li
On Thu, Mar 7, 2024 at 5:08 PM weijie guo wrote:
> Hi Hangxiang,
>
> Thanks for your reply!
>
> > We have also discussed in FLIP-359/FLINK-3
Hi devs,
I'd like to start a discussion on a sub-FLIP of FLIP-423: Disaggregated
State Storage and Management[1], which is a joint work of Yuan Mei, Zakelly
Lan, Jinzhong Li, Hangxiang Yu, Yanfei Lei and Feng Wang:
- FLIP-428: Fault Tolerance/Rescale Integration for Disaggregated State
<ht
Hi devs,
I'd like to start a discussion on a sub-FLIP of FLIP-423: Disaggregated
State Storage and Management[1], which is a joint work of Yuan Mei, Zakelly
Lan, Jinzhong Li, Hangxiang Yu, Yanfei Lei and Feng Wang:
- FLIP-426: Grouping Remote State Access
<https://cwiki.apache.org/conflue
/JQs4EQ
[2]https://lists.apache.org/thread/4t71lz2j2ft8hf90ylvtomynhr2qthoo
Best,
Jinzhong Li
Hi all,
Thanks for all the feedback. It seems there are no more questions
unaddressed. I would like to open the voting thread after three days.
Please let me know if you have any concerns, thanks!
Best,
Jinzhong Li
On Mon, Feb 26, 2024 at 11:29 AM Yanfei Lei wrote:
> @Yun Tang
>
ther leave
it unmarked or mark it as @Internal. I just consider that
SingleStateIterator is one interface with the "public" modifier and it is
harmless to annotate it as @Internal.
Hi Hangxiang,
Thanks for the reminder!
It makes sense to mark RocksDBStateBackendFactory as Deprecated.
Best,
Jinzho
will add annotations for them to clarify their
usage.
Looking forward to hearing from you, thanks!
Best regards,
Jinzhong Li
[1]
https://cwiki.apache.org/confluence/display/FLINK/FLIP-420%3A+Add+API+annotations+for+RocksDB+StateBackend+user-facing+classes
[2] https://issues.apache.org/jira
Jinzhong Li created FLINK-34078:
---
Summary: Move InternalKeyContext classes from
o.a.f.runtime.state.heap to o.a.f.runtime.state package
Key: FLINK-34078
URL: https://issues.apache.org/jira/browse/FLINK-34078
Hi Zakelly,
Thanks for driving the discussion. It makes sense to remove LEGACY mode in
Flink 2.0.
Best,
Jinzhong Li
On Mon, Jan 15, 2024 at 10:34 AM Xuannan Su wrote:
> Hi Zakelly,
>
> Thanks for driving this. +1 to removing the LEGACY mode.
>
> Best regards,
> Xuannan
Jinzhong Li created FLINK-34050:
---
Summary: Rocksdb state has space amplification after rescaling
with DeleteRange
Key: FLINK-34050
URL: https://issues.apache.org/jira/browse/FLINK-34050
Project: Flink
Jinzhong Li created FLINK-33881:
---
Summary: [TtlListState]Avoid copy and update value when
TtlListState don‘t have expired element
Key: FLINK-33881
URL: https://issues.apache.org/jira/browse/FLINK-33881
Hi Piotr,
Thanks for driving this proposal! I strongly agree that the existing
metric APIs are not suitable for monitoring restore/checkpoint behavior!
I think the TM-level recovery/checkpointing traces are necessary in the
future. In our production environment, we sometimes encounter that job
Jinzhong Li created FLINK-32955:
---
Summary: Support state compatibility between enabling TTL and
disabling TTL
Key: FLINK-32955
URL: https://issues.apache.org/jira/browse/FLINK-32955
Project: Flink
Jinzhong Li created FLINK-32953:
---
Summary: [State TTL]resolve data correctness problem after ttl was
changed
Key: FLINK-32953
URL: https://issues.apache.org/jira/browse/FLINK-32953
Project: Flink
Jinzhong Li created FLINK-28515:
---
Summary: The files in local recovery directory hasn't be clean up
properly after checkpoint abort
Key: FLINK-28515
URL: https://issues.apache.org/jira/browse/FLINK-28515
Congratulations!
Best,
Jinzhong
On Wed, Feb 16, 2022 at 9:23 PM Robert Metzger wrote:
> Hi all,
>
> I would like to formally announce a few new Flink PMC members on the dev@
> list. The PMC has not done a good job of always announcing new PMC members
> (and committers) recently. I'll try to
Congratulations!
Best,
Jinzhong
Robert Metzger 于2022年2月16日周三 21:32写道：
> Hi everyone,
>
> On behalf of the PMC, I'm very happy to announce two new Flink
> committers: Feng Wang and Zhipeng Zhang!
>
> Feng is one of the most active Flink evangelists in China, with plenty of
> public talks,
Jinzhong Li created FLINK-25314:
---
Summary: Update log4j2 version to 2.16.0
Key: FLINK-25314
URL: https://issues.apache.org/jira/browse/FLINK-25314
Project: Flink
Issue Type: Improvement
Jinzhong Li created FLINK-25094:
---
Summary: The verify code in
LatencyTrackingMapStateTest#verifyIterator is not actually executed
Key: FLINK-25094
URL: https://issues.apache.org/jira/browse/FLINK-25094
54 matches
Mail list logo
