Re: Force to commit kafka offset when stop a job.

2024-06-11 Thread Lei Wang
; Zhanghao Chen > -- > *From:* Lei Wang > *Sent:* Thursday, June 6, 2024 16:54 > *To:* Zhanghao Chen ; ruanhang1...@gmail.com < > ruanhang1...@gmail.com> > *Cc:* user > *Subject:* Re: Force to commit kafka offset when stop a job. > > Thanks Zhanghao && Hang. >

Re: Force to commit kafka offset when stop a job.

2024-06-06 Thread Zhanghao Chen
Yes, the exact offset position will also be committed when doing the savepoint. Best, Zhanghao Chen From: Lei Wang Sent: Thursday, June 6, 2024 16:54 To: Zhanghao Chen ; ruanhang1...@gmail.com Cc: user Subject: Re: Force to commit kafka offset when stop a job

Re: Force to commit kafka offset when stop a job.

2024-06-06 Thread Lei Wang
--- > *From:* Lei Wang > *Sent:* Wednesday, June 5, 2024 22:47 > *To:* user > *Subject:* Force to commit kafka offset when stop a job. > > > When stopping a flink job that consuming kafka message, how to force it to > commit kafka offset > > Thanks, > Lei >

Re: Force to commit kafka offset when stop a job.

2024-06-05 Thread Zhanghao Chen
From: Lei Wang Sent: Wednesday, June 5, 2024 22:47 To: user Subject: Force to commit kafka offset when stop a job. When stopping a flink job that consuming kafka message, how to force it to commit kafka offset Thanks, Lei

Re: Force to commit kafka offset when stop a job.

2024-06-05 Thread Hang Ruan
Hi Lei. I think you could try to use `stop with savepoint` to stop the job. The offset will be committed when the checkpoint finished. So I think `stop with savepoint` may be helpful. Best, Hang Lei Wang 于2024年6月6日周四 01:16写道: > > When stopping a flink job that consuming kafka message, how to f

Force to commit kafka offset when stop a job.

2024-06-05 Thread Lei Wang
When stopping a flink job that consuming kafka message, how to force it to commit kafka offset Thanks, Lei