Checkpointed data size is zero
Hello Community, I have a requirement to read data coming over TCP socket stream and for the same written one custom source function reading data by TCP socket. Job is running successfully but in flink dashboard checkpoint overview, checkpointed data size is 0. Can you please help if there is anything need to check or some issue/limitation due to TCP streaming? Rgds, Kamal
Re: Checkpointed data size is zero
Hi Kamal, You can check whether flink job has readed data from source in flink web ui, it will show total record count and size for each operator. Best, Shammon FY On Sat, Jul 1, 2023 at 4:53 PM Kamal Mittal via user wrote: > Hello Community, > > > > I have a requirement to read data coming over TCP socket stream and for > the same written one custom source function reading data by TCP socket. > > > > Job is running successfully but in flink dashboard checkpoint overview, > checkpointed data size is 0. > > > > Can you please help if there is anything need to check or some > issue/limitation due to TCP streaming? > > > > Rgds, > > Kamal >
Re: Checkpointed data size is zero
Hi Kamal, Is the Full Checkpoint Data Size[1] also zero? If not, it may be that no data is processed during this checkpoint. [1] https://nightlies.apache.org/flink/flink-docs-release-1.16/docs/ops/monitoring/checkpoint_monitoring/ Shammon FY 于2023年7月4日周二 09:10写道： > > Hi Kamal, > > You can check whether flink job has readed data from source in flink web ui, > it will show total record count and size for each operator. > > Best, > Shammon FY > > On Sat, Jul 1, 2023 at 4:53 PM Kamal Mittal via user > wrote: >> >> Hello Community, >> >> >> >> I have a requirement to read data coming over TCP socket stream and for the >> same written one custom source function reading data by TCP socket. >> >> >> >> Job is running successfully but in flink dashboard checkpoint overview, >> checkpointed data size is 0. >> >> >> >> Can you please help if there is anything need to check or some >> issue/limitation due to TCP streaming? >> >> >> >> Rgds, >> >> Kamal -- Best, Yanfei
