How to read flinkSQL job state

2023-09-05 Thread Yifan He via user
Hi team, We are investigating why the checkpoint size of our FlinkSQL jobs keeps growing and we want to look into the checkpoint file to know what is causing the problem. I know we can use the state processor api to read the state of jobs using datastream api, but how can I read the state of jobs

RE: Re: How to read flinkSQL job state

2023-09-06 Thread Yifan He via user
elease-1.17/docs/libs/state_processor_api/ > > [2] > > https://nightlies.apache.org/flink/flink-docs-release-1.17/docs/dev/table/data_stream_api/#converting-between-datastream-and-table > > > > Yifan He via user 于2023年9月6日周三 13:10写道: > > > >> Hi team, > >

RE: Re: How to read flinkSQL job state

2023-09-06 Thread Yifan He via user
ou using ? > 2. Are you enabling incremental checkpoint ? The checkpoint size you > mentioned is incremental size or full size ? > 3. If full size, Did you evaluate whether the size is matching the > theoretical size ? > > > On Wed, Sep 6, 2023 at 1:11 PM Yifan He via user >

RE: Re: Re: How to read flinkSQL job state

2023-09-06 Thread Yifan He via user
Tasks Disabled Thanks, Yifan On 2023/09/07 06:16:41 Hangxiang Yu wrote: > Hi, Yifan. > Which flink version are you using ? > You are using filesystem instead of rocksdb so that your checkpoint size > may not be incremental IIUC. > > On Thu, Sep 7, 2023 at 10:52 AM Yifan He

RE: Re: Re: How to read flinkSQL job state

2023-09-20 Thread Yifan He via user
fan. > Which flink version are you using ? > You are using filesystem instead of rocksdb so that your checkpoint size > may not be incremental IIUC. > > On Thu, Sep 7, 2023 at 10:52 AM Yifan He via user > wrote: > > > Hi Shammon, > > > > We are us