Hi, If I remember correctly, set operations supports only a limited set of configurations.
Most of them are table options that are listed on table configuration [1] plus some pipeline options. State backend options are not likely one of them. [1] https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/dev/table/config/ <https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/dev/table/config/> Best, Paul Lam > 2022年3月15日 19:21，dz902 <dz9...@gmail.com> 写道： > > Just tried editing flink-conf.yaml and it seems SQL Client does not respect > that also. Is this an intended behavior? > > On Tue, Mar 15, 2022 at 7:14 PM dz902 <dz9...@gmail.com > <mailto:dz9...@gmail.com>> wrote: > Hi, > > I'm using Flink 1.14 and was unable to set S3 as state backend. I tried > combination of: > > SET state.backend='filesystem'; > SET state.checkpoints.dir='s3://xxx/checkpoints/'; > SET state.backend.fs.checkpointdir='s3://xxx/checkpoints/'; > SET state.checkpoint-storage='filesystem' > > As well as: > > SET state.backend='hashmap'; > > Which covered both legacy 1.13 way to do it and 1.14 new way to do it. > > None worked. In the Web UI I see checkpoints being made to the Job Manager > continuously. Configuration reads: > > - Checkpoint Storage: JobManagerCheckpointStorage > - State Backend: HashMapStateBackend > > Is this a bug? Is there a way to set state backend to S3 using SQL Client? > > Thanks, > Dai > >
