Hi dz902, I actually can't find that sentence on the website you've linked to. It does state "The following sections list all available options that can be used to adjust Flink Table & SQL API programs.". So that list are the available options that you can use. The options that you're trying are not included in the list, you can't set those options from the SQL Client.
Options that you set in flink-conf.yaml are applicable to the jobs on the cluster, so also the ones created via the SQL Client. Best regards, Martijn Visser https://twitter.com/MartijnVisser82 On Wed, 16 Mar 2022 at 08:43, dz902 <dz9...@gmail.com> wrote: > Hi, > > Per SQL Lite doc ( > https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/dev/table/sqlclient/) > I see this: > > > SQL Client Configuration > > You can configure the SQL client by setting the options below, or any > valid Flink configuration entry: > > So any valid Flink configuration should work? For example, > execution.checkpointing.interval='10s' works despite not being listed there. > > > On Wed, Mar 16, 2022 at 3:07 PM Paul Lam <paullin3...@gmail.com> wrote: > >> Hi, >> >> If I remember correctly, set operations supports only a limited set of >> configurations. >> >> Most of them are table options that are listed on table configuration [1] >> plus some pipeline options. >> >> State backend options are not likely one of them. >> >> [1] >> https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/dev/table/config/ >> >> Best, >> Paul Lam >> >> 2022年3月15日 19:21，dz902 <dz9...@gmail.com> 写道： >> >> Just tried editing flink-conf.yaml and it seems SQL Client does not >> respect that also. Is this an intended behavior? >> >> On Tue, Mar 15, 2022 at 7:14 PM dz902 <dz9...@gmail.com> wrote: >> >>> Hi, >>> >>> I'm using Flink 1.14 and was unable to set S3 as state backend. I tried >>> combination of: >>> >>> SET state.backend='filesystem'; >>> SET state.checkpoints.dir='s3://xxx/checkpoints/'; >>> SET state.backend.fs.checkpointdir='s3://xxx/checkpoints/'; >>> SET state.checkpoint-storage='filesystem' >>> >>> As well as: >>> >>> SET state.backend='hashmap'; >>> >>> Which covered both legacy 1.13 way to do it and 1.14 new way to do it. >>> >>> None worked. In the Web UI I see checkpoints being made to the Job >>> Manager continuously. Configuration reads: >>> >>> - Checkpoint Storage: JobManagerCheckpointStorage >>> - State Backend: HashMapStateBackend >>> >>> Is this a bug? Is there a way to set state backend to S3 using SQL >>> Client? >>> >>> Thanks, >>> Dai >>> >>> >>> >>
