Re: Setting S3 as State Backend in SQL Client

2022-03-16 Thread Martijn Visser
Hi dz902, I actually can't find that sentence on the website you've linked to. It does state "The following sections list all available options that can be used to adjust Flink Table & SQL API programs.". So that list are the available options that you can use. The options that you're trying are

Re: Setting S3 as State Backend in SQL Client

2022-03-16 Thread dz902
Hi, Per SQL Lite doc ( https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/dev/table/sqlclient/) I see this: > SQL Client Configuration > You can configure the SQL client by setting the options below, or any valid Flink configuration entry: So any valid Flink configuration should

Re: Setting S3 as State Backend in SQL Client

2022-03-16 Thread Paul Lam
Hi, If I remember correctly, set operations supports only a limited set of configurations. Most of them are table options that are listed on table configuration [1] plus some pipeline options. State backend options are not likely one of them. [1]

Re: Setting S3 as State Backend in SQL Client

2022-03-15 Thread dz902
Just tried editing flink-conf.yaml and it seems SQL Client does not respect that also. Is this an intended behavior? On Tue, Mar 15, 2022 at 7:14 PM dz902 wrote: > Hi, > > I'm using Flink 1.14 and was unable to set S3 as state backend. I tried > combination of: > > SET

Setting S3 as State Backend in SQL Client

2022-03-15 Thread dz902
Hi, I'm using Flink 1.14 and was unable to set S3 as state backend. I tried combination of: SET state.backend='filesystem'; SET state.checkpoints.dir='s3://xxx/checkpoints/'; SET state.backend.fs.checkpointdir='s3://xxx/checkpoints/'; SET state.checkpoint-storage='filesystem' As well as: SET