> *To:* Zhanghao Chen
> *Cc:* Biao Geng ; user
> *Subject:* Re: How to enable RocksDB native metrics?
>
> Hi Zhanghao,
>
> flink run -m yarn-cluster -ys 4 -ynm EventCleaning_wl -yjm 2G -ytm 16G
> -yqu default -p 8 -yDstate.backend.latency-track.keyed-state-ena
Add a space between -yD and the param should do the trick.
Best,
Zhanghao Chen
From: Lei Wang
Sent: Thursday, April 11, 2024 19:40
To: Zhanghao Chen
Cc: Biao Geng ; user
Subject: Re: How to enable RocksDB native metrics?
Hi Zhanghao,
flink run -m yarn-cluster
old-styled CLI for YARN jobs where "-yD" instead of "-D"
> should be used.
> --
> *From:* Lei Wang
> *Sent:* Thursday, April 11, 2024 12:39
> *To:* Biao Geng
> *Cc:* user
> *Subject:* Re: How to enable RocksDB native metrics?
Hi Lei,
You are using an old-styled CLI for YARN jobs where "-yD" instead of "-D"
should be used.
From: Lei Wang
Sent: Thursday, April 11, 2024 12:39
To: Biao Geng
Cc: user
Subject: Re: How to enable RocksDB native metrics?
Hi Biao,
I
Hi Biao,
I tried, it doesn't work. The cmd is:
flink run -m yarn-cluster -ys 4 -ynm EventCleaning_wl -yjm 2G -ytm 16G -yqu
default -p 8 -Dstate.backend.latency-track.keyed-state-enabled=true -c
com.zkj.task.EventCleaningTask SourceDataCleaning-wl_0410.jar --sourceTopic
dwd_audio_record --grou
Hi Biao,
I tried, it does
On Mon, Apr 8, 2024 at 9:48 AM Biao Geng wrote:
> Hi Lei,
> You can use the "-D" option in the command line to set configs for a
> specific job. E.g, `flink run-application -t
> yarn-application -Djobmanager.memory.process.size=1024m `.
> See
> https://nightlies
Hi Lei,
You can use the "-D" option in the command line to set configs for a
specific job. E.g, `flink run-application -t
yarn-application -Djobmanager.memory.process.size=1024m `.
See
https://nightlies.apache.org/flink/flink-docs-release-1.19/docs/deployment/cli/
for more details.
Best,
Bia
I can enable them by adding to flink-conf.yaml, it will work.
However, I don't want to edit the flink-conf.yaml file, I want to enable
the configurations when submitting a job on cmd line, then it only
works for the job I submitted, I have no idea how to do this?
Thanks,
Lei
On Mon, Apr 8, 2024
Hi Lei, Have you tried enabling these Flink configuration properties?Configurationnightlies.apache.orgSent from my iPhoneOn Apr 7, 2024, at 6:03 PM, Lei Wang wrote:I want to enable it only for specified jobs, how can I specify the configurations on cmd line when submitting a job?Thanks,LeiOn
I want to enable it only for specified jobs, how can I specify the
configurations on cmd line when submitting a job?
Thanks,
Lei
On Sun, Apr 7, 2024 at 4:59 PM Zakelly Lan wrote:
> Hi Lei,
>
> You can enable it by some configurations listed in:
> https://nightlies.apache.org/flink/flink-docs
Hi Lei,
You can enable it by some configurations listed in:
https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/deployment/config/#rocksdb-native-metrics
(RocksDB Native Metrics)
Best,
Zakelly
On Sun, Apr 7, 2024 at 4:59 PM Zakelly Lan wrote:
> Hi Lei,
>
> You can enable it by so
You can take a look at the document. [
https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/deployment/config/#rocksdb-native-metrics
]
Thanks,
Zbz
> 2024年4月7日 13:41,Lei Wang 写道:
>
>
> Using big state and want to do some performance tuning, how can i enable
> RocksDB native metri
12 matches
Mail list logo