Hi Zhanghao， flink run -m yarn-cluster -ys 4 -ynm EventCleaning_wl -yjm 2G -ytm 16G -yqu default -p 8 -yDstate.backend.latency-track.keyed-state-enabled=true -c com.zkj.task.EventCleaningTask SourceDataCleaning-wl_0410.jar --sourceTopic dwd_audio_record --groupId clean_wl_ --sourceServers x.x.x.x:9092
Tried， it doesn't work, the error is: Could not get job jar and dependencies from JAR file: JAR file does not exist: -yDstate.backend.latency-track.keyed-state-enabled=true Thanks， Lei On Thu, Apr 11, 2024 at 5:19 PM Zhanghao Chen <zhanghao.c...@outlook.com> wrote: > Hi Lei, > > You are using an old-styled CLI for YARN jobs where "-yD" instead of "-D" > should be used. > ------------------------------ > *From:* Lei Wang <leiwang...@gmail.com> > *Sent:* Thursday, April 11, 2024 12:39 > *To:* Biao Geng <biaoge...@gmail.com> > *Cc:* user <user@flink.apache.org> > *Subject:* Re: How to enable RocksDB native metrics？ > > Hi Biao, > > I tried, it doesn't work. The cmd is: > > flink run -m yarn-cluster -ys 4 -ynm EventCleaning_wl -yjm 2G -ytm 16G > -yqu default -p 8 -Dstate.backend.latency-track.keyed-state-enabled=true > -c com.zkj.task.EventCleaningTask SourceDataCleaning-wl_0410.jar > --sourceTopic dwd_audio_record --groupId clean_wl_ --sourceServers > x.x.x.x:9092 > > Seems the -D param is ignored. Even i change the param to a wrong > spelling, the job is submitted successfully. > Any suggestions on this? > > Thanks, > Lei > > On Mon, Apr 8, 2024 at 9:48 AM Biao Geng <biaoge...@gmail.com> wrote: > > Hi Lei, > You can use the "-D" option in the command line to set configs for a > specific job. E.g, `flink run-application -t > yarn-application -Djobmanager.memory.process.size=1024m .... `. > See > https://nightlies.apache.org/flink/flink-docs-release-1.19/docs/deployment/cli/ > for more details. > > Best, > Biao Geng > > Marco Villalobos <mvillalo...@kineteque.com> 于2024年4月8日周一 09:22写道： > > Hi Lei, > > Have you tried enabling these Flink configuration properties? > > Configuration > <https://nightlies.apache.org/flink/flink-docs-release-1.19/docs/deployment/config/#rocksdb-native-metrics> > nightlies.apache.org > <https://nightlies.apache.org/flink/flink-docs-release-1.19/docs/deployment/config/#rocksdb-native-metrics> > [image: favicon.png] > <https://nightlies.apache.org/flink/flink-docs-release-1.19/docs/deployment/config/#rocksdb-native-metrics> > <https://nightlies.apache.org/flink/flink-docs-release-1.19/docs/deployment/config/#rocksdb-native-metrics> > > Sent from my iPhone > > On Apr 7, 2024, at 6:03 PM, Lei Wang <leiwang...@gmail.com> wrote: > > > I want to enable it only for specified jobs, how can I specify the > configurations on cmd line when submitting a job? > > Thanks， > Lei > > On Sun, Apr 7, 2024 at 4:59 PM Zakelly Lan <zakelly....@gmail.com> wrote: > > Hi Lei, > > You can enable it by some configurations listed in: > https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/deployment/config/#rocksdb-native-metrics > (RocksDB Native Metrics) > > > Best, > Zakelly > > On Sun, Apr 7, 2024 at 4:59 PM Zakelly Lan <zakelly....@gmail.com> wrote: > > Hi Lei, > > You can enable it by some configurations listed in: > https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/deployment/config/#rocksdb-native-metrics > (RocksDB Native Metrics) > > > Best, > Zakelly > > On Sun, Apr 7, 2024 at 4:47 PM Lei Wang <leiwang...@gmail.com> wrote: > > > Using big state and want to do some performance tuning, how can i enable > RocksDB native metrics？ > > I am using Flink 1.14.4 > > Thanks， > Lei > >
