The ClickCountJob used in the operations playground accepts an application parameter, like this:
flink run -d /opt/ClickCountJob.jar --bootstrap.servers kafka:9092 --checkpointing --event-time --backpressure To try this, you would modify the docker-compose.yaml file in [1]. If you want to see how it is implemented, see [2]. You can not use this --backpressure option with any other application. [1] https://github.com/apache/flink-playgrounds/blob/release-1.11/operations-playground/docker-compose.yaml [2] https://github.com/apache/flink-playgrounds/blob/release-1.11/docker/ops-playground-image/java/flink-playground-clickcountjob/src/main/java/org/apache/flink/playgrounds/ops/clickcount/functions/BackpressureMap.java On Sat, Oct 10, 2020 at 7:26 AM 大森林 <appleyu...@foxmail.com> wrote: > Thanks for both of your help... > but... > > I can not understand both: > > ------------------------------------------------------------------------------------------------ > Dear David Anderson: > Is the whole command like this? > flink run *--backpressure* -c wordcount_increstate > datastream_api-1.0-SNAPSHOT.jar > > > ------------------------------------------------------------------------------------------------ > Dear Arvid Heise: > For conf.setInteger(RestOptions.PORT, RestOptions.PORT.defaultValue()); > will this settings work to sleep when the output stream is generating? > > > ------------------------------------------------------------------------------------------------ > apologise for my poor basic knowledge of flink~ > Thanks for both of your help~ > > > > ------------------ 原始邮件 ------------------ > *发件人:* "David Anderson" <dander...@apache.org>; > *发送时间:* 2020年10月9日(星期五) 晚上8:23 > *收件人:* "Arvid Heise"<ar...@ververica.com>; > *抄送:* "大森林"<appleyu...@foxmail.com>;"user"<user@flink.apache.org>; > *主题:* Re: how to simulate the scene "back pressure" in flink?Thanks~! > > The Flink Operations Playground includes an optional backpressure > simulation you can experiment with. It is described at the end of [1]. > > [1] > https://ci.apache.org/projects/flink/flink-docs-release-1.11/try-flink/flink-operations-playground.html#variants > > > On Fri, Oct 9, 2020 at 10:02 AM Arvid Heise <ar...@ververica.com> wrote: > >> You can add >> >> conf.setInteger(RestOptions.PORT, RestOptions.PORT.defaultValue()); >> >> at any place before creating the environment [1]. Default value is 8081, >> so you can access web ui through http://localhost:8081, but you can >> really choose any other free port. >> >> [1] >> https://github.com/apache/flink/blob/61a997364b020b44bd26df76208e76106c6390b5/flink-tests/src/test/java/org/apache/flink/test/checkpointing/UnalignedCheckpointITCase.java#L198 >> On Fri, Oct 9, 2020 at 9:24 AM 大森林 <appleyu...@foxmail.com> wrote: >> >>> Thanks for your repies, >>> could you tell me where to set RestOption.POPT?in configuration >>> what's the value should I set for RestOption.PORT? >>> >>> Thanks. >>> >>> >>> ------------------ 原始邮件 ------------------ >>> *发件人:* "Arvid Heise" <ar...@ververica.com>; >>> *发送时间:* 2020年10月9日(星期五) 下午3:00 >>> *收件人:* "大森林"<appleyu...@foxmail.com>; >>> *抄送:* "David ,Anderson"<dander...@apache.org>;"user"< >>> user@flink.apache.org>; >>> *主题:* Re: how to simulate the scene "back pressure" in flink?Thanks~! >>> >>> The easiest way to see backpressure is to add some sleep to your sink, >>> check [1] for an example. >>> If you execute that unit test with a RestOption.PORT set in the >>> configuration, you can even load the Web UI and watch the backpressure >>> accumulate and finally go away at the end of the test. >>> >>> [1] >>> https://github.com/apache/flink/blob/61a997364b020b44bd26df76208e76106c6390b5/flink-tests/src/test/java/org/apache/flink/test/checkpointing/UnalignedCheckpointITCase.java#L536 >>> >>> On Tue, Oct 6, 2020 at 4:13 PM 大森林 <appleyu...@foxmail.com> wrote: >>> >>>> >>>> I want to learn the concept "back pressure". >>>> but I can not find the datastream generator example to generate a lot >>>> of data. >>>> >>>> besides, >>>> is there any example on how to simulate the scene "back pressure" in >>>> WEB UI? >>>> >>>> Thanks for your help~ >>>> >>> >>> >>> -- >>> >>> Arvid Heise | Senior Java Developer >>> >>> <https://www.ververica.com/> >>> >>> Follow us @VervericaData >>> >>> -- >>> >>> Join Flink Forward <https://flink-forward.org/> - The Apache Flink >>> Conference >>> >>> Stream Processing | Event Driven | Real Time >>> >>> -- >>> >>> Ververica GmbH | Invalidenstrasse 115, 10115 Berlin, Germany >>> >>> -- >>> Ververica GmbH >>> Registered at Amtsgericht Charlottenburg: HRB 158244 B >>> Managing Directors: Timothy Alexander Steinert, Yip Park Tung Jason, Ji >>> (Toni) Cheng >>> >> >> >> -- >> >> Arvid Heise | Senior Java Developer >> >> <https://www.ververica.com/> >> >> Follow us @VervericaData >> >> -- >> >> Join Flink Forward <https://flink-forward.org/> - The Apache Flink >> Conference >> >> Stream Processing | Event Driven | Real Time >> >> -- >> >> Ververica GmbH | Invalidenstrasse 115, 10115 Berlin, Germany >> >> -- >> Ververica GmbH >> Registered at Amtsgericht Charlottenburg: HRB 158244 B >> Managing Directors: Timothy Alexander Steinert, Yip Park Tung Jason, Ji >> (Toni) Cheng >> >
