[
https://issues.apache.org/jira/browse/FLINK-38972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18065588#comment-18065588
]
Rui Fan commented on FLINK-38972:
---------------------------------
I ran the job in IDEA directly, it consumes job from DataGeneratorSource, then
rebalance shuffle, simple mapper and DiscardingSink.
{code:java}
public static void main(String[] args) throws Exception {
Configuration conf = new Configuration();
conf.set(RestOptions.PORT, 12345);
conf.setString("execution.checkpointing.unaligned.enabled", "true");
conf.setString("rest.flamegraph.enabled", "true");
conf.setString("taskmanager.numberOfTaskSlots", "100");
conf.setString("execution.checkpointing.interval", "10s");
conf.setString("execution.checkpointing.min-pause", "8s");
conf.setString("jobmanager.scheduler", "adaptive");
conf.setString("jobmanager.execution.dynamic-configuration.white-list",
"*");
conf.setString("state.checkpoints.dir", "file:///tmp/flinkjob");
conf.set(WebOptions.CHECKPOINTS_HISTORY_SIZE, 100);
StreamExecutionEnvironment env =
StreamExecutionEnvironment.createLocalEnvironmentWithWebUI(conf);
env.setParallelism(5); DataGeneratorSource<Long> generatorSource =
new DataGeneratorSource<>(
value -> value,
Long.MAX_VALUE,
RateLimiterStrategy.perSecond(1000),
Types.LONG); env.fromSource(generatorSource,
WatermarkStrategy.noWatermarks(), "Data Generator")
.rebalance()
.map(
value -> {
Thread.sleep(20);
return value;
})
.sinkTo(new DiscardingSink<>())
.name("MySink"); env.execute();
}{code}
> FLIP-560: Application Capability Enhancement
> --------------------------------------------
>
> Key: FLINK-38972
> URL: https://issues.apache.org/jira/browse/FLINK-38972
> Project: Flink
> Issue Type: Improvement
> Reporter: Yi Zhang
> Assignee: Yi Zhang
> Priority: Major
> Fix For: 2.3.0
>
> Attachments: flink-overview-page.png, running_jobs page.png
>
>
> This is the umbrella ticket for
> [FLIP-560|https://cwiki.apache.org/confluence/display/FLINK/FLIP-560%3A+Application+Capability+Enhancement]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
