This is an automated email from the ASF dual-hosted git repository.
1996fanrui pushed a change to branch release-2.2
in repository https://gitbox.apache.org/repos/asf/flink.git
from e497f5d6d95 [hotfix][ci] Use more threads for download during ci, also
download dep POMs in parallel
new 1b31a5acc3b [FLINK-33123][runtime] Fix the wrong dynamic replacement
of partitioner from FORWARD to REBALANCE for autoscaler and adaptive scheduler
new e0d4365b263 [FLINK-39912][runtime] Change the annotation from
'RepeatTest' to 'Test' in ForwardEdgesAdapterTest to reduce the time cost
(#28393)
new a3bc8b387b0 [FLINK-40904][runtime] Pass consumer parallelism to tasks
via ResultPartitionDeploymentDescriptor
new 327e584b705 [FLINK-40904][runtime] Detect FORWARD parallelism mismatch
with the actual consumer parallelism
new c3e2c07e8bd [FLINK-40780][runtime] Make FORWARD-to-REBALANCE downgrade
on parallelism mismatch configurable
new f292243a52f [FLINK-40780][tests] Add ITCases for forward edge
parallelism mismatch modes
The 6 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../generated/pipeline_configuration.html | 6 +
.../flink/configuration/PipelineOptions.java | 62 +++++
.../state/api/runtime/SavepointEnvironment.java | 5 +
.../ResultPartitionDeploymentDescriptor.java | 30 ++-
.../flink/runtime/execution/Environment.java | 8 +
.../flink/runtime/executiongraph/Execution.java | 5 +-
.../runtime/jobgraph/IntermediateDataSet.java | 6 +
.../org/apache/flink/runtime/jobgraph/JobEdge.java | 18 +-
.../scheduler/adaptive/AdaptiveScheduler.java | 6 +-
.../scheduler/adaptive/ForwardEdgesAdapter.java | 75 ++++++
.../runtime/taskmanager/RuntimeEnvironment.java | 10 +
.../org/apache/flink/runtime/taskmanager/Task.java | 8 +
.../flink/streaming/runtime/tasks/StreamTask.java | 68 ++++-
.../ResultPartitionDeploymentDescriptorTest.java | 8 +-
.../runtime/deployment/ShuffleDescriptorTest.java | 3 +-
.../partition/AbstractPartitionTrackerTest.java | 1 +
.../io/network/partition/PartitionTestUtils.java | 3 +-
.../partition/ResultPartitionFactoryTest.java | 1 +
.../operators/testutils/DummyEnvironment.java | 5 +
.../operators/testutils/MockEnvironment.java | 6 +
.../adaptive/ForwardEdgesAdapterTest.java | 160 ++++++++++++
.../runtime/shuffle/NettyShuffleUtilsTest.java | 3 +-
.../taskexecutor/TaskExecutorSubmissionTest.java | 5 +-
.../apache/flink/runtime/taskmanager/TaskTest.java | 3 +-
.../runtime/tasks/StreamMockEnvironment.java | 27 +-
.../streaming/runtime/tasks/StreamTaskITCase.java | 1 +
.../streaming/runtime/tasks/StreamTaskTest.java | 92 ++++++-
.../ForwardEdgeParallelismMismatchITCaseBase.java | 279 +++++++++++++++++++++
...wardEdgeParallelismMismatchOverridesITCase.java | 83 ++++++
...rdEdgeParallelismMismatchRestRescaleITCase.java | 187 ++++++++++++++
30 files changed, 1150 insertions(+), 24 deletions(-)
create mode 100644
flink-runtime/src/main/java/org/apache/flink/runtime/scheduler/adaptive/ForwardEdgesAdapter.java
create mode 100644
flink-runtime/src/test/java/org/apache/flink/runtime/scheduler/adaptive/ForwardEdgesAdapterTest.java
create mode 100644
flink-tests/src/test/java/org/apache/flink/test/scheduling/ForwardEdgeParallelismMismatchITCaseBase.java
create mode 100644
flink-tests/src/test/java/org/apache/flink/test/scheduling/ForwardEdgeParallelismMismatchOverridesITCase.java
create mode 100644
flink-tests/src/test/java/org/apache/flink/test/scheduling/ForwardEdgeParallelismMismatchRestRescaleITCase.java
