This is an automated email from the ASF dual-hosted git repository.
1996fanrui pushed a change to branch release-1.20
in repository https://gitbox.apache.org/repos/asf/flink.git
from 33b4010725f [hotfix][ci] Use `includeOnlyProperties` only for JGit
new 3f1abf2fff4 [FLINK-33123][runtime] Fix the wrong dynamic replacement
of partitioner from FORWARD to REBALANCE for autoscaler and adaptive scheduler
new 621d68cd781 [FLINK-39912][runtime] Change the annotation from
'RepeatTest' to 'Test' in ForwardEdgesAdapterTest to reduce the time cost
(#28393)
new 6dedeca4010 [FLINK-40904][runtime] Pass consumer parallelism to tasks
via ResultPartitionDeploymentDescriptor
new 5e280bca97d [FLINK-40904][runtime] Detect FORWARD parallelism mismatch
with the actual consumer parallelism
new d302956a97a [FLINK-40780][runtime] Make FORWARD-to-REBALANCE downgrade
on parallelism mismatch configurable
new 1dce10347e9 [FLINK-40780][tests] Add ITCases for forward edge
parallelism mismatch modes
The 6 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../generated/pipeline_configuration.html | 6 +
.../flink/configuration/PipelineOptions.java | 62 +++++
.../state/api/runtime/SavepointEnvironment.java | 5 +
.../ResultPartitionDeploymentDescriptor.java | 30 ++-
.../flink/runtime/execution/Environment.java | 8 +
.../flink/runtime/executiongraph/Execution.java | 5 +-
.../runtime/jobgraph/IntermediateDataSet.java | 4 +
.../org/apache/flink/runtime/jobgraph/JobEdge.java | 16 +-
.../scheduler/adaptive/AdaptiveScheduler.java | 5 +-
.../scheduler/adaptive/ForwardEdgesAdapter.java | 71 ++++++
.../runtime/taskmanager/RuntimeEnvironment.java | 10 +
.../org/apache/flink/runtime/taskmanager/Task.java | 8 +
.../ResultPartitionDeploymentDescriptorTest.java | 8 +-
.../runtime/deployment/ShuffleDescriptorTest.java | 3 +-
.../partition/AbstractPartitionTrackerTest.java | 1 +
.../io/network/partition/PartitionTestUtils.java | 3 +-
.../partition/ResultPartitionFactoryTest.java | 1 +
.../operators/testutils/DummyEnvironment.java | 5 +
.../operators/testutils/MockEnvironment.java | 6 +
.../adaptive/ForwardEdgesAdapterTest.java | 151 +++++++++++
.../runtime/shuffle/NettyShuffleUtilsTest.java | 3 +-
.../taskexecutor/TaskExecutorSubmissionTest.java | 5 +-
.../apache/flink/runtime/taskmanager/TaskTest.java | 3 +-
.../flink/streaming/runtime/tasks/StreamTask.java | 68 ++++-
.../runtime/tasks/StreamMockEnvironment.java | 27 +-
.../streaming/runtime/tasks/StreamTaskITCase.java | 1 +
.../tasks/StreamTaskMailboxTestHarnessBuilder.java | 7 +
.../streaming/runtime/tasks/StreamTaskTest.java | 92 ++++++-
.../ForwardEdgeParallelismMismatchITCaseBase.java | 275 +++++++++++++++++++++
...wardEdgeParallelismMismatchOverridesITCase.java | 83 +++++++
...rdEdgeParallelismMismatchRestRescaleITCase.java | 187 ++++++++++++++
31 files changed, 1136 insertions(+), 23 deletions(-)
create mode 100644
flink-runtime/src/main/java/org/apache/flink/runtime/scheduler/adaptive/ForwardEdgesAdapter.java
create mode 100644
flink-runtime/src/test/java/org/apache/flink/runtime/scheduler/adaptive/ForwardEdgesAdapterTest.java
create mode 100644
flink-tests/src/test/java/org/apache/flink/test/scheduling/ForwardEdgeParallelismMismatchITCaseBase.java
create mode 100644
flink-tests/src/test/java/org/apache/flink/test/scheduling/ForwardEdgeParallelismMismatchOverridesITCase.java
create mode 100644
flink-tests/src/test/java/org/apache/flink/test/scheduling/ForwardEdgeParallelismMismatchRestRescaleITCase.java
