This is an automated email from the ASF dual-hosted git repository.
guoweijie pushed a change to branch test-doc
in repository https://gitbox.apache.org/repos/asf/flink.git
discard d00239dcb29 upload file
discard b4bc1e8b10b change branch
discard bb427888e8f new sh
discard dfa70fccc1d fixup! fixup! only trigger on 1.20 for testing
discard c457a5690da fixup! only trigger on 1.20 for testing
discard d44a7cfba90 only trigger on 1.20 for testing
discard 96db3c51567 fixup! try to downgrade maven-javadoc-plugin to `2.10.4`
discard e08af201a22 try to downgrade maven-javadoc-plugin to `2.10.4`
add 6719efc6b12 [FLINK-35832][Table SQL / Planner] Fix IFNULL function
returns incorrect result
add 55db68c5c8f [FLINK-35860][test] Fix S5CmdOnMinioITCase failed due to
IllegalAccessError in JDK17/21
add 9aab300c9f2 [FLINK-34543][docs] Add document of full partition
processing on non-keyed datastream
add caf9b23b320 [hotfix][runtime] Remove unnecessary throws clause
add 203acadb44d [FLINK-31261][runtime] Make AdaptiveScheduler aware of
local state size
add 999b7a2f2e3 fixup: aggregate keyGroupSize in subtask (not across
subtasks)
add bcacea9ca37 [FLINK-34657] extract lineage info for stream API (#25056)
add af7d2b3ab0e [FLINK-35872][table] Fix the incorrect partition
generation for materialized table period refresh in Full Mode
add 95c617249c7 [FLINK-35835][test] Make file-merging test tolerate the
scenario that source does not produce any record (#25116)
add b07b0b4d994 [FLINK-35858][Runtime/State] Add namespace in internal
async states
add 055e11e6b46 [FLINK-35858][Runtime/State] Create state with namespaces
add d4294c59e6f [FLINK-35858][State/ForSt] Support state namespace
add b1d78ed749b [hotfix][runtime] Migrate the Time to Duration for
DefaultScheduler in the minimum impact range
add ea752ff1129 [FLINK-33874][runtime] Support resource request wait
mechanism at DefaultDeclarativeSlotPool side for Default Scheduler
add 83f52945d29 [Hotfix][runtime] Add '@Internal' annotation for
TaskManagerLoadBalanceMode#loadFromConfiguration
add ba3f87ef683 [Hotfix][runtime] Enrich the toString method of
SlotSharingGroup class
add 76049d09e40 [FLINK-33386][runtime] Support tasks balancing at slot
level for Default Scheduler
add 82b628d4730 [hotfix][scheduler] Migrate the Time to Duration for
SlotPool in the minimum scope
add c7a50d05186 [FLINK-35678][doc] Update compatibility matrix for 1.20
release
add 11b1fdfc7cf [FLINK-34446][table] Port parser's fix of cross join with
lateral from Calcite (#24317)
new 1ef699475c1 try to downgrade maven-javadoc-plugin to `2.10.4`
new 9d18b5d5e7a fixup! try to downgrade maven-javadoc-plugin to `2.10.4`
new f42fbe51b58 only trigger on 1.20 for testing
new d54a9df5c96 fixup! only trigger on 1.20 for testing
new 87b5e18516f fixup! fixup! only trigger on 1.20 for testing
new 3a3eaa2460d new sh
new b36b5320d9f change branch
new 462110523a3 upload file
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (d00239dcb29)
\
N -- N -- N refs/heads/test-doc (462110523a3)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 8 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../datastream/operators/full_window_partition.md | 104 ++++++
.../docs/dev/datastream/operators/overview.md | 26 ++
docs/content.zh/docs/ops/upgrading.md | 22 +-
.../datastream/operators/full_window_partition.md | 104 ++++++
.../docs/dev/datastream/operators/overview.md | 28 ++
docs/content/docs/ops/upgrading.md | 22 +-
.../generated/expert_scheduling_section.html | 6 +
.../generated/job_manager_configuration.html | 6 +
.../flink/configuration/JobManagerOptions.java | 7 +
.../flink/configuration/TaskManagerOptions.java | 2 +
.../flink/fs/s3/common/S5CmdOnMinioITCase.java | 3 +-
.../asyncprocessing/AsyncExecutionController.java | 8 +
.../runtime/asyncprocessing/RecordContext.java | 18 +
.../asyncprocessing/StateRequestHandler.java | 8 +
.../checkpoint/CompletedCheckpointStore.java | 4 +-
...ctivatedCheckpointCompletedCheckpointStore.java | 2 +-
.../jobmanager/scheduler/SlotSharingGroup.java | 2 +-
.../DefaultSlotPoolServiceSchedulerFactory.java | 30 +-
.../apache/flink/runtime/jobmaster/JobMaster.java | 5 +-
.../jobmaster/SlotPoolServiceSchedulerFactory.java | 7 +-
.../slotpool/AbstractSlotPoolServiceFactory.java | 19 +-
.../slotpool/BlocklistDeclarativeSlotPool.java | 18 +-
.../BlocklistDeclarativeSlotPoolFactory.java | 13 +-
.../slotpool/DeclarativeSlotPoolBridge.java | 54 +--
.../DeclarativeSlotPoolBridgeServiceFactory.java | 21 +-
.../slotpool/DeclarativeSlotPoolFactory.java | 9 +-
.../slotpool/DeclarativeSlotPoolService.java | 32 +-
.../DeclarativeSlotPoolServiceFactory.java | 28 +-
.../slotpool/DefaultDeclarativeSlotPool.java | 63 +++-
.../DefaultDeclarativeSlotPoolFactory.java | 15 +-
.../flink/runtime/jobmaster/slotpool/SlotPool.java | 15 +-
.../jobmaster/slotpool/SlotPoolService.java | 6 +-
.../jobmaster/slotpool/SlotPoolServiceFactory.java | 5 +-
.../runtime/resourcemanager/ResourceManager.java | 2 +-
.../resourcemanager/ResourceManagerGateway.java | 2 +-
.../scheduler/AbstractSlotSharingStrategy.java | 113 ++++++
.../scheduler/ExecutionSlotSharingGroup.java | 22 +-
.../LocalInputPreferredSlotSharingStrategy.java | 90 +----
.../TaskBalancedPreferredSlotSharingStrategy.java | 310 ++++++++++++++++
.../allocator/JobAllocationsInformation.java | 19 +-
.../allocator/StateLocalitySlotAssigner.java | 21 +-
.../adaptive/allocator/StateSizeEstimates.java | 133 +++++++
.../runtime/state/AsyncKeyedStateBackend.java | 11 +-
.../runtime/state/v2/DefaultKeyedStateStoreV2.java | 16 +-
.../runtime/state/v2/InternalAggregatingState.java | 2 +-
.../flink/runtime/state/v2/InternalKeyedState.java | 7 +-
.../flink/runtime/state/v2/InternalListState.java | 3 +-
.../flink/runtime/state/v2/InternalMapState.java | 2 +-
.../v2/InternalPartitionedState.java} | 21 +-
.../runtime/state/v2/InternalReducingState.java | 2 +-
.../flink/runtime/state/v2/InternalValueState.java | 3 +-
.../AsyncExecutionControllerTest.java | 133 ++++++-
.../CheckpointCoordinatorFailureTest.java | 7 +-
.../executiongraph/ExecutionGraphRestartTest.java | 2 +-
.../flink/runtime/jobmaster/JobMasterTest.java | 11 +-
.../AbstractDeclarativeSlotPoolBridgeTest.java | 107 ++++++
.../slotpool/BlocklistDeclarativeSlotPoolTest.java | 57 ++-
.../slotpool/DeclarativeSlotPoolBridgeBuilder.java | 55 ++-
...tiveSlotPoolBridgePreferredAllocationsTest.java | 20 +-
...arativeSlotPoolBridgeRequestCompletionTest.java | 9 +-
...ativeSlotPoolBridgeResourceDeclarationTest.java | 52 +--
.../slotpool/DeclarativeSlotPoolBridgeTest.java | 101 ++---
.../slotpool/DeclarativeSlotPoolServiceTest.java | 15 +-
.../DefaultDeclarativeSlotPoolBuilder.java | 30 +-
.../slotpool/DefaultDeclarativeSlotPoolTest.java | 155 +++++---
.../DefaultDeclarativeSlotPoolTestBase.java | 45 +++
.../slotpool/PhysicalSlotProviderExtension.java | 5 +-
...erImplWithDefaultSlotSelectionStrategyTest.java | 4 +-
...lSlotProviderImplWithSpreadOutStrategyTest.java | 4 +-
.../slotpool/SlotPoolBatchSlotRequestTest.java | 10 +-
.../slotpool/SlotPoolInteractionsTest.java | 10 +-
.../runtime/jobmaster/slotpool/SlotPoolUtils.java | 4 +-
.../TestingDeclarativeSlotPoolFactory.java | 11 +-
.../jobmaster/slotpool/TestingSlotPoolService.java | 15 +-
.../slotpool/TestingSlotPoolServiceBuilder.java | 9 +-
.../resourcemanager/ResourceManagerTest.java | 4 +-
.../utils/TestingResourceManagerGateway.java | 2 +-
.../scheduler/AbstractSlotSharingStrategyTest.java | 140 +++++++
.../DefaultSchedulerBatchSchedulingTest.java | 5 +-
.../runtime/scheduler/DefaultSchedulerTest.java | 8 +-
...LocalInputPreferredSlotSharingStrategyTest.java | 260 ++++++-------
.../MergingSharedSlotProfileRetrieverTest.java | 7 +-
.../runtime/scheduler/SharedSlotTestingUtils.java | 3 +-
.../SlotSharingExecutionSlotAllocatorTest.java | 6 +-
...skBalancedPreferredSlotSharingStrategyTest.java | 178 +++++++++
.../adaptive/AdaptiveSchedulerBuilder.java | 13 +-
.../scheduler/adaptive/AdaptiveSchedulerTest.java | 14 +-
.../allocator/SlotSharingSlotAllocatorTest.java | 15 +-
.../allocator/StateLocalitySlotAssignerTest.java | 43 ++-
.../e2e/SchedulerEndToEndBenchmarkBase.java | 5 +-
.../flink/runtime/state/StateBackendTestUtils.java | 3 +-
.../state/v2/InternalAggregatingStateTest.java | 2 +-
.../state/v2/InternalKeyedStateTestBase.java | 5 +-
.../runtime/state/v2/InternalListStateTest.java | 3 +-
.../runtime/state/v2/InternalMapStateTest.java | 2 +-
.../state/v2/InternalReducingStateTest.java | 2 +-
.../runtime/state/v2/InternalValueStateTest.java | 3 +-
.../org/apache/flink/state/forst/ContextKey.java | 11 +-
.../flink/state/forst/ForStDBGetRequest.java | 13 +-
.../flink/state/forst/ForStDBPutRequest.java | 17 +-
.../state/forst/ForStGeneralMultiGetOperation.java | 6 +-
.../apache/flink/state/forst/ForStInnerTable.java | 8 +-
.../flink/state/forst/ForStKeyedStateBackend.java | 4 +-
.../flink/state/forst/ForStStateExecutor.java | 4 +-
.../state/forst/ForStStateRequestClassifier.java | 20 +-
.../apache/flink/state/forst/ForStValueState.java | 24 +-
.../state/forst/ForStWriteBatchOperation.java | 10 +-
.../state/forst/ForStDBOperationTestBase.java | 14 +-
.../forst/ForStGeneralMultiGetOperationTest.java | 13 +-
.../flink/state/forst/ForStStateExecutorTest.java | 20 +-
.../state/forst/ForStWriteBatchOperationTest.java | 17 +-
.../streaming/api/datastream/DataStreamSink.java | 12 +-
.../api/lineage/DefaultLineageVertex.java | 31 +-
.../api/lineage/DefaultSourceLineageVertex.java | 40 +-
.../api/operators/StreamOperatorStateHandler.java | 16 +
.../LegacySourceTransformation.java | 10 +
.../api/transformations/SourceTransformation.java | 9 +
.../AbstractAsyncStateStreamOperator.java | 9 +
.../AbstractAsyncStateStreamOperatorV2.java | 9 +
.../api/lineage/LineageGraphUtilsTest.java | 188 ++++++++++
.../api/operators/StreamingRuntimeContextTest.java | 6 +-
.../MaterializedTableManager.java | 14 +-
.../service/MaterializedTableStatementITCase.java | 11 +-
.../MaterializedTableManagerTest.java | 405 ++++++++++++++++++---
.../src/main/codegen/templates/Parser.jj | 39 +-
.../main/java/org/apache/calcite/sql/SqlJoin.java | 289 +++++++++++++++
.../flink/sql/parser/FlinkSqlParserImplTest.java | 66 ++++
.../inference/strategies/IfNullTypeStrategy.java | 18 +-
.../apache/flink/table/utils/DateTimeUtils.java | 15 +-
.../planner/functions/MiscFunctionsITCase.java | 12 +-
.../planner/expressions/ScalarFunctionsTest.scala | 16 +-
.../planner/runtime/batch/sql/CalcITCase.scala | 6 +
.../planner/runtime/stream/sql/CalcITCase.scala | 14 +-
.../runtime/stream/sql/CorrelateITCase.scala | 19 +
.../SnapshotFileMergingCompatibilityITCase.java | 77 ++--
.../execution/JobStatusChangedListenerITCase.java | 68 +++-
136 files changed, 3741 insertions(+), 924 deletions(-)
create mode 100644
docs/content.zh/docs/dev/datastream/operators/full_window_partition.md
create mode 100644
docs/content/docs/dev/datastream/operators/full_window_partition.md
create mode 100644
flink-runtime/src/main/java/org/apache/flink/runtime/scheduler/AbstractSlotSharingStrategy.java
create mode 100644
flink-runtime/src/main/java/org/apache/flink/runtime/scheduler/TaskBalancedPreferredSlotSharingStrategy.java
create mode 100644
flink-runtime/src/main/java/org/apache/flink/runtime/scheduler/adaptive/allocator/StateSizeEstimates.java
copy
flink-runtime/src/main/java/org/apache/flink/runtime/{jobmaster/slotpool/SlotPoolServiceFactory.java
=> state/v2/InternalPartitionedState.java} (63%)
create mode 100644
flink-runtime/src/test/java/org/apache/flink/runtime/jobmaster/slotpool/AbstractDeclarativeSlotPoolBridgeTest.java
create mode 100644
flink-runtime/src/test/java/org/apache/flink/runtime/jobmaster/slotpool/DefaultDeclarativeSlotPoolTestBase.java
create mode 100644
flink-runtime/src/test/java/org/apache/flink/runtime/scheduler/AbstractSlotSharingStrategyTest.java
create mode 100644
flink-runtime/src/test/java/org/apache/flink/runtime/scheduler/TaskBalancedPreferredSlotSharingStrategyTest.java
copy
flink-runtime/src/test/java/org/apache/flink/runtime/scheduler/SharedSlotTestingUtils.java
=>
flink-streaming-java/src/main/java/org/apache/flink/streaming/api/lineage/DefaultLineageVertex.java
(56%)
copy
flink-table/flink-table-common/src/main/java/org/apache/flink/table/types/inference/strategies/IfNullTypeStrategy.java
=>
flink-streaming-java/src/main/java/org/apache/flink/streaming/api/lineage/DefaultSourceLineageVertex.java
(52%)
create mode 100644
flink-streaming-java/src/test/java/org/apache/flink/streaming/api/lineage/LineageGraphUtilsTest.java
create mode 100644
flink-table/flink-sql-parser/src/main/java/org/apache/calcite/sql/SqlJoin.java
