This is an automated email from the ASF dual-hosted git repository. azagrebin pushed a change to branch flip116 in repository https://gitbox.apache.org/repos/asf/flink.git.
discard 6284621 change type to cron discard 6fe137c [FLINK-16746] Add default 'jobmanager.memory.process.size: 1472m' to flink-conf.yaml discard f7000fe fixup! [FLINK-16745][yarn] Start Yarn JM with FLIP-116 JVM memory args discard 31d2d58 [FLINK-16745][coordination] Remove unused container cutoff discard aa9e045 [FLINK-16745][k8s] Start Kubernetes JM with FLIP-116 JVM memory args discard 42e913a [FLINK-16745][yarn] Start Yarn JM with FLIP-116 JVM memory args discard b29a14d [FLINK-16745][clients] Parse JobManagerProcessSpec from Configuration into ClusterSpecification discard c862573 [FLINK-16472][dist] Remove unused memory configuration logics from config.sh. discard 20d29dc [FLINK-16742][dist] Extend and use BashJavaUtils for JM memory configuration in start-up scripts. discard 442a533 [FLINK-16742][runtime] Ignore unknown command line options for BashJavaUtils. discard e624042 [FLINK-16742][dist] config.sh does not assume BashJavaUtils always return two lines of results. discard d22f6d8 [hotfix][runtime] Code clean-ups in BashJavaUtils and its test cases. add 48bf9fb [FLINK-17093][python][table-planner][table-planner-blink] Fix Python UDF to make it work with inputs from composite field (#11717) add 893ae56 [FLINK-16222][metrics][docs] Document plugins support add 5d21fbe [hotfix][rocksdb] Fix exception message add 0a4870d [FLINK-16576][state backends] Fix the problem of wrong mapping between stateId and metaInfo in HeapRestoreOperation add 792dbf0 [FLINK-16576][state backends] Do not distribute KeyGroupsStateHandle which contains empty KeyGroupRange add dcdbc79 [FLINK-16887][table-planner-blink] Refactor retraction rules to support inferring ChangelogMode add 297f0a2 [FLINK-16822][sql-client] `table.xx` property set from CLI should also be set into TableEnvironment's TableConfig add 5f14987 [FLINK-15827][runtime][coordination] Deprecate unused taskmanager.registration.* options add 96d4dfe [FLINK-17064][table-planner] Improve literals conversion in ExpressionConverter add b3292cb [hotfix] Use UTC when converting to/from SqlTimestamp and TimestampString add 6acd646 [FLINK-17084][table] Implement input type inference and output type strategy for ARRAY/ROW/MAP built-in functions (#11701) add 3bfeea1 [FLINK-16813][jdbc] JDBCInputFormat doesn't correctly map Short add aa9bcc1 [FLINK-16820][jdbc] support reading timestamp, data, and time in JDBCTableSource add 978d7e9 [FLINK-16815][jdbc] add e2e tests for reading primitive data types from postgres with JDBCTableSource and PostgresCatalog add 59a71b0 [FLINK-16486][python][docs] Add documentation for vectorized Python UDF (#11724) add 135d2e2c [FLINK-16598][k8s] Respect the rest port exposed by Service in Fabric8FlinkKubeClient#getRestEndpoint add 177976b [FLINK-16983][python] Support RowType in vectorized Python UDF (#11656) add 4563176 [FLINK-17152][table] Fix FunctionDefinitionUtil generate wrong resultType and acc type for AggregateFunctionDefinition add a49f75d [FLINK-15486][tests] Remove timeout of LocalInputChannelTest#testConcurrentConsumeMultiplePartitions to avoid potential timeout problem on slow machine add 56d7f53 [FLINK-16750][e2e] Always copy and show the logs when yarn e2e tests failed add ef9bf36 [hotfix][sql] CliTablaeuResultViewTest runnable on Windows add b3b4ac5 [hotfix][sql] Add name for exector add 546afbe [FLINK-17082][sql] Remove mocking in SQL client add b482695 [FLINK-17131][build] Downgrade javadoc-plugin add ee9ea10 [FLINK-16346][tests] Use fixed JobIDs add c96cd9c [FLINK-16968][stats][metrics] Add StatsDReporterFactory add 72f9f20 [hotfix][doc] Fix typo of TaskManagerSlot#jobId javadoc add 1a5b35b [FLINK-17118][python] Add Cython support for primitive data types (#11718) add f4a062a [hotfix][javadocs] Fix typo add 577abe7 [FLINK-15790][k8s] Make some interfaces in FlinkKubeClient asynchronous which potentially blocks the execution of RpcEndpoint's main thread add 2669f5b [FLINK-17172][tests] Enable DEBUG level logging in Jepsen tests add 5eaf2b5 [FLINK-17119][python] Add Cython support for composite types (#11767) add c1bc0d4 [FLINK-17128][table] Add isBounded to TableSinkFactory#Context add b21ef4b [hotfix][runtime] Remove declaring of ResourceManagerException from ResourceActions#allocateResource. add 9479338 [hotfix][runtime] Code clean-ups in ActiveResourceManagerFactory. add 7286c5c [FLINK-16437][runtime] Introduce WorkerResourceSpec for describing resource specification of a requested worker between ResourceManager and SlotManager. add 5b735c0 [FLINK-16437][runtime] Pass SlotManagerConfiguration into SlotManagerImpl. add 7089bd6 [FLINK-16437][runtime] Create SlotManagerImpl with default WorkerResourceSpec. add 92b30ed [FLINK-16437][runtime] Create SlotManagerImpl with default numSlotsPerWorker. add 9c5a1d1 [FLINK-16437][runtime] Compute pending slot profiles inside SlotManager when allocating resource. add 8f43063 [FLINK-16437][runtime] ResourceManager retrieve a collection of pending workers from SlotManager, instead of number of pending slots. add d981c94 [FLINK-16437][runtime] Remove numSlotsPerTaskManager from ActiveResourceManager and ContaineredTaskManagerParameters. add 6b99a57 [FLINK-16437][runtime] SlotManager allocate resource from ResourceManager with WorkerRequest instead of ResourceProfile. add 3fa10a1 [hotfix] Fix PerJobMiniClusterFactory does not properly calculate numSlotsPerTaskManager. add 3f6080f [FLINK-16581][table-planner-blink] Support state ttl for Mini-Batch deduplication using StateTtlConfig add c201e1d Revert "[FLINK-17119][python] Add Cython support for composite types (#11767)" add e1ac6c9 [FLINK-17132][metrics] Bump Prometheus to 0.8.1 add 9bed566 [hotfix][task] Avoid unnecessary actionExecutor for notifyCheckpointComplete. add 7327ffd [hotfix][network] Remove unused InterruptedExceptions. add c172e7a [hotfix][network] Move uncritical code out of lock in RemoteInputChannel#onBuffer. add 4319b01 [hotfix][task] Rename CheckpointedInputGate#cleanup to close and implement Closeable. add 9649d38 [hotfix][task] Narrowing checkpointing related exceptions to IOException. add ef6e2c4 [hotfix][task] Generalizing MailboxExecutor#execute to ThrowingRunnable. add b63797c [FLINK-16587][checkpointing] Make ChannelStateWriterImpl#getWriteResult idempotent. add b9b761d [FLINK-16587][coordinator] Ensuring channel deployment descriptors are lists. add 1007232 [FLINK-16587][checkpointing] Introducing IndexedInputGate for abstracting single channel InputGates with a specific index. add bde57b2 [FLINK-16587][checkpointing] Switch to positional input channel and subpartitions. add aed6c1a [FLINK-16587][checkpointing] Adding unaligned checkpoint config flag. add dbdaa51 [FLINK-16587][checkpointing] Introduce BufferReceivedListener for notifying of received buffers and barriers from network channel. add 4538321 [FLINK-16587][checkpointing] Implement CheckpointBarrierUnaligner to trigger checkpoint when receiving the first barrier. add 825cb25 [FLINK-16587][task] Moving event creation from OperatorChain to SubtaskCheckpointCoordinatorImpl. add 9b0477f [FLINK-16587][checkpointing] Implement checkpoint barrier overtake in output partitions. add d041efe [FLINK-16587][checkpointing] Provide the method for getting unconsumed buffer from RecordDeserializer. add f661d18 [FLINK-16587][checkpointing] Provide the method of getting in-flight buffers from input gate. add 5cebfb7 [FLINK-16587][checkpointing] Spill the in-flight input and output buffers during checkpointing. add 77dce77 [FLINK-16587][checkpointing] Fix abortion of ChannelStateWriter and add test/IT cases for unaligned checkpoint. add 5fce7df [hotfix] Fix the code style in BashJavaUtilsITCase add 295449f [FLINK-16874] Respect the dynamic options when calculating memory options in taskmanager.sh add fd6174c [hotfix][runtime] Code clean-ups in BashJavaUtils and its test cases. add d2e199d [FLINK-16742][dist] config.sh does not assume BashJavaUtils always return two lines of results. add b73c996 [FLINK-16742][runtime] Ignore unknown command line options for BashJavaUtils. add 340fde2 [FLINK-16742][dist] Extend and use BashJavaUtils for JM memory configuration in start-up scripts. add 11775b3 [FLINK-16472][dist] Remove unused memory configuration logics from config.sh. add 1504abb [FLINK-16742][runtime] Refactor BashJavaUtils, move to separated package and extract configuration loading logics. add 7d31edc [FLINK-16745][clients] Parse JobManagerProcessSpec from Configuration into ClusterSpecification add 0c84a68 [FLINK-16745][yarn] Start Yarn JM with FLIP-116 JVM memory args add 8adb309 [FLINK-16745][k8s] Start Kubernetes JM with FLIP-116 JVM memory args add cf91b68 [FLINK-16745][coordination] Remove unused container cutoff add e3fdf98 [hotfix] Remove 'TaskManager' from MemoryBackwardsCompatibilityUtils#getLegacyTaskManagerHeapMemoryIfExplicitlyConfigured add 9e0a523 [FLINK-16746] Add default 'jobmanager.memory.process.size: 1472m' to flink-conf.yaml add 74f7619 [FLINK-16746][conf] Deprecate jobmanager.heap.size new e299488 change type to cron This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (6284621) \ N -- N -- N refs/heads/flip116 (e299488) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .gitignore | 2 + .../generated/all_jobmanager_section.html | 6 - .../generated/all_taskmanager_section.html | 18 - .../_includes/generated/common_memory_section.html | 48 ++ .../execution_checkpointing_configuration.html | 6 + .../generated/job_manager_configuration.html | 46 +- .../generated/task_manager_configuration.html | 18 - docs/dev/table/python/index.md | 1 + docs/dev/table/python/index.zh.md | 1 + docs/dev/table/python/vectorized_python_udfs.md | 65 +++ docs/dev/table/python/vectorized_python_udfs.zh.md | 65 +++ docs/monitoring/metrics.md | 14 +- docs/monitoring/metrics.zh.md | 14 +- docs/ops/config.md | 6 +- docs/ops/config.zh.md | 6 +- docs/ops/deployment/cluster_setup.md | 4 +- docs/ops/deployment/cluster_setup.zh.md | 4 +- docs/ops/deployment/kubernetes.md | 2 +- docs/ops/deployment/kubernetes.zh.md | 2 +- docs/ops/deployment/mesos.md | 4 +- docs/ops/deployment/mesos.zh.md | 4 +- docs/ops/memory/mem_migration.zh.md | 1 - .../AbstractContainerizedClusterClientFactory.java | 9 +- .../client/deployment/ClusterSpecification.java | 46 +- .../client/program/PerJobMiniClusterFactory.java | 7 +- .../connectors/hive/HiveTableFactoryTest.java | 10 +- .../flink/api/java/io/jdbc/JdbcTypeUtil.java | 18 +- .../api/java/io/jdbc/dialect/JDBCDialects.java | 1 - .../row/converter/AbstractJDBCRowConverter.java | 23 +- .../source/row/converter/JDBCRowConverter.java | 9 + .../io/jdbc/catalog/PostgresCatalogITCase.java | 10 + .../java/io/jdbc/catalog/PostgresCatalogTest.java | 17 +- .../io/jdbc/catalog/PostgresCatalogTestBase.java | 86 ++- .../apache/flink/configuration/ClusterOptions.java | 3 + .../flink/configuration/ConfigConstants.java | 12 +- .../flink/configuration/JobManagerOptions.java | 16 +- .../flink/configuration/TaskManagerOptions.java | 12 +- .../main/java/org/apache/flink/util/MathUtils.java | 11 + flink-dist/pom.xml | 4 +- flink-dist/src/main/flink-bin/bin/config.sh | 7 +- flink-dist/src/main/flink-bin/bin/jobmanager.sh | 2 +- .../src/main/flink-bin/bin/standalone-job.sh | 2 +- flink-dist/src/main/flink-bin/bin/taskmanager.sh | 2 +- flink-dist/src/test/bin/runBashJavaUtilsCmd.sh | 5 +- .../org/apache/flink/dist/BashJavaUtilsITCase.java | 46 +- flink-end-to-end-tests/test-scripts/common.sh | 2 +- .../test-scripts/common_utils.sh | 2 + .../test-scripts/common_yarn_docker.sh | 3 + .../test-scripts/test_yarn_kerberos_docker.sh | 2 - flink-jepsen/src/jepsen/flink/db.clj | 4 +- .../kubernetes/KubernetesClusterDescriptor.java | 10 +- .../kubernetes/KubernetesResourceManager.java | 81 ++- .../flink/kubernetes/cli/KubernetesSessionCli.java | 2 +- .../KubernetesResourceManagerConfiguration.java | 33 +- .../KubernetesResourceManagerFactory.java | 17 +- .../KubernetesWorkerResourceSpecFactory.java | 46 ++ .../kubeclient/Fabric8FlinkKubeClient.java | 199 ++++--- .../kubernetes/kubeclient/FlinkKubeClient.java | 27 +- .../kubernetes/kubeclient/KubeClientFactory.java | 9 +- .../decorators/JavaCmdJobManagerDecorator.java | 3 +- .../parameters/KubernetesJobManagerParameters.java | 5 - .../flink/kubernetes/KubernetesClientTestBase.java | 130 +++++ .../KubernetesClusterDescriptorTest.java | 39 +- .../kubernetes/KubernetesResourceManagerTest.java | 99 +++- .../flink/kubernetes/KubernetesTestBase.java | 7 +- .../kubeclient/Fabric8FlinkKubeClientTest.java | 97 ++-- .../kubeclient/KubernetesJobManagerTestBase.java | 8 +- .../kubeclient/KubernetesTaskManagerTestBase.java | 3 +- .../decorators/JavaCmdJobManagerDecoratorTest.java | 4 +- .../KubernetesJobManagerParametersTest.java | 7 +- .../KubernetesTaskManagerParametersTest.java | 3 +- .../state/api/runtime/SavepointEnvironment.java | 6 +- .../clusterframework/MesosResourceManager.java | 27 +- .../MesosResourceManagerFactory.java | 3 +- .../MesosTaskManagerParameters.java | 7 +- .../MesosWorkerResourceSpecFactory.java | 45 ++ .../clusterframework/store/MesosWorkerStore.java | 40 +- .../org/apache/flink/mesos/util/MesosUtils.java | 3 +- .../clusterframework/MesosResourceManagerTest.java | 40 +- .../flink/metrics/statsd/StatsDReporter.java | 2 + .../metrics/statsd/StatsDReporterFactory.java | 25 +- ...he.flink.metrics.reporter.MetricReporterFactory | 16 + flink-python/MANIFEST.in | 2 + flink-python/pyflink/fn_execution/coder_impl.py | 2 +- flink-python/pyflink/fn_execution/coders.py | 6 +- .../pyflink/fn_execution/fast_coder_impl.pxd | 192 ++++++ .../pyflink/fn_execution/fast_coder_impl.pyx | 553 ++++++++++++++++++ .../{test_coders_common.py => test_coders.py} | 9 + .../pyflink/fn_execution/tests/test_fast_coders.py | 141 +++++ .../pyflink/table/tests/test_pandas_udf.py | 31 +- flink-python/pyflink/table/types.py | 10 +- flink-python/setup.py | 28 +- .../flink/table/runtime/arrow/ArrowUtils.java | 57 +- .../runtime/arrow/readers/RowFieldReader.java | 37 +- .../arrow/vectors/ArrowRowColumnVector.java | 57 ++ .../table/runtime/arrow/writers/RowRowWriter.java | 71 +++ .../table/runtime/arrow/writers/RowWriter.java | 72 +++ .../flink/table/runtime/arrow/ArrowUtilsTest.java | 16 + .../arrow/BaseRowArrowReaderWriterTest.java | 28 +- .../runtime/arrow/RowArrowReaderWriterTest.java | 19 +- flink-python/tox.ini | 8 +- .../checkpoint/StateAssignmentOperation.java | 29 +- .../channel/ChannelStateCheckpointWriter.java | 1 - .../checkpoint/channel/ChannelStateWriter.java | 9 +- .../checkpoint/channel/ChannelStateWriterImpl.java | 7 +- .../ContaineredTaskManagerParameters.java | 17 +- .../clusterframework/TaskExecutorProcessSpec.java | 6 +- .../clusterframework/TaskExecutorProcessUtils.java | 51 +- .../flink/runtime/concurrent/FutureUtils.java | 16 + .../flink/runtime/execution/Environment.java | 6 +- .../io/network/NettyShuffleEnvironment.java | 21 +- .../io/network/NetworkSequenceViewReader.java | 2 +- .../api/serialization/RecordDeserializer.java | 9 + ...SpillingAdaptiveSpanningRecordDeserializer.java | 57 ++ .../io/network/api/writer/RecordWriter.java | 6 +- .../network/api/writer/ResultPartitionWriter.java | 23 +- .../io/network/buffer/BufferReceivedListener.java | 47 ++ .../CreditBasedSequenceNumberingViewReader.java | 2 +- .../partition/BoundedBlockingSubpartition.java | 8 +- .../BoundedBlockingSubpartitionReader.java | 2 +- .../partition/BufferAvailabilityListener.java | 13 + .../network/partition/PipelinedSubpartition.java | 66 ++- .../partition/PipelinedSubpartitionView.java | 8 +- .../io/network/partition/ResultPartition.java | 14 +- .../io/network/partition/ResultSubpartition.java | 38 +- .../network/partition/ResultSubpartitionView.java | 2 +- .../network/partition/consumer/BufferOrEvent.java | 2 +- .../partition/consumer/IndexedInputGate.java | 17 +- .../network/partition/consumer/InputChannel.java | 45 +- .../io/network/partition/consumer/InputGate.java | 8 + .../partition/consumer/LocalInputChannel.java | 26 +- .../partition/consumer/RemoteInputChannel.java | 59 +- .../partition/consumer/SingleInputGate.java | 45 +- .../partition/consumer/SingleInputGateFactory.java | 2 +- .../network/partition/consumer/UnionInputGate.java | 82 +-- .../partition/consumer/UnknownInputChannel.java | 4 +- .../runtime/jobgraph/tasks/AbstractInvokable.java | 20 +- .../apache/flink/runtime/operators/BatchTask.java | 6 +- .../resourcemanager/ActiveResourceManager.java | 10 - .../ActiveResourceManagerFactory.java | 2 +- .../ArbitraryWorkerResourceSpecFactory.java | 28 +- .../runtime/resourcemanager/ResourceManager.java | 21 +- .../ResourceManagerRuntimeServices.java | 22 +- ...esourceManagerRuntimeServicesConfiguration.java | 8 +- .../resourcemanager/StandaloneResourceManager.java | 7 +- .../StandaloneResourceManagerFactory.java | 3 +- .../resourcemanager/WorkerResourceSpec.java | 166 ++++++ .../resourcemanager/WorkerResourceSpecFactory.java | 40 ++ .../slotmanager/ResourceActions.java | 14 +- .../resourcemanager/slotmanager/SlotManager.java | 14 +- .../slotmanager/SlotManagerConfiguration.java | 39 +- .../slotmanager/SlotManagerImpl.java | 81 ++- .../slotmanager/TaskManagerSlot.java | 2 +- .../flink/runtime/shuffle/ShuffleEnvironment.java | 7 +- .../runtime/shuffle/ShuffleServiceFactory.java | 4 +- .../flink/runtime/state/KeyGroupsStateHandle.java | 7 +- .../flink/runtime/state/KeyedStateHandle.java | 6 +- .../runtime/state/heap/HeapRestoreOperation.java | 8 +- .../taskexecutor/TaskManagerConfiguration.java | 53 -- ...bleNotifyingResultPartitionWriterDecorator.java | 13 +- .../runtime/taskmanager/InputGateWithMetrics.java | 24 +- .../runtime/taskmanager/RuntimeEnvironment.java | 10 +- .../org/apache/flink/runtime/taskmanager/Task.java | 16 +- .../runtime/util/{ => bash}/BashJavaUtils.java | 41 +- .../flink/runtime/util/bash/FlinkConfigLoader.java | 68 +++ .../memory/MemoryBackwardsCompatibilityUtils.java | 4 +- .../util/config/memory/ProcessMemoryUtils.java | 2 +- .../taskmanager/TaskExecutorFlinkMemoryUtils.java | 4 +- .../channel/ChannelStateWriterImplTest.java | 13 + .../checkpoint/channel/MockChannelStateWriter.java | 119 ++++ .../channel/RecordingChannelStateWriter.java | 88 +++ .../clusterframework/BootstrapToolsTest.java | 2 +- .../TaskExecutorProcessUtilsTest.java | 45 +- .../io/network/NettyShuffleEnvironmentTest.java | 36 +- .../SpanningRecordSerializationTest.java | 124 ++++ .../AbstractCollectingResultPartitionWriter.java | 5 +- .../io/network/api/writer/RecordWriterTest.java | 4 +- ...editBasedPartitionRequestClientHandlerTest.java | 48 +- .../NettyMessageClientDecoderDelegateTest.java | 9 +- .../NettyMessageClientSideSerializationTest.java | 1 + .../netty/NettyPartitionRequestClientTest.java | 5 +- .../AwaitableBufferAvailablityListener.java | 21 + .../network/partition/InputChannelTestUtils.java | 8 +- .../network/partition/InputGateFairnessTest.java | 12 +- .../partition/MockResultPartitionWriter.java | 12 +- .../PipelinedSubpartitionWithReadViewTest.java | 79 ++- .../TaskExecutorPartitionTrackerImplTest.java | 4 +- .../consumer/InputBuffersMetricsTest.java | 16 +- .../partition/consumer/InputChannelBuilder.java | 20 +- .../partition/consumer/InputGateTestBase.java | 10 + .../IteratorWrappingTestSingleInputGate.java | 10 +- .../partition/consumer/LocalInputChannelTest.java | 14 +- .../partition/consumer/RemoteInputChannelTest.java | 60 +- .../partition/consumer/SingleInputGateTest.java | 147 ++++- .../partition/consumer/TestInputChannel.java | 3 +- .../partition/consumer/TestSingleInputGate.java | 10 +- .../partition/consumer/UnionInputGateTest.java | 8 +- .../runtime/jobmanager/BlobsCleanupITCase.java | 2 +- .../StandaloneResourceManagerWithUUIDFactory.java | 4 +- .../operators/testutils/DummyEnvironment.java | 6 +- .../operators/testutils/MockEnvironment.java | 19 +- .../resourcemanager/ResourceManagerHATest.java | 5 +- .../resourcemanager/TestingResourceManager.java | 8 +- .../resourcemanager/WorkerResourceSpecTest.java | 173 ++++++ .../slotmanager/SlotManagerBuilder.java | 28 +- .../slotmanager/SlotManagerConfigurationTest.java | 5 +- .../SlotManagerFailUnfulfillableTest.java | 17 +- .../slotmanager/SlotManagerImplTest.java | 109 ++-- .../slotmanager/SlotProtocolTest.java | 11 +- .../slotmanager/TestingResourceActions.java | 14 +- .../slotmanager/TestingResourceActionsBuilder.java | 19 +- .../slotmanager/TestingSlotManager.java | 7 +- .../runtime/shuffle/ShuffleServiceLoaderTest.java | 6 +- .../runtime/state/KeyGroupsStateHandleTest.java | 59 ++ .../flink/runtime/state/StateBackendTestBase.java | 209 ++++--- .../runtime/taskmanager/TaskAsyncCallTest.java | 2 +- .../FlinkConfigLoaderTest.java} | 16 +- .../streaming/state/RocksDBStateUploader.java | 2 +- .../api/environment/CheckpointConfig.java | 47 ++ .../environment/ExecutionCheckpointingOptions.java | 19 + .../flink/streaming/api/graph/StreamConfig.java | 9 + .../api/graph/StreamingJobGraphGenerator.java | 1 + .../streaming/api/operators/MailboxExecutor.java | 5 +- .../runtime/io/CheckpointBarrierHandler.java | 29 +- .../runtime/io/CheckpointBarrierUnaligner.java | 431 ++++++++++++++ .../runtime/io/CheckpointedInputGate.java | 26 +- .../flink/streaming/runtime/io/InputGateUtil.java | 9 +- .../streaming/runtime/io/InputProcessorUtil.java | 70 ++- .../streaming/runtime/io/RecordWriterOutput.java | 4 +- .../streaming/runtime/io/StreamInputProcessor.java | 5 + .../runtime/io/StreamMultipleInputProcessor.java | 18 + .../runtime/io/StreamOneInputProcessor.java | 8 + .../streaming/runtime/io/StreamTaskInput.java | 8 + .../runtime/io/StreamTaskNetworkInput.java | 28 +- .../runtime/io/StreamTaskSourceInput.java | 8 + .../runtime/io/StreamTwoInputProcessor.java | 10 + .../runtime/tasks/AbstractTwoInputStreamTask.java | 12 +- .../runtime/tasks/AsyncCheckpointRunnable.java | 6 + .../runtime/tasks/MultipleInputStreamTask.java | 12 +- .../runtime/tasks/OneInputStreamTask.java | 6 +- .../streaming/runtime/tasks/OperatorChain.java | 16 +- .../flink/streaming/runtime/tasks/StreamTask.java | 59 +- .../tasks/SubtaskCheckpointCoordinator.java | 3 +- .../tasks/SubtaskCheckpointCoordinatorImpl.java | 64 +- .../runtime/tasks/TwoInputStreamTask.java | 12 +- .../streaming/runtime/tasks/mailbox/Mail.java | 10 +- .../runtime/tasks/mailbox/MailboxExecutorImpl.java | 8 +- .../runtime/tasks/mailbox/MailboxProcessor.java | 9 + .../consumer/StreamTestSingleInputGate.java | 12 +- .../CheckpointConfigFromConfigurationTest.java | 8 +- ...CheckpointBarrierAlignerAlignmentLimitTest.java | 10 +- .../CheckpointBarrierAlignerMassiveRandomTest.java | 11 + .../io/CheckpointBarrierAlignerTestBase.java | 6 +- .../runtime/io/CheckpointBarrierUnalignerTest.java | 642 ++++++++++++++++++++ .../runtime/io/CheckpointSequenceValidator.java | 2 +- .../flink/streaming/runtime/io/MockInputGate.java | 11 + .../runtime/io/StreamTaskNetworkInputTest.java | 2 +- .../benchmark/SingleInputGateBenchmarkFactory.java | 6 +- .../StreamNetworkBenchmarkEnvironment.java | 7 +- .../runtime/tasks/LocalStateForwardingTest.java | 2 + .../MultipleInputStreamTaskTestHarnessBuilder.java | 7 +- .../tasks/OneInputStreamTaskTestHarness.java | 6 +- .../runtime/tasks/StreamMockEnvironment.java | 16 +- .../streaming/runtime/tasks/StreamTaskTest.java | 13 + .../tasks/TwoInputStreamTaskTestHarness.java | 14 +- .../util/AbstractStreamOperatorTestHarness.java | 12 +- .../table/client/cli/CliTableauResultView.java | 3 +- .../client/gateway/local/ExecutionContext.java | 30 +- .../table/client/gateway/local/LocalExecutor.java | 5 +- .../flink/table/client/cli/CliClientTest.java | 25 +- .../table/client/cli/CliTableauResultViewTest.java | 257 ++++---- .../flink/table/client/cli/TestingExecutor.java | 228 ++++++++ .../table/client/cli/TestingExecutorBuilder.java | 78 +++ .../client/gateway/local/LocalExecutorITCase.java | 33 ++ .../org/apache/flink/table/api/TableConfig.java | 45 +- .../table/expressions/ApiExpressionUtils.java | 12 +- .../table/functions/FunctionDefinitionUtil.java | 8 +- .../functions/FunctionDefinitionUtilTest.java | 16 +- .../flink/table/utils/FunctionLookupMock.java | 17 +- .../table/expressions/ValueLiteralExpression.java | 141 +++-- .../flink/table/factories/TableSinkFactory.java | 9 + .../factories/TableSinkFactoryContextImpl.java | 10 +- .../functions/BuiltInFunctionDefinitions.java | 33 +- .../flink/table/types/inference/CallContext.java | 4 + .../table/types/inference/InputTypeStrategies.java | 29 + .../table/types/inference/TypeStrategies.java | 44 ++ ...peStrategy.java => ArrayInputTypeStrategy.java} | 46 +- .../inference/strategies/MapInputTypeStrategy.java | 112 ++++ .../strategies/WildcardInputTypeStrategy.java | 11 +- .../flink/table/expressions/ExpressionTest.java | 99 +++- .../types/inference/InputTypeStrategiesTest.java | 69 ++- .../table/types/inference/TypeStrategiesTest.java | 40 +- .../expressions/converter/ExpressionConverter.java | 154 ++--- .../converter/FunctionDefinitionConvertRule.java | 13 +- .../inference/AbstractSqlCallContext.java | 33 +- .../operations/DataStreamQueryOperation.java | 14 - .../planner/plan/QueryOperationConverter.java | 4 - .../rules/logical/PythonCorrelateSplitRule.java | 52 +- .../flink/table/planner/plan/trait/ModifyKind.java | 20 +- .../table/planner/plan/trait/ModifyKindSet.java | 192 ++++++ .../flink/table/planner/plan/trait/UpdateKind.java | 31 +- .../flink/table/planner/utils/ShortcutUtils.java | 5 + .../table/planner/calcite/FlinkTypeFactory.scala | 3 + .../planner/codegen/CodeGeneratorContext.scala | 2 +- .../table/planner/codegen/ExpressionReducer.scala | 7 +- .../table/planner/codegen/GenerateUtils.scala | 8 +- .../planner/codegen/calls/FloorCeilCallGen.scala | 2 +- .../planner/codegen/calls/MethodCallGen.scala | 2 +- .../planner/codegen/calls/ScalarOperatorGens.scala | 20 +- .../table/planner/delegation/PlannerBase.scala | 7 +- .../table/planner/delegation/StreamPlanner.scala | 8 +- .../expressions/PlannerExpressionConverter.scala | 23 +- .../table/planner/expressions/collection.scala | 68 --- .../metadata/FlinkRelMdModifiedMonotonicity.scala | 5 +- .../nodes/common/CommonIntermediateTableScan.scala | 4 + .../plan/nodes/common/CommonPythonCorrelate.scala | 7 +- .../nodes/physical/stream/StreamExecCalcBase.scala | 8 - .../physical/stream/StreamExecCorrelateBase.scala | 8 - .../physical/stream/StreamExecDataStreamScan.scala | 10 - .../physical/stream/StreamExecDeduplicate.scala | 43 +- .../nodes/physical/stream/StreamExecExchange.scala | 8 - .../nodes/physical/stream/StreamExecExpand.scala | 8 - .../stream/StreamExecGlobalGroupAggregate.scala | 14 +- .../physical/stream/StreamExecGroupAggregate.scala | 38 +- .../stream/StreamExecGroupTableAggregate.scala | 36 +- .../StreamExecGroupWindowAggregateBase.scala | 30 +- .../StreamExecIncrementalGroupAggregate.scala | 8 - .../stream/StreamExecIntermediateTableScan.scala | 13 - .../nodes/physical/stream/StreamExecJoin.scala | 40 +- .../nodes/physical/stream/StreamExecLimit.scala | 21 +- .../stream/StreamExecLocalGroupAggregate.scala | 11 +- .../physical/stream/StreamExecLookupJoin.scala | 8 - .../nodes/physical/stream/StreamExecMatch.scala | 17 - .../stream/StreamExecMiniBatchAssigner.scala | 8 - .../physical/stream/StreamExecOverAggregate.scala | 17 - .../nodes/physical/stream/StreamExecRank.scala | 54 +- .../nodes/physical/stream/StreamExecSink.scala | 25 +- .../nodes/physical/stream/StreamExecSort.scala | 12 - .../physical/stream/StreamExecSortLimit.scala | 45 +- .../stream/StreamExecTableSourceScan.scala | 8 - .../physical/stream/StreamExecTemporalJoin.scala | 8 - .../physical/stream/StreamExecTemporalSort.scala | 8 - .../nodes/physical/stream/StreamExecUnion.scala | 8 - .../nodes/physical/stream/StreamExecValues.scala | 8 - .../stream/StreamExecWatermarkAssigner.scala | 8 - .../physical/stream/StreamExecWindowJoin.scala | 18 +- .../nodes/physical/stream/StreamPhysicalRel.scala | 23 - .../table/planner/plan/optimize/RelNodeBlock.scala | 18 +- .../StreamCommonSubGraphBasedOptimizer.scala | 96 +-- .../FlinkChangelogModeInferenceProgram.scala | 644 +++++++++++++++++++++ .../plan/optimize/program/FlinkStreamProgram.scala | 10 +- .../optimize/program/StreamOptimizeContext.scala | 11 +- .../planner/plan/rules/FlinkBatchRuleSets.scala | 1 + .../planner/plan/rules/FlinkStreamRuleSets.scala | 11 +- .../plan/rules/logical/PythonCalcSplitRule.scala | 111 +++- .../rules/physical/FlinkExpandConversionRule.scala | 8 +- .../rules/physical/stream/StreamExecRankRule.scala | 5 +- .../stream/StreamExecRetractionRules.scala | 241 -------- .../physical/stream/StreamExecSortLimitRule.scala | 5 +- .../stream/TwoStageOptimizedAggregateRule.scala | 17 +- .../planner/plan/schema/DataStreamTable.scala | 25 - .../planner/plan/schema/IntermediateRelTable.scala | 10 +- .../planner/plan/trait/ModifyKindSetTrait.scala | 69 +++ ...TraitDefs.scala => ModifyKindSetTraitDef.scala} | 54 +- .../flink/table/planner/plan/trait/TraitUtil.scala | 10 +- .../table/planner/plan/trait/UpdateKindTrait.scala | 98 ++++ ...ionTraitDefs.scala => UpdateKindTraitDef.scala} | 53 +- .../planner/plan/trait/retractionTraits.scala | 113 ---- .../table/planner/plan/utils/AggregateUtil.scala | 30 +- .../planner/plan/utils/ChangelogPlanUtils.scala | 125 ++++ .../planner/plan/utils/ExecNodePlanDumper.scala | 30 +- .../table/planner/plan/utils/FlinkRelOptUtil.scala | 10 +- .../planner/plan/utils/RankProcessStrategy.scala | 47 +- .../planner/plan/utils/RelTreeWriterImpl.scala | 12 +- .../planner/plan/utils/UpdatingPlanChecker.scala | 31 - .../table/planner/sinks/DataStreamTableSink.scala | 4 +- .../planner/expressions/TypeConversionsTest.java | 129 +++++ .../converter/ExpressionConverterTest.java | 149 ++++- .../apache/flink/table/api/stream/ExplainTest.xml | 102 ++-- .../CalcPythonCorrelateTransposeRuleTest.xml | 8 +- .../plan/rules/logical/PythonCalcSplitRuleTest.xml | 152 +++-- .../rules/logical/PythonCorrelateSplitRuleTest.xml | 90 ++- .../physical/stream/ChangelogModeInferenceTest.xml | 224 +++++++ .../rules/physical/stream/RetractionRulesTest.xml | 117 ---- .../stream/RetractionRulesWithTwoStageAggTest.xml | 110 ---- .../plan/stream/sql/DagOptimizationTest.xml | 550 +++++++++--------- .../plan/stream/sql/ModifiedMonotonicityTest.xml | 90 +-- .../table/planner/plan/stream/sql/RankTest.xml | 146 ++--- .../table/planner/plan/stream/sql/SinkTest.xml | 165 +++--- .../planner/plan/stream/sql/SortLimitTest.xml | 98 ++-- .../planner/plan/stream/sql/SubplanReuseTest.xml | 4 +- .../planner/plan/stream/sql/agg/AggregateTest.xml | 56 +- .../plan/stream/sql/agg/DistinctAggregateTest.xml | 246 ++++---- .../stream/sql/agg/IncrementalAggregateTest.xml | 78 +-- .../planner/plan/stream/sql/join/JoinTest.xml | 584 +++++++++---------- .../validation/MatchRecognizeValidationTest.scala | 4 +- .../table/planner/expressions/ArrayTypeTest.scala | 9 + .../table/planner/expressions/MapTypeTest.scala | 9 + .../validation/ArrayTypeValidationTest.scala | 5 - .../planner/plan/common/TableFactoryTest.scala | 3 +- .../plan/metadata/FlinkRelMdHandlerTestBase.scala | 14 +- .../rules/logical/PythonCalcSplitRuleTest.scala | 20 +- .../logical/PythonCorrelateSplitRuleTest.scala | 16 + ...Test.scala => ChangelogModeInferenceTest.scala} | 38 +- .../physical/stream/RetractionRulesTest.scala | 70 --- .../plan/stream/sql/DagOptimizationTest.scala | 36 +- .../planner/plan/stream/sql/DeduplicateTest.scala | 3 +- .../table/planner/plan/stream/sql/SinkTest.scala | 49 +- .../validation/OverWindowValidationTest.scala | 30 +- .../planner/plan/utils/PartitionPrunerTest.scala | 2 + .../plan/utils/TestContextTableFactory.scala | 4 +- .../runtime/stream/table/TableSinkITCase.scala | 40 ++ .../flink/table/planner/utils/TableTestBase.scala | 42 +- .../expressions/PlannerTypeInferenceUtilImpl.java | 4 + .../rules/logical/PythonCorrelateSplitRule.java | 52 +- .../flink/table/api/internal/TableEnvImpl.scala | 2 +- .../table/plan/nodes/CommonPythonCorrelate.scala | 7 +- .../flink/table/plan/rules/FlinkRuleSets.scala | 1 + .../plan/rules/logical/PythonCalcSplitRule.scala | 111 +++- .../apache/flink/table/planner/StreamPlanner.scala | 2 +- .../table/validation/CalcValidationTest.scala | 13 - .../flink/table/expressions/ArrayTypeTest.scala | 1 + .../validation/ArrayTypeValidationTest.scala | 5 - .../validation/MapTypeValidationTest.scala | 5 - .../flink/table/plan/PythonCalcSplitRuleTest.scala | 73 +++ .../table/plan/PythonCorrelateSplitRuleTest.scala | 75 +++ .../table/utils/TestContextTableFactory.scala | 1 + .../apache/flink/table/dataformat/ColumnarRow.java | 3 +- .../table/dataformat/vector/RowColumnVector.java | 21 +- .../dataformat/vector/VectorizedColumnBatch.java | 5 + .../operators/aggregate/GroupAggFunction.java | 12 +- .../operators/aggregate/GroupTableAggFunction.java | 12 +- .../aggregate/MiniBatchGlobalGroupAggFunction.java | 12 +- .../aggregate/MiniBatchGroupAggFunction.java | 12 +- .../deduplicate/DeduplicateFunctionHelper.java | 12 +- .../DeduplicateKeepFirstRowFunction.java | 26 +- .../DeduplicateKeepLastRowFunction.java | 36 +- .../MiniBatchDeduplicateKeepFirstRowFunction.java | 13 +- .../MiniBatchDeduplicateKeepLastRowFunction.java | 22 +- .../join/stream/AbstractStreamingJoinOperator.java | 2 - .../join/stream/StreamingJoinOperator.java | 12 +- .../join/stream/StreamingSemiAntiJoinOperator.java | 6 +- .../join/stream/state/JoinRecordStateViews.java | 26 +- .../stream/state/OuterJoinRecordStateViews.java | 13 +- .../operators/rank/AbstractTopNFunction.java | 11 +- .../operators/rank/AppendOnlyTopNFunction.java | 4 +- .../operators/rank/RetractableTopNFunction.java | 4 +- .../operators/rank/UpdatableTopNFunction.java | 4 +- .../table/runtime/util/StateTtlConfigUtil.java | 33 +- .../deduplicate/DeduplicateFunctionTestBase.java | 2 - .../DeduplicateKeepFirstRowFunctionTest.java | 27 +- .../DeduplicateKeepLastRowFunctionTest.java | 41 +- ...niBatchDeduplicateKeepFirstRowFunctionTest.java | 31 +- ...iniBatchDeduplicateKeepLastRowFunctionTest.java | 39 +- .../operators/rank/AppendOnlyTopNFunctionTest.java | 4 +- .../rank/RetractableTopNFunctionTest.java | 31 +- .../operators/rank/TopNFunctionTestBase.java | 18 +- .../operators/rank/UpdatableTopNFunctionTest.java | 26 +- .../table/runtime/util/StreamRecordUtils.java | 5 + .../checkpointing/UnalignedCheckpointITCase.java | 175 ++++++ .../test/java/org/apache/flink/yarn/UtilsTest.java | 2 +- .../yarn/YARNSessionCapacitySchedulerITCase.java | 1 - .../apache/flink/yarn/YarnConfigurationITCase.java | 5 +- .../apache/flink/yarn/YarnClusterDescriptor.java | 8 +- .../org/apache/flink/yarn/YarnResourceManager.java | 20 +- .../entrypoint/YarnResourceManagerFactory.java | 3 +- .../entrypoint/YarnWorkerResourceSpecFactory.java | 70 +++ .../apache/flink/yarn/YarnResourceManagerTest.java | 7 +- pom.xml | 4 +- 469 files changed, 12090 insertions(+), 5115 deletions(-) create mode 100644 docs/dev/table/python/vectorized_python_udfs.md create mode 100644 docs/dev/table/python/vectorized_python_udfs.zh.md copy flink-connectors/flink-jdbc/src/main/java/org/apache/flink/api/java/io/jdbc/source/row/converter/JDBCRowConverter.java => flink-kubernetes/src/main/java/org/apache/flink/kubernetes/configuration/KubernetesResourceManagerConfiguration.java (55%) create mode 100644 flink-kubernetes/src/main/java/org/apache/flink/kubernetes/entrypoint/KubernetesWorkerResourceSpecFactory.java create mode 100644 flink-kubernetes/src/test/java/org/apache/flink/kubernetes/KubernetesClientTestBase.java create mode 100644 flink-mesos/src/main/java/org/apache/flink/mesos/runtime/clusterframework/MesosWorkerResourceSpecFactory.java rename flink-table/flink-table-planner-blink/src/main/scala/org/apache/flink/table/planner/plan/optimize/program/FlinkUpdateAsRetractionTraitInitProgram.scala => flink-metrics/flink-metrics-statsd/src/main/java/org/apache/flink/metrics/statsd/StatsDReporterFactory.java (55%) create mode 100644 flink-metrics/flink-metrics-statsd/src/main/resources/META-INF/services/org.apache.flink.metrics.reporter.MetricReporterFactory create mode 100644 flink-python/pyflink/fn_execution/fast_coder_impl.pxd create mode 100644 flink-python/pyflink/fn_execution/fast_coder_impl.pyx rename flink-python/pyflink/fn_execution/tests/{test_coders_common.py => test_coders.py} (95%) create mode 100644 flink-python/pyflink/fn_execution/tests/test_fast_coders.py copy flink-connectors/flink-jdbc/src/main/java/org/apache/flink/api/java/io/jdbc/source/row/converter/AbstractJDBCRowConverter.java => flink-python/src/main/java/org/apache/flink/table/runtime/arrow/readers/RowFieldReader.java (52%) create mode 100644 flink-python/src/main/java/org/apache/flink/table/runtime/arrow/vectors/ArrowRowColumnVector.java create mode 100644 flink-python/src/main/java/org/apache/flink/table/runtime/arrow/writers/RowRowWriter.java create mode 100644 flink-python/src/main/java/org/apache/flink/table/runtime/arrow/writers/RowWriter.java create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/io/network/buffer/BufferReceivedListener.java copy flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/io/StreamTaskInput.java => flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/consumer/IndexedInputGate.java (70%) copy flink-connectors/flink-jdbc/src/main/java/org/apache/flink/api/java/io/jdbc/source/row/converter/JDBCRowConverter.java => flink-runtime/src/main/java/org/apache/flink/runtime/resourcemanager/ArbitraryWorkerResourceSpecFactory.java (54%) create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/resourcemanager/WorkerResourceSpec.java create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/resourcemanager/WorkerResourceSpecFactory.java rename flink-runtime/src/main/java/org/apache/flink/runtime/util/{ => bash}/BashJavaUtils.java (76%) create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/util/bash/FlinkConfigLoader.java create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/checkpoint/channel/MockChannelStateWriter.java create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/checkpoint/channel/RecordingChannelStateWriter.java create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/resourcemanager/WorkerResourceSpecTest.java create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/state/KeyGroupsStateHandleTest.java rename flink-runtime/src/test/java/org/apache/flink/runtime/util/{BashJavaUtilsTest.java => bash/FlinkConfigLoaderTest.java} (86%) create mode 100644 flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/io/CheckpointBarrierUnaligner.java create mode 100644 flink-streaming-java/src/test/java/org/apache/flink/streaming/runtime/io/CheckpointBarrierUnalignerTest.java create mode 100644 flink-table/flink-sql-client/src/test/java/org/apache/flink/table/client/cli/TestingExecutor.java create mode 100644 flink-table/flink-sql-client/src/test/java/org/apache/flink/table/client/cli/TestingExecutorBuilder.java copy flink-table/flink-table-common/src/main/java/org/apache/flink/table/types/inference/strategies/{WildcardInputTypeStrategy.java => ArrayInputTypeStrategy.java} (57%) create mode 100644 flink-table/flink-table-common/src/main/java/org/apache/flink/table/types/inference/strategies/MapInputTypeStrategy.java copy flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/BufferAvailabilityListener.java => flink-table/flink-table-planner-blink/src/main/java/org/apache/flink/table/planner/plan/trait/ModifyKind.java (71%) create mode 100644 flink-table/flink-table-planner-blink/src/main/java/org/apache/flink/table/planner/plan/trait/ModifyKindSet.java copy flink-connectors/flink-jdbc/src/main/java/org/apache/flink/api/java/io/jdbc/source/row/converter/JDBCRowConverter.java => flink-table/flink-table-planner-blink/src/main/java/org/apache/flink/table/planner/plan/trait/UpdateKind.java (60%) create mode 100644 flink-table/flink-table-planner-blink/src/main/scala/org/apache/flink/table/planner/plan/optimize/program/FlinkChangelogModeInferenceProgram.scala delete mode 100644 flink-table/flink-table-planner-blink/src/main/scala/org/apache/flink/table/planner/plan/rules/physical/stream/StreamExecRetractionRules.scala create mode 100644 flink-table/flink-table-planner-blink/src/main/scala/org/apache/flink/table/planner/plan/trait/ModifyKindSetTrait.scala copy flink-table/flink-table-planner-blink/src/main/scala/org/apache/flink/table/planner/plan/trait/{retractionTraitDefs.scala => ModifyKindSetTraitDef.scala} (50%) create mode 100644 flink-table/flink-table-planner-blink/src/main/scala/org/apache/flink/table/planner/plan/trait/UpdateKindTrait.scala rename flink-table/flink-table-planner-blink/src/main/scala/org/apache/flink/table/planner/plan/trait/{retractionTraitDefs.scala => UpdateKindTraitDef.scala} (50%) delete mode 100644 flink-table/flink-table-planner-blink/src/main/scala/org/apache/flink/table/planner/plan/trait/retractionTraits.scala create mode 100644 flink-table/flink-table-planner-blink/src/main/scala/org/apache/flink/table/planner/plan/utils/ChangelogPlanUtils.scala create mode 100644 flink-table/flink-table-planner-blink/src/test/java/org/apache/flink/table/planner/expressions/TypeConversionsTest.java create mode 100644 flink-table/flink-table-planner-blink/src/test/resources/org/apache/flink/table/planner/plan/rules/physical/stream/ChangelogModeInferenceTest.xml delete mode 100644 flink-table/flink-table-planner-blink/src/test/resources/org/apache/flink/table/planner/plan/rules/physical/stream/RetractionRulesTest.xml delete mode 100644 flink-table/flink-table-planner-blink/src/test/resources/org/apache/flink/table/planner/plan/rules/physical/stream/RetractionRulesWithTwoStageAggTest.xml rename flink-table/flink-table-planner-blink/src/test/scala/org/apache/flink/table/planner/plan/rules/physical/stream/{RetractionRulesWithTwoStageAggTest.scala => ChangelogModeInferenceTest.scala} (68%) delete mode 100644 flink-table/flink-table-planner-blink/src/test/scala/org/apache/flink/table/planner/plan/rules/physical/stream/RetractionRulesTest.scala copy flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/BufferAvailabilityListener.java => flink-table/flink-table-runtime-blink/src/main/java/org/apache/flink/table/dataformat/vector/RowColumnVector.java (65%) copy flink-connectors/flink-jdbc/src/main/java/org/apache/flink/api/java/io/jdbc/source/row/converter/JDBCRowConverter.java => flink-table/flink-table-runtime-blink/src/main/java/org/apache/flink/table/runtime/util/StateTtlConfigUtil.java (52%) create mode 100644 flink-tests/src/test/java/org/apache/flink/test/checkpointing/UnalignedCheckpointITCase.java create mode 100644 flink-yarn/src/main/java/org/apache/flink/yarn/entrypoint/YarnWorkerResourceSpecFactory.java