[flink] branch release-1.13 updated: [hotfix][docs] Update release notes for 1.13 with state backend migration details
This is an automated email from the ASF dual-hosted git repository. sjwiesman pushed a commit to branch release-1.13 in repository https://gitbox.apache.org/repos/asf/flink.git The following commit(s) were added to refs/heads/release-1.13 by this push: new e015753 [hotfix][docs] Update release notes for 1.13 with state backend migration details e015753 is described below commit e01575337bfe12e40644b0aeff9fa89e9e00ffd1 Author: Seth Wiesman AuthorDate: Fri Jul 9 15:29:12 2021 -0500 [hotfix][docs] Update release notes for 1.13 with state backend migration details Co-authored-by: David Anderson --- docs/content.zh/release-notes/flink-1.13.md | 15 ++- docs/content/release-notes/flink-1.13.md| 17 - 2 files changed, 30 insertions(+), 2 deletions(-) diff --git a/docs/content.zh/release-notes/flink-1.13.md b/docs/content.zh/release-notes/flink-1.13.md index 13def89..dceda51 100644 --- a/docs/content.zh/release-notes/flink-1.13.md +++ b/docs/content.zh/release-notes/flink-1.13.md @@ -38,6 +38,20 @@ by default before) and there is no option to configure a synchronous snapshot an The constructors of `FsStateBackend` and `MemoryStateBackend` that take a flag for sync/async snapshots are kept for API compatibility, but the flags are ignored now. +# [FLINK-19463](https://issues.apache.org/jira/browse/FLINK-19463) + +Flink has always separated local state storage from fault tolerance. +Keyed state is maintained locally in state backends, either on the JVM heap or in embedded RocksDB instances. +Fault tolerance comes from checkpoints and savepoints - periodic snapshots of a job's internal state to some durable file system - such as Amazon S3 or HDFS. + +Historically, Flink's `StateBackend` interface intermixed these concepts in a way that confused many users. +In 1.13, checkpointing configurations have been extracted into their own interface, `CheckpointStorage`. + +This change does not affect the runtime behavior and simply provides a better mental model to users. +Pipelines can be updated to use the new the new abstractions without losing state, consistency, or change in semantics. + +Please follow the [migration guide](https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/ops/state/state_backends/#migrating-from-legacy-backends) or the JavaDoc on the deprecated state backend classes - `MemoryStateBackend`, `FsStateBackend` and `RocksDBStateBackend` for migration details. + Unify binary format for Keyed State savepoints # [FLINK-20976](https://issues.apache.org/jira/browse/FLINK-20976) @@ -299,4 +313,3 @@ recovered. The community decided to deprecate the Apache Mesos support for Apache Flink. It is subject to removal in the future. Users are encouraged to switch to a different resource manager. - diff --git a/docs/content/release-notes/flink-1.13.md b/docs/content/release-notes/flink-1.13.md index 13def89..1798564 100644 --- a/docs/content/release-notes/flink-1.13.md +++ b/docs/content/release-notes/flink-1.13.md @@ -38,6 +38,22 @@ by default before) and there is no option to configure a synchronous snapshot an The constructors of `FsStateBackend` and `MemoryStateBackend` that take a flag for sync/async snapshots are kept for API compatibility, but the flags are ignored now. + Disentangle StateBackends from Checkpointing + +# [FLINK-19463](https://issues.apache.org/jira/browse/FLINK-19463) + +Flink has always separated local state storage from fault tolerance. +Keyed state is maintained locally in state backends, either on the JVM heap or in embedded RocksDB instances. +Fault tolerance comes from checkpoints and savepoints - periodic snapshots of a job's internal state to some durable file system - such as Amazon S3 or HDFS. + +Historically, Flink's `StateBackend` interface intermixed these concepts in a way that confused many users. +In 1.13, checkpointing configurations have been extracted into their own interface, `CheckpointStorage`. + +This change does not affect the runtime behavior and simply provides a better mental model to users. +Pipelines can be updated to use the new the new abstractions without losing state, consistency, or change in semantics. + +Please follow the [migration guide](https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/ops/state/state_backends/#migrating-from-legacy-backends) or the JavaDoc on the deprecated state backend classes - `MemoryStateBackend`, `FsStateBackend` and `RocksDBStateBackend` for migration details. + Unify binary format for Keyed State savepoints # [FLINK-20976](https://issues.apache.org/jira/browse/FLINK-20976) @@ -299,4 +315,3 @@ recovered. The community decided to deprecate the Apache Mesos support for Apache Flink. It is subject to removal in the future. Users are encouraged to switch to a different resource manager. -
[flink] branch master updated: [hotfix][docs] Update release notes for 1.13 with state backend migration details
This is an automated email from the ASF dual-hosted git repository. sjwiesman pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/flink.git The following commit(s) were added to refs/heads/master by this push: new 764f257 [hotfix][docs] Update release notes for 1.13 with state backend migration details 764f257 is described below commit 764f257de69f7427f1bf6dd7c877dd2171601fde Author: Seth Wiesman AuthorDate: Fri Jul 9 15:29:12 2021 -0500 [hotfix][docs] Update release notes for 1.13 with state backend migration details Co-authored-by: David Anderson --- docs/content.zh/release-notes/flink-1.13.md | 15 ++- docs/content/release-notes/flink-1.13.md| 17 - 2 files changed, 30 insertions(+), 2 deletions(-) diff --git a/docs/content.zh/release-notes/flink-1.13.md b/docs/content.zh/release-notes/flink-1.13.md index 13def89..dceda51 100644 --- a/docs/content.zh/release-notes/flink-1.13.md +++ b/docs/content.zh/release-notes/flink-1.13.md @@ -38,6 +38,20 @@ by default before) and there is no option to configure a synchronous snapshot an The constructors of `FsStateBackend` and `MemoryStateBackend` that take a flag for sync/async snapshots are kept for API compatibility, but the flags are ignored now. +# [FLINK-19463](https://issues.apache.org/jira/browse/FLINK-19463) + +Flink has always separated local state storage from fault tolerance. +Keyed state is maintained locally in state backends, either on the JVM heap or in embedded RocksDB instances. +Fault tolerance comes from checkpoints and savepoints - periodic snapshots of a job's internal state to some durable file system - such as Amazon S3 or HDFS. + +Historically, Flink's `StateBackend` interface intermixed these concepts in a way that confused many users. +In 1.13, checkpointing configurations have been extracted into their own interface, `CheckpointStorage`. + +This change does not affect the runtime behavior and simply provides a better mental model to users. +Pipelines can be updated to use the new the new abstractions without losing state, consistency, or change in semantics. + +Please follow the [migration guide](https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/ops/state/state_backends/#migrating-from-legacy-backends) or the JavaDoc on the deprecated state backend classes - `MemoryStateBackend`, `FsStateBackend` and `RocksDBStateBackend` for migration details. + Unify binary format for Keyed State savepoints # [FLINK-20976](https://issues.apache.org/jira/browse/FLINK-20976) @@ -299,4 +313,3 @@ recovered. The community decided to deprecate the Apache Mesos support for Apache Flink. It is subject to removal in the future. Users are encouraged to switch to a different resource manager. - diff --git a/docs/content/release-notes/flink-1.13.md b/docs/content/release-notes/flink-1.13.md index 13def89..1798564 100644 --- a/docs/content/release-notes/flink-1.13.md +++ b/docs/content/release-notes/flink-1.13.md @@ -38,6 +38,22 @@ by default before) and there is no option to configure a synchronous snapshot an The constructors of `FsStateBackend` and `MemoryStateBackend` that take a flag for sync/async snapshots are kept for API compatibility, but the flags are ignored now. + Disentangle StateBackends from Checkpointing + +# [FLINK-19463](https://issues.apache.org/jira/browse/FLINK-19463) + +Flink has always separated local state storage from fault tolerance. +Keyed state is maintained locally in state backends, either on the JVM heap or in embedded RocksDB instances. +Fault tolerance comes from checkpoints and savepoints - periodic snapshots of a job's internal state to some durable file system - such as Amazon S3 or HDFS. + +Historically, Flink's `StateBackend` interface intermixed these concepts in a way that confused many users. +In 1.13, checkpointing configurations have been extracted into their own interface, `CheckpointStorage`. + +This change does not affect the runtime behavior and simply provides a better mental model to users. +Pipelines can be updated to use the new the new abstractions without losing state, consistency, or change in semantics. + +Please follow the [migration guide](https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/ops/state/state_backends/#migrating-from-legacy-backends) or the JavaDoc on the deprecated state backend classes - `MemoryStateBackend`, `FsStateBackend` and `RocksDBStateBackend` for migration details. + Unify binary format for Keyed State savepoints # [FLINK-20976](https://issues.apache.org/jira/browse/FLINK-20976) @@ -299,4 +315,3 @@ recovered. The community decided to deprecate the Apache Mesos support for Apache Flink. It is subject to removal in the future. Users are encouraged to switch to a different resource manager. -
[flink-shaded] branch master updated: [FLINK-22326][guava] Adjust artifact name and directory
This is an automated email from the ASF dual-hosted git repository.
chesnay pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/flink-shaded.git
The following commit(s) were added to refs/heads/master by this push:
new 4782c96 [FLINK-22326][guava] Adjust artifact name and directory
4782c96 is described below
commit 4782c96be88d2b5378423f58385f07ec08565e67
Author: Chesnay Schepler
AuthorDate: Fri Jul 9 17:15:29 2021 +0200
[FLINK-22326][guava] Adjust artifact name and directory
---
{flink-shaded-guava-18 => flink-shaded-guava-30}/pom.xml| 2 +-
.../src/main/resources/META-INF/NOTICE | 2 +-
pom.xml | 2 +-
3 files changed, 3 insertions(+), 3 deletions(-)
diff --git a/flink-shaded-guava-18/pom.xml b/flink-shaded-guava-30/pom.xml
similarity index 98%
rename from flink-shaded-guava-18/pom.xml
rename to flink-shaded-guava-30/pom.xml
index 140df56..7ad8eb8 100644
--- a/flink-shaded-guava-18/pom.xml
+++ b/flink-shaded-guava-30/pom.xml
@@ -30,7 +30,7 @@ under the License.
flink-shaded-guava
-flink-shaded-guava-18
+flink-shaded-guava-30
${guava.version}-14.0
jar
diff --git a/flink-shaded-guava-18/src/main/resources/META-INF/NOTICE
b/flink-shaded-guava-30/src/main/resources/META-INF/NOTICE
similarity index 84%
rename from flink-shaded-guava-18/src/main/resources/META-INF/NOTICE
rename to flink-shaded-guava-30/src/main/resources/META-INF/NOTICE
index 0daf6e3..a127561 100644
--- a/flink-shaded-guava-18/src/main/resources/META-INF/NOTICE
+++ b/flink-shaded-guava-30/src/main/resources/META-INF/NOTICE
@@ -1,4 +1,4 @@
-flink-shaded-guava-18
+flink-shaded-guava-30
Copyright 2014-2021 The Apache Software Foundation
This product includes software developed at
diff --git a/pom.xml b/pom.xml
index ec7e2c2..48e4880 100644
--- a/pom.xml
+++ b/pom.xml
@@ -58,7 +58,7 @@ under the License.
flink-shaded-force-shading
flink-shaded-asm-7
-flink-shaded-guava-18
+flink-shaded-guava-30
flink-shaded-netty-4
flink-shaded-netty-tcnative-dynamic
flink-shaded-jackson-parent
[flink-shaded] branch master updated: [FLINK-23299] Bump Zookeeper to 3.5.9
This is an automated email from the ASF dual-hosted git repository.
chesnay pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/flink-shaded.git
The following commit(s) were added to refs/heads/master by this push:
new 1bd96c5 [FLINK-23299] Bump Zookeeper to 3.5.9
1bd96c5 is described below
commit 1bd96c587c1af601425357d28a8c68c61dad0ce3
Author: Chesnay Schepler
AuthorDate: Wed Jul 7 11:27:25 2021 +0200
[FLINK-23299] Bump Zookeeper to 3.5.9
---
flink-shaded-zookeeper-parent/flink-shaded-zookeeper-35/pom.xml | 2 +-
.../flink-shaded-zookeeper-35/src/main/resources/META-INF/NOTICE | 4 ++--
2 files changed, 3 insertions(+), 3 deletions(-)
diff --git a/flink-shaded-zookeeper-parent/flink-shaded-zookeeper-35/pom.xml
b/flink-shaded-zookeeper-parent/flink-shaded-zookeeper-35/pom.xml
index 20b4da1..8d65073 100644
--- a/flink-shaded-zookeeper-parent/flink-shaded-zookeeper-35/pom.xml
+++ b/flink-shaded-zookeeper-parent/flink-shaded-zookeeper-35/pom.xml
@@ -34,7 +34,7 @@ under the License.
${zookeeper.version}-14.0
-3.5.6
+3.5.9
4.2.0
diff --git
a/flink-shaded-zookeeper-parent/flink-shaded-zookeeper-35/src/main/resources/META-INF/NOTICE
b/flink-shaded-zookeeper-parent/flink-shaded-zookeeper-35/src/main/resources/META-INF/NOTICE
index de2df1e..17bdeef 100644
---
a/flink-shaded-zookeeper-parent/flink-shaded-zookeeper-35/src/main/resources/META-INF/NOTICE
+++
b/flink-shaded-zookeeper-parent/flink-shaded-zookeeper-35/src/main/resources/META-INF/NOTICE
@@ -10,5 +10,5 @@ This project bundles the following dependencies under the
Apache Software Licens
- org.apache.curator:curator-client:4.2.0
- org.apache.curator:curator-framework:4.2.0
- org.apache.curator:curator-recipes:4.2.0
-- org.apache.zookeeper:zookeeper:3.5.6
-- org.apache.zookeeper:zookeeper-jute:3.5.6
+- org.apache.zookeeper:zookeeper:3.5.9
+- org.apache.zookeeper:zookeeper-jute:3.5.9
[flink-shaded] 01/02: [FLINK-23291] Bump jackson to 2.12.4
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/flink-shaded.git commit 9fc48b10bcf273b8b8abd181301412387ad7df15 Author: Chesnay Schepler AuthorDate: Wed Jul 7 11:20:13 2021 +0200 [FLINK-23291] Bump jackson to 2.12.4 --- flink-shaded-jackson-parent/flink-shaded-jackson-2/pom.xml | 2 +- .../flink-shaded-jackson-2/src/main/resources/META-INF/NOTICE | 10 +- .../flink-shaded-jackson-module-jsonSchema-2/pom.xml | 2 +- .../src/main/resources/META-INF/NOTICE | 8 flink-shaded-jackson-parent/pom.xml| 4 ++-- 5 files changed, 13 insertions(+), 13 deletions(-) diff --git a/flink-shaded-jackson-parent/flink-shaded-jackson-2/pom.xml b/flink-shaded-jackson-parent/flink-shaded-jackson-2/pom.xml index 3298f53..eb7716c 100644 --- a/flink-shaded-jackson-parent/flink-shaded-jackson-2/pom.xml +++ b/flink-shaded-jackson-parent/flink-shaded-jackson-2/pom.xml @@ -25,7 +25,7 @@ under the License. org.apache.flink flink-shaded-jackson-parent -2.12.1-14.0 +2.12.4-14.0 .. diff --git a/flink-shaded-jackson-parent/flink-shaded-jackson-2/src/main/resources/META-INF/NOTICE b/flink-shaded-jackson-parent/flink-shaded-jackson-2/src/main/resources/META-INF/NOTICE index bf37528..36a7c65 100644 --- a/flink-shaded-jackson-parent/flink-shaded-jackson-2/src/main/resources/META-INF/NOTICE +++ b/flink-shaded-jackson-parent/flink-shaded-jackson-2/src/main/resources/META-INF/NOTICE @@ -6,9 +6,9 @@ The Apache Software Foundation (http://www.apache.org/). This project bundles the following dependencies under the Apache Software License 2.0 (http://www.apache.org/licenses/LICENSE-2.0.txt) -- com.fasterxml.jackson.core:jackson-annotations:2.12.1 -- com.fasterxml.jackson.core:jackson-core:2.12.1 -- com.fasterxml.jackson.core:jackson-databind:2.12.1 -- com.fasterxml.jackson.dataformat:jackson-dataformat-csv:2.12.1 -- com.fasterxml.jackson.dataformat:jackson-dataformat-yaml:2.12.1 +- com.fasterxml.jackson.core:jackson-annotations:2.12.4 +- com.fasterxml.jackson.core:jackson-core:2.12.4 +- com.fasterxml.jackson.core:jackson-databind:2.12.4 +- com.fasterxml.jackson.dataformat:jackson-dataformat-csv:2.12.4 +- com.fasterxml.jackson.dataformat:jackson-dataformat-yaml:2.12.4 - org.yaml:snakeyaml:1.27 diff --git a/flink-shaded-jackson-parent/flink-shaded-jackson-module-jsonSchema-2/pom.xml b/flink-shaded-jackson-parent/flink-shaded-jackson-module-jsonSchema-2/pom.xml index f457a37..62d7bfa 100644 --- a/flink-shaded-jackson-parent/flink-shaded-jackson-module-jsonSchema-2/pom.xml +++ b/flink-shaded-jackson-parent/flink-shaded-jackson-module-jsonSchema-2/pom.xml @@ -25,7 +25,7 @@ under the License. org.apache.flink flink-shaded-jackson-parent -2.12.1-14.0 +2.12.4-14.0 .. diff --git a/flink-shaded-jackson-parent/flink-shaded-jackson-module-jsonSchema-2/src/main/resources/META-INF/NOTICE b/flink-shaded-jackson-parent/flink-shaded-jackson-module-jsonSchema-2/src/main/resources/META-INF/NOTICE index 670e8b7..2ff23c8 100644 --- a/flink-shaded-jackson-parent/flink-shaded-jackson-module-jsonSchema-2/src/main/resources/META-INF/NOTICE +++ b/flink-shaded-jackson-parent/flink-shaded-jackson-module-jsonSchema-2/src/main/resources/META-INF/NOTICE @@ -6,8 +6,8 @@ The Apache Software Foundation (http://www.apache.org/). This project bundles the following dependencies under the Apache Software License 2.0 (http://www.apache.org/licenses/LICENSE-2.0.txt) -- com.fasterxml.jackson.core:jackson-annotations:2.12.1 -- com.fasterxml.jackson.core:jackson-core:2.12.1 -- com.fasterxml.jackson.core:jackson-databind:2.12.1 -- com.fasterxml.jackson.module:jackson-module-jsonSchema:2.12.1 +- com.fasterxml.jackson.core:jackson-annotations:2.12.4 +- com.fasterxml.jackson.core:jackson-core:2.12.4 +- com.fasterxml.jackson.core:jackson-databind:2.12.4 +- com.fasterxml.jackson.module:jackson-module-jsonSchema:2.12.4 - javax.validation:validation-api:1.1.0.Final \ No newline at end of file diff --git a/flink-shaded-jackson-parent/pom.xml b/flink-shaded-jackson-parent/pom.xml index 6ee2f0b..6218798 100644 --- a/flink-shaded-jackson-parent/pom.xml +++ b/flink-shaded-jackson-parent/pom.xml @@ -32,10 +32,10 @@ under the License. flink-shaded-jackson-parent flink-shaded-jackson-parent pom -2.12.1-14.0 +2.12.4-14.0 -2.12.1 +2.12.4
[flink-shaded] 02/02: [FLINK-23291] Bump snakeyaml to 1.29
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/flink-shaded.git commit f35e3f951f6e813a07afd015beba084696e34b48 Author: Chesnay Schepler AuthorDate: Wed Jul 7 11:21:16 2021 +0200 [FLINK-23291] Bump snakeyaml to 1.29 --- flink-shaded-jackson-parent/flink-shaded-jackson-2/pom.xml | 2 +- .../flink-shaded-jackson-2/src/main/resources/META-INF/NOTICE | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/flink-shaded-jackson-parent/flink-shaded-jackson-2/pom.xml b/flink-shaded-jackson-parent/flink-shaded-jackson-2/pom.xml index eb7716c..d18571b 100644 --- a/flink-shaded-jackson-parent/flink-shaded-jackson-2/pom.xml +++ b/flink-shaded-jackson-parent/flink-shaded-jackson-2/pom.xml @@ -62,7 +62,7 @@ under the License. org.yaml snakeyaml -1.27 +1.29 diff --git a/flink-shaded-jackson-parent/flink-shaded-jackson-2/src/main/resources/META-INF/NOTICE b/flink-shaded-jackson-parent/flink-shaded-jackson-2/src/main/resources/META-INF/NOTICE index 36a7c65..a0e1750 100644 --- a/flink-shaded-jackson-parent/flink-shaded-jackson-2/src/main/resources/META-INF/NOTICE +++ b/flink-shaded-jackson-parent/flink-shaded-jackson-2/src/main/resources/META-INF/NOTICE @@ -11,4 +11,4 @@ This project bundles the following dependencies under the Apache Software Licens - com.fasterxml.jackson.core:jackson-databind:2.12.4 - com.fasterxml.jackson.dataformat:jackson-dataformat-csv:2.12.4 - com.fasterxml.jackson.dataformat:jackson-dataformat-yaml:2.12.4 -- org.yaml:snakeyaml:1.27 +- org.yaml:snakeyaml:1.29
[flink-shaded] branch master updated (5782380 -> f35e3f9)
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink-shaded.git. from 5782380 [FLINK-23326] Bump guava to 30.1.1-jre new 9fc48b1 [FLINK-23291] Bump jackson to 2.12.4 new f35e3f9 [FLINK-23291] Bump snakeyaml to 1.29 The 2 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: flink-shaded-jackson-parent/flink-shaded-jackson-2/pom.xml | 4 ++-- .../src/main/resources/META-INF/NOTICE | 12 ++-- .../flink-shaded-jackson-module-jsonSchema-2/pom.xml | 2 +- .../src/main/resources/META-INF/NOTICE | 8 flink-shaded-jackson-parent/pom.xml | 4 ++-- 5 files changed, 15 insertions(+), 15 deletions(-)
[flink-shaded] branch master updated: [FLINK-23326] Bump guava to 30.1.1-jre
This is an automated email from the ASF dual-hosted git repository.
chesnay pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/flink-shaded.git
The following commit(s) were added to refs/heads/master by this push:
new 5782380 [FLINK-23326] Bump guava to 30.1.1-jre
5782380 is described below
commit 5782380675a0bcfb85031e9985a9bd4ae5f19259
Author: Chesnay Schepler
AuthorDate: Wed Jul 7 11:40:21 2021 +0200
[FLINK-23326] Bump guava to 30.1.1-jre
---
flink-shaded-guava-18/pom.xml| 11 +--
flink-shaded-guava-18/src/main/resources/META-INF/NOTICE | 3 ++-
2 files changed, 11 insertions(+), 3 deletions(-)
diff --git a/flink-shaded-guava-18/pom.xml b/flink-shaded-guava-18/pom.xml
index a585fa4..140df56 100644
--- a/flink-shaded-guava-18/pom.xml
+++ b/flink-shaded-guava-18/pom.xml
@@ -36,7 +36,7 @@ under the License.
jar
-18.0
+30.1.1-jre
@@ -44,6 +44,13 @@ under the License.
com.google.guava
guava
${guava.version}
+
+
+
+com.google.guava
+listenablefuture
+
+
@@ -70,7 +77,7 @@ under the License.
com.google
-
${shading.prefix}.guava18.com.google
+
${shading.prefix}.guava30.com.google
diff --git a/flink-shaded-guava-18/src/main/resources/META-INF/NOTICE
b/flink-shaded-guava-18/src/main/resources/META-INF/NOTICE
index 9af6155..0daf6e3 100644
--- a/flink-shaded-guava-18/src/main/resources/META-INF/NOTICE
+++ b/flink-shaded-guava-18/src/main/resources/META-INF/NOTICE
@@ -6,4 +6,5 @@ The Apache Software Foundation (http://www.apache.org/).
This project bundles the following dependencies under the Apache Software
License 2.0 (http://www.apache.org/licenses/LICENSE-2.0.txt)
-- com.google.guava:guava:18.0
\ No newline at end of file
+- com.google.guava:guava:30.1.1-jre
+- com.google.guava:failureaccess:1.0.1
\ No newline at end of file
[flink] branch release-1.12 updated (09ac6e5 -> e280421)
This is an automated email from the ASF dual-hosted git repository. trohrmann pushed a change to branch release-1.12 in repository https://gitbox.apache.org/repos/asf/flink.git. from 09ac6e5 [FLINK-23074][connector-hive] Shade parquet class in hive-exec to prevent conflict with flink-parquet module add e280421 [FLINK-22819][yarn] Remove 'yarn.am.liveness-monitor.expiry-interval-ms' override for tests. No new revisions were added by this update. Summary of changes: .../src/test/java/org/apache/flink/yarn/YarnTestBase.java | 4 1 file changed, 4 deletions(-)
[flink] branch release-1.13 updated: [FLINK-22819][yarn] Remove 'yarn.am.liveness-monitor.expiry-interval-ms' override for tests.
This is an automated email from the ASF dual-hosted git repository.
trohrmann pushed a commit to branch release-1.13
in repository https://gitbox.apache.org/repos/asf/flink.git
The following commit(s) were added to refs/heads/release-1.13 by this push:
new 3708cc4 [FLINK-22819][yarn] Remove
'yarn.am.liveness-monitor.expiry-interval-ms' override for tests.
3708cc4 is described below
commit 3708cc4cf9382f18e2f8e48b91d7c7dac74d607b
Author: David Moravek
AuthorDate: Wed Jul 7 15:27:07 2021 +0200
[FLINK-22819][yarn] Remove 'yarn.am.liveness-monitor.expiry-interval-ms'
override for tests.
This is an interval between AM container allocation and actually running RM
Client inside this container,
which can take longer in resource limited environment such as CI. If
heartbeats between AM and RM don't
work and a test relies on this, then it will fail a bit later because the
default value is 5 minutes.
This closes #16413.
---
.../src/test/java/org/apache/flink/yarn/YarnTestBase.java | 4
1 file changed, 4 deletions(-)
diff --git
a/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YarnTestBase.java
b/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YarnTestBase.java
index da334c9..b4dc3d3 100644
--- a/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YarnTestBase.java
+++ b/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YarnTestBase.java
@@ -217,12 +217,8 @@ public abstract class YarnTestBase extends TestLogger {
YARN_CONFIGURATION.setInt(
YarnConfiguration.NM_VCORES, 666); // memory is overwritten in
the MiniYARNCluster.
// so we have to change the number of cores for testing.
-YARN_CONFIGURATION.setInt(
-YarnConfiguration.RM_AM_EXPIRY_INTERVAL_MS,
-2); // 20 seconds expiry (to ensure we properly heartbeat
with YARN).
YARN_CONFIGURATION.setFloat(
YarnConfiguration.NM_MAX_PER_DISK_UTILIZATION_PERCENTAGE,
99.0F);
-
YARN_CONFIGURATION.set(YarnConfiguration.YARN_APPLICATION_CLASSPATH,
getYarnClasspath());
}
[flink] branch master updated: [FLINK-22819][yarn] Remove 'yarn.am.liveness-monitor.expiry-interval-ms' override for tests.
This is an automated email from the ASF dual-hosted git repository.
trohrmann pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/flink.git
The following commit(s) were added to refs/heads/master by this push:
new 9b4fc49 [FLINK-22819][yarn] Remove
'yarn.am.liveness-monitor.expiry-interval-ms' override for tests.
9b4fc49 is described below
commit 9b4fc49a44920b6d94b8e69a98f3f725e6b63c22
Author: David Moravek
AuthorDate: Wed Jul 7 15:27:07 2021 +0200
[FLINK-22819][yarn] Remove 'yarn.am.liveness-monitor.expiry-interval-ms'
override for tests.
This is an interval between AM container allocation and actually running RM
Client inside this container,
which can take longer in resource limited environment such as CI. If
heartbeats between AM and RM don't
work and a test relies on this, then it will fail a bit later because the
default value is 5 minutes.
This closes #16413.
---
.../src/test/java/org/apache/flink/yarn/YarnTestBase.java | 4
1 file changed, 4 deletions(-)
diff --git
a/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YarnTestBase.java
b/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YarnTestBase.java
index da334c9..b4dc3d3 100644
--- a/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YarnTestBase.java
+++ b/flink-yarn-tests/src/test/java/org/apache/flink/yarn/YarnTestBase.java
@@ -217,12 +217,8 @@ public abstract class YarnTestBase extends TestLogger {
YARN_CONFIGURATION.setInt(
YarnConfiguration.NM_VCORES, 666); // memory is overwritten in
the MiniYARNCluster.
// so we have to change the number of cores for testing.
-YARN_CONFIGURATION.setInt(
-YarnConfiguration.RM_AM_EXPIRY_INTERVAL_MS,
-2); // 20 seconds expiry (to ensure we properly heartbeat
with YARN).
YARN_CONFIGURATION.setFloat(
YarnConfiguration.NM_MAX_PER_DISK_UTILIZATION_PERCENTAGE,
99.0F);
-
YARN_CONFIGURATION.set(YarnConfiguration.YARN_APPLICATION_CLASSPATH,
getYarnClasspath());
}
[flink] branch master updated (8319bf4 -> f2eb655)
This is an automated email from the ASF dual-hosted git repository. roman pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from 8319bf4 [FLINK-23223] Notifies if there are available data on resumption for pipelined subpartition add a3405df [hotfix][state/ttl] Don't wrap with TTL twice add f2eb655 [FLINK-23277][state/changelog] Store and recover TTL metadata using changelog No new revisions were added by this update. Summary of changes: .../flink/runtime/state/ttl/TtlStateFactory.java | 46 +++--- .../apache/flink/runtime/state/ttl/TtlValue.java | 3 ++ .../state/changelog/AbstractStateChangeLogger.java | 17 +++- .../changelog/ChangelogKeyedStateBackend.java | 32 +++ .../state/changelog/KvStateChangeLoggerImpl.java | 6 ++- .../PriorityQueueStateChangeLoggerImpl.java| 3 +- .../restore/ChangelogBackendLogApplier.java| 34 ++-- .../changelog/KvStateChangeLoggerImplTest.java | 9 - 8 files changed, 119 insertions(+), 31 deletions(-)
[flink-jira-bot] branch master updated: [hotfix] dont warn on tickets that already have the warning label
This is an automated email from the ASF dual-hosted git repository.
knaufk pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/flink-jira-bot.git
The following commit(s) were added to refs/heads/master by this push:
new bc37608 [hotfix] dont warn on tickets that already have the warning
label
new ee516a3 Merge pull request #22 from knaufk/hotfix-blocker-issues
bc37608 is described below
commit bc376084c6c76a4d0fd578e526d2930977461e54
Author: Konstantin Knauf
AuthorDate: Fri Jul 9 12:26:05 2021 +0200
[hotfix] dont warn on tickets that already have the warning label
---
stale_assigned_rule.py | 2 +-
stale_major_or_above_rule.py | 3 ++-
stale_minor_rule.py | 3 ++-
3 files changed, 5 insertions(+), 3 deletions(-)
diff --git a/stale_assigned_rule.py b/stale_assigned_rule.py
index dd87598..ecbc3d3 100644
--- a/stale_assigned_rule.py
+++ b/stale_assigned_rule.py
@@ -37,7 +37,7 @@ class StaleAssignedRule(FlinkJiraRule):
)
self.mark_stale_tickets_stale(
f"project = FLINK AND resolution = Unresolved AND assignee is not
EMPTY "
-f"AND updated < startOfDay(-{self.stale_days}d)"
+f'AND updated < startOfDay(-{self.stale_days}d) AND NOT labels in
("{self.warning_label}")'
)
def handle_stale_ticket(self, key, warning_label, done_label, comment):
diff --git a/stale_major_or_above_rule.py b/stale_major_or_above_rule.py
index c309f17..c0f8123 100644
--- a/stale_major_or_above_rule.py
+++ b/stale_major_or_above_rule.py
@@ -43,7 +43,8 @@ class StaleMajorOrAboveRule(FlinkJiraRule):
)
self.mark_stale_tickets_stale(
f'project=FLINK AND type != "Sub-Task" AND priority =
{self.priority} AND resolution = Unresolved '
-f"AND assignee is empty AND updated <
startOfDay(-{self.stale_days}d) AND fixVersion = null"
+f'AND assignee is empty AND updated <
startOfDay(-{self.stale_days}d) AND fixVersion = null AND NOT labels '
+f'in ("{self.warning_label}")'
)
def handle_stale_ticket(self, key, warning_label, done_label, comment):
diff --git a/stale_minor_rule.py b/stale_minor_rule.py
index 4056219..35e9c49 100644
--- a/stale_minor_rule.py
+++ b/stale_minor_rule.py
@@ -39,7 +39,8 @@ class StaleMinorRule(FlinkJiraRule):
)
self.mark_stale_tickets_stale(
f'project = FLINK AND type != "Sub-Task" AND Priority = Minor AND
resolution = Unresolved '
-f"AND updated < startOfDay(-{self.stale_days}d) AND fixVersion =
null"
+f'AND updated < startOfDay(-{self.stale_days}d) AND fixVersion =
null AND NOT labels in '
+f'("{self.warning_label}")'
)
def handle_stale_ticket(self, key, warning_label, done_label, comment):
[flink] branch master updated: [FLINK-23223] Notifies if there are available data on resumption for pipelined subpartition
This is an automated email from the ASF dual-hosted git repository.
pnowojski pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/flink.git
The following commit(s) were added to refs/heads/master by this push:
new 8319bf4 [FLINK-23223] Notifies if there are available data on
resumption for pipelined subpartition
8319bf4 is described below
commit 8319bf44b1561a4b69851b105fd379dec161e675
Author: Yun Gao
AuthorDate: Sun Jul 4 22:17:42 2021 +0800
[FLINK-23223] Notifies if there are available data on resumption for
pipelined subpartition
---
.../network/partition/PipelinedSubpartition.java | 9 ++---
.../PipelinedSubpartitionWithReadViewTest.java | 47 ++
.../partition/consumer/LocalInputChannelTest.java | 37 +
3 files changed, 81 insertions(+), 12 deletions(-)
diff --git
a/flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/PipelinedSubpartition.java
b/flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/PipelinedSubpartition.java
index e13f413..134ef68 100644
---
a/flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/PipelinedSubpartition.java
+++
b/flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/PipelinedSubpartition.java
@@ -463,11 +463,10 @@ public class PipelinedSubpartition extends
ResultSubpartition
}
// if there is more then 1 buffer, we already notified the reader
// (at the latest when adding the second buffer)
-notifyDataAvailable =
-!isBlocked
-&& buffers.size() == 1
-&&
buffers.peek().getBufferConsumer().isDataAvailable();
-flushRequested = buffers.size() > 1 || notifyDataAvailable;
+boolean isDataAvailableInUnfinishedBuffer =
+buffers.size() == 1 &&
buffers.peek().getBufferConsumer().isDataAvailable();
+notifyDataAvailable = !isBlocked &&
isDataAvailableInUnfinishedBuffer;
+flushRequested = buffers.size() > 1 ||
isDataAvailableInUnfinishedBuffer;
}
if (notifyDataAvailable) {
notifyDataAvailable();
diff --git
a/flink-runtime/src/test/java/org/apache/flink/runtime/io/network/partition/PipelinedSubpartitionWithReadViewTest.java
b/flink-runtime/src/test/java/org/apache/flink/runtime/io/network/partition/PipelinedSubpartitionWithReadViewTest.java
index 972455b..de1b32b 100644
---
a/flink-runtime/src/test/java/org/apache/flink/runtime/io/network/partition/PipelinedSubpartitionWithReadViewTest.java
+++
b/flink-runtime/src/test/java/org/apache/flink/runtime/io/network/partition/PipelinedSubpartitionWithReadViewTest.java
@@ -487,8 +487,7 @@ public class PipelinedSubpartitionWithReadViewTest {
}
@Test
-public void testBlockedByCheckpointAndResumeConsumption()
-throws IOException, InterruptedException {
+public void testResumeBlockedSubpartitionWithEvents() throws IOException,
InterruptedException {
blockSubpartitionByCheckpoint(1);
// add an event after subpartition blocked
@@ -496,33 +495,67 @@ public class PipelinedSubpartitionWithReadViewTest {
// no data available notification after adding an event
checkNumNotificationsAndAvailability(1);
+// Resumption will make the subpartition available.
resumeConsumptionAndCheckAvailability(0, true);
assertNextEvent(readView, BUFFER_SIZE, null, false, 0, false, true);
+}
-blockSubpartitionByCheckpoint(2);
+@Test
+public void testResumeBlockedSubpartitionWithUnfinishedBufferFlushed()
+throws IOException, InterruptedException {
+blockSubpartitionByCheckpoint(1);
// add a buffer and flush the subpartition
subpartition.add(createFilledFinishedBufferConsumer(BUFFER_SIZE));
subpartition.flush();
// no data available notification after adding a buffer and flushing
the subpartition
-checkNumNotificationsAndAvailability(2);
+checkNumNotificationsAndAvailability(1);
-resumeConsumptionAndCheckAvailability(Integer.MAX_VALUE, false);
+// Resumption will make the subpartition available.
+resumeConsumptionAndCheckAvailability(Integer.MAX_VALUE, true);
assertNextBuffer(readView, BUFFER_SIZE, false, 0, false, true);
+}
+
+@Test
+public void testResumeBlockedSubpartitionWithUnfinishedBufferNotFlushed()
+throws IOException, InterruptedException {
+blockSubpartitionByCheckpoint(1);
+
+// add a buffer but not flush the subpartition.
+subpartition.add(createFilledFinishedBufferConsumer(BUFFER_SIZE));
+// no data available notification after adding a buffer.
+checkNumNotificationsAndAvailability(1);
+
+// Resumption will not make the subpartition available since the data
[flink-shaded] branch master updated: [FLINK-23325] Bump netty to 4.1.65
This is an automated email from the ASF dual-hosted git repository.
chesnay pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/flink-shaded.git
The following commit(s) were added to refs/heads/master by this push:
new 0dafc0b [FLINK-23325] Bump netty to 4.1.65
0dafc0b is described below
commit 0dafc0b3b7a7a436d65e054976c04d2a6dc05caf
Author: Chesnay Schepler
AuthorDate: Fri Jul 9 11:09:16 2021 +0200
[FLINK-23325] Bump netty to 4.1.65
---
flink-shaded-netty-4/pom.xml | 2 +-
.../src/main/resources/META-INF/NOTICE | 2 +-
flink-shaded-netty-tcnative-dynamic/pom.xml| 24 --
.../src/main/resources/META-INF/NOTICE | 2 +-
flink-shaded-netty-tcnative-static/pom.xml | 5 +++--
.../src/main/resources/META-INF/NOTICE | 2 +-
6 files changed, 15 insertions(+), 22 deletions(-)
diff --git a/flink-shaded-netty-4/pom.xml b/flink-shaded-netty-4/pom.xml
index 6adda76..5babbe4 100644
--- a/flink-shaded-netty-4/pom.xml
+++ b/flink-shaded-netty-4/pom.xml
@@ -34,7 +34,7 @@ under the License.
${netty.version}-14.0
-4.1.49.Final
+4.1.65.Final
diff --git a/flink-shaded-netty-4/src/main/resources/META-INF/NOTICE
b/flink-shaded-netty-4/src/main/resources/META-INF/NOTICE
index 06da558..2bbdc2f 100644
--- a/flink-shaded-netty-4/src/main/resources/META-INF/NOTICE
+++ b/flink-shaded-netty-4/src/main/resources/META-INF/NOTICE
@@ -6,4 +6,4 @@ The Apache Software Foundation (http://www.apache.org/).
This project bundles the following dependencies under the Apache Software
License 2.0 (http://www.apache.org/licenses/LICENSE-2.0.txt)
-- io.netty:netty-all:4.1.49.Final
+- io.netty:netty-all:4.1.65.Final
diff --git a/flink-shaded-netty-tcnative-dynamic/pom.xml
b/flink-shaded-netty-tcnative-dynamic/pom.xml
index db2626b..0032a34 100644
--- a/flink-shaded-netty-tcnative-dynamic/pom.xml
+++ b/flink-shaded-netty-tcnative-dynamic/pom.xml
@@ -34,7 +34,8 @@ under the License.
${netty.tcnative.version}-14.0
-2.0.30.Final
+
+2.0.39.Final
@@ -123,7 +124,7 @@ under the License.
io.netty
netty-tcnative
${netty.tcnative.version}
-windows-x86_64
+linux-aarch_64-fedora
jar
false
${project.build.directory}/native_libs
@@ -146,27 +147,18 @@ under the License.
-
-
-
-
-
-
-
-
-
-
-
+
-
+
-
+
+
-
+
diff --git
a/flink-shaded-netty-tcnative-dynamic/src/main/resources/META-INF/NOTICE
b/flink-shaded-netty-tcnative-dynamic/src/main/resources/META-INF/NOTICE
index b598d46..d10ef04 100644
--- a/flink-shaded-netty-tcnative-dynamic/src/main/resources/META-INF/NOTICE
+++ b/flink-shaded-netty-tcnative-dynamic/src/main/resources/META-INF/NOTICE
@@ -6,4 +6,4 @@ The Apache Software Foundation (http://www.apache.org/).
This project bundles the following dependencies under the Apache Software
License 2.0 (http://www.apache.org/licenses/LICENSE-2.0.txt)
-- io.netty:netty-tcnative:2.0.30.Final
+- io.netty:netty-tcnative:2.0.39.Final
diff --git a/flink-shaded-netty-tcnative-static/pom.xml
b/flink-shaded-netty-tcnative-static/pom.xml
index ccfcfbf..24b3961 100644
--- a/flink-shaded-netty-tcnative-static/pom.xml
+++ b/flink-shaded-netty-tcnative-static/pom.xml
@@ -34,7 +34,8 @@ under the License.
${netty.tcnative.version}-14.0
-2.0.30.Final
+
+2.0.39.Final
@@ -91,7 +92,7 @@ under the License.
-
+
[flink] branch master updated (b8ff60d -> 49f6d6f)
This is an automated email from the ASF dual-hosted git repository. dwysakowicz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from b8ff60d [FLINK-23262][tests] Check watermark frequency instead of count add ba58c62 [FLINK-23080][datastream] Introduce SinkFunction#finish() method. add 49f6d6f [FLINK-23080] Add finish() for the TwoPhaseCommitSink No new revisions were added by this update. Summary of changes: .../kafka/table/BufferedUpsertSinkFunction.java | 21 - .../streaming/api/functions/sink/SinkFunction.java | 16 .../functions/sink/TwoPhaseCommitSinkFunction.java | 15 +++ .../api/operators/AbstractUdfStreamOperator.java| 9 + 4 files changed, 52 insertions(+), 9 deletions(-)
[flink] branch master updated (f37cf25 -> b8ff60d)
This is an automated email from the ASF dual-hosted git repository. dwysakowicz pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from f37cf25 [FLINK-23306][table] Reduce usages of legacy TableSchema add b8ff60d [FLINK-23262][tests] Check watermark frequency instead of count No new revisions were added by this update. Summary of changes: .../streaming/api/FileReadingWatermarkITCase.java | 65 +++--- 1 file changed, 46 insertions(+), 19 deletions(-)
[flink] branch release-1.13 updated: [FLINK-23306][table] Reduce usages of legacy TableSchema
This is an automated email from the ASF dual-hosted git repository.
twalthr pushed a commit to branch release-1.13
in repository https://gitbox.apache.org/repos/asf/flink.git
The following commit(s) were added to refs/heads/release-1.13 by this push:
new 51e4ee2 [FLINK-23306][table] Reduce usages of legacy TableSchema
51e4ee2 is described below
commit 51e4ee24a48b475ce6e19b6c06c43c12d5dce42d
Author: Timo Walther
AuthorDate: Thu Jul 8 10:49:53 2021 +0200
[FLINK-23306][table] Reduce usages of legacy TableSchema
This closes #16425.
---
docs/content.zh/docs/dev/table/sourcesSinks.md | 3 ++-
docs/content/docs/dev/table/sourcesSinks.md| 3 ++-
.../table/examples/java/connectors/SocketDynamicTableFactory.java | 2 +-
.../java/org/apache/flink/table/factories/PrintTableSinkFactory.java | 2 +-
.../flink/table/planner/plan/metadata/FlinkRelMdUniqueKeys.scala | 2 +-
.../planner/plan/rules/physical/stream/StreamPhysicalSinkRule.scala| 2 +-
.../plan/rules/physical/stream/StreamPhysicalTableSourceScanRule.scala | 2 +-
7 files changed, 9 insertions(+), 7 deletions(-)
diff --git a/docs/content.zh/docs/dev/table/sourcesSinks.md
b/docs/content.zh/docs/dev/table/sourcesSinks.md
index b2932f5..666fa1b 100644
--- a/docs/content.zh/docs/dev/table/sourcesSinks.md
+++ b/docs/content.zh/docs/dev/table/sourcesSinks.md
@@ -452,7 +452,8 @@ public class SocketDynamicTableFactory implements
DynamicTableSourceFactory {
final byte byteDelimiter = (byte) (int) options.get(BYTE_DELIMITER);
// derive the produced data type (excluding computed columns) from the
catalog table
-final DataType producedDataType =
context.getCatalogTable().getSchema().toPhysicalRowDataType();
+final DataType producedDataType =
+
context.getCatalogTable().getResolvedSchema().toPhysicalRowDataType();
// create and return dynamic table source
return new SocketDynamicTableSource(hostname, port, byteDelimiter,
decodingFormat, producedDataType);
diff --git a/docs/content/docs/dev/table/sourcesSinks.md
b/docs/content/docs/dev/table/sourcesSinks.md
index b2932f5..666fa1b 100644
--- a/docs/content/docs/dev/table/sourcesSinks.md
+++ b/docs/content/docs/dev/table/sourcesSinks.md
@@ -452,7 +452,8 @@ public class SocketDynamicTableFactory implements
DynamicTableSourceFactory {
final byte byteDelimiter = (byte) (int) options.get(BYTE_DELIMITER);
// derive the produced data type (excluding computed columns) from the
catalog table
-final DataType producedDataType =
context.getCatalogTable().getSchema().toPhysicalRowDataType();
+final DataType producedDataType =
+
context.getCatalogTable().getResolvedSchema().toPhysicalRowDataType();
// create and return dynamic table source
return new SocketDynamicTableSource(hostname, port, byteDelimiter,
decodingFormat, producedDataType);
diff --git
a/flink-examples/flink-examples-table/src/main/java/org/apache/flink/table/examples/java/connectors/SocketDynamicTableFactory.java
b/flink-examples/flink-examples-table/src/main/java/org/apache/flink/table/examples/java/connectors/SocketDynamicTableFactory.java
index 0341466..f7c5603 100644
---
a/flink-examples/flink-examples-table/src/main/java/org/apache/flink/table/examples/java/connectors/SocketDynamicTableFactory.java
+++
b/flink-examples/flink-examples-table/src/main/java/org/apache/flink/table/examples/java/connectors/SocketDynamicTableFactory.java
@@ -95,7 +95,7 @@ public final class SocketDynamicTableFactory implements
DynamicTableSourceFactor
// derive the produced data type (excluding computed columns) from the
catalog table
final DataType producedDataType =
-context.getCatalogTable().getSchema().toPhysicalRowDataType();
+
context.getCatalogTable().getResolvedSchema().toPhysicalRowDataType();
// create and return dynamic table source
return new SocketDynamicTableSource(
diff --git
a/flink-table/flink-table-api-java-bridge/src/main/java/org/apache/flink/table/factories/PrintTableSinkFactory.java
b/flink-table/flink-table-api-java-bridge/src/main/java/org/apache/flink/table/factories/PrintTableSinkFactory.java
index e1393c5..01e1f52 100644
---
a/flink-table/flink-table-api-java-bridge/src/main/java/org/apache/flink/table/factories/PrintTableSinkFactory.java
+++
b/flink-table/flink-table-api-java-bridge/src/main/java/org/apache/flink/table/factories/PrintTableSinkFactory.java
@@ -95,7 +95,7 @@ public class PrintTableSinkFactory implements
DynamicTableSinkFactory {
helper.validate();
ReadableConfig options = helper.getOptions();
return new PrintSink(
-context.getCatalogTable().getSchema().toPhysicalRowDataType(),
+
context.getCatalogTable().getResolvedSchema().toPhysicalRowDataType(),
options.get(PRINT_IDENTIFIER),
[flink] branch master updated (31fcb6c -> f37cf25)
This is an automated email from the ASF dual-hosted git repository. twalthr pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git. from 31fcb6c [FLINK-22994][table-planner] Improve the performace of invoking nesting udf add f37cf25 [FLINK-23306][table] Reduce usages of legacy TableSchema No new revisions were added by this update. Summary of changes: docs/content.zh/docs/dev/table/sourcesSinks.md | 3 ++- docs/content/docs/dev/table/sourcesSinks.md| 3 ++- .../table/examples/java/connectors/SocketDynamicTableFactory.java | 2 +- .../java/org/apache/flink/table/factories/PrintTableSinkFactory.java | 2 +- .../flink/table/planner/plan/metadata/FlinkRelMdUniqueKeys.scala | 2 +- .../planner/plan/rules/physical/stream/StreamPhysicalSinkRule.scala| 2 +- .../plan/rules/physical/stream/StreamPhysicalTableSourceScanRule.scala | 2 +- 7 files changed, 9 insertions(+), 7 deletions(-)
