(flink-connector-kafka) annotated tag v3.1.0 updated (e51adab0 -> 62b9ab6a)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to annotated tag v3.1.0 in repository https://gitbox.apache.org/repos/asf/flink-connector-kafka.git *** WARNING: tag v3.1.0 was modified! *** from e51adab0 (commit) to 62b9ab6a (tag) tagging e51adab088107bc79a9f531a164d6397ad0361fc (commit) by Martijn Visser on Tue Feb 6 16:52:09 2024 +0100 - Log - v3.1.0 -BEGIN PGP SIGNATURE- iHUEABYKAB0WIQSl87zky+mTVz7FlmplMhuDgrIZrwUCZcJVqQAKCRBlMhuDgrIZ rx0GAQCyYo0jUeNiuY5S4xMmvP6SxIsKhbqVuYK02ivMihqN5AD/Q4/bbN3+gb3j A+K3ZrKkYUobvXlDTN7HfUxwpxXc0QM= =NXau -END PGP SIGNATURE- --- No new revisions were added by this update. Summary of changes:
svn commit: r66870 - in /dev/flink/flink-connector-kafka-3.1.0-rc1: ./ flink-connector-kafka-3.1.0-src.tgz flink-connector-kafka-3.1.0-src.tgz.asc flink-connector-kafka-3.1.0-src.tgz.sha512
Author: martijnvisser Date: Fri Jan 26 12:46:16 2024 New Revision: 66870 Log: Add flink-connector-kafka-3.1.0-rc1 Added: dev/flink/flink-connector-kafka-3.1.0-rc1/ dev/flink/flink-connector-kafka-3.1.0-rc1/flink-connector-kafka-3.1.0-src.tgz (with props) dev/flink/flink-connector-kafka-3.1.0-rc1/flink-connector-kafka-3.1.0-src.tgz.asc dev/flink/flink-connector-kafka-3.1.0-rc1/flink-connector-kafka-3.1.0-src.tgz.sha512 Added: dev/flink/flink-connector-kafka-3.1.0-rc1/flink-connector-kafka-3.1.0-src.tgz == Binary file - no diff available. Propchange: dev/flink/flink-connector-kafka-3.1.0-rc1/flink-connector-kafka-3.1.0-src.tgz -- svn:mime-type = application/octet-stream Added: dev/flink/flink-connector-kafka-3.1.0-rc1/flink-connector-kafka-3.1.0-src.tgz.asc == --- dev/flink/flink-connector-kafka-3.1.0-rc1/flink-connector-kafka-3.1.0-src.tgz.asc (added) +++ dev/flink/flink-connector-kafka-3.1.0-rc1/flink-connector-kafka-3.1.0-src.tgz.asc Fri Jan 26 12:46:16 2024 @@ -0,0 +1,7 @@ +-BEGIN PGP SIGNATURE- + +iHUEABYKAB0WIQSl87zky+mTVz7FlmplMhuDgrIZrwUCZbOpigAKCRBlMhuDgrIZ +r8sIAQDw76byYXsD6bOBtSxnYG/3CouFyK71QMmvwIaGzqSqTAEA7nEy4henvc2o +IxqiB5BC+lW0iMC6jhmoGbm28t8UZw8= +=HDz2 +-END PGP SIGNATURE- Added: dev/flink/flink-connector-kafka-3.1.0-rc1/flink-connector-kafka-3.1.0-src.tgz.sha512 == --- dev/flink/flink-connector-kafka-3.1.0-rc1/flink-connector-kafka-3.1.0-src.tgz.sha512 (added) +++ dev/flink/flink-connector-kafka-3.1.0-rc1/flink-connector-kafka-3.1.0-src.tgz.sha512 Fri Jan 26 12:46:16 2024 @@ -0,0 +1 @@ +49a416ec8a4e11a117718aba7c7b6787238c9bf77cfba9cee327789048a4f54e63789c84525223e77b0da3dd23c4fd3c54fdba0b52cd53e1f38a699fb0aebe9e flink-connector-kafka-3.1.0-src.tgz
(flink-connector-kafka) annotated tag v3.1.0-rc1 updated (e51adab0 -> 87b8d74d)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to annotated tag v3.1.0-rc1 in repository https://gitbox.apache.org/repos/asf/flink-connector-kafka.git *** WARNING: tag v3.1.0-rc1 was modified! *** from e51adab0 (commit) to 87b8d74d (tag) tagging e51adab088107bc79a9f531a164d6397ad0361fc (commit) by Martijn Visser on Fri Jan 26 13:45:49 2024 +0100 - Log - v3.1.0-rc1 -BEGIN PGP SIGNATURE- iHUEABYKAB0WIQSl87zky+mTVz7FlmplMhuDgrIZrwUCZbOpfQAKCRBlMhuDgrIZ r8nJAPkBkvWnBHA9VmBmsrKwWMpqC+o9tYKBrz7m2X4wO2+ZuwD+Ix3RJooTETXF n405Q4alRNDgu+lvTu+h3QIwYZL5PQc= =GlB2 -END PGP SIGNATURE- --- No new revisions were added by this update. Summary of changes:
(flink-connector-kafka) branch v3.0 updated: [hotfix] Update copyright year to 2024
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a commit to branch v3.0 in repository https://gitbox.apache.org/repos/asf/flink-connector-kafka.git The following commit(s) were added to refs/heads/v3.0 by this push: new b4586db6 [hotfix] Update copyright year to 2024 b4586db6 is described below commit b4586db64c5b429cbfe1dd7ce0db404a6bade94c Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com> AuthorDate: Fri Jan 26 13:43:46 2024 +0100 [hotfix] Update copyright year to 2024 (cherry picked from commit 624f0a13c81dcbfc5f6c2b05a088a23e4c04e1f8) --- NOTICE | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/NOTICE b/NOTICE index 1914984d..a0ed0194 100644 --- a/NOTICE +++ b/NOTICE @@ -1,5 +1,5 @@ Apache Flink Kafka Connector -Copyright 2014-2023 The Apache Software Foundation +Copyright 2014-2024 The Apache Software Foundation This product includes software developed at The Apache Software Foundation (http://www.apache.org/).
(flink-connector-kafka) branch v3.1 updated: [hotfix] Update copyright year to 2024
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a commit to branch v3.1 in repository https://gitbox.apache.org/repos/asf/flink-connector-kafka.git The following commit(s) were added to refs/heads/v3.1 by this push: new e2584991 [hotfix] Update copyright year to 2024 e2584991 is described below commit e25849911c119eca0a5af9dfc98491e6191df59f Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com> AuthorDate: Fri Jan 26 13:43:46 2024 +0100 [hotfix] Update copyright year to 2024 (cherry picked from commit 624f0a13c81dcbfc5f6c2b05a088a23e4c04e1f8) --- NOTICE | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/NOTICE b/NOTICE index 1914984d..a0ed0194 100644 --- a/NOTICE +++ b/NOTICE @@ -1,5 +1,5 @@ Apache Flink Kafka Connector -Copyright 2014-2023 The Apache Software Foundation +Copyright 2014-2024 The Apache Software Foundation This product includes software developed at The Apache Software Foundation (http://www.apache.org/).
(flink-connector-kafka) branch main updated: [hotfix] Update copyright year to 2024
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-kafka.git The following commit(s) were added to refs/heads/main by this push: new 624f0a13 [hotfix] Update copyright year to 2024 624f0a13 is described below commit 624f0a13c81dcbfc5f6c2b05a088a23e4c04e1f8 Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com> AuthorDate: Fri Jan 26 13:43:46 2024 +0100 [hotfix] Update copyright year to 2024 --- NOTICE | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/NOTICE b/NOTICE index 1914984d..a0ed0194 100644 --- a/NOTICE +++ b/NOTICE @@ -1,5 +1,5 @@ Apache Flink Kafka Connector -Copyright 2014-2023 The Apache Software Foundation +Copyright 2014-2024 The Apache Software Foundation This product includes software developed at The Apache Software Foundation (http://www.apache.org/).
(flink-connector-kafka) annotated tag v3.1.0-rc1 deleted (was b28baaff)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to annotated tag v3.1.0-rc1 in repository https://gitbox.apache.org/repos/asf/flink-connector-kafka.git *** WARNING: tag v3.1.0-rc1 was deleted! *** tag was b28baaff This change permanently discards the following revisions: discard 4d298aba Update version to 3.1.0
svn commit: r66869 - /dev/flink/flink-connector-kafka-3.1.0-rc1/
Author: martijnvisser Date: Fri Jan 26 12:42:37 2024 New Revision: 66869 Log: [Revert] Delete https://dist.apache.org/repos/dist/dev/flink/flink-connector-kafka-3.1.0-rc1 Removed: dev/flink/flink-connector-kafka-3.1.0-rc1/
svn commit: r66867 - in /dev/flink/flink-connector-kafka-3.1.0-rc1: ./ flink-connector-kafka-3.1.0-src.tgz flink-connector-kafka-3.1.0-src.tgz.asc flink-connector-kafka-3.1.0-src.tgz.sha512
Author: martijnvisser Date: Fri Jan 26 12:38:35 2024 New Revision: 66867 Log: Add flink-connector-kafka-3.1.0-rc1 Added: dev/flink/flink-connector-kafka-3.1.0-rc1/ dev/flink/flink-connector-kafka-3.1.0-rc1/flink-connector-kafka-3.1.0-src.tgz (with props) dev/flink/flink-connector-kafka-3.1.0-rc1/flink-connector-kafka-3.1.0-src.tgz.asc dev/flink/flink-connector-kafka-3.1.0-rc1/flink-connector-kafka-3.1.0-src.tgz.sha512 Added: dev/flink/flink-connector-kafka-3.1.0-rc1/flink-connector-kafka-3.1.0-src.tgz == Binary file - no diff available. Propchange: dev/flink/flink-connector-kafka-3.1.0-rc1/flink-connector-kafka-3.1.0-src.tgz -- svn:mime-type = application/octet-stream Added: dev/flink/flink-connector-kafka-3.1.0-rc1/flink-connector-kafka-3.1.0-src.tgz.asc == --- dev/flink/flink-connector-kafka-3.1.0-rc1/flink-connector-kafka-3.1.0-src.tgz.asc (added) +++ dev/flink/flink-connector-kafka-3.1.0-rc1/flink-connector-kafka-3.1.0-src.tgz.asc Fri Jan 26 12:38:35 2024 @@ -0,0 +1,7 @@ +-BEGIN PGP SIGNATURE- + +iHUEABYKAB0WIQSl87zky+mTVz7FlmplMhuDgrIZrwUCZbOnvgAKCRBlMhuDgrIZ +r8odAQC3mkx2S2i0ufkTqjl0aBDiWdLhA/pwShvYNcIcYzSXkgD9GORRY7Z322J1 +TbeyUtnqqdAbhlL4h01pig3KhBDBfgU= +=rORw +-END PGP SIGNATURE- Added: dev/flink/flink-connector-kafka-3.1.0-rc1/flink-connector-kafka-3.1.0-src.tgz.sha512 == --- dev/flink/flink-connector-kafka-3.1.0-rc1/flink-connector-kafka-3.1.0-src.tgz.sha512 (added) +++ dev/flink/flink-connector-kafka-3.1.0-rc1/flink-connector-kafka-3.1.0-src.tgz.sha512 Fri Jan 26 12:38:35 2024 @@ -0,0 +1 @@ +2ae25010687d8ee0f0b844bf3ec53c98f31d97df9feafd59d127432154c51009a37471d3bfa522b90556acf8cb9a01bd1259adad194da0aebdf5543793f1aa5f flink-connector-kafka-3.1.0-src.tgz
(flink-connector-kafka) annotated tag v3.1.0-rc1 updated (4d298aba -> b28baaff)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to annotated tag v3.1.0-rc1 in repository https://gitbox.apache.org/repos/asf/flink-connector-kafka.git *** WARNING: tag v3.1.0-rc1 was modified! *** from 4d298aba (commit) to b28baaff (tag) tagging 4d298abafbb117cb1093c885e73d55ba31c2261f (commit) by Martijn Visser on Fri Jan 26 13:38:08 2024 +0100 - Log - v3.1.0-rc1 -BEGIN PGP SIGNATURE- iHUEABYKAB0WIQSl87zky+mTVz7FlmplMhuDgrIZrwUCZbOnsAAKCRBlMhuDgrIZ r5EUAQDS0XeEfP0p9NFALM3UIUehWGoi6X04VKt44w6annznSwD+LyKzrYzfJJVF 2y9xjp3EujVNFSeQPyN9FZcA0DY0rAw= =hvB7 -END PGP SIGNATURE- --- No new revisions were added by this update. Summary of changes:
(flink-connector-kafka) branch main updated: [hotfix] Add missing JDK17 test for 1.18 against v3.1
This is an automated email from the ASF dual-hosted git repository.
martijnvisser pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/flink-connector-kafka.git
The following commit(s) were added to refs/heads/main by this push:
new a468c2b7 [hotfix] Add missing JDK17 test for 1.18 against v3.1
a468c2b7 is described below
commit a468c2b766acf8d8cdaa4f64122497632cdaaf39
Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com>
AuthorDate: Fri Jan 26 13:04:03 2024 +0100
[hotfix] Add missing JDK17 test for 1.18 against v3.1
---
.github/workflows/weekly.yml | 1 +
1 file changed, 1 insertion(+)
diff --git a/.github/workflows/weekly.yml b/.github/workflows/weekly.yml
index 8d23c79d..21462eb7 100644
--- a/.github/workflows/weekly.yml
+++ b/.github/workflows/weekly.yml
@@ -38,6 +38,7 @@ jobs:
branch: v3.1
}, {
flink: 1.18.1,
+ jdk: '8, 11, 17',
branch: v3.1
}, {
flink: 1.17.2,
(flink-connector-kafka) branch main updated: [hotfix] Remove weekly test against 1.19-SNAPSHOT since that's currently broken and tracked under FLINK-34193
This is an automated email from the ASF dual-hosted git repository.
martijnvisser pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/flink-connector-kafka.git
The following commit(s) were added to refs/heads/main by this push:
new 68ac980b [hotfix] Remove weekly test against 1.19-SNAPSHOT since
that's currently broken and tracked under FLINK-34193
68ac980b is described below
commit 68ac980b777593f4a14489e93684f3b4e9a1922b
Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com>
AuthorDate: Fri Jan 26 13:02:26 2024 +0100
[hotfix] Remove weekly test against 1.19-SNAPSHOT since that's currently
broken and tracked under FLINK-34193
---
.github/workflows/weekly.yml | 4
1 file changed, 4 deletions(-)
diff --git a/.github/workflows/weekly.yml b/.github/workflows/weekly.yml
index 850ca5b2..8d23c79d 100644
--- a/.github/workflows/weekly.yml
+++ b/.github/workflows/weekly.yml
@@ -33,10 +33,6 @@ jobs:
flink: 1.18-SNAPSHOT,
jdk: '8, 11, 17',
branch: main
-}, {
- flink: 1.19-SNAPSHOT,
- jdk: '8, 11, 17, 21',
- branch: main
}, {
flink: 1.17.2,
branch: v3.1
(flink-connector-kafka) branch main updated: [release] Update weekly CI to check against new release branch `v3.1`
This is an automated email from the ASF dual-hosted git repository.
martijnvisser pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/flink-connector-kafka.git
The following commit(s) were added to refs/heads/main by this push:
new fd7b46c5 [release] Update weekly CI to check against new release
branch `v3.1`
fd7b46c5 is described below
commit fd7b46c5431ba9e384543f7fe7a1ad9f45030f2b
Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com>
AuthorDate: Fri Jan 26 13:00:30 2024 +0100
[release] Update weekly CI to check against new release branch `v3.1`
---
.github/workflows/weekly.yml | 10 --
1 file changed, 8 insertions(+), 2 deletions(-)
diff --git a/.github/workflows/weekly.yml b/.github/workflows/weekly.yml
index e6bf27dd..850ca5b2 100644
--- a/.github/workflows/weekly.yml
+++ b/.github/workflows/weekly.yml
@@ -38,10 +38,16 @@ jobs:
jdk: '8, 11, 17, 21',
branch: main
}, {
- flink: 1.17.1,
+ flink: 1.17.2,
+ branch: v3.1
+}, {
+ flink: 1.18.1,
+ branch: v3.1
+}, {
+ flink: 1.17.2,
branch: v3.0
}, {
- flink: 1.18.0,
+ flink: 1.18.1,
branch: v3.0
}]
uses: apache/flink-connector-shared-utils/.github/workflows/ci.yml@ci_utils
(flink-connector-kafka) branch v3.1 created (now 4f300991)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to branch v3.1 in repository https://gitbox.apache.org/repos/asf/flink-connector-kafka.git at 4f300991 [FLINK-32417] Add DynamicKafkaSource documentation for setter methods, metrics, and config options. This closes #80 No new revisions were added by this update.
(flink-connector-kafka) branch main updated: [FLINK-32417] Add DynamicKafkaSource documentation for setter methods, metrics, and config options. This closes #80
This is an automated email from the ASF dual-hosted git repository.
martijnvisser pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/flink-connector-kafka.git
The following commit(s) were added to refs/heads/main by this push:
new 4f300991 [FLINK-32417] Add DynamicKafkaSource documentation for setter
methods, metrics, and config options. This closes #80
4f300991 is described below
commit 4f30099135fe68e412b4fc18d34c085d654c471e
Author: Mason Chen
AuthorDate: Thu Jan 25 13:56:04 2024 -0800
[FLINK-32417] Add DynamicKafkaSource documentation for setter methods,
metrics, and config options. This closes #80
---
.../docs/connectors/datastream/dynamic-kafka.md| 248 +
.../docs/connectors/table/dynamic-kafka.md | 141
.../docs/connectors/datastream/dynamic-kafka.md| 137 ++--
.../dynamic/source/DynamicKafkaSourceOptions.java | 4 +-
4 files changed, 372 insertions(+), 158 deletions(-)
diff --git a/docs/content.zh/docs/connectors/datastream/dynamic-kafka.md
b/docs/content.zh/docs/connectors/datastream/dynamic-kafka.md
new file mode 100644
index ..e46adca3
--- /dev/null
+++ b/docs/content.zh/docs/connectors/datastream/dynamic-kafka.md
@@ -0,0 +1,248 @@
+---
+title: Dynamic Kafka
+weight: 3
+type: docs
+aliases:
+- /dev/connectors/dynamic-kafka.html
+---
+
+
+# Dynamic Kafka Source _`Experimental`_
+
+Flink provides an [Apache Kafka](https://kafka.apache.org) connector for
reading data from Kafka topics from one or more Kafka clusters.
+The Dynamic Kafka connector discovers the clusters and topics using a Kafka
metadata service and can achieve reading in a dynamic fashion, facilitating
changes in
+topics and/or clusters, without requiring a job restart. This is especially
useful when you need to read a new Kafka cluster/topic and/or stop reading
+an existing Kafka cluster/topic (cluster migration/failover/other
infrastructure changes) and when you need direct integration with Hybrid
Source. The solution
+makes these operations automated so that they are transparent to Kafka
consumers.
+
+## Dependency
+
+For details on Kafka compatibility, please refer to the official [Kafka
documentation](https://kafka.apache.org/protocol.html#protocol_compatibility).
+
+{{< connector_artifact flink-connector-kafka 3.1.0 >}}
+
+Flink's streaming connectors are not part of the binary distribution.
+See how to link with them for cluster execution [here]({{< ref
"docs/dev/configuration/overview" >}}).
+
+## Dynamic Kafka Source
+{{< hint info >}}
+This part describes the Dynamic Kafka Source based on the new
+[data source]({{< ref "docs/dev/datastream/sources.md" >}}) API.
+{{< /hint >}}
+
+### Usage
+
+Dynamic Kafka Source provides a builder class to initialize the
DynamicKafkaSource. The code snippet
+below shows how to build a DynamicKafkaSource to consume messages from the
earliest offset of the
+stream "input-stream" and deserialize only the value of the
+ConsumerRecord as a string, using "MyKafkaMetadataService" to resolve the
cluster(s) and topic(s)
+corresponding to "input-stream".
+
+{{< tabs "DynamicKafkaSource" >}}
+{{< tab "Java" >}}
+```java
+
+DynamicKafkaSource source = DynamicKafkaSource.builder()
+.setKafkaMetadataService(new MyKafkaMetadataService())
+.setStreamIds(Collections.singleton("input-stream"))
+.setStartingOffsets(OffsetsInitializer.earliest())
+
.setDeserializer(KafkaRecordDeserializationSchema.valueOnly(StringDeserializer.class))
+.setProperties(properties)
+.build();
+
+env.fromSource(source, WatermarkStrategy.noWatermarks(), "Dynamic
Kafka Source");
+```
+{{< /tab >}}
+{{< /tabs >}}
+The following properties are **required** for building a DynamicKafkaSource:
+
+The Kafka metadata service, configured by
setKafkaMetadataService(KafkaMetadataService)
+The stream ids to subscribe, see the following Kafka stream subscription
section for more details.
+Deserializer to parse Kafka messages, see the [Kafka Source Documentation]({{<
ref "docs/connectors/datastream/kafka" >}}#deserializer) for more details.
+
+### Kafka Stream Subscription
+The Dynamic Kafka Source provides 2 ways of subscribing to Kafka stream(s).
+* A set of Kafka stream ids. For example:
+ {{< tabs "DynamicKafkaSource#setStreamIds" >}}
+ {{< tab "Java" >}}
+ ```java
+ DynamicKafkaSource.builder().setStreamIds(Set.of("stream-a", "stream-b"));
+ ```
+ {{< /tab >}}
+ {{< /tabs >}}
+* A regex pattern that subscribes to all Kafka stream ids that match the
provided regex. For example:
+ {{< tabs "DynamicKafkaSource#setStreamPattern" >}}
+ {{< tab "Java" >}}
+ ```java
+ DynamicKafkaSource.b
(flink-connector-kafka) branch dependabot/maven/org.apache.zookeeper-zookeeper-3.7.2 deleted (was 58ab6c12)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to branch dependabot/maven/org.apache.zookeeper-zookeeper-3.7.2 in repository https://gitbox.apache.org/repos/asf/flink-connector-kafka.git was 58ab6c12 [FLINK-34154] Bump org.apache.zookeeper:zookeeper from 3.5.9 to 3.7.2 The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(flink-connector-kafka) branch main updated: [FLINK-34154] Bump org.apache.zookeeper:zookeeper from 3.5.9 to 3.7.2. This closes #72
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-kafka.git The following commit(s) were added to refs/heads/main by this push: new 6f06f158 [FLINK-34154] Bump org.apache.zookeeper:zookeeper from 3.5.9 to 3.7.2. This closes #72 6f06f158 is described below commit 6f06f158e75fc557523eca25724ef026b911af61 Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> AuthorDate: Fri Jan 19 09:14:37 2024 +0100 [FLINK-34154] Bump org.apache.zookeeper:zookeeper from 3.5.9 to 3.7.2. This closes #72 Bumps org.apache.zookeeper:zookeeper from 3.5.9 to 3.7.2. --- updated-dependencies: - dependency-name: org.apache.zookeeper:zookeeper dependency-type: direct:development ... Signed-off-by: dependabot[bot] Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> --- pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pom.xml b/pom.xml index 25d3c101..a0583521 100644 --- a/pom.xml +++ b/pom.xml @@ -52,7 +52,7 @@ under the License. 1.17.0 3.4.0 -3.5.9 +3.7.2 7.2.2 2.15.2
(flink-connector-kafka) branch dependabot/maven/org.apache.zookeeper-zookeeper-3.7.2 updated (d66ab6e7 -> 58ab6c12)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to branch dependabot/maven/org.apache.zookeeper-zookeeper-3.7.2 in repository https://gitbox.apache.org/repos/asf/flink-connector-kafka.git discard d66ab6e7 Bump org.apache.zookeeper:zookeeper from 3.5.9 to 3.7.2 add 825052f5 [FLINK-33361][connectors/kafka] Add Java 17 compatibility to Flink Kafka connector add eaeb7817 [FLINK-32416] initial implementation of DynamicKafkaSource with bounded/unbounded support and unit/integration tests add cdfa328b [FLINK-32416] Fix flaky tests by ensuring test utilities produce records with consistency and cleanup notify no more splits to ensure it is sent. This closes #79 add d3bda90d [hotfix] Synchronize CI pipeline setup. This closes #78 add 58ab6c12 [FLINK-34154] Bump org.apache.zookeeper:zookeeper from 3.5.9 to 3.7.2 This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (d66ab6e7) \ N -- N -- N refs/heads/dependabot/maven/org.apache.zookeeper-zookeeper-3.7.2 (58ab6c12) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: .github/workflows/push_pr.yml | 12 +- .github/workflows/weekly.yml | 20 +- .../docs/connectors/table/dynamic-kafka.md | 141 +++ .../docs/connectors/datastream/dynamic-kafka.md| 141 +++ .../flink-end-to-end-tests-common-kafka/pom.xml| 4 +- .../984f05c0-ec82-405e-9bcc-d202dbe7202e | 357 flink-connector-kafka/pom.xml | 13 + .../kafka/dynamic/metadata/ClusterMetadata.java| 92 ++ .../dynamic/metadata/KafkaMetadataService.java | 53 ++ .../kafka/dynamic/metadata/KafkaStream.java| 94 ++ .../SingleClusterTopicMetadataService.java | 118 +++ .../kafka/dynamic/source/DynamicKafkaSource.java | 222 + .../dynamic/source/DynamicKafkaSourceBuilder.java | 328 +++ .../dynamic/source/DynamicKafkaSourceOptions.java | 60 ++ .../source/GetMetadataUpdateEvent.java}| 18 +- .../kafka/dynamic/source/MetadataUpdateEvent.java | 77 ++ .../enumerator/DynamicKafkaSourceEnumState.java| 58 ++ .../DynamicKafkaSourceEnumStateSerializer.java | 187 .../enumerator/DynamicKafkaSourceEnumerator.java | 546 .../enumerator/StoppableKafkaEnumContextProxy.java | 316 +++ .../subscriber/KafkaStreamSetSubscriber.java} | 28 +- .../subscriber/KafkaStreamSubscriber.java} | 25 +- .../subscriber/StreamPatternSubscriber.java| 53 ++ .../source/metrics/KafkaClusterMetricGroup.java| 142 +++ .../metrics/KafkaClusterMetricGroupManager.java| 76 ++ .../source/reader/DynamicKafkaSourceReader.java| 549 .../reader/KafkaPartitionSplitReaderWrapper.java | 98 +++ .../source/split/DynamicKafkaSourceSplit.java | 85 ++ .../split/DynamicKafkaSourceSplitSerializer.java} | 48 +- .../kafka/source/KafkaPropertiesUtil.java | 67 ++ .../source/enumerator/KafkaSourceEnumState.java| 2 +- .../dynamic/source/DynamicKafkaSourceITTest.java | 694 +++ .../DynamicKafkaSourceEnumStateSerializerTest.java | 118 +++ .../DynamicKafkaSourceEnumeratorTest.java | 966 + .../StoppableKafkaEnumContextProxyTest.java| 211 + .../SingleClusterTopicMetadataServiceTest.java | 117 +++ .../metrics/KafkaClusterMetricGroupTest.java | 95 ++ .../reader/DynamicKafkaSourceReaderTest.java | 347 .../DynamicKafkaSourceSplitSerializerTest.java | 47 + .../DynamicKafkaSourceExternalContext.java | 263 ++ ... DynamicKafkaSourceExternalContextFactory.java} | 40 +- .../kafka/testutils/MockKafkaMetadataService.java | 93 ++ .../kafka/testutils/TwoKafkaContainers.java| 62 ++ .../kafka/testutils/YamlFileMetadataService.java | 361 .../testutils/YamlFileMetadataServiceTest.java | 79 ++ .../kafka/DynamicKafkaSourceTestHelper.java| 231 + .../streaming/connectors/kafka/KafkaTestBase.java | 89 +- .../connectors/kafka/KafkaTestEnvironment.java | 2 + .../connectors/kafka/KafkaTestEnvironmentImpl.java | 7 +- .../src/test/resources/log4j2-test.properties | 3 + .../src/test/resources/stream-metadata.yaml| 19 + pom.xml
(flink-connector-shared-utils) branch release_utils updated: [FLINK-33401][connectors/kafka] Fix the wrong download link and version in the connector doc. This closes #64
This is an automated email from the ASF dual-hosted git repository.
martijnvisser pushed a commit to branch release_utils
in repository
https://gitbox.apache.org/repos/asf/flink-connector-shared-utils.git
The following commit(s) were added to refs/heads/release_utils by this push:
new d314bab [FLINK-33401][connectors/kafka] Fix the wrong download link
and version in the connector doc. This closes #64
new 164789b Merge remote-tracking branch 'origin/release_utils' into
release_utils
d314bab is described below
commit d314babafbd98abdd0b129eee5626b12869825f4
Author: Yuxin Tan
AuthorDate: Tue Nov 14 09:55:20 2023 +0100
[FLINK-33401][connectors/kafka] Fix the wrong download link and version in
the connector doc. This closes #64
---
_utils.sh | 2 ++
release_snapshot_branch.sh | 2 ++
stage_jars.sh | 2 ++
3 files changed, 6 insertions(+)
diff --git a/_utils.sh b/_utils.sh
index b63379a..b1d03b2 100644
--- a/_utils.sh
+++ b/_utils.sh
@@ -58,7 +58,9 @@ function create_pristine_source {
}
function get_pom_version {
+ set +u
echo $(${MVN} help:evaluate -Dexpression="project.version" -q -DforceStdout)
+ set -u
}
function set_pom_version {
diff --git a/release_snapshot_branch.sh b/release_snapshot_branch.sh
index 5a4d274..202773f 100755
--- a/release_snapshot_branch.sh
+++ b/release_snapshot_branch.sh
@@ -26,7 +26,9 @@ source "${SCRIPT_DIR}/_init.sh"
function create_snapshot_branch {
cd "${SOURCE_DIR}"
+ set +u
version=$(mvn help:evaluate -Dexpression="project.version" -q -DforceStdout
| sed "s/-SNAPSHOT//")
+ set -u
branch="v${version}"
git checkout -b ${branch}
diff --git a/stage_jars.sh b/stage_jars.sh
index 0dd180c..925dd46 100755
--- a/stage_jars.sh
+++ b/stage_jars.sh
@@ -48,7 +48,9 @@ function deploy_staging_jars {
set_pom_version "${version}"
options="-Prelease,docs-and-source -DskipTests
-DretryFailedDeploymentCount=10"
+ set +u
${MVN} clean deploy ${options} -Dflink.version=${FLINK_VERSION}
+ set -u
cd "${RELEASE_DIR}"
rm -rf "${clone_dir}"
(flink-connector-kafka) branch dependabot/maven/org.apache.commons-commons-compress-1.24.0 deleted (was f3ca94fb)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to branch dependabot/maven/org.apache.commons-commons-compress-1.24.0 in repository https://gitbox.apache.org/repos/asf/flink-connector-kafka.git was f3ca94fb [FLINK-33329] Bump org.apache.commons:commons-compress from 1.22 to 1.24.0 The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(flink-connector-kafka) branch main updated: [FLINK-33329] Bump org.apache.commons:commons-compress from 1.22 to 1.25.0. This closes #73
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-kafka.git The following commit(s) were added to refs/heads/main by this push: new 8d531898 [FLINK-33329] Bump org.apache.commons:commons-compress from 1.22 to 1.25.0. This closes #73 8d531898 is described below commit 8d531898d7df775535084e0413442c86a4c497ed Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> AuthorDate: Thu Jan 18 16:09:14 2024 +0100 [FLINK-33329] Bump org.apache.commons:commons-compress from 1.22 to 1.25.0. This closes #73 * Bump org.apache.commons:commons-compress from 1.22 to 1.24.0 Bumps org.apache.commons:commons-compress from 1.22 to 1.24.0. --- updated-dependencies: - dependency-name: org.apache.commons:commons-compress dependency-type: direct:production ... Signed-off-by: dependabot[bot] * [FLINK-33329] Bump org.apache.commons:commons-compress from 1.22 to 1.25.0 - Signed-off-by: dependabot[bot] Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Martijn Visser <2989614+martijnvis...@users.noreply.github.com> --- pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pom.xml b/pom.xml index f3131759..25d3c101 100644 --- a/pom.xml +++ b/pom.xml @@ -424,7 +424,7 @@ under the License. org.apache.commons commons-compress -1.22 +1.25.0
(flink-connector-kafka) branch dependabot/maven/org.apache.commons-commons-compress-1.24.0 updated (f701ac25 -> f3ca94fb)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to branch dependabot/maven/org.apache.commons-commons-compress-1.24.0 in repository https://gitbox.apache.org/repos/asf/flink-connector-kafka.git discard f701ac25 Bump org.apache.commons:commons-compress from 1.22 to 1.24.0 add 825052f5 [FLINK-33361][connectors/kafka] Add Java 17 compatibility to Flink Kafka connector add eaeb7817 [FLINK-32416] initial implementation of DynamicKafkaSource with bounded/unbounded support and unit/integration tests add cdfa328b [FLINK-32416] Fix flaky tests by ensuring test utilities produce records with consistency and cleanup notify no more splits to ensure it is sent. This closes #79 add d3bda90d [hotfix] Synchronize CI pipeline setup. This closes #78 add 8ab7d004 Bump org.apache.commons:commons-compress from 1.22 to 1.24.0 add f3ca94fb [FLINK-33329] Bump org.apache.commons:commons-compress from 1.22 to 1.24.0 This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (f701ac25) \ N -- N -- N refs/heads/dependabot/maven/org.apache.commons-commons-compress-1.24.0 (f3ca94fb) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: .github/workflows/push_pr.yml | 12 +- .github/workflows/weekly.yml | 20 +- .../docs/connectors/table/dynamic-kafka.md | 141 +++ .../docs/connectors/datastream/dynamic-kafka.md| 141 +++ .../flink-end-to-end-tests-common-kafka/pom.xml| 4 +- .../984f05c0-ec82-405e-9bcc-d202dbe7202e | 357 flink-connector-kafka/pom.xml | 13 + .../kafka/dynamic/metadata/ClusterMetadata.java| 92 ++ .../dynamic/metadata/KafkaMetadataService.java | 53 ++ .../kafka/dynamic/metadata/KafkaStream.java| 94 ++ .../SingleClusterTopicMetadataService.java | 118 +++ .../kafka/dynamic/source/DynamicKafkaSource.java | 222 + .../dynamic/source/DynamicKafkaSourceBuilder.java | 328 +++ .../dynamic/source/DynamicKafkaSourceOptions.java | 60 ++ .../source/GetMetadataUpdateEvent.java}| 18 +- .../kafka/dynamic/source/MetadataUpdateEvent.java | 77 ++ .../enumerator/DynamicKafkaSourceEnumState.java| 58 ++ .../DynamicKafkaSourceEnumStateSerializer.java | 187 .../enumerator/DynamicKafkaSourceEnumerator.java | 546 .../enumerator/StoppableKafkaEnumContextProxy.java | 316 +++ .../subscriber/KafkaStreamSetSubscriber.java} | 28 +- .../subscriber/KafkaStreamSubscriber.java} | 25 +- .../subscriber/StreamPatternSubscriber.java| 53 ++ .../source/metrics/KafkaClusterMetricGroup.java| 142 +++ .../metrics/KafkaClusterMetricGroupManager.java| 76 ++ .../source/reader/DynamicKafkaSourceReader.java| 549 .../reader/KafkaPartitionSplitReaderWrapper.java | 98 +++ .../source/split/DynamicKafkaSourceSplit.java | 85 ++ .../split/DynamicKafkaSourceSplitSerializer.java} | 48 +- .../kafka/source/KafkaPropertiesUtil.java | 67 ++ .../source/enumerator/KafkaSourceEnumState.java| 2 +- .../dynamic/source/DynamicKafkaSourceITTest.java | 694 +++ .../DynamicKafkaSourceEnumStateSerializerTest.java | 118 +++ .../DynamicKafkaSourceEnumeratorTest.java | 966 + .../StoppableKafkaEnumContextProxyTest.java| 211 + .../SingleClusterTopicMetadataServiceTest.java | 117 +++ .../metrics/KafkaClusterMetricGroupTest.java | 95 ++ .../reader/DynamicKafkaSourceReaderTest.java | 347 .../DynamicKafkaSourceSplitSerializerTest.java | 47 + .../DynamicKafkaSourceExternalContext.java | 263 ++ ... DynamicKafkaSourceExternalContextFactory.java} | 40 +- .../kafka/testutils/MockKafkaMetadataService.java | 93 ++ .../kafka/testutils/TwoKafkaContainers.java| 62 ++ .../kafka/testutils/YamlFileMetadataService.java | 361 .../testutils/YamlFileMetadataServiceTest.java | 79 ++ .../kafka/DynamicKafkaSourceTestHelper.java| 231 + .../streaming/connectors/kafka/KafkaTestBase.java | 89 +- .../connectors/kafka/KafkaTestEnvironment.java | 2 + .../connectors/kafka/KafkaTestEnvironmentImpl.java | 7 +- .../src/test/resources/log4j2-test.properties | 3 + .../src/t
(flink-connector-kafka) branch main updated: [hotfix] Synchronize CI pipeline setup. This closes #78
This is an automated email from the ASF dual-hosted git repository.
martijnvisser pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/flink-connector-kafka.git
The following commit(s) were added to refs/heads/main by this push:
new d3bda90d [hotfix] Synchronize CI pipeline setup. This closes #78
d3bda90d is described below
commit d3bda90d74ec7d9cb68ec74672fc049f85692940
Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com>
AuthorDate: Thu Jan 18 12:46:19 2024 +0100
[hotfix] Synchronize CI pipeline setup. This closes #78
* Synchronize CI pipeline setup
The Flink Kafka connector now tests:
- All PRs against `main` are tested against Flink `1.17.2` and `1.18.1`,
instead of `1.17.1` and `1.18.0`
- The weekly run tests
-- `main` against `1.17-SNAPSHOT, `1.18-SNAPSHOT` and `1.19-SNAPSHOT` (1.19
is newly added)
-- `v3.0` against `1.17-SNAPSHOT` and `1.18-SNAPSHOT` (as was before)
* Make sure that Python tests are also run during CI runs for PRs
---
.github/workflows/push_pr.yml | 14 +++---
.github/workflows/weekly.yml | 20 +---
2 files changed, 20 insertions(+), 14 deletions(-)
diff --git a/.github/workflows/push_pr.yml b/.github/workflows/push_pr.yml
index 099a181b..d57c0181 100644
--- a/.github/workflows/push_pr.yml
+++ b/.github/workflows/push_pr.yml
@@ -25,11 +25,11 @@ jobs:
compile_and_test:
strategy:
matrix:
-flink: [ 1.17.1, 1.18.0 ]
-jdk: [ 8, 11, 17 ]
-exclude:
- - jdk: 17
-flink: 1.17.1
+flink: [ 1.17.2 ]
+jdk: [ '8, 11' ]
+include:
+ - flink: 1.18.1
+jdk: '8, 11, 17'
uses: apache/flink-connector-shared-utils/.github/workflows/ci.yml@ci_utils
with:
flink_version: ${{ matrix.flink }}
@@ -37,7 +37,7 @@ jobs:
python_test:
strategy:
matrix:
-flink: [ 1.17.1, 1.18.0 ]
+flink: [ 1.17.2, 1.18.1 ]
uses:
apache/flink-connector-shared-utils/.github/workflows/python_ci.yml@ci_utils
with:
- flink_version: ${{ matrix.flink }}
+ flink_version: ${{ matrix.flink }}
\ No newline at end of file
diff --git a/.github/workflows/weekly.yml b/.github/workflows/weekly.yml
index b363b7fb..e6bf27dd 100644
--- a/.github/workflows/weekly.yml
+++ b/.github/workflows/weekly.yml
@@ -27,20 +27,26 @@ jobs:
strategy:
matrix:
flink_branches: [{
- flink: 1.17.1,
- branch: v3.0
+ flink: 1.17-SNAPSHOT,
+ branch: main
}, {
- flink: 1.18.0,
- branch: v3.0
+ flink: 1.18-SNAPSHOT,
+ jdk: '8, 11, 17',
+ branch: main
}, {
- flink: 1.17.1,
+ flink: 1.19-SNAPSHOT,
+ jdk: '8, 11, 17, 21',
branch: main
+}, {
+ flink: 1.17.1,
+ branch: v3.0
}, {
flink: 1.18.0,
- branch: main
+ branch: v3.0
}]
uses: apache/flink-connector-shared-utils/.github/workflows/ci.yml@ci_utils
with:
flink_version: ${{ matrix.flink_branches.flink }}
connector_branch: ${{ matrix.flink_branches.branch }}
- run_dependency_convergence: false
+ jdk_version: ${{ matrix.flink_branches.jdk || '8, 11' }}
+ run_dependency_convergence: false
\ No newline at end of file
(flink-connector-kafka) branch main updated: [FLINK-32416] Fix flaky tests by ensuring test utilities produce records with consistency and cleanup notify no more splits to ensure it is sent. This clos
This is an automated email from the ASF dual-hosted git repository.
martijnvisser pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/flink-connector-kafka.git
The following commit(s) were added to refs/heads/main by this push:
new cdfa328b [FLINK-32416] Fix flaky tests by ensuring test utilities
produce records with consistency and cleanup notify no more splits to ensure it
is sent. This closes #79
cdfa328b is described below
commit cdfa328b5ec34d711ae2c9e93de6de7565fd1db6
Author: Mason Chen
AuthorDate: Wed Jan 17 12:55:29 2024 -0800
[FLINK-32416] Fix flaky tests by ensuring test utilities produce records
with consistency and cleanup notify no more splits to ensure it is sent. This
closes #79
---
.../enumerator/DynamicKafkaSourceEnumerator.java | 49 --
.../enumerator/StoppableKafkaEnumContextProxy.java | 29 ++---
.../source/reader/DynamicKafkaSourceReader.java| 4 +-
.../DynamicKafkaSourceEnumeratorTest.java | 6 ++-
.../StoppableKafkaEnumContextProxyTest.java| 3 +-
.../kafka/DynamicKafkaSourceTestHelper.java| 4 +-
6 files changed, 63 insertions(+), 32 deletions(-)
diff --git
a/flink-connector-kafka/src/main/java/org/apache/flink/connector/kafka/dynamic/source/enumerator/DynamicKafkaSourceEnumerator.java
b/flink-connector-kafka/src/main/java/org/apache/flink/connector/kafka/dynamic/source/enumerator/DynamicKafkaSourceEnumerator.java
index cce8ab28..e14a36d9 100644
---
a/flink-connector-kafka/src/main/java/org/apache/flink/connector/kafka/dynamic/source/enumerator/DynamicKafkaSourceEnumerator.java
+++
b/flink-connector-kafka/src/main/java/org/apache/flink/connector/kafka/dynamic/source/enumerator/DynamicKafkaSourceEnumerator.java
@@ -96,6 +96,7 @@ public class DynamicKafkaSourceEnumerator
private int kafkaMetadataServiceDiscoveryFailureCount;
private Map> latestClusterTopicsMap;
private Set latestKafkaStreams;
+private boolean firstDiscoveryComplete;
public DynamicKafkaSourceEnumerator(
KafkaStreamSubscriber kafkaStreamSubscriber,
@@ -151,6 +152,7 @@ public class DynamicKafkaSourceEnumerator
DynamicKafkaSourceOptions.STREAM_METADATA_DISCOVERY_FAILURE_THRESHOLD,
Integer::parseInt);
this.kafkaMetadataServiceDiscoveryFailureCount = 0;
+this.firstDiscoveryComplete = false;
this.kafkaMetadataService = kafkaMetadataService;
this.stoppableKafkaEnumContextProxyFactory =
stoppableKafkaEnumContextProxyFactory;
@@ -212,32 +214,27 @@ public class DynamicKafkaSourceEnumerator
private void handleNoMoreSplits() {
if (Boundedness.BOUNDED.equals(boundedness)) {
-enumContext.runInCoordinatorThread(
-() -> {
-boolean allEnumeratorsHaveSignalledNoMoreSplits = true;
-for (StoppableKafkaEnumContextProxy context :
-clusterEnumContextMap.values()) {
-allEnumeratorsHaveSignalledNoMoreSplits =
-allEnumeratorsHaveSignalledNoMoreSplits
-&& context.isNoMoreSplits();
-}
-
-if (allEnumeratorsHaveSignalledNoMoreSplits) {
-logger.info(
-"Signal no more splits to all readers: {}",
-enumContext.registeredReaders().keySet());
-enumContext
-.registeredReaders()
-.keySet()
-.forEach(enumContext::signalNoMoreSplits);
-}
-});
+boolean allEnumeratorsHaveSignalledNoMoreSplits = true;
+for (StoppableKafkaEnumContextProxy context :
clusterEnumContextMap.values()) {
+allEnumeratorsHaveSignalledNoMoreSplits =
+allEnumeratorsHaveSignalledNoMoreSplits &&
context.isNoMoreSplits();
+}
+
+if (firstDiscoveryComplete &&
allEnumeratorsHaveSignalledNoMoreSplits) {
+logger.info(
+"Signal no more splits to all readers: {}",
+enumContext.registeredReaders().keySet());
+
enumContext.registeredReaders().keySet().forEach(enumContext::signalNoMoreSplits);
+} else {
+logger.info("Not ready to notify no more splits to readers.");
+}
}
}
// --- private methods for metadata discovery ---
private void onHandleSubscribedStreamsFetch(Set
fetchedKafkaStreams, Throwable t) {
+firstDiscoveryComplete = true;
Set handledFetchKafka
(flink-connector-elasticsearch) branch v3.0 updated: [hotfix] Set maximum supported Flink version to 1.17 for `v3.0`
This is an automated email from the ASF dual-hosted git repository.
martijnvisser pushed a commit to branch v3.0
in repository
https://gitbox.apache.org/repos/asf/flink-connector-elasticsearch.git
The following commit(s) were added to refs/heads/v3.0 by this push:
new f94649a [hotfix] Set maximum supported Flink version to 1.17 for
`v3.0`
f94649a is described below
commit f94649a60af367109f38c651d4dc819e0a430523
Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com>
AuthorDate: Tue Jan 16 10:42:10 2024 +0100
[hotfix] Set maximum supported Flink version to 1.17 for `v3.0`
---
.github/workflows/push_pr.yml | 9 +++--
1 file changed, 7 insertions(+), 2 deletions(-)
diff --git a/.github/workflows/push_pr.yml b/.github/workflows/push_pr.yml
index 89ea3fb..4f22f02 100644
--- a/.github/workflows/push_pr.yml
+++ b/.github/workflows/push_pr.yml
@@ -16,13 +16,18 @@
# limitations under the License.
-name: Build flink-connector-elasticsearch
+name: CI
on: [push, pull_request]
concurrency:
group: ${{ github.workflow }}-${{ github.ref }}
cancel-in-progress: true
jobs:
compile_and_test:
+strategy:
+ matrix:
+flink: [ 1.16-SNAPSHOT, 1.17-SNAPSHOT ]
+jdk: [ '8, 11' ]
uses: apache/flink-connector-shared-utils/.github/workflows/ci.yml@ci_utils
with:
- flink_version: 1.16.2
+ flink_version: ${{ matrix.flink }}
+ jdk_version: ${{ matrix.jdk }}
(flink-connector-elasticsearch) branch main updated: [hotfix] Set maximum supported Flink version to 1.17 for `v3.0`
This is an automated email from the ASF dual-hosted git repository.
martijnvisser pushed a commit to branch main
in repository
https://gitbox.apache.org/repos/asf/flink-connector-elasticsearch.git
The following commit(s) were added to refs/heads/main by this push:
new 153b8fc [hotfix] Set maximum supported Flink version to 1.17 for
`v3.0`
153b8fc is described below
commit 153b8fc23e14c03c4bacf2c24fbe0fee286ec6e2
Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com>
AuthorDate: Tue Jan 16 10:39:25 2024 +0100
[hotfix] Set maximum supported Flink version to 1.17 for `v3.0`
---
.github/workflows/weekly.yml | 4
1 file changed, 4 deletions(-)
diff --git a/.github/workflows/weekly.yml b/.github/workflows/weekly.yml
index 19904b2..109058c 100644
--- a/.github/workflows/weekly.yml
+++ b/.github/workflows/weekly.yml
@@ -46,10 +46,6 @@ jobs:
}, {
flink: 1.17.1,
branch: v3.0
-}, {
- flink: 1.18.0,
- jdk: '8, 11, 17',
- branch: v3.0
}]
uses: apache/flink-connector-shared-utils/.github/workflows/ci.yml@ci_utils
with:
(flink-connector-shared-utils) branch ci_utils updated: [hotfix] Fix incorrect echo in python_ci.yml so that it emits the correct JDK version. This closes #32
This is an automated email from the ASF dual-hosted git repository.
martijnvisser pushed a commit to branch ci_utils
in repository
https://gitbox.apache.org/repos/asf/flink-connector-shared-utils.git
The following commit(s) were added to refs/heads/ci_utils by this push:
new e39cd5f [hotfix] Fix incorrect echo in python_ci.yml so that it emits
the correct JDK version. This closes #32
e39cd5f is described below
commit e39cd5f3dd33fa1609c93004308a2aee3069abec
Author: gongzhongqiang
AuthorDate: Sat Jan 13 00:10:48 2024 +0800
[hotfix] Fix incorrect echo in python_ci.yml so that it emits the correct
JDK version. This closes #32
---
.github/workflows/python_ci.yml | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/.github/workflows/python_ci.yml b/.github/workflows/python_ci.yml
index 08811b3..8d9d7ac 100644
--- a/.github/workflows/python_ci.yml
+++ b/.github/workflows/python_ci.yml
@@ -55,7 +55,7 @@ jobs:
MVN_CONNECTION_OPTIONS: -Dhttp.keepAlive=false
-Dmaven.wagon.http.pool=false -Dmaven.wagon.httpconnectionManager.ttlSeconds=120
MVN_BUILD_OUTPUT_FILE: "/tmp/mvn_build_output.out"
steps:
- - run: echo "Running CI pipeline for JDK version 8"
+ - run: echo "Running CI pipeline for JDK version ${{ matrix.jdk }}"
- name: Check out repository code
uses: actions/checkout@v3
svn commit: r66574 - in /dev/flink/flink-connector-rabbitmq-3.0.2-rc1: ./ flink-connector-rabbitmq-3.0.2-src.tgz flink-connector-rabbitmq-3.0.2-src.tgz.asc flink-connector-rabbitmq-3.0.2-src.tgz.sha51
Author: martijnvisser Date: Fri Jan 12 12:41:51 2024 New Revision: 66574 Log: Add flink-connector-rabbitmq-3.0.2-rc1 Added: dev/flink/flink-connector-rabbitmq-3.0.2-rc1/ dev/flink/flink-connector-rabbitmq-3.0.2-rc1/flink-connector-rabbitmq-3.0.2-src.tgz (with props) dev/flink/flink-connector-rabbitmq-3.0.2-rc1/flink-connector-rabbitmq-3.0.2-src.tgz.asc dev/flink/flink-connector-rabbitmq-3.0.2-rc1/flink-connector-rabbitmq-3.0.2-src.tgz.sha512 Added: dev/flink/flink-connector-rabbitmq-3.0.2-rc1/flink-connector-rabbitmq-3.0.2-src.tgz == Binary file - no diff available. Propchange: dev/flink/flink-connector-rabbitmq-3.0.2-rc1/flink-connector-rabbitmq-3.0.2-src.tgz -- svn:mime-type = application/octet-stream Added: dev/flink/flink-connector-rabbitmq-3.0.2-rc1/flink-connector-rabbitmq-3.0.2-src.tgz.asc == --- dev/flink/flink-connector-rabbitmq-3.0.2-rc1/flink-connector-rabbitmq-3.0.2-src.tgz.asc (added) +++ dev/flink/flink-connector-rabbitmq-3.0.2-rc1/flink-connector-rabbitmq-3.0.2-src.tgz.asc Fri Jan 12 12:41:51 2024 @@ -0,0 +1,7 @@ +-BEGIN PGP SIGNATURE- + +iHUEABYKAB0WIQSl87zky+mTVz7FlmplMhuDgrIZrwUCZaEzggAKCRBlMhuDgrIZ +r3WoAPoDoMT88XVcLOUgxZ3W4Nde8ke23O2G5k93IOGZvMS1VwD/ZjazMDNO9uJD +vzXSl6pc1YuLedrOSSWZc/8A6VzxFAs= +=7WGF +-END PGP SIGNATURE- Added: dev/flink/flink-connector-rabbitmq-3.0.2-rc1/flink-connector-rabbitmq-3.0.2-src.tgz.sha512 == --- dev/flink/flink-connector-rabbitmq-3.0.2-rc1/flink-connector-rabbitmq-3.0.2-src.tgz.sha512 (added) +++ dev/flink/flink-connector-rabbitmq-3.0.2-rc1/flink-connector-rabbitmq-3.0.2-src.tgz.sha512 Fri Jan 12 12:41:51 2024 @@ -0,0 +1 @@ +e3fe32e426a69750798584e0db9bf542ce1794f8c38b657053189b43bc51bf6499950a443b0d837e5e2fb4c1d53e7727135047439dcd0749af556a14383b2425 flink-connector-rabbitmq-3.0.2-src.tgz
(flink-connector-rabbitmq) annotated tag v3.0.2-rc1 updated (0a3e3d1 -> 483bc05)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to annotated tag v3.0.2-rc1 in repository https://gitbox.apache.org/repos/asf/flink-connector-rabbitmq.git *** WARNING: tag v3.0.2-rc1 was modified! *** from 0a3e3d1 (commit) to 483bc05 (tag) tagging 0a3e3d102da2e216ac806212fc093b0d8518e22f (commit) by Martijn Visser on Fri Jan 12 13:40:20 2024 +0100 - Log - v3.0.2-rc1 -BEGIN PGP SIGNATURE- iHUEABYKAB0WIQSl87zky+mTVz7FlmplMhuDgrIZrwUCZaEzNAAKCRBlMhuDgrIZ r8wjAQDqRjhfl8oN1+QSi0yib2+w1u35m8GNb2tm/j8KgroyhwD9GPLES6yL+Qm3 YnQOFLTyqB82WmxAejQRFGhtzxDBEg4= =E4t9 -END PGP SIGNATURE- --- No new revisions were added by this update. Summary of changes:
(flink-connector-hbase) annotated tag v3.0.2-rc1 deleted (was 9341e8a)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to annotated tag v3.0.2-rc1 in repository https://gitbox.apache.org/repos/asf/flink-connector-hbase.git *** WARNING: tag v3.0.2-rc1 was deleted! *** tag was 9341e8a This change permanently discards the following revisions: discard 4c24d40 Update version to 3.0.2
svn commit: r66573 - /dev/flink/flink-connector-rabbitmq-3.0.2-rc1/
Author: martijnvisser Date: Fri Jan 12 12:39:37 2024 New Revision: 66573 Log: [Revert] Delete https://dist.apache.org/repos/dist/dev/flink/flink-connector-rabbitmq-3.0.2-rc1 Removed: dev/flink/flink-connector-rabbitmq-3.0.2-rc1/
svn commit: r66572 - in /dev/flink/flink-connector-rabbitmq-3.0.2-rc1: ./ flink-connector-rabbitmq-3.0.2-src.tgz flink-connector-rabbitmq-3.0.2-src.tgz.asc flink-connector-rabbitmq-3.0.2-src.tgz.sha51
Author: martijnvisser Date: Fri Jan 12 12:37:54 2024 New Revision: 66572 Log: Add flink-connector-rabbitmq-3.0.2-rc1 Added: dev/flink/flink-connector-rabbitmq-3.0.2-rc1/ dev/flink/flink-connector-rabbitmq-3.0.2-rc1/flink-connector-rabbitmq-3.0.2-src.tgz (with props) dev/flink/flink-connector-rabbitmq-3.0.2-rc1/flink-connector-rabbitmq-3.0.2-src.tgz.asc dev/flink/flink-connector-rabbitmq-3.0.2-rc1/flink-connector-rabbitmq-3.0.2-src.tgz.sha512 Added: dev/flink/flink-connector-rabbitmq-3.0.2-rc1/flink-connector-rabbitmq-3.0.2-src.tgz == Binary file - no diff available. Propchange: dev/flink/flink-connector-rabbitmq-3.0.2-rc1/flink-connector-rabbitmq-3.0.2-src.tgz -- svn:mime-type = application/octet-stream Added: dev/flink/flink-connector-rabbitmq-3.0.2-rc1/flink-connector-rabbitmq-3.0.2-src.tgz.asc == --- dev/flink/flink-connector-rabbitmq-3.0.2-rc1/flink-connector-rabbitmq-3.0.2-src.tgz.asc (added) +++ dev/flink/flink-connector-rabbitmq-3.0.2-rc1/flink-connector-rabbitmq-3.0.2-src.tgz.asc Fri Jan 12 12:37:54 2024 @@ -0,0 +1,7 @@ +-BEGIN PGP SIGNATURE- + +iHUEABYKAB0WIQSl87zky+mTVz7FlmplMhuDgrIZrwUCZaEylAAKCRBlMhuDgrIZ +r0w+AQCjNUOKrVwIcBgP0KZbu5busHx4RYnKPcvb4LmGIFOiJAD/YF+fn2QqYuz/ +AGQ7B5N6qpsN0ese2bwSYM73qfdg9A0= +=0RJK +-END PGP SIGNATURE- Added: dev/flink/flink-connector-rabbitmq-3.0.2-rc1/flink-connector-rabbitmq-3.0.2-src.tgz.sha512 == --- dev/flink/flink-connector-rabbitmq-3.0.2-rc1/flink-connector-rabbitmq-3.0.2-src.tgz.sha512 (added) +++ dev/flink/flink-connector-rabbitmq-3.0.2-rc1/flink-connector-rabbitmq-3.0.2-src.tgz.sha512 Fri Jan 12 12:37:54 2024 @@ -0,0 +1 @@ +2db68d3122dd1b5ddb0ad251952ad803c3fa8f4801ead223f08c378f8f86e54984b4be5ab8f1162245ba1eeb3db9201a7f8db68c705bec2236031c7fab47419e flink-connector-rabbitmq-3.0.2-src.tgz
(flink-connector-hbase) annotated tag v3.0.2-rc1 updated (4c24d40 -> 9341e8a)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to annotated tag v3.0.2-rc1 in repository https://gitbox.apache.org/repos/asf/flink-connector-hbase.git *** WARNING: tag v3.0.2-rc1 was modified! *** from 4c24d40 (commit) to 9341e8a (tag) tagging 4c24d40a788ec3cae6985203d9ac51ef857d (commit) replaces v3.0.1-rc2 by Martijn Visser on Fri Jan 12 13:36:13 2024 +0100 - Log - v3.0.2-rc1 -BEGIN PGP SIGNATURE- iHUEABYKAB0WIQSl87zky+mTVz7FlmplMhuDgrIZrwUCZaEyPQAKCRBlMhuDgrIZ r1idAQDJh4qW3nlp1U6+0aNSRVkBaP38IBhwzKaQtXub741vXgEAm69sDM2Ev+O0 F+7+jDj8LSE1Q+Gf5U4esx+1hufYeQ8= =17z2 -END PGP SIGNATURE- --- No new revisions were added by this update. Summary of changes:
svn commit: r66571 - /dev/flink/flink-connector-hbase-3.0.1-rc1/
Author: martijnvisser Date: Fri Jan 12 12:31:07 2024 New Revision: 66571 Log: [Revert] Delete https://dist.apache.org/repos/dist/dev/flink/flink-connector-hbase-3.0.1-rc1 Removed: dev/flink/flink-connector-hbase-3.0.1-rc1/
svn commit: r66568 - in /dev/flink/flink-connector-hbase-3.0.1-rc2: ./ flink-connector-hbase-3.0.1-src.tgz flink-connector-hbase-3.0.1-src.tgz.asc flink-connector-hbase-3.0.1-src.tgz.sha512
Author: martijnvisser Date: Fri Jan 12 10:38:33 2024 New Revision: 66568 Log: Add flink-connector-hbase-3.0.1-rc2 Added: dev/flink/flink-connector-hbase-3.0.1-rc2/ dev/flink/flink-connector-hbase-3.0.1-rc2/flink-connector-hbase-3.0.1-src.tgz (with props) dev/flink/flink-connector-hbase-3.0.1-rc2/flink-connector-hbase-3.0.1-src.tgz.asc dev/flink/flink-connector-hbase-3.0.1-rc2/flink-connector-hbase-3.0.1-src.tgz.sha512 Added: dev/flink/flink-connector-hbase-3.0.1-rc2/flink-connector-hbase-3.0.1-src.tgz == Binary file - no diff available. Propchange: dev/flink/flink-connector-hbase-3.0.1-rc2/flink-connector-hbase-3.0.1-src.tgz -- svn:mime-type = application/octet-stream Added: dev/flink/flink-connector-hbase-3.0.1-rc2/flink-connector-hbase-3.0.1-src.tgz.asc == --- dev/flink/flink-connector-hbase-3.0.1-rc2/flink-connector-hbase-3.0.1-src.tgz.asc (added) +++ dev/flink/flink-connector-hbase-3.0.1-rc2/flink-connector-hbase-3.0.1-src.tgz.asc Fri Jan 12 10:38:33 2024 @@ -0,0 +1,7 @@ +-BEGIN PGP SIGNATURE- + +iHUEABYKAB0WIQSl87zky+mTVz7FlmplMhuDgrIZrwUCZaEWmwAKCRBlMhuDgrIZ +rxPQAP9KI8bI6wfQfMo6g1omdU1jOynjqP4hg4fJ6QMhWPySoQEAxyHTfPQiGeDT +yMIN9OpEbX/tGBmCxBMzutC0XCRI5QY= +=eLZL +-END PGP SIGNATURE- Added: dev/flink/flink-connector-hbase-3.0.1-rc2/flink-connector-hbase-3.0.1-src.tgz.sha512 == --- dev/flink/flink-connector-hbase-3.0.1-rc2/flink-connector-hbase-3.0.1-src.tgz.sha512 (added) +++ dev/flink/flink-connector-hbase-3.0.1-rc2/flink-connector-hbase-3.0.1-src.tgz.sha512 Fri Jan 12 10:38:33 2024 @@ -0,0 +1 @@ +609413cb7dea8a15faa01087ba7d83e1dcd38c50f5c597c7c4ca12fe3ddda74d03b130af9b0875a43167da2a5bfaad167443780d202aa11ea52e991074bdb5bc flink-connector-hbase-3.0.1-src.tgz
(flink-connector-hbase) annotated tag v3.0.1-rc2 updated (ee6767b -> 978a165)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to annotated tag v3.0.1-rc2 in repository https://gitbox.apache.org/repos/asf/flink-connector-hbase.git *** WARNING: tag v3.0.1-rc2 was modified! *** from ee6767b (commit) to 978a165 (tag) tagging ee6767b3030992b3410a3e74bcf8ae665e24ac10 (commit) by Martijn Visser on Fri Jan 12 11:37:44 2024 +0100 - Log - v3.0.1-rc2 -BEGIN PGP SIGNATURE- iHUEABYKAB0WIQSl87zky+mTVz7FlmplMhuDgrIZrwUCZaEWeAAKCRBlMhuDgrIZ r2AUAP9AylCMNt5RdTYyGckLvMNdcBg7YXM0lbfY72uqxrm3GgD+KxXf6uNie6Ri V91VsE9nPVP13zyRGkUvQGlwzVwcEgQ= =xBIS -END PGP SIGNATURE- --- No new revisions were added by this update. Summary of changes:
(flink-connector-rabbitmq) branch v3.0 updated: [FLINK-34020] Bump CI flink version on flink-connector-rabbitmq. This closes #23
This is an automated email from the ASF dual-hosted git repository.
martijnvisser pushed a commit to branch v3.0
in repository https://gitbox.apache.org/repos/asf/flink-connector-rabbitmq.git
The following commit(s) were added to refs/heads/v3.0 by this push:
new 1dc7b36 [FLINK-34020] Bump CI flink version on
flink-connector-rabbitmq. This closes #23
1dc7b36 is described below
commit 1dc7b36477295dd57c29a13c964b8242653f5482
Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com>
AuthorDate: Fri Jan 12 10:13:23 2024 +0100
[FLINK-34020] Bump CI flink version on flink-connector-rabbitmq. This
closes #23
* [FLINK-34020] Bump CI flink version on flink-connector-rabbitmq
* [hotfix] Set lowest supported Flink version to 1.16.0 since that's still
supported
* [hotfix] Set copyright year to 2024
-
Co-authored-by: Hang Ruan
Co-authored-by: Sergey Nuyanzin
(cherry picked from commit 33d125f591cc5f99e12280fbe2725bd374f7738b)
---
.github/workflows/push_pr.yml | 10 +++-
.github/workflows/weekly.yml | 32 ++--
flink-connector-rabbitmq/pom.xml | 30 +++
.../streaming/connectors/rabbitmq/RMQSource.java | 4 ++
.../rabbitmq/test/DockerImageVersions.java | 2 +-
pom.xml| 61 +-
6 files changed, 121 insertions(+), 18 deletions(-)
diff --git a/.github/workflows/push_pr.yml b/.github/workflows/push_pr.yml
index e3a7f8b..c423f27 100644
--- a/.github/workflows/push_pr.yml
+++ b/.github/workflows/push_pr.yml
@@ -23,6 +23,14 @@ concurrency:
cancel-in-progress: true
jobs:
compile_and_test:
+strategy:
+ matrix:
+flink: [ 1.16.3, 1.17.2 ]
+jdk: [ '8, 11' ]
+include:
+ - flink: 1.18.0
+jdk: '8, 11, 17'
uses: apache/flink-connector-shared-utils/.github/workflows/ci.yml@ci_utils
with:
- flink_version: 1.16.1
+ flink_version: ${{ matrix.flink }}
+ jdk_version: ${{ matrix.jdk }}
\ No newline at end of file
diff --git a/.github/workflows/weekly.yml b/.github/workflows/weekly.yml
index 9d34bc1..cf31d3e 100644
--- a/.github/workflows/weekly.yml
+++ b/.github/workflows/weekly.yml
@@ -26,8 +26,34 @@ jobs:
if: github.repository_owner == 'apache'
strategy:
matrix:
-flink: [1.16-SNAPSHOT, 1.17-SNAPSHOT]
+flink_branches: [{
+ flink: 1.16-SNAPSHOT,
+ branch: main
+}, {
+ flink: 1.17-SNAPSHOT,
+ branch: main
+}, {
+ flink: 1.18-SNAPSHOT,
+ jdk: '8, 11, 17',
+ branch: main
+}, {
+ flink: 1.19-SNAPSHOT,
+ jdk: '8, 11, 17, 21',
+ branch: main
+}, {
+ flink: 1.16.2,
+ branch: v3.0
+}, {
+ flink: 1.17.1,
+ branch: v3.0
+}, {
+ flink: 1.18.0,
+ jdk: '8, 11, 17',
+ branch: v3.0
+}]
uses: apache/flink-connector-shared-utils/.github/workflows/ci.yml@ci_utils
with:
- flink_version: ${{ matrix.flink }}
- run_dependency_convergence: false
+ flink_version: ${{ matrix.flink_branches.flink }}
+ connector_branch: ${{ matrix.flink_branches.branch }}
+ jdk_version: ${{ matrix.flink_branches.jdk || '8, 11' }}
+ run_dependency_convergence: false
\ No newline at end of file
diff --git a/flink-connector-rabbitmq/pom.xml b/flink-connector-rabbitmq/pom.xml
index a8fa213..fc6d527 100644
--- a/flink-connector-rabbitmq/pom.xml
+++ b/flink-connector-rabbitmq/pom.xml
@@ -91,4 +91,34 @@ under the License.
+
+
+ run-end-to-end-tests
+
+
+
+
org.apache.maven.plugins
+
maven-surefire-plugin
+
+
+
end-to-end-tests
+
integration-test
+
+
(flink-connector-rabbitmq) branch main updated: [hotfix] Update Flink version for weekly tests from 1.16.2 to 1.16.3 and from 1.17.1 to 1.17.2
This is an automated email from the ASF dual-hosted git repository.
martijnvisser pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/flink-connector-rabbitmq.git
The following commit(s) were added to refs/heads/main by this push:
new 3d717b2 [hotfix] Update Flink version for weekly tests from 1.16.2 to
1.16.3 and from 1.17.1 to 1.17.2
3d717b2 is described below
commit 3d717b21db41dba2561f11fcb93423ad0aabccd4
Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com>
AuthorDate: Fri Jan 12 10:12:50 2024 +0100
[hotfix] Update Flink version for weekly tests from 1.16.2 to 1.16.3 and
from 1.17.1 to 1.17.2
---
.github/workflows/weekly.yml | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git a/.github/workflows/weekly.yml b/.github/workflows/weekly.yml
index cf31d3e..f7396ed 100644
--- a/.github/workflows/weekly.yml
+++ b/.github/workflows/weekly.yml
@@ -41,10 +41,10 @@ jobs:
jdk: '8, 11, 17, 21',
branch: main
}, {
- flink: 1.16.2,
+ flink: 1.16.3,
branch: v3.0
}, {
- flink: 1.17.1,
+ flink: 1.17.2,
branch: v3.0
}, {
flink: 1.18.0,
(flink-connector-rabbitmq) branch v3.0 updated: [hotfix] Set copyright year to 2024
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a commit to branch v3.0 in repository https://gitbox.apache.org/repos/asf/flink-connector-rabbitmq.git The following commit(s) were added to refs/heads/v3.0 by this push: new d7797a4 [hotfix] Set copyright year to 2024 d7797a4 is described below commit d7797a4066fbc4eb71cedf14ff5b77b9a5df2793 Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com> AuthorDate: Fri Jan 12 10:11:18 2024 +0100 [hotfix] Set copyright year to 2024 --- NOTICE | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/NOTICE b/NOTICE index cbd559e..b3d91aa 100644 --- a/NOTICE +++ b/NOTICE @@ -1,5 +1,5 @@ Apache Flink RabbitMQ Connector -Copyright 2014-2023 The Apache Software Foundation +Copyright 2014-2024 The Apache Software Foundation This product includes software developed at The Apache Software Foundation (http://www.apache.org/).
(flink-connector-rabbitmq) branch v3.0 updated: [FLINK-30417][Connectors/RabbitMQ] Add "RabbitMQ" to the error while creating the channel and failing. This closes #4
This is an automated email from the ASF dual-hosted git repository.
martijnvisser pushed a commit to branch v3.0
in repository https://gitbox.apache.org/repos/asf/flink-connector-rabbitmq.git
The following commit(s) were added to refs/heads/v3.0 by this push:
new 702f0bd [FLINK-30417][Connectors/RabbitMQ] Add "RabbitMQ" to the
error while creating the channel and failing. This closes #4
702f0bd is described below
commit 702f0bd687eca2ca1f460fef9229f3db213c1803
Author: Yaron Shani
AuthorDate: Tue Dec 20 17:06:27 2022 +0200
[FLINK-30417][Connectors/RabbitMQ] Add "RabbitMQ" to the error while
creating the channel and failing. This closes #4
(cherry picked from commit 967f713257bf7e933c04808c857b0e549071b863)
---
.../java/org/apache/flink/streaming/connectors/rabbitmq/RMQSink.java| 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git
a/flink-connector-rabbitmq/src/main/java/org/apache/flink/streaming/connectors/rabbitmq/RMQSink.java
b/flink-connector-rabbitmq/src/main/java/org/apache/flink/streaming/connectors/rabbitmq/RMQSink.java
index d0eb0ef..6ebeb1f 100644
---
a/flink-connector-rabbitmq/src/main/java/org/apache/flink/streaming/connectors/rabbitmq/RMQSink.java
+++
b/flink-connector-rabbitmq/src/main/java/org/apache/flink/streaming/connectors/rabbitmq/RMQSink.java
@@ -181,7 +181,7 @@ public class RMQSink extends RichSinkFunction {
channel.addReturnListener(returnListener);
}
} catch (IOException e) {
-throw new RuntimeException("Error while creating the channel", e);
+throw new RuntimeException("Error while creating the RabbitMQ
channel", e);
}
}
(flink-connector-rabbitmq) branch main updated: [FLINK-34020] Bump CI flink version on flink-connector-rabbitmq. This closes #22
This is an automated email from the ASF dual-hosted git repository.
martijnvisser pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/flink-connector-rabbitmq.git
The following commit(s) were added to refs/heads/main by this push:
new 33d125f [FLINK-34020] Bump CI flink version on
flink-connector-rabbitmq. This closes #22
33d125f is described below
commit 33d125f591cc5f99e12280fbe2725bd374f7738b
Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com>
AuthorDate: Fri Jan 12 09:35:00 2024 +0100
[FLINK-34020] Bump CI flink version on flink-connector-rabbitmq. This
closes #22
* [FLINK-34020] Bump CI flink version on flink-connector-rabbitmq
* [hotfix] Set lowest supported Flink version to 1.16.0 since that's still
supported
* [hotfix] Set copyright year to 2024
-
Co-authored-by: Hang Ruan
Co-authored-by: Sergey Nuyanzin
---
.github/workflows/push_pr.yml | 12 -
.github/workflows/weekly.yml | 11 +++-
NOTICE | 2 +-
flink-connector-rabbitmq/pom.xml | 30 +++
.../streaming/connectors/rabbitmq/RMQSource.java | 4 ++
.../rabbitmq/test/DockerImageVersions.java | 2 +-
pom.xml| 61 +-
7 files changed, 104 insertions(+), 18 deletions(-)
diff --git a/.github/workflows/push_pr.yml b/.github/workflows/push_pr.yml
index e84ea7d..6404e34 100644
--- a/.github/workflows/push_pr.yml
+++ b/.github/workflows/push_pr.yml
@@ -23,6 +23,16 @@ concurrency:
cancel-in-progress: true
jobs:
compile_and_test:
+strategy:
+ matrix:
+flink: [ 1.16-SNAPSHOT, 1.17-SNAPSHOT ]
+jdk: [ '8, 11' ]
+include:
+ - flink: 1.18-SNAPSHOT
+jdk: '8, 11, 17'
+ - flink: 1.19-SNAPSHOT
+jdk: '8, 11, 17, 21'
uses: apache/flink-connector-shared-utils/.github/workflows/ci.yml@ci_utils
with:
- flink_version: 1.17.0
\ No newline at end of file
+ flink_version: ${{ matrix.flink }}
+ jdk_version: ${{ matrix.jdk }}
\ No newline at end of file
diff --git a/.github/workflows/weekly.yml b/.github/workflows/weekly.yml
index c62cb13..cf31d3e 100644
--- a/.github/workflows/weekly.yml
+++ b/.github/workflows/weekly.yml
@@ -34,6 +34,11 @@ jobs:
branch: main
}, {
flink: 1.18-SNAPSHOT,
+ jdk: '8, 11, 17',
+ branch: main
+}, {
+ flink: 1.19-SNAPSHOT,
+ jdk: '8, 11, 17, 21',
branch: main
}, {
flink: 1.16.2,
@@ -42,11 +47,13 @@ jobs:
flink: 1.17.1,
branch: v3.0
}, {
- flink: 1.18-SNAPSHOT,
+ flink: 1.18.0,
+ jdk: '8, 11, 17',
branch: v3.0
}]
uses: apache/flink-connector-shared-utils/.github/workflows/ci.yml@ci_utils
with:
flink_version: ${{ matrix.flink_branches.flink }}
connector_branch: ${{ matrix.flink_branches.branch }}
- run_dependency_convergence: false
+ jdk_version: ${{ matrix.flink_branches.jdk || '8, 11' }}
+ run_dependency_convergence: false
\ No newline at end of file
diff --git a/NOTICE b/NOTICE
index cbd559e..b3d91aa 100644
--- a/NOTICE
+++ b/NOTICE
@@ -1,5 +1,5 @@
Apache Flink RabbitMQ Connector
-Copyright 2014-2023 The Apache Software Foundation
+Copyright 2014-2024 The Apache Software Foundation
This product includes software developed at
The Apache Software Foundation (http://www.apache.org/).
diff --git a/flink-connector-rabbitmq/pom.xml b/flink-connector-rabbitmq/pom.xml
index a8fa213..fc6d527 100644
--- a/flink-connector-rabbitmq/pom.xml
+++ b/flink-connector-rabbitmq/pom.xml
@@ -91,4 +91,34 @@ under the License.
+
+
+ run-end-to-end-tests
+
+
+
+
org.apache.maven.plugins
+
maven-surefire-plugin
+
+
+
end-to-end-tests
+
integration-test
+
+
svn commit: r66529 - /dev/flink/flink-shaded-18.0-rc1/ /release/flink/flink-shaded-18.0/
Author: martijnvisser Date: Wed Jan 10 08:21:48 2024 New Revision: 66529 Log: Release Flink-shaded 18.0 Added: release/flink/flink-shaded-18.0/ - copied from r66528, dev/flink/flink-shaded-18.0-rc1/ Removed: dev/flink/flink-shaded-18.0-rc1/
(flink-connector-elasticsearch) branch main updated: [FLINK-34002] Bump CI flink version on flink-connector-elasticsearch to support Flink 1.19. This closes #86
This is an automated email from the ASF dual-hosted git repository.
martijnvisser pushed a commit to branch main
in repository
https://gitbox.apache.org/repos/asf/flink-connector-elasticsearch.git
The following commit(s) were added to refs/heads/main by this push:
new 52f2afd [FLINK-34002] Bump CI flink version on
flink-connector-elasticsearch to support Flink 1.19. This closes #86
52f2afd is described below
commit 52f2afdda90d4d8881d64e6d13c8c8f8b94eb922
Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com>
AuthorDate: Mon Jan 8 13:07:24 2024 +0100
[FLINK-34002] Bump CI flink version on flink-connector-elasticsearch to
support Flink 1.19. This closes #86
* [FLINK-34002] Bump CI Flink version on flink-connector-elasticsearch to
support Flink 1.19
* [FLINK-34002] Java 17 support for connector
* Make tests passing for jdk 17+
-
Co-authored-by: Sergey Nuyanzin
---
.github/workflows/push_pr.yml| 9 -
.github/workflows/weekly.yml | 7 +++
.../flink-connector-elasticsearch6-e2e-tests/pom.xml | 2 ++
.../flink-connector-elasticsearch7-e2e-tests/pom.xml | 2 ++
flink-connector-elasticsearch-e2e-tests/pom.xml | 6 ++
flink-connector-elasticsearch6/pom.xml | 2 ++
flink-connector-elasticsearch7/pom.xml | 2 ++
pom.xml | 3 +++
8 files changed, 32 insertions(+), 1 deletion(-)
diff --git a/.github/workflows/push_pr.yml b/.github/workflows/push_pr.yml
index 0527357..9d349c0 100644
--- a/.github/workflows/push_pr.yml
+++ b/.github/workflows/push_pr.yml
@@ -25,7 +25,14 @@ jobs:
compile_and_test:
strategy:
matrix:
-flink: [1.17.1, 1.18.0, 1.19-SNAPSHOT]
+flink: [ 1.16-SNAPSHOT, 1.17-SNAPSHOT ]
+jdk: [ '8, 11' ]
+include:
+ - flink: 1.18-SNAPSHOT
+jdk: '8, 11, 17'
+ - flink: 1.19-SNAPSHOT
+jdk: '8, 11, 17, 21'
uses: apache/flink-connector-shared-utils/.github/workflows/ci.yml@ci_utils
with:
flink_version: ${{ matrix.flink }}
+ jdk_version: ${{ matrix.jdk }}
diff --git a/.github/workflows/weekly.yml b/.github/workflows/weekly.yml
index f5b46f0..19904b2 100644
--- a/.github/workflows/weekly.yml
+++ b/.github/workflows/weekly.yml
@@ -34,9 +34,11 @@ jobs:
branch: main
}, {
flink: 1.18-SNAPSHOT,
+ jdk: '8, 11, 17',
branch: main
}, {
flink: 1.19-SNAPSHOT,
+ jdk: '8, 11, 17, 21',
branch: main
}, {
flink: 1.16.2,
@@ -44,9 +46,14 @@ jobs:
}, {
flink: 1.17.1,
branch: v3.0
+}, {
+ flink: 1.18.0,
+ jdk: '8, 11, 17',
+ branch: v3.0
}]
uses: apache/flink-connector-shared-utils/.github/workflows/ci.yml@ci_utils
with:
flink_version: ${{ matrix.flink_branches.flink }}
connector_branch: ${{ matrix.flink_branches.branch }}
+ jdk_version: ${{ matrix.flink_branches.jdk || '8, 11' }}
run_dependency_convergence: false
diff --git
a/flink-connector-elasticsearch-e2e-tests/flink-connector-elasticsearch6-e2e-tests/pom.xml
b/flink-connector-elasticsearch-e2e-tests/flink-connector-elasticsearch6-e2e-tests/pom.xml
index a4bf490..d778c61 100644
---
a/flink-connector-elasticsearch-e2e-tests/flink-connector-elasticsearch6-e2e-tests/pom.xml
+++
b/flink-connector-elasticsearch-e2e-tests/flink-connector-elasticsearch6-e2e-tests/pom.xml
@@ -35,6 +35,8 @@ under the License.
6.8.20
+
--add-opens=java.base/java.util=ALL-UNNAMED
diff --git
a/flink-connector-elasticsearch-e2e-tests/flink-connector-elasticsearch7-e2e-tests/pom.xml
b/flink-connector-elasticsearch-e2e-tests/flink-connector-elasticsearch7-e2e-tests/pom.xml
index 78ec83a..617be40 100644
---
a/flink-connector-elasticsearch-e2e-tests/flink-connector-elasticsearch7-e2e-tests/pom.xml
+++
b/flink-connector-elasticsearch-e2e-tests/flink-connector-elasticsearch7-e2e-tests/pom.xml
@@ -35,6 +35,8 @@ under the License.
7.10.2
+
--add-opens=java.base/java.util=ALL-UNNAMED
diff --git a/flink-connector-elasticsearch-e2e-tests/pom.xml
b/flink-connector-elasticsearch-e2e-tests/pom.xml
index 1114edc..c7f8a4b 100644
--- a/flink-connector-elasticsearch-e2e-tests/pom.xml
+++ b/flink-connector-elasticsearch-e2e-tests/pom.xml
@@ -39,6 +39,11 @@ under the License.
flink-connector-elasticsearch7-e2e-tests
+
+
--add-opens=java.base/java.util=ALL-UNNAMED
+
+
run-end-to-end-tests
@@ -63,6 +68,7 @@ under the L
(flink-connector-rabbitmq) branch v3.0 updated: [FLINK-34019] Bump com.rabbitmq:amqp-client from 5.13.1 to 5.20.0. This closes #18
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a commit to branch v3.0 in repository https://gitbox.apache.org/repos/asf/flink-connector-rabbitmq.git The following commit(s) were added to refs/heads/v3.0 by this push: new 881c83b [FLINK-34019] Bump com.rabbitmq:amqp-client from 5.13.1 to 5.20.0. This closes #18 881c83b is described below commit 881c83b5daf3a4e48a8027f85dff1f1f99dc6f81 Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> AuthorDate: Mon Jan 8 11:05:28 2024 +0100 [FLINK-34019] Bump com.rabbitmq:amqp-client from 5.13.1 to 5.20.0. This closes #18 * Bump com.rabbitmq:amqp-client in /flink-connector-rabbitmq Bumps [com.rabbitmq:amqp-client](https://github.com/rabbitmq/rabbitmq-java-client) from 5.13.1 to 5.18.0. - [Release notes](https://github.com/rabbitmq/rabbitmq-java-client/releases) - [Commits](https://github.com/rabbitmq/rabbitmq-java-client/compare/v5.13.1...v5.18.0) --- updated-dependencies: - dependency-name: com.rabbitmq:amqp-client dependency-type: direct:production ... Signed-off-by: dependabot[bot] * Bump com.rabbitmq:amqp-client in /flink-connector-rabbitmq - Signed-off-by: dependabot[bot] Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Martijn Visser <2989614+martijnvis...@users.noreply.github.com> (cherry picked from commit 427bf4cd9fbf27d338a33250257489491952aeb8) --- flink-connector-rabbitmq/pom.xml| 2 +- flink-sql-connector-rabbitmq/src/main/resources/META-INF/NOTICE | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/flink-connector-rabbitmq/pom.xml b/flink-connector-rabbitmq/pom.xml index b2f5dcf..a8fa213 100644 --- a/flink-connector-rabbitmq/pom.xml +++ b/flink-connector-rabbitmq/pom.xml @@ -36,7 +36,7 @@ under the License. - 5.13.1 + 5.20.0 diff --git a/flink-sql-connector-rabbitmq/src/main/resources/META-INF/NOTICE b/flink-sql-connector-rabbitmq/src/main/resources/META-INF/NOTICE index 9cdf920..e4f475f 100644 --- a/flink-sql-connector-rabbitmq/src/main/resources/META-INF/NOTICE +++ b/flink-sql-connector-rabbitmq/src/main/resources/META-INF/NOTICE @@ -6,4 +6,4 @@ The Apache Software Foundation (http://www.apache.org/). This project bundles the following dependencies under the Apache Software License 2.0 (http://www.apache.org/licenses/LICENSE-2.0.txt) -- com.rabbitmq:amqp-client:5.13.1 +- com.rabbitmq:amqp-client:5.20.0
(flink-connector-rabbitmq) branch dependabot/maven/flink-connector-rabbitmq/com.rabbitmq-amqp-client-5.18.0 deleted (was b565135)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to branch dependabot/maven/flink-connector-rabbitmq/com.rabbitmq-amqp-client-5.18.0 in repository https://gitbox.apache.org/repos/asf/flink-connector-rabbitmq.git was b565135 Bump com.rabbitmq:amqp-client in /flink-connector-rabbitmq The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(flink-connector-rabbitmq) branch main updated: [FLINK-34019] Bump com.rabbitmq:amqp-client from 5.13.1 to 5.20.0. This closes #18
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-rabbitmq.git The following commit(s) were added to refs/heads/main by this push: new 427bf4c [FLINK-34019] Bump com.rabbitmq:amqp-client from 5.13.1 to 5.20.0. This closes #18 427bf4c is described below commit 427bf4cd9fbf27d338a33250257489491952aeb8 Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> AuthorDate: Mon Jan 8 11:05:28 2024 +0100 [FLINK-34019] Bump com.rabbitmq:amqp-client from 5.13.1 to 5.20.0. This closes #18 * Bump com.rabbitmq:amqp-client in /flink-connector-rabbitmq Bumps [com.rabbitmq:amqp-client](https://github.com/rabbitmq/rabbitmq-java-client) from 5.13.1 to 5.18.0. - [Release notes](https://github.com/rabbitmq/rabbitmq-java-client/releases) - [Commits](https://github.com/rabbitmq/rabbitmq-java-client/compare/v5.13.1...v5.18.0) --- updated-dependencies: - dependency-name: com.rabbitmq:amqp-client dependency-type: direct:production ... Signed-off-by: dependabot[bot] * Bump com.rabbitmq:amqp-client in /flink-connector-rabbitmq - Signed-off-by: dependabot[bot] Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Martijn Visser <2989614+martijnvis...@users.noreply.github.com> --- flink-connector-rabbitmq/pom.xml| 2 +- flink-sql-connector-rabbitmq/src/main/resources/META-INF/NOTICE | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/flink-connector-rabbitmq/pom.xml b/flink-connector-rabbitmq/pom.xml index b2f5dcf..a8fa213 100644 --- a/flink-connector-rabbitmq/pom.xml +++ b/flink-connector-rabbitmq/pom.xml @@ -36,7 +36,7 @@ under the License. - 5.13.1 + 5.20.0 diff --git a/flink-sql-connector-rabbitmq/src/main/resources/META-INF/NOTICE b/flink-sql-connector-rabbitmq/src/main/resources/META-INF/NOTICE index 9cdf920..e4f475f 100644 --- a/flink-sql-connector-rabbitmq/src/main/resources/META-INF/NOTICE +++ b/flink-sql-connector-rabbitmq/src/main/resources/META-INF/NOTICE @@ -6,4 +6,4 @@ The Apache Software Foundation (http://www.apache.org/). This project bundles the following dependencies under the Apache Software License 2.0 (http://www.apache.org/licenses/LICENSE-2.0.txt) -- com.rabbitmq:amqp-client:5.13.1 +- com.rabbitmq:amqp-client:5.20.0
(flink-connector-rabbitmq) branch dependabot/maven/flink-connector-rabbitmq/com.rabbitmq-amqp-client-5.18.0 updated (727fe27 -> b565135)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to branch dependabot/maven/flink-connector-rabbitmq/com.rabbitmq-amqp-client-5.18.0 in repository https://gitbox.apache.org/repos/asf/flink-connector-rabbitmq.git from 727fe27 Bump com.rabbitmq:amqp-client in /flink-connector-rabbitmq add b565135 Bump com.rabbitmq:amqp-client in /flink-connector-rabbitmq No new revisions were added by this update. Summary of changes: flink-connector-rabbitmq/pom.xml| 2 +- flink-sql-connector-rabbitmq/src/main/resources/META-INF/NOTICE | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-)
(flink-connector-rabbitmq) branch v3.0 updated: [FLINK-26907] RMQSourceITCase failed on Azure due to container startup failed. This closes #20
This is an automated email from the ASF dual-hosted git repository.
martijnvisser pushed a commit to branch v3.0
in repository https://gitbox.apache.org/repos/asf/flink-connector-rabbitmq.git
The following commit(s) were added to refs/heads/v3.0 by this push:
new 8672727 [FLINK-26907] RMQSourceITCase failed on Azure due to
container startup failed. This closes #20
8672727 is described below
commit 8672727f3643f19c951afcf20369ccf06aea9b56
Author: yuxiang <384669...@qq.com>
AuthorDate: Mon Jan 8 17:00:24 2024 +0800
[FLINK-26907] RMQSourceITCase failed on Azure due to container startup
failed. This closes #20
Co-authored-by: yu <13485876233>
(cherry picked from commit 7203c951987412c669e9b7ca75d5a8584b2b8c80)
---
.../apache/flink/streaming/connectors/rabbitmq/RMQSourceITCase.java| 3 ++-
1 file changed, 2 insertions(+), 1 deletion(-)
diff --git
a/flink-connector-rabbitmq/src/test/java/org/apache/flink/streaming/connectors/rabbitmq/RMQSourceITCase.java
b/flink-connector-rabbitmq/src/test/java/org/apache/flink/streaming/connectors/rabbitmq/RMQSourceITCase.java
index a245d54..db3a32e 100644
---
a/flink-connector-rabbitmq/src/test/java/org/apache/flink/streaming/connectors/rabbitmq/RMQSourceITCase.java
+++
b/flink-connector-rabbitmq/src/test/java/org/apache/flink/streaming/connectors/rabbitmq/RMQSourceITCase.java
@@ -88,7 +88,8 @@ public class RMQSourceITCase {
public static final RabbitMQContainer RMQ_CONTAINER =
new
RabbitMQContainer(DockerImageName.parse(DockerImageVersions.RABBITMQ))
.withExposedPorts(RABBITMQ_PORT)
-.withLogConsumer(LOG_CONSUMER);
+.withLogConsumer(LOG_CONSUMER)
+.withStartupAttempts(3);
@Before
public void setUp() throws Exception {
(flink-connector-rabbitmq) branch main updated: [FLINK-26907] RMQSourceITCase failed on Azure due to container startup failed. This closes #20
This is an automated email from the ASF dual-hosted git repository.
martijnvisser pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/flink-connector-rabbitmq.git
The following commit(s) were added to refs/heads/main by this push:
new 7203c95 [FLINK-26907] RMQSourceITCase failed on Azure due to
container startup failed. This closes #20
7203c95 is described below
commit 7203c951987412c669e9b7ca75d5a8584b2b8c80
Author: yuxiang <384669...@qq.com>
AuthorDate: Mon Jan 8 17:00:24 2024 +0800
[FLINK-26907] RMQSourceITCase failed on Azure due to container startup
failed. This closes #20
Co-authored-by: yu <13485876233>
---
.../apache/flink/streaming/connectors/rabbitmq/RMQSourceITCase.java| 3 ++-
1 file changed, 2 insertions(+), 1 deletion(-)
diff --git
a/flink-connector-rabbitmq/src/test/java/org/apache/flink/streaming/connectors/rabbitmq/RMQSourceITCase.java
b/flink-connector-rabbitmq/src/test/java/org/apache/flink/streaming/connectors/rabbitmq/RMQSourceITCase.java
index a245d54..db3a32e 100644
---
a/flink-connector-rabbitmq/src/test/java/org/apache/flink/streaming/connectors/rabbitmq/RMQSourceITCase.java
+++
b/flink-connector-rabbitmq/src/test/java/org/apache/flink/streaming/connectors/rabbitmq/RMQSourceITCase.java
@@ -88,7 +88,8 @@ public class RMQSourceITCase {
public static final RabbitMQContainer RMQ_CONTAINER =
new
RabbitMQContainer(DockerImageName.parse(DockerImageVersions.RABBITMQ))
.withExposedPorts(RABBITMQ_PORT)
-.withLogConsumer(LOG_CONSUMER);
+.withLogConsumer(LOG_CONSUMER)
+.withStartupAttempts(3);
@Before
public void setUp() throws Exception {
(flink-connector-hbase) annotated tag v3.0.1-rc1 updated (b968737 -> 2129704)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to annotated tag v3.0.1-rc1 in repository https://gitbox.apache.org/repos/asf/flink-connector-hbase.git *** WARNING: tag v3.0.1-rc1 was modified! *** from b968737 (commit) to 2129704 (tag) tagging b9687379e14644ebe4e21e6a3853187c47e2bed9 (commit) by Martijn Visser on Fri Jan 5 15:48:26 2024 +0100 - Log - v3.0.1-rc1 -BEGIN PGP SIGNATURE- iHUEABYKAB0WIQSl87zky+mTVz7FlmplMhuDgrIZrwUCZZgWugAKCRBlMhuDgrIZ r8ECAQCFivJDQkcNgdl80R5ar5DTxcweLZsK6fKv49cnI6Bu2gEAwwvuQVGD03kf 8kwmUm/z8c2Ztf9HZ78Qt1t6Z/vPXwI= =ayHu -END PGP SIGNATURE- --- No new revisions were added by this update. Summary of changes:
svn commit: r66434 - in /dev/flink/flink-connector-hbase-3.0.1-rc1: ./ flink-connector-hbase-3.0.1-src.tgz flink-connector-hbase-3.0.1-src.tgz.asc flink-connector-hbase-3.0.1-src.tgz.sha512
Author: martijnvisser Date: Fri Jan 5 14:48:47 2024 New Revision: 66434 Log: Add flink-connector-hbase-3.0.1-rc1 Added: dev/flink/flink-connector-hbase-3.0.1-rc1/ dev/flink/flink-connector-hbase-3.0.1-rc1/flink-connector-hbase-3.0.1-src.tgz (with props) dev/flink/flink-connector-hbase-3.0.1-rc1/flink-connector-hbase-3.0.1-src.tgz.asc dev/flink/flink-connector-hbase-3.0.1-rc1/flink-connector-hbase-3.0.1-src.tgz.sha512 Added: dev/flink/flink-connector-hbase-3.0.1-rc1/flink-connector-hbase-3.0.1-src.tgz == Binary file - no diff available. Propchange: dev/flink/flink-connector-hbase-3.0.1-rc1/flink-connector-hbase-3.0.1-src.tgz -- svn:mime-type = application/octet-stream Added: dev/flink/flink-connector-hbase-3.0.1-rc1/flink-connector-hbase-3.0.1-src.tgz.asc == --- dev/flink/flink-connector-hbase-3.0.1-rc1/flink-connector-hbase-3.0.1-src.tgz.asc (added) +++ dev/flink/flink-connector-hbase-3.0.1-rc1/flink-connector-hbase-3.0.1-src.tgz.asc Fri Jan 5 14:48:47 2024 @@ -0,0 +1,7 @@ +-BEGIN PGP SIGNATURE- + +iHUEABYKAB0WIQSl87zky+mTVz7FlmplMhuDgrIZrwUCZZgWxAAKCRBlMhuDgrIZ +r+kVAP95W+64PDroXou5fumpbUDbDVKemTvxOaflWJW4tpVALAEAk2KMa+pF6sHQ +1QBCX+tfVEc2YdJVtNVEbdo9s9WHuwA= +=YK53 +-END PGP SIGNATURE- Added: dev/flink/flink-connector-hbase-3.0.1-rc1/flink-connector-hbase-3.0.1-src.tgz.sha512 == --- dev/flink/flink-connector-hbase-3.0.1-rc1/flink-connector-hbase-3.0.1-src.tgz.sha512 (added) +++ dev/flink/flink-connector-hbase-3.0.1-rc1/flink-connector-hbase-3.0.1-src.tgz.sha512 Fri Jan 5 14:48:47 2024 @@ -0,0 +1 @@ +fc390efb59ad994bc3ef7967948392874e9a7ff072a71427b8aeceb122b2a69bd3e07f451f26ca118bf97f5733732c33f66e137b768bb18024e4c11aad306c1f flink-connector-hbase-3.0.1-src.tgz
(flink-connector-elasticsearch) branch main updated: [hotfix] Update copyright year to 2024
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-elasticsearch.git The following commit(s) were added to refs/heads/main by this push: new c0e9efd [hotfix] Update copyright year to 2024 c0e9efd is described below commit c0e9efda750c97233b219d0926f29fd05100d510 Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com> AuthorDate: Fri Jan 5 15:27:07 2024 +0100 [hotfix] Update copyright year to 2024 --- NOTICE | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/NOTICE b/NOTICE index e9934a4..9c19657 100644 --- a/NOTICE +++ b/NOTICE @@ -1,5 +1,5 @@ Apache Flink Elasticsearch Connector -Copyright 2014-2023 The Apache Software Foundation +Copyright 2014-2024 The Apache Software Foundation This product includes software developed at The Apache Software Foundation (http://www.apache.org/).
(flink-connector-elasticsearch) branch v3.0 updated: [hotfix] Update copyright year to 2024
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a commit to branch v3.0 in repository https://gitbox.apache.org/repos/asf/flink-connector-elasticsearch.git The following commit(s) were added to refs/heads/v3.0 by this push: new d5cc749 [hotfix] Update copyright year to 2024 d5cc749 is described below commit d5cc749278b8bf65a6846f59aa2fefd41fdfa314 Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com> AuthorDate: Fri Jan 5 15:27:07 2024 +0100 [hotfix] Update copyright year to 2024 --- NOTICE | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/NOTICE b/NOTICE index 3745571..9c19657 100644 --- a/NOTICE +++ b/NOTICE @@ -1,5 +1,5 @@ Apache Flink Elasticsearch Connector -Copyright 2014-2022 The Apache Software Foundation +Copyright 2014-2024 The Apache Software Foundation This product includes software developed at The Apache Software Foundation (http://www.apache.org/).
(flink-connector-hbase) branch main updated: [hotfix] Remove 1.19-SNAPSHOT since HBase currently can't compile for that version
This is an automated email from the ASF dual-hosted git repository.
martijnvisser pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/flink-connector-hbase.git
The following commit(s) were added to refs/heads/main by this push:
new 42870d5 [hotfix] Remove 1.19-SNAPSHOT since HBase currently can't
compile for that version
42870d5 is described below
commit 42870d5999e9762f814c4442910bed2bd123113c
Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com>
AuthorDate: Fri Jan 5 15:23:49 2024 +0100
[hotfix] Remove 1.19-SNAPSHOT since HBase currently can't compile for that
version
---
.github/workflows/push_pr.yml | 2 +-
.github/workflows/weekly.yml | 3 ---
2 files changed, 1 insertion(+), 4 deletions(-)
diff --git a/.github/workflows/push_pr.yml b/.github/workflows/push_pr.yml
index 317796b..6127ba6 100644
--- a/.github/workflows/push_pr.yml
+++ b/.github/workflows/push_pr.yml
@@ -25,7 +25,7 @@ jobs:
compile_and_test:
strategy:
matrix:
-flink: [1.16.2, 1.17.1, 1.18.0, 1.19-SNAPSHOT]
+flink: [1.16.2, 1.17.1, 1.18.0]
uses: apache/flink-connector-shared-utils/.github/workflows/ci.yml@ci_utils
with:
flink_version: ${{ matrix.flink }}
diff --git a/.github/workflows/weekly.yml b/.github/workflows/weekly.yml
index 8cadbe0..4613879 100644
--- a/.github/workflows/weekly.yml
+++ b/.github/workflows/weekly.yml
@@ -44,9 +44,6 @@ jobs:
}, {
flink: 1.18-SNAPSHOT,
branch: main
-}, {
- flink: 1.19-SNAPSHOT,
- branch: main
}]
uses: apache/flink-connector-shared-utils/.github/workflows/ci.yml@ci_utils
with:
(flink-connector-hbase) branch main updated: [hotfix] Test HBase `v3.0` also against 1.18.0 and `main` also against 1.19-SNAPSHOT
This is an automated email from the ASF dual-hosted git repository.
martijnvisser pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/flink-connector-hbase.git
The following commit(s) were added to refs/heads/main by this push:
new 8008c8d [hotfix] Test HBase `v3.0` also against 1.18.0 and `main`
also against 1.19-SNAPSHOT
8008c8d is described below
commit 8008c8d5451595bbe1515861c55cbf9bfc514ea1
Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com>
AuthorDate: Fri Jan 5 15:15:17 2024 +0100
[hotfix] Test HBase `v3.0` also against 1.18.0 and `main` also against
1.19-SNAPSHOT
---
.github/workflows/push_pr.yml | 2 +-
.github/workflows/weekly.yml | 10 --
2 files changed, 9 insertions(+), 3 deletions(-)
diff --git a/.github/workflows/push_pr.yml b/.github/workflows/push_pr.yml
index b575b3c..317796b 100644
--- a/.github/workflows/push_pr.yml
+++ b/.github/workflows/push_pr.yml
@@ -25,7 +25,7 @@ jobs:
compile_and_test:
strategy:
matrix:
-flink: [1.16.2, 1.17.1, 1.18-SNAPSHOT]
+flink: [1.16.2, 1.17.1, 1.18.0, 1.19-SNAPSHOT]
uses: apache/flink-connector-shared-utils/.github/workflows/ci.yml@ci_utils
with:
flink_version: ${{ matrix.flink }}
diff --git a/.github/workflows/weekly.yml b/.github/workflows/weekly.yml
index 76c2158..8cadbe0 100644
--- a/.github/workflows/weekly.yml
+++ b/.github/workflows/weekly.yml
@@ -33,14 +33,20 @@ jobs:
flink: 1.17.1,
branch: v3.0
}, {
- flink: 1.16.2,
+ flink: 1.18.0,
+ branch: v3.0
+}, {
+ flink: 1.16-SNAPSHOT,
branch: main
}, {
- flink: 1.17.1,
+ flink: 1.17-SNAPSHOT,
branch: main
}, {
flink: 1.18-SNAPSHOT,
branch: main
+}, {
+ flink: 1.19-SNAPSHOT,
+ branch: main
}]
uses: apache/flink-connector-shared-utils/.github/workflows/ci.yml@ci_utils
with:
(flink-connector-hbase) branch main updated: [hotfix] Update copyright year to 2024
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-hbase.git The following commit(s) were added to refs/heads/main by this push: new d61c3c5 [hotfix] Update copyright year to 2024 d61c3c5 is described below commit d61c3c5db954dbda15cbf96d95bca41b5b20729c Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com> AuthorDate: Fri Jan 5 15:11:33 2024 +0100 [hotfix] Update copyright year to 2024 --- NOTICE | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/NOTICE b/NOTICE index f91f4cf..7f69208 100644 --- a/NOTICE +++ b/NOTICE @@ -1,5 +1,5 @@ Apache Flink HBase Connector -Copyright 2014-2023 The Apache Software Foundation +Copyright 2014-2024 The Apache Software Foundation This product includes software developed at The Apache Software Foundation (http://www.apache.org/).
(flink-connector-hbase) branch v3.0 updated: [hotfix] Update copyright year to 2024
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a commit to branch v3.0 in repository https://gitbox.apache.org/repos/asf/flink-connector-hbase.git The following commit(s) were added to refs/heads/v3.0 by this push: new 07cd4fe [hotfix] Update copyright year to 2024 07cd4fe is described below commit 07cd4fea262f4c51abeaa7744c548a86b616a375 Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com> AuthorDate: Fri Jan 5 15:11:33 2024 +0100 [hotfix] Update copyright year to 2024 --- NOTICE | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/NOTICE b/NOTICE index f91f4cf..7f69208 100644 --- a/NOTICE +++ b/NOTICE @@ -1,5 +1,5 @@ Apache Flink HBase Connector -Copyright 2014-2023 The Apache Software Foundation +Copyright 2014-2024 The Apache Software Foundation This product includes software developed at The Apache Software Foundation (http://www.apache.org/).
svn commit: r66431 - in /dev/flink/flink-connector-jdbc-3.1.2-rc1: ./ flink-connector-jdbc-3.1.2-src.tgz flink-connector-jdbc-3.1.2-src.tgz.asc flink-connector-jdbc-3.1.2-src.tgz.sha512
Author: martijnvisser Date: Fri Jan 5 13:13:47 2024 New Revision: 66431 Log: Add flink-connector-jdbc-3.1.2-rc1 Added: dev/flink/flink-connector-jdbc-3.1.2-rc1/ dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz (with props) dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz.asc dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz.sha512 Added: dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz == Binary file - no diff available. Propchange: dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz -- svn:mime-type = application/octet-stream Added: dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz.asc == --- dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz.asc (added) +++ dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz.asc Fri Jan 5 13:13:47 2024 @@ -0,0 +1,7 @@ +-BEGIN PGP SIGNATURE- + +iHUEABYKAB0WIQSl87zky+mTVz7FlmplMhuDgrIZrwUCZZgAgAAKCRBlMhuDgrIZ +r8VeAP9lllLHkPXlQcE4yT4yhvzp9wnBjbmCT1eHBiiDHIm0wAEArm8M4d6m9HEl +0ABY/4YAUDuKc/67PAZJLkn6GqvVyAk= +=CKIs +-END PGP SIGNATURE- Added: dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz.sha512 == --- dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz.sha512 (added) +++ dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz.sha512 Fri Jan 5 13:13:47 2024 @@ -0,0 +1 @@ +397bf21b0c47f81a7299f92f34836b9d36ca51c2f7c91d0ffd4745c8cd6288f5abca992e6d6bc0ede1ddd4bf6293c420a047c7a45ff10b6abf662221c1b9ca59 flink-connector-jdbc-3.1.2-src.tgz
(flink-connector-jdbc) annotated tag v3.1.2-rc1 updated (1a61515d -> 7f86d752)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to annotated tag v3.1.2-rc1 in repository https://gitbox.apache.org/repos/asf/flink-connector-jdbc.git *** WARNING: tag v3.1.2-rc1 was modified! *** from 1a61515d (commit) to 7f86d752 (tag) tagging 1a61515db9f134175ecfdf9a2cb8f020b0d41a75 (commit) by Martijn Visser on Fri Jan 5 14:13:28 2024 +0100 - Log - v3.1.2-rc1 -BEGIN PGP SIGNATURE- iHUEABYKAB0WIQSl87zky+mTVz7FlmplMhuDgrIZrwUCZZgAeAAKCRBlMhuDgrIZ r5HtAQD46S3M7XIgV7zMJL1DOtp/GFQou7YOiIUPz53khX1xUgD/YqfODXcEz783 Efmu+ZXdXHsALLA38AnaeoZHDmQr1gM= =3WNr -END PGP SIGNATURE- --- No new revisions were added by this update. Summary of changes:
(flink-connector-jdbc) annotated tag v3.1.2-rc1 deleted (was e4ab69dc)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to annotated tag v3.1.2-rc1 in repository https://gitbox.apache.org/repos/asf/flink-connector-jdbc.git *** WARNING: tag v3.1.2-rc1 was deleted! *** tag was e4ab69dc This change permanently discards the following revisions: discard cd901482 Update version to 3.1.2
svn commit: r66430 - /dev/flink/flink-connector-jdbc-3.1.2-rc1/
Author: martijnvisser Date: Fri Jan 5 13:12:32 2024 New Revision: 66430 Log: [Revert] Delete https://dist.apache.org/repos/dist/dev/flink/flink-connector-jdbc-3.1.2-rc1 Removed: dev/flink/flink-connector-jdbc-3.1.2-rc1/
(flink-connector-jdbc) branch main updated: [hotfix] Set copyright year to 2024
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-jdbc.git The following commit(s) were added to refs/heads/main by this push: new e3dd8416 [hotfix] Set copyright year to 2024 e3dd8416 is described below commit e3dd84160cd665ae17672da8b6e742e61a72a32d Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com> AuthorDate: Fri Jan 5 14:11:07 2024 +0100 [hotfix] Set copyright year to 2024 --- NOTICE | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/NOTICE b/NOTICE index 0161a58b..bafb2269 100644 --- a/NOTICE +++ b/NOTICE @@ -1,5 +1,5 @@ Apache Flink JDBC Connector -Copyright 2014-2023 The Apache Software Foundation +Copyright 2014-2024 The Apache Software Foundation This product includes software developed at The Apache Software Foundation (http://www.apache.org/).
(flink-connector-jdbc) branch v3.1 updated: [hotfix] Set copyright year to 2024
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a commit to branch v3.1 in repository https://gitbox.apache.org/repos/asf/flink-connector-jdbc.git The following commit(s) were added to refs/heads/v3.1 by this push: new 33eae1f5 [hotfix] Set copyright year to 2024 33eae1f5 is described below commit 33eae1f55368096d31a55b5dbd4e8ec15239b324 Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com> AuthorDate: Fri Jan 5 14:11:07 2024 +0100 [hotfix] Set copyright year to 2024 --- NOTICE | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/NOTICE b/NOTICE index 1553115a..bafb2269 100644 --- a/NOTICE +++ b/NOTICE @@ -1,5 +1,5 @@ Apache Flink JDBC Connector -Copyright 2014-2022 The Apache Software Foundation +Copyright 2014-2024 The Apache Software Foundation This product includes software developed at The Apache Software Foundation (http://www.apache.org/).
svn commit: r66429 - in /dev/flink/flink-connector-jdbc-3.1.2-rc1: ./ flink-connector-jdbc-3.1.2-src.tgz flink-connector-jdbc-3.1.2-src.tgz.asc flink-connector-jdbc-3.1.2-src.tgz.sha512
Author: martijnvisser Date: Fri Jan 5 12:57:57 2024 New Revision: 66429 Log: Add flink-connector-jdbc-3.1.2-rc1 Added: dev/flink/flink-connector-jdbc-3.1.2-rc1/ dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz (with props) dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz.asc dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz.sha512 Added: dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz == Binary file - no diff available. Propchange: dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz -- svn:mime-type = application/octet-stream Added: dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz.asc == --- dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz.asc (added) +++ dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz.asc Fri Jan 5 12:57:57 2024 @@ -0,0 +1,7 @@ +-BEGIN PGP SIGNATURE- + +iHUEABYKAB0WIQSl87zky+mTVz7FlmplMhuDgrIZrwUCZZf8xwAKCRBlMhuDgrIZ +r0yxAP4pmLpvetLNraj2NQ+RoepQj7atXLBYu1QC12s2tVoEBQD/a0g1QsHkmoK6 +AW1ydHK91UEnnEtIWdR21i4ThPnjLgM= +=XZes +-END PGP SIGNATURE- Added: dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz.sha512 == --- dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz.sha512 (added) +++ dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz.sha512 Fri Jan 5 12:57:57 2024 @@ -0,0 +1 @@ +6cb1351723440436231d82c521acf71c6de63ff84a59fd526f4e6780be3d768e99a73ed18d9bdcae4237f1ae5e6abf6c0efa5fbd32d246e71926c95c63249d80 flink-connector-jdbc-3.1.2-src.tgz
(flink-connector-jdbc) annotated tag v3.1.2-rc1 updated (cd901482 -> e4ab69dc)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to annotated tag v3.1.2-rc1 in repository https://gitbox.apache.org/repos/asf/flink-connector-jdbc.git *** WARNING: tag v3.1.2-rc1 was modified! *** from cd901482 (commit) to e4ab69dc (tag) tagging cd901482bf33323cabc5d710f0803b291ab8cf26 (commit) by Martijn Visser on Fri Jan 5 13:57:25 2024 +0100 - Log - v3.1.2-rc1 -BEGIN PGP SIGNATURE- iHUEABYKAB0WIQSl87zky+mTVz7FlmplMhuDgrIZrwUCZZf8tQAKCRBlMhuDgrIZ r068AP49HblfX7pGsIWhy5iio3JVnhdh3uAkYyJERL2P3crFagEA6uMHGHX4A6qQ onXtol2t5hHOtrSadhFb6LMO6yYLtQA= =ZNY3 -END PGP SIGNATURE- --- No new revisions were added by this update. Summary of changes:
(flink-connector-jdbc) annotated tag v3.1.2-rc1 deleted (was 2ac1f383)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to annotated tag v3.1.2-rc1 in repository https://gitbox.apache.org/repos/asf/flink-connector-jdbc.git *** WARNING: tag v3.1.2-rc1 was deleted! *** tag was 2ac1f383 This change permanently discards the following revisions: discard cd901482 Update version to 3.1.2
(flink-connector-jdbc) annotated tag v3.1.2-rc1 updated (cd901482 -> 2ac1f383)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to annotated tag v3.1.2-rc1 in repository https://gitbox.apache.org/repos/asf/flink-connector-jdbc.git *** WARNING: tag v3.1.2-rc1 was modified! *** from cd901482 (commit) to 2ac1f383 (tag) tagging cd901482bf33323cabc5d710f0803b291ab8cf26 (commit) by Martijn Visser on Fri Jan 5 13:41:19 2024 +0100 - Log - v3.1.2-rc1 -BEGIN PGP SIGNATURE- iHUEABYKAB0WIQSl87zky+mTVz7FlmplMhuDgrIZrwUCZZf47wAKCRBlMhuDgrIZ r+72AP91pf3paNpIbAjr3Oz4neL9y6tB1wGiAo/9Ymv8ZT6YhAEAtMCcwaGl10GW zTh0iTOXMgXJFlAjEGs0xG1jHJTRRAs= =rL6K -END PGP SIGNATURE- --- No new revisions were added by this update. Summary of changes:
(flink-connector-jdbc) annotated tag v-rc1 deleted (was 29fb0cfb)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to annotated tag v-rc1 in repository https://gitbox.apache.org/repos/asf/flink-connector-jdbc.git *** WARNING: tag v-rc1 was deleted! *** tag was 29fb0cfb This change permanently discards the following revisions: discard cd901482 Update version to 3.1.2
(flink-connector-jdbc) annotated tag v-rc1 updated (cd901482 -> 29fb0cfb)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to annotated tag v-rc1 in repository https://gitbox.apache.org/repos/asf/flink-connector-jdbc.git *** WARNING: tag v-rc1 was modified! *** from cd901482 (commit) to 29fb0cfb (tag) tagging cd901482bf33323cabc5d710f0803b291ab8cf26 (commit) by Martijn Visser on Fri Jan 5 13:38:05 2024 +0100 - Log - v-rc1 -BEGIN PGP SIGNATURE- iHUEABYKAB0WIQSl87zky+mTVz7FlmplMhuDgrIZrwUCZZf4LQAKCRBlMhuDgrIZ r4BuAP0SBPCQmT9n4R+J9PLxUt7Gbe8GsV2/DltkABR7nhNaVwD/agIqoty167nu SHElPDCSAQOhX3YWlOvwp7tm/WT/0wo= =V0yB -END PGP SIGNATURE- --- No new revisions were added by this update. Summary of changes:
(flink-connector-jdbc) annotated tag v3.1.2-rc1 deleted (was a25a7b25)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to annotated tag v3.1.2-rc1 in repository https://gitbox.apache.org/repos/asf/flink-connector-jdbc.git *** WARNING: tag v3.1.2-rc1 was deleted! *** tag was a25a7b25 This change permanently discards the following revisions: discard cd901482 Update version to 3.1.2
(flink-connector-jdbc) annotated tag v3.1.2-rc1 updated (cd901482 -> a25a7b25)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to annotated tag v3.1.2-rc1 in repository https://gitbox.apache.org/repos/asf/flink-connector-jdbc.git *** WARNING: tag v3.1.2-rc1 was modified! *** from cd901482 (commit) to a25a7b25 (tag) tagging cd901482bf33323cabc5d710f0803b291ab8cf26 (commit) by Martijn Visser on Fri Jan 5 13:34:35 2024 +0100 - Log - v3.1.2-rc1 -BEGIN PGP SIGNATURE- iHUEABYKAB0WIQSl87zky+mTVz7FlmplMhuDgrIZrwUCZZf3XAAKCRBlMhuDgrIZ r/JXAQDC4yKV7oe7lcLRhtsPcVlLK/uDWVitGNOHlZkBUOt8KwD/TUJv5zfwVxFj ya+B0kVwT/9b0Fja3vkZpDVMOyZBHAI= =0XBt -END PGP SIGNATURE- --- No new revisions were added by this update. Summary of changes:
(flink) branch release-1.17 updated: [hotfix] Integrate HBase v3.0 connector documentation
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a commit to branch release-1.17 in repository https://gitbox.apache.org/repos/asf/flink.git The following commit(s) were added to refs/heads/release-1.17 by this push: new b6704495ba3 [hotfix] Integrate HBase v3.0 connector documentation b6704495ba3 is described below commit b6704495ba3459727ed236c0a14da50ee3a5de0a Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com> AuthorDate: Fri Jan 5 13:13:21 2024 +0100 [hotfix] Integrate HBase v3.0 connector documentation --- docs/setup_docs.sh | 1 + 1 file changed, 1 insertion(+) diff --git a/docs/setup_docs.sh b/docs/setup_docs.sh index 36997107d6c..f3ffa9e2602 100755 --- a/docs/setup_docs.sh +++ b/docs/setup_docs.sh @@ -52,6 +52,7 @@ integrate_connector_docs rabbitmq v3.0 integrate_connector_docs gcp-pubsub v3.0 integrate_connector_docs mongodb v1.0 integrate_connector_docs opensearch v1.0 +integrate_connector_docs hbase v3.0 cd .. rm -rf tmp
(flink) branch release-1.16 updated: [hotfix] Integrate HBase v3.0 connector documentation
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a commit to branch release-1.16 in repository https://gitbox.apache.org/repos/asf/flink.git The following commit(s) were added to refs/heads/release-1.16 by this push: new 664bd6760f2 [hotfix] Integrate HBase v3.0 connector documentation 664bd6760f2 is described below commit 664bd6760f256c4f252e3acb710c0de854568207 Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com> AuthorDate: Fri Jan 5 13:12:22 2024 +0100 [hotfix] Integrate HBase v3.0 connector documentation --- docs/setup_docs.sh | 1 + 1 file changed, 1 insertion(+) diff --git a/docs/setup_docs.sh b/docs/setup_docs.sh index e7c112d0426..ee80515751a 100755 --- a/docs/setup_docs.sh +++ b/docs/setup_docs.sh @@ -49,6 +49,7 @@ integrate_connector_docs elasticsearch v3.0 integrate_connector_docs aws v4.1 integrate_connector_docs opensearch v1.0 integrate_connector_docs mongodb v1.0 +integrate_connector_docs hbase v3.0 cd .. rm -rf tmp
(flink-web) branch asf-site updated (57563d1d7 -> 0cdff3daf)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/flink-web.git from 57563d1d7 Rebuild website new 645e73457 Add HBase v3.0.0 for Flink 1.16.x and 1.17.x new 0cdff3daf Rebuild website The 2 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../2014/08/26/apache-flink-0.6-available/index.html | 2 +- .../2014/09/26/apache-flink-0.6.1-available/index.html | 2 +- content/2014/10/03/upcoming-events/index.html | 2 +- .../2014/11/04/apache-flink-0.7.0-available/index.html | 2 +- .../11/18/hadoop-compatibility-in-flink/index.html | 2 +- .../06/december-2014-in-the-flink-community/index.html | 2 +- .../2015/01/21/apache-flink-0.8.0-available/index.html | 2 +- .../04/january-2015-in-the-flink-community/index.html | 2 +- .../2015/02/09/introducing-flink-streaming/index.html | 2 +- .../02/february-2015-in-the-flink-community/index.html | 2 +- .../peeking-into-apache-flinks-engine-room/index.html | 2 +- .../04/07/march-2015-in-the-flink-community/index.html | 2 +- .../index.html | 2 +- .../2015/05/11/juggling-with-bits-and-bytes/index.html | 2 +- .../05/14/april-2015-in-the-flink-community/index.html | 2 +- .../06/24/announcing-apache-flink-0.9.0/index.html | 2 +- .../index.html | 2 +- .../2015/09/01/apache-flink-0.9.1-available/index.html | 2 +- .../09/03/announcing-flink-forward-2015/index.html | 2 +- .../index.html | 2 +- .../11/16/announcing-apache-flink-0.10.0/index.html| 2 +- content/2015/11/27/flink-0.10.1-released/index.html| 2 +- .../index.html | 2 +- .../index.html | 2 +- .../index.html | 2 +- content/2016/02/11/flink-0.10.2-released/index.html| 2 +- .../03/08/announcing-apache-flink-1.0.0/index.html | 2 +- content/2016/04/06/flink-1.0.1-released/index.html | 2 +- .../index.html | 2 +- .../index.html | 2 +- content/2016/04/22/flink-1.0.2-released/index.html | 2 +- content/2016/05/11/flink-1.0.3-released/index.html | 2 +- .../index.html | 2 +- .../08/04/announcing-apache-flink-1.1.0/index.html | 2 +- content/2016/08/04/flink-1.1.1-released/index.html | 2 +- .../index.html | 2 +- .../2016/09/05/apache-flink-1.1.2-released/index.html | 2 +- .../2016/10/12/apache-flink-1.1.3-released/index.html | 2 +- .../19/apache-flink-in-2016-year-in-review/index.html | 2 +- .../2016/12/21/apache-flink-1.1.4-released/index.html | 2 +- .../02/06/announcing-apache-flink-1.2.0/index.html | 2 +- .../2017/03/23/apache-flink-1.1.5-released/index.html | 2 +- .../index.html | 2 +- .../30/continuous-queries-on-dynamic-tables/index.html | 2 +- .../2017/04/26/apache-flink-1.2.1-released/index.html | 2 +- .../index.html | 2 +- .../apache-flink-1.3.0-release-announcement/index.html | 2 +- .../2017/06/23/apache-flink-1.3.1-released/index.html | 2 +- .../index.html | 2 +- .../2017/08/05/apache-flink-1.3.2-released/index.html | 2 +- .../index.html | 2 +- .../apache-flink-1.4.0-release-announcement/index.html | 2 +- .../21/apache-flink-in-2017-year-in-review/index.html | 2 +- .../index.html | 2 +- .../2018/02/15/apache-flink-1.4.1-released/index.html | 2 +- .../index.html | 2 +- .../2018/03/08/apache-flink-1.4.2-released/index.html | 2 +- .../2018/03/15/apache-flink-1.3.3-released/index.html | 2 +- .../apache-flink-1.5.0-release-announcement/index.html | 2 +- .../2018/07/12/apache-flink-1.5.1-released/index.html | 2 +- .../2018/07/31/apache-flink-1.5.2-released/index.html | 2 +- .../apache-flink-1.6.0-release-announcement/index.html | 2 +- .../2018/08/21/apache-flink-1.5.3-released/index.html | 2 +- .../2018/09/20/apache-flink-1.5.4-released/index.html | 2 +- .../2018/09/20/apache-flink-1.6.1-released/index.html | 2 +- .../2018/10/29/apache-flink-1.5.5-released/index.html | 2 +- .../2018/10/29/apache-flink-1.6.2-released/index.html | 2 +- .../apache-flink-1.7.0-release-announcement/index.html | 2 +- .../2018/12/21/apache-flink-1.7.1-released/index.htm
(flink-web) 01/02: Add HBase v3.0.0 for Flink 1.16.x and 1.17.x
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/flink-web.git commit 645e73457d975c11fca30c32e8bf83ebcd8b78ba Author: Martijn Visser AuthorDate: Fri Sep 1 16:30:04 2023 +0200 Add HBase v3.0.0 for Flink 1.16.x and 1.17.x --- docs/data/flink_connectors.yml | 7 +++ docs/data/release_archive.yml | 7 ++- 2 files changed, 13 insertions(+), 1 deletion(-) diff --git a/docs/data/flink_connectors.yml b/docs/data/flink_connectors.yml index d312ee63d..90466390f 100644 --- a/docs/data/flink_connectors.yml +++ b/docs/data/flink_connectors.yml @@ -43,6 +43,13 @@ gcp-pubsub: source_release_sha512_url: "https://downloads.apache.org/flink/flink-connector-gcp-pubsub-3.0.1/flink-connector-gcp-pubsub-3.0.1-src.tgz.sha512; compatibility: ["1.16.x", "1.17.x"] +hbase: + name: "Apache Flink HBase Connector 3.0.0" + source_release_url: "https://www.apache.org/dyn/closer.lua/flink/flink-connector-hbase-3.0.0/flink-connector-hbase-3.0.0-src.tgz; + source_release_asc_url: "https://downloads.apache.org/flink/flink-connector-hbase-3.0.0/flink-connector-hbase-3.0.0-src.tgz.asc; + source_release_sha512_url: "https://downloads.apache.org/flink/flink-connector-hbase-3.0.0/flink-connector-hbase-3.0.0-src.tgz.sha512; + compatibility: ["1.16.x", "1.17.x"] + jdbc: name: "Apache Flink JDBC Connector 3.1.1" source_release_url: "https://www.apache.org/dyn/closer.lua/flink/flink-connector-jdbc-3.1.1/flink-connector-jdbc-3.1.1-src.tgz; diff --git a/docs/data/release_archive.yml b/docs/data/release_archive.yml index 2af84097f..3327d4c38 100644 --- a/docs/data/release_archive.yml +++ b/docs/data/release_archive.yml @@ -525,6 +525,11 @@ release_archive: version: 1.0.2 release_date: 2023-08-15 filename: "mongodb" +- name: "Flink HBase Connector" + connector: "hbase" + version: 3.0.0 + release_date: 2023-09-1 + filename: "hbase" - name: "Flink Kafka Connector" connector: "kafka" version: 3.0.1 @@ -622,7 +627,7 @@ release_archive: flink_kubernetes_operator: - version_short: 1.7 version_long: 1.7.0 - release_date: 2023-11-22 + release_date: 2023-11-22 - version_short: 1.6 version_long: 1.6.1 release_date: 2023-10-27
(flink) branch release-1.18 updated: [FLINK-33863] Fix restoring compressed operator state
This is an automated email from the ASF dual-hosted git repository.
martijnvisser pushed a commit to branch release-1.18
in repository https://gitbox.apache.org/repos/asf/flink.git
The following commit(s) were added to refs/heads/release-1.18 by this push:
new f9383e6780a [FLINK-33863] Fix restoring compressed operator state
f9383e6780a is described below
commit f9383e6780ae8beb995d9bbd58a8484d19900f55
Author: Ruibin Xing
AuthorDate: Sat Dec 16 14:14:22 2023 +0800
[FLINK-33863] Fix restoring compressed operator state
---
.../state/OperatorStateRestoreOperation.java | 30 +-
.../state/OperatorStateRestoreOperationTest.java | 114 +
2 files changed, 142 insertions(+), 2 deletions(-)
diff --git
a/flink-runtime/src/main/java/org/apache/flink/runtime/state/OperatorStateRestoreOperation.java
b/flink-runtime/src/main/java/org/apache/flink/runtime/state/OperatorStateRestoreOperation.java
index f818eb81978..fd983fd5d28 100644
---
a/flink-runtime/src/main/java/org/apache/flink/runtime/state/OperatorStateRestoreOperation.java
+++
b/flink-runtime/src/main/java/org/apache/flink/runtime/state/OperatorStateRestoreOperation.java
@@ -32,9 +32,12 @@ import org.apache.commons.io.IOUtils;
import javax.annotation.Nonnull;
import java.io.IOException;
+import java.util.ArrayList;
import java.util.Collection;
+import java.util.Comparator;
import java.util.List;
import java.util.Map;
+import java.util.stream.Collectors;
/** Implementation of operator state restore operation. */
public class OperatorStateRestoreOperation implements RestoreOperation {
@@ -168,9 +171,32 @@ public class OperatorStateRestoreOperation implements
RestoreOperation {
}
}
+List>
entries =
+new
ArrayList<>(stateHandle.getStateNameToPartitionOffsets().entrySet());
+
+if (backendSerializationProxy.isUsingStateCompression()) {
+// sort state handles by offsets to avoid building
SnappyFramedInputStream with
+// EOF stream.
+entries =
+entries.stream()
+.sorted(
+Comparator.comparingLong(
+entry -> {
+
OperatorStateHandle.StateMetaInfo
+stateMetaInfo
= entry.getValue();
+long[] offsets =
stateMetaInfo.getOffsets();
+if (offsets == null
+||
offsets.length == 0) {
+return
Long.MIN_VALUE;
+} else {
+return offsets[0];
+}
+}))
+.collect(Collectors.toList());
+}
+
// Restore all the states
-for (Map.Entry
nameToOffsets :
-
stateHandle.getStateNameToPartitionOffsets().entrySet()) {
+for (Map.Entry
nameToOffsets : entries) {
final String stateName = nameToOffsets.getKey();
diff --git
a/flink-runtime/src/test/java/org/apache/flink/runtime/state/OperatorStateRestoreOperationTest.java
b/flink-runtime/src/test/java/org/apache/flink/runtime/state/OperatorStateRestoreOperationTest.java
new file mode 100644
index 000..e0aecd5d723
--- /dev/null
+++
b/flink-runtime/src/test/java/org/apache/flink/runtime/state/OperatorStateRestoreOperationTest.java
@@ -0,0 +1,114 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.flink.runtime.state;
+
+import org.apache.flink.api.common.ExecutionConfig;
+import org.apache.flink.api.comm
(flink) branch dependabot/maven/org.apache.zookeeper-zookeeper-3.7.2 updated (228afa84cca -> cd034a133f7)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to branch dependabot/maven/org.apache.zookeeper-zookeeper-3.7.2 in repository https://gitbox.apache.org/repos/asf/flink.git discard 228afa84cca Bump org.apache.zookeeper:zookeeper from 3.7.1 to 3.7.2 add cd034a133f7 [FLINK-33956][Runtime/Coordination] Bump org.apache.zookeeper:zookeeper from 3.7.1 to 3.7.2 This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (228afa84cca) \ N -- N -- N refs/heads/dependabot/maven/org.apache.zookeeper-zookeeper-3.7.2 (cd034a133f7) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes:
(flink-connector-jdbc) branch v3.1 updated: [FLINK-33952][FLINK-33787][jdbc] Java 17 support for jdbc connector
This is an automated email from the ASF dual-hosted git repository.
martijnvisser pushed a commit to branch v3.1
in repository https://gitbox.apache.org/repos/asf/flink-connector-jdbc.git
The following commit(s) were added to refs/heads/v3.1 by this push:
new f4dd71fb [FLINK-33952][FLINK-33787][jdbc] Java 17 support for jdbc
connector
f4dd71fb is described below
commit f4dd71fbd0474bb855e05a7b9027c539130fc72b
Author: Sergey Nuyanzin
AuthorDate: Fri Dec 15 23:50:30 2023 +0100
[FLINK-33952][FLINK-33787][jdbc] Java 17 support for jdbc connector
---
.github/workflows/push_pr.yml | 7 ++-
.github/workflows/weekly.yml | 9 +++--
flink-connector-jdbc/pom.xml | 5 +
pom.xml | 3 +++
4 files changed, 21 insertions(+), 3 deletions(-)
diff --git a/.github/workflows/push_pr.yml b/.github/workflows/push_pr.yml
index b30b09f0..a54f4a0d 100644
--- a/.github/workflows/push_pr.yml
+++ b/.github/workflows/push_pr.yml
@@ -25,7 +25,12 @@ jobs:
compile_and_test:
strategy:
matrix:
-flink: [1.17.0, 1.18-SNAPSHOT]
+flink: [1.17-SNAPSHOT]
+jdk: [ '8, 11' ]
+include:
+ - flink: 1.18-SNAPSHOT
+jdk: '8, 11, 17'
uses: apache/flink-connector-shared-utils/.github/workflows/ci.yml@ci_utils
with:
flink_version: ${{ matrix.flink }}
+ jdk_version: ${{ matrix.jdk }}
diff --git a/.github/workflows/weekly.yml b/.github/workflows/weekly.yml
index f4645db8..123337bc 100644
--- a/.github/workflows/weekly.yml
+++ b/.github/workflows/weekly.yml
@@ -26,8 +26,13 @@ jobs:
if: github.repository_owner == 'apache'
strategy:
matrix:
-flink: [1.16-SNAPSHOT, 1.17-SNAPSHOT, 1.18-SNAPSHOT]
+flink: [1.16-SNAPSHOT, 1.17-SNAPSHOT]
+jdk: ['8, 11']
+include:
+ - flink: 1.18-SNAPSHOT
+jdk: '8, 11, 17'
uses: apache/flink-connector-shared-utils/.github/workflows/ci.yml@ci_utils
with:
flink_version: ${{ matrix.flink }}
- run_dependency_convergence: false
+ jdk_version: ${{ matrix.jdk }}
+ run_dependency_convergence: false
\ No newline at end of file
diff --git a/flink-connector-jdbc/pom.xml b/flink-connector-jdbc/pom.xml
index 378d34de..c5c24c57 100644
--- a/flink-connector-jdbc/pom.xml
+++ b/flink-connector-jdbc/pom.xml
@@ -40,6 +40,11 @@ under the License.
3.23.1
42.5.1
21.8.0.0
+ 1.12.10
+
--add-opens=java.base/java.util=ALL-UNNAMED
--add-opens=java.base/java.lang=ALL-UNNAMED
+
diff --git a/pom.xml b/pom.xml
index ac70c325..dd645500 100644
--- a/pom.xml
+++ b/pom.xml
@@ -63,6 +63,9 @@ under the License.
flink-connector-jdbc-parent
1
+
+-XX:+UseG1GC -Xms256m
-XX:+IgnoreUnrecognizedVMOptions
${surefire.module.config}
+
(flink-connector-jdbc) branch dependabot/maven/com.google.guava-guava-32.0.0-jre deleted (was 4ec67cb1)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to branch dependabot/maven/com.google.guava-guava-32.0.0-jre in repository https://gitbox.apache.org/repos/asf/flink-connector-jdbc.git was 4ec67cb1 [FLINK-33953] Bump com.google.guava:guava from 31.1-jre to 33.0.0-jre The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(flink-connector-jdbc) branch main updated: [FLINK-33953] Bump com.google.guava:guava from 31.1-jre to 33.0.0-jre. This closes #81
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-jdbc.git The following commit(s) were added to refs/heads/main by this push: new 32c1ca4e [FLINK-33953] Bump com.google.guava:guava from 31.1-jre to 33.0.0-jre. This closes #81 32c1ca4e is described below commit 32c1ca4e21eb360fc1c51bcafd21f42ff322c258 Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> AuthorDate: Wed Dec 27 16:25:33 2023 +0100 [FLINK-33953] Bump com.google.guava:guava from 31.1-jre to 33.0.0-jre. This closes #81 Bumps [com.google.guava:guava](https://github.com/google/guava) from 31.1-jre to 33.0.0-jre. - [Release notes](https://github.com/google/guava/releases) - [Commits](https://github.com/google/guava/commits) --- updated-dependencies: - dependency-name: com.google.guava:guava dependency-type: direct:production ... Signed-off-by: dependabot[bot] Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> --- pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pom.xml b/pom.xml index 5d72a384..993735b3 100644 --- a/pom.xml +++ b/pom.xml @@ -329,7 +329,7 @@ under the License. com.google.guava guava -31.1-jre +33.0.0-jre
(flink-connector-jdbc) branch dependabot/maven/com.google.guava-guava-32.0.0-jre updated (30e2d116 -> 4ec67cb1)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to branch dependabot/maven/com.google.guava-guava-32.0.0-jre in repository https://gitbox.apache.org/repos/asf/flink-connector-jdbc.git discard 30e2d116 Bump com.google.guava:guava from 31.1-jre to 32.0.0-jre add f8de82b4 [FLINK-33787][jdbc] Java 17 support for jdbc connector add e6645995 [FLINK-33883][jdbc] Bump CI flink version on flink-connector-jdbc to support flink 1.19 add be5150b3 [FLINK-33329 ] Bump org.apache.commons:commons-compress from 1.23.0 to 1.24.0. This closes #84 add 4ec67cb1 [FLINK-33953] Bump com.google.guava:guava from 31.1-jre to 33.0.0-jre This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (30e2d116) \ N -- N -- N refs/heads/dependabot/maven/com.google.guava-guava-32.0.0-jre (4ec67cb1) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: .github/workflows/push_pr.yml | 9 ++- .github/workflows/weekly.yml | 7 ++ flink-connector-jdbc/pom.xml | 4 .../connector/jdbc/table/JdbcTablePlanTest.java| 28 ++ pom.xml| 7 -- 5 files changed, 47 insertions(+), 8 deletions(-)
(flink-connector-jdbc) branch dependabot/maven/org.apache.commons-commons-compress-1.24.0 deleted (was f024ecac)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to branch dependabot/maven/org.apache.commons-commons-compress-1.24.0 in repository https://gitbox.apache.org/repos/asf/flink-connector-jdbc.git was f024ecac Bump org.apache.commons:commons-compress from 1.23.0 to 1.24.0 The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(flink-connector-jdbc) branch main updated (e6645995 -> be5150b3)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-jdbc.git from e6645995 [FLINK-33883][jdbc] Bump CI flink version on flink-connector-jdbc to support flink 1.19 add be5150b3 [FLINK-33329 ] Bump org.apache.commons:commons-compress from 1.23.0 to 1.24.0. This closes #84 No new revisions were added by this update. Summary of changes: pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
(flink) branch release-1.18 updated: [FLINK-33704][Filesytems] Update GCS filesystems to latest available versions. This closes #23935
This is an automated email from the ASF dual-hosted git repository.
martijnvisser pushed a commit to branch release-1.18
in repository https://gitbox.apache.org/repos/asf/flink.git
The following commit(s) were added to refs/heads/release-1.18 by this push:
new 8951f907b46 [FLINK-33704][Filesytems] Update GCS filesystems to latest
available versions. This closes #23935
8951f907b46 is described below
commit 8951f907b4633d6826852d62920ef638905c7c78
Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com>
AuthorDate: Mon Dec 18 09:05:00 2023 +0100
[FLINK-33704][Filesytems] Update GCS filesystems to latest available
versions. This closes #23935
* [FLINK-33704][Filesystem] Update GCS filesystem dependencies
- Update GS SDK from 2.15.0 to 2.29.1
- Update GS Hadoop Connector from 2.2.15 to 2.2.18
- Update GS GRPC to highest shared version
* [FLINK-33704] Make NOTICE inclusion of com.google.re2j for GCS consistent
RE2J is listed for the other filesystems as Go license, we should remain
consistent throughout the project
(cherry picked from commit 492a886248208904276fcd2bda138a79c86bc71c)
---
docs/content.zh/docs/deployment/filesystems/gcs.md | 4 +-
docs/content/docs/deployment/filesystems/gcs.md| 4 +-
flink-filesystems/flink-gs-fs-hadoop/pom.xml | 10 +-
.../src/main/resources/META-INF/NOTICE | 105 +++--
4 files changed, 64 insertions(+), 59 deletions(-)
diff --git a/docs/content.zh/docs/deployment/filesystems/gcs.md
b/docs/content.zh/docs/deployment/filesystems/gcs.md
index 363cd2fec90..7edf78b2e61 100644
--- a/docs/content.zh/docs/deployment/filesystems/gcs.md
+++ b/docs/content.zh/docs/deployment/filesystems/gcs.md
@@ -55,7 +55,7 @@ Note that these examples are *not* exhaustive and you can use
GCS in other place
Flink provides the `flink-gs-fs-hadoop` file system to write to GCS.
This implementation is self-contained with no dependency footprint, so there
is no need to add Hadoop to the classpath to use it.
-`flink-gs-fs-hadoop` registers a `FileSystem` wrapper for URIs with the
*gs://* scheme. It uses Google's
[gcs-connector](https://mvnrepository.com/artifact/com.google.cloud.bigdataoss/gcs-connector/hadoop3-2.2.15)
Hadoop library to access GCS. It also uses Google's
[google-cloud-storage](https://mvnrepository.com/artifact/com.google.cloud/google-cloud-storage/2.15.0)
library to provide `RecoverableWriter` support.
+`flink-gs-fs-hadoop` registers a `FileSystem` wrapper for URIs with the
*gs://* scheme. It uses Google's
[gcs-connector](https://mvnrepository.com/artifact/com.google.cloud.bigdataoss/gcs-connector/hadoop3-2.2.18)
Hadoop library to access GCS. It also uses Google's
[google-cloud-storage](https://mvnrepository.com/artifact/com.google.cloud/google-cloud-storage/2.29.1)
library to provide `RecoverableWriter` support.
This file system can be used with the [FileSystem connector]({{< ref
"docs/connectors/datastream/filesystem.md" >}}).
@@ -68,7 +68,7 @@ cp ./opt/flink-gs-fs-hadoop-{{< version >}}.jar
./plugins/gs-fs-hadoop/
### Configuration
-The underlying Hadoop file system can be configured using the [Hadoop
configuration
keys](https://github.com/GoogleCloudDataproc/hadoop-connectors/blob/v2.2.15/gcs/CONFIGURATION.md)
for `gcs-connector` by adding the configurations to your `flink-conf.yaml`.
+The underlying Hadoop file system can be configured using the [Hadoop
configuration
keys](https://github.com/GoogleCloudDataproc/hadoop-connectors/blob/v2.2.18/gcs/CONFIGURATION.md)
for `gcs-connector` by adding the configurations to your `flink-conf.yaml`.
For example, `gcs-connector` has a `fs.gs.http.connect-timeout` configuration
key. If you want to change it, you need to set `gs.http.connect-timeout: xyz`
in `flink-conf.yaml`. Flink will internally translate this back to
`fs.gs.http.connect-timeout`.
diff --git a/docs/content/docs/deployment/filesystems/gcs.md
b/docs/content/docs/deployment/filesystems/gcs.md
index 97e008eca33..3bd130e2046 100644
--- a/docs/content/docs/deployment/filesystems/gcs.md
+++ b/docs/content/docs/deployment/filesystems/gcs.md
@@ -55,7 +55,7 @@ Note that these examples are *not* exhaustive and you can use
GCS in other place
Flink provides the `flink-gs-fs-hadoop` file system to write to GCS.
This implementation is self-contained with no dependency footprint, so there
is no need to add Hadoop to the classpath to use it.
-`flink-gs-fs-hadoop` registers a `FileSystem` wrapper for URIs with the
*gs://* scheme. It uses Google's
[gcs-connector](https://mvnrepository.com/artifact/com.google.cloud.bigdataoss/gcs-connector/hadoop3-2.2.15)
Hadoop library to access GCS. It also uses Google's
[google-cloud-storage](https://mvnrepository.com/artifact/com.google.cloud/google-cloud-storage/2.15.0)
library to provide `RecoverableWriter` support.
+`flink-gs-fs-hadoop` registers a `
(flink) branch master updated: [FLINK-28215][Buildsystem] Update Maven Surefire plugin to 3.3.2. This closes #22502
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/flink.git The following commit(s) were added to refs/heads/master by this push: new ea4cdc28651 [FLINK-28215][Buildsystem] Update Maven Surefire plugin to 3.3.2. This closes #22502 ea4cdc28651 is described below commit ea4cdc28651ad91defd4fc7b371a1f520ea7a262 Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com> AuthorDate: Mon Dec 11 16:36:44 2023 +0100 [FLINK-28215][Buildsystem] Update Maven Surefire plugin to 3.3.2. This closes #22502 --- pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pom.xml b/pom.xml index 18c8b4b3f49..0304712e2ee 100644 --- a/pom.xml +++ b/pom.xml @@ -1714,7 +1714,7 @@ under the License. org.apache.maven.plugins maven-surefire-plugin - 3.0.0-M5 + 3.2.2
(flink) branch release-1.18 updated: Revert "[FLINK-31835][table-planner] Fix the array type that can't be converted from the external primitive array"
This is an automated email from the ASF dual-hosted git repository.
martijnvisser pushed a commit to branch release-1.18
in repository https://gitbox.apache.org/repos/asf/flink.git
The following commit(s) were added to refs/heads/release-1.18 by this push:
new 674d3a74641 Revert "[FLINK-31835][table-planner] Fix the array type
that can't be converted from the external primitive array"
674d3a74641 is described below
commit 674d3a746417ceb36f74ccebb6a713549af59033
Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com>
AuthorDate: Thu Dec 7 16:43:23 2023 +0100
Revert "[FLINK-31835][table-planner] Fix the array type that can't be
converted from the external primitive array"
This reverts commit a6adbdda0cdf90635f0cd7a3427486bced301fbd.
---
.../flink/table/types/CollectionDataType.java | 24 +
.../org/apache/flink/table/types/DataTypeTest.java | 14 -
.../planner/functions/CastFunctionITCase.java | 2 +-
.../planner/runtime/stream/sql/FunctionITCase.java | 60 --
.../planner/runtime/stream/table/ValuesITCase.java | 18 +--
.../table/data/DataStructureConvertersTest.java| 24 +
.../flink/table/test/TableAssertionTest.java | 2 +-
7 files changed, 7 insertions(+), 137 deletions(-)
diff --git
a/flink-table/flink-table-common/src/main/java/org/apache/flink/table/types/CollectionDataType.java
b/flink-table/flink-table-common/src/main/java/org/apache/flink/table/types/CollectionDataType.java
index 9188530a4ff..239e36eb201 100644
---
a/flink-table/flink-table-common/src/main/java/org/apache/flink/table/types/CollectionDataType.java
+++
b/flink-table/flink-table-common/src/main/java/org/apache/flink/table/types/CollectionDataType.java
@@ -26,8 +26,6 @@ import org.apache.flink.table.types.logical.LogicalType;
import org.apache.flink.table.types.logical.LogicalTypeRoot;
import org.apache.flink.util.Preconditions;
-import org.apache.commons.lang3.ClassUtils;
-
import javax.annotation.Nullable;
import java.lang.reflect.Array;
@@ -120,27 +118,9 @@ public final class CollectionDataType extends DataType {
// arrays are a special case because their default conversion class
depends on the
// conversion class of the element type
if (logicalType.getTypeRoot() == LogicalTypeRoot.ARRAY && clazz ==
null) {
-Class conversionClass =
-wrapOrUnWrap(
-elementDataType.getConversionClass(),
-elementDataType.getLogicalType().isNullable());
-
-return Array.newInstance(conversionClass, 0).getClass();
-}
-return wrapOrUnWrap(clazz,
elementDataType.getLogicalType().isNullable());
-}
-
-private static Class wrapOrUnWrap(@Nullable Class source, boolean
nullable) {
-if (source == null) {
-return null;
-}
-if (nullable) {
-return source.isPrimitive() ?
ClassUtils.primitiveToWrapper(source) : source;
-} else {
-return ClassUtils.isPrimitiveWrapper(source)
-? ClassUtils.wrapperToPrimitive(source)
-: source;
+return Array.newInstance(elementDataType.getConversionClass(),
0).getClass();
}
+return clazz;
}
private DataType updateInnerDataType(DataType elementDataType) {
diff --git
a/flink-table/flink-table-common/src/test/java/org/apache/flink/table/types/DataTypeTest.java
b/flink-table/flink-table-common/src/test/java/org/apache/flink/table/types/DataTypeTest.java
index ce9239266f2..a7d824009bf 100644
---
a/flink-table/flink-table-common/src/test/java/org/apache/flink/table/types/DataTypeTest.java
+++
b/flink-table/flink-table-common/src/test/java/org/apache/flink/table/types/DataTypeTest.java
@@ -24,8 +24,6 @@ import org.apache.flink.table.data.ArrayData;
import org.apache.flink.table.data.MapData;
import org.apache.flink.table.data.RowData;
import org.apache.flink.table.data.StringData;
-import org.apache.flink.table.types.inference.TypeTransformations;
-import org.apache.flink.table.types.utils.DataTypeUtils;
import org.junit.jupiter.api.Test;
@@ -222,16 +220,4 @@ class DataTypeTest {
assertThat(DataType.getFields(ARRAY(INT(.isEmpty();
assertThat(DataType.getFields(INT())).isEmpty();
}
-
-@Test
-void testArrayConversionClass() {
-assertThat(DataTypes.ARRAY(INT())).hasConversionClass(Integer[].class);
-
assertThat(DataTypes.ARRAY(INT().notNull())).hasConversionClass(int[].class);
-DataType type = DataTypes.ARRAY(INT());
-assertThat(DataTypeUtils.transform(type,
TypeTransformations.toNullable()))
-.hasConversionClass(Integer[].class);
-type = DataTypes.ARRAY(INT()).bridgedTo(int[].class);
-assertThat(DataTypeUtils.transform(type,
TypeTransformations.toNullable()))
-
(flink) branch master updated: [FLINK-33523][table-planner] Revert [FLINK-31835] Fix the array type that can't be converted from the external primitive array"
This is an automated email from the ASF dual-hosted git repository.
martijnvisser pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/flink.git
The following commit(s) were added to refs/heads/master by this push:
new fcc7bc2e5e5 [FLINK-33523][table-planner] Revert [FLINK-31835] Fix the
array type that can't be converted from the external primitive array"
fcc7bc2e5e5 is described below
commit fcc7bc2e5e529b135aee28d732b8c5a6769afdae
Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com>
AuthorDate: Thu Dec 7 15:16:37 2023 +0100
[FLINK-33523][table-planner] Revert [FLINK-31835] Fix the array type that
can't be converted from the external primitive array"
This reverts commit a6adbdda
---
.../flink/table/types/CollectionDataType.java | 24 +
.../org/apache/flink/table/types/DataTypeTest.java | 14 -
.../planner/functions/CastFunctionITCase.java | 2 +-
.../planner/runtime/stream/sql/FunctionITCase.java | 60 --
.../planner/runtime/stream/table/ValuesITCase.java | 18 +--
.../table/data/DataStructureConvertersTest.java| 24 +
.../flink/table/test/TableAssertionTest.java | 2 +-
7 files changed, 7 insertions(+), 137 deletions(-)
diff --git
a/flink-table/flink-table-common/src/main/java/org/apache/flink/table/types/CollectionDataType.java
b/flink-table/flink-table-common/src/main/java/org/apache/flink/table/types/CollectionDataType.java
index 9188530a4ff..239e36eb201 100644
---
a/flink-table/flink-table-common/src/main/java/org/apache/flink/table/types/CollectionDataType.java
+++
b/flink-table/flink-table-common/src/main/java/org/apache/flink/table/types/CollectionDataType.java
@@ -26,8 +26,6 @@ import org.apache.flink.table.types.logical.LogicalType;
import org.apache.flink.table.types.logical.LogicalTypeRoot;
import org.apache.flink.util.Preconditions;
-import org.apache.commons.lang3.ClassUtils;
-
import javax.annotation.Nullable;
import java.lang.reflect.Array;
@@ -120,27 +118,9 @@ public final class CollectionDataType extends DataType {
// arrays are a special case because their default conversion class
depends on the
// conversion class of the element type
if (logicalType.getTypeRoot() == LogicalTypeRoot.ARRAY && clazz ==
null) {
-Class conversionClass =
-wrapOrUnWrap(
-elementDataType.getConversionClass(),
-elementDataType.getLogicalType().isNullable());
-
-return Array.newInstance(conversionClass, 0).getClass();
-}
-return wrapOrUnWrap(clazz,
elementDataType.getLogicalType().isNullable());
-}
-
-private static Class wrapOrUnWrap(@Nullable Class source, boolean
nullable) {
-if (source == null) {
-return null;
-}
-if (nullable) {
-return source.isPrimitive() ?
ClassUtils.primitiveToWrapper(source) : source;
-} else {
-return ClassUtils.isPrimitiveWrapper(source)
-? ClassUtils.wrapperToPrimitive(source)
-: source;
+return Array.newInstance(elementDataType.getConversionClass(),
0).getClass();
}
+return clazz;
}
private DataType updateInnerDataType(DataType elementDataType) {
diff --git
a/flink-table/flink-table-common/src/test/java/org/apache/flink/table/types/DataTypeTest.java
b/flink-table/flink-table-common/src/test/java/org/apache/flink/table/types/DataTypeTest.java
index ce9239266f2..a7d824009bf 100644
---
a/flink-table/flink-table-common/src/test/java/org/apache/flink/table/types/DataTypeTest.java
+++
b/flink-table/flink-table-common/src/test/java/org/apache/flink/table/types/DataTypeTest.java
@@ -24,8 +24,6 @@ import org.apache.flink.table.data.ArrayData;
import org.apache.flink.table.data.MapData;
import org.apache.flink.table.data.RowData;
import org.apache.flink.table.data.StringData;
-import org.apache.flink.table.types.inference.TypeTransformations;
-import org.apache.flink.table.types.utils.DataTypeUtils;
import org.junit.jupiter.api.Test;
@@ -222,16 +220,4 @@ class DataTypeTest {
assertThat(DataType.getFields(ARRAY(INT(.isEmpty();
assertThat(DataType.getFields(INT())).isEmpty();
}
-
-@Test
-void testArrayConversionClass() {
-assertThat(DataTypes.ARRAY(INT())).hasConversionClass(Integer[].class);
-
assertThat(DataTypes.ARRAY(INT().notNull())).hasConversionClass(int[].class);
-DataType type = DataTypes.ARRAY(INT());
-assertThat(DataTypeUtils.transform(type,
TypeTransformations.toNullable()))
-.hasConversionClass(Integer[].class);
-type = DataTypes.ARRAY(INT()).bridgedTo(int[].class);
-assertThat(DataTypeUtils.transform(type,
TypeTransformations.toNullable()))
-.hasConversionClass(int[].clas
(flink-connector-kafka) branch v3.0 updated: [hotfix] Update compatibility data for Kafka 3.0.2
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a commit to branch v3.0 in repository https://gitbox.apache.org/repos/asf/flink-connector-kafka.git The following commit(s) were added to refs/heads/v3.0 by this push: new 6c3d3d06 [hotfix] Update compatibility data for Kafka 3.0.2 6c3d3d06 is described below commit 6c3d3d06689336f2fd37bfa5a3b17a5377f07887 Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com> AuthorDate: Mon Dec 4 09:15:54 2023 +0100 [hotfix] Update compatibility data for Kafka 3.0.2 --- docs/data/kafka.yml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/data/kafka.yml b/docs/data/kafka.yml index 18f6810c..33c0a569 100644 --- a/docs/data/kafka.yml +++ b/docs/data/kafka.yml @@ -16,7 +16,7 @@ # limitations under the License. -version: 3.0.1 +version: 3.0.2 flink_compatibility: [1.17, 1.18] variants: - maven: flink-connector-kafka
(flink) branch master updated: Revert "Revert "[FLINK-32878][Filesystems] Add entropy in temporary object name in GCS connector. This closes #23729""
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/flink.git The following commit(s) were added to refs/heads/master by this push: new 87d7b4abd0a Revert "Revert "[FLINK-32878][Filesystems] Add entropy in temporary object name in GCS connector. This closes #23729"" 87d7b4abd0a is described below commit 87d7b4abd0a1ec92433603c83401cc8ad00fd500 Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com> AuthorDate: Fri Dec 1 16:37:21 2023 +0100 Revert "Revert "[FLINK-32878][Filesystems] Add entropy in temporary object name in GCS connector. This closes #23729"" This reverts commit c7da98f23c3f86de3a3b12355fa7a1289200f93d. --- docs/content.zh/docs/deployment/filesystems/gcs.md | 9 ++--- docs/content/docs/deployment/filesystems/gcs.md| 9 ++--- .../apache/flink/fs/gs/GSFileSystemOptions.java| 17 ++ .../org/apache/flink/fs/gs/utils/BlobUtils.java| 21 +++- .../flink/fs/gs/writer/GSCommitRecoverable.java| 7 ++-- .../fs/gs/writer/GSRecoverableWriterCommitter.java | 29 + .../apache/flink/fs/gs/utils/BlobUtilsTest.java| 15 + .../fs/gs/writer/GSCommitRecoverableTest.java | 38 ++ 8 files changed, 127 insertions(+), 18 deletions(-) diff --git a/docs/content.zh/docs/deployment/filesystems/gcs.md b/docs/content.zh/docs/deployment/filesystems/gcs.md index 7edf78b2e61..f80e5b3af4a 100644 --- a/docs/content.zh/docs/deployment/filesystems/gcs.md +++ b/docs/content.zh/docs/deployment/filesystems/gcs.md @@ -76,10 +76,11 @@ You can also set `gcs-connector` options directly in the Hadoop `core-site.xml` `flink-gs-fs-hadoop` can also be configured by setting the following options in `flink-conf.yaml`: -| Key | Description [...] -|---|--- [...] -| gs.writer.temporary.bucket.name | Set this property to choose a bucket to hold temporary blobs for in-progress writes via `RecoverableWriter`. If this property is not set, temporary blobs will be written to same bucket as the final file being written. In either case, temporary blobs are written with the prefix `.inprogress/`. It is recommended to choose a separate bucket in order to [assign it a TTL](https://cloud.google.com/storage/docs/lifecycle), to provide a mec [...] -| gs.writer.chunk.size | Set this property to [set the chunk size](https://cloud.google.com/java/docs/reference/google-cloud-core/latest/com.google.cloud.WriteChannel#com_google_cloud_WriteChannel_setChunkSize_int_) for writes via `RecoverableWriter`. If not set, a Google-determined default chunk size will be used. [...] +| Key | Description [...] +|-|- [...] +| gs.writer.temporary.bucket.name | Set this property to choose a bucket to h
(flink) branch master updated: Revert "[FLINK-32878][Filesystems] Add entropy in temporary object name in GCS connector. This closes #23729"
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/flink.git The following commit(s) were added to refs/heads/master by this push: new c7da98f23c3 Revert "[FLINK-32878][Filesystems] Add entropy in temporary object name in GCS connector. This closes #23729" c7da98f23c3 is described below commit c7da98f23c3f86de3a3b12355fa7a1289200f93d Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com> AuthorDate: Fri Dec 1 16:00:36 2023 +0100 Revert "[FLINK-32878][Filesystems] Add entropy in temporary object name in GCS connector. This closes #23729" This reverts commit dc1db12137ecad921ae90969d7bfbf1ee7d3d2ef. --- docs/content.zh/docs/deployment/filesystems/gcs.md | 9 +++-- docs/content/docs/deployment/filesystems/gcs.md| 9 +++-- .../apache/flink/fs/gs/GSFileSystemOptions.java| 17 -- .../org/apache/flink/fs/gs/utils/BlobUtils.java| 21 +--- .../flink/fs/gs/writer/GSCommitRecoverable.java| 7 ++-- .../fs/gs/writer/GSRecoverableWriterCommitter.java | 29 - .../apache/flink/fs/gs/utils/BlobUtilsTest.java| 15 - .../fs/gs/writer/GSCommitRecoverableTest.java | 38 -- 8 files changed, 18 insertions(+), 127 deletions(-) diff --git a/docs/content.zh/docs/deployment/filesystems/gcs.md b/docs/content.zh/docs/deployment/filesystems/gcs.md index f80e5b3af4a..7edf78b2e61 100644 --- a/docs/content.zh/docs/deployment/filesystems/gcs.md +++ b/docs/content.zh/docs/deployment/filesystems/gcs.md @@ -76,11 +76,10 @@ You can also set `gcs-connector` options directly in the Hadoop `core-site.xml` `flink-gs-fs-hadoop` can also be configured by setting the following options in `flink-conf.yaml`: -| Key | Description [...] -|-|- [...] -| gs.writer.temporary.bucket.name | Set this property to choose a bucket to hold temporary blobs for in-progress writes via `RecoverableWriter`. If this property is not set, temporary blobs will be written to same bucket as the final file being written. In either case, temporary blobs are written with the prefix `.inprogress/`. It is recommended to choose a separate bucket in order to [assign it a TTL](https://cloud.google.com/storage/docs/lifecycle), to provide a mechanism to [...] -| gs.writer.chunk.size| Set this property to [set the chunk size](https://cloud.google.com/java/docs/reference/google-cloud-core/latest/com.google.cloud.WriteChannel#com_google_cloud_WriteChannel_setChunkSize_int_) for writes via `RecoverableWriter`. If not set, a Google-determined default chunk size will be used. [...] -| gs.filesink.entropy.enabled | Set this property to improve performance due to hotspotting issues on GCS. This option defines whether to enable entropy injection in filesink gcs path. If this is enabled, entropy in the form of temporary object id will be injected in beginning of the gcs path of the temporary objects. The final object path remains unchanged. [...] +| Key
(flink) branch master updated: [FLINK-32878][Filesystems] Add entropy in temporary object name in GCS connector. This closes #23729
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/flink.git The following commit(s) were added to refs/heads/master by this push: new dc1db12137e [FLINK-32878][Filesystems] Add entropy in temporary object name in GCS connector. This closes #23729 dc1db12137e is described below commit dc1db12137ecad921ae90969d7bfbf1ee7d3d2ef Author: Cheena Budhiraja <110803195+bche...@users.noreply.github.com> AuthorDate: Fri Dec 1 18:52:43 2023 +0530 [FLINK-32878][Filesystems] Add entropy in temporary object name in GCS connector. This closes #23729 --- docs/content.zh/docs/deployment/filesystems/gcs.md | 9 ++--- docs/content/docs/deployment/filesystems/gcs.md| 9 ++--- .../apache/flink/fs/gs/GSFileSystemOptions.java| 17 ++ .../org/apache/flink/fs/gs/utils/BlobUtils.java| 21 +++- .../flink/fs/gs/writer/GSCommitRecoverable.java| 7 ++-- .../fs/gs/writer/GSRecoverableWriterCommitter.java | 29 + .../apache/flink/fs/gs/utils/BlobUtilsTest.java| 15 + .../fs/gs/writer/GSCommitRecoverableTest.java | 38 ++ 8 files changed, 127 insertions(+), 18 deletions(-) diff --git a/docs/content.zh/docs/deployment/filesystems/gcs.md b/docs/content.zh/docs/deployment/filesystems/gcs.md index 7edf78b2e61..f80e5b3af4a 100644 --- a/docs/content.zh/docs/deployment/filesystems/gcs.md +++ b/docs/content.zh/docs/deployment/filesystems/gcs.md @@ -76,10 +76,11 @@ You can also set `gcs-connector` options directly in the Hadoop `core-site.xml` `flink-gs-fs-hadoop` can also be configured by setting the following options in `flink-conf.yaml`: -| Key | Description [...] -|---|--- [...] -| gs.writer.temporary.bucket.name | Set this property to choose a bucket to hold temporary blobs for in-progress writes via `RecoverableWriter`. If this property is not set, temporary blobs will be written to same bucket as the final file being written. In either case, temporary blobs are written with the prefix `.inprogress/`. It is recommended to choose a separate bucket in order to [assign it a TTL](https://cloud.google.com/storage/docs/lifecycle), to provide a mec [...] -| gs.writer.chunk.size | Set this property to [set the chunk size](https://cloud.google.com/java/docs/reference/google-cloud-core/latest/com.google.cloud.WriteChannel#com_google_cloud_WriteChannel_setChunkSize_int_) for writes via `RecoverableWriter`. If not set, a Google-determined default chunk size will be used. [...] +| Key | Description [...] +|-|- [...] +| gs.writer.temporary.bucket.name | Set this property to choose a bucket to hold temporary blobs for in-progress writes via `RecoverableWriter`. If this property is not set, temporary blobs will be written to same
(flink) branch master updated: [FLINK-33704][Filesytems] Update GCS filesystems to latest available versions. This closes #23837
This is an automated email from the ASF dual-hosted git repository.
martijnvisser pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/flink.git
The following commit(s) were added to refs/heads/master by this push:
new 492a8862482 [FLINK-33704][Filesytems] Update GCS filesystems to latest
available versions. This closes #23837
492a8862482 is described below
commit 492a886248208904276fcd2bda138a79c86bc71c
Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com>
AuthorDate: Thu Nov 30 15:55:05 2023 +0100
[FLINK-33704][Filesytems] Update GCS filesystems to latest available
versions. This closes #23837
* [FLINK-33704][Filesystem] Update GCS filesystem dependencies
- Update GS SDK from 2.15.0 to 2.29.1
- Update GS Hadoop Connector from 2.2.15 to 2.2.18
- Update GS GRPC to highest shared version
* [FLINK-33704] Make NOTICE inclusion of com.google.re2j for GCS consistent
RE2J is listed for the other filesystems as Go license, we should remain
consistent throughout the project
---
docs/content.zh/docs/deployment/filesystems/gcs.md | 4 +-
docs/content/docs/deployment/filesystems/gcs.md| 4 +-
flink-filesystems/flink-gs-fs-hadoop/pom.xml | 10 +-
.../src/main/resources/META-INF/NOTICE | 105 +++--
4 files changed, 64 insertions(+), 59 deletions(-)
diff --git a/docs/content.zh/docs/deployment/filesystems/gcs.md
b/docs/content.zh/docs/deployment/filesystems/gcs.md
index 363cd2fec90..7edf78b2e61 100644
--- a/docs/content.zh/docs/deployment/filesystems/gcs.md
+++ b/docs/content.zh/docs/deployment/filesystems/gcs.md
@@ -55,7 +55,7 @@ Note that these examples are *not* exhaustive and you can use
GCS in other place
Flink provides the `flink-gs-fs-hadoop` file system to write to GCS.
This implementation is self-contained with no dependency footprint, so there
is no need to add Hadoop to the classpath to use it.
-`flink-gs-fs-hadoop` registers a `FileSystem` wrapper for URIs with the
*gs://* scheme. It uses Google's
[gcs-connector](https://mvnrepository.com/artifact/com.google.cloud.bigdataoss/gcs-connector/hadoop3-2.2.15)
Hadoop library to access GCS. It also uses Google's
[google-cloud-storage](https://mvnrepository.com/artifact/com.google.cloud/google-cloud-storage/2.15.0)
library to provide `RecoverableWriter` support.
+`flink-gs-fs-hadoop` registers a `FileSystem` wrapper for URIs with the
*gs://* scheme. It uses Google's
[gcs-connector](https://mvnrepository.com/artifact/com.google.cloud.bigdataoss/gcs-connector/hadoop3-2.2.18)
Hadoop library to access GCS. It also uses Google's
[google-cloud-storage](https://mvnrepository.com/artifact/com.google.cloud/google-cloud-storage/2.29.1)
library to provide `RecoverableWriter` support.
This file system can be used with the [FileSystem connector]({{< ref
"docs/connectors/datastream/filesystem.md" >}}).
@@ -68,7 +68,7 @@ cp ./opt/flink-gs-fs-hadoop-{{< version >}}.jar
./plugins/gs-fs-hadoop/
### Configuration
-The underlying Hadoop file system can be configured using the [Hadoop
configuration
keys](https://github.com/GoogleCloudDataproc/hadoop-connectors/blob/v2.2.15/gcs/CONFIGURATION.md)
for `gcs-connector` by adding the configurations to your `flink-conf.yaml`.
+The underlying Hadoop file system can be configured using the [Hadoop
configuration
keys](https://github.com/GoogleCloudDataproc/hadoop-connectors/blob/v2.2.18/gcs/CONFIGURATION.md)
for `gcs-connector` by adding the configurations to your `flink-conf.yaml`.
For example, `gcs-connector` has a `fs.gs.http.connect-timeout` configuration
key. If you want to change it, you need to set `gs.http.connect-timeout: xyz`
in `flink-conf.yaml`. Flink will internally translate this back to
`fs.gs.http.connect-timeout`.
diff --git a/docs/content/docs/deployment/filesystems/gcs.md
b/docs/content/docs/deployment/filesystems/gcs.md
index 97e008eca33..3bd130e2046 100644
--- a/docs/content/docs/deployment/filesystems/gcs.md
+++ b/docs/content/docs/deployment/filesystems/gcs.md
@@ -55,7 +55,7 @@ Note that these examples are *not* exhaustive and you can use
GCS in other place
Flink provides the `flink-gs-fs-hadoop` file system to write to GCS.
This implementation is self-contained with no dependency footprint, so there
is no need to add Hadoop to the classpath to use it.
-`flink-gs-fs-hadoop` registers a `FileSystem` wrapper for URIs with the
*gs://* scheme. It uses Google's
[gcs-connector](https://mvnrepository.com/artifact/com.google.cloud.bigdataoss/gcs-connector/hadoop3-2.2.15)
Hadoop library to access GCS. It also uses Google's
[google-cloud-storage](https://mvnrepository.com/artifact/com.google.cloud/google-cloud-storage/2.15.0)
library to provide `RecoverableWriter` support.
+`flink-gs-fs-hadoop` registers a `FileSystem` wrapper for URIs with the
*gs://* scheme. It uses Google's
[gcs-connecto
(flink-connector-jdbc) branch dependabot/maven/flink-connector-jdbc/com.h2database-h2-2.2.220 deleted (was 4e4cc41)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to branch dependabot/maven/flink-connector-jdbc/com.h2database-h2-2.2.220 in repository https://gitbox.apache.org/repos/asf/flink-connector-jdbc.git was 4e4cc41 [FLINK-33662] Bump h2 from 2.1.210 to 2.2.224 in /flink-connector-jdbc The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(flink-connector-jdbc) branch main updated: [FLINK-33662] Bump h2 from 2.1.210 to 2.2.224. This closes #69
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-jdbc.git The following commit(s) were added to refs/heads/main by this push: new b477d45 [FLINK-33662] Bump h2 from 2.1.210 to 2.2.224. This closes #69 b477d45 is described below commit b477d452ba3aac38d53d1f5d4c4820bdad3ad9cd Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> AuthorDate: Mon Nov 27 11:42:56 2023 +0100 [FLINK-33662] Bump h2 from 2.1.210 to 2.2.224. This closes #69 Bumps [h2](https://github.com/h2database/h2database) from 2.1.210 to 2.2.224. - [Release notes](https://github.com/h2database/h2database/releases) - [Commits](https://github.com/h2database/h2database/compare/version-2.1.210...version-2.2.224) --- updated-dependencies: - dependency-name: com.h2database:h2 dependency-type: direct:development ... Signed-off-by: dependabot[bot] Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> --- flink-connector-jdbc/pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/flink-connector-jdbc/pom.xml b/flink-connector-jdbc/pom.xml index ac6ec05..51406e4 100644 --- a/flink-connector-jdbc/pom.xml +++ b/flink-connector-jdbc/pom.xml @@ -220,7 +220,7 @@ under the License. com.h2database h2 - 2.1.210 + 2.2.224 test
(flink-connector-jdbc) 01/01: [FLINK-33662] Bump h2 from 2.1.210 to 2.2.224 in /flink-connector-jdbc
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a commit to branch dependabot/maven/flink-connector-jdbc/com.h2database-h2-2.2.220 in repository https://gitbox.apache.org/repos/asf/flink-connector-jdbc.git commit 4e4cc413b1d19965ece00b03942329407da91285 Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> AuthorDate: Fri Jul 7 21:55:44 2023 + [FLINK-33662] Bump h2 from 2.1.210 to 2.2.224 in /flink-connector-jdbc Bumps [h2](https://github.com/h2database/h2database) from 2.1.210 to 2.2.224. - [Release notes](https://github.com/h2database/h2database/releases) - [Commits](https://github.com/h2database/h2database/compare/version-2.1.210...version-2.2.224) --- updated-dependencies: - dependency-name: com.h2database:h2 dependency-type: direct:development ... Signed-off-by: dependabot[bot] --- flink-connector-jdbc/pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/flink-connector-jdbc/pom.xml b/flink-connector-jdbc/pom.xml index ac6ec05..51406e4 100644 --- a/flink-connector-jdbc/pom.xml +++ b/flink-connector-jdbc/pom.xml @@ -220,7 +220,7 @@ under the License. com.h2database h2 - 2.1.210 + 2.2.224 test
(flink-connector-jdbc) branch dependabot/maven/flink-connector-jdbc/com.h2database-h2-2.2.220 updated (25b76c9 -> 4e4cc41)
This is an automated email from the ASF dual-hosted git repository.
martijnvisser pushed a change to branch
dependabot/maven/flink-connector-jdbc/com.h2database-h2-2.2.220
in repository https://gitbox.apache.org/repos/asf/flink-connector-jdbc.git
omit 25b76c9 Bump h2 from 2.1.210 to 2.2.220 in /flink-connector-jdbc
add 3ecd0fd [FLINK-14102] Introduce DB2Dialect
add 8e0496a [FLINK-15462] Add Trino dialect
add a2fd18a [FLINK-31332] Limit the use of ExecutionConfig on
JdbcOutputFormat
add 79e7509 [FLINK-33378] Prepare actions for flink version 1.18
new 4e4cc41 [FLINK-33662] Bump h2 from 2.1.210 to 2.2.224 in
/flink-connector-jdbc
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (25b76c9)
\
N -- N -- N
refs/heads/dependabot/maven/flink-connector-jdbc/com.h2database-h2-2.2.220
(4e4cc41)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.github/workflows/push_pr.yml | 2 +-
.github/workflows/weekly.yml | 2 +-
docs/content.zh/docs/connectors/table/jdbc.md | 94 +++---
docs/content/docs/connectors/table/jdbc.md | 88 +++--
flink-connector-jdbc/pom.xml | 36 +++-
.../flink/connector/jdbc/JdbcRowOutputFormat.java | 14 +-
.../org/apache/flink/connector/jdbc/JdbcSink.java | 7 +-
.../dialect/Db2Dialect.java} | 116 ++--
.../dialect/Db2DialectFactory.java}| 10 +-
.../dialect/Db2RowConverter.java} | 18 +-
.../dialect/TrinoDialect.java} | 58 +++---
.../dialect/TrinoDialectFactory.java} | 10 +-
.../dialect/TrinoRowConverter.java}| 39 ++--
.../jdbc/internal/GenericJdbcSinkFunction.java | 14 +-
.../connector/jdbc/internal/JdbcOutputFormat.java | 198 ++---
.../jdbc/internal/JdbcOutputSerializer.java| 55 ++
.../jdbc/internal/RowJdbcOutputFormat.java | 148 +++
.../jdbc/internal/TableJdbcUpsertOutputFormat.java | 41 ++---
.../executor/JdbcBatchStatementExecutor.java | 6 +-
.../executor/SimpleBatchStatementExecutor.java | 16 +-
.../TableBufferReducedStatementExecutor.java | 8 +-
.../executor/TableBufferedStatementExecutor.java | 10 +-
.../connector/jdbc/table/JdbcDynamicTableSink.java | 5 -
.../jdbc/table/JdbcOutputFormatBuilder.java| 50 +-
.../connector/jdbc/xa/JdbcXaSinkFunction.java | 22 +--
...flink.connector.jdbc.dialect.JdbcDialectFactory | 2 +
.../flink/connector/jdbc/JdbcDataTestBase.java | 25 ++-
.../connector/jdbc/JdbcRowOutputFormatTest.java| 50 --
.../apache/flink/connector/jdbc/JdbcTestBase.java | 34 +++-
.../{h2/H2XaTestBase.java => db2/Db2TestBase.java} | 12 +-
.../dialect/Db2DialectTypeTest.java} | 16 +-
.../dialect/Db2PreparedStatementTest.java} | 17 +-
.../table/Db2DynamicTableSinkITCase.java} | 28 ++-
.../db2/table/Db2DynamicTableSourceITCase.java | 113
.../xa/Db2ExactlyOnceSinkE2eTest.java} | 7 +-
.../TrinoTestBase.java}| 14 +-
.../dialect/TrinoDialectTypeTest.java} | 20 +--
.../dialect/TrinoPreparedStatementTest.java} | 36 +---
.../trino/table/TrinoDynamicTableSinkITCase.java | 75
.../table/TrinoDynamicTableSourceITCase.java} | 52 +++---
.../connector/jdbc/internal/JdbcFullTest.java | 71 +---
.../jdbc/internal/JdbcOutputSerializerTest.java| 35
.../jdbc/internal/JdbcTableOutputFormatTest.java | 50 +++---
.../jdbc/table/JdbcAppendOnlyWriterTest.java | 25 ++-
.../jdbc/table/JdbcDynamicTableSinkITCase.java | 20 ++-
.../jdbc/table/JdbcDynamicTableSourceITCase.java | 28 ++-
.../connector/jdbc/table/JdbcOutputFormatTest.java | 70 +---
.../jdbc/testutils/databases/db2/Db2Database.java | 69 +++
.../Db2Metadata.java} | 36 ++--
.../testutils/databases/trino/TrinoDatabase.java | 108 +++
.../PostgresImages.java => trino/TrinoImages.java} | 7 +-
.../TrinoM
(flink) branch master updated: [hotfix] Set available Flink Cassandra connector for 1.18 to v3.1
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/flink.git The following commit(s) were added to refs/heads/master by this push: new 0b4e32e8634 [hotfix] Set available Flink Cassandra connector for 1.18 to v3.1 0b4e32e8634 is described below commit 0b4e32e86342a7b10d612157cefe1dc114801aa1 Author: Martijn Visser AuthorDate: Mon Nov 20 10:41:36 2023 +0100 [hotfix] Set available Flink Cassandra connector for 1.18 to v3.1 There is no Flink 1.18+ compatible version for the Cassandra connector yet, but the v3.1 at least has the indicator that there's no version available so it will correctly display the results. --- docs/setup_docs.sh | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/setup_docs.sh b/docs/setup_docs.sh index 11302bb489a..aaee09149bd 100755 --- a/docs/setup_docs.sh +++ b/docs/setup_docs.sh @@ -45,7 +45,7 @@ cd tmp integrate_connector_docs elasticsearch v3.0 integrate_connector_docs aws v4.1 -integrate_connector_docs cassandra v3.0 +integrate_connector_docs cassandra v3.1 integrate_connector_docs pulsar v4.0 integrate_connector_docs jdbc v3.1 integrate_connector_docs rabbitmq v3.0
(flink) branch release-1.18 updated: [hotfix] Set available Flink Cassandra connector for 1.18 to v3.1
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a commit to branch release-1.18 in repository https://gitbox.apache.org/repos/asf/flink.git The following commit(s) were added to refs/heads/release-1.18 by this push: new 2e86568b439 [hotfix] Set available Flink Cassandra connector for 1.18 to v3.1 2e86568b439 is described below commit 2e86568b4395ba188f34082891cd767d31979d4b Author: Martijn Visser AuthorDate: Mon Nov 20 10:40:14 2023 +0100 [hotfix] Set available Flink Cassandra connector for 1.18 to v3.1 There is no Flink 1.18 compatible version for the Cassandra connector yet, but the v3.1 at least has the indicator that there's no version available so it will correctly display the results. --- docs/setup_docs.sh | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/setup_docs.sh b/docs/setup_docs.sh index 11302bb489a..aaee09149bd 100755 --- a/docs/setup_docs.sh +++ b/docs/setup_docs.sh @@ -45,7 +45,7 @@ cd tmp integrate_connector_docs elasticsearch v3.0 integrate_connector_docs aws v4.1 -integrate_connector_docs cassandra v3.0 +integrate_connector_docs cassandra v3.1 integrate_connector_docs pulsar v4.0 integrate_connector_docs jdbc v3.1 integrate_connector_docs rabbitmq v3.0
(flink) branch release-1.17 updated (9052407919c -> 69a573ee9b5)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to branch release-1.17 in repository https://gitbox.apache.org/repos/asf/flink.git from 9052407919c [FLINK-33589][docs] Fix connector_artifact to prevent generation of broken layout add 69a573ee9b5 [hotfix] Set available Flink Cassandra connector for 1.17 to v3.1 No new revisions were added by this update. Summary of changes: docs/setup_docs.sh | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
(flink-connector-hbase) branch v3.0 updated: [FLINK-33542] Update tests to JUnit5. This closes #32
This is an automated email from the ASF dual-hosted git repository.
martijnvisser pushed a commit to branch v3.0
in repository https://gitbox.apache.org/repos/asf/flink-connector-hbase.git
The following commit(s) were added to refs/heads/v3.0 by this push:
new c0216b7 [FLINK-33542] Update tests to JUnit5. This closes #32
c0216b7 is described below
commit c0216b75242b97f03e895b9127d0f17174ca2ea5
Author: Ferenc Csaky
AuthorDate: Fri Nov 17 11:10:58 2023 +0100
[FLINK-33542] Update tests to JUnit5. This closes #32
* [FLINK-33542] Update tests to JUnit5
* Remove remaining "public" modifiers from test methods
* Remove unnecessary mini cluster extension
(cherry picked from commit a36b137d0474312b893934dbdf36afde8bb2819f)
---
.../connector/hbase1/HBaseConnectorITCase.java | 48 ++---
.../hbase1/HBaseDynamicTableFactoryTest.java | 225 +++
.../flink/connector/hbase1/util/HBaseTestBase.java | 8 +-
.../util/HBaseTestingClusterAutoStarter.java | 55 +++--
.../connector/hbase2/HBaseConnectorITCase.java | 69 +++---
.../hbase2/HBaseDynamicTableFactoryTest.java | 238 -
.../HBaseRowDataAsyncLookupFunctionTest.java | 35 ++-
.../flink/connector/hbase2/util/HBaseTestBase.java | 8 +-
.../util/HBaseTestingClusterAutoStarter.java | 45 ++--
9 files changed, 307 insertions(+), 424 deletions(-)
diff --git
a/flink-connector-hbase-1.4/src/test/java/org/apache/flink/connector/hbase1/HBaseConnectorITCase.java
b/flink-connector-hbase-1.4/src/test/java/org/apache/flink/connector/hbase1/HBaseConnectorITCase.java
index e924d58..c9cabb3 100644
---
a/flink-connector-hbase-1.4/src/test/java/org/apache/flink/connector/hbase1/HBaseConnectorITCase.java
+++
b/flink-connector-hbase-1.4/src/test/java/org/apache/flink/connector/hbase1/HBaseConnectorITCase.java
@@ -47,7 +47,7 @@ import org.apache.hadoop.hbase.HConstants;
import org.apache.hadoop.hbase.TableName;
import org.apache.hadoop.hbase.TableNotFoundException;
import org.apache.hadoop.hbase.util.Bytes;
-import org.junit.Test;
+import org.junit.jupiter.api.Test;
import java.io.IOException;
import java.util.ArrayList;
@@ -61,19 +61,16 @@ import java.util.stream.Collectors;
import static org.apache.flink.table.api.Expressions.$;
import static org.assertj.core.api.Assertions.assertThat;
import static org.assertj.core.api.Assertions.assertThatThrownBy;
-import static org.junit.Assert.assertEquals;
-import static org.junit.Assert.assertNotNull;
-import static org.junit.Assert.assertNull;
/** IT cases for HBase connector (source and sink). */
-public class HBaseConnectorITCase extends HBaseTestBase {
+class HBaseConnectorITCase extends HBaseTestBase {
//
-
// HBaseTableSource tests
//
-
@Test
-public void testTableSourceFullScan() {
+void testTableSourceFullScan() {
TableEnvironment tEnv = TableEnvironment.create(batchSettings);
tEnv.executeSql(
"CREATE TABLE hTable ("
@@ -118,7 +115,7 @@ public class HBaseConnectorITCase extends HBaseTestBase {
}
@Test
-public void testTableSourceEmptyTableScan() {
+void testTableSourceEmptyTableScan() {
TableEnvironment tEnv = TableEnvironment.create(batchSettings);
tEnv.executeSql(
@@ -143,7 +140,7 @@ public class HBaseConnectorITCase extends HBaseTestBase {
}
@Test
-public void testTableSourceProjection() {
+void testTableSourceProjection() {
TableEnvironment tEnv = TableEnvironment.create(batchSettings);
tEnv.executeSql(
@@ -187,7 +184,7 @@ public class HBaseConnectorITCase extends HBaseTestBase {
}
@Test
-public void testTableSourceFieldOrder() {
+void testTableSourceFieldOrder() {
TableEnvironment tEnv = TableEnvironment.create(batchSettings);
tEnv.executeSql(
@@ -223,7 +220,7 @@ public class HBaseConnectorITCase extends HBaseTestBase {
}
@Test
-public void testTableSourceReadAsByteArray() {
+void testTableSourceReadAsByteArray() {
TableEnvironment tEnv = TableEnvironment.create(batchSettings);
tEnv.executeSql(
@@ -265,7 +262,7 @@ public class HBaseConnectorITCase extends HBaseTestBase {
}
@Test
-public void testTableSink() throws Exception {
+void testTableSink() throws Exception {
StreamExecutionEnvironment execEnv =
StreamExecutionEnvironment.getExecutionEnvironment();
StreamTableEnvironment tEnv = StreamTableEnvironment.create(execEnv,
streamSettings);
@@ -321,7 +318,7 @@ public class HBaseConnectorITCase extends HBaseTestBase {
}
@Test
-public void testTableSinkWithChangelog() throws Exception {
+void testTableSinkWithChangelo
