[flink-benchmarks] branch 30717 updated (bf57a85 -> 9d7d868)
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a change to branch 30717 in repository https://gitbox.apache.org/repos/asf/flink-benchmarks.git from bf57a85 [FLINK-30717][ci] Migrate to GitHub Actions add 9d7d868 install libssl No new revisions were added by this update. Summary of changes: .github/workflows/ci.yml | 4 1 file changed, 4 insertions(+)
[flink-benchmarks] 01/01: [FLINK-30717][ci] Migrate to GitHub Actions
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch 30717 in repository https://gitbox.apache.org/repos/asf/flink-benchmarks.git commit bf57a854ffda09684f47c64d30844c64ce0e200a Author: Chesnay Schepler AuthorDate: Tue Jan 17 15:56:31 2023 +0100 [FLINK-30717][ci] Migrate to GitHub Actions --- .github/workflows/ci.yml | 44 .travis.yml | 10 -- 2 files changed, 44 insertions(+), 10 deletions(-) diff --git a/.github/workflows/ci.yml b/.github/workflows/ci.yml new file mode 100644 index 000..aac962e --- /dev/null +++ b/.github/workflows/ci.yml @@ -0,0 +1,44 @@ +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor license agreements. See the NOTICE file distributed with +# this work for additional information regarding copyright ownership. +# The ASF licenses this file to You under the Apache License, Version 2.0 +# (the "License"); you may not use this file except in compliance with +# the License. You may obtain a copy of the License at +# +#http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, software +# distributed under the License is distributed on an "AS IS" BASIS, +# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +# See the License for the specific language governing permissions and +# limitations under the License. + +name: CI + +on: [push, pull_request] + +jobs: + build: +runs-on: ubuntu-latest + +steps: + - uses: actions/checkout@v3 + + - name: Set JDK +uses: actions/setup-java@v3 +with: + java-version: 11 + distribution: 'temurin' + cache: 'maven' + + - name: Set Maven 3.8.6 +uses: stCarolas/setup-maven@v4.2 +with: + maven-version: 3.8.6 + + - name: Compile +# https.protocols is a workaround for https://bugs.openjdk.java.net/browse/JDK-8213202 +run: mvn install -P test -DskipTests=true -Dmaven.javadoc.skip=true -Dhttps.protocols=TLSv1,TLSv1.1,TLSv1.2 -B -V + + - name: Test +run: mvn test -P test -B diff --git a/.travis.yml b/.travis.yml deleted file mode 100644 index 150cb4c..000 --- a/.travis.yml +++ /dev/null @@ -1,10 +0,0 @@ -language: java -install: -# Invoke the "travis" profile during Maven steps; see in pom.xml -# files. The "mvn install" command will run by default during the "install" -# phase by Travis, without the profile flag. Here we customize the install -# phase to use the relevant profile. -# https.protocols is a workaround for https://bugs.openjdk.java.net/browse/JDK-8213202 -- mvn install -P test -DskipTests=true -Dmaven.javadoc.skip=true -Dhttps.protocols=TLSv1,TLSv1.1,TLSv1.2 -B -V -script: -- mvn test -P test -B
[flink-benchmarks] branch 30717 updated (a83702b -> bf57a85)
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a change to branch 30717 in repository https://gitbox.apache.org/repos/asf/flink-benchmarks.git discard a83702b [FLINK-30717][ci] Migrate to GitHub Actions new bf57a85 [FLINK-30717][ci] Migrate to GitHub Actions This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (a83702b) \ N -- N -- N refs/heads/30717 (bf57a85) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .github/workflows/ci.yml | 7 ++- 1 file changed, 6 insertions(+), 1 deletion(-)
[flink-benchmarks] branch 30717 created (now a83702b)
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a change to branch 30717 in repository https://gitbox.apache.org/repos/asf/flink-benchmarks.git at a83702b [FLINK-30717][ci] Migrate to GitHub Actions This branch includes the following new commits: new a83702b [FLINK-30717][ci] Migrate to GitHub Actions The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[flink-benchmarks] 01/01: [FLINK-30717][ci] Migrate to GitHub Actions
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch 30717 in repository https://gitbox.apache.org/repos/asf/flink-benchmarks.git commit a83702be2bfda2a42dbc5888abf2d731e40b2a02 Author: Chesnay Schepler AuthorDate: Tue Jan 17 15:56:31 2023 +0100 [FLINK-30717][ci] Migrate to GitHub Actions --- .github/workflows/ci.yml | 39 +++ .travis.yml | 10 -- 2 files changed, 39 insertions(+), 10 deletions(-) diff --git a/.github/workflows/ci.yml b/.github/workflows/ci.yml new file mode 100644 index 000..5492dc4 --- /dev/null +++ b/.github/workflows/ci.yml @@ -0,0 +1,39 @@ +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor license agreements. See the NOTICE file distributed with +# this work for additional information regarding copyright ownership. +# The ASF licenses this file to You under the Apache License, Version 2.0 +# (the "License"); you may not use this file except in compliance with +# the License. You may obtain a copy of the License at +# +#http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, software +# distributed under the License is distributed on an "AS IS" BASIS, +# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +# See the License for the specific language governing permissions and +# limitations under the License. + +name: CI + +on: [push, pull_request] + +jobs: + build: +runs-on: ubuntu-latest + +steps: + - uses: actions/checkout@v3 + + - name: Set JDK +uses: actions/setup-java@v3 +with: + java-version: 8 + distribution: 'temurin' + cache: 'maven' + + - name: Compile +# https.protocols is a workaround for https://bugs.openjdk.java.net/browse/JDK-8213202 +run: mvn install -P test -DskipTests=true -Dmaven.javadoc.skip=true -Dhttps.protocols=TLSv1,TLSv1.1,TLSv1.2 -B -V + + - name: Test +run: mvn test -P test -B diff --git a/.travis.yml b/.travis.yml deleted file mode 100644 index 150cb4c..000 --- a/.travis.yml +++ /dev/null @@ -1,10 +0,0 @@ -language: java -install: -# Invoke the "travis" profile during Maven steps; see in pom.xml -# files. The "mvn install" command will run by default during the "install" -# phase by Travis, without the profile flag. Here we customize the install -# phase to use the relevant profile. -# https.protocols is a workaround for https://bugs.openjdk.java.net/browse/JDK-8213202 -- mvn install -P test -DskipTests=true -Dmaven.javadoc.skip=true -Dhttps.protocols=TLSv1,TLSv1.1,TLSv1.2 -B -V -script: -- mvn test -P test -B
[flink-training] 01/01: [FLINK-30717][ci] Migrate to GitHub Actions
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch 30717 in repository https://gitbox.apache.org/repos/asf/flink-training.git commit c286769fd80b89581c5c9164927c15160ee723e2 Author: Chesnay Schepler AuthorDate: Tue Jan 17 15:47:06 2023 +0100 [FLINK-30717][ci] Migrate to GitHub Actions --- .github/workflows/ci.yml | 41 + .travis.yml | 17 - 2 files changed, 41 insertions(+), 17 deletions(-) diff --git a/.github/workflows/ci.yml b/.github/workflows/ci.yml new file mode 100644 index 000..321508f --- /dev/null +++ b/.github/workflows/ci.yml @@ -0,0 +1,41 @@ +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor license agreements. See the NOTICE file distributed with +# this work for additional information regarding copyright ownership. +# The ASF licenses this file to You under the Apache License, Version 2.0 +# (the "License"); you may not use this file except in compliance with +# the License. You may obtain a copy of the License at +# +#http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, software +# distributed under the License is distributed on an "AS IS" BASIS, +# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +# See the License for the specific language governing permissions and +# limitations under the License. + +name: CI + +on: [push, pull_request] + +jobs: + build: +runs-on: ubuntu-latest +strategy: + matrix: +java: [8, 11] + +steps: + - uses: actions/checkout@v3 + + - name: Set JDK +uses: actions/setup-java@v3 +with: + java-version: ${{ matrix.java }} + distribution: 'temurin' + cache: 'gradle' + + - name: Build without Scala +run: ./gradlew build --scan --stacktrace -Porg.gradle.project.enable_scala=false + + - name: Build without Scala +run: ./gradlew build --scan --stacktrace -Porg.gradle.project.enable_scala=true diff --git a/.travis.yml b/.travis.yml deleted file mode 100644 index a1c252d..000 --- a/.travis.yml +++ /dev/null @@ -1,17 +0,0 @@ -language: java -jdk: - - openjdk8 - - openjdk11 - -script: - - ./gradlew build --scan --stacktrace -Porg.gradle.project.enable_scala=false - - ./gradlew build --scan --stacktrace -Porg.gradle.project.enable_scala=true - -before_cache: - - rm -f $HOME/.gradle/caches/modules-2/modules-2.lock - - rm -fr $HOME/.gradle/caches/*/plugin-resolution/ - -cache: - directories: -- $HOME/.gradle/caches/ -- $HOME/.gradle/wrapper/
[flink-training] branch 30717 updated (3f281f6 -> c286769)
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a change to branch 30717 in repository https://gitbox.apache.org/repos/asf/flink-training.git discard 3f281f6 [FLINK-30717][ci] Migrate to GitHub Actions new c286769 [FLINK-30717][ci] Migrate to GitHub Actions This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (3f281f6) \ N -- N -- N refs/heads/30717 (c286769) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .github/workflows/ci.yml | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)
[flink-training] branch 30717 created (now 3f281f6)
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a change to branch 30717 in repository https://gitbox.apache.org/repos/asf/flink-training.git at 3f281f6 [FLINK-30717][ci] Migrate to GitHub Actions This branch includes the following new commits: new 3f281f6 [FLINK-30717][ci] Migrate to GitHub Actions The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[flink-training] 01/01: [FLINK-30717][ci] Migrate to GitHub Actions
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch 30717 in repository https://gitbox.apache.org/repos/asf/flink-training.git commit 3f281f63c88067732aabe47ea0b3f2f97f06308f Author: Chesnay Schepler AuthorDate: Tue Jan 17 15:47:06 2023 +0100 [FLINK-30717][ci] Migrate to GitHub Actions --- .github/workflows/ci.yml | 41 + .travis.yml | 17 - 2 files changed, 41 insertions(+), 17 deletions(-) diff --git a/.github/workflows/ci.yml b/.github/workflows/ci.yml new file mode 100644 index 000..dd686ed --- /dev/null +++ b/.github/workflows/ci.yml @@ -0,0 +1,41 @@ +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor license agreements. See the NOTICE file distributed with +# this work for additional information regarding copyright ownership. +# The ASF licenses this file to You under the Apache License, Version 2.0 +# (the "License"); you may not use this file except in compliance with +# the License. You may obtain a copy of the License at +# +#http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, software +# distributed under the License is distributed on an "AS IS" BASIS, +# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +# See the License for the specific language governing permissions and +# limitations under the License. + +name: CI + +on: [push, pull_request] + +jobs: + build: +runs-on: ubuntu-latest +strategy: + matrix: +java: [8, 11] + +steps: + - uses: actions/checkout@v2 + + - name: Set JDK +uses: actions/setup-java@v2 +with: + java-version: ${{ matrix.java }} + distribution: 'temurin' + cache: 'gradle' + + - name: Build without Scala +run: ./gradlew build --scan --stacktrace -Porg.gradle.project.enable_scala=false + + - name: Build without Scala +run: ./gradlew build --scan --stacktrace -Porg.gradle.project.enable_scala=true diff --git a/.travis.yml b/.travis.yml deleted file mode 100644 index a1c252d..000 --- a/.travis.yml +++ /dev/null @@ -1,17 +0,0 @@ -language: java -jdk: - - openjdk8 - - openjdk11 - -script: - - ./gradlew build --scan --stacktrace -Porg.gradle.project.enable_scala=false - - ./gradlew build --scan --stacktrace -Porg.gradle.project.enable_scala=true - -before_cache: - - rm -f $HOME/.gradle/caches/modules-2/modules-2.lock - - rm -fr $HOME/.gradle/caches/*/plugin-resolution/ - -cache: - directories: -- $HOME/.gradle/caches/ -- $HOME/.gradle/wrapper/
[flink] branch master updated (60101e120fb -> 0c4fdb6cb56)
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git from 60101e120fb [FLINK-30350][build] Use default location for dependency reduced pom add 0c4fdb6cb56 [FLINK-30083][build] Bump maven-shade-plugin version to 3.4.1 No new revisions were added by this update. Summary of changes: pom.xml | 7 +-- 1 file changed, 1 insertion(+), 6 deletions(-)
[flink] branch master updated (904c695776a -> 60101e120fb)
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git from 904c695776a [FLINK-30661][table] introduce SupportsRowLevelUpdate interface add 60101e120fb [FLINK-30350][build] Use default location for dependency reduced pom No new revisions were added by this update. Summary of changes: flink-dist/pom.xml | 4 +--- .../test-scripts/test_quickstarts.sh | 2 +- .../flink/client/cli/PythonProgramOptionsITCase.java | 3 ++- flink-table/flink-table-planner/pom.xml | 1 - .../flink/test/classloading/ClassLoaderITCase.java | 20 +++- flink-yarn-tests/pom.xml | 3 --- pom.xml | 17 - tools/releasing/create_source_release.sh | 1 + 8 files changed, 32 insertions(+), 19 deletions(-)
[flink] branch release-1.16 updated (5ac47d61134 -> 8283dfcf69f)
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a change to branch release-1.16 in repository https://gitbox.apache.org/repos/asf/flink.git from 5ac47d61134 [hotfix][docs] Update the outdated documentation about broadcast state's support in PyFlink add 8283dfcf69f [FLINK-30525][web] Remove broken reference to env variables field No new revisions were added by this update. Summary of changes: .../web-dashboard/src/app/interfaces/configuration.ts | 1 - .../common/configuration-cards/configuration-cards.component.html | 7 --- 2 files changed, 8 deletions(-)
[flink] branch master updated: [FLINK-30525][web] Remove broken reference to env variables field
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/flink.git The following commit(s) were added to refs/heads/master by this push: new 560b4612735 [FLINK-30525][web] Remove broken reference to env variables field 560b4612735 is described below commit 560b4612735a2b9cd3b5db88adf5cb223e85535b Author: Weihua Hu AuthorDate: Fri Jan 13 23:00:38 2023 +0800 [FLINK-30525][web] Remove broken reference to env variables field --- .../configuration-cards/configuration-cards.component.html | 7 --- .../web-dashboard/src/app/interfaces/configuration.ts | 1 - 2 files changed, 8 deletions(-) diff --git a/flink-runtime-web/web-dashboard/src/app/components/configuration-cards/configuration-cards.component.html b/flink-runtime-web/web-dashboard/src/app/components/configuration-cards/configuration-cards.component.html index eaa91780ea7..687e4481123 100644 --- a/flink-runtime-web/web-dashboard/src/app/components/configuration-cards/configuration-cards.component.html +++ b/flink-runtime-web/web-dashboard/src/app/components/configuration-cards/configuration-cards.component.html @@ -23,13 +23,6 @@ > - - - - ; jvm: JvmInfo; classpath: string[]; }
[flink-connector-shared-utils] branch parent_pom updated: [hotfix] Fix parent groupId
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch parent_pom in repository https://gitbox.apache.org/repos/asf/flink-connector-shared-utils.git The following commit(s) were added to refs/heads/parent_pom by this push: new f02998c [hotfix] Fix parent groupId f02998c is described below commit f02998ca8f0f6a00dfbb8573454b48ea53660152 Author: Chesnay Schepler AuthorDate: Fri Jan 13 15:40:50 2023 +0100 [hotfix] Fix parent groupId --- pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pom.xml b/pom.xml index 947c510..501c9d2 100644 --- a/pom.xml +++ b/pom.xml @@ -20,7 +20,7 @@ under the License. 4.0.0 -org.apache.flink +org.apache apache 20
[flink-connector-shared-utils] branch parent_pom updated: [hotfix] Add missing groupId
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch parent_pom in repository https://gitbox.apache.org/repos/asf/flink-connector-shared-utils.git The following commit(s) were added to refs/heads/parent_pom by this push: new fb5d5ed [hotfix] Add missing groupId fb5d5ed is described below commit fb5d5ed05e78b934b6be4fb76861f89054e1f2e8 Author: Chesnay Schepler AuthorDate: Fri Jan 13 15:36:49 2023 +0100 [hotfix] Add missing groupId --- pom.xml | 1 + 1 file changed, 1 insertion(+) diff --git a/pom.xml b/pom.xml index f8e25d4..947c510 100644 --- a/pom.xml +++ b/pom.xml @@ -25,6 +25,7 @@ under the License. 20 +org.apache.flink flink-connector-parent 1.0 pom
[flink-connector-shared-utils] branch parent_pom updated: [hotfix] Fix parent section
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch parent_pom in repository https://gitbox.apache.org/repos/asf/flink-connector-shared-utils.git The following commit(s) were added to refs/heads/parent_pom by this push: new e0e745e [hotfix] Fix parent section e0e745e is described below commit e0e745e6f4caf8e8c0ecf8c4a95ca88a247df0d8 Author: Chesnay Schepler AuthorDate: Fri Jan 13 15:34:51 2023 +0100 [hotfix] Fix parent section --- pom.xml | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/pom.xml b/pom.xml index 18f7566..f8e25d4 100644 --- a/pom.xml +++ b/pom.xml @@ -20,11 +20,11 @@ under the License. 4.0.0 -org.apache +org.apache.flink apache 20 + -org.apache.flink flink-connector-parent 1.0 pom @@ -955,4 +955,4 @@ under the License. - \ No newline at end of file +
[flink-connector-shared-utils] branch parent_pom created (now 1e05d70)
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a change to branch parent_pom in repository https://gitbox.apache.org/repos/asf/flink-connector-shared-utils.git at 1e05d70 Add 1.0 connector parent pom This branch includes the following new commits: new 1e05d70 Add 1.0 connector parent pom The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[flink-connector-shared-utils] 01/01: Add 1.0 connector parent pom
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch parent_pom in repository https://gitbox.apache.org/repos/asf/flink-connector-shared-utils.git commit 1e05d70c066ee6a27f6a3af2d9cb48e65e96cc2b Author: Chesnay Schepler AuthorDate: Thu Jan 12 17:40:41 2023 +0100 Add 1.0 connector parent pom --- .gitignore | 39 ++- pom.xml| 958 + 2 files changed, 995 insertions(+), 2 deletions(-) diff --git a/.gitignore b/.gitignore index 29b636a..a402c47 100644 --- a/.gitignore +++ b/.gitignore @@ -1,2 +1,37 @@ -.idea -*.iml \ No newline at end of file +.eslintcache +.cache +scalastyle-output.xml +.classpath +.idea/* +.metadata +.settings +.project +.version.properties +filter.properties +logs.zip +.mvn/wrapper/*.jar +target +tmp +*.class +*.iml +*.swp +*.jar +*.zip +*.log +*.pyc +.DS_Store +build-target +atlassian-ide-plugin.xml +out/ +/docs/api +/docs/.bundle +/docs/.rubydeps +/docs/ruby2/.bundle +/docs/ruby2/.rubydeps +/docs/.jekyll-metadata +*.ipr +*.iws +tools/flink +tools/flink-* +tools/releasing/release +tools/japicmp-output diff --git a/pom.xml b/pom.xml new file mode 100644 index 000..18f7566 --- /dev/null +++ b/pom.xml @@ -0,0 +1,958 @@ + +http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd; + xmlns="http://maven.apache.org/POM/4.0.0; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance;> + +4.0.0 + + +org.apache +apache +20 + +org.apache.flink +flink-connector-parent +1.0 +pom + +https://flink.apache.org +2022 + + +https://github.com/apache/flink-connector-shared-utils + g...@github.com:apache/flink-connector-shared-utils.git + https://github.com/apache/flink-connector-shared-utils.git + + + + +The Apache Software License, Version 2.0 +https://www.apache.org/licenses/LICENSE-2.0.txt +repo + + + + + + +apache.snapshots.https +${distMgmtSnapshotsName} +${distMgmtSnapshotsUrl} + + + + +UTF-8 + UTF-8 + +1.8 +${target.java.version} +${target.java.version} + +**/*Test.* +2048m +1024m + +2 +4 +-XX:+UseG1GC -Xms256m + +validate +tools/japicmp-output + + + + + + + + + + +org.apache.maven.plugins +maven-eclipse-plugin +2.8 + + + +org.eclipse.jdt.launching.JRE_CONTAINER + + +true +true + + + + + + + + +org.apache.maven.plugins +maven-checkstyle-plugin +3.1.2 + + +com.puppycrawl.tools +checkstyle + +8.14 + + + + +validate +validate + +check + + + + + /tools/maven/suppressions.xml + true + /tools/maven/checkstyle.xml +true +true + + + + +com.diffplug.spotless +spotless-maven-plugin +2.27.1 + + + +1.7 +AOSP + + + + + org.apache.flink,org.apache.flink.shaded,,javax,java,scala,\# + + + + + + + +spotless-check +validate + +check + + + + + + +org.apache.maven.plugins +maven-enforcer-plugin +
[flink] branch release-1.16 updated: [FLINK-30383][datadog] Add "flink." prefix to logical identifier
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch release-1.16 in repository https://gitbox.apache.org/repos/asf/flink.git The following commit(s) were added to refs/heads/release-1.16 by this push: new 0293c3b998a [FLINK-30383][datadog] Add "flink." prefix to logical identifier 0293c3b998a is described below commit 0293c3b998a75cc6a3ac1c8fa13d6d69b7f0d306 Author: Chesnay Schepler AuthorDate: Wed Dec 14 17:30:39 2022 +0100 [FLINK-30383][datadog] Add "flink." prefix to logical identifier --- .../java/org/apache/flink/metrics/datadog/DatadogHttpReporter.java | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/flink-metrics/flink-metrics-datadog/src/main/java/org/apache/flink/metrics/datadog/DatadogHttpReporter.java b/flink-metrics/flink-metrics-datadog/src/main/java/org/apache/flink/metrics/datadog/DatadogHttpReporter.java index 5778728db2e..8b458730f3c 100644 --- a/flink-metrics/flink-metrics-datadog/src/main/java/org/apache/flink/metrics/datadog/DatadogHttpReporter.java +++ b/flink-metrics/flink-metrics-datadog/src/main/java/org/apache/flink/metrics/datadog/DatadogHttpReporter.java @@ -88,7 +88,8 @@ public class DatadogHttpReporter implements MetricReporter, Scheduled { public void notifyOfAddedMetric(Metric metric, String metricName, MetricGroup group) { final String name = this.useLogicalIdentifier -? ((LogicalScopeProvider) group) +? "flink." ++ ((LogicalScopeProvider) group) .getLogicalScope(CharacterFilter.NO_OP_FILTER) + "." + metricName
[flink] branch master updated: [FLINK-30383][datadog] Add "flink." prefix to logical identifier
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/flink.git The following commit(s) were added to refs/heads/master by this push: new 97509a13bf2 [FLINK-30383][datadog] Add "flink." prefix to logical identifier 97509a13bf2 is described below commit 97509a13bf2aee219873c22e47ce67decfb09c5a Author: Chesnay Schepler AuthorDate: Wed Dec 14 17:30:39 2022 +0100 [FLINK-30383][datadog] Add "flink." prefix to logical identifier --- .../java/org/apache/flink/metrics/datadog/DatadogHttpReporter.java | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/flink-metrics/flink-metrics-datadog/src/main/java/org/apache/flink/metrics/datadog/DatadogHttpReporter.java b/flink-metrics/flink-metrics-datadog/src/main/java/org/apache/flink/metrics/datadog/DatadogHttpReporter.java index 5778728db2e..8b458730f3c 100644 --- a/flink-metrics/flink-metrics-datadog/src/main/java/org/apache/flink/metrics/datadog/DatadogHttpReporter.java +++ b/flink-metrics/flink-metrics-datadog/src/main/java/org/apache/flink/metrics/datadog/DatadogHttpReporter.java @@ -88,7 +88,8 @@ public class DatadogHttpReporter implements MetricReporter, Scheduled { public void notifyOfAddedMetric(Metric metric, String metricName, MetricGroup group) { final String name = this.useLogicalIdentifier -? ((LogicalScopeProvider) group) +? "flink." ++ ((LogicalScopeProvider) group) .getLogicalScope(CharacterFilter.NO_OP_FILTER) + "." + metricName
[flink-connector-pulsar] branch main updated: [hotfix] Amend NOTICE
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-pulsar.git The following commit(s) were added to refs/heads/main by this push: new f547f7b [hotfix] Amend NOTICE f547f7b is described below commit f547f7b534953f6f47697bb427847bcea8153b9b Author: Chesnay Schepler AuthorDate: Tue Dec 13 12:26:23 2022 +0100 [hotfix] Amend NOTICE --- NOTICE | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/NOTICE b/NOTICE index 8136947..1767509 100644 --- a/NOTICE +++ b/NOTICE @@ -1,4 +1,4 @@ -Apache Flink +Apache Flink Pulsar Connector Copyright 2014-2022 The Apache Software Foundation This product includes software developed at @@ -11,4 +11,4 @@ THE SOFTWARE IS PROVIDED "AS IS" AND THE AUTHOR DISCLAIMS ALL WARRANTIES WITH RE ALL IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS. IN NO EVENT SHALL THE AUTHOR BE LIABLE FOR ANY SPECIAL, DIRECT, INDIRECT, OR CONSEQUENTIAL DAMAGES OR ANY DAMAGES WHATSOEVER RESULTING FROM LOSS OF USE, DATA OR PROFITS, WHETHER IN AN ACTION OF CONTRACT, NEGLIGENCE OR OTHER TORTIOUS ACTION, ARISING OUT OF OR IN CONNECTION WITH THE -USE OR PERFORMANCE OF THIS SOFTWARE. \ No newline at end of file +USE OR PERFORMANCE OF THIS SOFTWARE.
[flink-connector-hbase] branch main updated: [hotfix] Add licensing
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-hbase.git The following commit(s) were added to refs/heads/main by this push: new d3f878a [hotfix] Add licensing d3f878a is described below commit d3f878ad4cd9ca1d9fed7632c785d07d96c7456e Author: Chesnay Schepler AuthorDate: Tue Dec 13 12:25:44 2022 +0100 [hotfix] Add licensing --- LICENSE | 201 NOTICE | 17 ++ 2 files changed, 218 insertions(+) diff --git a/LICENSE b/LICENSE new file mode 100644 index 000..261eeb9 --- /dev/null +++ b/LICENSE @@ -0,0 +1,201 @@ + Apache License + Version 2.0, January 2004 +http://www.apache.org/licenses/ + + TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION + + 1. Definitions. + + "License" shall mean the terms and conditions for use, reproduction, + and distribution as defined by Sections 1 through 9 of this document. + + "Licensor" shall mean the copyright owner or entity authorized by + the copyright owner that is granting the License. + + "Legal Entity" shall mean the union of the acting entity and all + other entities that control, are controlled by, or are under common + control with that entity. For the purposes of this definition, + "control" means (i) the power, direct or indirect, to cause the + direction or management of such entity, whether by contract or + otherwise, or (ii) ownership of fifty percent (50%) or more of the + outstanding shares, or (iii) beneficial ownership of such entity. + + "You" (or "Your") shall mean an individual or Legal Entity + exercising permissions granted by this License. + + "Source" form shall mean the preferred form for making modifications, + including but not limited to software source code, documentation + source, and configuration files. + + "Object" form shall mean any form resulting from mechanical + transformation or translation of a Source form, including but + not limited to compiled object code, generated documentation, + and conversions to other media types. + + "Work" shall mean the work of authorship, whether in Source or + Object form, made available under the License, as indicated by a + copyright notice that is included in or attached to the work + (an example is provided in the Appendix below). + + "Derivative Works" shall mean any work, whether in Source or Object + form, that is based on (or derived from) the Work and for which the + editorial revisions, annotations, elaborations, or other modifications + represent, as a whole, an original work of authorship. For the purposes + of this License, Derivative Works shall not include works that remain + separable from, or merely link (or bind by name) to the interfaces of, + the Work and Derivative Works thereof. + + "Contribution" shall mean any work of authorship, including + the original version of the Work and any modifications or additions + to that Work or Derivative Works thereof, that is intentionally + submitted to Licensor for inclusion in the Work by the copyright owner + or by an individual or Legal Entity authorized to submit on behalf of + the copyright owner. For the purposes of this definition, "submitted" + means any form of electronic, verbal, or written communication sent + to the Licensor or its representatives, including but not limited to + communication on electronic mailing lists, source code control systems, + and issue tracking systems that are managed by, or on behalf of, the + Licensor for the purpose of discussing and improving the Work, but + excluding communication that is conspicuously marked or otherwise + designated in writing by the copyright owner as "Not a Contribution." + + "Contributor" shall mean Licensor and any individual or Legal Entity + on behalf of whom a Contribution has been received by Licensor and + subsequently incorporated within the Work. + + 2. Grant of Copyright License. Subject to the terms and conditions of + this License, each Contributor hereby grants to You a perpetual, + worldwide, non-exclusive, no-charge, royalty-free, irrevocable + copyright license to reproduce, prepare Derivative Works of, + publicly display, publicly perform, sublicense, and distribute the + Work and such Derivative Works in Source or Object form. + + 3. Grant of Patent License. Subject to the terms and conditions of + this License, each Contributor hereby grants to You
[flink-connector-pulsar] branch main updated: [hotfix] Fix workflow reference
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-pulsar.git The following commit(s) were added to refs/heads/main by this push: new 11a0274 [hotfix] Fix workflow reference 11a0274 is described below commit 11a0274274c379faeb48c1c1a3158356b64e0d4e Author: Chesnay Schepler AuthorDate: Tue Dec 13 12:13:24 2022 +0100 [hotfix] Fix workflow reference --- .github/workflows/push_pr.yml | 2 +- .github/workflows/weekly.yml | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/.github/workflows/push_pr.yml b/.github/workflows/push_pr.yml index 27527cb..ba36a50 100644 --- a/.github/workflows/push_pr.yml +++ b/.github/workflows/push_pr.yml @@ -23,7 +23,7 @@ concurrency: cancel-in-progress: true jobs: compile_and_test: -uses: ./.github/workflows/ci.yml +uses: apache/flink-connector-shared-utils/.github/workflows/ci.yml with: flink_version: 1.17-SNAPSHOT flink_url: https://s3.amazonaws.com/flink-nightly/flink-1.17-SNAPSHOT-bin-scala_2.12.tgz diff --git a/.github/workflows/weekly.yml b/.github/workflows/weekly.yml index 707aa71..ec2828b 100644 --- a/.github/workflows/weekly.yml +++ b/.github/workflows/weekly.yml @@ -26,7 +26,7 @@ jobs: strategy: matrix: flink: [1.17-SNAPSHOT] -uses: ./.github/workflows/ci.yml +uses: apache/flink-connector-shared-utils/.github/workflows/ci.yml with: flink_version: ${{ matrix.flink }} flink_url: https://s3.amazonaws.com/flink-nightly/flink-${{ matrix.flink }}-bin-scala_2.12.tgz
[flink-connector-jdbc] branch main updated: [hotfix] Add licensing
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-jdbc.git The following commit(s) were added to refs/heads/main by this push: new 5eabc8d [hotfix] Add licensing 5eabc8d is described below commit 5eabc8d9ef9ad79f897fc5018cb0d40d6ddda3f2 Author: Chesnay Schepler AuthorDate: Tue Dec 13 12:10:55 2022 +0100 [hotfix] Add licensing --- LICENSE | 201 NOTICE | 17 ++ 2 files changed, 218 insertions(+) diff --git a/LICENSE b/LICENSE new file mode 100644 index 000..261eeb9 --- /dev/null +++ b/LICENSE @@ -0,0 +1,201 @@ + Apache License + Version 2.0, January 2004 +http://www.apache.org/licenses/ + + TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION + + 1. Definitions. + + "License" shall mean the terms and conditions for use, reproduction, + and distribution as defined by Sections 1 through 9 of this document. + + "Licensor" shall mean the copyright owner or entity authorized by + the copyright owner that is granting the License. + + "Legal Entity" shall mean the union of the acting entity and all + other entities that control, are controlled by, or are under common + control with that entity. For the purposes of this definition, + "control" means (i) the power, direct or indirect, to cause the + direction or management of such entity, whether by contract or + otherwise, or (ii) ownership of fifty percent (50%) or more of the + outstanding shares, or (iii) beneficial ownership of such entity. + + "You" (or "Your") shall mean an individual or Legal Entity + exercising permissions granted by this License. + + "Source" form shall mean the preferred form for making modifications, + including but not limited to software source code, documentation + source, and configuration files. + + "Object" form shall mean any form resulting from mechanical + transformation or translation of a Source form, including but + not limited to compiled object code, generated documentation, + and conversions to other media types. + + "Work" shall mean the work of authorship, whether in Source or + Object form, made available under the License, as indicated by a + copyright notice that is included in or attached to the work + (an example is provided in the Appendix below). + + "Derivative Works" shall mean any work, whether in Source or Object + form, that is based on (or derived from) the Work and for which the + editorial revisions, annotations, elaborations, or other modifications + represent, as a whole, an original work of authorship. For the purposes + of this License, Derivative Works shall not include works that remain + separable from, or merely link (or bind by name) to the interfaces of, + the Work and Derivative Works thereof. + + "Contribution" shall mean any work of authorship, including + the original version of the Work and any modifications or additions + to that Work or Derivative Works thereof, that is intentionally + submitted to Licensor for inclusion in the Work by the copyright owner + or by an individual or Legal Entity authorized to submit on behalf of + the copyright owner. For the purposes of this definition, "submitted" + means any form of electronic, verbal, or written communication sent + to the Licensor or its representatives, including but not limited to + communication on electronic mailing lists, source code control systems, + and issue tracking systems that are managed by, or on behalf of, the + Licensor for the purpose of discussing and improving the Work, but + excluding communication that is conspicuously marked or otherwise + designated in writing by the copyright owner as "Not a Contribution." + + "Contributor" shall mean Licensor and any individual or Legal Entity + on behalf of whom a Contribution has been received by Licensor and + subsequently incorporated within the Work. + + 2. Grant of Copyright License. Subject to the terms and conditions of + this License, each Contributor hereby grants to You a perpetual, + worldwide, non-exclusive, no-charge, royalty-free, irrevocable + copyright license to reproduce, prepare Derivative Works of, + publicly display, publicly perform, sublicense, and distribute the + Work and such Derivative Works in Source or Object form. + + 3. Grant of Patent License. Subject to the terms and conditions of + this License, each Contributor hereby grants to You
[flink-connector-kafka] branch main updated: [hotfix] Add licensing
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-kafka.git The following commit(s) were added to refs/heads/main by this push: new 685bea1 [hotfix] Add licensing 685bea1 is described below commit 685bea1490005c00499e2d6a0742170c22c9 Author: Chesnay Schepler AuthorDate: Tue Dec 13 12:10:06 2022 +0100 [hotfix] Add licensing --- LICENSE | 201 NOTICE | 17 ++ 2 files changed, 218 insertions(+) diff --git a/LICENSE b/LICENSE new file mode 100644 index 000..261eeb9 --- /dev/null +++ b/LICENSE @@ -0,0 +1,201 @@ + Apache License + Version 2.0, January 2004 +http://www.apache.org/licenses/ + + TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION + + 1. Definitions. + + "License" shall mean the terms and conditions for use, reproduction, + and distribution as defined by Sections 1 through 9 of this document. + + "Licensor" shall mean the copyright owner or entity authorized by + the copyright owner that is granting the License. + + "Legal Entity" shall mean the union of the acting entity and all + other entities that control, are controlled by, or are under common + control with that entity. For the purposes of this definition, + "control" means (i) the power, direct or indirect, to cause the + direction or management of such entity, whether by contract or + otherwise, or (ii) ownership of fifty percent (50%) or more of the + outstanding shares, or (iii) beneficial ownership of such entity. + + "You" (or "Your") shall mean an individual or Legal Entity + exercising permissions granted by this License. + + "Source" form shall mean the preferred form for making modifications, + including but not limited to software source code, documentation + source, and configuration files. + + "Object" form shall mean any form resulting from mechanical + transformation or translation of a Source form, including but + not limited to compiled object code, generated documentation, + and conversions to other media types. + + "Work" shall mean the work of authorship, whether in Source or + Object form, made available under the License, as indicated by a + copyright notice that is included in or attached to the work + (an example is provided in the Appendix below). + + "Derivative Works" shall mean any work, whether in Source or Object + form, that is based on (or derived from) the Work and for which the + editorial revisions, annotations, elaborations, or other modifications + represent, as a whole, an original work of authorship. For the purposes + of this License, Derivative Works shall not include works that remain + separable from, or merely link (or bind by name) to the interfaces of, + the Work and Derivative Works thereof. + + "Contribution" shall mean any work of authorship, including + the original version of the Work and any modifications or additions + to that Work or Derivative Works thereof, that is intentionally + submitted to Licensor for inclusion in the Work by the copyright owner + or by an individual or Legal Entity authorized to submit on behalf of + the copyright owner. For the purposes of this definition, "submitted" + means any form of electronic, verbal, or written communication sent + to the Licensor or its representatives, including but not limited to + communication on electronic mailing lists, source code control systems, + and issue tracking systems that are managed by, or on behalf of, the + Licensor for the purpose of discussing and improving the Work, but + excluding communication that is conspicuously marked or otherwise + designated in writing by the copyright owner as "Not a Contribution." + + "Contributor" shall mean Licensor and any individual or Legal Entity + on behalf of whom a Contribution has been received by Licensor and + subsequently incorporated within the Work. + + 2. Grant of Copyright License. Subject to the terms and conditions of + this License, each Contributor hereby grants to You a perpetual, + worldwide, non-exclusive, no-charge, royalty-free, irrevocable + copyright license to reproduce, prepare Derivative Works of, + publicly display, publicly perform, sublicense, and distribute the + Work and such Derivative Works in Source or Object form. + + 3. Grant of Patent License. Subject to the terms and conditions of + this License, each Contributor hereby grants to You
[flink-connector-hive] branch main updated: [hotfix] Add licensing
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-hive.git The following commit(s) were added to refs/heads/main by this push: new 197efdd [hotfix] Add licensing 197efdd is described below commit 197efddd95a385d84ed408ff0d5017e48a49c3ec Author: Chesnay Schepler AuthorDate: Tue Dec 13 12:09:41 2022 +0100 [hotfix] Add licensing --- LICENSE | 201 NOTICE | 17 ++ 2 files changed, 218 insertions(+) diff --git a/LICENSE b/LICENSE new file mode 100644 index 000..261eeb9 --- /dev/null +++ b/LICENSE @@ -0,0 +1,201 @@ + Apache License + Version 2.0, January 2004 +http://www.apache.org/licenses/ + + TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION + + 1. Definitions. + + "License" shall mean the terms and conditions for use, reproduction, + and distribution as defined by Sections 1 through 9 of this document. + + "Licensor" shall mean the copyright owner or entity authorized by + the copyright owner that is granting the License. + + "Legal Entity" shall mean the union of the acting entity and all + other entities that control, are controlled by, or are under common + control with that entity. For the purposes of this definition, + "control" means (i) the power, direct or indirect, to cause the + direction or management of such entity, whether by contract or + otherwise, or (ii) ownership of fifty percent (50%) or more of the + outstanding shares, or (iii) beneficial ownership of such entity. + + "You" (or "Your") shall mean an individual or Legal Entity + exercising permissions granted by this License. + + "Source" form shall mean the preferred form for making modifications, + including but not limited to software source code, documentation + source, and configuration files. + + "Object" form shall mean any form resulting from mechanical + transformation or translation of a Source form, including but + not limited to compiled object code, generated documentation, + and conversions to other media types. + + "Work" shall mean the work of authorship, whether in Source or + Object form, made available under the License, as indicated by a + copyright notice that is included in or attached to the work + (an example is provided in the Appendix below). + + "Derivative Works" shall mean any work, whether in Source or Object + form, that is based on (or derived from) the Work and for which the + editorial revisions, annotations, elaborations, or other modifications + represent, as a whole, an original work of authorship. For the purposes + of this License, Derivative Works shall not include works that remain + separable from, or merely link (or bind by name) to the interfaces of, + the Work and Derivative Works thereof. + + "Contribution" shall mean any work of authorship, including + the original version of the Work and any modifications or additions + to that Work or Derivative Works thereof, that is intentionally + submitted to Licensor for inclusion in the Work by the copyright owner + or by an individual or Legal Entity authorized to submit on behalf of + the copyright owner. For the purposes of this definition, "submitted" + means any form of electronic, verbal, or written communication sent + to the Licensor or its representatives, including but not limited to + communication on electronic mailing lists, source code control systems, + and issue tracking systems that are managed by, or on behalf of, the + Licensor for the purpose of discussing and improving the Work, but + excluding communication that is conspicuously marked or otherwise + designated in writing by the copyright owner as "Not a Contribution." + + "Contributor" shall mean Licensor and any individual or Legal Entity + on behalf of whom a Contribution has been received by Licensor and + subsequently incorporated within the Work. + + 2. Grant of Copyright License. Subject to the terms and conditions of + this License, each Contributor hereby grants to You a perpetual, + worldwide, non-exclusive, no-charge, royalty-free, irrevocable + copyright license to reproduce, prepare Derivative Works of, + publicly display, publicly perform, sublicense, and distribute the + Work and such Derivative Works in Source or Object form. + + 3. Grant of Patent License. Subject to the terms and conditions of + this License, each Contributor hereby grants to You
[flink-connector-gcp-pubsub] branch main updated: [hotfix] Add licensing
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-gcp-pubsub.git The following commit(s) were added to refs/heads/main by this push: new fabf8fa [hotfix] Add licensing fabf8fa is described below commit fabf8faaa75b701b72828f2255fcea7a287f4d5e Author: Chesnay Schepler AuthorDate: Tue Dec 13 12:07:53 2022 +0100 [hotfix] Add licensing --- LICENSE | 201 NOTICE | 17 ++ 2 files changed, 218 insertions(+) diff --git a/LICENSE b/LICENSE new file mode 100644 index 000..261eeb9 --- /dev/null +++ b/LICENSE @@ -0,0 +1,201 @@ + Apache License + Version 2.0, January 2004 +http://www.apache.org/licenses/ + + TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION + + 1. Definitions. + + "License" shall mean the terms and conditions for use, reproduction, + and distribution as defined by Sections 1 through 9 of this document. + + "Licensor" shall mean the copyright owner or entity authorized by + the copyright owner that is granting the License. + + "Legal Entity" shall mean the union of the acting entity and all + other entities that control, are controlled by, or are under common + control with that entity. For the purposes of this definition, + "control" means (i) the power, direct or indirect, to cause the + direction or management of such entity, whether by contract or + otherwise, or (ii) ownership of fifty percent (50%) or more of the + outstanding shares, or (iii) beneficial ownership of such entity. + + "You" (or "Your") shall mean an individual or Legal Entity + exercising permissions granted by this License. + + "Source" form shall mean the preferred form for making modifications, + including but not limited to software source code, documentation + source, and configuration files. + + "Object" form shall mean any form resulting from mechanical + transformation or translation of a Source form, including but + not limited to compiled object code, generated documentation, + and conversions to other media types. + + "Work" shall mean the work of authorship, whether in Source or + Object form, made available under the License, as indicated by a + copyright notice that is included in or attached to the work + (an example is provided in the Appendix below). + + "Derivative Works" shall mean any work, whether in Source or Object + form, that is based on (or derived from) the Work and for which the + editorial revisions, annotations, elaborations, or other modifications + represent, as a whole, an original work of authorship. For the purposes + of this License, Derivative Works shall not include works that remain + separable from, or merely link (or bind by name) to the interfaces of, + the Work and Derivative Works thereof. + + "Contribution" shall mean any work of authorship, including + the original version of the Work and any modifications or additions + to that Work or Derivative Works thereof, that is intentionally + submitted to Licensor for inclusion in the Work by the copyright owner + or by an individual or Legal Entity authorized to submit on behalf of + the copyright owner. For the purposes of this definition, "submitted" + means any form of electronic, verbal, or written communication sent + to the Licensor or its representatives, including but not limited to + communication on electronic mailing lists, source code control systems, + and issue tracking systems that are managed by, or on behalf of, the + Licensor for the purpose of discussing and improving the Work, but + excluding communication that is conspicuously marked or otherwise + designated in writing by the copyright owner as "Not a Contribution." + + "Contributor" shall mean Licensor and any individual or Legal Entity + on behalf of whom a Contribution has been received by Licensor and + subsequently incorporated within the Work. + + 2. Grant of Copyright License. Subject to the terms and conditions of + this License, each Contributor hereby grants to You a perpetual, + worldwide, non-exclusive, no-charge, royalty-free, irrevocable + copyright license to reproduce, prepare Derivative Works of, + publicly display, publicly perform, sublicense, and distribute the + Work and such Derivative Works in Source or Object form. + + 3. Grant of Patent License. Subject to the terms and conditions of + this License, each Contributor hereby grants to You
[flink] branch release-1.15 updated: [hotfix][build] Add dependency-reduced-poms to .gitignore
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch release-1.15 in repository https://gitbox.apache.org/repos/asf/flink.git The following commit(s) were added to refs/heads/release-1.15 by this push: new 075273c796d [hotfix][build] Add dependency-reduced-poms to .gitignore 075273c796d is described below commit 075273c796dea560aa714355ed8f88c4b3bebb52 Author: Chesnay Schepler AuthorDate: Tue Dec 13 12:02:53 2022 +0100 [hotfix][build] Add dependency-reduced-poms to .gitignore Preparation for FLINK-30350 to minimize impact on active branches. --- .gitignore | 1 + 1 file changed, 1 insertion(+) diff --git a/.gitignore b/.gitignore index 49b638d213f..76f67b3ae4c 100644 --- a/.gitignore +++ b/.gitignore @@ -22,6 +22,7 @@ tmp *.pyc .DS_Store build-target +**/dependency-reduced-pom.xml flink-runtime-web/web-dashboard/node/ flink-runtime-web/web-dashboard/node_modules/ flink-runtime-web/web-dashboard/web/
[flink] branch release-1.16 updated: [hotfix][build] Add dependency-reduced-poms to .gitignore
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch release-1.16 in repository https://gitbox.apache.org/repos/asf/flink.git The following commit(s) were added to refs/heads/release-1.16 by this push: new 89ca74bd9f6 [hotfix][build] Add dependency-reduced-poms to .gitignore 89ca74bd9f6 is described below commit 89ca74bd9f680d66018c7615c1b4039588be229b Author: Chesnay Schepler AuthorDate: Tue Dec 13 12:02:53 2022 +0100 [hotfix][build] Add dependency-reduced-poms to .gitignore Preparation for FLINK-30350 to minimize impact on active branches. --- .gitignore | 1 + 1 file changed, 1 insertion(+) diff --git a/.gitignore b/.gitignore index 877890a72f5..53ed499f8e3 100644 --- a/.gitignore +++ b/.gitignore @@ -22,6 +22,7 @@ tmp *.pyc .DS_Store build-target +**/dependency-reduced-pom.xml flink-runtime-web/web-dashboard/node/ flink-runtime-web/web-dashboard/node_modules/ flink-runtime-web/web-dashboard/web/
[flink] branch master updated (b6c5534efc8 -> 249eb522b09)
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git from b6c5534efc8 [FLINK-29998] Make the backpressure tab could be sort by the busy percent add 249eb522b09 [hotfix][build] Add dependency-reduced-poms to .gitignore No new revisions were added by this update. Summary of changes: .gitignore | 1 + 1 file changed, 1 insertion(+)
[flink-connector-gcp-pubsub] branch main updated: [hotfix] Sync CI setup & reuse workflow
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-gcp-pubsub.git The following commit(s) were added to refs/heads/main by this push: new 1c361ca [hotfix] Sync CI setup & reuse workflow 1c361ca is described below commit 1c361ca066614d02d877181326c1f1c0137e562e Author: Chesnay Schepler AuthorDate: Tue Dec 13 11:36:59 2022 +0100 [hotfix] Sync CI setup & reuse workflow --- .github/workflows/ci.yml | 101 -- .github/workflows/push_pr.yml | 9 ++-- .github/workflows/weekly.yml | 7 +-- 3 files changed, 10 insertions(+), 107 deletions(-) diff --git a/.github/workflows/ci.yml b/.github/workflows/ci.yml deleted file mode 100644 index d74ff7b..000 --- a/.github/workflows/ci.yml +++ /dev/null @@ -1,101 +0,0 @@ - -# Licensed to the Apache Software Foundation (ASF) under one -# or more contributor license agreements. See the NOTICE file -# distributed with this work for additional information -# regarding copyright ownership. The ASF licenses this file -# to you under the Apache License, Version 2.0 (the -# "License"); you may not use this file except in compliance -# with the License. You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. - - -on: - workflow_call: -inputs: - flink_url: -description: "Url to Flink binary." -required: true -type: string - flink_version: -description: "Flink version to test against." -required: true -type: string - cache_flink_binary: -description: "Whether to cache the Flink binary. Should be false for SNAPSHOT URLs, true otherwise." -required: true -type: boolean - -jobs: - compile_and_test: -runs-on: ubuntu-latest -strategy: - matrix: -jdk: [8, 11] -timeout-minutes: 40 -env: - MVN_COMMON_OPTIONS: -U -B --no-transfer-progress -Dflink.version=${{ inputs.flink_version }} - MVN_CONNECTION_OPTIONS: -Dhttp.keepAlive=false -Dmaven.wagon.http.pool=false -Dmaven.wagon.httpconnectionManager.ttlSeconds=120 - FLINK_CACHE_DIR: "/tmp/cache/flink" - MVN_BUILD_OUTPUT_FILE: "/tmp/mvn_build_output.out" - MVN_VALIDATION_DIR: "/tmp/flink-validation-deployment" -steps: - - run: echo "Running CI pipeline for JDK version ${{ matrix.jdk }}" - - - name: Check out repository code -uses: actions/checkout@v2 - - - name: Set JDK -uses: actions/setup-java@v2 -with: - java-version: ${{ matrix.jdk }} - distribution: 'temurin' - cache: 'maven' - - - name: Set Maven 3.8.6 -uses: stCarolas/setup-maven@v4.2 -with: - maven-version: 3.8.6 - - - name: Create cache dirs -run: mkdir -p ${{ env.FLINK_CACHE_DIR }} - - - name: Cache Flink binary -if: ${{ inputs.cache_flink_binary == 'true' }} -uses: actions/cache@v3 -id: cache-flink -with: - path: ${{ env.FLINK_CACHE_DIR }} - key: ${{ inputs.flink_url }} - - - name: Download Flink binary -working-directory: ${{ env.FLINK_CACHE_DIR }} -if: steps.cache-flink.outputs.cache-hit != 'true' -run: wget -q -c ${{ inputs.flink_url }} -O - | tar -xz - - - name: Compile and test flink-connector-gcp-pubsub -timeout-minutes: 30 -run: | - set -o pipefail - - mvn clean deploy ${MVN_COMMON_OPTIONS} \ --DaltDeploymentRepository=validation_repository::default::file:${{ env.MVN_VALIDATION_DIR }} \ --Dscala-2.12 \ --Prun-end-to-end-tests -DdistDir=${{ env.FLINK_CACHE_DIR }}/flink-${{ inputs.flink_version }} \ --Dflink.convergence.phase=install -Pcheck-convergence \ -${{ env.MVN_CONNECTION_OPTIONS }} \ --Dlog4j.configurationFile=file://$(pwd)/tools/ci/log4j.properties \ -| tee ${{ env.MVN_BUILD_OUTPUT_FILE }} - - - name: Check licensing -run: | - mvn ${MVN_COMMON_OPTIONS} exec:java@check-license -N \ --Dexec.args="${{ env.MVN_BUILD_OUTPUT_FILE }} $(pwd) ${{ env.MVN_VALIDATION_DIR }}" \ -${{ env.MVN_CONNECTION_OPTIONS }} \ --Dlog4j.configurationFile=file
[flink-connector-redis-streams] branch main updated: [hotfix] Sync CI setup
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-redis-streams.git The following commit(s) were added to refs/heads/main by this push: new 6dd6c07 [hotfix] Sync CI setup 6dd6c07 is described below commit 6dd6c07a3b8f3a368d75ad7dae77afee5ceff56a Author: Chesnay Schepler AuthorDate: Tue Dec 13 11:35:23 2022 +0100 [hotfix] Sync CI setup --- .github/workflows/{ci.yaml => push_pr.yml} | 36 - .github/workflows/{ci.yaml => weekly.yml} | 37 +- 2 files changed, 20 insertions(+), 53 deletions(-) diff --git a/.github/workflows/ci.yaml b/.github/workflows/push_pr.yml similarity index 52% copy from .github/workflows/ci.yaml copy to .github/workflows/push_pr.yml index 6b01163..e5d6b2a 100644 --- a/.github/workflows/ci.yaml +++ b/.github/workflows/push_pr.yml @@ -16,33 +16,15 @@ # limitations under the License. -name: Build flink-connector-redis +name: CI on: [push, pull_request] +concurrency: + group: ${{ github.workflow }}-${{ github.ref }} + cancel-in-progress: true jobs: compile_and_test: -runs-on: ubuntu-latest -strategy: - matrix: -jdk: [8, 11] -env: - MVN_CONNECTION_OPTIONS: -Dhttp.keepAlive=false -Dmaven.wagon.http.pool=false -Dmaven.wagon.httpconnectionManager.ttlSeconds=120 -steps: - - run: echo "Running CI pipeline for JDK version ${{ matrix.jdk }}" - - - name: Check out repository code -uses: actions/checkout@v2 - - - name: Set JDK -uses: actions/setup-java@v2 -with: - java-version: ${{ matrix.jdk }} - distribution: 'temurin' - cache: 'maven' - - - name: Set Maven 3.8.5 -uses: stCarolas/setup-maven@v4.2 -with: - maven-version: 3.8.5 - - - name: Compile and test flink-connector-redis -run: mvn clean install -Dscala-2.12 -Dflink.convergence.phase=install -Pcheck-convergence -U -B ${{ env.MVN_CONNECTION_OPTIONS }} +uses: apache/flink-connector-shared-utils/.github/workflows/ci.yml@ci_utils +with: + flink_version: 1.16.0 + flink_url: https://dist.apache.org/repos/dist/release/flink/flink-1.16.0/flink-1.16.0-bin-scala_2.12.tgz + cache_flink_binary: true diff --git a/.github/workflows/ci.yaml b/.github/workflows/weekly.yml similarity index 53% rename from .github/workflows/ci.yaml rename to .github/workflows/weekly.yml index 6b01163..619183f 100644 --- a/.github/workflows/ci.yaml +++ b/.github/workflows/weekly.yml @@ -16,33 +16,18 @@ # limitations under the License. -name: Build flink-connector-redis -on: [push, pull_request] +name: Nightly +on: + schedule: +- cron: "0 0 * * 0" jobs: compile_and_test: -runs-on: ubuntu-latest +if: github.repository_owner == 'apache' strategy: matrix: -jdk: [8, 11] -env: - MVN_CONNECTION_OPTIONS: -Dhttp.keepAlive=false -Dmaven.wagon.http.pool=false -Dmaven.wagon.httpconnectionManager.ttlSeconds=120 -steps: - - run: echo "Running CI pipeline for JDK version ${{ matrix.jdk }}" - - - name: Check out repository code -uses: actions/checkout@v2 - - - name: Set JDK -uses: actions/setup-java@v2 -with: - java-version: ${{ matrix.jdk }} - distribution: 'temurin' - cache: 'maven' - - - name: Set Maven 3.8.5 -uses: stCarolas/setup-maven@v4.2 -with: - maven-version: 3.8.5 - - - name: Compile and test flink-connector-redis -run: mvn clean install -Dscala-2.12 -Dflink.convergence.phase=install -Pcheck-convergence -U -B ${{ env.MVN_CONNECTION_OPTIONS }} +flink: [1.16-SNAPSHOT, 1.17-SNAPSHOT] +uses: apache/flink-connector-shared-utils/.github/workflows/ci.yml@ci_utils +with: + flink_version: ${{ matrix.flink }} + flink_url: https://s3.amazonaws.com/flink-nightly/flink-${{ matrix.flink }}-bin-scala_2.12.tgz + cache_flink_binary: false
[flink-connector-mongodb] branch main updated: [hotfix] Sync CI setup
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-mongodb.git The following commit(s) were added to refs/heads/main by this push: new c4e854d [hotfix] Sync CI setup c4e854d is described below commit c4e854d24104dea54f458c484df0b161857b3d3b Author: Chesnay Schepler AuthorDate: Tue Dec 13 11:34:29 2022 +0100 [hotfix] Sync CI setup --- .github/workflows/ci.yaml | 75 --- .github/workflows/push_pr.yml | 30 + .github/workflows/weekly.yml | 33 +++ 3 files changed, 63 insertions(+), 75 deletions(-) diff --git a/.github/workflows/ci.yaml b/.github/workflows/ci.yaml deleted file mode 100644 index f528404..000 --- a/.github/workflows/ci.yaml +++ /dev/null @@ -1,75 +0,0 @@ - -# Licensed to the Apache Software Foundation (ASF) under one -# or more contributor license agreements. See the NOTICE file -# distributed with this work for additional information -# regarding copyright ownership. The ASF licenses this file -# to you under the Apache License, Version 2.0 (the -# "License"); you may not use this file except in compliance -# with the License. You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. - - -name: Build flink-connector-mongodb -on: [push, pull_request] -jobs: - compile_and_test: -runs-on: ubuntu-latest -strategy: - matrix: -jdk: [8, 11] -timeout-minutes: 40 -env: - MVN_COMMON_OPTIONS: -U -B --no-transfer-progress - MVN_CONNECTION_OPTIONS: -Dhttp.keepAlive=false -Dmaven.wagon.http.pool=false -Dmaven.wagon.httpconnectionManager.ttlSeconds=120 - FLINK_URL: https://s3.amazonaws.com/flink-nightly/flink-1.16-SNAPSHOT-bin-scala_2.12.tgz - MVN_BUILD_OUTPUT_FILE: "/tmp/mvn_build_output.out" - MVN_VALIDATION_DIR: "/tmp/flink-validation-deployment" -steps: - - run: echo "Running CI pipeline for JDK version ${{ matrix.jdk }}" - - - name: Check out repository code -uses: actions/checkout@v2 - - - name: Set JDK -uses: actions/setup-java@v2 -with: - java-version: ${{ matrix.jdk }} - distribution: 'temurin' - cache: 'maven' - - - name: Set Maven 3.8.6 -uses: stCarolas/setup-maven@v4.2 -with: - maven-version: 3.8.6 - - - name: Download Flink binary -working-directory: ./.. -run: wget -q -c ${{ env.FLINK_URL }} -O - | tar -xz - - - name: Compile and test flink-connector-mongodb -timeout-minutes: 30 -run: | - set -o pipefail - - mvn clean deploy ${MVN_COMMON_OPTIONS} \ --DaltDeploymentRepository=validation_repository::default::file:${{ env.MVN_VALIDATION_DIR }} \ --Dscala-2.12 \ --Prun-end-to-end-tests -DdistDir=$(pwd)/../flink-1.16-SNAPSHOT \ --Dflink.convergence.phase=install -Pcheck-convergence \ -${{ env.MVN_CONNECTION_OPTIONS }} \ --Dlog4j.configurationFile=file://$(pwd)/tools/ci/log4j.properties \ -| tee ${{ env.MVN_BUILD_OUTPUT_FILE }} - - - name: Check licensing -run: | - mvn ${MVN_COMMON_OPTIONS} exec:java@check-license -N \ --Dexec.args="${{ env.MVN_BUILD_OUTPUT_FILE }} $(pwd) ${{ env.MVN_VALIDATION_DIR }}" \ -${{ env.MVN_CONNECTION_OPTIONS }} \ --Dlog4j.configurationFile=file://$(pwd)/tools/ci/log4j.properties diff --git a/.github/workflows/push_pr.yml b/.github/workflows/push_pr.yml new file mode 100644 index 000..e5d6b2a --- /dev/null +++ b/.github/workflows/push_pr.yml @@ -0,0 +1,30 @@ + +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, software +# distrib
[flink-connector-hive] branch main updated: [hotfix] Sync CI setup & reuse workflow
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-hive.git The following commit(s) were added to refs/heads/main by this push: new 4e50b3c [hotfix] Sync CI setup & reuse workflow 4e50b3c is described below commit 4e50b3c5fafc5c2298fc4130cfeee9b26693de42 Author: Chesnay Schepler AuthorDate: Tue Dec 13 11:33:21 2022 +0100 [hotfix] Sync CI setup & reuse workflow --- .github/workflows/ci.yml | 101 -- .github/workflows/push_pr.yml | 9 ++-- .github/workflows/weekly.yml | 7 +-- 3 files changed, 10 insertions(+), 107 deletions(-) diff --git a/.github/workflows/ci.yml b/.github/workflows/ci.yml deleted file mode 100644 index f2fa15f..000 --- a/.github/workflows/ci.yml +++ /dev/null @@ -1,101 +0,0 @@ - -# Licensed to the Apache Software Foundation (ASF) under one -# or more contributor license agreements. See the NOTICE file -# distributed with this work for additional information -# regarding copyright ownership. The ASF licenses this file -# to you under the Apache License, Version 2.0 (the -# "License"); you may not use this file except in compliance -# with the License. You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. - - -on: - workflow_call: -inputs: - flink_url: -description: "Url to Flink binary." -required: true -type: string - flink_version: -description: "Flink version to test against." -required: true -type: string - cache_flink_binary: -description: "Whether to cache the Flink binary. Should be false for SNAPSHOT URLs, true otherwise." -required: true -type: boolean - -jobs: - compile_and_test: -runs-on: ubuntu-latest -strategy: - matrix: -jdk: [8, 11] -timeout-minutes: 40 -env: - MVN_COMMON_OPTIONS: -U -B --no-transfer-progress -Dflink.version=${{ inputs.flink_version }} - MVN_CONNECTION_OPTIONS: -Dhttp.keepAlive=false -Dmaven.wagon.http.pool=false -Dmaven.wagon.httpconnectionManager.ttlSeconds=120 - FLINK_CACHE_DIR: "/tmp/cache/flink" - MVN_BUILD_OUTPUT_FILE: "/tmp/mvn_build_output.out" - MVN_VALIDATION_DIR: "/tmp/flink-validation-deployment" -steps: - - run: echo "Running CI pipeline for JDK version ${{ matrix.jdk }}" - - - name: Check out repository code -uses: actions/checkout@v2 - - - name: Set JDK -uses: actions/setup-java@v2 -with: - java-version: ${{ matrix.jdk }} - distribution: 'temurin' - cache: 'maven' - - - name: Set Maven 3.8.6 -uses: stCarolas/setup-maven@v4.2 -with: - maven-version: 3.8.6 - - - name: Create cache dirs -run: mkdir -p ${{ env.FLINK_CACHE_DIR }} - - - name: Cache Flink binary -if: ${{ inputs.cache_flink_binary == 'true' }} -uses: actions/cache@v3 -id: cache-flink -with: - path: ${{ env.FLINK_CACHE_DIR }} - key: ${{ inputs.flink_url }} - - - name: Download Flink binary -working-directory: ${{ env.FLINK_CACHE_DIR }} -if: steps.cache-flink.outputs.cache-hit != 'true' -run: wget -q -c ${{ inputs.flink_url }} -O - | tar -xz - - - name: Compile and test flink-connector-hive -timeout-minutes: 30 -run: | - set -o pipefail - - mvn clean deploy ${MVN_COMMON_OPTIONS} \ --DaltDeploymentRepository=validation_repository::default::file:${{ env.MVN_VALIDATION_DIR }} \ --Dscala-2.12 \ --Prun-end-to-end-tests -DdistDir=${{ env.FLINK_CACHE_DIR }}/flink-${{ inputs.flink_version }} \ --Dflink.convergence.phase=install -Pcheck-convergence \ -${{ env.MVN_CONNECTION_OPTIONS }} \ --Dlog4j.configurationFile=file://$(pwd)/tools/ci/log4j.properties \ -| tee ${{ env.MVN_BUILD_OUTPUT_FILE }} - - - name: Check licensing -run: | - mvn ${MVN_COMMON_OPTIONS} exec:java@check-license -N \ --Dexec.args="${{ env.MVN_BUILD_OUTPUT_FILE }} $(pwd) ${{ env.MVN_VALIDATION_DIR }}" \ -${{ env.MVN_CONNECTION_OPTIONS }} \ --Dlog4j.configurationFile=file://$(pwd
[flink-connector-cassandra] branch main updated: [hotfix] Reuse workflow
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-cassandra.git The following commit(s) were added to refs/heads/main by this push: new ebb0e6e [hotfix] Reuse workflow ebb0e6e is described below commit ebb0e6e41549b7219b3fbad0bb8eb2b98204f6ad Author: Chesnay Schepler AuthorDate: Tue Dec 13 11:29:52 2022 +0100 [hotfix] Reuse workflow --- .github/workflows/ci.yml | 101 -- .github/workflows/push_pr.yml | 2 +- .github/workflows/weekly.yml | 2 +- 3 files changed, 2 insertions(+), 103 deletions(-) diff --git a/.github/workflows/ci.yml b/.github/workflows/ci.yml deleted file mode 100644 index 91b9091..000 --- a/.github/workflows/ci.yml +++ /dev/null @@ -1,101 +0,0 @@ - -# Licensed to the Apache Software Foundation (ASF) under one -# or more contributor license agreements. See the NOTICE file -# distributed with this work for additional information -# regarding copyright ownership. The ASF licenses this file -# to you under the Apache License, Version 2.0 (the -# "License"); you may not use this file except in compliance -# with the License. You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. - - -on: - workflow_call: -inputs: - flink_url: -description: "Url to Flink binary." -required: true -type: string - flink_version: -description: "Flink version to test against." -required: true -type: string - cache_flink_binary: -description: "Whether to cache the Flink binary. Should be false for SNAPSHOT URLs, true otherwise." -required: true -type: boolean - -jobs: - compile_and_test: -runs-on: ubuntu-latest -strategy: - matrix: -jdk: [8, 11] -timeout-minutes: 40 -env: - MVN_COMMON_OPTIONS: -U -B --no-transfer-progress -Dflink.version=${{ inputs.flink_version }} - MVN_CONNECTION_OPTIONS: -Dhttp.keepAlive=false -Dmaven.wagon.http.pool=false -Dmaven.wagon.httpconnectionManager.ttlSeconds=120 - FLINK_CACHE_DIR: "/tmp/cache/flink" - MVN_BUILD_OUTPUT_FILE: "/tmp/mvn_build_output.out" - MVN_VALIDATION_DIR: "/tmp/flink-validation-deployment" -steps: - - run: echo "Running CI pipeline for JDK version ${{ matrix.jdk }}" - - - name: Check out repository code -uses: actions/checkout@v2 - - - name: Set JDK -uses: actions/setup-java@v2 -with: - java-version: ${{ matrix.jdk }} - distribution: 'temurin' - cache: 'maven' - - - name: Set Maven 3.8.6 -uses: stCarolas/setup-maven@v4.2 -with: - maven-version: 3.8.6 - - - name: Create cache dirs -run: mkdir -p ${{ env.FLINK_CACHE_DIR }} - - - name: Cache Flink binary -if: ${{ inputs.cache_flink_binary == 'true' }} -uses: actions/cache@v3 -id: cache-flink -with: - path: ${{ env.FLINK_CACHE_DIR }} - key: ${{ inputs.flink_url }} - - - name: Download Flink binary -working-directory: ${{ env.FLINK_CACHE_DIR }} -if: steps.cache-flink.outputs.cache-hit != 'true' -run: wget -q -c ${{ inputs.flink_url }} -O - | tar -xz - - - name: Compile and test -timeout-minutes: 30 -run: | - set -o pipefail - - mvn clean deploy ${MVN_COMMON_OPTIONS} \ --DaltDeploymentRepository=validation_repository::default::file:${{ env.MVN_VALIDATION_DIR }} \ --Dscala-2.12 \ --Prun-end-to-end-tests -DdistDir=${{ env.FLINK_CACHE_DIR }}/flink-${{ inputs.flink_version }} \ --Dflink.convergence.phase=install -Pcheck-convergence \ -${{ env.MVN_CONNECTION_OPTIONS }} \ --Dlog4j.configurationFile=file://$(pwd)/tools/ci/log4j.properties \ -| tee ${{ env.MVN_BUILD_OUTPUT_FILE }} - - - name: Check licensing -run: | - mvn ${MVN_COMMON_OPTIONS} exec:java@check-license -N \ --Dexec.args="${{ env.MVN_BUILD_OUTPUT_FILE }} $(pwd) ${{ env.MVN_VALIDATION_DIR }}" \ -${{ env.MVN_CONNECTION_OPTIONS }} \ --Dlog4j.configurationFile=file://$(pwd)/tools/ci/log4j.properties diff --git a/.gith
[flink-connector-kafka] branch main updated: [hotfix] Reuse workflow
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-kafka.git The following commit(s) were added to refs/heads/main by this push: new 4e52129 [hotfix] Reuse workflow 4e52129 is described below commit 4e52129beb3ebc6f9a26a4b5245eb378e7d7bfba Author: Chesnay Schepler AuthorDate: Tue Dec 13 11:28:34 2022 +0100 [hotfix] Reuse workflow --- .github/workflows/ci.yml | 101 -- .github/workflows/push_pr.yml | 2 +- .github/workflows/weekly.yml | 2 +- 3 files changed, 2 insertions(+), 103 deletions(-) diff --git a/.github/workflows/ci.yml b/.github/workflows/ci.yml deleted file mode 100644 index 91b9091..000 --- a/.github/workflows/ci.yml +++ /dev/null @@ -1,101 +0,0 @@ - -# Licensed to the Apache Software Foundation (ASF) under one -# or more contributor license agreements. See the NOTICE file -# distributed with this work for additional information -# regarding copyright ownership. The ASF licenses this file -# to you under the Apache License, Version 2.0 (the -# "License"); you may not use this file except in compliance -# with the License. You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. - - -on: - workflow_call: -inputs: - flink_url: -description: "Url to Flink binary." -required: true -type: string - flink_version: -description: "Flink version to test against." -required: true -type: string - cache_flink_binary: -description: "Whether to cache the Flink binary. Should be false for SNAPSHOT URLs, true otherwise." -required: true -type: boolean - -jobs: - compile_and_test: -runs-on: ubuntu-latest -strategy: - matrix: -jdk: [8, 11] -timeout-minutes: 40 -env: - MVN_COMMON_OPTIONS: -U -B --no-transfer-progress -Dflink.version=${{ inputs.flink_version }} - MVN_CONNECTION_OPTIONS: -Dhttp.keepAlive=false -Dmaven.wagon.http.pool=false -Dmaven.wagon.httpconnectionManager.ttlSeconds=120 - FLINK_CACHE_DIR: "/tmp/cache/flink" - MVN_BUILD_OUTPUT_FILE: "/tmp/mvn_build_output.out" - MVN_VALIDATION_DIR: "/tmp/flink-validation-deployment" -steps: - - run: echo "Running CI pipeline for JDK version ${{ matrix.jdk }}" - - - name: Check out repository code -uses: actions/checkout@v2 - - - name: Set JDK -uses: actions/setup-java@v2 -with: - java-version: ${{ matrix.jdk }} - distribution: 'temurin' - cache: 'maven' - - - name: Set Maven 3.8.6 -uses: stCarolas/setup-maven@v4.2 -with: - maven-version: 3.8.6 - - - name: Create cache dirs -run: mkdir -p ${{ env.FLINK_CACHE_DIR }} - - - name: Cache Flink binary -if: ${{ inputs.cache_flink_binary == 'true' }} -uses: actions/cache@v3 -id: cache-flink -with: - path: ${{ env.FLINK_CACHE_DIR }} - key: ${{ inputs.flink_url }} - - - name: Download Flink binary -working-directory: ${{ env.FLINK_CACHE_DIR }} -if: steps.cache-flink.outputs.cache-hit != 'true' -run: wget -q -c ${{ inputs.flink_url }} -O - | tar -xz - - - name: Compile and test -timeout-minutes: 30 -run: | - set -o pipefail - - mvn clean deploy ${MVN_COMMON_OPTIONS} \ --DaltDeploymentRepository=validation_repository::default::file:${{ env.MVN_VALIDATION_DIR }} \ --Dscala-2.12 \ --Prun-end-to-end-tests -DdistDir=${{ env.FLINK_CACHE_DIR }}/flink-${{ inputs.flink_version }} \ --Dflink.convergence.phase=install -Pcheck-convergence \ -${{ env.MVN_CONNECTION_OPTIONS }} \ --Dlog4j.configurationFile=file://$(pwd)/tools/ci/log4j.properties \ -| tee ${{ env.MVN_BUILD_OUTPUT_FILE }} - - - name: Check licensing -run: | - mvn ${MVN_COMMON_OPTIONS} exec:java@check-license -N \ --Dexec.args="${{ env.MVN_BUILD_OUTPUT_FILE }} $(pwd) ${{ env.MVN_VALIDATION_DIR }}" \ -${{ env.MVN_CONNECTION_OPTIONS }} \ --Dlog4j.configurationFile=file://$(pwd)/tools/ci/log4j.properties diff --git a/.github/workflo
[flink-connector-jdbc] branch main updated: [hotfix] Reuse workflow
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-jdbc.git The following commit(s) were added to refs/heads/main by this push: new 50a4b29 [hotfix] Reuse workflow 50a4b29 is described below commit 50a4b29363b39287123fece1b6bab4a0f5831084 Author: Chesnay Schepler AuthorDate: Tue Dec 13 11:27:36 2022 +0100 [hotfix] Reuse workflow --- .github/workflows/ci.yml | 101 -- .github/workflows/push_pr.yml | 2 +- .github/workflows/weekly.yml | 2 +- 3 files changed, 2 insertions(+), 103 deletions(-) diff --git a/.github/workflows/ci.yml b/.github/workflows/ci.yml deleted file mode 100644 index 91b9091..000 --- a/.github/workflows/ci.yml +++ /dev/null @@ -1,101 +0,0 @@ - -# Licensed to the Apache Software Foundation (ASF) under one -# or more contributor license agreements. See the NOTICE file -# distributed with this work for additional information -# regarding copyright ownership. The ASF licenses this file -# to you under the Apache License, Version 2.0 (the -# "License"); you may not use this file except in compliance -# with the License. You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. - - -on: - workflow_call: -inputs: - flink_url: -description: "Url to Flink binary." -required: true -type: string - flink_version: -description: "Flink version to test against." -required: true -type: string - cache_flink_binary: -description: "Whether to cache the Flink binary. Should be false for SNAPSHOT URLs, true otherwise." -required: true -type: boolean - -jobs: - compile_and_test: -runs-on: ubuntu-latest -strategy: - matrix: -jdk: [8, 11] -timeout-minutes: 40 -env: - MVN_COMMON_OPTIONS: -U -B --no-transfer-progress -Dflink.version=${{ inputs.flink_version }} - MVN_CONNECTION_OPTIONS: -Dhttp.keepAlive=false -Dmaven.wagon.http.pool=false -Dmaven.wagon.httpconnectionManager.ttlSeconds=120 - FLINK_CACHE_DIR: "/tmp/cache/flink" - MVN_BUILD_OUTPUT_FILE: "/tmp/mvn_build_output.out" - MVN_VALIDATION_DIR: "/tmp/flink-validation-deployment" -steps: - - run: echo "Running CI pipeline for JDK version ${{ matrix.jdk }}" - - - name: Check out repository code -uses: actions/checkout@v2 - - - name: Set JDK -uses: actions/setup-java@v2 -with: - java-version: ${{ matrix.jdk }} - distribution: 'temurin' - cache: 'maven' - - - name: Set Maven 3.8.6 -uses: stCarolas/setup-maven@v4.2 -with: - maven-version: 3.8.6 - - - name: Create cache dirs -run: mkdir -p ${{ env.FLINK_CACHE_DIR }} - - - name: Cache Flink binary -if: ${{ inputs.cache_flink_binary == 'true' }} -uses: actions/cache@v3 -id: cache-flink -with: - path: ${{ env.FLINK_CACHE_DIR }} - key: ${{ inputs.flink_url }} - - - name: Download Flink binary -working-directory: ${{ env.FLINK_CACHE_DIR }} -if: steps.cache-flink.outputs.cache-hit != 'true' -run: wget -q -c ${{ inputs.flink_url }} -O - | tar -xz - - - name: Compile and test -timeout-minutes: 30 -run: | - set -o pipefail - - mvn clean deploy ${MVN_COMMON_OPTIONS} \ --DaltDeploymentRepository=validation_repository::default::file:${{ env.MVN_VALIDATION_DIR }} \ --Dscala-2.12 \ --Prun-end-to-end-tests -DdistDir=${{ env.FLINK_CACHE_DIR }}/flink-${{ inputs.flink_version }} \ --Dflink.convergence.phase=install -Pcheck-convergence \ -${{ env.MVN_CONNECTION_OPTIONS }} \ --Dlog4j.configurationFile=file://$(pwd)/tools/ci/log4j.properties \ -| tee ${{ env.MVN_BUILD_OUTPUT_FILE }} - - - name: Check licensing -run: | - mvn ${MVN_COMMON_OPTIONS} exec:java@check-license -N \ --Dexec.args="${{ env.MVN_BUILD_OUTPUT_FILE }} $(pwd) ${{ env.MVN_VALIDATION_DIR }}" \ -${{ env.MVN_CONNECTION_OPTIONS }} \ --Dlog4j.configurationFile=file://$(pwd)/tools/ci/log4j.properties diff --git a/.github/workflo
[flink-connector-opensearch] branch main updated: [hotfix] Reuse workflow
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-opensearch.git The following commit(s) were added to refs/heads/main by this push: new 198f5a7 [hotfix] Reuse workflow 198f5a7 is described below commit 198f5a7786d5154245892fde6bfef5b2e9febb67 Author: Chesnay Schepler AuthorDate: Tue Dec 13 11:26:39 2022 +0100 [hotfix] Reuse workflow --- .github/workflows/ci.yml | 101 -- .github/workflows/push_pr.yml | 2 +- .github/workflows/weekly.yml | 2 +- 3 files changed, 2 insertions(+), 103 deletions(-) diff --git a/.github/workflows/ci.yml b/.github/workflows/ci.yml deleted file mode 100644 index 91b9091..000 --- a/.github/workflows/ci.yml +++ /dev/null @@ -1,101 +0,0 @@ - -# Licensed to the Apache Software Foundation (ASF) under one -# or more contributor license agreements. See the NOTICE file -# distributed with this work for additional information -# regarding copyright ownership. The ASF licenses this file -# to you under the Apache License, Version 2.0 (the -# "License"); you may not use this file except in compliance -# with the License. You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. - - -on: - workflow_call: -inputs: - flink_url: -description: "Url to Flink binary." -required: true -type: string - flink_version: -description: "Flink version to test against." -required: true -type: string - cache_flink_binary: -description: "Whether to cache the Flink binary. Should be false for SNAPSHOT URLs, true otherwise." -required: true -type: boolean - -jobs: - compile_and_test: -runs-on: ubuntu-latest -strategy: - matrix: -jdk: [8, 11] -timeout-minutes: 40 -env: - MVN_COMMON_OPTIONS: -U -B --no-transfer-progress -Dflink.version=${{ inputs.flink_version }} - MVN_CONNECTION_OPTIONS: -Dhttp.keepAlive=false -Dmaven.wagon.http.pool=false -Dmaven.wagon.httpconnectionManager.ttlSeconds=120 - FLINK_CACHE_DIR: "/tmp/cache/flink" - MVN_BUILD_OUTPUT_FILE: "/tmp/mvn_build_output.out" - MVN_VALIDATION_DIR: "/tmp/flink-validation-deployment" -steps: - - run: echo "Running CI pipeline for JDK version ${{ matrix.jdk }}" - - - name: Check out repository code -uses: actions/checkout@v2 - - - name: Set JDK -uses: actions/setup-java@v2 -with: - java-version: ${{ matrix.jdk }} - distribution: 'temurin' - cache: 'maven' - - - name: Set Maven 3.8.6 -uses: stCarolas/setup-maven@v4.2 -with: - maven-version: 3.8.6 - - - name: Create cache dirs -run: mkdir -p ${{ env.FLINK_CACHE_DIR }} - - - name: Cache Flink binary -if: ${{ inputs.cache_flink_binary == 'true' }} -uses: actions/cache@v3 -id: cache-flink -with: - path: ${{ env.FLINK_CACHE_DIR }} - key: ${{ inputs.flink_url }} - - - name: Download Flink binary -working-directory: ${{ env.FLINK_CACHE_DIR }} -if: steps.cache-flink.outputs.cache-hit != 'true' -run: wget -q -c ${{ inputs.flink_url }} -O - | tar -xz - - - name: Compile and test -timeout-minutes: 30 -run: | - set -o pipefail - - mvn clean deploy ${MVN_COMMON_OPTIONS} \ --DaltDeploymentRepository=validation_repository::default::file:${{ env.MVN_VALIDATION_DIR }} \ --Dscala-2.12 \ --Prun-end-to-end-tests -DdistDir=${{ env.FLINK_CACHE_DIR }}/flink-${{ inputs.flink_version }} \ --Dflink.convergence.phase=install -Pcheck-convergence \ -${{ env.MVN_CONNECTION_OPTIONS }} \ --Dlog4j.configurationFile=file://$(pwd)/tools/ci/log4j.properties \ -| tee ${{ env.MVN_BUILD_OUTPUT_FILE }} - - - name: Check licensing -run: | - mvn ${MVN_COMMON_OPTIONS} exec:java@check-license -N \ --Dexec.args="${{ env.MVN_BUILD_OUTPUT_FILE }} $(pwd) ${{ env.MVN_VALIDATION_DIR }}" \ -${{ env.MVN_CONNECTION_OPTIONS }} \ --Dlog4j.configurationFile=file://$(pwd)/tools/ci/log4j.properties diff --git a/.gith
[flink-connector-rabbitmq] branch main updated: [hotfix] Reuse workflow
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-rabbitmq.git The following commit(s) were added to refs/heads/main by this push: new 81d03b8 [hotfix] Reuse workflow 81d03b8 is described below commit 81d03b8dd70f69bd7d0f01609b5a9ed4877e17a3 Author: Chesnay Schepler AuthorDate: Tue Dec 13 11:25:12 2022 +0100 [hotfix] Reuse workflow --- .github/workflows/ci.yml | 102 -- .github/workflows/push_pr.yml | 2 +- .github/workflows/weekly.yml | 2 +- 3 files changed, 2 insertions(+), 104 deletions(-) diff --git a/.github/workflows/ci.yml b/.github/workflows/ci.yml deleted file mode 100644 index c5da6bb..000 --- a/.github/workflows/ci.yml +++ /dev/null @@ -1,102 +0,0 @@ - -# Licensed to the Apache Software Foundation (ASF) under one -# or more contributor license agreements. See the NOTICE file -# distributed with this work for additional information -# regarding copyright ownership. The ASF licenses this file -# to you under the Apache License, Version 2.0 (the -# "License"); you may not use this file except in compliance -# with the License. You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. - - -on: - workflow_call: -inputs: - flink_url: -description: "Url to Flink binary." -required: true -type: string - flink_version: -description: "Flink version to test against." -required: true -type: string - cache_flink_binary: -description: "Whether to cache the Flink binary. Should be false for SNAPSHOT URLs, true otherwise." -required: true -type: boolean - -jobs: - compile_and_test: -runs-on: ubuntu-latest -strategy: - matrix: -jdk: [8, 11] -timeout-minutes: 40 -env: - MVN_COMMON_OPTIONS: -U -B --no-transfer-progress -Dflink.version=${{ inputs.flink_version }} - MVN_CONNECTION_OPTIONS: -Dhttp.keepAlive=false -Dmaven.wagon.http.pool=false -Dmaven.wagon.httpconnectionManager.ttlSeconds=120 - FLINK_CACHE_DIR: "/tmp/cache/flink" - MVN_BUILD_OUTPUT_FILE: "/tmp/mvn_build_output.out" - MVN_VALIDATION_DIR: "/tmp/flink-validation-deployment" -steps: - - run: echo "Running CI pipeline for JDK version ${{ matrix.jdk }}" - - - name: Check out repository code -uses: actions/checkout@v2 - - - name: Set JDK -uses: actions/setup-java@v2 -with: - java-version: ${{ matrix.jdk }} - distribution: 'temurin' - cache: 'maven' - - - name: Set Maven 3.8.6 -uses: stCarolas/setup-maven@v4.2 -with: - maven-version: 3.8.6 - - - name: Create cache dirs -run: mkdir -p ${{ env.FLINK_CACHE_DIR }} - - - name: Cache Flink binary -if: ${{ inputs.cache_flink_binary == 'true' }} -uses: actions/cache@v3 -id: cache-flink -with: - path: ${{ env.FLINK_CACHE_DIR }} - key: ${{ inputs.flink_url }} - - - name: Download Flink binary -working-directory: ${{ env.FLINK_CACHE_DIR }} -if: steps.cache-flink.outputs.cache-hit != 'true' -run: wget -q -c ${{ inputs.flink_url }} -O - | tar -xz - - - name: Compile and test -timeout-minutes: 30 -run: | - set -o pipefail - - mvn clean deploy ${MVN_COMMON_OPTIONS} \ --DaltDeploymentRepository=validation_repository::default::file:${{ env.MVN_VALIDATION_DIR }} \ --Dscala-2.12 \ --Prun-end-to-end-tests -DdistDir=${{ env.FLINK_CACHE_DIR }}/flink-${{ inputs.flink_version }} \ --Dflink.convergence.phase=install -Pcheck-convergence \ --Darchunit.freeze.store.default.allowStoreUpdate=false \ -${{ env.MVN_CONNECTION_OPTIONS }} \ --Dlog4j.configurationFile=file://$(pwd)/tools/ci/log4j.properties \ -| tee ${{ env.MVN_BUILD_OUTPUT_FILE }} - - - name: Check licensing -run: | - mvn ${MVN_COMMON_OPTIONS} exec:java@check-license -N \ --Dexec.args="${{ env.MVN_BUILD_OUTPUT_FILE }} $(pwd) ${{ env.MVN_VALIDATION_DIR }}" \ -${{ env.MVN_CONNECTION_OPTIONS }} \ --Dlog4j.configurat
[flink-connector-hbase] branch main updated: [hotfix][ci] Reuse workflow
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-hbase.git The following commit(s) were added to refs/heads/main by this push: new e6d2c65 [hotfix][ci] Reuse workflow e6d2c65 is described below commit e6d2c659601ba4ad956782299f9fb37ccef63a1d Author: Chesnay Schepler AuthorDate: Tue Dec 13 11:23:12 2022 +0100 [hotfix][ci] Reuse workflow --- .github/workflows/ci.yml | 101 -- .github/workflows/push_pr.yml | 2 +- .github/workflows/weekly.yml | 2 +- 3 files changed, 2 insertions(+), 103 deletions(-) diff --git a/.github/workflows/ci.yml b/.github/workflows/ci.yml deleted file mode 100644 index 0a812c8..000 --- a/.github/workflows/ci.yml +++ /dev/null @@ -1,101 +0,0 @@ - -# Licensed to the Apache Software Foundation (ASF) under one -# or more contributor license agreements. See the NOTICE file -# distributed with this work for additional information -# regarding copyright ownership. The ASF licenses this file -# to you under the Apache License, Version 2.0 (the -# "License"); you may not use this file except in compliance -# with the License. You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. - - -on: - workflow_call: -inputs: - flink_url: -description: "Url to Flink binary." -required: true -type: string - flink_version: -description: "Flink version to test against." -required: true -type: string - cache_flink_binary: -description: "Whether to cache the Flink binary. Should be false for SNAPSHOT URLs, true otherwise." -required: true -type: boolean - -jobs: - compile_and_test: -runs-on: ubuntu-latest -strategy: - matrix: -jdk: [8, 11] -timeout-minutes: 40 -env: - MVN_COMMON_OPTIONS: -U -B --no-transfer-progress -Dflink.version=${{ inputs.flink_version }} - MVN_CONNECTION_OPTIONS: -Dhttp.keepAlive=false -Dmaven.wagon.http.pool=false -Dmaven.wagon.httpconnectionManager.ttlSeconds=120 - FLINK_CACHE_DIR: "/tmp/cache/flink" - MVN_BUILD_OUTPUT_FILE: "/tmp/mvn_build_output.out" - MVN_VALIDATION_DIR: "/tmp/flink-validation-deployment" -steps: - - run: echo "Running CI pipeline for JDK version ${{ matrix.jdk }}" - - - name: Check out repository code -uses: actions/checkout@v2 - - - name: Set JDK -uses: actions/setup-java@v2 -with: - java-version: ${{ matrix.jdk }} - distribution: 'temurin' - cache: 'maven' - - - name: Set Maven 3.8.6 -uses: stCarolas/setup-maven@v4.2 -with: - maven-version: 3.8.6 - - - name: Create cache dirs -run: mkdir -p ${{ env.FLINK_CACHE_DIR }} - - - name: Cache Flink binary -if: ${{ inputs.cache_flink_binary == 'true' }} -uses: actions/cache@v3 -id: cache-flink -with: - path: ${{ env.FLINK_CACHE_DIR }} - key: ${{ inputs.flink_url }} - - - name: Download Flink binary -working-directory: ${{ env.FLINK_CACHE_DIR }} -if: steps.cache-flink.outputs.cache-hit != 'true' -run: wget -q -c ${{ inputs.flink_url }} -O - | tar -xz - - - name: Compile and test -timeout-minutes: 30 -run: | - set -o pipefail - - mvn clean deploy ${MVN_COMMON_OPTIONS} \ --DaltDeploymentRepository=validation_repository::default::file:${{ env.MVN_VALIDATION_DIR }} \ --Dscala-2.12 \ --Prun-end-to-end-tests -DdistDir=${{ env.FLINK_CACHE_DIR }}/flink-${{ inputs.flink_version }} \ --Dflink.convergence.phase=install -Pcheck-convergence \ -${{ env.MVN_CONNECTION_OPTIONS }} \ --Dlog4j.configurationFile=file://$(pwd)/tools/ci/log4j.properties \ -| tee ${{ env.MVN_BUILD_OUTPUT_FILE }} - - - name: Check licensing -run: | - mvn ${MVN_COMMON_OPTIONS} exec:java@check-license -N \ --Dexec.args="${{ env.MVN_BUILD_OUTPUT_FILE }} $(pwd) ${{ env.MVN_VALIDATION_DIR }}" \ -${{ env.MVN_CONNECTION_OPTIONS }} \ --Dlog4j.configurationFile=file://$(pwd)/tools/ci/log4j.properties diff --git a/.github/workflo
[flink-connector-pulsar] branch main updated: [hotfix][ci] Reuse workflow
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-pulsar.git The following commit(s) were added to refs/heads/main by this push: new 56b1e5e [hotfix][ci] Reuse workflow 56b1e5e is described below commit 56b1e5eca30d4423e174df09ea122eb3dc7b8c92 Author: Chesnay Schepler AuthorDate: Tue Dec 13 11:16:15 2022 +0100 [hotfix][ci] Reuse workflow --- .github/workflows/ci.yml | 101 -- .github/workflows/push_pr.yml | 4 +- .github/workflows/weekly.yml | 2 + 3 files changed, 5 insertions(+), 102 deletions(-) diff --git a/.github/workflows/ci.yml b/.github/workflows/ci.yml deleted file mode 100644 index a80b46d..000 --- a/.github/workflows/ci.yml +++ /dev/null @@ -1,101 +0,0 @@ - -# Licensed to the Apache Software Foundation (ASF) under one -# or more contributor license agreements. See the NOTICE file -# distributed with this work for additional information -# regarding copyright ownership. The ASF licenses this file -# to you under the Apache License, Version 2.0 (the -# "License"); you may not use this file except in compliance -# with the License. You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. - - -on: - workflow_call: -inputs: - flink_url: -description: "Url to Flink binary." -required: true -type: string - flink_version: -description: "Flink version to test against." -required: true -type: string - cache_flink_binary: -description: "Whether to cache the Flink binary. Should be false for SNAPSHOT URLs, true otherwise." -required: true -type: boolean - -jobs: - compile_and_test: -runs-on: ubuntu-latest -strategy: - matrix: -jdk: [8, 11] -timeout-minutes: 80 -env: - MVN_COMMON_OPTIONS: -U -B --no-transfer-progress -Dflink.version=${{ inputs.flink_version }} - MVN_CONNECTION_OPTIONS: -Dhttp.keepAlive=false -Dmaven.wagon.http.pool=false -Dmaven.wagon.httpconnectionManager.ttlSeconds=120 - FLINK_CACHE_DIR: "/tmp/cache/flink" - MVN_BUILD_OUTPUT_FILE: "/tmp/mvn_build_output.out" - MVN_VALIDATION_DIR: "/tmp/flink-validation-deployment" -steps: - - run: echo "Running CI pipeline for JDK version ${{ matrix.jdk }}" - - - name: Check out repository code -uses: actions/checkout@v2 - - - name: Set JDK -uses: actions/setup-java@v2 -with: - java-version: ${{ matrix.jdk }} - distribution: 'temurin' - cache: 'maven' - - - name: Set Maven 3.8.6 -uses: stCarolas/setup-maven@v4.2 -with: - maven-version: 3.8.6 - - - name: Create cache dirs -run: mkdir -p ${{ env.FLINK_CACHE_DIR }} - - - name: Cache Flink binary -if: ${{ inputs.cache_flink_binary == 'true' }} -uses: actions/cache@v3 -id: cache-flink -with: - path: ${{ env.FLINK_CACHE_DIR }} - key: ${{ inputs.flink_url }} - - - name: Download Flink binary -working-directory: ${{ env.FLINK_CACHE_DIR }} -if: steps.cache-flink.outputs.cache-hit != 'true' -run: wget -q -c ${{ inputs.flink_url }} -O - | tar -xz - - - name: Compile and test -timeout-minutes: 60 -run: | - set -o pipefail - - mvn clean deploy ${MVN_COMMON_OPTIONS} \ --DaltDeploymentRepository=validation_repository::default::file:${{ env.MVN_VALIDATION_DIR }} \ --Dscala-2.12 \ --Prun-end-to-end-tests -DdistDir=${{ env.FLINK_CACHE_DIR }}/flink-${{ inputs.flink_version }} \ --Dflink.convergence.phase=install -Pcheck-convergence \ -${{ env.MVN_CONNECTION_OPTIONS }} \ --Dlog4j.configurationFile=file://$(pwd)/tools/ci/log4j.properties \ -| tee ${{ env.MVN_BUILD_OUTPUT_FILE }} - - - name: Check licensing -run: | - mvn ${MVN_COMMON_OPTIONS} exec:java@check-license -N \ --Dexec.args="${{ env.MVN_BUILD_OUTPUT_FILE }} $(pwd) ${{ env.MVN_VALIDATION_DIR }}" \ -${{ env.MVN_CONNECTION_OPTIONS }} \ --Dlog4j.configurationFile=file://$(pwd)/tools/ci/log4j.properties \ No newline at end of file diff
[flink-connector-elasticsearch] branch main updated: [hotfix][ci] Reuse workflow
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-elasticsearch.git The following commit(s) were added to refs/heads/main by this push: new ce221bb [hotfix][ci] Reuse workflow ce221bb is described below commit ce221bb726fc48e94dec5c6c984d8ca5ec2b6037 Author: Chesnay Schepler AuthorDate: Tue Dec 13 10:55:15 2022 +0100 [hotfix][ci] Reuse workflow --- .github/workflows/ci.yml | 101 -- .github/workflows/push_pr.yml | 2 +- .github/workflows/weekly.yml | 2 +- 3 files changed, 2 insertions(+), 103 deletions(-) diff --git a/.github/workflows/ci.yml b/.github/workflows/ci.yml deleted file mode 100644 index 91b9091..000 --- a/.github/workflows/ci.yml +++ /dev/null @@ -1,101 +0,0 @@ - -# Licensed to the Apache Software Foundation (ASF) under one -# or more contributor license agreements. See the NOTICE file -# distributed with this work for additional information -# regarding copyright ownership. The ASF licenses this file -# to you under the Apache License, Version 2.0 (the -# "License"); you may not use this file except in compliance -# with the License. You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. - - -on: - workflow_call: -inputs: - flink_url: -description: "Url to Flink binary." -required: true -type: string - flink_version: -description: "Flink version to test against." -required: true -type: string - cache_flink_binary: -description: "Whether to cache the Flink binary. Should be false for SNAPSHOT URLs, true otherwise." -required: true -type: boolean - -jobs: - compile_and_test: -runs-on: ubuntu-latest -strategy: - matrix: -jdk: [8, 11] -timeout-minutes: 40 -env: - MVN_COMMON_OPTIONS: -U -B --no-transfer-progress -Dflink.version=${{ inputs.flink_version }} - MVN_CONNECTION_OPTIONS: -Dhttp.keepAlive=false -Dmaven.wagon.http.pool=false -Dmaven.wagon.httpconnectionManager.ttlSeconds=120 - FLINK_CACHE_DIR: "/tmp/cache/flink" - MVN_BUILD_OUTPUT_FILE: "/tmp/mvn_build_output.out" - MVN_VALIDATION_DIR: "/tmp/flink-validation-deployment" -steps: - - run: echo "Running CI pipeline for JDK version ${{ matrix.jdk }}" - - - name: Check out repository code -uses: actions/checkout@v2 - - - name: Set JDK -uses: actions/setup-java@v2 -with: - java-version: ${{ matrix.jdk }} - distribution: 'temurin' - cache: 'maven' - - - name: Set Maven 3.8.6 -uses: stCarolas/setup-maven@v4.2 -with: - maven-version: 3.8.6 - - - name: Create cache dirs -run: mkdir -p ${{ env.FLINK_CACHE_DIR }} - - - name: Cache Flink binary -if: ${{ inputs.cache_flink_binary == 'true' }} -uses: actions/cache@v3 -id: cache-flink -with: - path: ${{ env.FLINK_CACHE_DIR }} - key: ${{ inputs.flink_url }} - - - name: Download Flink binary -working-directory: ${{ env.FLINK_CACHE_DIR }} -if: steps.cache-flink.outputs.cache-hit != 'true' -run: wget -q -c ${{ inputs.flink_url }} -O - | tar -xz - - - name: Compile and test -timeout-minutes: 30 -run: | - set -o pipefail - - mvn clean deploy ${MVN_COMMON_OPTIONS} \ --DaltDeploymentRepository=validation_repository::default::file:${{ env.MVN_VALIDATION_DIR }} \ --Dscala-2.12 \ --Prun-end-to-end-tests -DdistDir=${{ env.FLINK_CACHE_DIR }}/flink-${{ inputs.flink_version }} \ --Dflink.convergence.phase=install -Pcheck-convergence \ -${{ env.MVN_CONNECTION_OPTIONS }} \ --Dlog4j.configurationFile=file://$(pwd)/tools/ci/log4j.properties \ -| tee ${{ env.MVN_BUILD_OUTPUT_FILE }} - - - name: Check licensing -run: | - mvn ${MVN_COMMON_OPTIONS} exec:java@check-license -N \ --Dexec.args="${{ env.MVN_BUILD_OUTPUT_FILE }} $(pwd) ${{ env.MVN_VALIDATION_DIR }}" \ -${{ env.MVN_CONNECTION_OPTIONS }} \ --Dlog4j.configurationFile=file://$(pwd)/tools/ci/log4j.properties diff
[flink-connector-shared-utils] branch ci_utils updated: Add re-usable CI workflow
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch ci_utils in repository https://gitbox.apache.org/repos/asf/flink-connector-shared-utils.git The following commit(s) were added to refs/heads/ci_utils by this push: new 9a49516 Add re-usable CI workflow 9a49516 is described below commit 9a4951622e80ecb11d72ede29f75076031cf2845 Author: Chesnay Schepler AuthorDate: Tue Dec 13 10:53:13 2022 +0100 Add re-usable CI workflow --- .github/workflows/ci.yml | 111 +++ 1 file changed, 111 insertions(+) diff --git a/.github/workflows/ci.yml b/.github/workflows/ci.yml new file mode 100644 index 000..9080021 --- /dev/null +++ b/.github/workflows/ci.yml @@ -0,0 +1,111 @@ + +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, software +# distributed under the License is distributed on an "AS IS" BASIS, +# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +# See the License for the specific language governing permissions and +# limitations under the License. + + +on: + workflow_call: +inputs: + flink_url: +description: "Url to Flink binary." +required: true +type: string + flink_version: +description: "Flink version to test against." +required: true +type: string + cache_flink_binary: +description: "Whether to cache the Flink binary. Should be false for SNAPSHOT URLs, true otherwise." +required: true +type: boolean + timeout_global: +description: "The timeout in minutes for the entire workflow." +required: false +type: number +default: 40 + timeout_test: +description: "The timeout in minutes for the test compile" +required: false +type: number +default: 30 + +jobs: + compile_and_test: +runs-on: ubuntu-latest +strategy: + matrix: +jdk: [8, 11] +timeout-minutes: ${{ inputs.timeout_global }} +env: + MVN_COMMON_OPTIONS: -U -B --no-transfer-progress -Dflink.version=${{ inputs.flink_version }} + MVN_CONNECTION_OPTIONS: -Dhttp.keepAlive=false -Dmaven.wagon.http.pool=false -Dmaven.wagon.httpconnectionManager.ttlSeconds=120 + FLINK_CACHE_DIR: "/tmp/cache/flink" + MVN_BUILD_OUTPUT_FILE: "/tmp/mvn_build_output.out" + MVN_VALIDATION_DIR: "/tmp/flink-validation-deployment" +steps: + - run: echo "Running CI pipeline for JDK version ${{ matrix.jdk }}" + + - name: Check out repository code +uses: actions/checkout@v2 + + - name: Set JDK +uses: actions/setup-java@v2 +with: + java-version: ${{ matrix.jdk }} + distribution: 'temurin' + cache: 'maven' + + - name: Set Maven 3.8.6 +uses: stCarolas/setup-maven@v4.2 +with: + maven-version: 3.8.6 + + - name: Create cache dirs +run: mkdir -p ${{ env.FLINK_CACHE_DIR }} + + - name: Cache Flink binary +if: ${{ inputs.cache_flink_binary == 'true' }} +uses: actions/cache@v3 +id: cache-flink +with: + path: ${{ env.FLINK_CACHE_DIR }} + key: ${{ inputs.flink_url }} + + - name: Download Flink binary +working-directory: ${{ env.FLINK_CACHE_DIR }} +if: steps.cache-flink.outputs.cache-hit != 'true' +run: wget -q -c ${{ inputs.flink_url }} -O - | tar -xz + + - name: Compile and test +timeout-minutes: ${{ inputs.timeout_test }} +run: | + set -o pipefail + + mvn clean deploy ${MVN_COMMON_OPTIONS} \ +-DaltDeploymentRepository=validation_repository::default::file:${{ env.MVN_VALIDATION_DIR }} \ +-Dscala-2.12 \ +-Prun-end-to-end-tests -DdistDir=${{ env.FLINK_CACHE_DIR }}/flink-${{ inputs.flink_version }} \ +-Dflink.convergence.phase=install -Pcheck-convergence \ +${{ env.MVN_CONNECTION_OPTIONS }} \ +-Dlog4j.configurationFile=file://$(pwd)/tools/ci/log4j.properties \ +| tee ${{ env.MVN_BUILD_OUTPUT_FILE }} + + - name: Check licensing +run: | + mvn ${MVN
[flink-connector-hbase] branch main updated (d74e518 -> a236254)
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-hbase.git from d74e518 [FLINK-30062][Connectors/HBase] Bundle the exact same dependencies as 1.16.0 new dc85476 [FLINK-30353][ci] Limit concurrency new 8996bed [hotfix][ci] Only run weekly in Apache repo new a236254 [hotfix][ci] Remove repo name from workflow files The 3 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .github/workflows/ci.yml | 4 ++-- .github/workflows/push_pr.yml | 7 +-- .github/workflows/weekly.yml | 5 +++-- 3 files changed, 10 insertions(+), 6 deletions(-)
[flink-connector-hbase] 01/03: [FLINK-30353][ci] Limit concurrency
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-hbase.git commit dc8547641c3f4d20f87a231fa71d49171f2de302 Author: Chesnay Schepler AuthorDate: Tue Dec 13 10:48:30 2022 +0100 [FLINK-30353][ci] Limit concurrency --- .github/workflows/push_pr.yml | 3 +++ 1 file changed, 3 insertions(+) diff --git a/.github/workflows/push_pr.yml b/.github/workflows/push_pr.yml index 2aa22cc..e4688c1 100644 --- a/.github/workflows/push_pr.yml +++ b/.github/workflows/push_pr.yml @@ -18,6 +18,9 @@ name: Build flink-connector-hbase on: [push, pull_request] +concurrency: + group: ${{ github.workflow }}-${{ github.ref }} + cancel-in-progress: true jobs: compile_and_test: uses: ./.github/workflows/ci.yml
[flink-connector-hbase] 02/03: [hotfix][ci] Only run weekly in Apache repo
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-hbase.git commit 8996bed455a517b7f69522ab0f9fc8c9f6b800a2 Author: Chesnay Schepler AuthorDate: Tue Dec 13 10:48:38 2022 +0100 [hotfix][ci] Only run weekly in Apache repo --- .github/workflows/weekly.yml | 1 + 1 file changed, 1 insertion(+) diff --git a/.github/workflows/weekly.yml b/.github/workflows/weekly.yml index 568bc82..ac27633 100644 --- a/.github/workflows/weekly.yml +++ b/.github/workflows/weekly.yml @@ -22,6 +22,7 @@ on: - cron: "0 0 * * 0" jobs: compile_and_test: +if: github.repository_owner == 'apache' strategy: matrix: flink: [1.16-SNAPSHOT, 1.17-SNAPSHOT]
[flink-connector-hbase] 03/03: [hotfix][ci] Remove repo name from workflow files
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-hbase.git commit a2362544c768ba1c4e7dcc237582f40a71484a89 Author: Chesnay Schepler AuthorDate: Tue Dec 13 10:48:56 2022 +0100 [hotfix][ci] Remove repo name from workflow files --- .github/workflows/ci.yml | 4 ++-- .github/workflows/push_pr.yml | 4 ++-- .github/workflows/weekly.yml | 4 ++-- 3 files changed, 6 insertions(+), 6 deletions(-) diff --git a/.github/workflows/ci.yml b/.github/workflows/ci.yml index a7d65c0..0a812c8 100644 --- a/.github/workflows/ci.yml +++ b/.github/workflows/ci.yml @@ -79,7 +79,7 @@ jobs: if: steps.cache-flink.outputs.cache-hit != 'true' run: wget -q -c ${{ inputs.flink_url }} -O - | tar -xz - - name: Compile and test flink-connector-hbase + - name: Compile and test timeout-minutes: 30 run: | set -o pipefail @@ -98,4 +98,4 @@ jobs: mvn ${MVN_COMMON_OPTIONS} exec:java@check-license -N \ -Dexec.args="${{ env.MVN_BUILD_OUTPUT_FILE }} $(pwd) ${{ env.MVN_VALIDATION_DIR }}" \ ${{ env.MVN_CONNECTION_OPTIONS }} \ --Dlog4j.configurationFile=file://$(pwd)/tools/ci/log4j.properties \ No newline at end of file +-Dlog4j.configurationFile=file://$(pwd)/tools/ci/log4j.properties diff --git a/.github/workflows/push_pr.yml b/.github/workflows/push_pr.yml index e4688c1..a2a7c33 100644 --- a/.github/workflows/push_pr.yml +++ b/.github/workflows/push_pr.yml @@ -16,7 +16,7 @@ # limitations under the License. -name: Build flink-connector-hbase +name: CI on: [push, pull_request] concurrency: group: ${{ github.workflow }}-${{ github.ref }} @@ -27,4 +27,4 @@ jobs: with: flink_version: 1.16.0 flink_url: https://dist.apache.org/repos/dist/release/flink/flink-1.16.0/flink-1.16.0-bin-scala_2.12.tgz - cache_flink_binary: true \ No newline at end of file + cache_flink_binary: true diff --git a/.github/workflows/weekly.yml b/.github/workflows/weekly.yml index ac27633..63f566f 100644 --- a/.github/workflows/weekly.yml +++ b/.github/workflows/weekly.yml @@ -16,7 +16,7 @@ # limitations under the License. -name: Build flink-connector-hbase +name: Nightly on: schedule: - cron: "0 0 * * 0" @@ -30,4 +30,4 @@ jobs: with: flink_version: ${{ matrix.flink }} flink_url: https://s3.amazonaws.com/flink-nightly/flink-${{ matrix.flink }}-bin-scala_2.12.tgz - cache_flink_binary: false \ No newline at end of file + cache_flink_binary: false
[flink-connector-rabbitmq] 03/03: [hotfix][ci] Remove repo name from workflow files
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-rabbitmq.git commit 7ac11267ec783d8af7f68d1b8086956b8d71c78c Author: Chesnay Schepler AuthorDate: Tue Dec 13 10:47:18 2022 +0100 [hotfix][ci] Remove repo name from workflow files --- .github/workflows/ci.yml | 2 +- .github/workflows/push_pr.yml | 2 +- .github/workflows/weekly.yml | 2 +- 3 files changed, 3 insertions(+), 3 deletions(-) diff --git a/.github/workflows/ci.yml b/.github/workflows/ci.yml index 49f4835..c5da6bb 100644 --- a/.github/workflows/ci.yml +++ b/.github/workflows/ci.yml @@ -79,7 +79,7 @@ jobs: if: steps.cache-flink.outputs.cache-hit != 'true' run: wget -q -c ${{ inputs.flink_url }} -O - | tar -xz - - name: Compile and test flink-connector-rabbitmq + - name: Compile and test timeout-minutes: 30 run: | set -o pipefail diff --git a/.github/workflows/push_pr.yml b/.github/workflows/push_pr.yml index d76db2f..a2a7c33 100644 --- a/.github/workflows/push_pr.yml +++ b/.github/workflows/push_pr.yml @@ -16,7 +16,7 @@ # limitations under the License. -name: Build flink-connector-rabbitmq +name: CI on: [push, pull_request] concurrency: group: ${{ github.workflow }}-${{ github.ref }} diff --git a/.github/workflows/weekly.yml b/.github/workflows/weekly.yml index b4be421..63f566f 100644 --- a/.github/workflows/weekly.yml +++ b/.github/workflows/weekly.yml @@ -16,7 +16,7 @@ # limitations under the License. -name: Build flink-connector-rabbitmq +name: Nightly on: schedule: - cron: "0 0 * * 0"
[flink-connector-rabbitmq] 02/03: [hotfix][ci] Only run weekly in Apache repo
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-rabbitmq.git commit 50502f41d87830e3bf6c95a7adde0d095d36150f Author: Chesnay Schepler AuthorDate: Tue Dec 13 10:47:05 2022 +0100 [hotfix][ci] Only run weekly in Apache repo --- .github/workflows/weekly.yml | 1 + 1 file changed, 1 insertion(+) diff --git a/.github/workflows/weekly.yml b/.github/workflows/weekly.yml index 1ba6a82..b4be421 100644 --- a/.github/workflows/weekly.yml +++ b/.github/workflows/weekly.yml @@ -22,6 +22,7 @@ on: - cron: "0 0 * * 0" jobs: compile_and_test: +if: github.repository_owner == 'apache' strategy: matrix: flink: [1.16-SNAPSHOT, 1.17-SNAPSHOT]
[flink-connector-rabbitmq] branch main updated (972fc15 -> 7ac1126)
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-rabbitmq.git from 972fc15 [hotfix] Update README new 711dee3 [FLINK-30353][ci] Limit concurrency new 50502f4 [hotfix][ci] Only run weekly in Apache repo new 7ac1126 [hotfix][ci] Remove repo name from workflow files The 3 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .github/workflows/ci.yml | 2 +- .github/workflows/push_pr.yml | 5 - .github/workflows/weekly.yml | 3 ++- 3 files changed, 7 insertions(+), 3 deletions(-)
[flink-connector-rabbitmq] 01/03: [FLINK-30353][ci] Limit concurrency
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-rabbitmq.git commit 711dee31366e3e3b794b3a85074ad2ab3a133e6d Author: Chesnay Schepler AuthorDate: Tue Dec 13 10:46:56 2022 +0100 [FLINK-30353][ci] Limit concurrency --- .github/workflows/push_pr.yml | 3 +++ 1 file changed, 3 insertions(+) diff --git a/.github/workflows/push_pr.yml b/.github/workflows/push_pr.yml index 45f67ce..d76db2f 100644 --- a/.github/workflows/push_pr.yml +++ b/.github/workflows/push_pr.yml @@ -18,6 +18,9 @@ name: Build flink-connector-rabbitmq on: [push, pull_request] +concurrency: + group: ${{ github.workflow }}-${{ github.ref }} + cancel-in-progress: true jobs: compile_and_test: uses: ./.github/workflows/ci.yml
[flink-connector-pulsar] branch main updated: [hotfix][ci] Fix workflow
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-pulsar.git The following commit(s) were added to refs/heads/main by this push: new b1e4d51 [hotfix][ci] Fix workflow b1e4d51 is described below commit b1e4d512c76b8c1293727c10e6d6ea879ea951d0 Author: Chesnay Schepler AuthorDate: Tue Dec 13 10:45:25 2022 +0100 [hotfix][ci] Fix workflow --- .github/workflows/ci.yml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/.github/workflows/ci.yml b/.github/workflows/ci.yml index 47fee39..a80b46d 100644 --- a/.github/workflows/ci.yml +++ b/.github/workflows/ci.yml @@ -79,9 +79,9 @@ jobs: if: steps.cache-flink.outputs.cache-hit != 'true' run: wget -q -c ${{ inputs.flink_url }} -O - | tar -xz + - name: Compile and test timeout-minutes: 60 run: | - - name: Compile and test set -o pipefail mvn clean deploy ${MVN_COMMON_OPTIONS} \
[flink-connector-opensearch] branch main updated (6407aab -> 34dc5de)
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-opensearch.git from 6407aab [FLINK-25756][docs] Add documentation new 4d07063 [FLINK-30353][ci] Limit concurrency new 7f26e64 [hotfix][ci] Only run weekly in Apache repo new 34dc5de [hotfix][ci] Remove repo name from workflow files The 3 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .github/workflows/ci.yml | 2 +- .github/workflows/push_pr.yml | 5 - .github/workflows/weekly.yml | 3 ++- 3 files changed, 7 insertions(+), 3 deletions(-)
[flink-connector-opensearch] 03/03: [hotfix][ci] Remove repo name from workflow files
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-opensearch.git commit 34dc5de98a5bbdb8ce99f3a58cae896d31aee30a Author: Chesnay Schepler AuthorDate: Tue Dec 13 10:43:53 2022 +0100 [hotfix][ci] Remove repo name from workflow files --- .github/workflows/ci.yml | 2 +- .github/workflows/push_pr.yml | 2 +- .github/workflows/weekly.yml | 2 +- 3 files changed, 3 insertions(+), 3 deletions(-) diff --git a/.github/workflows/ci.yml b/.github/workflows/ci.yml index b4ad24f..91b9091 100644 --- a/.github/workflows/ci.yml +++ b/.github/workflows/ci.yml @@ -79,7 +79,7 @@ jobs: if: steps.cache-flink.outputs.cache-hit != 'true' run: wget -q -c ${{ inputs.flink_url }} -O - | tar -xz - - name: Compile and test flink-connector-opensearch + - name: Compile and test timeout-minutes: 30 run: | set -o pipefail diff --git a/.github/workflows/push_pr.yml b/.github/workflows/push_pr.yml index 41b6197..a2a7c33 100644 --- a/.github/workflows/push_pr.yml +++ b/.github/workflows/push_pr.yml @@ -16,7 +16,7 @@ # limitations under the License. -name: Build flink-connector-opensearch +name: CI on: [push, pull_request] concurrency: group: ${{ github.workflow }}-${{ github.ref }} diff --git a/.github/workflows/weekly.yml b/.github/workflows/weekly.yml index 1828c82..63f566f 100644 --- a/.github/workflows/weekly.yml +++ b/.github/workflows/weekly.yml @@ -16,7 +16,7 @@ # limitations under the License. -name: Build flink-connector-opensearch +name: Nightly on: schedule: - cron: "0 0 * * 0"
[flink-connector-opensearch] 01/03: [FLINK-30353][ci] Limit concurrency
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-opensearch.git commit 4d07063602d5739f15113ff6357a3607d0c8e047 Author: Chesnay Schepler AuthorDate: Tue Dec 13 10:41:17 2022 +0100 [FLINK-30353][ci] Limit concurrency --- .github/workflows/push_pr.yml | 3 +++ 1 file changed, 3 insertions(+) diff --git a/.github/workflows/push_pr.yml b/.github/workflows/push_pr.yml index b3ab749..41b6197 100644 --- a/.github/workflows/push_pr.yml +++ b/.github/workflows/push_pr.yml @@ -18,6 +18,9 @@ name: Build flink-connector-opensearch on: [push, pull_request] +concurrency: + group: ${{ github.workflow }}-${{ github.ref }} + cancel-in-progress: true jobs: compile_and_test: uses: ./.github/workflows/ci.yml
[flink-connector-opensearch] 02/03: [hotfix][ci] Only run weekly in Apache repo
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-opensearch.git commit 7f26e648f79eb20ce74b24fc18cd9c1c18762f45 Author: Chesnay Schepler AuthorDate: Tue Dec 13 10:41:34 2022 +0100 [hotfix][ci] Only run weekly in Apache repo --- .github/workflows/weekly.yml | 1 + 1 file changed, 1 insertion(+) diff --git a/.github/workflows/weekly.yml b/.github/workflows/weekly.yml index 1f9cecf..1828c82 100644 --- a/.github/workflows/weekly.yml +++ b/.github/workflows/weekly.yml @@ -22,6 +22,7 @@ on: - cron: "0 0 * * 0" jobs: compile_and_test: +if: github.repository_owner == 'apache' strategy: matrix: flink: [1.16-SNAPSHOT, 1.17-SNAPSHOT]
[flink-connector-pulsar] 03/03: [hotfix][ci] Remove repo name from workflow files
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-pulsar.git commit 15e1372f4df63fac6946654f76ec3e35b90bc5d7 Author: Chesnay Schepler AuthorDate: Tue Dec 13 10:40:20 2022 +0100 [hotfix][ci] Remove repo name from workflow files --- .github/workflows/ci.yml | 2 +- .github/workflows/push_pr.yml | 2 +- .github/workflows/weekly.yml | 4 ++-- 3 files changed, 4 insertions(+), 4 deletions(-) diff --git a/.github/workflows/ci.yml b/.github/workflows/ci.yml index ea8a6c1..47fee39 100644 --- a/.github/workflows/ci.yml +++ b/.github/workflows/ci.yml @@ -79,9 +79,9 @@ jobs: if: steps.cache-flink.outputs.cache-hit != 'true' run: wget -q -c ${{ inputs.flink_url }} -O - | tar -xz - - name: Compile and test flink-connector-pulsar timeout-minutes: 60 run: | + - name: Compile and test set -o pipefail mvn clean deploy ${MVN_COMMON_OPTIONS} \ diff --git a/.github/workflows/push_pr.yml b/.github/workflows/push_pr.yml index 23a19fb..63805ef 100644 --- a/.github/workflows/push_pr.yml +++ b/.github/workflows/push_pr.yml @@ -16,7 +16,7 @@ # limitations under the License. -name: Build flink-connector-pulsar +name: CI on: [push, pull_request] concurrency: group: ${{ github.workflow }}-${{ github.ref }} diff --git a/.github/workflows/weekly.yml b/.github/workflows/weekly.yml index 215d2f5..acea426 100644 --- a/.github/workflows/weekly.yml +++ b/.github/workflows/weekly.yml @@ -16,7 +16,7 @@ # limitations under the License. -name: Build flink-connector-pulsar +name: Nightly on: schedule: - cron: "0 0 * * 0" @@ -30,4 +30,4 @@ jobs: with: flink_version: ${{ matrix.flink }} flink_url: https://s3.amazonaws.com/flink-nightly/flink-${{ matrix.flink }}-bin-scala_2.12.tgz - cache_flink_binary: false \ No newline at end of file + cache_flink_binary: false
[flink-connector-pulsar] branch main updated (ded956e -> 15e1372)
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-pulsar.git from ded956e [hotfix][architecture] Add ProductionCodeArchitectureTest new c5c9227 [FLINK-30353][ci] Limit concurrency new 0e05cb5 [hotfix][ci] Only run weekly in Apache repo new 15e1372 [hotfix][ci] Remove repo name from workflow files The 3 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .github/workflows/ci.yml | 2 +- .github/workflows/push_pr.yml | 5 - .github/workflows/weekly.yml | 5 +++-- 3 files changed, 8 insertions(+), 4 deletions(-)
[flink-connector-pulsar] 02/03: [hotfix][ci] Only run weekly in Apache repo
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-pulsar.git commit 0e05cb5dc72e2627064ec994270a508ef43849dd Author: Chesnay Schepler AuthorDate: Tue Dec 13 10:39:43 2022 +0100 [hotfix][ci] Only run weekly in Apache repo --- .github/workflows/weekly.yml | 1 + 1 file changed, 1 insertion(+) diff --git a/.github/workflows/weekly.yml b/.github/workflows/weekly.yml index cb628f2..215d2f5 100644 --- a/.github/workflows/weekly.yml +++ b/.github/workflows/weekly.yml @@ -22,6 +22,7 @@ on: - cron: "0 0 * * 0" jobs: compile_and_test: +if: github.repository_owner == 'apache' strategy: matrix: flink: [1.17-SNAPSHOT]
[flink-connector-pulsar] 01/03: [FLINK-30353][ci] Limit concurrency
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-pulsar.git commit c5c922759ed0539063d4a9a48536e1ef87f4b7d1 Author: Chesnay Schepler AuthorDate: Tue Dec 13 10:39:33 2022 +0100 [FLINK-30353][ci] Limit concurrency --- .github/workflows/push_pr.yml | 3 +++ 1 file changed, 3 insertions(+) diff --git a/.github/workflows/push_pr.yml b/.github/workflows/push_pr.yml index 759de4b..23a19fb 100644 --- a/.github/workflows/push_pr.yml +++ b/.github/workflows/push_pr.yml @@ -18,6 +18,9 @@ name: Build flink-connector-pulsar on: [push, pull_request] +concurrency: + group: ${{ github.workflow }}-${{ github.ref }} + cancel-in-progress: true jobs: compile_and_test: uses: ./.github/workflows/ci.yml
[flink-connector-aws] branch main updated: [FLINK-30353][ci] Limit concurrency
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-aws.git The following commit(s) were added to refs/heads/main by this push: new 1646ec0 [FLINK-30353][ci] Limit concurrency 1646ec0 is described below commit 1646ec0b59e5244d37048225174d4cc3367acfc0 Author: Chesnay Schepler AuthorDate: Tue Dec 13 10:38:18 2022 +0100 [FLINK-30353][ci] Limit concurrency --- .github/workflows/ci.yml | 3 +++ 1 file changed, 3 insertions(+) diff --git a/.github/workflows/ci.yml b/.github/workflows/ci.yml index 97d9313..c2ad69f 100644 --- a/.github/workflows/ci.yml +++ b/.github/workflows/ci.yml @@ -18,6 +18,9 @@ name: Build flink-connector-aws on: [push, pull_request] +concurrency: + group: ${{ github.workflow }}-${{ github.ref }} + cancel-in-progress: true jobs: compile_and_test: runs-on: ubuntu-latest
[flink-connector-jdbc] 01/03: [FLINK-30353][ci] Limit concurrency
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-jdbc.git commit ba0f18470245a0c397ac5b96dfcbc4c9e7bc483a Author: Chesnay Schepler AuthorDate: Tue Dec 13 10:27:02 2022 +0100 [FLINK-30353][ci] Limit concurrency --- .github/workflows/push_pr.yml | 3 +++ 1 file changed, 3 insertions(+) diff --git a/.github/workflows/push_pr.yml b/.github/workflows/push_pr.yml index e679db6..b066b7c 100644 --- a/.github/workflows/push_pr.yml +++ b/.github/workflows/push_pr.yml @@ -18,6 +18,9 @@ name: Build flink-connector-jdbc on: [push, pull_request] +concurrency: + group: ${{ github.workflow }}-${{ github.ref }} + cancel-in-progress: true jobs: compile_and_test: uses: ./.github/workflows/ci.yml
[flink-connector-jdbc] 02/03: [hotfix][ci] Only run weekly in Apache repo
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-jdbc.git commit ce55ce06040e52821e7e6bb1692f63ea5cb4a118 Author: Chesnay Schepler AuthorDate: Tue Dec 13 10:27:11 2022 +0100 [hotfix][ci] Only run weekly in Apache repo --- .github/workflows/weekly.yml | 1 + 1 file changed, 1 insertion(+) diff --git a/.github/workflows/weekly.yml b/.github/workflows/weekly.yml index 899b92c..1372549 100644 --- a/.github/workflows/weekly.yml +++ b/.github/workflows/weekly.yml @@ -22,6 +22,7 @@ on: - cron: "0 0 * * 0" jobs: compile_and_test: +if: github.repository_owner == 'apache' strategy: matrix: flink: [1.16-SNAPSHOT, 1.17-SNAPSHOT]
[flink-connector-jdbc] 03/03: [hotfix][ci] Remove repo name from workflow files
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-jdbc.git commit 092f502b2962984af47d8428eab86687db229b81 Author: Chesnay Schepler AuthorDate: Tue Dec 13 10:27:19 2022 +0100 [hotfix][ci] Remove repo name from workflow files --- .github/workflows/ci.yml | 6 +++--- .github/workflows/push_pr.yml | 4 ++-- .github/workflows/weekly.yml | 4 ++-- 3 files changed, 7 insertions(+), 7 deletions(-) diff --git a/.github/workflows/ci.yml b/.github/workflows/ci.yml index b41eedc..91b9091 100644 --- a/.github/workflows/ci.yml +++ b/.github/workflows/ci.yml @@ -79,9 +79,9 @@ jobs: if: steps.cache-flink.outputs.cache-hit != 'true' run: wget -q -c ${{ inputs.flink_url }} -O - | tar -xz - - name: Compile and test flink-connector-jdbc + - name: Compile and test timeout-minutes: 30 -run: | +run: | set -o pipefail mvn clean deploy ${MVN_COMMON_OPTIONS} \ @@ -98,4 +98,4 @@ jobs: mvn ${MVN_COMMON_OPTIONS} exec:java@check-license -N \ -Dexec.args="${{ env.MVN_BUILD_OUTPUT_FILE }} $(pwd) ${{ env.MVN_VALIDATION_DIR }}" \ ${{ env.MVN_CONNECTION_OPTIONS }} \ --Dlog4j.configurationFile=file://$(pwd)/tools/ci/log4j.properties \ No newline at end of file +-Dlog4j.configurationFile=file://$(pwd)/tools/ci/log4j.properties diff --git a/.github/workflows/push_pr.yml b/.github/workflows/push_pr.yml index b066b7c..a2a7c33 100644 --- a/.github/workflows/push_pr.yml +++ b/.github/workflows/push_pr.yml @@ -16,7 +16,7 @@ # limitations under the License. -name: Build flink-connector-jdbc +name: CI on: [push, pull_request] concurrency: group: ${{ github.workflow }}-${{ github.ref }} @@ -27,4 +27,4 @@ jobs: with: flink_version: 1.16.0 flink_url: https://dist.apache.org/repos/dist/release/flink/flink-1.16.0/flink-1.16.0-bin-scala_2.12.tgz - cache_flink_binary: true \ No newline at end of file + cache_flink_binary: true diff --git a/.github/workflows/weekly.yml b/.github/workflows/weekly.yml index 1372549..63f566f 100644 --- a/.github/workflows/weekly.yml +++ b/.github/workflows/weekly.yml @@ -16,7 +16,7 @@ # limitations under the License. -name: Build flink-connector-jdbc +name: Nightly on: schedule: - cron: "0 0 * * 0" @@ -30,4 +30,4 @@ jobs: with: flink_version: ${{ matrix.flink }} flink_url: https://s3.amazonaws.com/flink-nightly/flink-${{ matrix.flink }}-bin-scala_2.12.tgz - cache_flink_binary: false \ No newline at end of file + cache_flink_binary: false
[flink-connector-jdbc] branch main updated (9559acf -> 092f502)
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-jdbc.git from 9559acf [FLINK-30060][Connector/JDBC] Move existing JDBC connector code from Flink repo to dedicated JDBC repo new ba0f184 [FLINK-30353][ci] Limit concurrency new ce55ce0 [hotfix][ci] Only run weekly in Apache repo new 092f502 [hotfix][ci] Remove repo name from workflow files The 3 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .github/workflows/ci.yml | 6 +++--- .github/workflows/push_pr.yml | 7 +-- .github/workflows/weekly.yml | 5 +++-- 3 files changed, 11 insertions(+), 7 deletions(-)
[flink-connector-kafka] 02/03: [hotfix][ci] Only run weekly in Apache repo
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-kafka.git commit f5c35f093c12b2bee90f3091e93990270026768e Author: Chesnay Schepler AuthorDate: Tue Dec 13 10:25:18 2022 +0100 [hotfix][ci] Only run weekly in Apache repo --- .github/workflows/weekly.yml | 1 + 1 file changed, 1 insertion(+) diff --git a/.github/workflows/weekly.yml b/.github/workflows/weekly.yml index 84ec8bb..c1776ad 100644 --- a/.github/workflows/weekly.yml +++ b/.github/workflows/weekly.yml @@ -22,6 +22,7 @@ on: - cron: "0 0 * * 0" jobs: compile_and_test: +if: github.repository_owner == 'apache' strategy: matrix: flink: [1.16-SNAPSHOT, 1.17-SNAPSHOT]
[flink-connector-kafka] 03/03: [hotfix][ci] Remove repo name from workflow files
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-kafka.git commit d9e4c2466e0681f1f90b71f44d40f6b3fcd80085 Author: Chesnay Schepler AuthorDate: Tue Dec 13 10:25:43 2022 +0100 [hotfix][ci] Remove repo name from workflow files --- .github/workflows/ci.yml | 6 +++--- .github/workflows/push_pr.yml | 4 ++-- .github/workflows/weekly.yml | 4 ++-- 3 files changed, 7 insertions(+), 7 deletions(-) diff --git a/.github/workflows/ci.yml b/.github/workflows/ci.yml index 726b112..91b9091 100644 --- a/.github/workflows/ci.yml +++ b/.github/workflows/ci.yml @@ -79,9 +79,9 @@ jobs: if: steps.cache-flink.outputs.cache-hit != 'true' run: wget -q -c ${{ inputs.flink_url }} -O - | tar -xz - - name: Compile and test flink-connector-kafka + - name: Compile and test timeout-minutes: 30 -run: | +run: | set -o pipefail mvn clean deploy ${MVN_COMMON_OPTIONS} \ @@ -98,4 +98,4 @@ jobs: mvn ${MVN_COMMON_OPTIONS} exec:java@check-license -N \ -Dexec.args="${{ env.MVN_BUILD_OUTPUT_FILE }} $(pwd) ${{ env.MVN_VALIDATION_DIR }}" \ ${{ env.MVN_CONNECTION_OPTIONS }} \ --Dlog4j.configurationFile=file://$(pwd)/tools/ci/log4j.properties \ No newline at end of file +-Dlog4j.configurationFile=file://$(pwd)/tools/ci/log4j.properties diff --git a/.github/workflows/push_pr.yml b/.github/workflows/push_pr.yml index 8860f06..a2a7c33 100644 --- a/.github/workflows/push_pr.yml +++ b/.github/workflows/push_pr.yml @@ -16,7 +16,7 @@ # limitations under the License. -name: Build flink-connector-kafka +name: CI on: [push, pull_request] concurrency: group: ${{ github.workflow }}-${{ github.ref }} @@ -27,4 +27,4 @@ jobs: with: flink_version: 1.16.0 flink_url: https://dist.apache.org/repos/dist/release/flink/flink-1.16.0/flink-1.16.0-bin-scala_2.12.tgz - cache_flink_binary: true \ No newline at end of file + cache_flink_binary: true diff --git a/.github/workflows/weekly.yml b/.github/workflows/weekly.yml index c1776ad..63f566f 100644 --- a/.github/workflows/weekly.yml +++ b/.github/workflows/weekly.yml @@ -16,7 +16,7 @@ # limitations under the License. -name: Build flink-connector-kafka +name: Nightly on: schedule: - cron: "0 0 * * 0" @@ -30,4 +30,4 @@ jobs: with: flink_version: ${{ matrix.flink }} flink_url: https://s3.amazonaws.com/flink-nightly/flink-${{ matrix.flink }}-bin-scala_2.12.tgz - cache_flink_binary: false \ No newline at end of file + cache_flink_binary: false
[flink-connector-kafka] 01/03: [FLINK-30353][ci] Limit concurrency
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-kafka.git commit e253f0cdf596e14c540501d928da3315f0618619 Author: Chesnay Schepler AuthorDate: Tue Dec 13 10:25:08 2022 +0100 [FLINK-30353][ci] Limit concurrency --- .github/workflows/push_pr.yml | 3 +++ 1 file changed, 3 insertions(+) diff --git a/.github/workflows/push_pr.yml b/.github/workflows/push_pr.yml index 7a9ecba..8860f06 100644 --- a/.github/workflows/push_pr.yml +++ b/.github/workflows/push_pr.yml @@ -18,6 +18,9 @@ name: Build flink-connector-kafka on: [push, pull_request] +concurrency: + group: ${{ github.workflow }}-${{ github.ref }} + cancel-in-progress: true jobs: compile_and_test: uses: ./.github/workflows/ci.yml
[flink-connector-kafka] branch main updated (4f664f1 -> d9e4c24)
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-kafka.git from 4f664f1 [hotfix] Setup auto-linking new e253f0c [FLINK-30353][ci] Limit concurrency new f5c35f0 [hotfix][ci] Only run weekly in Apache repo new d9e4c24 [hotfix][ci] Remove repo name from workflow files The 3 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .github/workflows/ci.yml | 6 +++--- .github/workflows/push_pr.yml | 7 +-- .github/workflows/weekly.yml | 5 +++-- 3 files changed, 11 insertions(+), 7 deletions(-)
[flink-connector-cassandra] 01/03: [FLINK-30353][ci] Limit concurrency
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-cassandra.git commit 98528f021f5d279ece7f98751f7a740ff4ac3d37 Author: Chesnay Schepler AuthorDate: Tue Dec 13 10:19:49 2022 +0100 [FLINK-30353][ci] Limit concurrency --- .github/workflows/push_pr.yml | 3 +++ 1 file changed, 3 insertions(+) diff --git a/.github/workflows/push_pr.yml b/.github/workflows/push_pr.yml index b089eba..b99deae 100644 --- a/.github/workflows/push_pr.yml +++ b/.github/workflows/push_pr.yml @@ -18,6 +18,9 @@ name: Build flink-connector-cassandra on: [push, pull_request] +concurrency: + group: ${{ github.workflow }}-${{ github.ref }} + cancel-in-progress: true jobs: compile_and_test: uses: ./.github/workflows/ci.yml
[flink-connector-cassandra] 02/03: [hotfix][ci] Only run weekly in Apache repo
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-cassandra.git commit 46b1128747a07a892beeabe79ae37b50d530f70d Author: Chesnay Schepler AuthorDate: Tue Dec 13 10:19:56 2022 +0100 [hotfix][ci] Only run weekly in Apache repo --- .github/workflows/weekly.yml | 1 + 1 file changed, 1 insertion(+) diff --git a/.github/workflows/weekly.yml b/.github/workflows/weekly.yml index 0454187..1f4d1d3 100644 --- a/.github/workflows/weekly.yml +++ b/.github/workflows/weekly.yml @@ -22,6 +22,7 @@ on: - cron: "0 0 * * 0" jobs: compile_and_test: +if: github.repository_owner == 'apache' strategy: matrix: flink: [1.16-SNAPSHOT, 1.17-SNAPSHOT]
[flink-connector-cassandra] 03/03: [hotfix][ci] Remove repo name from workflow files
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-cassandra.git commit 693dc5288fbd867740c064718713c652842afe0b Author: Chesnay Schepler AuthorDate: Tue Dec 13 10:20:11 2022 +0100 [hotfix][ci] Remove repo name from workflow files --- .github/workflows/ci.yml | 2 +- .github/workflows/push_pr.yml | 2 +- .github/workflows/weekly.yml | 2 +- 3 files changed, 3 insertions(+), 3 deletions(-) diff --git a/.github/workflows/ci.yml b/.github/workflows/ci.yml index 5694fa6..91b9091 100644 --- a/.github/workflows/ci.yml +++ b/.github/workflows/ci.yml @@ -79,7 +79,7 @@ jobs: if: steps.cache-flink.outputs.cache-hit != 'true' run: wget -q -c ${{ inputs.flink_url }} -O - | tar -xz - - name: Compile and test flink-connector-cassandra + - name: Compile and test timeout-minutes: 30 run: | set -o pipefail diff --git a/.github/workflows/push_pr.yml b/.github/workflows/push_pr.yml index b99deae..a2a7c33 100644 --- a/.github/workflows/push_pr.yml +++ b/.github/workflows/push_pr.yml @@ -16,7 +16,7 @@ # limitations under the License. -name: Build flink-connector-cassandra +name: CI on: [push, pull_request] concurrency: group: ${{ github.workflow }}-${{ github.ref }} diff --git a/.github/workflows/weekly.yml b/.github/workflows/weekly.yml index 1f4d1d3..63f566f 100644 --- a/.github/workflows/weekly.yml +++ b/.github/workflows/weekly.yml @@ -16,7 +16,7 @@ # limitations under the License. -name: Build flink-connector-cassandra +name: Nightly on: schedule: - cron: "0 0 * * 0"
[flink-connector-cassandra] branch main updated (77b088f -> 693dc52)
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-cassandra.git from 77b088f [hotfix] Setup auto-linking new 98528f0 [FLINK-30353][ci] Limit concurrency new 46b1128 [hotfix][ci] Only run weekly in Apache repo new 693dc52 [hotfix][ci] Remove repo name from workflow files The 3 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .github/workflows/ci.yml | 2 +- .github/workflows/push_pr.yml | 5 - .github/workflows/weekly.yml | 3 ++- 3 files changed, 7 insertions(+), 3 deletions(-)
[flink-connector-elasticsearch] 03/03: [hotfix][ci] Remove repo name from workflow files
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-elasticsearch.git commit 8275d13968b56ed93088455b7b3d950cf8c070b5 Author: Chesnay Schepler AuthorDate: Tue Dec 13 10:17:39 2022 +0100 [hotfix][ci] Remove repo name from workflow files --- .github/workflows/ci.yml | 2 +- .github/workflows/push_pr.yml | 2 +- .github/workflows/weekly.yml | 2 +- 3 files changed, 3 insertions(+), 3 deletions(-) diff --git a/.github/workflows/ci.yml b/.github/workflows/ci.yml index af39b82..91b9091 100644 --- a/.github/workflows/ci.yml +++ b/.github/workflows/ci.yml @@ -79,7 +79,7 @@ jobs: if: steps.cache-flink.outputs.cache-hit != 'true' run: wget -q -c ${{ inputs.flink_url }} -O - | tar -xz - - name: Compile and test flink-connector-elasticsearch + - name: Compile and test timeout-minutes: 30 run: | set -o pipefail diff --git a/.github/workflows/push_pr.yml b/.github/workflows/push_pr.yml index 9622ad9..a2a7c33 100644 --- a/.github/workflows/push_pr.yml +++ b/.github/workflows/push_pr.yml @@ -16,7 +16,7 @@ # limitations under the License. -name: Build flink-connector-elasticsearch +name: CI on: [push, pull_request] concurrency: group: ${{ github.workflow }}-${{ github.ref }} diff --git a/.github/workflows/weekly.yml b/.github/workflows/weekly.yml index 538c6f5..63f566f 100644 --- a/.github/workflows/weekly.yml +++ b/.github/workflows/weekly.yml @@ -16,7 +16,7 @@ # limitations under the License. -name: Build flink-connector-elasticsearch +name: Nightly on: schedule: - cron: "0 0 * * 0"
[flink-connector-elasticsearch] 01/03: [FLINK-30353][ci] Limit concurrency
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-elasticsearch.git commit 68ac773168e993dd608448cb6027665f28d227b1 Author: Chesnay Schepler AuthorDate: Tue Dec 13 10:08:03 2022 +0100 [FLINK-30353][ci] Limit concurrency --- .github/workflows/push_pr.yml | 3 +++ 1 file changed, 3 insertions(+) diff --git a/.github/workflows/push_pr.yml b/.github/workflows/push_pr.yml index 45eeed0..9622ad9 100644 --- a/.github/workflows/push_pr.yml +++ b/.github/workflows/push_pr.yml @@ -18,6 +18,9 @@ name: Build flink-connector-elasticsearch on: [push, pull_request] +concurrency: + group: ${{ github.workflow }}-${{ github.ref }} + cancel-in-progress: true jobs: compile_and_test: uses: ./.github/workflows/ci.yml
[flink-connector-elasticsearch] 02/03: [hotfix][ci] Only run weekly in Apache repo
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-elasticsearch.git commit 35ae216b05772c010d47f6aa9f5b072842590c66 Author: Chesnay Schepler AuthorDate: Tue Dec 13 10:15:40 2022 +0100 [hotfix][ci] Only run weekly in Apache repo --- .github/workflows/weekly.yml | 1 + 1 file changed, 1 insertion(+) diff --git a/.github/workflows/weekly.yml b/.github/workflows/weekly.yml index 260c325..538c6f5 100644 --- a/.github/workflows/weekly.yml +++ b/.github/workflows/weekly.yml @@ -22,6 +22,7 @@ on: - cron: "0 0 * * 0" jobs: compile_and_test: +if: github.repository_owner == 'apache' strategy: matrix: flink: [1.16-SNAPSHOT, 1.17-SNAPSHOT]
[flink-connector-elasticsearch] branch main updated (e205d90 -> 8275d13)
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-elasticsearch.git from e205d90 [FLINK-30352][docs] Document missing configuration properties new 68ac773 [FLINK-30353][ci] Limit concurrency new 35ae216 [hotfix][ci] Only run weekly in Apache repo new 8275d13 [hotfix][ci] Remove repo name from workflow files The 3 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .github/workflows/ci.yml | 2 +- .github/workflows/push_pr.yml | 5 - .github/workflows/weekly.yml | 3 ++- 3 files changed, 7 insertions(+), 3 deletions(-)
[flink-connector-elasticsearch] branch v3.0 updated: [FLINK-30352][docs] Document missing configuration properties
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch v3.0 in repository https://gitbox.apache.org/repos/asf/flink-connector-elasticsearch.git The following commit(s) were added to refs/heads/v3.0 by this push: new 2d5900d [FLINK-30352][docs] Document missing configuration properties 2d5900d is described below commit 2d5900da633ccc6dd6a8dc2f91877828eb78f3ea Author: Andriy Redko AuthorDate: Mon Dec 12 11:06:26 2022 -0500 [FLINK-30352][docs] Document missing configuration properties --- .../docs/connectors/table/elasticsearch.md | 13 .../content/docs/connectors/table/elasticsearch.md | 38 ++ 2 files changed, 51 insertions(+) diff --git a/docs/content.zh/docs/connectors/table/elasticsearch.md b/docs/content.zh/docs/connectors/table/elasticsearch.md index 3395eda..e7e0552 100644 --- a/docs/content.zh/docs/connectors/table/elasticsearch.md +++ b/docs/content.zh/docs/connectors/table/elasticsearch.md @@ -143,6 +143,19 @@ CREATE TABLE myUserTable ( + + sink.delivery-guarantee + optional + AT_LEAST_ONCE + String + Optional delivery guarantee when committing. Valid values are: + +EXACTLY_ONCE: records are only delivered exactly-once also under failover scenarios. +AT_LEAST_ONCE: records are ensured to be delivered but it may happen that the same record is delivered multiple times. +NONE: records are delivered on a best effort basis. + + + sink.flush-on-checkpoint optional diff --git a/docs/content/docs/connectors/table/elasticsearch.md b/docs/content/docs/connectors/table/elasticsearch.md index 7e5cf99..6956fda 100644 --- a/docs/content/docs/connectors/table/elasticsearch.md +++ b/docs/content/docs/connectors/table/elasticsearch.md @@ -154,6 +154,20 @@ Connector Options + + sink.delivery-guarantee + optional + no + AT_LEAST_ONCE + String + Optional delivery guarantee when committing. Valid values are: + +EXACTLY_ONCE: records are only delivered exactly-once also under failover scenarios. +AT_LEAST_ONCE: records are ensured to be delivered but it may happen that the same record is delivered multiple times. +NONE: records are delivered on a best effort basis. + + + sink.flush-on-checkpoint optional @@ -234,6 +248,30 @@ Connector Options String Prefix string to be added to every REST communication, e.g., '/v1'. + + connection.request-timeout + optional + yes + (none) + Duration + The timeout for requesting a connection from the connection manager. + + + connection.timeout + optional + yes + (none) + Duration + The timeout for establishing a connection. + + + socket.timeout + optional + yes + (none) + Duration + The socket timeout (SO_TIMEOUT) for waiting for data or, put differently, a maximum period inactivity between two consecutive data packets. + format optional
[flink-connector-elasticsearch] branch main updated: [FLINK-30352][docs] Document missing configuration properties
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-elasticsearch.git The following commit(s) were added to refs/heads/main by this push: new e205d90 [FLINK-30352][docs] Document missing configuration properties e205d90 is described below commit e205d907ce53b2bfa8e3152dfc1308d19311d347 Author: Andriy Redko AuthorDate: Mon Dec 12 11:06:26 2022 -0500 [FLINK-30352][docs] Document missing configuration properties --- .../docs/connectors/table/elasticsearch.md | 13 .../content/docs/connectors/table/elasticsearch.md | 38 ++ 2 files changed, 51 insertions(+) diff --git a/docs/content.zh/docs/connectors/table/elasticsearch.md b/docs/content.zh/docs/connectors/table/elasticsearch.md index 3395eda..e7e0552 100644 --- a/docs/content.zh/docs/connectors/table/elasticsearch.md +++ b/docs/content.zh/docs/connectors/table/elasticsearch.md @@ -143,6 +143,19 @@ CREATE TABLE myUserTable ( + + sink.delivery-guarantee + optional + AT_LEAST_ONCE + String + Optional delivery guarantee when committing. Valid values are: + +EXACTLY_ONCE: records are only delivered exactly-once also under failover scenarios. +AT_LEAST_ONCE: records are ensured to be delivered but it may happen that the same record is delivered multiple times. +NONE: records are delivered on a best effort basis. + + + sink.flush-on-checkpoint optional diff --git a/docs/content/docs/connectors/table/elasticsearch.md b/docs/content/docs/connectors/table/elasticsearch.md index 7e5cf99..6956fda 100644 --- a/docs/content/docs/connectors/table/elasticsearch.md +++ b/docs/content/docs/connectors/table/elasticsearch.md @@ -154,6 +154,20 @@ Connector Options + + sink.delivery-guarantee + optional + no + AT_LEAST_ONCE + String + Optional delivery guarantee when committing. Valid values are: + +EXACTLY_ONCE: records are only delivered exactly-once also under failover scenarios. +AT_LEAST_ONCE: records are ensured to be delivered but it may happen that the same record is delivered multiple times. +NONE: records are delivered on a best effort basis. + + + sink.flush-on-checkpoint optional @@ -234,6 +248,30 @@ Connector Options String Prefix string to be added to every REST communication, e.g., '/v1'. + + connection.request-timeout + optional + yes + (none) + Duration + The timeout for requesting a connection from the connection manager. + + + connection.timeout + optional + yes + (none) + Duration + The timeout for establishing a connection. + + + socket.timeout + optional + yes + (none) + Duration + The socket timeout (SO_TIMEOUT) for waiting for data or, put differently, a maximum period inactivity between two consecutive data packets. + format optional
[flink] branch master updated: [FLINK-29846][build] Upgrade ArchUnit to 1.0.0
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/flink.git The following commit(s) were added to refs/heads/master by this push: new ba6c0c7da89 [FLINK-29846][build] Upgrade ArchUnit to 1.0.0 ba6c0c7da89 is described below commit ba6c0c7da89746511c567bb12ff62b9315ecfd9b Author: Sergey Nuyanzin AuthorDate: Mon Dec 12 17:04:40 2022 +0100 [FLINK-29846][build] Upgrade ArchUnit to 1.0.0 --- .../flink/architecture/common/Conditions.java | 8 +- .../flink/architecture/common/Predicates.java | 25 ++ .../architecture/common/SourcePredicates.java | 2 +- .../5b9eed8a-5fb6-4373-98ac-3be2a71941b8 | 2 +- .../b8900323-6aab-4e7e-9b17-f53b3c3dca46 | 92 +++--- .../e5126cae-f3fe-48aa-b6fb-60ae6cc3fcd5 | 36 - .../architecture/rules/ApiAnnotationRules.java | 2 +- .../flink/architecture/rules/ITCaseRules.java | 5 ++ .../83371291-f688-4eaf-a207-24981f1067f3 | 3 - ...va => HadoopPathBasedPartFileWriterITCase.java} | 2 +- ...t.java => HadoopRenameCommitterHDFSITCase.java} | 4 +- ...ava => HadoopRenameCommitterLocalFSITCase.java} | 4 +- pom.xml| 2 +- 13 files changed, 89 insertions(+), 98 deletions(-) diff --git a/flink-architecture-tests/flink-architecture-tests-base/src/main/java/org/apache/flink/architecture/common/Conditions.java b/flink-architecture-tests/flink-architecture-tests-base/src/main/java/org/apache/flink/architecture/common/Conditions.java index d3da232d7de..53ac1ef8122 100644 --- a/flink-architecture-tests/flink-architecture-tests-base/src/main/java/org/apache/flink/architecture/common/Conditions.java +++ b/flink-architecture-tests/flink-architecture-tests-base/src/main/java/org/apache/flink/architecture/common/Conditions.java @@ -43,7 +43,7 @@ public class Conditions { return new ArchCondition(predicate.getDescription()) { @Override public void check(T item, ConditionEvents events) { -if (!predicate.apply(item)) { +if (!predicate.test(item)) { final String message = String.format( "%s does not satisfy: %s", @@ -89,7 +89,7 @@ public class Conditions { continue; } -if (!typePredicate.apply(leafType)) { +if (!typePredicate.test(leafType)) { final String message = String.format( "%s: Returned leaf type %s does not satisfy: %s", @@ -125,7 +125,7 @@ public class Conditions { continue; } -if (!typePredicate.apply(leafType)) { +if (!typePredicate.test(leafType)) { final String message = String.format( "%s: Argument leaf type %s does not satisfy: %s", @@ -161,7 +161,7 @@ public class Conditions { continue; } -if (!typePredicate.apply(leafType)) { +if (!typePredicate.test(leafType)) { final String message = String.format( "%s: Exception leaf type %s does not satisfy: %s", diff --git a/flink-architecture-tests/flink-architecture-tests-base/src/main/java/org/apache/flink/architecture/common/Predicates.java b/flink-architecture-tests/flink-architecture-tests-base/src/main/java/org/apache/flink/architecture/common/Predicates.java index d45cb56b5a3..1c5bd6de533 100644 --- a/flink-architecture-tests/flink-architecture-tests-base/src/main/java/org/apache/flink/architecture/common/Predicates.java +++ b/flink-architecture-tests/flink-architecture-tests-base/src/main/java/org/apache/flink/architecture/common/Predicates.java @@ -18,9 +18,7 @@ package org.apache.flink.architecture.common; -import com.tngtech.archunit.base.ChainableFunction; import com.tngtech.archunit.base.DescribedPredicate; -import com.tngtech.archunit.base.Function; import com.tngtech.archunit.core.domain.JavaClass; import com.tngtech.archunit.core.domain.JavaField; import com.tngtech.archunit.core.domain.JavaModifier; @@ -29,6 +27,7 @@ import com.tngtech.archunit.core.domain.properties.CanBeAnnotated; import java.lang.annotation.Annotation; import java.util.Arrays; import java.util.Set; +import java.util.function.Function; import java.util.stream.Collectors; import static com.tngtech.archunit.lang.conditions.ArchPredicates.is; @@ -48,7 +47,7 @@ public class Predicates { Class... annotat
[flink-connector-opensearch] branch main updated: [FLINK-25756][docs] Add documentation
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-opensearch.git The following commit(s) were added to refs/heads/main by this push: new 6407aab [FLINK-25756][docs] Add documentation 6407aab is described below commit 6407aabfe82a48002f301aee2bd3fc38fe52e035 Author: Andriy Redko AuthorDate: Mon Dec 12 08:06:17 2022 -0500 [FLINK-25756][docs] Add documentation --- .../docs/connectors/datastream/opensearch.md | 261 + .../content.zh/docs/connectors/table/opensearch.md | 308 + .../docs/connectors/datastream/opensearch.md | 261 + docs/content/docs/connectors/table/opensearch.md | 308 + .../table/OpensearchConnectorOptions.java | 2 +- 5 files changed, 1139 insertions(+), 1 deletion(-) diff --git a/docs/content.zh/docs/connectors/datastream/opensearch.md b/docs/content.zh/docs/connectors/datastream/opensearch.md new file mode 100644 index 000..cca9e4f --- /dev/null +++ b/docs/content.zh/docs/connectors/datastream/opensearch.md @@ -0,0 +1,261 @@ +--- +title: Opensearch +weight: 5 +type: docs +--- + + + +# Opensearch Connector + +This connector provides sinks that can request document actions to an +[Opensearch](https://opensearch.org/) Index. To use this connector, add +the following dependency to your project: + + + + + Opensearch version + Maven Dependency + + + + +1.x +{{< connector_artifact flink-connector-opensearch 1.0.0 >}} + + +2.x +{{< connector_artifact flink-connector-opensearch 1.0.0 >}} + + + + +Note that the streaming connectors are currently not part of the binary +distribution. See [here]({{< ref "docs/dev/configuration/overview" >}}) for information +about how to package the program with the libraries for cluster execution. + +## Installing Opensearch + +Instructions for setting up an Opensearch cluster can be found +[here](https://opensearch.org/docs/latest/opensearch/install/index/). + +## Opensearch Sink + +The example below shows how to configure and create a sink: + +{{< tabs "a1732edd-4218-470e-adad-b1ebb4021a12" >}} +{{< tab "Java" >}} + +```java +import org.apache.flink.api.common.functions.MapFunction; +import org.apache.flink.connector.opensearch.sink.OpensearchSinkBuilder; +import org.apache.flink.streaming.api.datastream.DataStream; + +import org.apache.http.HttpHost; +import org.opensearch.action.index.IndexRequest; +import org.opensearch.client.Requests; + +import java.util.HashMap; +import java.util.Map; + +DataStream input = ...; + +input.sinkTo( +new OpensearchSinkBuilder() +.setBulkFlushMaxActions(1) // Instructs the sink to emit after every element, otherwise they would be buffered +.setHosts(new HttpHost("127.0.0.1", 9200, "http")) +.setEmitter( +(element, context, indexer) -> +indexer.add(createIndexRequest(element))) +.build()); + +private static IndexRequest createIndexRequest(String element) { +Map json = new HashMap<>(); +json.put("data", element); + +return Requests.indexRequest() +.index("my-index") +.id(element) +.source(json); +} +``` +{{< /tab >}} +{{< tab "Scala" >}} +```scala +import org.apache.flink.api.connector.sink.SinkWriter +import org.apache.flink.connector.opensearch.sink.{OpensearchSinkBuilder, RequestIndexer} +import org.apache.flink.streaming.api.datastream.DataStream +import org.apache.http.HttpHost +import org.opensearch.action.index.IndexRequest +import org.opensearch.client.Requests + +val input: DataStream[String] = ... + +input.sinkTo( + new OpensearchSinkBuilder[String] +.setBulkFlushMaxActions(1) // Instructs the sink to emit after every element, otherwise they would be buffered +.setHosts(new HttpHost("127.0.0.1", 9200, "http")) +.setEmitter((element: String, context: SinkWriter.Context, indexer: RequestIndexer) => +indexer.add(createIndexRequest(element))) +.build()) + +def createIndexRequest(element: (String)): IndexRequest = { + + val json = Map( +"data" -> element.asInstanceOf[AnyRef] + ) + + Requests.indexRequest.index("my-index").source(mapAsJavaMap(json)) +} +``` + +{{< /tab >}} +{{< /tabs >}} + +Note that the example only demonstrates performing a single index +request for each incoming element. Generally, the `OpensearchEmitter` +can be used to perform requests of different types (ex., +`DeleteRequest`, `UpdateRequest`, etc.). + +Internally, each parallel instance of the Flink Opensearch Sink uses +a `BulkProcessor` to send action requests to the cluster. +This will buffer elements before sending them in bulk to
[flink-connector-hbase] branch v3.0 updated: [FLINK-30062][Connectors/HBase] Bundle the exact same dependencies as 1.16.0
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch v3.0 in repository https://gitbox.apache.org/repos/asf/flink-connector-hbase.git The following commit(s) were added to refs/heads/v3.0 by this push: new 8a33fbf [FLINK-30062][Connectors/HBase] Bundle the exact same dependencies as 1.16.0 8a33fbf is described below commit 8a33fbf53eaf8c245647f9b4595ec9c9ea8cc215 Author: Ferenc Csaky AuthorDate: Mon Dec 12 07:58:27 2022 -0500 [FLINK-30062][Connectors/HBase] Bundle the exact same dependencies as 1.16.0 --- .idea/vcs.xml | 3 +- flink-connector-hbase-1.4/pom.xml | 63 ++ flink-connector-hbase-2.2/pom.xml | 37 - flink-connector-hbase-base/pom.xml | 8 --- flink-sql-connector-hbase-2.2/pom.xml | 6 --- .../src/main/resources/META-INF/NOTICE | 2 +- pom.xml| 52 +- 7 files changed, 45 insertions(+), 126 deletions(-) diff --git a/.idea/vcs.xml b/.idea/vcs.xml index 10fab3b..a5d93d8 100644 --- a/.idea/vcs.xml +++ b/.idea/vcs.xml @@ -20,5 +20,6 @@ + - + \ No newline at end of file diff --git a/flink-connector-hbase-1.4/pom.xml b/flink-connector-hbase-1.4/pom.xml index 50694b8..04526f1 100644 --- a/flink-connector-hbase-1.4/pom.xml +++ b/flink-connector-hbase-1.4/pom.xml @@ -51,12 +51,6 @@ under the License. org.apache.flink flink-connector-hbase-base ${project.version} - - - commons-logging - commons-logging - - @@ -69,6 +63,11 @@ under the License. true + + io.netty + netty-all + + org.apache.flink @@ -225,22 +224,10 @@ under the License. commons-cli commons-cli - - commons-codec - commons-codec - - - commons-logging - commons-logging - org.apache.commons commons-compress - - commons-io - commons-io - @@ -283,18 +270,6 @@ under the License. commons-cli commons-cli - - commons-codec - commons-codec - - - commons-io - commons-io - - - commons-logging - commons-logging - @@ -319,10 +294,6 @@ under the License. com.google.guava guava - - commons-io - commons-io - org.apache.avro avro @@ -402,18 +373,6 @@ under the License. commons-cli commons-cli - - commons-codec - commons-codec - - - commons-io - commons-io - - - commons-logging - commons-logging
[flink-connector-hbase] branch main updated: [FLINK-30062][Connectors/HBase] Bundle the exact same dependencies as 1.16.0
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-hbase.git The following commit(s) were added to refs/heads/main by this push: new d74e518 [FLINK-30062][Connectors/HBase] Bundle the exact same dependencies as 1.16.0 d74e518 is described below commit d74e518aa000506bccbb5da4604c0814d5840ecb Author: Ferenc Csaky AuthorDate: Mon Dec 12 07:58:27 2022 -0500 [FLINK-30062][Connectors/HBase] Bundle the exact same dependencies as 1.16.0 --- .idea/vcs.xml | 3 +- flink-connector-hbase-1.4/pom.xml | 63 ++ flink-connector-hbase-2.2/pom.xml | 37 - flink-connector-hbase-base/pom.xml | 8 --- flink-sql-connector-hbase-2.2/pom.xml | 6 --- .../src/main/resources/META-INF/NOTICE | 2 +- pom.xml| 52 +- 7 files changed, 45 insertions(+), 126 deletions(-) diff --git a/.idea/vcs.xml b/.idea/vcs.xml index 10fab3b..a5d93d8 100644 --- a/.idea/vcs.xml +++ b/.idea/vcs.xml @@ -20,5 +20,6 @@ + - + \ No newline at end of file diff --git a/flink-connector-hbase-1.4/pom.xml b/flink-connector-hbase-1.4/pom.xml index 50694b8..04526f1 100644 --- a/flink-connector-hbase-1.4/pom.xml +++ b/flink-connector-hbase-1.4/pom.xml @@ -51,12 +51,6 @@ under the License. org.apache.flink flink-connector-hbase-base ${project.version} - - - commons-logging - commons-logging - - @@ -69,6 +63,11 @@ under the License. true + + io.netty + netty-all + + org.apache.flink @@ -225,22 +224,10 @@ under the License. commons-cli commons-cli - - commons-codec - commons-codec - - - commons-logging - commons-logging - org.apache.commons commons-compress - - commons-io - commons-io - @@ -283,18 +270,6 @@ under the License. commons-cli commons-cli - - commons-codec - commons-codec - - - commons-io - commons-io - - - commons-logging - commons-logging - @@ -319,10 +294,6 @@ under the License. com.google.guava guava - - commons-io - commons-io - org.apache.avro avro @@ -402,18 +373,6 @@ under the License. commons-cli commons-cli - - commons-codec - commons-codec - - - commons-io - commons-io - - - commons-logging - commons-logging
[flink-connector-elasticsearch] branch docs updated: +
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch docs in repository https://gitbox.apache.org/repos/asf/flink-connector-elasticsearch.git The following commit(s) were added to refs/heads/docs by this push: new f3b61d8 + f3b61d8 is described below commit f3b61d81372e2605a279d6baa6e943fae1b89e34 Author: Chesnay Schepler AuthorDate: Mon Dec 12 11:57:00 2022 +0100 + --- docs/content.zh/docs/connectors/table/elasticsearch.md | 2 +- docs/content/docs/connectors/table/elasticsearch.md| 2 +- docs/data/elasticsearch.yml| 4 ++-- 3 files changed, 4 insertions(+), 4 deletions(-) diff --git a/docs/content.zh/docs/connectors/table/elasticsearch.md b/docs/content.zh/docs/connectors/table/elasticsearch.md index 3395eda..c4d29cd 100644 --- a/docs/content.zh/docs/connectors/table/elasticsearch.md +++ b/docs/content.zh/docs/connectors/table/elasticsearch.md @@ -38,7 +38,7 @@ Elasticsearch 连接器允许将数据写入到 Elasticsearch 引擎的索引中 依赖 -{{< sql_download_table "elastic" >}} +{{< sql_connector_download_table "elasticsearch" 3.0.0 >}} Elasticsearch 连接器不是二进制发行版的一部分,请查阅[这里]({{< ref "docs/dev/configuration/overview" >}})了解如何在集群运行中引用 Elasticsearch 连接器。 diff --git a/docs/content/docs/connectors/table/elasticsearch.md b/docs/content/docs/connectors/table/elasticsearch.md index 7e5cf99..e3b4d00 100644 --- a/docs/content/docs/connectors/table/elasticsearch.md +++ b/docs/content/docs/connectors/table/elasticsearch.md @@ -38,7 +38,7 @@ If no primary key is defined on the DDL, the connector can only operate in appen Dependencies -{{< sql_download_table "elastic" >}} +{{< sql_connector_download_table "elasticsearch" 3.0.0 >}} The Elasticsearch connector is not part of the binary distribution. See how to link with it for cluster execution [here]({{< ref "docs/dev/configuration/overview" >}}). diff --git a/docs/data/elasticsearch.yml b/docs/data/elasticsearch.yml index 49da287..3296e3b 100644 --- a/docs/data/elasticsearch.yml +++ b/docs/data/elasticsearch.yml @@ -4,7 +4,7 @@ elasticsearch: versions: - version: 6.x maven: flink-connector-elasticsearch6 - sql_url: https://repo.maven.apache.org/maven2/org/apache/flink/flink-sql-connector-elasticsearch6/$version/flink-sql-connector-elasticsearch6-$version.jar + sql_url: https://repo.maven.apache.org/maven2/org/apache/flink/flink-sql-connector-elasticsearch6/$version-$flink/flink-sql-connector-elasticsearch6-$version-$flink.jar - version: 7.x and later versions maven: flink-connector-elasticsearch7 - sql_url: https://repo.maven.apache.org/maven2/org/apache/flink/flink-sql-connector-elasticsearch7/$version/flink-sql-connector-elasticsearch7-$version.jar + sql_url: https://repo.maven.apache.org/maven2/org/apache/flink/flink-sql-connector-elasticsearch7/$version-$flink/flink-sql-connector-elasticsearch7-$version-$flink.jar
[flink-connector-elasticsearch] branch docs created (now d079a23)
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a change to branch docs in repository https://gitbox.apache.org/repos/asf/flink-connector-elasticsearch.git at d079a23 try This branch includes the following new commits: new d079a23 try The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[flink-connector-elasticsearch] 01/01: try
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch docs in repository https://gitbox.apache.org/repos/asf/flink-connector-elasticsearch.git commit d079a2369cfa8ed7435b1a0f6cc83c4712d169e5 Author: Chesnay Schepler AuthorDate: Mon Dec 12 11:43:18 2022 +0100 try --- docs/data/elasticsearch.yml | 10 ++ 1 file changed, 10 insertions(+) diff --git a/docs/data/elasticsearch.yml b/docs/data/elasticsearch.yml new file mode 100644 index 000..49da287 --- /dev/null +++ b/docs/data/elasticsearch.yml @@ -0,0 +1,10 @@ +elasticsearch: + name: Elasticsearch + category: connector + versions: +- version: 6.x + maven: flink-connector-elasticsearch6 + sql_url: https://repo.maven.apache.org/maven2/org/apache/flink/flink-sql-connector-elasticsearch6/$version/flink-sql-connector-elasticsearch6-$version.jar +- version: 7.x and later versions + maven: flink-connector-elasticsearch7 + sql_url: https://repo.maven.apache.org/maven2/org/apache/flink/flink-sql-connector-elasticsearch7/$version/flink-sql-connector-elasticsearch7-$version.jar
[flink] branch master updated: [FLINK-30116][rest] Do not expose environment variables
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/flink.git The following commit(s) were added to refs/heads/master by this push: new cfc2ec84125 [FLINK-30116][rest] Do not expose environment variables cfc2ec84125 is described below commit cfc2ec841257eba37f49f6ed96ea8937a98bf535 Author: ConradJam AuthorDate: Mon Dec 12 18:06:22 2022 +0800 [FLINK-30116][rest] Do not expose environment variables --- .../shortcodes/generated/rest_v1_dispatcher.html | 2 +- docs/static/generated/rest_v1_dispatcher.yml | 2 +- .../runtime/rest/messages/EnvironmentInfo.java | 38 -- .../job/JobManagerJobEnvironmentHeaders.java | 2 +- 4 files changed, 3 insertions(+), 41 deletions(-) diff --git a/docs/layouts/shortcodes/generated/rest_v1_dispatcher.html b/docs/layouts/shortcodes/generated/rest_v1_dispatcher.html index fd3a2380cb2..b59b1b626c0 100644 --- a/docs/layouts/shortcodes/generated/rest_v1_dispatcher.html +++ b/docs/layouts/shortcodes/generated/rest_v1_dispatcher.html @@ -2684,7 +2684,7 @@ Using 'curl' you can upload a jar via 'curl -X POST -H "Expect:" -F "jarfile=@pa Response code: 200 OK - Returns the jobmanager's environment variables of a specific job. + Returns the jobmanager's environment of a specific job. Path parameters diff --git a/docs/static/generated/rest_v1_dispatcher.yml b/docs/static/generated/rest_v1_dispatcher.yml index 9d050c8c995..e368e7c6bf5 100644 --- a/docs/static/generated/rest_v1_dispatcher.yml +++ b/docs/static/generated/rest_v1_dispatcher.yml @@ -710,7 +710,7 @@ paths: $ref: '#/components/schemas/ConfigurationInfoEntry' /jobs/{jobid}/jobmanager/environment: get: - description: Returns the jobmanager's environment variables of a specific job. + description: Returns the jobmanager's environment of a specific job. operationId: getJobManagerJobEnvironment parameters: - name: jobid diff --git a/flink-runtime/src/main/java/org/apache/flink/runtime/rest/messages/EnvironmentInfo.java b/flink-runtime/src/main/java/org/apache/flink/runtime/rest/messages/EnvironmentInfo.java index a9af7f86a54..097ef4d0b43 100644 --- a/flink-runtime/src/main/java/org/apache/flink/runtime/rest/messages/EnvironmentInfo.java +++ b/flink-runtime/src/main/java/org/apache/flink/runtime/rest/messages/EnvironmentInfo.java @@ -70,44 +70,6 @@ public class EnvironmentInfo implements ResponseBody { JVMInfo.create(), Arrays.asList(System.getProperty("java.class.path").split(":"))); } -/** A single key-value pair entry in the {@link EnvironmentInfo} response. */ -private static class EnvironmentVariableItem { -private static final String FIELD_NAME_KEY = "key"; - -private static final String FIELD_NAME_VALUE = "value"; - -@JsonProperty(FIELD_NAME_KEY) -private final String key; - -@JsonProperty(FIELD_NAME_VALUE) -private final String value; - -@JsonCreator -public EnvironmentVariableItem( -@JsonProperty(FIELD_NAME_KEY) String key, -@JsonProperty(FIELD_NAME_VALUE) String value) { -this.key = key; -this.value = value; -} - -@Override -public boolean equals(Object o) { -if (this == o) { -return true; -} -if (o == null || getClass() != o.getClass()) { -return false; -} -EnvironmentVariableItem that = (EnvironmentVariableItem) o; -return key.equals(that.key) && value.equals(that.value); -} - -@Override -public int hashCode() { -return Objects.hash(key, value); -} -} - /** JVM information. */ private static class JVMInfo { private static final String FIELD_NAME_VERSION = "version"; diff --git a/flink-runtime/src/main/java/org/apache/flink/runtime/rest/messages/job/JobManagerJobEnvironmentHeaders.java b/flink-runtime/src/main/java/org/apache/flink/runtime/rest/messages/job/JobManagerJobEnvironmentHeaders.java index 256c1f6149c..a5e3e4846ed 100644 --- a/flink-runtime/src/main/java/org/apache/flink/runtime/rest/messages/job/JobManagerJobEnvironmentHeaders.java +++ b/flink-runtime/src/main/java/org/apache/flink/runtime/rest/messages/job/JobManagerJobEnvironmentHeaders.java @@ -75,6 +75,6 @@ public class JobManagerJobEnvironmentHeaders @Override public String getDescription() { -return "Returns the jobmanager's environment variables of a specific job."; +return "Returns the jobmanager's environment of a specific job."; } }
[flink] branch release-1.16 updated: [FLINK-30116][rest] Do not expose environment variables
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch release-1.16 in repository https://gitbox.apache.org/repos/asf/flink.git The following commit(s) were added to refs/heads/release-1.16 by this push: new cf027891b3a [FLINK-30116][rest] Do not expose environment variables cf027891b3a is described below commit cf027891b3ab51e8203af39e387f5badd4020a9b Author: ConradJam AuthorDate: Mon Dec 12 18:06:22 2022 +0800 [FLINK-30116][rest] Do not expose environment variables --- .../shortcodes/generated/rest_v1_dispatcher.html | 32 +-- docs/static/generated/rest_v1_dispatcher.yml | 13 + .../src/test/resources/rest_api_v1.snapshot| 30 -- .../runtime/rest/messages/EnvironmentInfo.java | 64 +- .../job/JobManagerJobEnvironmentHeaders.java | 2 +- 5 files changed, 6 insertions(+), 135 deletions(-) diff --git a/docs/layouts/shortcodes/generated/rest_v1_dispatcher.html b/docs/layouts/shortcodes/generated/rest_v1_dispatcher.html index 050d3750d8e..d96cee05d24 100644 --- a/docs/layouts/shortcodes/generated/rest_v1_dispatcher.html +++ b/docs/layouts/shortcodes/generated/rest_v1_dispatcher.html @@ -929,21 +929,6 @@ Using 'curl' you can upload a jar via 'curl -X POST -H "Expect:" -F "jarfile=@pa "type" : "string" } }, -"environment" : { - "type" : "array", - "items" : { -"type" : "object", -"id" : "urn:jsonschema:org:apache:flink:runtime:rest:messages:EnvironmentInfo:EnvironmentVariableItem", -"properties" : { - "key" : { -"type" : "string" - }, - "value" : { -"type" : "string" - } -} - } -}, "jvm" : { "type" : "object", "id" : "urn:jsonschema:org:apache:flink:runtime:rest:messages:EnvironmentInfo:JVMInfo", @@ -3110,7 +3095,7 @@ Using 'curl' you can upload a jar via 'curl -X POST -H "Expect:" -F "jarfile=@pa Response code: 200 OK - Returns the jobmanager's environment variables of a specific job. + Returns the jobmanager's environment of a specific job. Path parameters @@ -3163,21 +3148,6 @@ Using 'curl' you can upload a jar via 'curl -X POST -H "Expect:" -F "jarfile=@pa "type" : "string" } }, -"environment" : { - "type" : "array", - "items" : { -"type" : "object", -"id" : "urn:jsonschema:org:apache:flink:runtime:rest:messages:EnvironmentInfo:EnvironmentVariableItem", -"properties" : { - "key" : { -"type" : "string" - }, - "value" : { -"type" : "string" - } -} - } -}, "jvm" : { "type" : "object", "id" : "urn:jsonschema:org:apache:flink:runtime:rest:messages:EnvironmentInfo:JVMInfo", diff --git a/docs/static/generated/rest_v1_dispatcher.yml b/docs/static/generated/rest_v1_dispatcher.yml index e0c7855c589..b2500ee831b 100644 --- a/docs/static/generated/rest_v1_dispatcher.yml +++ b/docs/static/generated/rest_v1_dispatcher.yml @@ -664,7 +664,7 @@ paths: $ref: '#/components/schemas/ConfigurationInfoEntry' /jobs/{jobid}/jobmanager/environment: get: - description: Returns the jobmanager's environment variables of a specific job. + description: Returns the jobmanager's environment of a specific job. operationId: getJobManagerJobEnvironment parameters: - name: jobid @@ -3041,10 +3041,6 @@ components: EnvironmentInfo: type: object properties: -environment: - type: array - items: -$ref: '#/components/schemas/EnvironmentVariableItem' jvm: $ref: '#/components/schemas/JVMInfo' classpath: @@ -3078,13 +3074,6 @@ components: type: string value: type: string -EnvironmentVariableItem: - type: object - properties: -key: - type: string -value: - type: string TriggerResponse: type: object properties: diff --git a/flink-runtime-web/src/test/resources/rest_api_v1.snapshot b/flink-runtime-web/src/test/resources/rest_api_v1.snapshot index b13156998af..4258dab16ce 100644 --- a/flink-runtime-web/src/test/resources/rest_api_v1.snapshot +++ b/flink-runtime-web/src/test/resources/rest_api_v1.snapshot @@ -501,21 +501,6 @@ &quo
[flink] branch master updated: [FLINK-30116][rest] Do not expose environment variables
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/flink.git The following commit(s) were added to refs/heads/master by this push: new 842ef5d2e82 [FLINK-30116][rest] Do not expose environment variables 842ef5d2e82 is described below commit 842ef5d2e820dcaf666410f67c855167a922c9cf Author: ConradJam AuthorDate: Mon Dec 12 18:06:22 2022 +0800 [FLINK-30116][rest] Do not expose environment variables --- .../shortcodes/generated/rest_v1_dispatcher.html | 42 +++--- docs/static/generated/rest_v1_dispatcher.yml | 13 ++- .../src/test/resources/rest_api_v1.snapshot| 30 .../runtime/rest/messages/EnvironmentInfo.java | 26 ++ 4 files changed, 17 insertions(+), 94 deletions(-) diff --git a/docs/layouts/shortcodes/generated/rest_v1_dispatcher.html b/docs/layouts/shortcodes/generated/rest_v1_dispatcher.html index e06d8f4b5bc..fd3a2380cb2 100644 --- a/docs/layouts/shortcodes/generated/rest_v1_dispatcher.html +++ b/docs/layouts/shortcodes/generated/rest_v1_dispatcher.html @@ -704,21 +704,6 @@ Using 'curl' you can upload a jar via 'curl -X POST -H "Expect:" -F "jarfile=@pa "type" : "string" } }, -"environment" : { - "type" : "array", - "items" : { -"type" : "object", -"id" : "urn:jsonschema:org:apache:flink:runtime:rest:messages:EnvironmentInfo:EnvironmentVariableItem", -"properties" : { - "key" : { -"type" : "string" - }, - "value" : { -"type" : "string" - } -} - } -}, "jvm" : { "type" : "object", "id" : "urn:jsonschema:org:apache:flink:runtime:rest:messages:EnvironmentInfo:JVMInfo", @@ -1547,6 +1532,9 @@ Using 'curl' you can upload a jar via 'curl -X POST -H "Expect:" -F "jarfile=@pa "processed_data" : { "type" : "integer" }, + "savepointFormat" : { +"type" : "string" + }, "state_size" : { "type" : "integer" }, @@ -1615,6 +1603,9 @@ Using 'curl' you can upload a jar via 'curl -X POST -H "Expect:" -F "jarfile=@pa "processed_data" : { "type" : "integer" }, +"savepointFormat" : { + "type" : "string" +}, "state_size" : { "type" : "integer" }, @@ -1714,6 +1705,9 @@ Using 'curl' you can upload a jar via 'curl -X POST -H "Expect:" -F "jarfile=@pa "processed_data" : { "type" : "integer" }, +"savepointFormat" : { + "type" : "string" +}, "state_size" : { "type" : "integer" }, @@ -2058,6 +2052,9 @@ Using 'curl' you can upload a jar via 'curl -X POST -H "Expect:" -F "jarfile=@pa "processed_data" : { "type" : "integer" }, +"savepointFormat" : { + "type" : "string" +}, "state_size" : { "type" : "integer" }, @@ -2723,21 +2720,6 @@ Using 'curl' you can upload a jar via 'curl -X POST -H "Expect:" -F "jarfile=@pa "type" : "string" } }, -"environment" : { - "type" : "array", - "items" : { -"type" : "object", -"id" : "urn:jsonschema:org:apache:flink:runtime:rest:messages:EnvironmentInfo:EnvironmentVariableItem", -"properties" : { - "key" : { -"type" : "string" - }, - "value" : { -"type" : "string" - } -} - } -}, "jvm" : { "type" : "object", "id" : "urn:jsonschema:org:apache:flink:runtime:rest:messages:EnvironmentInfo:JVMInfo", diff --git a/docs/static/generated/rest_v1_dispatcher.yml b/docs/static/generated/rest_v1_dispatcher.yml index 786856f5ed6..9d050c8c995 100644 --- a/docs/static/generated/rest_v1_dispatcher.yml +++ b/docs/static/generated/rest_v1_dispatcher.yml @@ -1719
[flink-connector-rabbitmq] branch main updated (276d04b -> b299fa1)
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-rabbitmq.git from 276d04b [hotfix] Sync CI setup add b299fa1 [hotfix][ci] Fail on architecture tests store update No new revisions were added by this update. Summary of changes: .github/workflows/ci.yml | 1 + 1 file changed, 1 insertion(+)
[flink-docker] branch dev-1.15 updated: Add GPG key for 1.15.3 release
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch dev-1.15 in repository https://gitbox.apache.org/repos/asf/flink-docker.git The following commit(s) were added to refs/heads/dev-1.15 by this push: new c01eac6 Add GPG key for 1.15.3 release c01eac6 is described below commit c01eac63491c5521308ed4b33116db6f71a7869c Author: Fabian Paul AuthorDate: Mon Dec 5 09:32:16 2022 +0100 Add GPG key for 1.15.3 release --- add-version.sh | 2 ++ 1 file changed, 2 insertions(+) diff --git a/add-version.sh b/add-version.sh index 8c8bd37..185cf59 100755 --- a/add-version.sh +++ b/add-version.sh @@ -100,6 +100,8 @@ elif [ "$flink_version" = "1.15.1" ]; then gpg_key="7D660377995CA7A5AFEBA79A3EE012FEE982F098" elif [ "$flink_version" = "1.15.2" ]; then gpg_key="0F79F2AFB2351BC29678544591F9C1EC125FD8DB" +elif [ "$flink_version" = "1.15.3" ]; then +gpg_key="90755B0A184BD9FFD22B6BE19D4F76C84EC11E37" else error "Missing GPG key ID for this release" fi
[flink] branch master updated (e6215d4f7ed -> d86ae5d642f)
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git from e6215d4f7ed [FLINK-29732][sql-gateway] Support to configureSession in the SqlGatewayService add d86ae5d642f [hotfix] Remove cassandra checkstyle suppression No new revisions were added by this update. Summary of changes: tools/maven/suppressions.xml | 4 1 file changed, 4 deletions(-)
[flink] branch master updated (12cb2212f78 -> a798e52ab41)
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git from 12cb2212f78 [FLINK-30312][cassandra] Remove Cassandra connector add 28aaa4b80c5 [FLINK-30286][ci] Skip rat-plugin for javadocs add a798e52ab41 [FLINK-30286][build] Run rat-plugin in validate phase No new revisions were added by this update. Summary of changes: pom.xml | 2 +- tools/ci/compile.sh | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-)
[flink] 01/02: [hotfix][python] Depend on externalized ES connector
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/flink.git commit 7bb75ab6d9603713c8a3e20295e3d1f551816603 Author: Chesnay Schepler AuthorDate: Tue Dec 6 11:32:20 2022 +0100 [hotfix][python] Depend on externalized ES connector --- flink-python/pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/flink-python/pom.xml b/flink-python/pom.xml index 7ac4959ff94..90f5217d42a 100644 --- a/flink-python/pom.xml +++ b/flink-python/pom.xml @@ -282,7 +282,7 @@ under the License. org.apache.flink flink-sql-connector-elasticsearch7 - 1.16.0 + 3.0.0-1.16 test
[flink] branch master updated (4c67f8fca52 -> 12cb2212f78)
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git from 4c67f8fca52 [FLINK-30189][runtime] HsSubpartitionFileReader may load data that has been consumed from memory new 7bb75ab6d96 [hotfix][python] Depend on externalized ES connector new 12cb2212f78 [FLINK-30312][cassandra] Remove Cassandra connector The 2 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../docs/connectors/datastream/cassandra.md| 288 --- .../docs/connectors/datastream/cassandra.md| 288 --- docs/setup_docs.sh | 1 + .../5b9eed8a-5fb6-4373-98ac-3be2a71941b8 | 4 +- .../b8900323-6aab-4e7e-9b17-f53b3c3dca46 | 3 - .../flink-architecture-tests-production/pom.xml| 5 - flink-architecture-tests/pom.xml | 7 - .../b7279bb1-1eb7-40c0-931d-f6db7971d126 | 0 .../dc1ba6f4-3d84-498c-a085-e02ba5936201 | 6 - .../archunit-violations/stored.rules | 4 - flink-connectors/flink-connector-cassandra/pom.xml | 218 - .../CassandraColumnarOutputFormatBase.java | 68 -- .../connectors/cassandra/CassandraInputFormat.java | 68 -- .../cassandra/CassandraInputFormatBase.java| 102 --- .../cassandra/CassandraOutputFormat.java | 35 - .../cassandra/CassandraOutputFormatBase.java | 129 --- .../cassandra/CassandraPojoInputFormat.java| 81 -- .../cassandra/CassandraPojoOutputFormat.java | 97 --- .../cassandra/CassandraRowOutputFormat.java| 52 -- .../cassandra/CassandraTupleOutputFormat.java | 54 -- .../cassandra/AbstractCassandraTupleSink.java | 72 -- .../cassandra/CassandraAppendTableSink.java| 103 --- .../connectors/cassandra/CassandraCommitter.java | 160 .../cassandra/CassandraFailureHandler.java | 62 -- .../connectors/cassandra/CassandraPojoSink.java| 125 --- .../connectors/cassandra/CassandraRowSink.java | 60 -- .../cassandra/CassandraRowWriteAheadSink.java | 170 .../cassandra/CassandraScalaProductSink.java | 55 -- .../connectors/cassandra/CassandraSink.java| 663 --- .../connectors/cassandra/CassandraSinkBase.java| 194 - .../cassandra/CassandraSinkBaseConfig.java | 125 --- .../connectors/cassandra/CassandraTupleSink.java | 53 -- .../cassandra/CassandraTupleWriteAheadSink.java| 170 .../connectors/cassandra/ClusterBuilder.java | 43 - .../connectors/cassandra/MapperOptions.java| 37 - .../cassandra/NoOpCassandraFailureHandler.java | 35 - .../connectors/cassandra/SimpleMapperOptions.java | 121 --- .../src/main/resources/META-INF/NOTICE | 11 - .../architecture/TestCodeArchitectureTest.java | 43 - .../connectors/cassandra/example/BatchExample.java | 88 -- .../cassandra/example/BatchPojoExample.java| 93 --- .../batch/connectors/cassandra/example/Pojo.java | 72 -- .../cassandra/utils/ResultSetFutures.java | 103 --- .../cassandra/CassandraConnectorITCase.java| 912 - .../cassandra/CassandraSinkBaseTest.java | 453 -- .../CassandraTupleWriteAheadSinkTest.java | 150 .../flink/streaming/connectors/cassandra/Pojo.java | 70 -- .../example/CassandraPojoSinkExample.java | 68 -- .../example/CassandraTupleSinkExample.java | 68 -- .../CassandraTupleWriteAheadSinkExample.java | 118 --- .../connectors/cassandra/example/Message.java | 62 -- .../org.junit.jupiter.api.extension.Extension | 16 - .../src/test/resources/archunit.properties | 31 - .../src/test/resources/log4j2-test.properties | 28 - flink-connectors/pom.xml | 1 - flink-python/pom.xml | 4 +- .../org/apache/flink/util/DockerImageVersions.java | 2 - tools/azure-pipelines/cache_docker_images.sh | 2 +- tools/ci/stage.sh | 1 - 59 files changed, 5 insertions(+), 6149 deletions(-) delete mode 100644 docs/content.zh/docs/connectors/datastream/cassandra.md delete mode 100644 docs/content/docs/connectors/datastream/cassandra.md delete mode 100644 flink-connectors/flink-connector-cassandra/archunit-violations/b7279bb1-1eb7-40c0-931d-f6db7971d126 delete mode 100644 flink-connectors/flink-connector-cassandra/archunit-violations/dc1ba6f4-3d84-498c-a085-e02ba5936201 delete mode 100644 flink-connectors/flink-connector-cassandra/archunit-violations/stored.rules delete mode 100644 flink-connectors/flink-connector-cassandra/pom.xml delete mode 1006
[flink] branch master updated (576c312d373 -> c6e824c955b)
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git from 576c312d373 [FLINK-29420][build] Upgrade Zookeeper to 3.7.1 add c6e824c955b [hotfix] Remove out-dated comment No new revisions were added by this update. Summary of changes: docs/setup_docs.sh | 2 -- 1 file changed, 2 deletions(-)
[flink-web] branch asf-site updated: Rebuild website
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/flink-web.git The following commit(s) were added to refs/heads/asf-site by this push: new 45ec46e09 Rebuild website 45ec46e09 is described below commit 45ec46e09ff55499687d75778a3673a046fd728d Author: Chesnay Schepler AuthorDate: Tue Dec 6 11:05:55 2022 +0100 Rebuild website --- content/downloads.html| 19 +++ content/zh/downloads.html | 19 +++ 2 files changed, 38 insertions(+) diff --git a/content/downloads.html b/content/downloads.html index 9131cd208..374ad6894 100644 --- a/content/downloads.html +++ b/content/downloads.html @@ -245,6 +245,7 @@ Flink connectors Apache Flink Elasticsearch Connector 3.0.0 Apache Flink AWS Connectors 3.0.0 + Apache Flink Cassandra Connector 3.0.0 Apache Flink Stateful Functions 3.2.0 @@ -349,6 +350,19 @@ +Apache Flink Cassandra Connector 3.0.0 + + +https://www.apache.org/dyn/closer.lua/flink/flink-connector-cassandra-3.0.0/flink-connector-cassandra-3.0.0-src.tgz; id="300-cassandra-connector-download-source">Apache Flink Cassandra Connector 3.0.0 Source Release +(https://downloads.apache.org/flink/flink-connector-cassandra-3.0.0/flink-connector-cassandra-3.0.0-src.tgz.asc;>asc, https://downloads.apache.org/flink/flink-connector-cassandra-3.0.0/flink-connector-cassandra-3.0.0-src.tgz.sha512;>sha512) + + +This connector is compatible with these Apache Flink versions: + + + 1.16.x + + Apache Flink® Stateful Functions 3.2.0 is the latest stable release for the https://flink.apache.org/stateful-functions.html;>Stateful Functions component. @@ -1524,6 +1538,11 @@ Flink AWS Connectors 3.0.0 - 2022-11-28 (https://archive.apache.org/dist/flink/flink-connector-$-3.0.0/flink-connector-$-3.0.0-src.tgz;>Source) + +Flink Cassandra Connector 3.0.0 - 2022-11-30 +(https://archive.apache.org/dist/flink/flink-connector-$-3.0.0/flink-connector-$-3.0.0-src.tgz;>Source) + + Flink-StateFun diff --git a/content/zh/downloads.html b/content/zh/downloads.html index 885f29221..c0638f50d 100644 --- a/content/zh/downloads.html +++ b/content/zh/downloads.html @@ -243,6 +243,7 @@ Flink connectors Apache Flink Elasticsearch Connector 3.0.0 Apache Flink AWS Connectors 3.0.0 + Apache Flink Cassandra Connector 3.0.0 Apache Flink Stateful Functions 3.2.0 @@ -346,6 +347,19 @@ flink-docs-release-1.15/release-notes/flink-1.15.html">Flink 1.15 的发布说 +Apache Flink Cassandra Connector 3.0.0 + + +https://www.apache.org/dyn/closer.lua/flink/flink-connector-cassandra-3.0.0/flink-connector-cassandra-3.0.0-src.tgz; id="300-cassandra-connector-download-source">Apache Flink Cassandra Connector 3.0.0 Source Release +(https://downloads.apache.org/flink/flink-connector-cassandra-3.0.0/flink-connector-cassandra-3.0.0-src.tgz.asc;>asc, https://downloads.apache.org/flink/flink-connector-cassandra-3.0.0/flink-connector-cassandra-3.0.0-src.tgz.sha512;>sha512) + + +This connector is compatible with these Apache Flink versions: + + + 1.16.x + + Apache Flink® Stateful Functions 3.2.0 是 https://flink.apache.org/stateful-functions.html;>Stateful Functions 组件的最新稳定版本. @@ -1475,6 +1489,11 @@ Flink AWS Connectors 3.0.0 - 2022-11-28 (https://archive.apache.org/dist/flink/flink-connector-$-3.0.0/flink-connector-$-3.0.0-src.tgz;>Source) + +Flink Cassandra Connector 3.0.0 - 2022-11-30 +(https://archive.apache.org/dist/flink/flink-connector-$-3.0.0/flink-connector-$-3.0.0-src.tgz;>Source) + + Flink-shaded
[flink-web] branch asf-site updated: Add Cassandra connector 3.0.0
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/flink-web.git The following commit(s) were added to refs/heads/asf-site by this push: new c032a25c3 Add Cassandra connector 3.0.0 c032a25c3 is described below commit c032a25c3d2af1c38db58c3a7947eaef642a0fc2 Author: Chesnay Schepler AuthorDate: Fri Nov 25 10:29:56 2022 +0100 Add Cassandra connector 3.0.0 --- _config.yml | 13 + 1 file changed, 13 insertions(+) diff --git a/_config.yml b/_config.yml index 28182c00b..2fe52574f 100644 --- a/_config.yml +++ b/_config.yml @@ -125,6 +125,15 @@ connector_releases: url: "https://www.apache.org/dyn/closer.lua/flink/flink-connector-aws-3.0.0/flink-connector-aws-3.0.0-src.tgz; asc_url: "https://downloads.apache.org/flink/flink-connector-aws-3.0.0/flink-connector-aws-3.0.0-src.tgz.asc; sha512_url: "https://downloads.apache.org/flink/flink-connector-aws-3.0.0/flink-connector-aws-3.0.0-src.tgz.sha512; + - version: "3.0.0" +source_release: + name: "Apache Flink Cassandra Connector 3.0.0" + id: "300-cassandra-connector-download-source" + flink_versions: +- "1.16" + url: "https://www.apache.org/dyn/closer.lua/flink/flink-connector-cassandra-3.0.0/flink-connector-cassandra-3.0.0-src.tgz; + asc_url: "https://downloads.apache.org/flink/flink-connector-cassandra-3.0.0/flink-connector-cassandra-3.0.0-src.tgz.asc; + sha512_url: "https://downloads.apache.org/flink/flink-connector-cassandra-3.0.0/flink-connector-cassandra-3.0.0-src.tgz.sha512; flink_statefun_releases: @@ -646,6 +655,10 @@ release_archive: connector: "aws" version: 3.0.0 release_date: 2022-11-28 + - name: "Flink Cassandra Connector" +connector: "cassandra" +version: 3.0.0 +release_date: 2022-11-30 flink_shaded: -
[flink] branch master updated (95be1e5abfe -> 576c312d373)
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git from 95be1e5abfe [FLINK-30239][rest] Fix the bug that FlameGraph cannot be generated due to using ImmutableSet incorrectly add 576c312d373 [FLINK-29420][build] Upgrade Zookeeper to 3.7.1 No new revisions were added by this update. Summary of changes: .../testframe/container/FlinkTestcontainersConfigurator.java | 2 +- pom.xml | 4 ++-- 2 files changed, 3 insertions(+), 3 deletions(-)
[flink] branch master updated: [FLINK-30202][core] Force first call to go through isAvailable()
This is an automated email from the ASF dual-hosted git repository. chesnay pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/flink.git The following commit(s) were added to refs/heads/master by this push: new 81ed6c649e1 [FLINK-30202][core] Force first call to go through isAvailable() 81ed6c649e1 is described below commit 81ed6c649e1a219c457628c54a7165d75b803474 Author: Chesnay Schepler AuthorDate: Sun Dec 4 21:32:30 2022 +0100 [FLINK-30202][core] Force first call to go through isAvailable() Capturing the checkpointId for a generated record is impossible since the notifyCheckpointComplete notification may arrive at any time (or not at all). Instead just assert that each subtask got exactly as many records as expected, which can only happen (reliably) if the rate-limiting works as expected. - the test was never calling isAvailable(), relying on the previous (bugged) behavior of rate-limiting not being enforced - The loop was difficult to understand in terms of how many records are actually being processed and was refactored accordingly - use 0-383 to make off-by-one error obvious (the splits included 385 values, not 384) - assert that we reach END_OF_INPUT - correctly assert all 384 elements --- .../datagen/source/DataGeneratorSourceITCase.java | 60 + .../datagen/source/DataGeneratorSourceTest.java| 62 +++--- .../util/ratelimit/RateLimitedSourceReader.java| 4 ++ 3 files changed, 73 insertions(+), 53 deletions(-) diff --git a/flink-connectors/flink-connector-datagen/src/test/java/org/apache/flink/connector/datagen/source/DataGeneratorSourceITCase.java b/flink-connectors/flink-connector-datagen/src/test/java/org/apache/flink/connector/datagen/source/DataGeneratorSourceITCase.java index 76f5eca8494..842982ac584 100644 --- a/flink-connectors/flink-connector-datagen/src/test/java/org/apache/flink/connector/datagen/source/DataGeneratorSourceITCase.java +++ b/flink-connectors/flink-connector-datagen/src/test/java/org/apache/flink/connector/datagen/source/DataGeneratorSourceITCase.java @@ -19,18 +19,19 @@ package org.apache.flink.connector.datagen.source; import org.apache.flink.api.common.eventtime.WatermarkStrategy; -import org.apache.flink.api.common.functions.RichMapFunction; -import org.apache.flink.api.common.state.CheckpointListener; +import org.apache.flink.api.common.functions.FlatMapFunction; import org.apache.flink.api.common.typeinfo.Types; import org.apache.flink.api.connector.source.SourceReaderContext; import org.apache.flink.api.connector.source.util.ratelimit.RateLimiterStrategy; -import org.apache.flink.api.java.tuple.Tuple2; -import org.apache.flink.configuration.Configuration; +import org.apache.flink.runtime.state.FunctionInitializationContext; +import org.apache.flink.runtime.state.FunctionSnapshotContext; import org.apache.flink.runtime.testutils.MiniClusterResourceConfiguration; +import org.apache.flink.streaming.api.checkpoint.CheckpointedFunction; import org.apache.flink.streaming.api.datastream.DataStream; import org.apache.flink.streaming.api.datastream.DataStreamSource; import org.apache.flink.streaming.api.environment.StreamExecutionEnvironment; import org.apache.flink.test.junit5.MiniClusterExtension; +import org.apache.flink.util.Collector; import org.apache.flink.util.TestLogger; import org.junit.jupiter.api.Disabled; @@ -39,11 +40,9 @@ import org.junit.jupiter.api.Test; import org.junit.jupiter.api.extension.RegisterExtension; import java.util.List; -import java.util.Map; import java.util.stream.Collectors; import java.util.stream.LongStream; -import static java.util.stream.Collectors.summingInt; import static org.apache.flink.core.testutils.FlinkAssertions.anyCauseMatches; import static org.assertj.core.api.Assertions.assertThat; import static org.assertj.core.api.AssertionsForClassTypes.assertThatThrownBy; @@ -178,57 +177,48 @@ class DataGeneratorSourceITCase extends TestLogger { env.setParallelism(PARALLELISM); -int capacityPerSubtaskPerCycle = 2; -int capacityPerCycle = // avoid rounding errors when spreading records among subtasks -PARALLELISM * capacityPerSubtaskPerCycle; +int capacityPerSubtaskPerCheckpoint = 2; +int capacityPerCheckpoint = // avoid rounding errors when spreading records among subtasks +PARALLELISM * capacityPerSubtaskPerCheckpoint; final GeneratorFunction generatorFunction = index -> 1L; -// Allow each subtask to produce at least 3 cycles, gated by checkpoints -int count = capacityPerCycle * 3; +// produce slightly more elements than the checkpoint-rate-limit would allow +int count = capacityPerCheckpoint + 1; final DataGeneratorSource generatorSource = new DataGeneratorSource<>( generato