(flink) branch master updated (4a852fee28f -> 793a66b9c6a)
This is an automated email from the ASF dual-hosted git repository. pnowojski pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/flink.git from 4a852fee28f [FLINK-33935][checkpoint] Improve the default value logic related to `state.backend.type` add 11220872d4a [hotfix] Get rid of Mockito in testCheckpointStatsTrackerRestoreCallback add 74a36b1f729 [hotfix] Remove unused local variable add 56b18a2bfa7 [FLINK-33775][checkpointing] Add checkpoint state size to RestoredCheckpointStats add ad17c2de770 [FLINK-33775][metrics] Introduce SubTaskInitializationMetrics pojo add 16bac780228 [FLINK-33775][checkpointing][metrics] Report SubTask initialization metrics to CheckpointCoordinator add 4dd3ec9cc64 [FLINK-33775][checkpointing][metrics] Aggregate subtask initialization metrics and report trace add 0294d764b21 [FLINK-33775][task][metrics] Calculate SubTaskInitializationMetrics in StreamTask add 793a66b9c6a [FLINK-33775][metrics][docs] Document JobInitialization trace No new revisions were added by this update. Summary of changes: docs/content.zh/docs/ops/traces.md | 43 +- docs/content/docs/ops/traces.md| 39 +- .../api/runtime/SavepointTaskStateManager.java | 5 + .../runtime/checkpoint/CheckpointCoordinator.java | 31 +++-- .../checkpoint/CheckpointCoordinatorGateway.java | 3 + .../runtime/checkpoint/CheckpointStatsTracker.java | 124 ++--- .../runtime/checkpoint/InitializationStatus.java | 13 +- .../checkpoint/JobInitializationMetrics.java | 147 + .../JobInitializationMetricsBuilder.java | 142 .../checkpoint/RestoredCheckpointStats.java| 52 +++- .../checkpoint/SubTaskInitializationMetrics.java | 108 +++ .../SubTaskInitializationMetricsBuilder.java | 68 ++ .../executiongraph/DefaultExecutionGraph.java | 8 +- .../DefaultExecutionGraphBuilder.java | 1 - .../runtime/executiongraph/ExecutionGraph.java | 3 + .../apache/flink/runtime/jobmaster/JobMaster.java | 7 + .../apache/flink/runtime/metrics/MetricNames.java | 5 + .../scheduler/DefaultExecutionGraphFactory.java| 17 ++- .../runtime/scheduler/ExecutionGraphHandler.java | 22 ++- .../flink/runtime/scheduler/SchedulerBase.java | 7 + .../flink/runtime/scheduler/SchedulerNG.java | 4 + .../scheduler/adaptive/AdaptiveScheduler.java | 11 ++ .../adaptive/StateWithExecutionGraph.java | 5 + .../flink/runtime/state/TaskStateManager.java | 3 + .../flink/runtime/state/TaskStateManagerImpl.java | 7 + .../taskexecutor/rpc/RpcCheckpointResponder.java | 7 + .../runtime/taskmanager/CheckpointResponder.java | 4 + .../checkpoint/CheckpointCoordinatorTest.java | 10 +- .../checkpoint/CheckpointStatsSnapshotTest.java| 3 +- .../checkpoint/CheckpointStatsTrackerTest.java | 103 ++- .../DefaultSchedulerCheckpointCoordinatorTest.java | 1 + .../checkpoint/JobInitializationMetricsTest.java | 116 .../checkpoint/RestoredCheckpointStatsTest.java| 4 +- .../SubTaskInitializationMetricsTest.java | 59 + .../jobmaster/utils/TestingJobMasterGateway.java | 5 + .../DefaultExecutionGraphFactoryTest.java | 82 +++- .../runtime/scheduler/TestingSchedulerNG.java | 5 + .../adaptive/StateTrackingMockExecutionGraph.java | 6 + .../flink/runtime/state/TestTaskStateManager.java | 13 +- .../taskmanager/NoOpCheckpointResponder.java | 5 + .../taskmanager/TestCheckpointResponder.java | 5 + .../streaming/state/RocksDBAsyncSnapshotTest.java | 5 + .../flink/streaming/runtime/tasks/StreamTask.java | 101 +- .../streaming/runtime/tasks/StreamTaskTest.java| 17 +++ .../tasks/TaskCheckpointingBehaviourTest.java | 5 + .../util/CompletingCheckpointResponder.java| 5 + 46 files changed, 1336 insertions(+), 100 deletions(-) copy flink-core/src/test/java/org/apache/flink/api/common/typeutils/base/TestEnum.java => flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/InitializationStatus.java (84%) create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/JobInitializationMetrics.java create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/JobInitializationMetricsBuilder.java create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/SubTaskInitializationMetrics.java create mode 100644 flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/SubTaskInitializationMetricsBuilder.java create mode 100644 flink-runtime/src/test/java/org/apache/flink/runtime/checkpoint/JobInitializationMetricsTest.java create mode 100644
(flink-connector-hbase) annotated tag v3.0.1-rc1 updated (b968737 -> 2129704)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to annotated tag v3.0.1-rc1 in repository https://gitbox.apache.org/repos/asf/flink-connector-hbase.git *** WARNING: tag v3.0.1-rc1 was modified! *** from b968737 (commit) to 2129704 (tag) tagging b9687379e14644ebe4e21e6a3853187c47e2bed9 (commit) by Martijn Visser on Fri Jan 5 15:48:26 2024 +0100 - Log - v3.0.1-rc1 -BEGIN PGP SIGNATURE- iHUEABYKAB0WIQSl87zky+mTVz7FlmplMhuDgrIZrwUCZZgWugAKCRBlMhuDgrIZ r8ECAQCFivJDQkcNgdl80R5ar5DTxcweLZsK6fKv49cnI6Bu2gEAwwvuQVGD03kf 8kwmUm/z8c2Ztf9HZ78Qt1t6Z/vPXwI= =ayHu -END PGP SIGNATURE- --- No new revisions were added by this update. Summary of changes:
svn commit: r66434 - in /dev/flink/flink-connector-hbase-3.0.1-rc1: ./ flink-connector-hbase-3.0.1-src.tgz flink-connector-hbase-3.0.1-src.tgz.asc flink-connector-hbase-3.0.1-src.tgz.sha512
Author: martijnvisser Date: Fri Jan 5 14:48:47 2024 New Revision: 66434 Log: Add flink-connector-hbase-3.0.1-rc1 Added: dev/flink/flink-connector-hbase-3.0.1-rc1/ dev/flink/flink-connector-hbase-3.0.1-rc1/flink-connector-hbase-3.0.1-src.tgz (with props) dev/flink/flink-connector-hbase-3.0.1-rc1/flink-connector-hbase-3.0.1-src.tgz.asc dev/flink/flink-connector-hbase-3.0.1-rc1/flink-connector-hbase-3.0.1-src.tgz.sha512 Added: dev/flink/flink-connector-hbase-3.0.1-rc1/flink-connector-hbase-3.0.1-src.tgz == Binary file - no diff available. Propchange: dev/flink/flink-connector-hbase-3.0.1-rc1/flink-connector-hbase-3.0.1-src.tgz -- svn:mime-type = application/octet-stream Added: dev/flink/flink-connector-hbase-3.0.1-rc1/flink-connector-hbase-3.0.1-src.tgz.asc == --- dev/flink/flink-connector-hbase-3.0.1-rc1/flink-connector-hbase-3.0.1-src.tgz.asc (added) +++ dev/flink/flink-connector-hbase-3.0.1-rc1/flink-connector-hbase-3.0.1-src.tgz.asc Fri Jan 5 14:48:47 2024 @@ -0,0 +1,7 @@ +-BEGIN PGP SIGNATURE- + +iHUEABYKAB0WIQSl87zky+mTVz7FlmplMhuDgrIZrwUCZZgWxAAKCRBlMhuDgrIZ +r+kVAP95W+64PDroXou5fumpbUDbDVKemTvxOaflWJW4tpVALAEAk2KMa+pF6sHQ +1QBCX+tfVEc2YdJVtNVEbdo9s9WHuwA= +=YK53 +-END PGP SIGNATURE- Added: dev/flink/flink-connector-hbase-3.0.1-rc1/flink-connector-hbase-3.0.1-src.tgz.sha512 == --- dev/flink/flink-connector-hbase-3.0.1-rc1/flink-connector-hbase-3.0.1-src.tgz.sha512 (added) +++ dev/flink/flink-connector-hbase-3.0.1-rc1/flink-connector-hbase-3.0.1-src.tgz.sha512 Fri Jan 5 14:48:47 2024 @@ -0,0 +1 @@ +fc390efb59ad994bc3ef7967948392874e9a7ff072a71427b8aeceb122b2a69bd3e07f451f26ca118bf97f5733732c33f66e137b768bb18024e4c11aad306c1f flink-connector-hbase-3.0.1-src.tgz
(flink-connector-elasticsearch) branch main updated: [hotfix] Update copyright year to 2024
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-elasticsearch.git The following commit(s) were added to refs/heads/main by this push: new c0e9efd [hotfix] Update copyright year to 2024 c0e9efd is described below commit c0e9efda750c97233b219d0926f29fd05100d510 Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com> AuthorDate: Fri Jan 5 15:27:07 2024 +0100 [hotfix] Update copyright year to 2024 --- NOTICE | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/NOTICE b/NOTICE index e9934a4..9c19657 100644 --- a/NOTICE +++ b/NOTICE @@ -1,5 +1,5 @@ Apache Flink Elasticsearch Connector -Copyright 2014-2023 The Apache Software Foundation +Copyright 2014-2024 The Apache Software Foundation This product includes software developed at The Apache Software Foundation (http://www.apache.org/).
(flink-connector-elasticsearch) branch v3.0 updated: [hotfix] Update copyright year to 2024
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a commit to branch v3.0 in repository https://gitbox.apache.org/repos/asf/flink-connector-elasticsearch.git The following commit(s) were added to refs/heads/v3.0 by this push: new d5cc749 [hotfix] Update copyright year to 2024 d5cc749 is described below commit d5cc749278b8bf65a6846f59aa2fefd41fdfa314 Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com> AuthorDate: Fri Jan 5 15:27:07 2024 +0100 [hotfix] Update copyright year to 2024 --- NOTICE | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/NOTICE b/NOTICE index 3745571..9c19657 100644 --- a/NOTICE +++ b/NOTICE @@ -1,5 +1,5 @@ Apache Flink Elasticsearch Connector -Copyright 2014-2022 The Apache Software Foundation +Copyright 2014-2024 The Apache Software Foundation This product includes software developed at The Apache Software Foundation (http://www.apache.org/).
(flink-connector-hbase) branch main updated: [hotfix] Remove 1.19-SNAPSHOT since HBase currently can't compile for that version
This is an automated email from the ASF dual-hosted git repository.
martijnvisser pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/flink-connector-hbase.git
The following commit(s) were added to refs/heads/main by this push:
new 42870d5 [hotfix] Remove 1.19-SNAPSHOT since HBase currently can't
compile for that version
42870d5 is described below
commit 42870d5999e9762f814c4442910bed2bd123113c
Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com>
AuthorDate: Fri Jan 5 15:23:49 2024 +0100
[hotfix] Remove 1.19-SNAPSHOT since HBase currently can't compile for that
version
---
.github/workflows/push_pr.yml | 2 +-
.github/workflows/weekly.yml | 3 ---
2 files changed, 1 insertion(+), 4 deletions(-)
diff --git a/.github/workflows/push_pr.yml b/.github/workflows/push_pr.yml
index 317796b..6127ba6 100644
--- a/.github/workflows/push_pr.yml
+++ b/.github/workflows/push_pr.yml
@@ -25,7 +25,7 @@ jobs:
compile_and_test:
strategy:
matrix:
-flink: [1.16.2, 1.17.1, 1.18.0, 1.19-SNAPSHOT]
+flink: [1.16.2, 1.17.1, 1.18.0]
uses: apache/flink-connector-shared-utils/.github/workflows/ci.yml@ci_utils
with:
flink_version: ${{ matrix.flink }}
diff --git a/.github/workflows/weekly.yml b/.github/workflows/weekly.yml
index 8cadbe0..4613879 100644
--- a/.github/workflows/weekly.yml
+++ b/.github/workflows/weekly.yml
@@ -44,9 +44,6 @@ jobs:
}, {
flink: 1.18-SNAPSHOT,
branch: main
-}, {
- flink: 1.19-SNAPSHOT,
- branch: main
}]
uses: apache/flink-connector-shared-utils/.github/workflows/ci.yml@ci_utils
with:
(flink-connector-hbase) branch dependabot/maven/org.apache.commons-commons-compress-1.24.0 created (now 042a08e)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/org.apache.commons-commons-compress-1.24.0 in repository https://gitbox.apache.org/repos/asf/flink-connector-hbase.git at 042a08e Bump org.apache.commons:commons-compress from 1.23.0 to 1.24.0 No new revisions were added by this update.
(flink-connector-hbase) branch dependabot/maven/org.apache.zookeeper-zookeeper-3.7.2 created (now 91c0a80)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/maven/org.apache.zookeeper-zookeeper-3.7.2 in repository https://gitbox.apache.org/repos/asf/flink-connector-hbase.git at 91c0a80 Bump org.apache.zookeeper:zookeeper from 3.4.14 to 3.7.2 No new revisions were added by this update.
(flink-connector-hbase) branch main updated: [hotfix] Test HBase `v3.0` also against 1.18.0 and `main` also against 1.19-SNAPSHOT
This is an automated email from the ASF dual-hosted git repository.
martijnvisser pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/flink-connector-hbase.git
The following commit(s) were added to refs/heads/main by this push:
new 8008c8d [hotfix] Test HBase `v3.0` also against 1.18.0 and `main`
also against 1.19-SNAPSHOT
8008c8d is described below
commit 8008c8d5451595bbe1515861c55cbf9bfc514ea1
Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com>
AuthorDate: Fri Jan 5 15:15:17 2024 +0100
[hotfix] Test HBase `v3.0` also against 1.18.0 and `main` also against
1.19-SNAPSHOT
---
.github/workflows/push_pr.yml | 2 +-
.github/workflows/weekly.yml | 10 --
2 files changed, 9 insertions(+), 3 deletions(-)
diff --git a/.github/workflows/push_pr.yml b/.github/workflows/push_pr.yml
index b575b3c..317796b 100644
--- a/.github/workflows/push_pr.yml
+++ b/.github/workflows/push_pr.yml
@@ -25,7 +25,7 @@ jobs:
compile_and_test:
strategy:
matrix:
-flink: [1.16.2, 1.17.1, 1.18-SNAPSHOT]
+flink: [1.16.2, 1.17.1, 1.18.0, 1.19-SNAPSHOT]
uses: apache/flink-connector-shared-utils/.github/workflows/ci.yml@ci_utils
with:
flink_version: ${{ matrix.flink }}
diff --git a/.github/workflows/weekly.yml b/.github/workflows/weekly.yml
index 76c2158..8cadbe0 100644
--- a/.github/workflows/weekly.yml
+++ b/.github/workflows/weekly.yml
@@ -33,14 +33,20 @@ jobs:
flink: 1.17.1,
branch: v3.0
}, {
- flink: 1.16.2,
+ flink: 1.18.0,
+ branch: v3.0
+}, {
+ flink: 1.16-SNAPSHOT,
branch: main
}, {
- flink: 1.17.1,
+ flink: 1.17-SNAPSHOT,
branch: main
}, {
flink: 1.18-SNAPSHOT,
branch: main
+}, {
+ flink: 1.19-SNAPSHOT,
+ branch: main
}]
uses: apache/flink-connector-shared-utils/.github/workflows/ci.yml@ci_utils
with:
(flink-connector-hbase) branch main updated: [hotfix] Update copyright year to 2024
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-hbase.git The following commit(s) were added to refs/heads/main by this push: new d61c3c5 [hotfix] Update copyright year to 2024 d61c3c5 is described below commit d61c3c5db954dbda15cbf96d95bca41b5b20729c Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com> AuthorDate: Fri Jan 5 15:11:33 2024 +0100 [hotfix] Update copyright year to 2024 --- NOTICE | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/NOTICE b/NOTICE index f91f4cf..7f69208 100644 --- a/NOTICE +++ b/NOTICE @@ -1,5 +1,5 @@ Apache Flink HBase Connector -Copyright 2014-2023 The Apache Software Foundation +Copyright 2014-2024 The Apache Software Foundation This product includes software developed at The Apache Software Foundation (http://www.apache.org/).
(flink-connector-hbase) branch v3.0 updated: [hotfix] Update copyright year to 2024
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a commit to branch v3.0 in repository https://gitbox.apache.org/repos/asf/flink-connector-hbase.git The following commit(s) were added to refs/heads/v3.0 by this push: new 07cd4fe [hotfix] Update copyright year to 2024 07cd4fe is described below commit 07cd4fea262f4c51abeaa7744c548a86b616a375 Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com> AuthorDate: Fri Jan 5 15:11:33 2024 +0100 [hotfix] Update copyright year to 2024 --- NOTICE | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/NOTICE b/NOTICE index f91f4cf..7f69208 100644 --- a/NOTICE +++ b/NOTICE @@ -1,5 +1,5 @@ Apache Flink HBase Connector -Copyright 2014-2023 The Apache Software Foundation +Copyright 2014-2024 The Apache Software Foundation This product includes software developed at The Apache Software Foundation (http://www.apache.org/).
svn commit: r66431 - in /dev/flink/flink-connector-jdbc-3.1.2-rc1: ./ flink-connector-jdbc-3.1.2-src.tgz flink-connector-jdbc-3.1.2-src.tgz.asc flink-connector-jdbc-3.1.2-src.tgz.sha512
Author: martijnvisser Date: Fri Jan 5 13:13:47 2024 New Revision: 66431 Log: Add flink-connector-jdbc-3.1.2-rc1 Added: dev/flink/flink-connector-jdbc-3.1.2-rc1/ dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz (with props) dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz.asc dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz.sha512 Added: dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz == Binary file - no diff available. Propchange: dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz -- svn:mime-type = application/octet-stream Added: dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz.asc == --- dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz.asc (added) +++ dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz.asc Fri Jan 5 13:13:47 2024 @@ -0,0 +1,7 @@ +-BEGIN PGP SIGNATURE- + +iHUEABYKAB0WIQSl87zky+mTVz7FlmplMhuDgrIZrwUCZZgAgAAKCRBlMhuDgrIZ +r8VeAP9lllLHkPXlQcE4yT4yhvzp9wnBjbmCT1eHBiiDHIm0wAEArm8M4d6m9HEl +0ABY/4YAUDuKc/67PAZJLkn6GqvVyAk= +=CKIs +-END PGP SIGNATURE- Added: dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz.sha512 == --- dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz.sha512 (added) +++ dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz.sha512 Fri Jan 5 13:13:47 2024 @@ -0,0 +1 @@ +397bf21b0c47f81a7299f92f34836b9d36ca51c2f7c91d0ffd4745c8cd6288f5abca992e6d6bc0ede1ddd4bf6293c420a047c7a45ff10b6abf662221c1b9ca59 flink-connector-jdbc-3.1.2-src.tgz
(flink-connector-jdbc) annotated tag v3.1.2-rc1 updated (1a61515d -> 7f86d752)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to annotated tag v3.1.2-rc1 in repository https://gitbox.apache.org/repos/asf/flink-connector-jdbc.git *** WARNING: tag v3.1.2-rc1 was modified! *** from 1a61515d (commit) to 7f86d752 (tag) tagging 1a61515db9f134175ecfdf9a2cb8f020b0d41a75 (commit) by Martijn Visser on Fri Jan 5 14:13:28 2024 +0100 - Log - v3.1.2-rc1 -BEGIN PGP SIGNATURE- iHUEABYKAB0WIQSl87zky+mTVz7FlmplMhuDgrIZrwUCZZgAeAAKCRBlMhuDgrIZ r5HtAQD46S3M7XIgV7zMJL1DOtp/GFQou7YOiIUPz53khX1xUgD/YqfODXcEz783 Efmu+ZXdXHsALLA38AnaeoZHDmQr1gM= =3WNr -END PGP SIGNATURE- --- No new revisions were added by this update. Summary of changes:
(flink-connector-jdbc) annotated tag v3.1.2-rc1 deleted (was e4ab69dc)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to annotated tag v3.1.2-rc1 in repository https://gitbox.apache.org/repos/asf/flink-connector-jdbc.git *** WARNING: tag v3.1.2-rc1 was deleted! *** tag was e4ab69dc This change permanently discards the following revisions: discard cd901482 Update version to 3.1.2
svn commit: r66430 - /dev/flink/flink-connector-jdbc-3.1.2-rc1/
Author: martijnvisser Date: Fri Jan 5 13:12:32 2024 New Revision: 66430 Log: [Revert] Delete https://dist.apache.org/repos/dist/dev/flink/flink-connector-jdbc-3.1.2-rc1 Removed: dev/flink/flink-connector-jdbc-3.1.2-rc1/
(flink-connector-jdbc) branch main updated: [hotfix] Set copyright year to 2024
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/flink-connector-jdbc.git The following commit(s) were added to refs/heads/main by this push: new e3dd8416 [hotfix] Set copyright year to 2024 e3dd8416 is described below commit e3dd84160cd665ae17672da8b6e742e61a72a32d Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com> AuthorDate: Fri Jan 5 14:11:07 2024 +0100 [hotfix] Set copyright year to 2024 --- NOTICE | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/NOTICE b/NOTICE index 0161a58b..bafb2269 100644 --- a/NOTICE +++ b/NOTICE @@ -1,5 +1,5 @@ Apache Flink JDBC Connector -Copyright 2014-2023 The Apache Software Foundation +Copyright 2014-2024 The Apache Software Foundation This product includes software developed at The Apache Software Foundation (http://www.apache.org/).
(flink-connector-jdbc) branch v3.1 updated: [hotfix] Set copyright year to 2024
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a commit to branch v3.1 in repository https://gitbox.apache.org/repos/asf/flink-connector-jdbc.git The following commit(s) were added to refs/heads/v3.1 by this push: new 33eae1f5 [hotfix] Set copyright year to 2024 33eae1f5 is described below commit 33eae1f55368096d31a55b5dbd4e8ec15239b324 Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com> AuthorDate: Fri Jan 5 14:11:07 2024 +0100 [hotfix] Set copyright year to 2024 --- NOTICE | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/NOTICE b/NOTICE index 1553115a..bafb2269 100644 --- a/NOTICE +++ b/NOTICE @@ -1,5 +1,5 @@ Apache Flink JDBC Connector -Copyright 2014-2022 The Apache Software Foundation +Copyright 2014-2024 The Apache Software Foundation This product includes software developed at The Apache Software Foundation (http://www.apache.org/).
svn commit: r66429 - in /dev/flink/flink-connector-jdbc-3.1.2-rc1: ./ flink-connector-jdbc-3.1.2-src.tgz flink-connector-jdbc-3.1.2-src.tgz.asc flink-connector-jdbc-3.1.2-src.tgz.sha512
Author: martijnvisser Date: Fri Jan 5 12:57:57 2024 New Revision: 66429 Log: Add flink-connector-jdbc-3.1.2-rc1 Added: dev/flink/flink-connector-jdbc-3.1.2-rc1/ dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz (with props) dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz.asc dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz.sha512 Added: dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz == Binary file - no diff available. Propchange: dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz -- svn:mime-type = application/octet-stream Added: dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz.asc == --- dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz.asc (added) +++ dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz.asc Fri Jan 5 12:57:57 2024 @@ -0,0 +1,7 @@ +-BEGIN PGP SIGNATURE- + +iHUEABYKAB0WIQSl87zky+mTVz7FlmplMhuDgrIZrwUCZZf8xwAKCRBlMhuDgrIZ +r0yxAP4pmLpvetLNraj2NQ+RoepQj7atXLBYu1QC12s2tVoEBQD/a0g1QsHkmoK6 +AW1ydHK91UEnnEtIWdR21i4ThPnjLgM= +=XZes +-END PGP SIGNATURE- Added: dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz.sha512 == --- dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz.sha512 (added) +++ dev/flink/flink-connector-jdbc-3.1.2-rc1/flink-connector-jdbc-3.1.2-src.tgz.sha512 Fri Jan 5 12:57:57 2024 @@ -0,0 +1 @@ +6cb1351723440436231d82c521acf71c6de63ff84a59fd526f4e6780be3d768e99a73ed18d9bdcae4237f1ae5e6abf6c0efa5fbd32d246e71926c95c63249d80 flink-connector-jdbc-3.1.2-src.tgz
(flink-connector-jdbc) annotated tag v3.1.2-rc1 updated (cd901482 -> e4ab69dc)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to annotated tag v3.1.2-rc1 in repository https://gitbox.apache.org/repos/asf/flink-connector-jdbc.git *** WARNING: tag v3.1.2-rc1 was modified! *** from cd901482 (commit) to e4ab69dc (tag) tagging cd901482bf33323cabc5d710f0803b291ab8cf26 (commit) by Martijn Visser on Fri Jan 5 13:57:25 2024 +0100 - Log - v3.1.2-rc1 -BEGIN PGP SIGNATURE- iHUEABYKAB0WIQSl87zky+mTVz7FlmplMhuDgrIZrwUCZZf8tQAKCRBlMhuDgrIZ r068AP49HblfX7pGsIWhy5iio3JVnhdh3uAkYyJERL2P3crFagEA6uMHGHX4A6qQ onXtol2t5hHOtrSadhFb6LMO6yYLtQA= =ZNY3 -END PGP SIGNATURE- --- No new revisions were added by this update. Summary of changes:
(flink-connector-jdbc) annotated tag v3.1.2-rc1 deleted (was 2ac1f383)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to annotated tag v3.1.2-rc1 in repository https://gitbox.apache.org/repos/asf/flink-connector-jdbc.git *** WARNING: tag v3.1.2-rc1 was deleted! *** tag was 2ac1f383 This change permanently discards the following revisions: discard cd901482 Update version to 3.1.2
(flink-connector-jdbc) annotated tag v3.1.2-rc1 updated (cd901482 -> 2ac1f383)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to annotated tag v3.1.2-rc1 in repository https://gitbox.apache.org/repos/asf/flink-connector-jdbc.git *** WARNING: tag v3.1.2-rc1 was modified! *** from cd901482 (commit) to 2ac1f383 (tag) tagging cd901482bf33323cabc5d710f0803b291ab8cf26 (commit) by Martijn Visser on Fri Jan 5 13:41:19 2024 +0100 - Log - v3.1.2-rc1 -BEGIN PGP SIGNATURE- iHUEABYKAB0WIQSl87zky+mTVz7FlmplMhuDgrIZrwUCZZf47wAKCRBlMhuDgrIZ r+72AP91pf3paNpIbAjr3Oz4neL9y6tB1wGiAo/9Ymv8ZT6YhAEAtMCcwaGl10GW zTh0iTOXMgXJFlAjEGs0xG1jHJTRRAs= =rL6K -END PGP SIGNATURE- --- No new revisions were added by this update. Summary of changes:
(flink-connector-jdbc) annotated tag v-rc1 deleted (was 29fb0cfb)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to annotated tag v-rc1 in repository https://gitbox.apache.org/repos/asf/flink-connector-jdbc.git *** WARNING: tag v-rc1 was deleted! *** tag was 29fb0cfb This change permanently discards the following revisions: discard cd901482 Update version to 3.1.2
(flink-connector-jdbc) annotated tag v-rc1 updated (cd901482 -> 29fb0cfb)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to annotated tag v-rc1 in repository https://gitbox.apache.org/repos/asf/flink-connector-jdbc.git *** WARNING: tag v-rc1 was modified! *** from cd901482 (commit) to 29fb0cfb (tag) tagging cd901482bf33323cabc5d710f0803b291ab8cf26 (commit) by Martijn Visser on Fri Jan 5 13:38:05 2024 +0100 - Log - v-rc1 -BEGIN PGP SIGNATURE- iHUEABYKAB0WIQSl87zky+mTVz7FlmplMhuDgrIZrwUCZZf4LQAKCRBlMhuDgrIZ r4BuAP0SBPCQmT9n4R+J9PLxUt7Gbe8GsV2/DltkABR7nhNaVwD/agIqoty167nu SHElPDCSAQOhX3YWlOvwp7tm/WT/0wo= =V0yB -END PGP SIGNATURE- --- No new revisions were added by this update. Summary of changes:
(flink-connector-jdbc) annotated tag v3.1.2-rc1 deleted (was a25a7b25)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to annotated tag v3.1.2-rc1 in repository https://gitbox.apache.org/repos/asf/flink-connector-jdbc.git *** WARNING: tag v3.1.2-rc1 was deleted! *** tag was a25a7b25 This change permanently discards the following revisions: discard cd901482 Update version to 3.1.2
(flink-connector-jdbc) annotated tag v3.1.2-rc1 updated (cd901482 -> a25a7b25)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to annotated tag v3.1.2-rc1 in repository https://gitbox.apache.org/repos/asf/flink-connector-jdbc.git *** WARNING: tag v3.1.2-rc1 was modified! *** from cd901482 (commit) to a25a7b25 (tag) tagging cd901482bf33323cabc5d710f0803b291ab8cf26 (commit) by Martijn Visser on Fri Jan 5 13:34:35 2024 +0100 - Log - v3.1.2-rc1 -BEGIN PGP SIGNATURE- iHUEABYKAB0WIQSl87zky+mTVz7FlmplMhuDgrIZrwUCZZf3XAAKCRBlMhuDgrIZ r/JXAQDC4yKV7oe7lcLRhtsPcVlLK/uDWVitGNOHlZkBUOt8KwD/TUJv5zfwVxFj ya+B0kVwT/9b0Fja3vkZpDVMOyZBHAI= =0XBt -END PGP SIGNATURE- --- No new revisions were added by this update. Summary of changes:
(flink) branch release-1.17 updated: [hotfix] Integrate HBase v3.0 connector documentation
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a commit to branch release-1.17 in repository https://gitbox.apache.org/repos/asf/flink.git The following commit(s) were added to refs/heads/release-1.17 by this push: new b6704495ba3 [hotfix] Integrate HBase v3.0 connector documentation b6704495ba3 is described below commit b6704495ba3459727ed236c0a14da50ee3a5de0a Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com> AuthorDate: Fri Jan 5 13:13:21 2024 +0100 [hotfix] Integrate HBase v3.0 connector documentation --- docs/setup_docs.sh | 1 + 1 file changed, 1 insertion(+) diff --git a/docs/setup_docs.sh b/docs/setup_docs.sh index 36997107d6c..f3ffa9e2602 100755 --- a/docs/setup_docs.sh +++ b/docs/setup_docs.sh @@ -52,6 +52,7 @@ integrate_connector_docs rabbitmq v3.0 integrate_connector_docs gcp-pubsub v3.0 integrate_connector_docs mongodb v1.0 integrate_connector_docs opensearch v1.0 +integrate_connector_docs hbase v3.0 cd .. rm -rf tmp
(flink) branch release-1.16 updated: [hotfix] Integrate HBase v3.0 connector documentation
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a commit to branch release-1.16 in repository https://gitbox.apache.org/repos/asf/flink.git The following commit(s) were added to refs/heads/release-1.16 by this push: new 664bd6760f2 [hotfix] Integrate HBase v3.0 connector documentation 664bd6760f2 is described below commit 664bd6760f256c4f252e3acb710c0de854568207 Author: Martijn Visser <2989614+martijnvis...@users.noreply.github.com> AuthorDate: Fri Jan 5 13:12:22 2024 +0100 [hotfix] Integrate HBase v3.0 connector documentation --- docs/setup_docs.sh | 1 + 1 file changed, 1 insertion(+) diff --git a/docs/setup_docs.sh b/docs/setup_docs.sh index e7c112d0426..ee80515751a 100755 --- a/docs/setup_docs.sh +++ b/docs/setup_docs.sh @@ -49,6 +49,7 @@ integrate_connector_docs elasticsearch v3.0 integrate_connector_docs aws v4.1 integrate_connector_docs opensearch v1.0 integrate_connector_docs mongodb v1.0 +integrate_connector_docs hbase v3.0 cd .. rm -rf tmp
(flink-web) branch asf-site updated (57563d1d7 -> 0cdff3daf)
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/flink-web.git from 57563d1d7 Rebuild website new 645e73457 Add HBase v3.0.0 for Flink 1.16.x and 1.17.x new 0cdff3daf Rebuild website The 2 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../2014/08/26/apache-flink-0.6-available/index.html | 2 +- .../2014/09/26/apache-flink-0.6.1-available/index.html | 2 +- content/2014/10/03/upcoming-events/index.html | 2 +- .../2014/11/04/apache-flink-0.7.0-available/index.html | 2 +- .../11/18/hadoop-compatibility-in-flink/index.html | 2 +- .../06/december-2014-in-the-flink-community/index.html | 2 +- .../2015/01/21/apache-flink-0.8.0-available/index.html | 2 +- .../04/january-2015-in-the-flink-community/index.html | 2 +- .../2015/02/09/introducing-flink-streaming/index.html | 2 +- .../02/february-2015-in-the-flink-community/index.html | 2 +- .../peeking-into-apache-flinks-engine-room/index.html | 2 +- .../04/07/march-2015-in-the-flink-community/index.html | 2 +- .../index.html | 2 +- .../2015/05/11/juggling-with-bits-and-bytes/index.html | 2 +- .../05/14/april-2015-in-the-flink-community/index.html | 2 +- .../06/24/announcing-apache-flink-0.9.0/index.html | 2 +- .../index.html | 2 +- .../2015/09/01/apache-flink-0.9.1-available/index.html | 2 +- .../09/03/announcing-flink-forward-2015/index.html | 2 +- .../index.html | 2 +- .../11/16/announcing-apache-flink-0.10.0/index.html| 2 +- content/2015/11/27/flink-0.10.1-released/index.html| 2 +- .../index.html | 2 +- .../index.html | 2 +- .../index.html | 2 +- content/2016/02/11/flink-0.10.2-released/index.html| 2 +- .../03/08/announcing-apache-flink-1.0.0/index.html | 2 +- content/2016/04/06/flink-1.0.1-released/index.html | 2 +- .../index.html | 2 +- .../index.html | 2 +- content/2016/04/22/flink-1.0.2-released/index.html | 2 +- content/2016/05/11/flink-1.0.3-released/index.html | 2 +- .../index.html | 2 +- .../08/04/announcing-apache-flink-1.1.0/index.html | 2 +- content/2016/08/04/flink-1.1.1-released/index.html | 2 +- .../index.html | 2 +- .../2016/09/05/apache-flink-1.1.2-released/index.html | 2 +- .../2016/10/12/apache-flink-1.1.3-released/index.html | 2 +- .../19/apache-flink-in-2016-year-in-review/index.html | 2 +- .../2016/12/21/apache-flink-1.1.4-released/index.html | 2 +- .../02/06/announcing-apache-flink-1.2.0/index.html | 2 +- .../2017/03/23/apache-flink-1.1.5-released/index.html | 2 +- .../index.html | 2 +- .../30/continuous-queries-on-dynamic-tables/index.html | 2 +- .../2017/04/26/apache-flink-1.2.1-released/index.html | 2 +- .../index.html | 2 +- .../apache-flink-1.3.0-release-announcement/index.html | 2 +- .../2017/06/23/apache-flink-1.3.1-released/index.html | 2 +- .../index.html | 2 +- .../2017/08/05/apache-flink-1.3.2-released/index.html | 2 +- .../index.html | 2 +- .../apache-flink-1.4.0-release-announcement/index.html | 2 +- .../21/apache-flink-in-2017-year-in-review/index.html | 2 +- .../index.html | 2 +- .../2018/02/15/apache-flink-1.4.1-released/index.html | 2 +- .../index.html | 2 +- .../2018/03/08/apache-flink-1.4.2-released/index.html | 2 +- .../2018/03/15/apache-flink-1.3.3-released/index.html | 2 +- .../apache-flink-1.5.0-release-announcement/index.html | 2 +- .../2018/07/12/apache-flink-1.5.1-released/index.html | 2 +- .../2018/07/31/apache-flink-1.5.2-released/index.html | 2 +- .../apache-flink-1.6.0-release-announcement/index.html | 2 +- .../2018/08/21/apache-flink-1.5.3-released/index.html | 2 +- .../2018/09/20/apache-flink-1.5.4-released/index.html | 2 +- .../2018/09/20/apache-flink-1.6.1-released/index.html | 2 +- .../2018/10/29/apache-flink-1.5.5-released/index.html | 2 +- .../2018/10/29/apache-flink-1.6.2-released/index.html | 2 +- .../apache-flink-1.7.0-release-announcement/index.html | 2 +- .../2018/12/21/apache-flink-1.7.1-released/index.html | 2 +-
(flink-web) 01/02: Add HBase v3.0.0 for Flink 1.16.x and 1.17.x
This is an automated email from the ASF dual-hosted git repository. martijnvisser pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/flink-web.git commit 645e73457d975c11fca30c32e8bf83ebcd8b78ba Author: Martijn Visser AuthorDate: Fri Sep 1 16:30:04 2023 +0200 Add HBase v3.0.0 for Flink 1.16.x and 1.17.x --- docs/data/flink_connectors.yml | 7 +++ docs/data/release_archive.yml | 7 ++- 2 files changed, 13 insertions(+), 1 deletion(-) diff --git a/docs/data/flink_connectors.yml b/docs/data/flink_connectors.yml index d312ee63d..90466390f 100644 --- a/docs/data/flink_connectors.yml +++ b/docs/data/flink_connectors.yml @@ -43,6 +43,13 @@ gcp-pubsub: source_release_sha512_url: "https://downloads.apache.org/flink/flink-connector-gcp-pubsub-3.0.1/flink-connector-gcp-pubsub-3.0.1-src.tgz.sha512; compatibility: ["1.16.x", "1.17.x"] +hbase: + name: "Apache Flink HBase Connector 3.0.0" + source_release_url: "https://www.apache.org/dyn/closer.lua/flink/flink-connector-hbase-3.0.0/flink-connector-hbase-3.0.0-src.tgz; + source_release_asc_url: "https://downloads.apache.org/flink/flink-connector-hbase-3.0.0/flink-connector-hbase-3.0.0-src.tgz.asc; + source_release_sha512_url: "https://downloads.apache.org/flink/flink-connector-hbase-3.0.0/flink-connector-hbase-3.0.0-src.tgz.sha512; + compatibility: ["1.16.x", "1.17.x"] + jdbc: name: "Apache Flink JDBC Connector 3.1.1" source_release_url: "https://www.apache.org/dyn/closer.lua/flink/flink-connector-jdbc-3.1.1/flink-connector-jdbc-3.1.1-src.tgz; diff --git a/docs/data/release_archive.yml b/docs/data/release_archive.yml index 2af84097f..3327d4c38 100644 --- a/docs/data/release_archive.yml +++ b/docs/data/release_archive.yml @@ -525,6 +525,11 @@ release_archive: version: 1.0.2 release_date: 2023-08-15 filename: "mongodb" +- name: "Flink HBase Connector" + connector: "hbase" + version: 3.0.0 + release_date: 2023-09-1 + filename: "hbase" - name: "Flink Kafka Connector" connector: "kafka" version: 3.0.1 @@ -622,7 +627,7 @@ release_archive: flink_kubernetes_operator: - version_short: 1.7 version_long: 1.7.0 - release_date: 2023-11-22 + release_date: 2023-11-22 - version_short: 1.6 version_long: 1.6.1 release_date: 2023-10-27
(flink-kubernetes-operator) branch main updated: [FLINK-33993] Fix misleading events for scaling effectiveness detection (#748)
This is an automated email from the ASF dual-hosted git repository.
mxm pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/flink-kubernetes-operator.git
The following commit(s) were added to refs/heads/main by this push:
new 58b8ea8c [FLINK-33993] Fix misleading events for scaling effectiveness
detection (#748)
58b8ea8c is described below
commit 58b8ea8ca3ce12d6f7c8d0b893a5e2d29c506cfd
Author: Maximilian Michels
AuthorDate: Fri Jan 5 10:58:53 2024 +0100
[FLINK-33993] Fix misleading events for scaling effectiveness detection
(#748)
When the ineffective scaling decision feature is turned off, events are
regenerated which look like this:
```
Skipping further scale up after ineffective previous scale up for
65c763af14a952c064c400d516c25529
```
This is misleading because no action will be taken. It is fair to inform
users
about ineffective scale up even when the feature is disabled but a different
message should be printed to convey that no action will be taken.
---
.../apache/flink/autoscaler/JobVertexScaler.java | 15 +++---
.../flink/autoscaler/JobVertexScalerTest.java | 23 --
2 files changed, 33 insertions(+), 5 deletions(-)
diff --git
a/flink-autoscaler/src/main/java/org/apache/flink/autoscaler/JobVertexScaler.java
b/flink-autoscaler/src/main/java/org/apache/flink/autoscaler/JobVertexScaler.java
index 915cd2c4..01f6d940 100644
---
a/flink-autoscaler/src/main/java/org/apache/flink/autoscaler/JobVertexScaler.java
+++
b/flink-autoscaler/src/main/java/org/apache/flink/autoscaler/JobVertexScaler.java
@@ -58,7 +58,7 @@ public class JobVertexScaler> {
@VisibleForTesting
protected static final String INEFFECTIVE_MESSAGE_FORMAT =
-"Skipping further scale up after ineffective previous scale up for
%s";
+"Ineffective scaling detected for %s (expected increase: %s,
actual increase %s). Blocking of ineffective scaling decisions is %s";
private Clock clock = Clock.system(ZoneId.systemDefault());
@@ -214,7 +214,16 @@ public class JobVertexScaler> {
return false;
}
-var message = String.format(INEFFECTIVE_MESSAGE_FORMAT, vertex);
+boolean blockIneffectiveScalings =
+
conf.get(AutoScalerOptions.SCALING_EFFECTIVENESS_DETECTION_ENABLED);
+
+var message =
+String.format(
+INEFFECTIVE_MESSAGE_FORMAT,
+vertex,
+expectedIncrease,
+actualIncrease,
+blockIneffectiveScalings ? "enabled" : "disabled");
autoScalerEventHandler.handleEvent(
context,
@@ -224,7 +233,7 @@ public class JobVertexScaler> {
null,
conf.get(SCALING_EVENT_INTERVAL));
-if
(conf.get(AutoScalerOptions.SCALING_EFFECTIVENESS_DETECTION_ENABLED)) {
+if (blockIneffectiveScalings) {
LOG.warn(
"Ineffective scaling detected for {}, expected increase
{}, actual {}",
vertex,
diff --git
a/flink-autoscaler/src/test/java/org/apache/flink/autoscaler/JobVertexScalerTest.java
b/flink-autoscaler/src/test/java/org/apache/flink/autoscaler/JobVertexScalerTest.java
index 0f9242e7..f87fbebe 100644
---
a/flink-autoscaler/src/test/java/org/apache/flink/autoscaler/JobVertexScalerTest.java
+++
b/flink-autoscaler/src/test/java/org/apache/flink/autoscaler/JobVertexScalerTest.java
@@ -431,7 +431,9 @@ public class JobVertexScalerTest {
var event = eventCollector.events.poll();
assertThat(event).isNotNull();
assertThat(event.getMessage())
-.isEqualTo(String.format(INEFFECTIVE_MESSAGE_FORMAT,
jobVertexID));
+.isEqualTo(
+String.format(
+INEFFECTIVE_MESSAGE_FORMAT, jobVertexID, 90.0,
5.0, "enabled"));
assertThat(event.getReason()).isEqualTo(INEFFECTIVE_SCALING);
assertEquals(1, event.getCount());
@@ -463,9 +465,26 @@ public class JobVertexScalerTest {
event = eventCollector.events.poll();
assertThat(event).isNotNull();
assertThat(event.getMessage())
-.isEqualTo(String.format(INEFFECTIVE_MESSAGE_FORMAT,
jobVertexID));
+.isEqualTo(
+String.format(
+INEFFECTIVE_MESSAGE_FORMAT, jobVertexID, 90.0,
5.0, "enabled"));
assertThat(event.getReason()).isEqualTo(INEFFECTIVE_SCALING);
assertEquals(2, event.getCount());
+
+// Test ineffective scaling switched off
+conf.set(AutoScalerOptions.SCALING_EFFECTIVENESS_DETECTION_ENABLED,
false);
+assertEquals(
+40,
+vertexScaler.computeScaleTargetParallelism(
+context, jobVertexID, evaluated, history,
