[GitHub] [flink] dawidwys commented on a change in pull request #16655: [FLINK-23512][runtime][checkpoint] Check for illegal modifications of JobGraph with partially finished operators

2021-08-05 Thread GitBox
dawidwys commented on a change in pull request #16655: URL: https://github.com/apache/flink/pull/16655#discussion_r683182410 ## File path: flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/VertexFinishedStateChecker.java ## @@ -0,0 +1,216 @@ +/* + * Licensed to t

[GitHub] [flink] flinkbot edited a comment on pull request #16676: [FLINK-22902] Port KafkaSink to FLIP-143

2021-08-05 Thread GitBox
flinkbot edited a comment on pull request #16676: URL: https://github.com/apache/flink/pull/16676#issuecomment-890987522 ## CI report: * 0fd6c57783b7dee619945551d94490442b77af0a UNKNOWN * 5916417a1266f4af34d387dd2e61a10673a1a9fe Azure: [PENDING](https://dev.azure.com/apache-fl

[GitHub] [flink] flinkbot commented on pull request #16717: [FLINK-23635][s3-fs-presto] Fix PrestoS3FileSystemITCase

2021-08-05 Thread GitBox
flinkbot commented on pull request #16717: URL: https://github.com/apache/flink/pull/16717#issuecomment-893219203 ## CI report: * 6eb2aa5bc27700ed17f2952f11f16e185f0fdbaf UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot r

[jira] [Commented] (FLINK-23635) PrestoS3FileSystemITCase.testConfigKeysForwarding

2021-08-05 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393669#comment-17393669 ] Xintong Song commented on FLINK-23635: -- https://dev.azure.com/apache-flink/apache-f

[jira] [Commented] (FLINK-22480) KafkaChangelogTableITCase hangs on Azure

2021-08-05 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393670#comment-17393670 ] Xintong Song commented on FLINK-22480: -- https://dev.azure.com/apache-flink/apache-f

[GitHub] [flink] dawidwys commented on a change in pull request #16655: [FLINK-23512][runtime][checkpoint] Check for illegal modifications of JobGraph with partially finished operators

2021-08-05 Thread GitBox
dawidwys commented on a change in pull request #16655: URL: https://github.com/apache/flink/pull/16655#discussion_r683185648 ## File path: flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/metadata/MetadataV3Serializer.java ## @@ -114,8 +115,14 @@ protected void

[jira] [Commented] (FLINK-23635) PrestoS3FileSystemITCase.testConfigKeysForwarding

2021-08-05 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-23635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393673#comment-17393673 ] Ingo Bürk commented on FLINK-23635: --- I've also reported this change in behavior to pre

[jira] [Closed] (FLINK-23492) JobVertexThreadInfoTrackerTest.testCachedStatsCleanedAfterCleanupInterval fails on Azure

2021-08-05 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler closed FLINK-23492. Fix Version/s: 1.13.3 1.14.0 Resolution: Fixed master: ef99b99a9

[jira] [Reopened] (FLINK-23487) IRSA doesn't work with S3

2021-08-05 Thread Timo Walther (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timo Walther reopened FLINK-23487: -- > IRSA doesn't work with S3 > - > > Key: FLINK-23487 >

[GitHub] [flink] zentol closed pull request #16690: [FLINK-23492][runtime][backport] harden testCachedStatsCleanedAfterCleanupInterval

2021-08-05 Thread GitBox
zentol closed pull request #16690: URL: https://github.com/apache/flink/pull/16690 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr

[jira] [Commented] (FLINK-23221) Docker image vulnerability

2021-08-05 Thread Razvan AGAPE (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393676#comment-17393676 ] Razvan AGAPE commented on FLINK-23221: -- Thank you all for your responses! Will chec

[jira] [Closed] (FLINK-23635) PrestoS3FileSystemITCase.testConfigKeysForwarding

2021-08-05 Thread Timo Walther (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timo Walther closed FLINK-23635. Resolution: Fixed I reverted the affecting commit and reopened FLINK-23487. > PrestoS3FileSystemI

[jira] [Commented] (FLINK-23545) Use new schema in SqlCreateTableConverter

2021-08-05 Thread jinfeng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393678#comment-17393678 ] jinfeng commented on FLINK-23545: - When I implement the code, I found a few problems. A

[GitHub] [flink] curcur commented on a change in pull request #16606: [FLINK-21357][runtime/statebackend]Periodic materialization for generalized incremental checkpoints

2021-08-05 Thread GitBox
curcur commented on a change in pull request #16606: URL: https://github.com/apache/flink/pull/16606#discussion_r683190222 ## File path: flink-state-backends/flink-statebackend-rocksdb/src/test/java/org/apache/flink/contrib/streaming/state/EmbeddedRocksDBStateBackendTest.java

[jira] [Comment Edited] (FLINK-23635) PrestoS3FileSystemITCase.testConfigKeysForwarding

2021-08-05 Thread Timo Walther (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393677#comment-17393677 ] Timo Walther edited comment on FLINK-23635 at 8/5/21, 7:15 AM: ---

[jira] [Commented] (FLINK-23487) IRSA doesn't work with S3

2021-08-05 Thread Timo Walther (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393679#comment-17393679 ] Timo Walther commented on FLINK-23487: -- Temporarily reverted in 452fb6774521eec1129

[GitHub] [flink] dawidwys commented on a change in pull request #16655: [FLINK-23512][runtime][checkpoint] Check for illegal modifications of JobGraph with partially finished operators

2021-08-05 Thread GitBox
dawidwys commented on a change in pull request #16655: URL: https://github.com/apache/flink/pull/16655#discussion_r683188817 ## File path: flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/VertexFinishedStateChecker.java ## @@ -0,0 +1,216 @@ +/* + * Licensed to t

[jira] [Commented] (FLINK-23635) PrestoS3FileSystemITCase.testConfigKeysForwarding

2021-08-05 Thread Dawid Wysakowicz (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393680#comment-17393680 ] Dawid Wysakowicz commented on FLINK-23635: -- https://dev.azure.com/apache-flink/

[jira] [Commented] (FLINK-23635) PrestoS3FileSystemITCase.testConfigKeysForwarding

2021-08-05 Thread Dawid Wysakowicz (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393681#comment-17393681 ] Dawid Wysakowicz commented on FLINK-23635: -- https://dev.azure.com/apache-flink/

[GitHub] [flink] gyfora commented on pull request #16463: [FLINK-23272][web] Add custom netty HTTP request inbound/outbound handlers

2021-08-05 Thread GitBox
gyfora commented on pull request #16463: URL: https://github.com/apache/flink/pull/16463#issuecomment-893234348 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

[GitHub] [flink] gyfora commented on pull request #16463: [FLINK-23272][web] Add custom netty HTTP request inbound/outbound handlers

2021-08-05 Thread GitBox
gyfora commented on pull request #16463: URL: https://github.com/apache/flink/pull/16463#issuecomment-893236679 @flinkbot approve all -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [flink] curcur commented on a change in pull request #16606: [FLINK-21357][runtime/statebackend]Periodic materialization for generalized incremental checkpoints

2021-08-05 Thread GitBox
curcur commented on a change in pull request #16606: URL: https://github.com/apache/flink/pull/16606#discussion_r683206709 ## File path: flink-state-backends/flink-statebackend-changelog/src/main/java/org/apache/flink/state/changelog/materializer/PeriodicMaterializer.java ## @

[GitHub] [flink] flinkbot edited a comment on pull request #16463: [FLINK-23272][web] Add custom netty HTTP request inbound/outbound handlers

2021-08-05 Thread GitBox
flinkbot edited a comment on pull request #16463: URL: https://github.com/apache/flink/pull/16463#issuecomment-878058026 ## CI report: * 8743ec576ba567b1534455ca608ac0064a6e4834 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/result

[GitHub] [flink] flinkbot edited a comment on pull request #16717: [FLINK-23635][s3-fs-presto] Fix PrestoS3FileSystemITCase

2021-08-05 Thread GitBox
flinkbot edited a comment on pull request #16717: URL: https://github.com/apache/flink/pull/16717#issuecomment-893219203 ## CI report: * 6eb2aa5bc27700ed17f2952f11f16e185f0fdbaf Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/result

[GitHub] [flink] curcur commented on a change in pull request #16606: [FLINK-21357][runtime/statebackend]Periodic materialization for generalized incremental checkpoints

2021-08-05 Thread GitBox
curcur commented on a change in pull request #16606: URL: https://github.com/apache/flink/pull/16606#discussion_r683206709 ## File path: flink-state-backends/flink-statebackend-changelog/src/main/java/org/apache/flink/state/changelog/materializer/PeriodicMaterializer.java ## @

[GitHub] [flink] tsreaper opened a new pull request #16718: [FLINK-23579][table-runtime] Fix compile exception in hash functions with varbinary arguments

2021-08-05 Thread GitBox
tsreaper opened a new pull request #16718: URL: https://github.com/apache/flink/pull/16718 ## What is the purpose of the change Currently hash functions like `MD5`, `SHA2`, etc. fails to compile if the argument is a varbinary value. This PR fixes this issue. ## Brief change lo

[jira] [Updated] (FLINK-23579) SELECT SHA2(CAST(NULL AS VARBINARY), CAST(NULL AS INT)) AS ref0 can't compile

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-23579: --- Labels: pull-request-available (was: ) > SELECT SHA2(CAST(NULL AS VARBINARY), CAST(NULL AS

[jira] [Commented] (FLINK-23635) PrestoS3FileSystemITCase.testConfigKeysForwarding

2021-08-05 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-23635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393693#comment-17393693 ] Ingo Bürk commented on FLINK-23635: --- I also identified the reason for why the PR origi

[GitHub] [flink] flinkbot commented on pull request #16718: [FLINK-23579][table-runtime] Fix compile exception in hash functions with varbinary arguments

2021-08-05 Thread GitBox
flinkbot commented on pull request #16718: URL: https://github.com/apache/flink/pull/16718#issuecomment-893243518 Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community to review your pull request. We will use this comment to track the pro

[jira] [Assigned] (FLINK-23634) BatchingStateChangeUploaderTest.testDelay fails on azure

2021-08-05 Thread Roman Khachatryan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roman Khachatryan reassigned FLINK-23634: - Assignee: Roman Khachatryan > BatchingStateChangeUploaderTest.testDelay fails o

[GitHub] [flink] curcur commented on a change in pull request #16606: [FLINK-21357][runtime/statebackend]Periodic materialization for generalized incremental checkpoints

2021-08-05 Thread GitBox
curcur commented on a change in pull request #16606: URL: https://github.com/apache/flink/pull/16606#discussion_r683218039 ## File path: flink-state-backends/flink-statebackend-changelog/src/main/java/org/apache/flink/state/changelog/materializer/PeriodicMaterializer.java ## @

[jira] [Commented] (FLINK-22889) JdbcExactlyOnceSinkE2eTest hangs on azure

2021-08-05 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393696#comment-17393696 ] Till Rohrmann commented on FLINK-22889: --- Another instance: https://dev.azure.com/

[jira] [Updated] (FLINK-22889) JdbcExactlyOnceSinkE2eTest.testInsert hangs on azure

2021-08-05 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann updated FLINK-22889: -- Summary: JdbcExactlyOnceSinkE2eTest.testInsert hangs on azure (was: JdbcExactlyOnceSinkE2eTes

[jira] [Updated] (FLINK-22889) JdbcExactlyOnceSinkE2eTest.testInsert hangs on azure

2021-08-05 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann updated FLINK-22889: -- Fix Version/s: 1.14.0 > JdbcExactlyOnceSinkE2eTest.testInsert hangs on azure > ---

[GitHub] [flink] tillrohrmann commented on pull request #16704: [FLINK-22382][tests] Harden ProcessFailureCancelingITCase.testCancelingOnProcessFailure

2021-08-05 Thread GitBox
tillrohrmann commented on pull request #16704: URL: https://github.com/apache/flink/pull/16704#issuecomment-893249045 Thanks for the review @zentol. The test failure seems to be unrelated. Merging this PR now. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [flink] rkhachatryan commented on pull request #16685: [FLINK-23279][tests] Randomly use Changelog Backend in tests

2021-08-05 Thread GitBox
rkhachatryan commented on pull request #16685: URL: https://github.com/apache/flink/pull/16685#issuecomment-893250448 The most recent build failed with `UnalignedCheckpointStressITCase` missing `chk` folder in the middle of traversal, after the job finished. I've looked into it and I thi

[jira] [Created] (FLINK-23637) MeasurementInfoProviderTest.testNormalizingTags fails on Azure

2021-08-05 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-23637: - Summary: MeasurementInfoProviderTest.testNormalizingTags fails on Azure Key: FLINK-23637 URL: https://issues.apache.org/jira/browse/FLINK-23637 Project: Flink

[GitHub] [flink] tillrohrmann commented on pull request #16705: [BP-1.13][FLINK-22382][tests] Harden ProcessFailureCancelingITCase.testCancelingOnProcessFailure

2021-08-05 Thread GitBox
tillrohrmann commented on pull request #16705: URL: https://github.com/apache/flink/pull/16705#issuecomment-893250851 Thanks for the review @zentol. The failing test case seems to be unrelated. Merging this PR now. -- This is an automated message from the Apache Git Service. To respond t

[GitHub] [flink] flinkbot edited a comment on pull request #16463: [FLINK-23272][web] Add custom netty HTTP request inbound/outbound handlers

2021-08-05 Thread GitBox
flinkbot edited a comment on pull request #16463: URL: https://github.com/apache/flink/pull/16463#issuecomment-878058026 ## CI report: * 8743ec576ba567b1534455ca608ac0064a6e4834 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/result

[GitHub] [flink] tillrohrmann closed pull request #16704: [FLINK-22382][tests] Harden ProcessFailureCancelingITCase.testCancelingOnProcessFailure

2021-08-05 Thread GitBox
tillrohrmann closed pull request #16704: URL: https://github.com/apache/flink/pull/16704 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-un

[GitHub] [flink] flinkbot edited a comment on pull request #16717: [FLINK-23487][FLINK-23635][s3] Update aws and presto-hive

2021-08-05 Thread GitBox
flinkbot edited a comment on pull request #16717: URL: https://github.com/apache/flink/pull/16717#issuecomment-893219203 ## CI report: * 6eb2aa5bc27700ed17f2952f11f16e185f0fdbaf Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/result

[GitHub] [flink] flinkbot commented on pull request #16718: [FLINK-23579][table-runtime] Fix compile exception in hash functions with varbinary arguments

2021-08-05 Thread GitBox
flinkbot commented on pull request #16718: URL: https://github.com/apache/flink/pull/16718#issuecomment-893255641 ## CI report: * a37cc11a04c5e4ccd7f47fbd94142b09f035b899 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot r

[GitHub] [flink] beyond1920 commented on pull request #16620: [FLINK-23246][table-planner] Refactor the time indicator materialization

2021-08-05 Thread GitBox
beyond1920 commented on pull request #16620: URL: https://github.com/apache/flink/pull/16620#issuecomment-893260786 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

[GitHub] [flink] fapaul commented on a change in pull request #16701: [FLINK-23617][datastream] Co-locate sink operators with same parallelism

2021-08-05 Thread GitBox
fapaul commented on a change in pull request #16701: URL: https://github.com/apache/flink/pull/16701#discussion_r683172137 ## File path: flink-core/src/main/java/org/apache/flink/api/connector/sink/Sink.java ## @@ -48,41 +54,70 @@ public interface Sink extends Serializable {

[GitHub] [flink] curcur commented on a change in pull request #16606: [FLINK-21357][runtime/statebackend]Periodic materialization for generalized incremental checkpoints

2021-08-05 Thread GitBox
curcur commented on a change in pull request #16606: URL: https://github.com/apache/flink/pull/16606#discussion_r683232659 ## File path: flink-state-backends/flink-statebackend-changelog/src/main/java/org/apache/flink/state/changelog/materializer/PeriodicMaterializer.java ## @

[GitHub] [flink] pnowojski merged pull request #16628: [FLINK-23453][streaming] Created the buffer size calculator for the ability to automatically change the buffer size based on the throughput.

2021-08-05 Thread GitBox
pnowojski merged pull request #16628: URL: https://github.com/apache/flink/pull/16628 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsub

[GitHub] [flink] fapaul commented on a change in pull request #16701: [FLINK-23617][datastream] Co-locate sink operators with same parallelism

2021-08-05 Thread GitBox
fapaul commented on a change in pull request #16701: URL: https://github.com/apache/flink/pull/16701#discussion_r683223090 ## File path: flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/operators/sink/CommitterHandler.java ## @@ -0,0 +1,71 @@ +/* + * Licen

[jira] [Closed] (FLINK-23637) MeasurementInfoProviderTest.testNormalizingTags fails on Azure

2021-08-05 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler closed FLINK-23637. Resolution: Duplicate > MeasurementInfoProviderTest.testNormalizingTags fails on Azure > -

[GitHub] [flink] curcur commented on a change in pull request #16606: [FLINK-21357][runtime/statebackend]Periodic materialization for generalized incremental checkpoints

2021-08-05 Thread GitBox
curcur commented on a change in pull request #16606: URL: https://github.com/apache/flink/pull/16606#discussion_r683218039 ## File path: flink-state-backends/flink-statebackend-changelog/src/main/java/org/apache/flink/state/changelog/materializer/PeriodicMaterializer.java ## @

[GitHub] [flink] curcur commented on a change in pull request #16606: [FLINK-21357][runtime/statebackend]Periodic materialization for generalized incremental checkpoints

2021-08-05 Thread GitBox
curcur commented on a change in pull request #16606: URL: https://github.com/apache/flink/pull/16606#discussion_r683238764 ## File path: flink-state-backends/flink-statebackend-changelog/src/main/java/org/apache/flink/state/changelog/materializer/PeriodicMaterializer.java ## @

[jira] [Closed] (FLINK-23453) Dynamic calculation of the buffer size

2021-08-05 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-23453. -- Fix Version/s: 1.14.0 Resolution: Fixed merged to master as 088d1651712..d8477bda394 >

[GitHub] [flink] rkhachatryan opened a new pull request #16719: [FLINK-23634][tests] Explicitly trigger scheduled tasks

2021-08-05 Thread GitBox
rkhachatryan opened a new pull request #16719: URL: https://github.com/apache/flink/pull/16719 ## What is the purpose of the change Fix flaky `BatchingStateChangeUploaderTest.testDelay` by explicitly checking and triggering scheduled tasks instead of waiting. -- This is a

[jira] [Updated] (FLINK-23634) BatchingStateChangeUploaderTest.testDelay fails on azure

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-23634: --- Labels: pull-request-available test-stability (was: test-stability) > BatchingStateChangeUp

[GitHub] [flink] dmvk opened a new pull request #16720: [FLINK-23507] Use IP address of a kubernetes node when constructing node port connection string for the REST gateway.

2021-08-05 Thread GitBox
dmvk opened a new pull request #16720: URL: https://github.com/apache/flink/pull/16720 ## What is the purpose of the change Currently, we've been using kubernetes api server url, when constructing the connection string for REST gateway. While this might work in some cases (eg. api i

[jira] [Updated] (FLINK-23507) The node IP obtained in NodePort mode is a VIP

2021-08-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-23507: --- Labels: pull-request-available (was: ) > The node IP obtained in NodePort mode is a VIP > -

[GitHub] [flink] flinkbot commented on pull request #16719: [FLINK-23634][tests] Explicitly trigger scheduled tasks

2021-08-05 Thread GitBox
flinkbot commented on pull request #16719: URL: https://github.com/apache/flink/pull/16719#issuecomment-893275439 Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community to review your pull request. We will use this comment to track the pro

[GitHub] [flink] flinkbot commented on pull request #16720: [FLINK-23507] Use IP address of a kubernetes node when constructing node port connection string for the REST gateway.

2021-08-05 Thread GitBox
flinkbot commented on pull request #16720: URL: https://github.com/apache/flink/pull/16720#issuecomment-893276887 Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community to review your pull request. We will use this comment to track the pro

[jira] [Comment Edited] (FLINK-23635) PrestoS3FileSystemITCase.testConfigKeysForwarding

2021-08-05 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-23635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393673#comment-17393673 ] Ingo Bürk edited comment on FLINK-23635 at 8/5/21, 8:39 AM:

[jira] [Updated] (FLINK-22382) ProcessFailureCancelingITCase.testCancelingOnProcessFailure

2021-08-05 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song updated FLINK-22382: - Fix Version/s: (was: 1.13.2) 1.13.3 > ProcessFailureCancelingITCase.testC

[jira] [Updated] (FLINK-23605) An exception was thrown when the metric was reported by PrometheusPushGatewayReporter

2021-08-05 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song updated FLINK-23605: - Fix Version/s: (was: 1.13.2) 1.13.3 > An exception was thrown when the me

[jira] [Updated] (FLINK-22312) YARNSessionFIFOSecuredITCase>YARNSessionFIFOITCase.checkForProhibitedLogContents due to the heartbeat exception with Yarn RM

2021-08-05 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song updated FLINK-22312: - Fix Version/s: (was: 1.13.2) 1.13.3 > YARNSessionFIFOSecuredITCase>YARNSe

[jira] [Updated] (FLINK-22545) JVM crashes when runing OperatorEventSendingCheckpointITCase.testOperatorEventAckLost

2021-08-05 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song updated FLINK-22545: - Fix Version/s: (was: 1.13.2) 1.13.3 > JVM crashes when runing > Operator

[jira] [Updated] (FLINK-20975) HiveTableSourceITCase.testPartitionFilter fails on AZP

2021-08-05 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song updated FLINK-20975: - Fix Version/s: (was: 1.13.2) 1.13.3 > HiveTableSourceITCase.testPartition

[jira] [Updated] (FLINK-23147) ThreadPools can be poisoned by context class loaders

2021-08-05 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler updated FLINK-23147: - Priority: Minor (was: Major) > ThreadPools can be poisoned by context class loaders > -

[jira] [Updated] (FLINK-23147) ThreadPools can be poisoned by context class loaders

2021-08-05 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler updated FLINK-23147: - Fix Version/s: (was: 1.14.0) 1.15.0 > ThreadPools can be poisoned

[jira] [Updated] (FLINK-22885) Support 'SHOW COLUMNS'.

2021-08-05 Thread Roc Marshal (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roc Marshal updated FLINK-22885: Description: h1. Support 'SHOW COLUMNS'. SHOW COLUMNS ( FROM | IN ) [ [NOT] LIKE ] was: h1. S

[GitHub] [flink] flinkbot edited a comment on pull request #16620: [FLINK-23246][table-planner] Refactor the time indicator materialization

2021-08-05 Thread GitBox
flinkbot edited a comment on pull request #16620: URL: https://github.com/apache/flink/pull/16620#issuecomment-888120908 ## CI report: * 12c0dbb7a1359053f4804910f58f06434e542dad UNKNOWN * 0e8d829121b4c048f171a7ae1f9296f789d68316 Azure: [FAILURE](https://dev.azure.com/apache-fl

[GitHub] [flink] curcur commented on a change in pull request #16606: [FLINK-21357][runtime/statebackend]Periodic materialization for generalized incremental checkpoints

2021-08-05 Thread GitBox
curcur commented on a change in pull request #16606: URL: https://github.com/apache/flink/pull/16606#discussion_r683253454 ## File path: flink-state-backends/flink-statebackend-changelog/src/main/java/org/apache/flink/state/changelog/ChangelogKeyedStateBackend.java ## @@ -329,

[GitHub] [flink] flinkbot edited a comment on pull request #16710: [FLINK-23560][task] Fix performance regression by unnecessary throughput calculations

2021-08-05 Thread GitBox
flinkbot edited a comment on pull request #16710: URL: https://github.com/apache/flink/pull/16710#issuecomment-892620323 ## CI report: * 7922535840bddd7d194a154e6bade41b42d08b93 Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/result

[GitHub] [flink] flinkbot edited a comment on pull request #16705: [BP-1.13][FLINK-22382][tests] Harden ProcessFailureCancelingITCase.testCancelingOnProcessFailure

2021-08-05 Thread GitBox
flinkbot edited a comment on pull request #16705: URL: https://github.com/apache/flink/pull/16705#issuecomment-892583108 ## CI report: * e7a457dcb25dd902aff51f7d02d39afc2eef6a95 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/result

[GitHub] [flink] flinkbot edited a comment on pull request #16717: [FLINK-23487][FLINK-23635][s3] Update aws and presto-hive

2021-08-05 Thread GitBox
flinkbot edited a comment on pull request #16717: URL: https://github.com/apache/flink/pull/16717#issuecomment-893219203 ## CI report: * 6eb2aa5bc27700ed17f2952f11f16e185f0fdbaf Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/result

[GitHub] [flink] flinkbot edited a comment on pull request #16718: [FLINK-23579][table-runtime] Fix compile exception in hash functions with varbinary arguments

2021-08-05 Thread GitBox
flinkbot edited a comment on pull request #16718: URL: https://github.com/apache/flink/pull/16718#issuecomment-893255641 ## CI report: * a37cc11a04c5e4ccd7f47fbd94142b09f035b899 Azure: [PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/result

[GitHub] [flink] fapaul commented on pull request #16693: [FLINK-23509][connectors/kafka] Create new ProducerIdAndEpoch when re…

2021-08-05 Thread GitBox
fapaul commented on pull request #16693: URL: https://github.com/apache/flink/pull/16693#issuecomment-893281517 @klam-shop Thanks for your test I have adjusted the code to not rely on the full package name and instead derive the class from the field. I think this should make it a bit more

[jira] [Updated] (FLINK-23507) The node IP obtained in NodePort mode is a VIP

2021-08-05 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-23507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Morávek updated FLINK-23507: -- Fix Version/s: 1.14.0 > The node IP obtained in NodePort mode is a VIP > -

[GitHub] [flink] curcur commented on a change in pull request #16606: [FLINK-21357][runtime/statebackend]Periodic materialization for generalized incremental checkpoints

2021-08-05 Thread GitBox
curcur commented on a change in pull request #16606: URL: https://github.com/apache/flink/pull/16606#discussion_r683258246 ## File path: flink-core/src/main/java/org/apache/flink/api/common/ExecutionConfig.java ## @@ -127,13 +128,29 @@ private boolean forceAvro = false;

[GitHub] [flink] rkhachatryan commented on pull request #16615: [FLINK-23437][jdbc] Add an option to (dis)allow XA transaction multiplexing

2021-08-05 Thread GitBox
rkhachatryan commented on pull request #16615: URL: https://github.com/apache/flink/pull/16615#issuecomment-893284017 Thanks for the review. The build failed because of FLINK-23518 (which is fixed but this PR doesn't include c8644c8f0a21e6052e4a7515b794984920d65073). Private build [s

[jira] [Created] (FLINK-23638) Field names are not kept after apply ProjectToWindowRule#ProjectToLogicalProjectAndWindowRule

2021-08-05 Thread JING ZHANG (Jira)
JING ZHANG created FLINK-23638: -- Summary: Field names are not kept after apply ProjectToWindowRule#ProjectToLogicalProjectAndWindowRule Key: FLINK-23638 URL: https://issues.apache.org/jira/browse/FLINK-23638

[GitHub] [flink] curcur commented on a change in pull request #16606: [FLINK-21357][runtime/statebackend]Periodic materialization for generalized incremental checkpoints

2021-08-05 Thread GitBox
curcur commented on a change in pull request #16606: URL: https://github.com/apache/flink/pull/16606#discussion_r683258886 ## File path: flink-core/src/main/java/org/apache/flink/configuration/StateBackendOptions.java ## @@ -88,4 +88,35 @@ .defaultValue(12

[GitHub] [flink] rkhachatryan merged pull request #16615: [FLINK-23437][jdbc] Add an option to (dis)allow XA transaction multiplexing

2021-08-05 Thread GitBox
rkhachatryan merged pull request #16615: URL: https://github.com/apache/flink/pull/16615 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-un

[GitHub] [flink] beyond1920 commented on a change in pull request #16620: [FLINK-23246][table-planner] Refactor the time indicator materialization

2021-08-05 Thread GitBox
beyond1920 commented on a change in pull request #16620: URL: https://github.com/apache/flink/pull/16620#discussion_r683259475 ## File path: flink-table/flink-table-planner/src/test/resources/org/apache/flink/table/planner/plan/stream/sql/DeduplicateTest.xml ## @@ -207,7 +207,

[GitHub] [flink] curcur commented on a change in pull request #16606: [FLINK-21357][runtime/statebackend]Periodic materialization for generalized incremental checkpoints

2021-08-05 Thread GitBox
curcur commented on a change in pull request #16606: URL: https://github.com/apache/flink/pull/16606#discussion_r683259635 ## File path: flink-core/src/main/java/org/apache/flink/api/common/ExecutionConfig.java ## @@ -127,13 +128,29 @@ private boolean forceAvro = false;

[jira] [Updated] (FLINK-22767) Optimize the initialization of LocalInputPreferredSlotSharingStrategy

2021-08-05 Thread Zhilong Hong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhilong Hong updated FLINK-22767: - Description: Based on the scheduler benchmark introduced in FLINK-21731, we find that during th

[jira] [Updated] (FLINK-22767) Optimize the initialization of LocalInputPreferredSlotSharingStrategy

2021-08-05 Thread Zhilong Hong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhilong Hong updated FLINK-22767: - Description: Based on the scheduler benchmark introduced in FLINK-21731, we find that during th

[jira] [Created] (FLINK-23639) Migrate Table API to new KafkaSink

2021-08-05 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-23639: --- Summary: Migrate Table API to new KafkaSink Key: FLINK-23639 URL: https://issues.apache.org/jira/browse/FLINK-23639 Project: Flink Issue Type: Sub-task

[GitHub] [flink] JingsongLi commented on a change in pull request #16699: [FLINK-23420][table-runtime] LinkedListSerializer now checks for null elements in the list

2021-08-05 Thread GitBox
JingsongLi commented on a change in pull request #16699: URL: https://github.com/apache/flink/pull/16699#discussion_r683263937 ## File path: flink-table/flink-table-runtime/src/main/java/org/apache/flink/table/runtime/typeutils/LinkedListSerializer.java ## @@ -186,12 +267,28 @

[GitHub] [flink] JingsongLi commented on a change in pull request #16699: [FLINK-23420][table-runtime] LinkedListSerializer now checks for null elements in the list

2021-08-05 Thread GitBox
JingsongLi commented on a change in pull request #16699: URL: https://github.com/apache/flink/pull/16699#discussion_r683264310 ## File path: flink-table/flink-table-runtime/src/main/java/org/apache/flink/table/runtime/typeutils/LinkedListSerializer.java ## @@ -39,18 +39,27 @@

[GitHub] [flink] JingsongLi commented on a change in pull request #16699: [FLINK-23420][table-runtime] LinkedListSerializer now checks for null elements in the list

2021-08-05 Thread GitBox
JingsongLi commented on a change in pull request #16699: URL: https://github.com/apache/flink/pull/16699#discussion_r683264663 ## File path: flink-table/flink-table-runtime/src/main/java/org/apache/flink/table/runtime/typeutils/LinkedListSerializer.java ## @@ -186,12 +267,28 @

[GitHub] [flink] fapaul commented on a change in pull request #16676: [FLINK-22902] Port KafkaSink to FLIP-143

2021-08-05 Thread GitBox
fapaul commented on a change in pull request #16676: URL: https://github.com/apache/flink/pull/16676#discussion_r683265825 ## File path: flink-tests/src/test/java/org/apache/flink/test/checkpointing/UnalignedCheckpointTestBase.java ## @@ -165,35 +161,11 @@ protected File execu

[GitHub] [flink] Myasuka commented on a change in pull request #16719: [FLINK-23634][tests] Explicitly trigger scheduled tasks

2021-08-05 Thread GitBox
Myasuka commented on a change in pull request #16719: URL: https://github.com/apache/flink/pull/16719#discussion_r683266809 ## File path: flink-dstl/flink-dstl-dfs/src/test/java/org/apache/flink/changelog/fs/BatchingStateChangeUploaderTest.java ## @@ -94,14 +97,23 @@ public vo

[GitHub] [flink] curcur commented on a change in pull request #16606: [FLINK-21357][runtime/statebackend]Periodic materialization for generalized incremental checkpoints

2021-08-05 Thread GitBox
curcur commented on a change in pull request #16606: URL: https://github.com/apache/flink/pull/16606#discussion_r683267945 ## File path: flink-state-backends/flink-statebackend-changelog/src/main/java/org/apache/flink/state/changelog/materializer/PeriodicMaterializer.java ## @

[GitHub] [flink] rkhachatryan commented on a change in pull request #16719: [FLINK-23634][tests] Explicitly trigger scheduled tasks

2021-08-05 Thread GitBox
rkhachatryan commented on a change in pull request #16719: URL: https://github.com/apache/flink/pull/16719#discussion_r683268095 ## File path: flink-dstl/flink-dstl-dfs/src/test/java/org/apache/flink/changelog/fs/BatchingStateChangeUploaderTest.java ## @@ -94,14 +97,23 @@ publ

[GitHub] [flink] rkhachatryan commented on a change in pull request #16719: [FLINK-23634][tests] Explicitly trigger scheduled tasks

2021-08-05 Thread GitBox
rkhachatryan commented on a change in pull request #16719: URL: https://github.com/apache/flink/pull/16719#discussion_r683268095 ## File path: flink-dstl/flink-dstl-dfs/src/test/java/org/apache/flink/changelog/fs/BatchingStateChangeUploaderTest.java ## @@ -94,14 +97,23 @@ publ

[GitHub] [flink] pnowojski commented on a change in pull request #16655: [FLINK-23512][runtime][checkpoint] Check for illegal modifications of JobGraph with partially finished operators

2021-08-05 Thread GitBox
pnowojski commented on a change in pull request #16655: URL: https://github.com/apache/flink/pull/16655#discussion_r683269734 ## File path: flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/metadata/MetadataV3Serializer.java ## @@ -114,8 +115,14 @@ protected void

[jira] [Commented] (FLINK-23495) [GCP PubSub] Make checkpoint optional for preview/staging mode

2021-08-05 Thread Nico Kruber (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393734#comment-17393734 ] Nico Kruber commented on FLINK-23495: - Messages are only acknowledged once the check

[GitHub] [flink] curcur commented on a change in pull request #16606: [FLINK-21357][runtime/statebackend]Periodic materialization for generalized incremental checkpoints

2021-08-05 Thread GitBox
curcur commented on a change in pull request #16606: URL: https://github.com/apache/flink/pull/16606#discussion_r683270450 ## File path: flink-state-backends/flink-statebackend-changelog/src/main/java/org/apache/flink/state/changelog/materializer/AsyncExceptionHandler.java ##

[jira] [Comment Edited] (FLINK-23005) Cache the compressed serialized value of ShuffleDescriptors

2021-08-05 Thread Zhilong Hong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17386867#comment-17386867 ] Zhilong Hong edited comment on FLINK-23005 at 8/5/21, 9:07 AM: ---

[GitHub] [flink] flinkbot edited a comment on pull request #16430: [FLINK-23032][hive] Refactor HiveSource to make it usable in data str…

2021-08-05 Thread GitBox
flinkbot edited a comment on pull request #16430: URL: https://github.com/apache/flink/pull/16430#issuecomment-876373125 ## CI report: * cfb2e0d3673720c658d525008f709ecd7afd1fb9 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/result

[GitHub] [flink] flinkbot edited a comment on pull request #16551: [FLINK-23255][test] Introduce JUnit 5 dependencies

2021-08-05 Thread GitBox
flinkbot edited a comment on pull request #16551: URL: https://github.com/apache/flink/pull/16551#issuecomment-883977463 ## CI report: * eb42585ca68ef7aae24b240d55098c829c50c283 Azure: [FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/result

[GitHub] [flink] flinkbot edited a comment on pull request #16620: [FLINK-23246][table-planner] Refactor the time indicator materialization

2021-08-05 Thread GitBox
flinkbot edited a comment on pull request #16620: URL: https://github.com/apache/flink/pull/16620#issuecomment-888120908 ## CI report: * 12c0dbb7a1359053f4804910f58f06434e542dad UNKNOWN * 0e8d829121b4c048f171a7ae1f9296f789d68316 Azure: [PENDING](https://dev.azure.com/apache-fl

[GitHub] [flink] flinkbot edited a comment on pull request #16692: [FLINK-23509][connectors/kafka] Create new ProducerIdAndEpoch when re…

2021-08-05 Thread GitBox
flinkbot edited a comment on pull request #16692: URL: https://github.com/apache/flink/pull/16692#issuecomment-891870165 ## CI report: * dcebe54c19ee58530db300a6919e9c43589a6753 Azure: [SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/result

  1   2   3   4   5   6   7   8   >