[jira] [Commented] (FLINK-34752) "legacy-flink-cdc-sources" Page of TIDB for Flink CDC Chinese Documentation.

2024-04-16 Thread LvYanquan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837975#comment-17837975 ] LvYanquan commented on FLINK-34752: --- [~siriusfan] Thanks for taking this, I don't have the authority

[jira] [Commented] (FLINK-35112) Membership for Row class does not include field names

2024-04-16 Thread Dian Fu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837965#comment-17837965 ] Dian Fu commented on FLINK-35112: - Great (y). Thanks [~wzorgdrager]  > Membership for Row class does

[jira] [Closed] (FLINK-35089) Two input AbstractStreamOperator may throw NPE when receiving RecordAttributes

2024-04-16 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-35089. Fix Version/s: 1.20.0 1.19.1 Resolution: Fixed - master (1.20):

Re: [PR] [FLINK-35089][runtime] Initialize lastRecordAttributes in AbstractStreamOperator during setup [flink]

2024-04-16 Thread via GitHub
xintongsong closed pull request #24655: [FLINK-35089][runtime] Initialize lastRecordAttributes in AbstractStreamOperator during setup URL: https://github.com/apache/flink/pull/24655 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] [FLINK-35125][state] Implement ValueState for ForStStateBackend [flink]

2024-04-16 Thread via GitHub
fredia commented on code in PR #24671: URL: https://github.com/apache/flink/pull/24671#discussion_r1568129118 ## flink-runtime/src/main/java/org/apache/flink/runtime/state/v2/InternalSyncState.java: ## @@ -0,0 +1,51 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[jira] [Updated] (FLINK-34907) jobRunningTs should be the timestamp that all tasks are running

2024-04-16 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan updated FLINK-34907: Description: Currently, we consider the timestamp that JobStatus is changed to RUNNING as jobRunningTs.

[jira] [Commented] (FLINK-35129) Postgres source commits the offset after every multiple checkpoint cycles.

2024-04-16 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837942#comment-17837942 ] Hongshun Wang commented on FLINK-35129: --- [~m.orazow] , would you like to take it? > Postgres

[jira] [Created] (FLINK-35129) Postgres source commits the offset after every multiple checkpoint cycles.

2024-04-16 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35129: - Summary: Postgres source commits the offset after every multiple checkpoint cycles. Key: FLINK-35129 URL: https://issues.apache.org/jira/browse/FLINK-35129

Re: [PR] [FLINK-35025][Runtime/State] Abstract stream operators for async state processing [flink]

2024-04-16 Thread via GitHub
Zakelly commented on code in PR #24657: URL: https://github.com/apache/flink/pull/24657#discussion_r1568151628 ## flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/operators/asyncprocessing/AsyncStateProcessing.java: ## @@ -34,19 +34,6 @@ public interface

Re: [PR] [FLINK-35025][Runtime/State] Abstract stream operators for async state processing [flink]

2024-04-16 Thread via GitHub
Zakelly commented on code in PR #24657: URL: https://github.com/apache/flink/pull/24657#discussion_r1568147623 ## flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/operators/asyncprocessing/AsyncStateProcessingOperator.java: ## @@ -0,0 +1,54 @@ +/* + *

Re: [PR] [FLINK-34987][state] Introduce Internal State for Async State API [flink]

2024-04-16 Thread via GitHub
masteryhx commented on PR #24651: URL: https://github.com/apache/flink/pull/24651#issuecomment-2060251285 Rebased master. I will merge it after the CI is green. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[jira] [Updated] (FLINK-35092) Add integrated test for Doris / Starrocks sink pipeline connector

2024-04-16 Thread Xiqian YU (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiqian YU updated FLINK-35092: -- Summary: Add integrated test for Doris / Starrocks sink pipeline connector (was: Add integrated test

[jira] [Updated] (FLINK-35071) Remove dependency on flink-shaded from cdc source connector

2024-04-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35071: --- Labels: pull-request-available (was: ) > Remove dependency on flink-shaded from cdc source

Re: [PR] [FLINK-35071][cdc-connector][cdc-base] Shade guava31 to avoid dependency conflict with flink below 1.18 [flink-cdc]

2024-04-16 Thread via GitHub
loserwang1024 commented on PR #3083: URL: https://github.com/apache/flink-cdc/pull/3083#issuecomment-2060246663 @PatrickRen , CC? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] [FLINK-34908][pipeline-connector][doris] Fix Mysql pipeline to doris will lost precision for timestamp [flink-cdc]

2024-04-16 Thread via GitHub
yuxiqian commented on code in PR #3207: URL: https://github.com/apache/flink-cdc/pull/3207#discussion_r1568134905 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-doris/src/main/java/org/apache/flink/cdc/connectors/doris/sink/DorisRowConverter.java:

Re: [PR] [FLINK-35128][cdc-connector][cdc-base] Re-calculate the starting changelog offset after the new table added [flink-cdc]

2024-04-16 Thread via GitHub
loserwang1024 commented on PR #3230: URL: https://github.com/apache/flink-cdc/pull/3230#issuecomment-2060235695 @PatrickRen , @morazow , CC -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Updated] (FLINK-35128) Re-calculate the starting change log offset after the new table added

2024-04-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35128: --- Labels: pull-request-available (was: ) > Re-calculate the starting change log offset after

[PR] [FLINK-35128][cdc-connector][cdc-base] Re-calculate the starting changelog offset after the new table added [flink-cdc]

2024-04-16 Thread via GitHub
loserwang1024 opened a new pull request, #3230: URL: https://github.com/apache/flink-cdc/pull/3230 In mysql cdc, re-calculate the starting binlog offset after the new table added in MySqlBinlogSplit#appendFinishedSplitInfos, while there lack of same action in

[jira] [Assigned] (FLINK-35028) Timer firing under async execution model

2024-04-16 Thread Yanfei Lei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanfei Lei reassigned FLINK-35028: -- Assignee: Yanfei Lei > Timer firing under async execution model >

[jira] [Resolved] (FLINK-35079) MongoConnector failed to resume token when current collection removed

2024-04-16 Thread Jiabao Sun (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiabao Sun resolved FLINK-35079. Fix Version/s: cdc-3.1.0 Resolution: Fixed resolved via cdc master:

Re: [PR] [FLINK-35079] Fallback to timestamp startup mode when resume token has expired [flink-cdc]

2024-04-16 Thread via GitHub
Jiabao-Sun merged PR #3221: URL: https://github.com/apache/flink-cdc/pull/3221 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Resolved] (FLINK-35046) Introduce New KeyedStateBackend related Async interfaces

2024-04-16 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu resolved FLINK-35046. -- Fix Version/s: 1.20.0 Resolution: Fixed merged 691cc671 into master. > Introduce New

Re: [PR] [FLINK-35046][state] Introduce AsyncKeyedStateBackend supporting to create StateExecutor [flink]

2024-04-16 Thread via GitHub
masteryhx closed pull request #24663: [FLINK-35046][state] Introduce AsyncKeyedStateBackend supporting to create StateExecutor URL: https://github.com/apache/flink/pull/24663 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[jira] [Updated] (FLINK-35128) Re-calculate the starting change log offset after the new table added

2024-04-16 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-35128: -- Description: In mysql cdc, re-calculate the starting binlog offset after the new table added

[jira] [Updated] (FLINK-35128) Re-calculate the starting change log offset after the new table added

2024-04-16 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongshun Wang updated FLINK-35128: -- Summary: Re-calculate the starting change log offset after the new table added (was:

[jira] [Created] (FLINK-35128) Re-calculate the starting binlog offset after the new table added

2024-04-16 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35128: - Summary: Re-calculate the starting binlog offset after the new table added Key: FLINK-35128 URL: https://issues.apache.org/jira/browse/FLINK-35128 Project: Flink

[jira] [Commented] (FLINK-35127) CDC ValuesDataSourceITCase crashed due to OutOfMemoryError

2024-04-16 Thread Jiabao Sun (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837929#comment-17837929 ] Jiabao Sun commented on FLINK-35127: Hi [~kunni], Could you help take a look? > CDC

[jira] [Created] (FLINK-35127) CDC ValuesDataSourceITCase crashed due to OutOfMemoryError

2024-04-16 Thread Jiabao Sun (Jira)
Jiabao Sun created FLINK-35127: -- Summary: CDC ValuesDataSourceITCase crashed due to OutOfMemoryError Key: FLINK-35127 URL: https://issues.apache.org/jira/browse/FLINK-35127 Project: Flink Issue

[PR] [docs]Problem with Case Document Format in Quickstart [flink-cdc]

2024-04-16 Thread via GitHub
ZmmBigdata opened a new pull request, #3229: URL: https://github.com/apache/flink-cdc/pull/3229 There is an issue with the format of three shell scripts ![cf9c895cc2a90e65946ffd620217f48](https://github.com/apache/flink-cdc/assets/102840730/35bdf1d9-cbeb-404a-8eed-4330aad445b9)

Re: [PR] [FLINK-35025][Runtime/State] Abstract stream operators for async state processing [flink]

2024-04-16 Thread via GitHub
yunfengzhou-hub commented on code in PR #24657: URL: https://github.com/apache/flink/pull/24657#discussion_r1567131634 ## flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/operators/asyncprocessing/AsyncStateProcessingOperator.java: ## @@ -0,0 +1,54 @@ +/* +

Re: [PR] [FLINK-34444] Initial implementation of JM operator metric rest api [flink]

2024-04-16 Thread via GitHub
mas-chen commented on code in PR #24564: URL: https://github.com/apache/flink/pull/24564#discussion_r1568044466 ## docs/static/generated/rest_v1_dispatcher.yml: ## @@ -1089,6 +1089,37 @@ paths: application/json: schema: $ref:

Re: [PR] [FLINK-34444] Initial implementation of JM operator metric rest api [flink]

2024-04-16 Thread via GitHub
mas-chen commented on code in PR #24564: URL: https://github.com/apache/flink/pull/24564#discussion_r1568044466 ## docs/static/generated/rest_v1_dispatcher.yml: ## @@ -1089,6 +1089,37 @@ paths: application/json: schema: $ref:

Re: [PR] [FLINK-35116] Bump operator sdk version to 4.8.3 [flink-kubernetes-operator]

2024-04-16 Thread via GitHub
gyfora commented on PR #816: URL: https://github.com/apache/flink-kubernetes-operator/pull/816#issuecomment-2059797010 Together with the version bump, this workaround can also be removed I believe:

[jira] [Updated] (FLINK-31966) Flink Kubernetes operator lacks TLS support

2024-04-16 Thread Adrian Vasiliu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adrian Vasiliu updated FLINK-31966: --- Attachment: (was: image-2024-04-16-16-33-39-644.png) > Flink Kubernetes operator lacks

Re: [PR] [FLINK-34961] Use dedicated CI name for HBase connector to differentiate it in infra-reports [flink-connector-hbase]

2024-04-16 Thread via GitHub
snuyanzin merged PR #45: URL: https://github.com/apache/flink-connector-hbase/pull/45 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Created] (FLINK-35126) Improve checkpoint progress health check config and enable by default

2024-04-16 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-35126: -- Summary: Improve checkpoint progress health check config and enable by default Key: FLINK-35126 URL: https://issues.apache.org/jira/browse/FLINK-35126 Project: Flink

[jira] [Commented] (FLINK-34653) Support table merging with route in Flink CDC

2024-04-16 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837752#comment-17837752 ] Leonard Xu commented on FLINK-34653: master via 6017b165289d8e6f40db396cd07c62285be7fca9 > Support

[jira] [Updated] (FLINK-34653) Support table merging with route in Flink CDC

2024-04-16 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu updated FLINK-34653: --- Release Note: (was: master via 6017b165289d8e6f40db396cd07c62285be7fca9) > Support table merging

[jira] [Closed] (FLINK-34653) Support table merging with route in Flink CDC

2024-04-16 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu closed FLINK-34653. -- Release Note: master via 6017b165289d8e6f40db396cd07c62285be7fca9 Resolution: Fixed > Support

Re: [PR] [FLINK-34653] Support table merging with route [flink-cdc]

2024-04-16 Thread via GitHub
leonardBang merged PR #3129: URL: https://github.com/apache/flink-cdc/pull/3129 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [e2e] add pipeline e2e test for mysql connector. [flink-cdc]

2024-04-16 Thread via GitHub
leonardBang commented on PR #2997: URL: https://github.com/apache/flink-cdc/pull/2997#issuecomment-2059264100 @lvyanquan kindly ping -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] [FLINK-34648] add waitChangeResultRequest and WaitChangeResultResponse to avoid RPC timeout. [flink-cdc]

2024-04-16 Thread via GitHub
leonardBang commented on code in PR #3128: URL: https://github.com/apache/flink-cdc/pull/3128#discussion_r1567483688 ## flink-cdc-common/src/main/java/org/apache/flink/cdc/common/pipeline/PipelineOptions.java: ## @@ -85,5 +89,12 @@ public class PipelineOptions {

[jira] [Updated] (FLINK-31966) Flink Kubernetes operator lacks TLS support

2024-04-16 Thread Adrian Vasiliu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adrian Vasiliu updated FLINK-31966: --- Attachment: image-2024-04-16-16-33-39-644.png > Flink Kubernetes operator lacks TLS support

Re: [PR] [FLINK-34961] Use dedicated CI name for Hbase connector to differentiate it in infra-reports [flink-connector-hbase]

2024-04-16 Thread via GitHub
snuyanzin merged PR #44: URL: https://github.com/apache/flink-connector-hbase/pull/44 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [FLINK-34961] Use dedicated CI name for Hbase connector to differentiate it in infra-reports [flink-connector-hbase]

2024-04-16 Thread via GitHub
snuyanzin commented on PR #44: URL: https://github.com/apache/flink-connector-hbase/pull/44#issuecomment-2059202176 Thanks for taking a look -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[PR] [FLINK-34961] Use dedicated CI name for Hbase connector to differentiate it in infra-reports [flink-connector-hbase]

2024-04-16 Thread via GitHub
snuyanzin opened a new pull request, #44: URL: https://github.com/apache/flink-connector-hbase/pull/44 The PR will allow to differentiate between Hbase connector statistics and others with name ci -- This is an automated message from the Apache Git Service. To respond to the

[jira] [Updated] (FLINK-34878) [Feature][Pipeline] Flink CDC pipeline transform supports CASE WHEN

2024-04-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-34878: --- Labels: github-import pull-request-available (was: github-import) > [Feature][Pipeline]

[jira] [Closed] (FLINK-33440) Bump flink version on flink-connectors-hbase

2024-04-16 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin closed FLINK-33440. --- > Bump flink version on flink-connectors-hbase > >

[jira] [Resolved] (FLINK-33440) Bump flink version on flink-connectors-hbase

2024-04-16 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin resolved FLINK-33440. - Fix Version/s: hbase-4.0.0 Resolution: Fixed > Bump flink version on

[jira] [Commented] (FLINK-33440) Bump flink version on flink-connectors-hbase

2024-04-16 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837705#comment-17837705 ] Sergey Nuyanzin commented on FLINK-33440: - Merged as

Re: [PR] [FLINK-35116] Bump operator sdk version to 4.8.3 [flink-kubernetes-operator]

2024-04-16 Thread via GitHub
csviri commented on code in PR #816: URL: https://github.com/apache/flink-kubernetes-operator/pull/816#discussion_r1567338233 ## flink-kubernetes-operator-api/src/main/java/org/apache/flink/kubernetes/operator/api/validation/CrdCompatibilityChecker.java: ## @@ -93,7 +93,10 @@

[jira] [Assigned] (FLINK-33440) Bump flink version on flink-connectors-hbase

2024-04-16 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin reassigned FLINK-33440: --- Assignee: Ferenc Csaky > Bump flink version on flink-connectors-hbase >

Re: [PR] [FLINK-33440] Update Flink version matrix, add 1.19-SNAPSHOT to GH workflows, update flink-connector-parent [flink-connector-hbase]

2024-04-16 Thread via GitHub
snuyanzin merged PR #35: URL: https://github.com/apache/flink-connector-hbase/pull/35 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [FLINK-35116] Bump operator sdk version to 4.8.3 [flink-kubernetes-operator]

2024-04-16 Thread via GitHub
mbalassi commented on PR #816: URL: https://github.com/apache/flink-kubernetes-operator/pull/816#issuecomment-2059011676 I will take a look at the test failure later, it is a timeout in `AbstractFlinkServiceTest#testBlockingDeploymentDeletion`. I managed to reproduce it locally. --

Re: [PR] [FLINK-35028][runtime] Timer firing under async execution model [flink]

2024-04-16 Thread via GitHub
flinkbot commented on PR #24672: URL: https://github.com/apache/flink/pull/24672#issuecomment-2059006200 ## CI report: * 6507dc0d38dec17e91fa3f722cd924ca82197622 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-34444] Initial implementation of JM operator metric rest api [flink]

2024-04-16 Thread via GitHub
afedulov commented on code in PR #24564: URL: https://github.com/apache/flink/pull/24564#discussion_r1567286518 ## docs/static/generated/rest_v1_dispatcher.yml: ## @@ -1089,6 +1089,37 @@ paths: application/json: schema: $ref:

[jira] [Updated] (FLINK-35028) Timer firing under async execution model

2024-04-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35028: --- Labels: pull-request-available (was: ) > Timer firing under async execution model >

[PR] [FLINK-35028][runtime] Timer firing under async execution model [flink]

2024-04-16 Thread via GitHub
fredia opened a new pull request, #24672: URL: https://github.com/apache/flink/pull/24672 ## What is the purpose of the change This PR adapts timer firing to async state execution. The entrances are `AbstractAsyncStateStreamOperator ` and `AbstractAsyncStateStreamOperatorV2`,

Re: [PR] [FLINK-32877][Filesystem]add HTTP options to gcs-cloud-storage client [flink]

2024-04-16 Thread via GitHub
dfontana commented on PR #23226: URL: https://github.com/apache/flink/pull/23226#issuecomment-2058978531 Hi @singhravidutt thank you for your efforts; are you actively working on this PR? I am also interested in seeing this land; am happy to help where needed -- This is an automated

Re: [PR] [FLINK-35125][state] Implement ValueState for ForStStateBackend [flink]

2024-04-16 Thread via GitHub
flinkbot commented on PR #24671: URL: https://github.com/apache/flink/pull/24671#issuecomment-2058974205 ## CI report: * f4b1a4374cc6c579ff50e5b09bb5715b386645d2 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-35125) Implement ValueState for ForStStateBackend

2024-04-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35125: --- Labels: pull-request-available (was: ) > Implement ValueState for ForStStateBackend >

[PR] [FLINK-35125][state] Implement ValueState for ForStStateBackend [flink]

2024-04-16 Thread via GitHub
ljz2051 opened a new pull request, #24671: URL: https://github.com/apache/flink/pull/24671 ## What is the purpose of the change This pull request implements the ValueState for ForStStateBackend. ## Brief change log - Define the InternalSyncState interfaces in

[jira] [Created] (FLINK-35125) Implement ValueState for ForStStateBackend

2024-04-16 Thread Jinzhong Li (Jira)
Jinzhong Li created FLINK-35125: --- Summary: Implement ValueState for ForStStateBackend Key: FLINK-35125 URL: https://issues.apache.org/jira/browse/FLINK-35125 Project: Flink Issue Type:

Re: [PR] [FLINK-33440] Update Flink version matrix, add 1.19-SNAPSHOT to GH workflows, update flink-connector-parent [flink-connector-hbase]

2024-04-16 Thread via GitHub
ferenc-csaky commented on PR #35: URL: https://github.com/apache/flink-connector-hbase/pull/35#issuecomment-2058924269 @snuyanzin I fixed the dep convergence for 1.19 the last CI run failed on, also had to change `HBaseTablePlanTest` as the JUnit5 migration for `TableTestBase` in the core

Re: [PR] [FLINK-35025][Runtime/State] Abstract stream operators for async state processing [flink]

2024-04-16 Thread via GitHub
Zakelly commented on code in PR #24657: URL: https://github.com/apache/flink/pull/24657#discussion_r1567158767 ## flink-runtime/src/main/java/org/apache/flink/runtime/asyncprocessing/StateRequestBuffer.java: ## @@ -59,6 +60,9 @@ public StateRequestBuffer() { } void

[jira] [Updated] (FLINK-35116) Upgrade JOSDK dependency to 4.8.3

2024-04-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35116: --- Labels: pull-request-available (was: ) > Upgrade JOSDK dependency to 4.8.3 >

[PR] [FLINK-35116] Bump operator sdk version to 4.8.3 [flink-kubernetes-operator]

2024-04-16 Thread via GitHub
mbalassi opened a new pull request, #816: URL: https://github.com/apache/flink-kubernetes-operator/pull/816 Also bumps fabric8 client 6.11.0 to harmonize it with JOSDK. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[PR] Adding AWS Connectors v4.3.0 [flink-web]

2024-04-16 Thread via GitHub
dannycranmer opened a new pull request, #733: URL: https://github.com/apache/flink-web/pull/733 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [FLINK-35045][state] Introduce ForStFlinkFileSystem to support reading and writing with ByteBuffer [flink]

2024-04-16 Thread via GitHub
Zakelly commented on code in PR #24632: URL: https://github.com/apache/flink/pull/24632#discussion_r1567124524 ## flink-state-backends/flink-statebackend-forst/src/main/java/org/apache/flink/state/forst/fs/ByteBufferReadableFSDataInputStream.java: ## @@ -0,0 +1,195 @@ +/* + *

[jira] [Updated] (FLINK-33991) Custom Error Handling for Kinesis Polling Consumer

2024-04-16 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-33991: -- Affects Version/s: (was: aws-connector-4.2.0) > Custom Error Handling for Kinesis Polling

[jira] [Updated] (FLINK-32007) Implement Python Wrappers for DynamoDB Connector

2024-04-16 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-32007: -- Fix Version/s: aws-connector-4.4.0 (was: aws-connector-4.3.0) >

[jira] [Updated] (FLINK-33259) flink-connector-aws should use/extend the common connector workflow

2024-04-16 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-33259: -- Fix Version/s: aws-connector-4.4.0 (was: aws-connector-4.3.0) >

[jira] [Updated] (FLINK-33259) flink-connector-aws should use/extend the common connector workflow

2024-04-16 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-33259: -- Affects Version/s: aws-connector-4.3.0 > flink-connector-aws should use/extend the common

[jira] [Updated] (FLINK-33991) Custom Error Handling for Kinesis Polling Consumer

2024-04-16 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-33991: -- Fix Version/s: aws-connector-4.4.0 (was: aws-connector-4.3.0) > Custom

[jira] [Updated] (FLINK-31872) Add Support for Configuring AIMD Ratelimiting strategy parameters by Sink users for KinesisStreamsSink

2024-04-16 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-31872: -- Affects Version/s: (was: aws-connector-4.2.0) > Add Support for Configuring AIMD

[jira] [Updated] (FLINK-32116) FlinkKinesisConsumer cannot stop-with-savepoint when configured with watermark assigner and watermark tracker

2024-04-16 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-32116: -- Affects Version/s: aws-connector-4.3.0 > FlinkKinesisConsumer cannot stop-with-savepoint when

[jira] [Updated] (FLINK-25779) Define ConfigOption for aws, scan and sink map in Kinesis

2024-04-16 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-25779: -- Fix Version/s: aws-connector-4.4.0 (was: aws-connector-4.3.0) > Define

[jira] [Updated] (FLINK-31922) Port over Kinesis Client configurations for retry and backoff

2024-04-16 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-31922: -- Affects Version/s: aws-connector-4.3.0 > Port over Kinesis Client configurations for retry

[jira] [Updated] (FLINK-24379) Support AWS Glue Schema Registry Avro for Table API

2024-04-16 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-24379: -- Affects Version/s: (was: aws-connector-4.2.0) > Support AWS Glue Schema Registry Avro for

[jira] [Updated] (FLINK-31922) Port over Kinesis Client configurations for retry and backoff

2024-04-16 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-31922: -- Fix Version/s: aws-connector-4.4.0 (was: aws-connector-4.3.0) > Port

[jira] [Updated] (FLINK-32116) FlinkKinesisConsumer cannot stop-with-savepoint when configured with watermark assigner and watermark tracker

2024-04-16 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-32116: -- Fix Version/s: aws-connector-4.4.0 (was: aws-connector-4.3.0) >

[jira] [Updated] (FLINK-24379) Support AWS Glue Schema Registry Avro for Table API

2024-04-16 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-24379: -- Fix Version/s: aws-connector-4.4.0 (was: aws-connector-4.3.0) >

[jira] [Updated] (FLINK-25779) Define ConfigOption for aws, scan and sink map in Kinesis

2024-04-16 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-25779: -- Affects Version/s: aws-connector-4.3.0 > Define ConfigOption for aws, scan and sink map in

[jira] [Updated] (FLINK-31872) Add Support for Configuring AIMD Ratelimiting strategy parameters by Sink users for KinesisStreamsSink

2024-04-16 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-31872: -- Fix Version/s: aws-connector-4.4.0 (was: aws-connector-4.3.0) > Add

[jira] [Commented] (FLINK-35124) Connector Release Fails to run Checkstyle

2024-04-16 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837654#comment-17837654 ] Danny Cranmer commented on FLINK-35124: --- [~echauchot] do you recall why the tools directory was

[jira] [Created] (FLINK-35124) Connector Release Fails to run Checkstyle

2024-04-16 Thread Danny Cranmer (Jira)
Danny Cranmer created FLINK-35124: - Summary: Connector Release Fails to run Checkstyle Key: FLINK-35124 URL: https://issues.apache.org/jira/browse/FLINK-35124 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-35041) IncrementalRemoteKeyedStateHandleTest.testSharedStateReRegistration failed

2024-04-16 Thread Ryan Skraba (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837647#comment-17837647 ] Ryan Skraba commented on FLINK-35041: - 1.20 test_ci core

[jira] [Commented] (FLINK-35041) IncrementalRemoteKeyedStateHandleTest.testSharedStateReRegistration failed

2024-04-16 Thread Ryan Skraba (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837642#comment-17837642 ] Ryan Skraba commented on FLINK-35041: - * 1.20 Java 11: Test (module: core)

[jira] [Commented] (FLINK-34919) WebMonitorEndpointTest.cleansUpExpiredExecutionGraphs fails starting REST server

2024-04-16 Thread Ryan Skraba (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837643#comment-17837643 ] Ryan Skraba commented on FLINK-34919: - 1.19 Java 21: Test (module: core)

Re: [PR] [FLINK-35025][Runtime/State] Abstract stream operators for async state processing [flink]

2024-04-16 Thread via GitHub
fredia commented on code in PR #24657: URL: https://github.com/apache/flink/pull/24657#discussion_r1567096409 ## flink-runtime/src/main/java/org/apache/flink/runtime/asyncprocessing/StateRequestBuffer.java: ## @@ -59,6 +60,9 @@ public StateRequestBuffer() { } void

[jira] [Commented] (FLINK-35002) GitHub action/upload-artifact@v4 can timeout

2024-04-16 Thread Ryan Skraba (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837641#comment-17837641 ] Ryan Skraba commented on FLINK-35002: - 1.20 AdaptiveScheduler: Compile

Re: [PR] [FLINK-25537] [JUnit5 Migration] Module: flink-core with,Package: util [flink]

2024-04-16 Thread via GitHub
flinkbot commented on PR #24670: URL: https://github.com/apache/flink/pull/24670#issuecomment-2058604771 ## CI report: * aae449392b8ce075a2413679ed2a0c42eaa52c68 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-35025][Runtime/State] Abstract stream operators for async state processing [flink]

2024-04-16 Thread via GitHub
fredia commented on code in PR #24657: URL: https://github.com/apache/flink/pull/24657#discussion_r1567004818 ## flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/io/RecordProcessorUtils.java: ## @@ -82,6 +87,10 @@ public static ThrowingConsumer,

Re: [PR] [FLINK-34961] Use dedicated CI name for Pulsar connector to differentiate it in infra-reports [flink-connector-pulsar]

2024-04-16 Thread via GitHub
snuyanzin merged PR #89: URL: https://github.com/apache/flink-connector-pulsar/pull/89 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (FLINK-35123) Flink Kubernetes Operator should not do deleteHAData

2024-04-16 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837610#comment-17837610 ] Gyula Fora commented on FLINK-35123: I agree that if the rest api is accessible we could call

Re: [PR] [FLINK-34961] Use dedicated CI name for Pulsar connector to differentiate it in infra-reports [flink-connector-pulsar]

2024-04-16 Thread via GitHub
snuyanzin commented on PR #89: URL: https://github.com/apache/flink-connector-pulsar/pull/89#issuecomment-2058580128 yep, thanks for noticing it however i guess it is worth discussion first to change it thanks for taking a look -- This is an automated message from the Apache Git

Re: [PR] [FLINK-25537] [JUnit5 Migration] Module: flink-core with,Package: util [flink]

2024-04-16 Thread via GitHub
GOODBOY008 commented on PR #24670: URL: https://github.com/apache/flink/pull/24670#issuecomment-2058579166 @Jiabao-Sun @1996fanrui PTAL -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] [FLINK-34549][API] Introduce config, context and processingTimerService for DataStream API V2 [flink]

2024-04-16 Thread via GitHub
reswqa commented on code in PR #24541: URL: https://github.com/apache/flink/pull/24541#discussion_r1566991099 ## flink-datastream-api/src/main/java/org/apache/flink/datastream/api/context/TimestampManager.java: ## @@ -0,0 +1,35 @@ +/* + * Licensed to the Apache Software

Re: [PR] [FLINK-34549][API] Introduce config, context and processingTimerService for DataStream API V2 [flink]

2024-04-16 Thread via GitHub
reswqa commented on code in PR #24541: URL: https://github.com/apache/flink/pull/24541#discussion_r1566988135 ## flink-datastream-api/src/main/java/org/apache/flink/datastream/api/context/StateManager.java: ## @@ -0,0 +1,35 @@ +/* + * Licensed to the Apache Software Foundation

Re: [PR] [FLINK-34549][API] Introduce config, context and processingTimerService for DataStream API V2 [flink]

2024-04-16 Thread via GitHub
reswqa commented on code in PR #24541: URL: https://github.com/apache/flink/pull/24541#discussion_r1566978504 ## flink-datastream/src/main/java/org/apache/flink/datastream/impl/stream/ProcessConfigurableDataStream.java: ## @@ -0,0 +1,72 @@ +/* + * Licensed to the Apache

  1   2   >