[jira] [Created] (FLINK-35508) Use OceanBase LTS version Docker image in testing

2024-06-03 Thread He Wang (Jira)
He Wang created FLINK-35508: --- Summary: Use OceanBase LTS version Docker image in testing Key: FLINK-35508 URL: https://issues.apache.org/jira/browse/FLINK-35508 Project: Flink Issue Type: Improveme

[PR] [cdc][mysql]Code optimization extracts constants [flink-cdc]

2024-06-03 Thread via GitHub
ChengJie1053 opened a new pull request, #3385: URL: https://github.com/apache/flink-cdc/pull/3385 Code optimization extracts constants -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] [FLINK-34572] Support OceanBase Jdbc Catalog [flink-connector-jdbc]

2024-06-03 Thread via GitHub
whhe commented on PR #109: URL: https://github.com/apache/flink-connector-jdbc/pull/109#issuecomment-2144456254 @eskabetxe PTAL -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

Re: [PR] put more relevant link to the Scala wrapper [flink-web]

2024-06-03 Thread via GitHub
novakov-alexey commented on PR #670: URL: https://github.com/apache/flink-web/pull/670#issuecomment-2144465518 Can someone merge this PR finally? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

Re: [PR] [FLINK-35129][cdc][postgres] Add checkpoint cycle option for commit offsets [flink-cdc]

2024-06-03 Thread via GitHub
morazow commented on code in PR #3349: URL: https://github.com/apache/flink-cdc/pull/3349#discussion_r1623904431 ## docs/content/docs/connectors/flink-sources/postgres-cdc.md: ## @@ -236,6 +236,15 @@ Connector Options so it does not need to be explicitly configured '

Re: [PR] put more relevant link to the Scala wrapper [flink-web]

2024-06-03 Thread via GitHub
rmetzger commented on PR #670: URL: https://github.com/apache/flink-web/pull/670#issuecomment-2144472974 Sorry, I'll merge it right away! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

Re: [PR] put more relevant link to the Scala wrapper [flink-web]

2024-06-03 Thread via GitHub
rmetzger merged PR #670: URL: https://github.com/apache/flink-web/pull/670 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apac

Re: [PR] put more relevant link to the Scala wrapper [flink-web]

2024-06-03 Thread via GitHub
rmetzger commented on PR #670: URL: https://github.com/apache/flink-web/pull/670#issuecomment-2144475292 I still need to regenerate the website -- I'll try to do that later today, or it will happen the next time somebody changes the website. -- This is an automated message from the Apache

Re: [PR] [FLINK-35129][cdc][postgres] Add checkpoint cycle option for commit offsets [flink-cdc]

2024-06-03 Thread via GitHub
morazow commented on code in PR #3349: URL: https://github.com/apache/flink-cdc/pull/3349#discussion_r1623914704 ## docs/content/docs/connectors/flink-sources/postgres-cdc.md: ## @@ -236,6 +236,15 @@ Connector Options so it does not need to be explicitly configured '

[jira] [Updated] (FLINK-35229) join An error occurred when the table was empty

2024-06-03 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Liang Teoh updated FLINK-35229: Fix Version/s: 1.19.2 (was: 1.19.1) > join An error occurred when t

[jira] [Updated] (FLINK-35453) StreamReader Charset fix with UTF8 in core files

2024-06-03 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Liang Teoh updated FLINK-35453: Fix Version/s: 1.19.2 (was: 1.19.1) > StreamReader Charset fix with

[jira] [Updated] (FLINK-34672) HA deadlock between JobMasterServiceLeadershipRunner and DefaultLeaderElectionService

2024-06-03 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Liang Teoh updated FLINK-34672: Fix Version/s: 1.19.2 (was: 1.19.1) > HA deadlock between JobMaster

Re: [PR] [FLINK-25538][Connectors/Kafka] Migration flink-connector-kafka from junit4 to junit5 [flink-connector-kafka]

2024-06-03 Thread via GitHub
MartijnVisser commented on PR #66: URL: https://github.com/apache/flink-connector-kafka/pull/66#issuecomment-2144498882 @morazow Feel free to take it over :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[jira] [Updated] (FLINK-35383) Update compatibility matrix to include 1.19 release

2024-06-03 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Liang Teoh updated FLINK-35383: Issue Type: Bug (was: Technical Debt) > Update compatibility matrix to include 1.19 relea

[jira] [Updated] (FLINK-35383) Update compatibility matrix to include 1.19 release

2024-06-03 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Liang Teoh updated FLINK-35383: Issue Type: Technical Debt (was: Improvement) > Update compatibility matrix to include 1.

[jira] [Assigned] (FLINK-35358) Breaking change when loading artifacts

2024-06-03 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Liang Teoh reassigned FLINK-35358: --- Assignee: Ferenc Csaky > Breaking change when loading artifacts > -

Re: [PR] [FLINK-35129][cdc][postgres] Add checkpoint cycle option for commit offsets [flink-cdc]

2024-06-03 Thread via GitHub
leonardBang commented on code in PR #3349: URL: https://github.com/apache/flink-cdc/pull/3349#discussion_r1623938661 ## docs/content/docs/connectors/flink-sources/postgres-cdc.md: ## @@ -236,6 +236,17 @@ Connector Options so it does not need to be explicitly configure

Re: [PR] [FLINK-34883] Fix postgres uuid column as PK [flink-cdc]

2024-06-03 Thread via GitHub
eskabetxe commented on PR #3282: URL: https://github.com/apache/flink-cdc/pull/3282#issuecomment-2144558845 @leonardBang can you help here? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

Re: [PR] [FLINK-34883] Fix postgres uuid column as PK [flink-cdc]

2024-06-03 Thread via GitHub
leonardBang commented on PR #3282: URL: https://github.com/apache/flink-cdc/pull/3282#issuecomment-2144573999 Thanks @eskabetxe for the contribution, I'd like to find someone who is more familiar to Pg to review this PR. -- This is an automated message from the Apache Git Service. To

Re: [PR] [FLINK-34883] Fix postgres uuid column as PK [flink-cdc]

2024-06-03 Thread via GitHub
leonardBang commented on PR #3282: URL: https://github.com/apache/flink-cdc/pull/3282#issuecomment-2144575170 @loserwang1024 would you like to review this PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[jira] [Commented] (FLINK-35500) DynamoDb Table API Sink fails to delete elements due to key not found

2024-06-03 Thread Aleksandr Pilipenko (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17851551#comment-17851551 ] Aleksandr Pilipenko commented on FLINK-35500: - {quote} I do need a decision

Re: [PR] [BP-3.1][FLINK-35301][cdc] Avoid deadlock when loading driver classes [flink-cdc]

2024-06-03 Thread via GitHub
leonardBang merged PR #3372: URL: https://github.com/apache/flink-cdc/pull/3372 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink

Re: [PR] [FLINK-35282] Upgrade pyarrow and beam [flink]

2024-06-03 Thread via GitHub
z3d1k commented on code in PR #24876: URL: https://github.com/apache/flink/pull/24876#discussion_r1624009039 ## flink-python/setup.py: ## @@ -317,13 +317,13 @@ def extracted_output_files(base_dir, file_path, output_directory): 'pyflink.bin': ['*']} install_requi

[jira] [Comment Edited] (FLINK-35301) Fix deadlock when loading driver classes

2024-06-03 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17849696#comment-17849696 ] Leonard Xu edited comment on FLINK-35301 at 6/3/24 8:31 AM:

[jira] [Updated] (FLINK-35301) Fix deadlock when loading driver classes

2024-06-03 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu updated FLINK-35301: --- Fix Version/s: cdc-3.1.1 > Fix deadlock when loading driver classes > --

Re: [PR] [FLINK-35282] Upgrade pyarrow and beam [flink]

2024-06-03 Thread via GitHub
z3d1k commented on code in PR #24875: URL: https://github.com/apache/flink/pull/24875#discussion_r1624013219 ## flink-python/setup.py: ## @@ -317,13 +317,13 @@ def extracted_output_files(base_dir, file_path, output_directory): 'pyflink.bin': ['*']} install_requi

[jira] [Commented] (FLINK-32384) Remove deprecated configuration keys which violate YAML spec

2024-06-03 Thread Kartikey Pant (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17851554#comment-17851554 ] Kartikey Pant commented on FLINK-32384: --- Sure [~zhuzh], will do > Remove deprecat

Re: [PR] [BP-3.1][FLINK-35430][cdc-connector][kafka] Passed the zoneId to JsonSerializationSchema. [flink-cdc]

2024-06-03 Thread via GitHub
leonardBang merged PR #3377: URL: https://github.com/apache/flink-cdc/pull/3377 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink

[jira] [Updated] (FLINK-35430) ZoneId is not passed to DebeziumJsonSerializationSchema

2024-06-03 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu updated FLINK-35430: --- Issue Type: Bug (was: Improvement) > ZoneId is not passed to DebeziumJsonSerializationSchema >

[jira] [Assigned] (FLINK-35430) ZoneId is not passed to DebeziumJsonSerializationSchema

2024-06-03 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu reassigned FLINK-35430: -- Assignee: tianzhu.wen > ZoneId is not passed to DebeziumJsonSerializationSchema > ---

[jira] [Updated] (FLINK-35430) ZoneId is not passed to DebeziumJsonSerializationSchema

2024-06-03 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu updated FLINK-35430: --- Fix Version/s: cdc-3.2.0 > ZoneId is not passed to DebeziumJsonSerializationSchema > ---

[jira] [Resolved] (FLINK-35430) ZoneId is not passed to DebeziumJsonSerializationSchema

2024-06-03 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu resolved FLINK-35430. Resolution: Fixed Fixed via master: 0e8b2c7cc59db227dc0e15f219bd3d1b4c28ad42 3.1: 19f7afe6af8e7f

Re: [PR] [FLINK-35464] Fixes operator state backwards compatibility from CDC 3.0.x [flink-cdc]

2024-06-03 Thread via GitHub
yuxiqian commented on PR #3369: URL: https://github.com/apache/flink-cdc/pull/3369#issuecomment-2144714724 Thanks for @PatrickRen's comments! I too agree that it's not very elegant to package all history versions just for compatibility test, but seems to be inevitable since there's no such

Re: [PR] [FLINK-35129][cdc][postgres] Add checkpoint cycle option for commit offsets [flink-cdc]

2024-06-03 Thread via GitHub
morazow commented on code in PR #3349: URL: https://github.com/apache/flink-cdc/pull/3349#discussion_r1624123074 ## docs/content/docs/connectors/flink-sources/postgres-cdc.md: ## @@ -236,6 +236,17 @@ Connector Options so it does not need to be explicitly configured '

Re: [PR] [FLINK-35323][runtime] Fix transform failure when one rule matches multiple tables with incompatible schema [flink-cdc]

2024-06-03 Thread via GitHub
melin commented on PR #3313: URL: https://github.com/apache/flink-cdc/pull/3313#issuecomment-2144744535 Table A_1 has the same schema as table A_2, but A_3 has more fields than A_1. This scenario is not supported. -- This is an automated message from the Apache Git Service. To respond to

Re: [PR] [BP-3.1][FLINK-35294][mysql] Use source config to check if the filter should be applied in timestamp starting mode [flink-cdc]

2024-06-03 Thread via GitHub
leonardBang merged PR #3373: URL: https://github.com/apache/flink-cdc/pull/3373 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink

[jira] [Reopened] (FLINK-35294) Use source config to check if the filter should be applied in timestamp starting mode

2024-06-03 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu reopened FLINK-35294: > Use source config to check if the filter should be applied in timestamp > starting mode > -

[jira] [Updated] (FLINK-35294) Use source config to check if the filter should be applied in timestamp starting mode

2024-06-03 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu updated FLINK-35294: --- Fix Version/s: cdc-3.1.1 > Use source config to check if the filter should be applied in timestamp

[jira] [Comment Edited] (FLINK-35294) Use source config to check if the filter should be applied in timestamp starting mode

2024-06-03 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17849615#comment-17849615 ] Leonard Xu edited comment on FLINK-35294 at 6/3/24 9:58 AM:

[jira] [Resolved] (FLINK-35294) Use source config to check if the filter should be applied in timestamp starting mode

2024-06-03 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu resolved FLINK-35294. Resolution: Fixed > Use source config to check if the filter should be applied in timestamp > sta

Re: [PR] [FLINK-35129][cdc][postgres] Add checkpoint cycle option for commit offsets [flink-cdc]

2024-06-03 Thread via GitHub
morazow commented on code in PR #3349: URL: https://github.com/apache/flink-cdc/pull/3349#discussion_r1624166875 ## docs/content/docs/connectors/flink-sources/postgres-cdc.md: ## @@ -236,6 +236,17 @@ Connector Options so it does not need to be explicitly configured '

[jira] [Commented] (FLINK-25538) [JUnit5 Migration] Module: flink-connector-kafka

2024-06-03 Thread Muhammet Orazov (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17851573#comment-17851573 ] Muhammet Orazov commented on FLINK-25538: - Thanks [~martijnvisser], could you pl

Re: [PR] [FLINK-20398][e2e] Migrate test_batch_sql.sh to Java e2e tests framework [flink]

2024-06-03 Thread via GitHub
JingGe commented on code in PR #24471: URL: https://github.com/apache/flink/pull/24471#discussion_r1624191535 ## flink-end-to-end-tests/flink-batch-sql-test/src/test/java/org/apache/flink/sql/tests/Generator.java: ## @@ -0,0 +1,82 @@ +/* + * Licensed to the Apache Software Found

Re: [PR] [FLINK-20398][e2e] Migrate test_batch_sql.sh to Java e2e tests framework [flink]

2024-06-03 Thread via GitHub
JingGe commented on code in PR #24471: URL: https://github.com/apache/flink/pull/24471#discussion_r1624191535 ## flink-end-to-end-tests/flink-batch-sql-test/src/test/java/org/apache/flink/sql/tests/Generator.java: ## @@ -0,0 +1,82 @@ +/* + * Licensed to the Apache Software Found

[jira] [Commented] (FLINK-35453) StreamReader Charset fix with UTF8 in core files

2024-06-03 Thread xy (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17851580#comment-17851580 ] xy commented on FLINK-35453: [~hlteoh37] , could you give a review this pr? https://github.

Re: [PR] [FLINK-35282] Upgrade pyarrow and beam [flink]

2024-06-03 Thread via GitHub
hlteoh37 commented on code in PR #24875: URL: https://github.com/apache/flink/pull/24875#discussion_r1624220529 ## flink-python/pyproject.toml: ## @@ -21,7 +21,7 @@ requires = [ "packaging>=20.5; platform_machine=='arm64'", # macos M1 "setuptools>=18.0", "wheel",

Re: [PR] [FLINK-35282] Upgrade pyarrow and beam [flink]

2024-06-03 Thread via GitHub
hlteoh37 commented on code in PR #24875: URL: https://github.com/apache/flink/pull/24875#discussion_r1624221551 ## flink-python/pyproject.toml: ## @@ -21,7 +21,7 @@ requires = [ "packaging>=20.5; platform_machine=='arm64'", # macos M1 "setuptools>=18.0", "wheel",

Re: [PR] [FLINK-35282] Upgrade pyarrow and beam [flink]

2024-06-03 Thread via GitHub
hlteoh37 commented on PR #24876: URL: https://github.com/apache/flink/pull/24876#issuecomment-2144898483 Could we squash the commits please! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

Re: [PR] [FLINK-35282] Upgrade pyarrow and beam [flink]

2024-06-03 Thread via GitHub
hlteoh37 commented on PR #24875: URL: https://github.com/apache/flink/pull/24875#issuecomment-2144897972 Could we squash the commits please? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

[jira] [Commented] (FLINK-33202) FLIP-327: Support switching from batch to stream mode to improve throughput when processing backlog data

2024-06-03 Thread Dmitriy Linevich (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17851582#comment-17851582 ] Dmitriy Linevich commented on FLINK-33202: -- [~xuannan]  Hello. I apologize fo

[jira] [Created] (FLINK-35509) Slack community invite link has expired

2024-06-03 Thread Ufuk Celebi (Jira)
Ufuk Celebi created FLINK-35509: --- Summary: Slack community invite link has expired Key: FLINK-35509 URL: https://issues.apache.org/jira/browse/FLINK-35509 Project: Flink Issue Type: Bug

[jira] [Assigned] (FLINK-35509) Slack community invite link has expired

2024-06-03 Thread Ufuk Celebi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ufuk Celebi reassigned FLINK-35509: --- Assignee: Santwana Verma > Slack community invite link has expired > --

[PR] [FLINK-35509] Updates the slack invitation link [flink-web]

2024-06-03 Thread via GitHub
vsantwana opened a new pull request, #744: URL: https://github.com/apache/flink-web/pull/744 The original slack link had the expiry set as 30 days. The new link is set to never expire -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Updated] (FLINK-35509) Slack community invite link has expired

2024-06-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35509: --- Labels: pull-request-available (was: ) > Slack community invite link has expired >

Re: [PR] [FLINK-35509] Updates the slack invitation link [flink-web]

2024-06-03 Thread via GitHub
rmetzger commented on code in PR #744: URL: https://github.com/apache/flink-web/pull/744#discussion_r1624281186 ## content/how-to-contribute/code-style-and-quality-common/index.html: ## @@ -472,33 +472,33 @@ Code Style and Quality Guide — Common Rules # - + Review Comme

Re: [PR] [FLINK-33461][Connector/JDBC] Support streaming related semantics for the new JDBC source [flink-connector-jdbc]

2024-06-03 Thread via GitHub
RocMarshal commented on code in PR #119: URL: https://github.com/apache/flink-connector-jdbc/pull/119#discussion_r1621712488 ## flink-connector-jdbc/src/main/java/org/apache/flink/connector/jdbc/utils/ContinuousUnBoundingSettings.java: ## @@ -0,0 +1,86 @@ +/* + * Licensed to th

[jira] [Commented] (FLINK-33673) SizeLimits not being set on emptyDir

2024-06-03 Thread Tony Garrard (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17851594#comment-17851594 ] Tony Garrard commented on FLINK-33673: -- It is defined in both the operator and the

Re: [PR] [FLINK-35509] Updates the slack invitation link [flink-web]

2024-06-03 Thread via GitHub
vsantwana commented on code in PR #744: URL: https://github.com/apache/flink-web/pull/744#discussion_r1624292637 ## content/how-to-contribute/code-style-and-quality-common/index.html: ## @@ -472,33 +472,33 @@ Code Style and Quality Guide — Common Rules # - + Review Comm

Re: [PR] [FLINK-35509] Updates the slack invitation link [flink-web]

2024-06-03 Thread via GitHub
vsantwana commented on code in PR #744: URL: https://github.com/apache/flink-web/pull/744#discussion_r1624292637 ## content/how-to-contribute/code-style-and-quality-common/index.html: ## @@ -472,33 +472,33 @@ Code Style and Quality Guide — Common Rules # - + Review Comm

[jira] [Commented] (FLINK-33673) SizeLimits not being set on emptyDir

2024-06-03 Thread Tony Garrard (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17851596#comment-17851596 ] Tony Garrard commented on FLINK-33673: -- Though CR's we could document that users sh

Re: [PR] [FLINK-35509] Updates the slack invitation link [flink-web]

2024-06-03 Thread via GitHub
vsantwana commented on code in PR #744: URL: https://github.com/apache/flink-web/pull/744#discussion_r1624292637 ## content/how-to-contribute/code-style-and-quality-common/index.html: ## @@ -472,33 +472,33 @@ Code Style and Quality Guide — Common Rules # - + Review Comm

[jira] [Updated] (FLINK-35282) PyFlink Support for Apache Beam > 2.49

2024-06-03 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Liang Teoh updated FLINK-35282: Affects Version/s: 1.18.1 1.19.0 > PyFlink Support for Apache Beam

[jira] [Updated] (FLINK-35282) PyFlink Support for Apache Beam > 2.49

2024-06-03 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Liang Teoh updated FLINK-35282: Fix Version/s: 1.20.0 1.19.1 > PyFlink Support for Apache Beam > 2.49 >

[jira] [Created] (FLINK-35510) Implement basic incremental checkpoint for ForStStateBackend

2024-06-03 Thread Feifan Wang (Jira)
Feifan Wang created FLINK-35510: --- Summary: Implement basic incremental checkpoint for ForStStateBackend Key: FLINK-35510 URL: https://issues.apache.org/jira/browse/FLINK-35510 Project: Flink I

[jira] [Updated] (FLINK-35510) Implement basic incremental checkpoint for ForStStateBackend

2024-06-03 Thread Feifan Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feifan Wang updated FLINK-35510: Parent: FLINK-34982 Issue Type: Sub-task (was: New Feature) > Implement basic incremental

Re: [PR] [FLINK-20398][e2e] Migrate test_batch_sql.sh to Java e2e tests framework [flink]

2024-06-03 Thread via GitHub
affo commented on code in PR #24471: URL: https://github.com/apache/flink/pull/24471#discussion_r1624443303 ## flink-end-to-end-tests/flink-batch-sql-test/src/test/java/org/apache/flink/sql/tests/Generator.java: ## @@ -0,0 +1,82 @@ +/* + * Licensed to the Apache Software Foundat

[PR] [FLINK-35510][statebackend] Implement basic incremental checkpoint fo… [flink]

2024-06-03 Thread via GitHub
zoltar9264 opened a new pull request, #24879: URL: https://github.com/apache/flink/pull/24879 …r ForStStateBackend ## What is the purpose of the change Use low DB api implement a basic incremental checkpoint for ForStStatebackend, follow steps: 1. db.disableFileDeletions

[jira] [Updated] (FLINK-35510) Implement basic incremental checkpoint for ForStStateBackend

2024-06-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35510: --- Labels: pull-request-available (was: ) > Implement basic incremental checkpoint for ForStSt

Re: [PR] [FLINK-20398][e2e] Migrate test_batch_sql.sh to Java e2e tests framework [flink]

2024-06-03 Thread via GitHub
affo commented on code in PR #24471: URL: https://github.com/apache/flink/pull/24471#discussion_r1624446134 ## flink-end-to-end-tests/flink-batch-sql-test/src/test/java/org/apache/flink/sql/tests/Generator.java: ## @@ -0,0 +1,82 @@ +/* + * Licensed to the Apache Software Foundat

[jira] [Assigned] (FLINK-25538) [JUnit5 Migration] Module: flink-connector-kafka

2024-06-03 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martijn Visser reassigned FLINK-25538: -- Assignee: Muhammet Orazov (was: xiang1 yu) > [JUnit5 Migration] Module: flink-connec

Re: [PR] [FLINK-35510][statebackend] Implement basic incremental checkpoint fo… [flink]

2024-06-03 Thread via GitHub
flinkbot commented on PR #24879: URL: https://github.com/apache/flink/pull/24879#issuecomment-2145225059 ## CI report: * 6e2f34a849971292c1377ffc68b12c0ea10c4b61 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [hotfix] A couple of hotfixes [flink]

2024-06-03 Thread via GitHub
pnowojski commented on PR #24868: URL: https://github.com/apache/flink/pull/24868#issuecomment-2145281883 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [FLINK-35200][table] Support the execution of suspend, resume materialized table in full refresh mode [flink]

2024-06-03 Thread via GitHub
hackergin commented on PR #24877: URL: https://github.com/apache/flink/pull/24877#issuecomment-2145284586 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Created] (FLINK-35511) Enhance metrics. The incremental and full phases count the number of records separately

2024-06-03 Thread melin (Jira)
melin created FLINK-35511: - Summary: Enhance metrics. The incremental and full phases count the number of records separately Key: FLINK-35511 URL: https://issues.apache.org/jira/browse/FLINK-35511 Project: Fl

[PR] [FLINK-26050] Manually compact small SST files [flink]

2024-06-03 Thread via GitHub
rkhachatryan opened a new pull request, #24880: URL: https://github.com/apache/flink/pull/24880 In some cases, the number of files produced by RocksDB state backend grows indefinitely. This might cause task state info (TDD and checkpoint ACK) to exceed RPC message size and fail recovery/

[jira] [Updated] (FLINK-26050) Too many small sst files in rocksdb state backend when using time window created in ascending order

2024-06-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-26050: --- Labels: pull-request-available (was: ) > Too many small sst files in rocksdb state backend

Re: [PR] [FLINK-20398][e2e] Migrate test_batch_sql.sh to Java e2e tests framework [flink]

2024-06-03 Thread via GitHub
JingGe commented on code in PR #24471: URL: https://github.com/apache/flink/pull/24471#discussion_r1624540081 ## flink-end-to-end-tests/flink-batch-sql-test/src/test/java/org/apache/flink/sql/tests/Generator.java: ## @@ -0,0 +1,82 @@ +/* + * Licensed to the Apache Software Found

Re: [PR] [FLINK-25537] [JUnit5 Migration] Module: flink-core with,Package: core [flink]

2024-06-03 Thread via GitHub
GOODBOY008 closed pull request #24685: [FLINK-25537] [JUnit5 Migration] Module: flink-core with,Package: core URL: https://github.com/apache/flink/pull/24685 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[PR] [FLINK-25537] [JUnit5 Migration] Module: flink-core with,Package: core [flink]

2024-06-03 Thread via GitHub
GOODBOY008 opened a new pull request, #24881: URL: https://github.com/apache/flink/pull/24881 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e

Re: [PR] [FLINK-26050] Manually compact small SST files [flink]

2024-06-03 Thread via GitHub
flinkbot commented on PR #24880: URL: https://github.com/apache/flink/pull/24880#issuecomment-2145341247 ## CI report: * a63261046d57fb91897e9fb2e56a93081489c017 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-35501) Use common thread pools when transferring RocksDB state files

2024-06-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35501: --- Labels: pull-request-available (was: ) > Use common thread pools when transferring RocksDB

[PR] [FLINK-35501] Use common IO thread pool for RocksDB data transfer [flink]

2024-06-03 Thread via GitHub
rkhachatryan opened a new pull request, #24882: URL: https://github.com/apache/flink/pull/24882 ## What is the purpose of the change Allow to control the total number of data transfers per TM. ## Brief change log *(for example:)* - *The TaskInfo is stored in the

Re: [PR] [FLINK-25537] [JUnit5 Migration] Module: flink-core with,Package: core [flink]

2024-06-03 Thread via GitHub
flinkbot commented on PR #24881: URL: https://github.com/apache/flink/pull/24881#issuecomment-2145361395 ## CI report: * c1b3b0623e1d0fd68ca0d10924cea9bfa693b368 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[PR] [FLINK-35489][Autoscaler] Ensure METASPACE size is computed before the heap [flink-kubernetes-operator]

2024-06-03 Thread via GitHub
ashangit opened a new pull request, #833: URL: https://github.com/apache/flink-kubernetes-operator/pull/833 ## What is the purpose of the change If the heap usage with overhead leads to remaining memory to be assigned to the HEAP no memory will be assigned to the METASPACE lea

[jira] [Updated] (FLINK-35489) Metaspace size can be too little after autotuning change memory setting

2024-06-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35489: --- Labels: pull-request-available (was: ) > Metaspace size can be too little after autotuning

Re: [PR] [FLINK-35509] Updates the slack invitation link [flink-web]

2024-06-03 Thread via GitHub
rmetzger merged PR #744: URL: https://github.com/apache/flink-web/pull/744 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apac

Re: [PR] [FLINK-35501] Use common IO thread pool for RocksDB data transfer [flink]

2024-06-03 Thread via GitHub
flinkbot commented on PR #24882: URL: https://github.com/apache/flink/pull/24882#issuecomment-2145384476 ## CI report: * c71cdf93d7350212afe826ff76f49f9f318ec57c UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-25421] Port JDBC Sink to new Unified Sink API (FLIP-143) [flink-connector-jdbc]

2024-06-03 Thread via GitHub
leonardBang commented on code in PR #2: URL: https://github.com/apache/flink-connector-jdbc/pull/2#discussion_r1624585888 ## flink-connector-jdbc/src/main/java/org/apache/flink/connector/jdbc/sink/JdbcSink.java: ## @@ -0,0 +1,116 @@ +/* + * Licensed to the Apache Software Found

[jira] [Commented] (FLINK-35496) The annotations of the new JDBC connector should be changed to non-Public/non-PublicEvolving

2024-06-03 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17851671#comment-17851671 ] Leonard Xu commented on FLINK-35496: I lust want to clarify two points here: (1)We

[jira] [Comment Edited] (FLINK-35496) The annotations of the new JDBC connector should be changed to non-Public/non-PublicEvolving

2024-06-03 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17851671#comment-17851671 ] Leonard Xu edited comment on FLINK-35496 at 6/3/24 2:43 PM:

[jira] [Created] (FLINK-35512) ArtifactFetchManagerTest unit tests fail

2024-06-03 Thread Hong Liang Teoh (Jira)
Hong Liang Teoh created FLINK-35512: --- Summary: ArtifactFetchManagerTest unit tests fail Key: FLINK-35512 URL: https://issues.apache.org/jira/browse/FLINK-35512 Project: Flink Issue Type: Te

Re: [PR] [FLINK-34883] Fix postgres uuid column as PK [flink-cdc]

2024-06-03 Thread via GitHub
GOODBOY008 commented on code in PR #3282: URL: https://github.com/apache/flink-cdc/pull/3282#discussion_r1624561604 ## flink-cdc-connect/flink-cdc-source-connectors/flink-cdc-base/src/main/java/org/apache/flink/cdc/connectors/base/source/assigner/splitter/JdbcSourceChunkSplitter.java: #

Re: [PR] [FLINK-35200][table] Support the execution of suspend, resume materialized table in full refresh mode [flink]

2024-06-03 Thread via GitHub
hackergin commented on code in PR #24877: URL: https://github.com/apache/flink/pull/24877#discussion_r1624617251 ## flink-table/flink-sql-gateway/src/test/java/org/apache/flink/table/gateway/service/MaterializedTableStatementITCase.java: ## @@ -652,6 +654,158 @@ void testAlterM

Re: [PR] [FLINK-26050] Manually compact small SST files [flink]

2024-06-03 Thread via GitHub
rkhachatryan commented on PR #24880: URL: https://github.com/apache/flink/pull/24880#issuecomment-2145433373 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

[jira] [Created] (FLINK-35513) ArtifactFetchManager unit tests are failing

2024-06-03 Thread Elphas Toringepi (Jira)
Elphas Toringepi created FLINK-35513: Summary: ArtifactFetchManager unit tests are failing Key: FLINK-35513 URL: https://issues.apache.org/jira/browse/FLINK-35513 Project: Flink Issue Typ

[jira] [Updated] (FLINK-35513) ArtifactFetchManager unit tests are failing

2024-06-03 Thread Elphas Toringepi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elphas Toringepi updated FLINK-35513: - Description: The following unit tests in [ArtifactFetchManagerTest.java|https://github.

Re: [PR] [FLINK-35157][runtime] Sources with watermark alignment get stuck once some subtasks finish [flink]

2024-06-03 Thread via GitHub
elon-X commented on code in PR #24757: URL: https://github.com/apache/flink/pull/24757#discussion_r1624644653 ## flink-runtime/src/main/java/org/apache/flink/runtime/source/coordinator/SourceCoordinator.java: ## @@ -201,8 +201,11 @@ void announceCombinedWatermark() { //

[jira] [Closed] (FLINK-35513) ArtifactFetchManager unit tests are failing

2024-06-03 Thread Elphas Toringepi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elphas Toringepi closed FLINK-35513. Resolution: Duplicate > ArtifactFetchManager unit tests are failing >

Re: [PR] [FLINK-35510][statebackend] Implement basic incremental checkpoint fo… [flink]

2024-06-03 Thread via GitHub
zoltar9264 commented on PR #24879: URL: https://github.com/apache/flink/pull/24879#issuecomment-2145529943 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[jira] [Updated] (FLINK-35506) disable kafka auto-commit and rely on flink’s checkpointing if both are enabled

2024-06-03 Thread elon_X (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] elon_X updated FLINK-35506: --- Attachment: image-2024-06-03-23-39-28-270.png > disable kafka auto-commit and rely on flink’s checkpointing

  1   2   >