[GitHub] [flink] wsry commented on a diff in pull request #19653: [FLINK-27523] Runtime supports producing and consuming cached intermediate results

2022-05-25 Thread GitBox
wsry commented on code in PR #19653: URL: https://github.com/apache/flink/pull/19653#discussion_r882374093 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/TaskExecutorPartitionTrackerImpl.java: ## @@ -131,6 +135,7 @@ public ClusterPartitionReport cr

[GitHub] [flink] wsry commented on a diff in pull request #19653: [FLINK-27523] Runtime supports producing and consuming cached intermediate results

2022-05-25 Thread GitBox
wsry commented on code in PR #19653: URL: https://github.com/apache/flink/pull/19653#discussion_r882373238 ## flink-runtime/src/main/java/org/apache/flink/runtime/taskexecutor/TaskExecutor.java: ## @@ -901,7 +901,12 @@ public void releaseOrPromotePartitions( try {

[GitHub] [flink-table-store] LadyForest commented on a diff in pull request #138: [FLINK-27707] Implement ManagedTableFactory#onCompactTable

2022-05-25 Thread GitBox
LadyForest commented on code in PR #138: URL: https://github.com/apache/flink-table-store/pull/138#discussion_r882372928 ## flink-table-store-connector/src/main/java/org/apache/flink/table/store/connector/TableStoreManagedFactory.java: ## @@ -183,6 +200,70 @@ public void onDropT

[GitHub] [flink-table-store] LadyForest commented on a diff in pull request #138: [FLINK-27707] Implement ManagedTableFactory#onCompactTable

2022-05-25 Thread GitBox
LadyForest commented on code in PR #138: URL: https://github.com/apache/flink-table-store/pull/138#discussion_r882370652 ## flink-table-store-connector/src/main/java/org/apache/flink/table/store/connector/TableStoreManagedFactory.java: ## @@ -183,6 +200,70 @@ public void onDropT

[GitHub] [flink] wsry commented on a diff in pull request #19653: [FLINK-27523] Runtime supports producing and consuming cached intermediate results

2022-05-25 Thread GitBox
wsry commented on code in PR #19653: URL: https://github.com/apache/flink/pull/19653#discussion_r882353820 ## flink-runtime/src/main/java/org/apache/flink/runtime/taskexecutor/partition/ClusterPartitionReport.java: ## @@ -57,12 +59,21 @@ public static class ClusterPartitionRepor

[GitHub] [flink] fredia commented on a diff in pull request #19448: [FLINK-25872][state] Support restore from non-changelog checkpoint with changelog enabled in CLAIM mode

2022-05-25 Thread GitBox
fredia commented on code in PR #19448: URL: https://github.com/apache/flink/pull/19448#discussion_r882367014 ## flink-runtime/src/main/java/org/apache/flink/runtime/state/SharedStateRegistryImpl.java: ## @@ -137,8 +146,8 @@ public StreamStateHandle registerReference( re

[GitHub] [flink-table-store] LadyForest commented on a diff in pull request #138: [FLINK-27707] Implement ManagedTableFactory#onCompactTable

2022-05-25 Thread GitBox
LadyForest commented on code in PR #138: URL: https://github.com/apache/flink-table-store/pull/138#discussion_r882366370 ## flink-table-store-core/src/main/java/org/apache/flink/table/store/file/operation/FileStoreReadImpl.java: ## @@ -55,14 +56,14 @@ public FileStoreReadImpl(

[GitHub] [flink] fredia commented on a diff in pull request #19448: [FLINK-25872][state] Support restore from non-changelog checkpoint with changelog enabled in CLAIM mode

2022-05-25 Thread GitBox
fredia commented on code in PR #19448: URL: https://github.com/apache/flink/pull/19448#discussion_r882366289 ## flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/CheckpointsCleaner.java: ## @@ -65,6 +72,36 @@ public void cleanCheckpoint( cleanup(checkpoint

[GitHub] [flink] fredia commented on a diff in pull request #19448: [FLINK-25872][state] Support restore from non-changelog checkpoint with changelog enabled in CLAIM mode

2022-05-25 Thread GitBox
fredia commented on code in PR #19448: URL: https://github.com/apache/flink/pull/19448#discussion_r882360519 ## flink-runtime/src/main/java/org/apache/flink/runtime/state/SharedStateRegistryImpl.java: ## @@ -156,16 +165,40 @@ public void unregisterUnusedState(long lowestCheckpo

[GitHub] [flink-table-store] LadyForest commented on a diff in pull request #138: [FLINK-27707] Implement ManagedTableFactory#onCompactTable

2022-05-25 Thread GitBox
LadyForest commented on code in PR #138: URL: https://github.com/apache/flink-table-store/pull/138#discussion_r882357901 ## flink-table-store-connector/src/main/java/org/apache/flink/table/store/connector/AbstractTableStoreFactory.java: ## @@ -155,7 +155,7 @@ static Map filterL

[GitHub] [flink] wsry commented on a diff in pull request #19653: [FLINK-27523] Runtime supports producing and consuming cached intermediate results

2022-05-25 Thread GitBox
wsry commented on code in PR #19653: URL: https://github.com/apache/flink/pull/19653#discussion_r882354232 ## flink-runtime/src/main/java/org/apache/flink/runtime/taskexecutor/partition/ClusterPartitionReport.java: ## @@ -57,12 +59,21 @@ public static class ClusterPartitionRepor

[GitHub] [flink] wsry commented on a diff in pull request #19653: [FLINK-27523] Runtime supports producing and consuming cached intermediate results

2022-05-25 Thread GitBox
wsry commented on code in PR #19653: URL: https://github.com/apache/flink/pull/19653#discussion_r882353820 ## flink-runtime/src/main/java/org/apache/flink/runtime/taskexecutor/partition/ClusterPartitionReport.java: ## @@ -57,12 +59,21 @@ public static class ClusterPartitionRepor

[GitHub] [flink] wsry commented on a diff in pull request #19653: [FLINK-27523] Runtime supports producing and consuming cached intermediate results

2022-05-25 Thread GitBox
wsry commented on code in PR #19653: URL: https://github.com/apache/flink/pull/19653#discussion_r882351486 ## flink-runtime/src/main/java/org/apache/flink/runtime/taskexecutor/partition/ClusterPartitionReport.java: ## @@ -57,12 +59,21 @@ public static class ClusterPartitionRepor

[GitHub] [flink] wsry commented on a diff in pull request #19653: [FLINK-27523] Runtime supports producing and consuming cached intermediate results

2022-05-25 Thread GitBox
wsry commented on code in PR #19653: URL: https://github.com/apache/flink/pull/19653#discussion_r882350485 ## flink-runtime/src/main/java/org/apache/flink/runtime/taskexecutor/partition/ClusterPartitionReport.java: ## @@ -57,12 +59,21 @@ public static class ClusterPartitionRepor

[GitHub] [flink] wsry commented on a diff in pull request #19653: [FLINK-27523] Runtime supports producing and consuming cached intermediate results

2022-05-25 Thread GitBox
wsry commented on code in PR #19653: URL: https://github.com/apache/flink/pull/19653#discussion_r882347966 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/ClusterPartitionManager.java: ## @@ -39,4 +41,14 @@ public interface ClusterPartitionManager {

[GitHub] [flink-web] curcur commented on pull request #540: Add Changelog State Backend blog post

2022-05-25 Thread GitBox
curcur commented on PR #540: URL: https://github.com/apache/flink-web/pull/540#issuecomment-1138164698 I do not have other questions & have accepted the blog post. Please do not forget to rebuild the website before merging. -- This is an automated message from the Apache Git Service

[GitHub] [flink-web] curcur commented on a diff in pull request #540: Add Changelog State Backend blog post

2022-05-25 Thread GitBox
curcur commented on code in PR #540: URL: https://github.com/apache/flink-web/pull/540#discussion_r879488407 ## _posts/2022-05-20-changelog-state-backend.md: ## @@ -0,0 +1,353 @@ +--- +layout: post +title: "Improving speed and stability of checkpointing with generic log-based

[jira] [Commented] (FLINK-27722) Slack: set up auto-updated invitation link

2022-05-25 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542352#comment-17542352 ] Xintong Song commented on FLINK-27722: -- I tried but couldn't update it. - w/o check

[jira] [Created] (FLINK-27796) Document approaches to updating existing instances of stateful functions

2022-05-25 Thread Zixuan Rao (Jira)
Zixuan Rao created FLINK-27796: -- Summary: Document approaches to updating existing instances of stateful functions Key: FLINK-27796 URL: https://issues.apache.org/jira/browse/FLINK-27796 Project: Flink

[GitHub] [flink] rovboyko commented on pull request #19648: [FLINK-27438][table-planner] Fix the constructing a map array

2022-05-25 Thread GitBox
rovboyko commented on PR #19648: URL: https://github.com/apache/flink/pull/19648#issuecomment-1138154479 Hi Timo @twalthr ! I've rewritten the solution according to your idea to use the `generateCast` method. I had to change the `CodeGeneratorCastRule` to it be able to declare not on

[jira] [Updated] (FLINK-27794) The primary key obtained from MySQL is incorrect by using MysqlCatalog

2022-05-25 Thread dusukang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dusukang updated FLINK-27794: - Description: I want to use MysqlCatalog to get the primary key of the database table `user`. The databa

[jira] [Updated] (FLINK-27795) SqlValidatorException when insert null value

2022-05-25 Thread linqichen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] linqichen updated FLINK-27795: -- Description: Hello , I found a problem, when i try to insert null value.  i think it is very common t

[jira] [Updated] (FLINK-27795) SqlValidatorException when insert null value

2022-05-25 Thread linqichen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] linqichen updated FLINK-27795: -- Description: i found a problem, when i try to insert null value.  i think it is very common to insert

[jira] [Updated] (FLINK-27794) The primary key obtained from MySQL is incorrect by using MysqlCatalog

2022-05-25 Thread dusukang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dusukang updated FLINK-27794: - Description: I want to use MysqlCatalog to get the primary key of the database table `user`. The databa

[jira] [Created] (FLINK-27795) SqlValidatorException when insert null value

2022-05-25 Thread linqichen (Jira)
linqichen created FLINK-27795: - Summary: SqlValidatorException when insert null value Key: FLINK-27795 URL: https://issues.apache.org/jira/browse/FLINK-27795 Project: Flink Issue Type: Bug

[jira] [Updated] (FLINK-27794) The primary key obtained from MySQL is incorrect by using MysqlCatalog

2022-05-25 Thread dusukang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dusukang updated FLINK-27794: - Labels: pull-request-available (was: ) > The primary key obtained from MySQL is incorrect by using Mysq

[jira] [Updated] (FLINK-27794) The primary key obtained from MySQL is incorrect by using MysqlCatalog

2022-05-25 Thread dusukang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dusukang updated FLINK-27794: - Description: I want to use MysqlCatalog to get the primary key of the database table `user`. The databa

[jira] [Updated] (FLINK-27794) The primary key obtained from MySQL is incorrect by using MysqlCatalog

2022-05-25 Thread dusukang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dusukang updated FLINK-27794: - Description: I want to use MysqlCatalog to get the primary key of the database table `user`. The databa

[jira] [Updated] (FLINK-27794) The primary key obtained from MySQL is incorrect by using MysqlCatalog

2022-05-25 Thread dusukang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dusukang updated FLINK-27794: - Attachment: 167908239-c6f3f0ad-af06-436f-87e2-85c60428b400.png > The primary key obtained from MySQL is

[jira] [Updated] (FLINK-27794) The primary key obtained from MySQL is incorrect by using MysqlCatalog

2022-05-25 Thread dusukang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dusukang updated FLINK-27794: - Description: I want to use MysqlCatalog to get the primary key of the database table `user`. The databa

[jira] [Updated] (FLINK-27794) The primary key obtained from MySQL is incorrect by using MysqlCatalog

2022-05-25 Thread dusukang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dusukang updated FLINK-27794: - Description: I want to use MysqlCatalog to get the primary key of the database table `user`. The databa

[jira] [Updated] (FLINK-27794) The primary key obtained from MySQL is incorrect by using MysqlCatalog

2022-05-25 Thread dusukang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dusukang updated FLINK-27794: - Description: I want to use MysqlCatalog to get the primary key of the database table `user`. The databa

[jira] [Updated] (FLINK-27794) The primary key obtained from MySQL is incorrect by using MysqlCatalog

2022-05-25 Thread dusukang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dusukang updated FLINK-27794: - Description: I want to use MysqlCatalog to get the information of the database table `user`. The databa

[jira] [Created] (FLINK-27794) The primary key obtained from MySQL is incorrect by using MysqlCatalog

2022-05-25 Thread dusukang (Jira)
dusukang created FLINK-27794: Summary: The primary key obtained from MySQL is incorrect by using MysqlCatalog Key: FLINK-27794 URL: https://issues.apache.org/jira/browse/FLINK-27794 Project: Flink

[jira] [Created] (FLINK-27793) After upgrading to flink-1.15.0, flink jobmanager cannot shutdown

2022-05-25 Thread jinshuangxian (Jira)
jinshuangxian created FLINK-27793: - Summary: After upgrading to flink-1.15.0, flink jobmanager cannot shutdown Key: FLINK-27793 URL: https://issues.apache.org/jira/browse/FLINK-27793 Project: Flink

[jira] [Commented] (FLINK-27734) Not showing checkpoint interval properly in WebUI when checkpoint is disabled

2022-05-25 Thread Feifan Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542320#comment-17542320 ] Feifan Wang commented on FLINK-27734: - Hi [~junhany] , can you help me confirm this

[jira] [Commented] (FLINK-26621) flink-tests failed on azure due to Error occurred in starting fork

2022-05-25 Thread Huang Xingbo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542312#comment-17542312 ] Huang Xingbo commented on FLINK-26621: -- https://dev.azure.com/apache-flink/apache-f

[jira] [Created] (FLINK-27792) WindowDistinctAggregateITCase. testTumbleWindow_Rollup failed with InterruptedException

2022-05-25 Thread Huang Xingbo (Jira)
Huang Xingbo created FLINK-27792: Summary: WindowDistinctAggregateITCase. testTumbleWindow_Rollup failed with InterruptedException Key: FLINK-27792 URL: https://issues.apache.org/jira/browse/FLINK-27792

[jira] [Commented] (FLINK-27667) YARNHighAvailabilityITCase fails with "Failed to delete temp directory /tmp/junit1681"

2022-05-25 Thread Huang Xingbo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542311#comment-17542311 ] Huang Xingbo commented on FLINK-27667: -- https://dev.azure.com/apache-flink/apache-f

[jira] [Created] (FLINK-27791) SlotCountExceedingParallelismTest tests failed with NoResourceAvailableException

2022-05-25 Thread Huang Xingbo (Jira)
Huang Xingbo created FLINK-27791: Summary: SlotCountExceedingParallelismTest tests failed with NoResourceAvailableException Key: FLINK-27791 URL: https://issues.apache.org/jira/browse/FLINK-27791 Proj

[GitHub] [flink-statefun-playground] dependabot[bot] opened a new pull request, #32: Bump undertow-core from 1.4.18.Final to 2.2.11.Final in /java/greeter

2022-05-25 Thread GitBox
dependabot[bot] opened a new pull request, #32: URL: https://github.com/apache/flink-statefun-playground/pull/32 Bumps [undertow-core](https://github.com/undertow-io/undertow) from 1.4.18.Final to 2.2.11.Final. Commits https://github.com/undertow-io/undertow/commit/df0f10c6e620

[GitHub] [flink-table-store] JingsongLi commented on a diff in pull request #138: [FLINK-27707] Implement ManagedTableFactory#onCompactTable

2022-05-25 Thread GitBox
JingsongLi commented on code in PR #138: URL: https://github.com/apache/flink-table-store/pull/138#discussion_r882251162 ## flink-table-store-connector/src/main/java/org/apache/flink/table/store/connector/AbstractTableStoreFactory.java: ## @@ -155,7 +155,7 @@ static Map filterL

[GitHub] [flink-statefun-playground] dependabot[bot] opened a new pull request, #31: Bump undertow-core from 1.4.18.Final to 2.2.11.Final in /java/showcase

2022-05-25 Thread GitBox
dependabot[bot] opened a new pull request, #31: URL: https://github.com/apache/flink-statefun-playground/pull/31 Bumps [undertow-core](https://github.com/undertow-io/undertow) from 1.4.18.Final to 2.2.11.Final. Commits https://github.com/undertow-io/undertow/commit/df0f10c6e620

[GitHub] [flink-statefun-playground] dependabot[bot] opened a new pull request, #30: Bump undertow-core from 1.4.18.Final to 2.2.11.Final in /java/shopping-cart

2022-05-25 Thread GitBox
dependabot[bot] opened a new pull request, #30: URL: https://github.com/apache/flink-statefun-playground/pull/30 Bumps [undertow-core](https://github.com/undertow-io/undertow) from 1.4.18.Final to 2.2.11.Final. Commits https://github.com/undertow-io/undertow/commit/df0f10c6e620

[GitHub] [flink-statefun-playground] dependabot[bot] opened a new pull request, #29: Bump undertow-core from 1.4.18.Final to 2.2.11.Final in /java/connected-components

2022-05-25 Thread GitBox
dependabot[bot] opened a new pull request, #29: URL: https://github.com/apache/flink-statefun-playground/pull/29 Bumps [undertow-core](https://github.com/undertow-io/undertow) from 1.4.18.Final to 2.2.11.Final. Commits https://github.com/undertow-io/undertow/commit/df0f10c6e620

[jira] [Updated] (FLINK-27777) Can not get the parquet.compression when using native parquet&orc writer to sink hive

2022-05-25 Thread Small Wong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Small Wong updated FLINK-2: --- Description: flink.version: 1.13 After set {*}table.exec.hive.fallback-mapred-writer=false{*}, then

[jira] [Created] (FLINK-27790) Move ADD/Remove Jar syntax code implementation from SqlClient to TableEnvironment side

2022-05-25 Thread dalongliu (Jira)
dalongliu created FLINK-27790: - Summary: Move ADD/Remove Jar syntax code implementation from SqlClient to TableEnvironment side Key: FLINK-27790 URL: https://issues.apache.org/jira/browse/FLINK-27790 Proj

[jira] [Created] (FLINK-27789) LegacySource compatible with overdraft buffer

2022-05-25 Thread fanrui (Jira)
fanrui created FLINK-27789: -- Summary: LegacySource compatible with overdraft buffer Key: FLINK-27789 URL: https://issues.apache.org/jira/browse/FLINK-27789 Project: Flink Issue Type: Sub-task

[jira] [Commented] (FLINK-27721) Slack: set up archive

2022-05-25 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542309#comment-17542309 ] Xintong Song commented on FLINK-27721: -- bq. Which server are we going to use for th

[jira] [Closed] (FLINK-27760) NPE is thrown when executing PyFlink jobs in batch mode

2022-05-25 Thread Dian Fu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dian Fu closed FLINK-27760. --- Fix Version/s: 1.13.7 1.14.5 1.16.0 1.15.1 Re

[GitHub] [flink] dianfu closed pull request #19816: [FLINK-27760][python] Fix the issue that NPE is thrown when executing PyFlink Table API jobs in batch mode

2022-05-25 Thread GitBox
dianfu closed pull request #19816: [FLINK-27760][python] Fix the issue that NPE is thrown when executing PyFlink Table API jobs in batch mode URL: https://github.com/apache/flink/pull/19816 -- This is an automated message from the Apache Git Service. To respond to the message, please log on t

[GitHub] [flink] flinkbot commented on pull request #19820: [hotfix][docs-zh] Add missing the flame_graphs.md file to debugging.

2022-05-25 Thread GitBox
flinkbot commented on PR #19820: URL: https://github.com/apache/flink/pull/19820#issuecomment-1138019010 ## CI report: * 57553025921f2fb7db332973b0d88c75aa0d32bc UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink] liuzhuang2017 opened a new pull request, #19820: [hotfix][docs-zh] Add missing the flame_graphs.md file to debugging.

2022-05-25 Thread GitBox
liuzhuang2017 opened a new pull request, #19820: URL: https://github.com/apache/flink/pull/19820 ## What is the purpose of the change - **This is the English document:** ![image](https://user-images.githubusercontent.com/95120044/170391338-059395de-ff4e-4247-ba2f-6953526c4138.p

[jira] [Assigned] (FLINK-27788) Adding annotation to k8 operator Pod

2022-05-25 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise reassigned FLINK-27788: Assignee: Jaganathan Asokan > Adding annotation to k8 operator Pod >

[jira] [Updated] (FLINK-27788) Adding annotation to k8 operator Pod

2022-05-25 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise updated FLINK-27788: - Fix Version/s: (was: kubernetes-operator-0.1.0) (was: kubernetes-opera

[jira] [Created] (FLINK-27788) Adding annotation to k8 operator Pod

2022-05-25 Thread Jaganathan Asokan (Jira)
Jaganathan Asokan created FLINK-27788: - Summary: Adding annotation to k8 operator Pod Key: FLINK-27788 URL: https://issues.apache.org/jira/browse/FLINK-27788 Project: Flink Issue Type: Im

[jira] [Updated] (FLINK-27787) New tasks think they've been restored from savepoint (even when they weren't present in that savepoint)

2022-05-25 Thread Stephen Patel (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Patel updated FLINK-27787: -- Description: I think I've found a bug with new task restoration from savepoints. I have some

[jira] [Created] (FLINK-27787) New tasks think they've been restored from savepoint (even when they weren't present in that savepoint)

2022-05-25 Thread Stephen Patel (Jira)
Stephen Patel created FLINK-27787: - Summary: New tasks think they've been restored from savepoint (even when they weren't present in that savepoint) Key: FLINK-27787 URL: https://issues.apache.org/jira/browse/FLIN

[GitHub] [flink] Sxnan commented on pull request #19653: [FLINK-27523] Runtime supports producing and consuming cached intermediate results

2022-05-25 Thread GitBox
Sxnan commented on PR #19653: URL: https://github.com/apache/flink/pull/19653#issuecomment-1137495948 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [flink] fredia commented on a diff in pull request #19448: [FLINK-25872][state] Support restore from non-changelog checkpoint with changelog enabled in CLAIM mode

2022-05-25 Thread GitBox
fredia commented on code in PR #19448: URL: https://github.com/apache/flink/pull/19448#discussion_r881847122 ## flink-runtime/src/main/java/org/apache/flink/runtime/state/SharedStateRegistry.java: ## @@ -57,13 +63,30 @@ public interface SharedStateRegistry extends AutoCloseable

[GitHub] [flink] fredia commented on a diff in pull request #19448: [FLINK-25872][state] Support restore from non-changelog checkpoint with changelog enabled in CLAIM mode

2022-05-25 Thread GitBox
fredia commented on code in PR #19448: URL: https://github.com/apache/flink/pull/19448#discussion_r881839740 ## flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/CheckpointsCleaner.java: ## @@ -107,6 +144,7 @@ private void maybeCompleteCloseUnsafe() { if (

[GitHub] [flink] akalash commented on pull request #19702: [FLINK-27031][runtime] Assign even empty old state to the task if the…

2022-05-25 Thread GitBox
akalash commented on PR #19702: URL: https://github.com/apache/flink/pull/19702#issuecomment-1137472221 It is not really that way. jobManagerTaskRestore -> InflightDataRescalingDescriptor -> Virtual Channel is the current logic that says that we need Virtual Channel only if we need rescalin

[GitHub] [flink-kubernetes-operator] morhidi commented on a diff in pull request #237: [FLINK-27257] Flink kubernetes operator triggers savepoint failed because of not all tasks running

2022-05-25 Thread GitBox
morhidi commented on code in PR #237: URL: https://github.com/apache/flink-kubernetes-operator/pull/237#discussion_r881784524 ## flink-kubernetes-operator/src/main/java/org/apache/flink/kubernetes/operator/service/FlinkService.java: ## @@ -618,32 +623,51 @@ public SavepointFetc

[jira] [Assigned] (FLINK-27779) Connectors should not depend on `flink-table-planner`

2022-05-25 Thread Alexander Preuss (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Preuss reassigned FLINK-27779: Assignee: Alexander Preuss > Connectors should not depend on `flink-table-planner

[GitHub] [flink-kubernetes-operator] SteNicholas commented on a diff in pull request #237: [FLINK-27257] Flink kubernetes operator triggers savepoint failed because of not all tasks running

2022-05-25 Thread GitBox
SteNicholas commented on code in PR #237: URL: https://github.com/apache/flink-kubernetes-operator/pull/237#discussion_r881766813 ## flink-kubernetes-operator/src/main/java/org/apache/flink/kubernetes/operator/service/FlinkService.java: ## @@ -618,32 +623,51 @@ public Savepoint

[jira] [Created] (FLINK-27786) Connector-hive should not depend on `flink-table-planner`

2022-05-25 Thread Alexander Preuss (Jira)
Alexander Preuss created FLINK-27786: Summary: Connector-hive should not depend on `flink-table-planner` Key: FLINK-27786 URL: https://issues.apache.org/jira/browse/FLINK-27786 Project: Flink

[jira] [Updated] (FLINK-27784) Connector-jdbc should not depend on `flink-table-planner`

2022-05-25 Thread Alexander Preuss (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Preuss updated FLINK-27784: - Priority: Minor (was: Major) > Connector-jdbc should not depend on `flink-table-planner

[GitHub] [flink] rkhachatryan commented on a diff in pull request #19819: [FLINK-27169][tests] Set timeout for operator lifecycle tests and increase changelog upload timeout

2022-05-25 Thread GitBox
rkhachatryan commented on code in PR #19819: URL: https://github.com/apache/flink/pull/19819#discussion_r881765652 ## flink-tests/src/test/java/org/apache/flink/runtime/operators/lifecycle/TestJobExecutor.java: ## @@ -77,28 +77,28 @@ private TestJobExecutor( public static T

[jira] [Updated] (FLINK-27784) Connector-jdbc should not depend on `flink-table-planner`

2022-05-25 Thread Alexander Preuss (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Preuss updated FLINK-27784: - Component/s: Connectors / JDBC > Connector-jdbc should not depend on `flink-table-planne

[jira] [Updated] (FLINK-27781) Connector-kafka should not depend on `flink-table-planner`

2022-05-25 Thread Alexander Preuss (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Preuss updated FLINK-27781: - Component/s: Connectors / Kafka > Connector-kafka should not depend on `flink-table-plan

[jira] [Created] (FLINK-27784) Connector-jdbc should not depend on `flink-table-planner`

2022-05-25 Thread Alexander Preuss (Jira)
Alexander Preuss created FLINK-27784: Summary: Connector-jdbc should not depend on `flink-table-planner` Key: FLINK-27784 URL: https://issues.apache.org/jira/browse/FLINK-27784 Project: Flink

[jira] [Created] (FLINK-27783) Connector-aws-kinesis should not depend on `flink-table-planner`

2022-05-25 Thread Alexander Preuss (Jira)
Alexander Preuss created FLINK-27783: Summary: Connector-aws-kinesis should not depend on `flink-table-planner` Key: FLINK-27783 URL: https://issues.apache.org/jira/browse/FLINK-27783 Project: Fli

[jira] [Created] (FLINK-27785) Connector-hbase should not depend on `flink-table-planner`

2022-05-25 Thread Alexander Preuss (Jira)
Alexander Preuss created FLINK-27785: Summary: Connector-hbase should not depend on `flink-table-planner` Key: FLINK-27785 URL: https://issues.apache.org/jira/browse/FLINK-27785 Project: Flink

[jira] [Created] (FLINK-27782) Connector-kinesis should not depend on `flink-table-planner`

2022-05-25 Thread Alexander Preuss (Jira)
Alexander Preuss created FLINK-27782: Summary: Connector-kinesis should not depend on `flink-table-planner` Key: FLINK-27782 URL: https://issues.apache.org/jira/browse/FLINK-27782 Project: Flink

[jira] [Created] (FLINK-27781) Connector-kafka should not depend on `flink-table-planner`

2022-05-25 Thread Alexander Preuss (Jira)
Alexander Preuss created FLINK-27781: Summary: Connector-kafka should not depend on `flink-table-planner` Key: FLINK-27781 URL: https://issues.apache.org/jira/browse/FLINK-27781 Project: Flink

[jira] [Created] (FLINK-27780) Connector-cassandra should not depend on `flink-table-planner`

2022-05-25 Thread Alexander Preuss (Jira)
Alexander Preuss created FLINK-27780: Summary: Connector-cassandra should not depend on `flink-table-planner` Key: FLINK-27780 URL: https://issues.apache.org/jira/browse/FLINK-27780 Project: Flink

[GitHub] [flink] rkhachatryan commented on a diff in pull request #19448: [FLINK-25872][state] Support restore from non-changelog checkpoint with changelog enabled in CLAIM mode

2022-05-25 Thread GitBox
rkhachatryan commented on code in PR #19448: URL: https://github.com/apache/flink/pull/19448#discussion_r881739752 ## flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/CheckpointsCleaner.java: ## @@ -50,6 +54,9 @@ public class CheckpointsCleaner implements Serializ

[jira] [Created] (FLINK-27779) Connectors should not depend on `flink-table-planner`

2022-05-25 Thread Alexander Preuss (Jira)
Alexander Preuss created FLINK-27779: Summary: Connectors should not depend on `flink-table-planner` Key: FLINK-27779 URL: https://issues.apache.org/jira/browse/FLINK-27779 Project: Flink

[jira] [Closed] (FLINK-27740) [JUnit5 Migration] Module: flink-test-utils-junit

2022-05-25 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler closed FLINK-27740. Fix Version/s: 1.16.0 Assignee: Sergey Nuyanzin Resolution: Fixed master:

[GitHub] [flink] zentol merged pull request #19792: [FLINK-27740][tests] Migrate flink-test-utils-junit to JUnit5

2022-05-25 Thread GitBox
zentol merged PR #19792: URL: https://github.com/apache/flink/pull/19792 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache

[jira] [Updated] (FLINK-27557) Submit compaction when prepareCommit is triggered

2022-05-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-27557: --- Labels: pull-request-available (was: ) > Submit compaction when prepareCommit is triggered

[GitHub] [flink-table-store] LadyForest opened a new pull request, #139: [FLINK-27557] Submit compaction when prepareCommit is triggered

2022-05-25 Thread GitBox
LadyForest opened a new pull request, #139: URL: https://github.com/apache/flink-table-store/pull/139 Currently, `FileStoreWrite` will scan and plan files when creating a non-empty writer. We should also create a non-empty writer for non-rescale compaction cases but instead use the pre-plan

[jira] [Updated] (FLINK-27557) Trigger compaction when prepareCommit is triggered

2022-05-25 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-27557: -- Summary: Trigger compaction when prepareCommit is triggered (was: Let FileStoreWrite accept pre-plann

[jira] [Updated] (FLINK-27557) Submit compaction when prepareCommit is triggered

2022-05-25 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-27557: -- Summary: Submit compaction when prepareCommit is triggered (was: Trigger compaction when prepareCommi

[jira] [Updated] (FLINK-27557) Let FileStoreWrite accept pre-planned manifest entries and let MergeTreeWriter trigger compaction when commit

2022-05-25 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-27557: -- Description: Currently, FileStoreWrite will scan and plan files when creating a non-empty writer. We

[GitHub] [flink] zentol commented on pull request #19815: [FLINK-27731][Documentation][Build] Make it possible to build documentation with Hugo container

2022-05-25 Thread GitBox
zentol commented on PR #19815: URL: https://github.com/apache/flink/pull/19815#issuecomment-1137302619 Do we want to maintain a second image that is capable of building the docs (beyond the CI image)? The CI image is a bit heavier than a purpose-built hugo image, but I'm not sure that is su

[jira] [Updated] (FLINK-27557) Let FileStoreWrite accept pre-planned manifest entries and let MergeTreeWriter trigger compaction when commit

2022-05-25 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-27557: -- Summary: Let FileStoreWrite accept pre-planned manifest entries and let MergeTreeWriter trigger compac

[jira] [Updated] (FLINK-27557) Let FileStoreWrite accept pre-planned manifest entries and trigger compaction when commit

2022-05-25 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jane Chan updated FLINK-27557: -- Summary: Let FileStoreWrite accept pre-planned manifest entries and trigger compaction when commit (w

[GitHub] [flink] zentol commented on a diff in pull request #19819: [FLINK-27169][tests] Set timeout for operator lifecycle tests and increase changelog upload timeout

2022-05-25 Thread GitBox
zentol commented on code in PR #19819: URL: https://github.com/apache/flink/pull/19819#discussion_r881697420 ## flink-tests/src/test/java/org/apache/flink/runtime/operators/lifecycle/TestJobExecutor.java: ## @@ -77,28 +77,28 @@ private TestJobExecutor( public static TestJob

[GitHub] [flink-kubernetes-operator] csviri commented on pull request #239: [FLINK-27714] Migrate to java-operator-sdk v3

2022-05-25 Thread GitBox
csviri commented on PR #239: URL: https://github.com/apache/flink-kubernetes-operator/pull/239#issuecomment-1137278874 Hi, thank you @morhidi for reporting this issue. On the main it's already fixed. After we merged an additional related improvement: https://github.com/java-operator-sdk/j

[jira] [Commented] (FLINK-27745) ClientUtilsTest.uploadAndSetUserArtifacts failed with NoClassDefFoundError

2022-05-25 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542062#comment-17542062 ] Chesnay Schepler commented on FLINK-27745: -- https://dev.azure.com/chesnay/flink

[jira] [Updated] (FLINK-27169) PartiallyFinishedSourcesITCase.test hangs on azure

2022-05-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-27169: --- Labels: pull-request-available test-stability (was: test-stability) > PartiallyFinishedSour

[GitHub] [flink] flinkbot commented on pull request #19819: [FLINK-27169][tests] Set timeout for operator lifecycle tests and increase changelog upload timeout

2022-05-25 Thread GitBox
flinkbot commented on PR #19819: URL: https://github.com/apache/flink/pull/19819#issuecomment-1137257175 ## CI report: * 85506ac60575794e4db49523554655aefaa0c7a2 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink] rkhachatryan opened a new pull request, #19819: F27169

2022-05-25 Thread GitBox
rkhachatryan opened a new pull request, #19819: URL: https://github.com/apache/flink/pull/19819 ## What is the purpose of the change Fix test instability caused by changelog write timeouts. ## Verifying this change This change is a trivial rework without any test coverage

[GitHub] [flink] MartijnVisser commented on pull request #19815: [FLINK-27731][Documentation][Build] Make it possible to build documentation with Hugo container

2022-05-25 Thread GitBox
MartijnVisser commented on PR #19815: URL: https://github.com/apache/flink/pull/19815#issuecomment-1137245208 > Yeah, I'd be curious if we could come up with an alternative to that image, because it seems kinda eh. We could decide to fork it and remove the hardwire + add bash. --

[jira] [Updated] (FLINK-27778) table-planner should explicitly depend on table-code-splitter

2022-05-25 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler updated FLINK-27778: - Description: The {{table-planner}} has a direct dependency on the {{table-code-splitter}

[jira] [Created] (FLINK-27778) table-planner should explicitly depend on table-code-splitter

2022-05-25 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-27778: Summary: table-planner should explicitly depend on table-code-splitter Key: FLINK-27778 URL: https://issues.apache.org/jira/browse/FLINK-27778 Project: Flink

[jira] [Comment Edited] (FLINK-27169) PartiallyFinishedSourcesITCase.test hangs on azure

2022-05-25 Thread Roman Khachatryan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542043#comment-17542043 ] Roman Khachatryan edited comment on FLINK-27169 at 5/25/22 1:21 PM: --

[GitHub] [flink] flinkbot commented on pull request #19818: [FLINK-26410][hive] Hive dialect supports "transform using 'xxx'"

2022-05-25 Thread GitBox
flinkbot commented on PR #19818: URL: https://github.com/apache/flink/pull/19818#issuecomment-1137232047 ## CI report: * 872487e870162441de9fc69faca7d349e9f59327 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Commented] (FLINK-27721) Slack: set up archive

2022-05-25 Thread Robert Metzger (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542046#comment-17542046 ] Robert Metzger commented on FLINK-27721: I agree, let's not block the effort on

  1   2   3   >