[GitHub] [flink] adiaixin commented on pull request #18719: [FLINK-22781][table-planner-blink] Fix bug that when implements the LookupFunction In SQL that indirect extends (Async)TableFunction, throw

2022-04-21 Thread GitBox
adiaixin commented on PR #18719: URL: https://github.com/apache/flink/pull/18719#issuecomment-1106075545 @twalthr hi, could you review this pr when you are free ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[jira] [Closed] (FLINK-27161) Support user jar from different type of filesystems

2022-04-21 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang closed FLINK-27161. - Resolution: Fixed Fixed via: main: f7ee710e1b66885f57ab422ccb2293176df6c503 > Support user jar from di

[GitHub] [flink-kubernetes-operator] wangyang0918 merged pull request #168: [FLINK-27161] Support fetch user jar from different source

2022-04-21 Thread GitBox
wangyang0918 merged PR #168: URL: https://github.com/apache/flink-kubernetes-operator/pull/168 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-un

[jira] [Commented] (FLINK-27155) Reduce multiple reads to the same Changelog file in the same taskmanager during restore

2022-04-21 Thread Feifan Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17526218#comment-17526218 ] Feifan Wang commented on FLINK-27155: - I considered the reference count implementati

[jira] [Commented] (FLINK-24434) PyFlink YARN per-job on Docker test fails on Azure

2022-04-21 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17526209#comment-17526209 ] Yun Gao commented on FLINK-24434: - 1.14: https://dev.azure.com/apache-flink/apache-flin

[jira] [Commented] (FLINK-26721) PulsarSourceITCase.testSavepoint failed on azure pipeline

2022-04-21 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17526206#comment-17526206 ] Yun Gao commented on FLINK-26721: - https://dev.azure.com/apache-flink/apache-flink/_buil

[jira] [Updated] (FLINK-26772) Application and Job Mode does not wait for job cleanup during shutdown

2022-04-21 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl updated FLINK-26772: -- Summary: Application and Job Mode does not wait for job cleanup during shutdown (was: Applica

[jira] [Updated] (FLINK-27343) flink jdbc sink will lead to unordered result, because the sink buffer records execute unorder

2022-04-21 Thread pengyusong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] pengyusong updated FLINK-27343: --- Description: * situation one     when i use flink sql kafka connector re-consume a topic, the topic

[jira] [Commented] (FLINK-26772) Application Mode does not wait for job cleanup during shutdown

2022-04-21 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17526203#comment-17526203 ] Matthias Pohl commented on FLINK-26772: --- FYI: This applies to both, the applicatio

[GitHub] [flink-kubernetes-operator] Aitozi commented on pull request #168: [FLINK-27161] Support fetch user jar from different source

2022-04-21 Thread GitBox
Aitozi commented on PR #168: URL: https://github.com/apache/flink-kubernetes-operator/pull/168#issuecomment-1106004593 I have updated, please take a look again @wangyang0918 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub an

[GitHub] [flink] zoltar9264 commented on a diff in pull request #19441: [FLINK-27187][state/changelog] Add changelog storage metric totalAttemptsPerUpload

2022-04-21 Thread GitBox
zoltar9264 commented on code in PR #19441: URL: https://github.com/apache/flink/pull/19441#discussion_r855760227 ## flink-dstl/flink-dstl-dfs/src/test/java/org/apache/flink/changelog/fs/ChangelogStorageMetricsTest.java: ## @@ -295,6 +346,55 @@ public void close() { }

[jira] [Updated] (FLINK-27350) JobManager doesn't bring up new TaskManager during failure recovery

2022-04-21 Thread Chenyu Zheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenyu Zheng updated FLINK-27350: - Affects Version/s: 1.13.2 > JobManager doesn't bring up new TaskManager during failure recovery

[jira] [Created] (FLINK-27350) JobManager doesn't bring up new TaskManager during failure recovery

2022-04-21 Thread Chenyu Zheng (Jira)
Chenyu Zheng created FLINK-27350: Summary: JobManager doesn't bring up new TaskManager during failure recovery Key: FLINK-27350 URL: https://issues.apache.org/jira/browse/FLINK-27350 Project: Flink

[GitHub] [flink] zoltar9264 commented on a diff in pull request #19441: [FLINK-27187][state/changelog] Add changelog storage metric totalAttemptsPerUpload

2022-04-21 Thread GitBox
zoltar9264 commented on code in PR #19441: URL: https://github.com/apache/flink/pull/19441#discussion_r855755359 ## flink-dstl/flink-dstl-dfs/src/test/java/org/apache/flink/changelog/fs/ChangelogStorageMetricsTest.java: ## @@ -295,6 +346,55 @@ public void close() { }

[GitHub] [flink] Myasuka commented on a diff in pull request #19142: [FLINK-23252][changelog] Support recovery from checkpoint after disab…

2022-04-21 Thread GitBox
Myasuka commented on code in PR #19142: URL: https://github.com/apache/flink/pull/19142#discussion_r855747431 ## flink-runtime/src/main/java/org/apache/flink/runtime/state/AbstractKeyedStateBackend.java: ## @@ -155,6 +155,25 @@ public AbstractKeyedStateBackend( this.key

[GitHub] [flink-kubernetes-operator] Aitozi commented on a diff in pull request #168: [FLINK-27161] Support fetch user jar from different source

2022-04-21 Thread GitBox
Aitozi commented on code in PR #168: URL: https://github.com/apache/flink-kubernetes-operator/pull/168#discussion_r855749032 ## docs/content/docs/operations/configuration.md: ## @@ -62,3 +62,4 @@ To learn more about metrics and logging configuration please refer to the dedica

[GitHub] [flink-kubernetes-operator] Aitozi commented on a diff in pull request #168: [FLINK-27161] Support fetch user jar from different source

2022-04-21 Thread GitBox
Aitozi commented on code in PR #168: URL: https://github.com/apache/flink-kubernetes-operator/pull/168#discussion_r855748943 ## flink-kubernetes-operator/src/main/java/org/apache/flink/kubernetes/operator/artifact/ArtifactManager.java: ## @@ -0,0 +1,75 @@ +/* + * Licensed to th

[GitHub] [flink-kubernetes-operator] wangyang0918 commented on a diff in pull request #168: [FLINK-27161] Support fetch user jar from different source

2022-04-21 Thread GitBox
wangyang0918 commented on code in PR #168: URL: https://github.com/apache/flink-kubernetes-operator/pull/168#discussion_r855741663 ## docs/content/docs/operations/configuration.md: ## @@ -62,3 +62,4 @@ To learn more about metrics and logging configuration please refer to the d

[jira] [Commented] (FLINK-27348) Flink KafkaSource doesn't set groupId

2022-04-21 Thread Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17526185#comment-17526185 ] Liu commented on FLINK-27348: - Have you committed the kafka offset? > Flink KafkaSource doe

[GitHub] [flink] mayuehappy commented on pull request #19508: [FLINK-27218] fix the problem that the internal Serializer in Operato…

2022-04-21 Thread GitBox
mayuehappy commented on PR #19508: URL: https://github.com/apache/flink/pull/19508#issuecomment-1105963636 > Thanks for the fix @mayuehappy, LGTM. Could you please squash the commits? > > cc: @Myasuka @rkhachatryan Thanks for the review . I've squashed the commits. -- This is

[jira] [Commented] (FLINK-22984) UnsupportedOperationException when using Python UDF to generate watermark

2022-04-21 Thread Juntao Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17526176#comment-17526176 ] Juntao Hu commented on FLINK-22984: --- It's a bug in optimizing sql plan, rather than a

[jira] [Updated] (FLINK-27349) The timeout of some methods such as JobMaster#requestJobXXX(Time timeout) does not take effect

2022-04-21 Thread Echo Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Echo Lee updated FLINK-27349: - Description: The timeout of some methods such as *JobMaster#requestJobXXX(Time timeout)* does not take

[jira] [Created] (FLINK-27349) The timeout of some methods such as JobMaster#requestJobXXX(Time timeout) does not take effect

2022-04-21 Thread Echo Lee (Jira)
Echo Lee created FLINK-27349: Summary: The timeout of some methods such as JobMaster#requestJobXXX(Time timeout) does not take effect Key: FLINK-27349 URL: https://issues.apache.org/jira/browse/FLINK-27349

[jira] [Updated] (FLINK-27348) Flink KafkaSource doesn't set groupId

2022-04-21 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-27348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Gürbüz updated FLINK-27348: - Description: I have one very simple Flink application. I have installed kafka in my local and I

[jira] [Updated] (FLINK-27348) Flink KafkaSource doesn't set groupId

2022-04-21 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-27348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Gürbüz updated FLINK-27348: - Description: I have one very simple Flink application. I have installed kafka in my local and I

[jira] [Updated] (FLINK-27348) Flink KafkaSource doesn't set groupId

2022-04-21 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-27348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Gürbüz updated FLINK-27348: - Attachment: image-2022-04-22-05-52-04-760.png > Flink KafkaSource doesn't set groupId >

[jira] [Updated] (FLINK-27348) Flink KafkaSource doesn't set groupId

2022-04-21 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-27348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Gürbüz updated FLINK-27348: - Description: I have one very simple Flink application. I have installed kafka in my local and I

[jira] [Updated] (FLINK-24950) Use Hive Dialect execute Hive DDL, But throw a NullPointerException

2022-04-21 Thread Adrian Zhong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adrian Zhong updated FLINK-24950: - Attachment: (was: [Hive-Function][FLINK-24950].patch) > Use Hive Dialect execute Hive DDL, B

[jira] (FLINK-24950) Use Hive Dialect execute Hive DDL, But throw a NullPointerException

2022-04-21 Thread Adrian Zhong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24950 ] Adrian Zhong deleted comment on FLINK-24950: -- was (Author: adrian z): Hi, I'm working on it.  For people who have to compile hive. Hive-1.1.0-cdh-5.12.1 [^[Hive-Function][FLINK-24950].patc

[GitHub] [flink] flinkbot commented on pull request #19551: [FLINK-22984][python] Disable PushWatermarkIntoTableSourceScanAcrossCalcRule when having Python UDF

2022-04-21 Thread GitBox
flinkbot commented on PR #19551: URL: https://github.com/apache/flink/pull/19551#issuecomment-1105949634 ## CI report: * dc7975ca6151d42ffb059621c8a8cc6be8ccfdc6 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Created] (FLINK-27348) Flink KafkaSource doesn't set groupId

2022-04-21 Thread Jira
Ahmet Gürbüz created FLINK-27348: Summary: Flink KafkaSource doesn't set groupId Key: FLINK-27348 URL: https://issues.apache.org/jira/browse/FLINK-27348 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-27347) Create flink-table-store-hive module

2022-04-21 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-27347: Summary: Create flink-table-store-hive module Key: FLINK-27347 URL: https://issues.apache.org/jira/browse/FLINK-27347 Project: Flink Issue Type: Sub-task

[jira] [Updated] (FLINK-22984) UnsupportedOperationException when using Python UDF to generate watermark

2022-04-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-22984: --- Labels: auto-deprioritized-critical auto-deprioritized-major pull-request-available (was: a

[jira] [Created] (FLINK-27346) [umbrella] Introduce Hive reader for table store

2022-04-21 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-27346: Summary: [umbrella] Introduce Hive reader for table store Key: FLINK-27346 URL: https://issues.apache.org/jira/browse/FLINK-27346 Project: Flink Issue Type:

[GitHub] [flink] Vancior opened a new pull request, #19551: [FLINK-22984][python] Disable PushWatermarkIntoTableSourceScanAcrossCalcRule when having Python UDF

2022-04-21 Thread GitBox
Vancior opened a new pull request, #19551: URL: https://github.com/apache/flink/pull/19551 ## What is the purpose of the change This pr fixes [FLINK-22984](https://issues.apache.org/jira/browse/FLINK-22984), which is caused by `PushWatermarkIntoTableSourceScanAcrossCalcRule` pushing

[GitHub] [flink] EchoLee5 commented on pull request #19525: [FLINK-27315][docs] Fix the demo of MemoryStateBackendMigration

2022-04-21 Thread GitBox
EchoLee5 commented on PR #19525: URL: https://github.com/apache/flink/pull/19525#issuecomment-1105946242 > @EchoLee5 The official website is not updated continously, please check it tomorrow. Thanks, I get it. -- This is an automated message from the Apache Git Service. To respond

[jira] [Created] (FLINK-27345) operator does not update related resource when flinkConfiguration, logConfiguration are updated.

2022-04-21 Thread 陳昌倬
ChangZhuo Chen (陳昌倬) created FLINK-27345: Summary: operator does not update related resource when flinkConfiguration, logConfiguration are updated. Key: FLINK-27345 URL: https://issues.apache.org/jira/brow

[jira] [Commented] (FLINK-27337) Prevent session cluster to be deleted when there are running jobs

2022-04-21 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17526161#comment-17526161 ] Yang Wang commented on FLINK-27337: --- I lean to not propagate the deletion to all the s

[jira] [Created] (FLINK-27344) FLIP-222: Support full query lifecycle statements in SQL client

2022-04-21 Thread Paul Lin (Jira)
Paul Lin created FLINK-27344: Summary: FLIP-222: Support full query lifecycle statements in SQL client Key: FLINK-27344 URL: https://issues.apache.org/jira/browse/FLINK-27344 Project: Flink Issu

[jira] [Updated] (FLINK-27343) flink jdbc sink will lead to unordered result, because the sink buffer records execute unorder

2022-04-21 Thread pengyusong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] pengyusong updated FLINK-27343: --- Summary: flink jdbc sink will lead to unordered result, because the sink buffer records execute unor

[jira] [Assigned] (FLINK-27334) Support auto generate the doc for the KubernetesOperatorConfigOptions

2022-04-21 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang reassigned FLINK-27334: - Assignee: Nicholas Jiang > Support auto generate the doc for the KubernetesOperatorConfigOption

[jira] [Closed] (FLINK-26457) Introduce Join Accumulator for Wide table

2022-04-21 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-26457. Resolution: Fixed master: 41338cc0d13810becdd2390ab809e5cee9b59712 > Introduce Join Accumulator f

[GitHub] [flink-table-store] JingsongLi merged pull request #98: [FLINK-26457] Introduce PartialUpdateMergeFunction

2022-04-21 Thread GitBox
JingsongLi merged PR #98: URL: https://github.com/apache/flink-table-store/pull/98 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@fl

[jira] [Created] (FLINK-27343) flink jdbc sink with default param will lead buffer records in one batch unorder

2022-04-21 Thread pengyusong (Jira)
pengyusong created FLINK-27343: -- Summary: flink jdbc sink with default param will lead buffer records in one batch unorder Key: FLINK-27343 URL: https://issues.apache.org/jira/browse/FLINK-27343 Project:

[GitHub] [flink] afedulov commented on pull request #19286: [FLINK-25931] Add projection pushdown support for CsvFormatFactory

2022-04-21 Thread GitBox
afedulov commented on PR #19286: URL: https://github.com/apache/flink/pull/19286#issuecomment-1105830907 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Updated] (FLINK-21834) org.apache.flink.core.fs.AbstractRecoverableWriterTest.testResumeWithWrongOffset fail

2022-04-21 Thread Flink Jira Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-21834: --- Labels: auto-deprioritized-critical auto-deprioritized-major test-stability (was: auto-de

[jira] [Updated] (FLINK-25675) UnalignedCheckpointCompatibilityITCase.test hangs on AZP

2022-04-21 Thread Flink Jira Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-25675: --- Labels: auto-deprioritized-critical auto-deprioritized-major test-stability (was: auto-de

[jira] [Updated] (FLINK-25068) Show the maximum parallelism (number of key groups) of a job in Web UI

2022-04-21 Thread Flink Jira Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-25068: --- Labels: pull-request-available stale-assigned (was: pull-request-available) I am the [Flink

[GitHub] [flink] afedulov commented on a diff in pull request #19228: [FLINK-26074] Improve FlameGraphs scalability for high parallelism jobs

2022-04-21 Thread GitBox
afedulov commented on code in PR #19228: URL: https://github.com/apache/flink/pull/19228#discussion_r855628580 ## flink-runtime/src/main/java/org/apache/flink/runtime/webmonitor/threadinfo/JobVertexThreadInfoStats.java: ## @@ -44,7 +45,7 @@ private final long endTime;

[GitHub] [flink] afedulov commented on a diff in pull request #19228: [FLINK-26074] Improve FlameGraphs scalability for high parallelism jobs

2022-04-21 Thread GitBox
afedulov commented on code in PR #19228: URL: https://github.com/apache/flink/pull/19228#discussion_r855628580 ## flink-runtime/src/main/java/org/apache/flink/runtime/webmonitor/threadinfo/JobVertexThreadInfoStats.java: ## @@ -44,7 +45,7 @@ private final long endTime;

[GitHub] [flink] afedulov commented on a diff in pull request #19228: [FLINK-26074] Improve FlameGraphs scalability for high parallelism jobs

2022-04-21 Thread GitBox
afedulov commented on code in PR #19228: URL: https://github.com/apache/flink/pull/19228#discussion_r855628580 ## flink-runtime/src/main/java/org/apache/flink/runtime/webmonitor/threadinfo/JobVertexThreadInfoStats.java: ## @@ -44,7 +45,7 @@ private final long endTime;

[GitHub] [flink] afedulov commented on a diff in pull request #19228: [FLINK-26074] Improve FlameGraphs scalability for high parallelism jobs

2022-04-21 Thread GitBox
afedulov commented on code in PR #19228: URL: https://github.com/apache/flink/pull/19228#discussion_r855628580 ## flink-runtime/src/main/java/org/apache/flink/runtime/webmonitor/threadinfo/JobVertexThreadInfoStats.java: ## @@ -44,7 +45,7 @@ private final long endTime;

[GitHub] [flink] JingGe commented on a diff in pull request #19377: [FLINK-27048][test] Add ArchUnit rule that connectors should only depend on public API

2022-04-21 Thread GitBox
JingGe commented on code in PR #19377: URL: https://github.com/apache/flink/pull/19377#discussion_r855627519 ## flink-architecture-tests/flink-architecture-tests-production/src/main/java/org/apache/flink/architecture/rules/ConnectorRules.java: ## @@ -0,0 +1,69 @@ +/* + * License

[jira] [Commented] (FLINK-27334) Support auto generate the doc for the KubernetesOperatorConfigOptions

2022-04-21 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17526085#comment-17526085 ] Nicholas Jiang commented on FLINK-27334: [~gyfora] [~aitozi], I have pushed a pu

[jira] [Updated] (FLINK-27334) Support auto generate the doc for the KubernetesOperatorConfigOptions

2022-04-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-27334: --- Labels: pull-request-available (was: ) > Support auto generate the doc for the KubernetesOp

[GitHub] [flink-kubernetes-operator] SteNicholas opened a new pull request, #178: [FLINK-27334] Support auto generate the doc for the `KubernetesOperatorConfigOptions`

2022-04-21 Thread GitBox
SteNicholas opened a new pull request, #178: URL: https://github.com/apache/flink-kubernetes-operator/pull/178 The document of the `KubernetesOperatorConfigOptions` should be automatically generated. **The brief change log** - Adds the `flink-kubernetes-docs` module and introdu

[GitHub] [flink-kubernetes-operator] GezimSejdiu commented on pull request #170: [FLINK-27235] Publish Flink k8s Operator Helm Charts via Github Actions

2022-04-21 Thread GitBox
GezimSejdiu commented on PR #170: URL: https://github.com/apache/flink-kubernetes-operator/pull/170#issuecomment-1105752453 > If the helm chart-releaser could support snapshot override, then this PR makes sense to me. Because users could test the new version easily. Indeed. That woul

[GitHub] [flink] MartijnVisser commented on pull request #19514: [FLINK-27308][Filesystem][S3] Update the Hadoop implementation for filesystems to 3.3.2

2022-04-21 Thread GitBox
MartijnVisser commented on PR #19514: URL: https://github.com/apache/flink/pull/19514#issuecomment-1105705076 @chinmayms Ah I missed your comment. I'll first try with the removal of the exclusion, else I'll explicitly add it. Most likely it will be during the weekend -- This is an automa

[jira] [Assigned] (FLINK-25511) Pre-emptively uploaded changelog not discarded up if materialized before checkpoint

2022-04-21 Thread Roman Khachatryan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roman Khachatryan reassigned FLINK-25511: - Assignee: Roman Khachatryan > Pre-emptively uploaded changelog not discarded up

[GitHub] [flink] flinkbot commented on pull request #19550: [FLINK-25512][state/changelog] Discard pre-emptively uploaded state changes not included into any checkpoint

2022-04-21 Thread GitBox
flinkbot commented on PR #19550: URL: https://github.com/apache/flink/pull/19550#issuecomment-1105658573 ## CI report: * 0a5c99b00a3308cbe030b8ee43ed627a06c4f295 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink] flinkbot commented on pull request #19549: [hotfix][docs] fix "parameters"

2022-04-21 Thread GitBox
flinkbot commented on PR #19549: URL: https://github.com/apache/flink/pull/19549#issuecomment-1105658457 ## CI report: * 02c5a16365df38a79542ff1cbc98f68f4d08bb9e UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-25512) Materialization Files are not cleaned up if no checkpoint is using it

2022-04-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-25512: --- Labels: pull-request-available (was: ) > Materialization Files are not cleaned up if no che

[GitHub] [flink] rkhachatryan opened a new pull request, #19550: [FLINK-25512][state/changelog] Discard pre-emptively uploaded state changes not included into any checkpoint

2022-04-21 Thread GitBox
rkhachatryan opened a new pull request, #19550: URL: https://github.com/apache/flink/pull/19550 ## What is the purpose of the change Discard pre-emptively uploaded state changes not included into any checkpoint. ## Verifying this change - `ChangelogRegistryImplTest` -

[GitHub] [flink] Hongbo-Miao opened a new pull request, #19549: docs: fix "parameters"

2022-04-21 Thread GitBox
Hongbo-Miao opened a new pull request, #19549: URL: https://github.com/apache/flink/pull/19549 ## What is the purpose of the change *(For example: This pull request makes task deployment go through the blob server, rather than through RPC. That way we avoid re-transferring the

[jira] [Comment Edited] (FLINK-27055) java.lang.ArrayIndexOutOfBoundsException in BinarySegmentUtils

2022-04-21 Thread Kenny Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525948#comment-17525948 ] Kenny Ma edited comment on FLINK-27055 at 4/21/22 7:06 PM: --- Th

[jira] [Commented] (FLINK-27155) Reduce multiple reads to the same Changelog file in the same taskmanager during restore

2022-04-21 Thread Roman Khachatryan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525963#comment-17525963 ] Roman Khachatryan commented on FLINK-27155: --- I think that should work. It wou

[jira] [Commented] (FLINK-23143) Support state migration

2022-04-21 Thread Roman Khachatryan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525953#comment-17525953 ] Roman Khachatryan commented on FLINK-23143: --- Hi, [~masteryhx] . I meant an ap

[GitHub] [flink] MartijnVisser commented on pull request #19514: [FLINK-27308][Filesystem][S3] Update the Hadoop implementation for filesystems to 3.3.2

2022-04-21 Thread GitBox
MartijnVisser commented on PR #19514: URL: https://github.com/apache/flink/pull/19514#issuecomment-1105613053 I'm suspecting this is caused by the exclusion of commons-compress, see https://github.com/apache/flink/blob/master/flink-filesystems/flink-fs-hadoop-shaded/pom.xml#L157-L160 -- T

[jira] [Closed] (FLINK-27055) java.lang.ArrayIndexOutOfBoundsException in BinarySegmentUtils

2022-04-21 Thread Kenny Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenny Ma closed FLINK-27055. Resolution: Not A Problem > java.lang.ArrayIndexOutOfBoundsException in BinarySegmentUtils > -

[jira] [Commented] (FLINK-27055) java.lang.ArrayIndexOutOfBoundsException in BinarySegmentUtils

2022-04-21 Thread Kenny Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525948#comment-17525948 ] Kenny Ma commented on FLINK-27055: -- The problem seems to be caused by our custom UDF th

[jira] [Commented] (FLINK-25470) Add/Expose/Differentiate metrics of checkpoint size between changelog size vs materialization size

2022-04-21 Thread Roman Khachatryan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525926#comment-17525926 ] Roman Khachatryan commented on FLINK-25470: --- Thanks for the analysis [~mastery

[GitHub] [flink] rkhachatryan commented on a diff in pull request #19142: [FLINK-23252][changelog] Support recovery from checkpoint after disab…

2022-04-21 Thread GitBox
rkhachatryan commented on code in PR #19142: URL: https://github.com/apache/flink/pull/19142#discussion_r855441945 ## flink-state-backends/flink-statebackend-changelog/src/main/java/org/apache/flink/state/changelog/restore/ChangelogMigrationRestoreTarget.java: ## @@ -0,0 +1,223

[GitHub] [flink] afedulov commented on pull request #19405: [FLINK-27066] Reintroduce e2e tests in ES as Java tests.

2022-04-21 Thread GitBox
afedulov commented on PR #19405: URL: https://github.com/apache/flink/pull/19405#issuecomment-1105509822 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

[GitHub] [flink] gaborgsomogyi commented on a diff in pull request #19372: [FLINK-26043][runtime][security] Add periodic kerberos relogin to KerberosDelegationTokenManager

2022-04-21 Thread GitBox
gaborgsomogyi commented on code in PR #19372: URL: https://github.com/apache/flink/pull/19372#discussion_r855434579 ## flink-runtime/src/main/java/org/apache/flink/runtime/security/token/KerberosDelegationTokenManager.java: ## @@ -110,13 +139,62 @@ public void obtainDelegationTo

[GitHub] [flink] chinmayms commented on pull request #19514: [FLINK-27308][Filesystem][S3] Update the Hadoop implementation for filesystems to 3.3.2

2022-04-21 Thread GitBox
chinmayms commented on PR #19514: URL: https://github.com/apache/flink/pull/19514#issuecomment-1105479109 @MartijnVisser Thank you. I think I know the reason for the failing test, this is something we have fixed in our internal build by adding commons-compress (https://mvnrepository

[jira] [Updated] (FLINK-27303) Flink Operator will create a large amount of temp log config files

2022-04-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-27303: --- Labels: pull-request-available (was: ) > Flink Operator will create a large amount of temp

[GitHub] [flink-kubernetes-operator] gyfora commented on pull request #177: [FLINK-27303][FLINK-27309] Introduce FlinkConfigManager for efficient config management

2022-04-21 Thread GitBox
gyfora commented on PR #177: URL: https://github.com/apache/flink-kubernetes-operator/pull/177#issuecomment-1105455646 cc @Aitozi @bgeng777 @morhidi @tweise @wangyang0918 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

[GitHub] [flink-kubernetes-operator] gyfora opened a new pull request, #177: [FLINK-27303][FLINK-27309] Introduce FlinkConfigManager for efficient config management

2022-04-21 Thread GitBox
gyfora opened a new pull request, #177: URL: https://github.com/apache/flink-kubernetes-operator/pull/177 This PR improves/reworks the configuration management of the oprator. Problems with the current approach: - Configuration and FlinkOperatorConfigurations are passed around everywhe

[jira] [Commented] (FLINK-24950) Use Hive Dialect execute Hive DDL, But throw a NullPointerException

2022-04-21 Thread Adrian Zhong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525828#comment-17525828 ] Adrian Zhong commented on FLINK-24950: -- Hi, I'm working on it.  For people who have

[jira] [Commented] (FLINK-27309) Allow to load default flink configs in the k8s operator dynamically

2022-04-21 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525827#comment-17525827 ] Thomas Weise commented on FLINK-27309: -- +1, my comment was regarding Flink deployme

[jira] [Updated] (FLINK-24950) Use Hive Dialect execute Hive DDL, But throw a NullPointerException

2022-04-21 Thread Adrian Zhong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adrian Zhong updated FLINK-24950: - Attachment: [Hive-Function][FLINK-24950].patch > Use Hive Dialect execute Hive DDL, But throw a

[jira] [Commented] (FLINK-26772) Application Mode does not wait for job cleanup during shutdown

2022-04-21 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525812#comment-17525812 ] Matthias Pohl commented on FLINK-26772: --- Summary of the investigation: As stated b

[jira] [Updated] (FLINK-25872) Restoring from non-changelog checkpoint with changelog state-backend enabled in CLAIM mode discards state in use

2022-04-21 Thread Roman Khachatryan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roman Khachatryan updated FLINK-25872: -- Description: If we restore from checkpoint with changelog state-backend enabled in sna

[jira] [Commented] (FLINK-27309) Allow to load default flink configs in the k8s operator dynamically

2022-04-21 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525798#comment-17525798 ] Gyula Fora commented on FLINK-27309: Config changes should not affect the running de

[jira] [Commented] (FLINK-27309) Allow to load default flink configs in the k8s operator dynamically

2022-04-21 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525796#comment-17525796 ] Gyula Fora commented on FLINK-27309: Currently if the user changes the operator conf

[jira] [Commented] (FLINK-27309) Allow to load default flink configs in the k8s operator dynamically

2022-04-21 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525790#comment-17525790 ] Thomas Weise commented on FLINK-27309: -- I think most users would not expect changes

[jira] [Closed] (FLINK-27342) Link to Apache privacy policy

2022-04-21 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler closed FLINK-27342. Resolution: Fixed asf-site: c6ec04b50fff4dec1083d1d3989cf82475630c1c > Link to Apache pri

[GitHub] [flink-web] zentol merged pull request #529: [FLINK-27342] Link to Apache privacy policy

2022-04-21 Thread GitBox
zentol merged PR #529: URL: https://github.com/apache/flink-web/pull/529 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache

[jira] [Commented] (FLINK-26586) FileSystem uses unbuffered read I/O

2022-04-21 Thread Anton Kalashnikov (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525783#comment-17525783 ] Anton Kalashnikov commented on FLINK-26586: --- [~Matthias Schwalbe] , Why do you

[GitHub] [flink-playgrounds] JHinW closed pull request #27: Feature/filesys

2022-04-21 Thread GitBox
JHinW closed pull request #27: Feature/filesys URL: https://github.com/apache/flink-playgrounds/pull/27 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (FLINK-27156) [FLIP-171] MongoDB implementation of Async Sink

2022-04-21 Thread Almog Tavor (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525761#comment-17525761 ] Almog Tavor commented on FLINK-27156: - [~martijnvisser] That's fine by me, but is th

[jira] [Updated] (FLINK-27342) Link to Apache privacy policy

2022-04-21 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler updated FLINK-27342: - Description: We've been instructed to drop our custom privacy policy and only link to th

[jira] [Updated] (FLINK-27342) Link to Apache privacy policy

2022-04-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-27342: --- Labels: pull-request-available (was: ) > Link to Apache privacy policy > --

[jira] [Commented] (FLINK-26586) FileSystem uses unbuffered read I/O

2022-04-21 Thread Matthias Schwalbe (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525744#comment-17525744 ] Matthias Schwalbe commented on FLINK-26586: --- Hi Anton, I'll try to build local

[GitHub] [flink-web] zentol opened a new pull request, #529: [FLINK-27342] Link to Apache privacy policy

2022-04-21 Thread GitBox
zentol opened a new pull request, #529: URL: https://github.com/apache/flink-web/pull/529 We've been instructed to replace our custom privacy policy with one provided by Apache. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [flink] alpreu commented on a diff in pull request #19377: [FLINK-27048][test] Add ArchUnit rule that connectors should only depend on public API

2022-04-21 Thread GitBox
alpreu commented on code in PR #19377: URL: https://github.com/apache/flink/pull/19377#discussion_r855243602 ## flink-architecture-tests/flink-architecture-tests-production/src/main/java/org/apache/flink/architecture/rules/ConnectorRules.java: ## @@ -0,0 +1,69 @@ +/* + * License

[jira] [Created] (FLINK-27342) Link to Apache privacy policy

2022-04-21 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-27342: Summary: Link to Apache privacy policy Key: FLINK-27342 URL: https://issues.apache.org/jira/browse/FLINK-27342 Project: Flink Issue Type: Technical D

[GitHub] [flink] JingGe commented on a diff in pull request #19377: [FLINK-27048][test] Add ArchUnit rule that connectors should only depend on public API

2022-04-21 Thread GitBox
JingGe commented on code in PR #19377: URL: https://github.com/apache/flink/pull/19377#discussion_r855236604 ## flink-architecture-tests/flink-architecture-tests-production/src/main/java/org/apache/flink/architecture/rules/ConnectorRules.java: ## @@ -0,0 +1,69 @@ +/* + * License

[GitHub] [flink] MartijnVisser commented on pull request #19514: [FLINK-27308][Filesystem][S3] Update the Hadoop implementation for filesystems to 3.3.2

2022-04-21 Thread GitBox
MartijnVisser commented on PR #19514: URL: https://github.com/apache/flink/pull/19514#issuecomment-1105255497 One of the S3 tests is failing unfortunately: ``` 2022-04-21T14:01:10.5059692Z Apr 21 14:01:09 org.apache.flink.client.program.ProgramInvocationException: The main method

[GitHub] [flink-training] zuston commented on pull request #45: [FLINK-25313] Enable flink runtime web-ui

2022-04-21 Thread GitBox
zuston commented on PR #45: URL: https://github.com/apache/flink-training/pull/45#issuecomment-1105250196 Thanks @NicoK -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

  1   2   >