Re: [PR] [FLINK-33529][python] Updated GET_SITE_PACKAGES_SCRIPT to include pur… [flink]

2023-11-13 Thread via GitHub
PrabhuJoseph commented on PR #23700: URL: https://github.com/apache/flink/pull/23700#issuecomment-1809695196 Thanks @dianfu and @ColtenP for the review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Commented] (FLINK-32523) NotifyCheckpointAbortedITCase.testNotifyCheckpointAborted fails with timeout on AZP

2023-11-13 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785777#comment-17785777 ] Matthias Pohl commented on FLINK-32523: ---

[jira] [Commented] (FLINK-33082) Azure Pipelines 4 is not responding on AZP

2023-11-13 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785776#comment-17785776 ] Matthias Pohl commented on FLINK-33082: ---

[jira] [Commented] (FLINK-18356) flink-table-planner Exit code 137 returned from process

2023-11-13 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785775#comment-17785775 ] Matthias Pohl commented on FLINK-18356: ---

[jira] [Commented] (FLINK-31278) exit code 137 (i.e. OutOfMemoryError) in core module

2023-11-13 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785774#comment-17785774 ] Matthias Pohl commented on FLINK-31278: --- There is a 137 in the table module as well (which is

[jira] [Commented] (FLINK-32972) TaskTest.testInterruptibleSharedLockInInvokeAndCancel causes a JVM shutdown with exit code 239

2023-11-13 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785773#comment-17785773 ] Matthias Pohl commented on FLINK-32972: ---

[jira] [Commented] (FLINK-31278) exit code 137 (i.e. OutOfMemoryError) in core module

2023-11-13 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785772#comment-17785772 ] Matthias Pohl commented on FLINK-31278: ---

Re: [PR] W.I.P [flink]

2023-11-13 Thread via GitHub
flinkbot commented on PR #23708: URL: https://github.com/apache/flink/pull/23708#issuecomment-1809673993 ## CI report: * e5594277547c13c70d54f205a898de6718ccd871 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[PR] W.I.P [flink]

2023-11-13 Thread via GitHub
JunRuiLee opened a new pull request, #23708: URL: https://github.com/apache/flink/pull/23708 only for ci. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

Re: [PR] [FLINK-33532][rpc] Support configured akka remote dispatcher thread pool size [flink]

2023-11-13 Thread via GitHub
flinkbot commented on PR #23707: URL: https://github.com/apache/flink/pull/23707#issuecomment-1809658542 ## CI report: * 851df93825cd24aec6eecc63aa3aa7f6b9f723db UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-33532) Move the serialization of ShuffleDescriptorGroup out of the RPC main thread

2023-11-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-33532: --- Labels: pull-request-available (was: ) > Move the serialization of ShuffleDescriptorGroup

[PR] [FLINK-33532][rpc] Support configured akka remote dispatcher thread pool size [flink]

2023-11-13 Thread via GitHub
caodizhou opened a new pull request, #23707: URL: https://github.com/apache/flink/pull/23707 ## What is the purpose of the change Support configured akka remote dispatcher thread pool size. ## Brief change log - Add config

[jira] [Commented] (FLINK-31449) Remove DeclarativeSlotManager related logic

2023-11-13 Thread lincoln lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785760#comment-17785760 ] lincoln lee commented on FLINK-31449: - [~huwh] Any updates to this since it marked as a blocker? If

Re: [PR] [FLINK-33527] Simplify state store cleanup logic [flink-kubernetes-operator]

2023-11-13 Thread via GitHub
1996fanrui commented on code in PR #710: URL: https://github.com/apache/flink-kubernetes-operator/pull/710#discussion_r1392008277 ## flink-autoscaler/src/test/java/org/apache/flink/autoscaler/JobAutoScalerImplTest.java: ## @@ -299,60 +296,15 @@ void testAutoscalerDisabled()

Re: [PR] [FLINK-32299][gateway] Upload python jar when sql contains python udf… [flink]

2023-11-13 Thread via GitHub
flinkbot commented on PR #23706: URL: https://github.com/apache/flink/pull/23706#issuecomment-1809576519 ## CI report: * d4bddad7592207fcbcbb139c08feb927479cd91b UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-32299) Upload python jar when sql contains python udf jar

2023-11-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-32299: --- Labels: pull-request-available (was: ) > Upload python jar when sql contains python udf

[PR] [FLINK-32299][gateway] Upload python jar when sql contains python udf… [flink]

2023-11-13 Thread via GitHub
KarmaGYZ opened a new pull request, #23706: URL: https://github.com/apache/flink/pull/23706 … jar ## What is the purpose of the change Upload python jar only when sql contains python udf jar. ## Brief change log - Do not add python jar in the

Re: [PR] [FLINK-33448][runtime] Introduce a new configuration item 'taskmanager.load-balance.mode' [flink]

2023-11-13 Thread via GitHub
1996fanrui commented on PR #23658: URL: https://github.com/apache/flink/pull/23658#issuecomment-1809570312 > Sorry that I was on a trip last week and did not have a chance to take a look. The change looks good to me. Just one minor comment that it's better to annotate

[jira] [Commented] (FLINK-33251) SQL Client query execution aborts after a few seconds: ConnectTimeoutException

2023-11-13 Thread Shengkai Fang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785738#comment-17785738 ] Shengkai Fang commented on FLINK-33251: --- I can not reproduce this problem in my local machine with

Re: [PR] [FLINK-33448][runtime] Introduce a new configuration item 'taskmanager.load-balance.mode' [flink]

2023-11-13 Thread via GitHub
zhuzhurk commented on PR #23658: URL: https://github.com/apache/flink/pull/23658#issuecomment-1809516092 Sorry that I was on a trip last week and did not have a chance to take a look. The change looks good to me. Just one minor comment that it's better to annotate

Re: [PR] [FLINK-33148] Update Web UI to adopt the new "endpoint" field in REST API [flink]

2023-11-13 Thread via GitHub
X-czh commented on code in PR #23698: URL: https://github.com/apache/flink/pull/23698#discussion_r1391955874 ## flink-runtime-web/web-dashboard/src/app/interfaces/job-exception.ts: ## @@ -44,7 +44,8 @@ export interface ExceptionInfo { stacktrace: string; timestamp:

[jira] [Updated] (FLINK-33539) Potential regression (Nov. 7th): listAddAll on RocksDB with Java8

2023-11-13 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan updated FLINK-33539: Attachment: image-2023-11-14-11-47-52-499.png > Potential regression (Nov. 7th): listAddAll on

[jira] [Commented] (FLINK-33539) Potential regression (Nov. 7th): listAddAll on RocksDB with Java8

2023-11-13 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785735#comment-17785735 ] Zakelly Lan commented on FLINK-33539: - !image-2023-11-14-11-47-52-499.png|width=1383,height=304! >

[jira] [Commented] (FLINK-33539) Potential regression (Nov. 7th): listAddAll on RocksDB with Java8

2023-11-13 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785734#comment-17785734 ] Zakelly Lan commented on FLINK-33539: - Seems introduced by FLINK-5865 (cee2611e). Manually triggered

[jira] [Commented] (FLINK-31483) Implement Split Deletion Support in Flink Kafka Connector

2023-11-13 Thread Hilmi Al Fatih (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785733#comment-17785733 ] Hilmi Al Fatih commented on FLINK-31483: Hi [~ruibin] [~ruanhang1993] Any update on this topic?

[jira] [Updated] (FLINK-33539) Potential regression (Nov. 7th): listAddAll on RocksDB with Java8

2023-11-13 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan updated FLINK-33539: Description: !image-2023-11-14-10-56-36-189.png|width=981,height=228! There is a drop from

[jira] [Created] (FLINK-33539) Potential regression (Nov. 7th): listAddAll on RocksDB with Java8

2023-11-13 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-33539: --- Summary: Potential regression (Nov. 7th): listAddAll on RocksDB with Java8 Key: FLINK-33539 URL: https://issues.apache.org/jira/browse/FLINK-33539 Project: Flink

Re: [PR] [hotfix][docs] Delete kafka connector docs [flink]

2023-11-13 Thread via GitHub
ruanhang1993 commented on PR #23628: URL: https://github.com/apache/flink/pull/23628#issuecomment-1809482399 > I am wondering the reason you delete it. The kafka documents have been moved to the project `flink-connector-kafka` and we do not need these documents now. -- This is an

[jira] [Updated] (FLINK-33529) PyFlink fails with "No module named 'cloudpickle"

2023-11-13 Thread Dian Fu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dian Fu updated FLINK-33529: Affects Version/s: 1.17.2 > PyFlink fails with "No module named 'cloudpickle" >

[jira] [Closed] (FLINK-33529) PyFlink fails with "No module named 'cloudpickle"

2023-11-13 Thread Dian Fu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dian Fu closed FLINK-33529. --- Fix Version/s: 1.19.0 1.18.1 1.17.3 Resolution: Fixed >

[jira] [Commented] (FLINK-33529) PyFlink fails with "No module named 'cloudpickle"

2023-11-13 Thread Dian Fu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785727#comment-17785727 ] Dian Fu commented on FLINK-33529: - Fixed in: * master via 34d9594ab1e5412371b77912f120b7949c92dcdd *

Re: [PR] [FLINK-33148] Update Web UI to adopt the new "endpoint" field in REST API [flink]

2023-11-13 Thread via GitHub
huwh commented on code in PR #23698: URL: https://github.com/apache/flink/pull/23698#discussion_r1391925135 ## flink-runtime-web/web-dashboard/src/app/interfaces/job-exception.ts: ## @@ -44,7 +44,8 @@ export interface ExceptionInfo { stacktrace: string; timestamp: number;

[jira] [Assigned] (FLINK-33529) PyFlink fails with "No module named 'cloudpickle"

2023-11-13 Thread Dian Fu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dian Fu reassigned FLINK-33529: --- Assignee: Prabhu Joseph > PyFlink fails with "No module named 'cloudpickle" >

Re: [PR] [FLINK-33529][python] Updated GET_SITE_PACKAGES_SCRIPT to include pur… [flink]

2023-11-13 Thread via GitHub
dianfu closed pull request #23700: [FLINK-33529][python] Updated GET_SITE_PACKAGES_SCRIPT to include pur… URL: https://github.com/apache/flink/pull/23700 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[PR] FLINK-30893 Replace not specifying a driver in Minikube by something … [flink]

2023-11-13 Thread via GitHub
victor09091 opened a new pull request, #23494: URL: https://github.com/apache/flink/pull/23494 ## What is the purpose of the change *we could rely on the latest minikube version and find some potential incompatible problems with new K8s versions.*

Re: [PR] [FLINK-32738][formats] PROTOBUF format supports projection push down [flink]

2023-11-13 Thread via GitHub
ljw-hit commented on PR #23323: URL: https://github.com/apache/flink/pull/23323#issuecomment-1809447787 @zhougit86 Thank you for your patience. The ability to split protobuf code has been merged with commit a2ec4c. You can rebase and resolve any code conflicts. Let's work together to merge

Re: [PR] [FLINK-33398][runtime] Support switching from batch to stream mode for one input stream operator [flink]

2023-11-13 Thread via GitHub
Sxnan commented on PR #23521: URL: https://github.com/apache/flink/pull/23521#issuecomment-1809430382 @xintongsong Could you help review this PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Commented] (FLINK-33483) Why is “UNDEFINED” defined in the Flink task status?

2023-11-13 Thread Xin Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785718#comment-17785718 ] Xin Chen commented on FLINK-33483: -- Hi [~mapohl] yes, this is not a question in recent version. But I

[jira] [Commented] (FLINK-33528) Externalize Python connector code

2023-11-13 Thread Dian Fu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785708#comment-17785708 ] Dian Fu commented on FLINK-33528: - Yes, I think so. > Externalize Python connector code >

Re: [PR] [FLINK-33402] Hybrid Source Concurrency Race Condition Fixes and Related Bugs Results in Data Loss [flink]

2023-11-13 Thread via GitHub
varun1729DD commented on PR #23687: URL: https://github.com/apache/flink/pull/23687#issuecomment-1809396620 > @varun1729DD let's start with the enumerator. I'm probably missing something. From the logs that you had posted in JIRA, it appears that all events are processed by the same thread

Re: [PR] [BP-1.18][FLINK-32913][tests] Updates base version for japicmp check [flink]

2023-11-13 Thread via GitHub
flinkbot commented on PR #23705: URL: https://github.com/apache/flink/pull/23705#issuecomment-1809352435 ## CI report: * 5da79c8ce54ac2a4a224c5eada3af0bd5ec6027c UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-32913][tests] Updates base version for japicmp check [flink]

2023-11-13 Thread via GitHub
flinkbot commented on PR #23704: URL: https://github.com/apache/flink/pull/23704#issuecomment-1809352323 ## CI report: * 16d94bb172479392c14d2859a59691c7077a90ee UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-33455] Implement restore tests for SortLimit node [flink]

2023-11-13 Thread via GitHub
bvarghese1 commented on code in PR #23660: URL: https://github.com/apache/flink/pull/23660#discussion_r1391843797 ## flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/plan/nodes/exec/testutils/SortTestPrograms.java: ## @@ -0,0 +1,121 @@ +/* + *

[PR] [BP-1.18][FLINK-32913][tests] Updates base version for japicmp check [flink]

2023-11-13 Thread via GitHub
snuyanzin opened a new pull request, #23705: URL: https://github.com/apache/flink/pull/23705 Updating the japicmp base version. Verification of API changes happened in FLINK-32927 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Commented] (FLINK-33536) Flink Table API CSV streaming sink fails with "IOException: Stream closed"

2023-11-13 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785702#comment-17785702 ] Prabhu Joseph commented on FLINK-33536: --- Thanks [~samrat007]. > Flink Table API CSV streaming

[jira] [Updated] (FLINK-32913) Update japicmp configuration

2023-11-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-32913: --- Labels: pull-request-available (was: ) > Update japicmp configuration >

[PR] [FLINK-32913][tests] Updates base version for japicmp check [flink]

2023-11-13 Thread via GitHub
snuyanzin opened a new pull request, #23704: URL: https://github.com/apache/flink/pull/23704 Updating the japicmp base version. Verification of API changes happened in FLINK-32927 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Commented] (FLINK-32919) Updates the docs stable version

2023-11-13 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785689#comment-17785689 ] Sergey Nuyanzin commented on FLINK-32919: - done within

[jira] [Resolved] (FLINK-32919) Updates the docs stable version

2023-11-13 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin resolved FLINK-32919. - Resolution: Fixed > Updates the docs stable version > --- >

[jira] [Commented] (FLINK-32916) Apache mailing lists announcements

2023-11-13 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785688#comment-17785688 ] Sergey Nuyanzin commented on FLINK-32916: - Announcement in the mailing list:

[jira] [Resolved] (FLINK-32916) Apache mailing lists announcements

2023-11-13 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin resolved FLINK-32916. - Resolution: Fixed > Apache mailing lists announcements >

[jira] [Resolved] (FLINK-32914) Merge website pull request

2023-11-13 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin resolved FLINK-32914. - Resolution: Fixed > Merge website pull request > -- > >

[jira] [Commented] (FLINK-32914) Merge website pull request

2023-11-13 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785687#comment-17785687 ] Sergey Nuyanzin commented on FLINK-32914: - The website is on and correctly shows 1.18.0

[jira] [Commented] (FLINK-32924) Review Release Notes in JIRA

2023-11-13 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785684#comment-17785684 ] Sergey Nuyanzin commented on FLINK-32924: - PR for release notes has been created and reviewed

[jira] [Resolved] (FLINK-32924) Review Release Notes in JIRA

2023-11-13 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin resolved FLINK-32924. - Resolution: Fixed > Review Release Notes in JIRA > > >

[jira] [Resolved] (FLINK-32923) Triage release-blocking issues in JIRA

2023-11-13 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin resolved FLINK-32923. - Resolution: Fixed > Triage release-blocking issues in JIRA >

[jira] [Commented] (FLINK-32923) Triage release-blocking issues in JIRA

2023-11-13 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785683#comment-17785683 ] Sergey Nuyanzin commented on FLINK-32923: - All blockers of 1.18.0 has been swiped out.  >

Re: [PR] [FLINK-33402] Fix Intger Comparison For Source Index in Hybrid Source [flink]

2023-11-13 Thread via GitHub
flinkbot commented on PR #23703: URL: https://github.com/apache/flink/pull/23703#issuecomment-1809204776 ## CI report: * 0f49126940dd44114bc8d2a49c26a482ea858cf5 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-33402] Hybrid Source Concurrency Race Condition Fixes and Related Bugs Results in Data Loss [flink]

2023-11-13 Thread via GitHub
varun1729DD commented on code in PR #23687: URL: https://github.com/apache/flink/pull/23687#discussion_r1391750438 ## flink-connectors/flink-connector-base/src/main/java/org/apache/flink/connector/base/source/hybrid/HybridSourceSplitEnumerator.java: ## @@ -361,7 +394,7 @@

[PR] [FLINK-33402] Fix Intger Comparison For Source Index in Hybrid Source [flink]

2023-11-13 Thread via GitHub
varun1729DD opened a new pull request, #23703: URL: https://github.com/apache/flink/pull/23703 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

Re: [PR] [FLINK-28050][connectors] Migrate StreamExecutionEnvironment#fromElements() implementation to FLIP-27 Source API [flink]

2023-11-13 Thread via GitHub
snuyanzin commented on PR #23553: URL: https://github.com/apache/flink/pull/23553#issuecomment-1809183659 >Using Java 11 the tests pass, using Java 8 they fail (as in CI). >Is this a known issue? not sure wether this is your issue or not some time ago we've faced this

Re: [PR] [FLINK-28050][connectors] Migrate StreamExecutionEnvironment#fromElements() implementation to FLIP-27 Source API [flink]

2023-11-13 Thread via GitHub
afedulov commented on PR #23553: URL: https://github.com/apache/flink/pull/23553#issuecomment-1809168702 @zentol I can confirm that the reason for the discrepancy in the local and the remote Architecture Tests execution is the Java version. Using Java 11 the tests pass, using Java 8 they

[jira] [Commented] (FLINK-33365) Missing filter condition in execution plan containing lookup join with mysql jdbc connector

2023-11-13 Thread Lim Qing Wei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785672#comment-17785672 ] Lim Qing Wei commented on FLINK-33365: -- Hi [~davidradl] ,  if you can work on this that's better,

Re: [PR] [FLINK-33470] Implement restore tests for Join node [flink]

2023-11-13 Thread via GitHub
jnh5y commented on code in PR #23680: URL: https://github.com/apache/flink/pull/23680#discussion_r1391719912 ## flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/plan/nodes/exec/testutils/JoinTestPrograms.java: ## @@ -0,0 +1,274 @@ +/* + * Licensed to

Re: [PR] [FLINK-33527] Simplify state store cleanup logic [flink-kubernetes-operator]

2023-11-13 Thread via GitHub
gyfora commented on code in PR #710: URL: https://github.com/apache/flink-kubernetes-operator/pull/710#discussion_r1391694357 ## flink-kubernetes-operator/src/main/java/org/apache/flink/kubernetes/operator/autoscaler/ConfigMapStore.java: ## @@ -44,13 +43,44 @@ public class

[jira] [Commented] (FLINK-33536) Flink Table API CSV streaming sink fails with "IOException: Stream closed"

2023-11-13 Thread Samrat Deb (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785634#comment-17785634 ] Samrat Deb commented on FLINK-33536: Hello [~prabhujoseph]  and [~martijnvisser] , I was able to

[jira] [Created] (FLINK-33538) Create a "best match" option for CEP when using the optional operator in the Pattern API

2023-11-13 Thread Brian Lehman (Jira)
Brian Lehman created FLINK-33538: Summary: Create a "best match" option for CEP when using the optional operator in the Pattern API Key: FLINK-33538 URL: https://issues.apache.org/jira/browse/FLINK-33538

Re: [PR] [FLINK-33527] Simplify state store cleanup logic [flink-kubernetes-operator]

2023-11-13 Thread via GitHub
mxm commented on code in PR #710: URL: https://github.com/apache/flink-kubernetes-operator/pull/710#discussion_r1391538017 ## flink-kubernetes-operator/src/main/java/org/apache/flink/kubernetes/operator/autoscaler/ConfigMapStore.java: ## @@ -67,19 +67,14 @@ protected Optional

Re: [PR] [FLINK-33527] Simplify state store cleanup logic [flink-kubernetes-operator]

2023-11-13 Thread via GitHub
mxm commented on PR #710: URL: https://github.com/apache/flink-kubernetes-operator/pull/710#issuecomment-1808809666 Please have a look at the new implementation. Also see: https://github.com/apache/flink-kubernetes-operator/pull/710#discussion_r1391538017 -- This is an automated message

Re: [PR] [FLINK-33527] Simplify state store cleanup logic [flink-kubernetes-operator]

2023-11-13 Thread via GitHub
mxm commented on code in PR #710: URL: https://github.com/apache/flink-kubernetes-operator/pull/710#discussion_r1391538017 ## flink-kubernetes-operator/src/main/java/org/apache/flink/kubernetes/operator/autoscaler/ConfigMapStore.java: ## @@ -67,19 +67,14 @@ protected Optional

[jira] [Commented] (FLINK-18473) Optimize RocksDB disk load balancing strategy

2023-11-13 Thread Yi Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785621#comment-17785621 ] Yi Zhang commented on FLINK-18473: -- [~yunta] [~fanrui] the current logic of picking from multiple

[jira] [Comment Edited] (FLINK-33365) Missing filter condition in execution plan containing lookup join with mysql jdbc connector

2023-11-13 Thread david radley (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785563#comment-17785563 ] david radley edited comment on FLINK-33365 at 11/13/23 6:18 PM: [~Sergey

[jira] [Comment Edited] (FLINK-33365) Missing filter condition in execution plan containing lookup join with mysql jdbc connector

2023-11-13 Thread david radley (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785563#comment-17785563 ] david radley edited comment on FLINK-33365 at 11/13/23 6:18 PM: [~Sergey

Re: [PR] [FLINK-33527] Simplify state store cleanup logic [flink-kubernetes-operator]

2023-11-13 Thread via GitHub
gyfora commented on code in PR #710: URL: https://github.com/apache/flink-kubernetes-operator/pull/710#discussion_r1391499500 ## flink-autoscaler/src/main/java/org/apache/flink/autoscaler/JobAutoScalerImpl.java: ## @@ -121,37 +120,10 @@ public void cleanup(KEY jobKey) { }

[jira] [Comment Edited] (FLINK-33365) Missing filter condition in execution plan containing lookup join with mysql jdbc connector

2023-11-13 Thread david radley (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785563#comment-17785563 ] david radley edited comment on FLINK-33365 at 11/13/23 6:13 PM: [~Sergey

[jira] [Commented] (FLINK-29288) Can't start a job with a jar in the system classpath

2023-11-13 Thread Trystan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785600#comment-17785600 ] Trystan commented on FLINK-29288: - That seems to be the difference. It seems like using native

[jira] [Assigned] (FLINK-32922) Review and update documentation

2023-11-13 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin reassigned FLINK-32922: --- Assignee: Sergey Nuyanzin > Review and update documentation >

Re: [PR] [FLINK-32922][docs] Update compatibility matrix for release 1.18 [flink]

2023-11-13 Thread via GitHub
flinkbot commented on PR #23702: URL: https://github.com/apache/flink/pull/23702#issuecomment-1808703707 ## CI report: * 51dc4a71864dbea056dbf79fc4fc1dd59dc88615 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-32922][docs] Update compatibility matrix for release 1.18 [flink]

2023-11-13 Thread via GitHub
flinkbot commented on PR #23701: URL: https://github.com/apache/flink/pull/23701#issuecomment-1808702755 ## CI report: * 5b9ee1b0b73bb0c35085e9677c34e7c11014b2e9 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Created] (FLINK-33537) Docs version nav is missing 1.18 as an option

2023-11-13 Thread Robin Moffatt (Jira)
Robin Moffatt created FLINK-33537: - Summary: Docs version nav is missing 1.18 as an option Key: FLINK-33537 URL: https://issues.apache.org/jira/browse/FLINK-33537 Project: Flink Issue Type:

[PR] [FLINK-32922][docs] Update compatibility matrix for release 1.18 [flink]

2023-11-13 Thread via GitHub
snuyanzin opened a new pull request, #23702: URL: https://github.com/apache/flink/pull/23702 ## What is the purpose of the change This pull requests updates the snapshot compatibility matrix for release 1.18. Please note that 1.18 drops snapshot compatibility before 1.8 (same

[jira] [Updated] (FLINK-32922) Review and update documentation

2023-11-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-32922: --- Labels: pull-request-available (was: ) > Review and update documentation >

[PR] [FLINK-32922][docs] Update compatibility matrix for release 1.18 [flink]

2023-11-13 Thread via GitHub
snuyanzin opened a new pull request, #23701: URL: https://github.com/apache/flink/pull/23701 ## What is the purpose of the change This pull requests updates the snapshot compatibility matrix for release 1.18. Please note that 1.18 drops snapshot compatibility before 1.8 (same

[jira] [Updated] (FLINK-33531) Nightly Python fails with NPE at metadataHandlerProvider on AZP

2023-11-13 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin updated FLINK-33531: Description: It seems starting 02.11.2023 every master nightly fails with this (that's

[jira] [Comment Edited] (FLINK-33365) Missing filter condition in execution plan containing lookup join with mysql jdbc connector

2023-11-13 Thread david radley (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785563#comment-17785563 ] david radley edited comment on FLINK-33365 at 11/13/23 5:08 PM: [~Sergey

[jira] [Commented] (FLINK-29288) Can't start a job with a jar in the system classpath

2023-11-13 Thread Yaroslav Tkachenko (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785575#comment-17785575 ] Yaroslav Tkachenko commented on FLINK-29288: Standalone mode. I think it may not run in

[jira] [Commented] (FLINK-33536) Flink Table API CSV streaming sink fails with "IOException: Stream closed"

2023-11-13 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785573#comment-17785573 ] Prabhu Joseph commented on FLINK-33536: --- We are using flink-s3-fs-hadoop-1.18.0.jar. > Flink

[jira] [Comment Edited] (FLINK-33365) Missing filter condition in execution plan containing lookup join with mysql jdbc connector

2023-11-13 Thread david radley (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785563#comment-17785563 ] david radley edited comment on FLINK-33365 at 11/13/23 4:45 PM: [~Sergey

[jira] [Commented] (FLINK-33365) Missing filter condition in execution plan containing lookup join with mysql jdbc connector

2023-11-13 Thread david radley (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785563#comment-17785563 ] david radley commented on FLINK-33365: -- [~Sergey Nuyanzin] [~qingwei91] thanks for you input. The 2

Re: [PR] [FLINK-33402] Hybrid Source Concurrency Race Condition Fixes and Related Bugs Results in Data Loss [flink]

2023-11-13 Thread via GitHub
tweise commented on PR #23687: URL: https://github.com/apache/flink/pull/23687#issuecomment-1808466482 @varun1729DD let's start with the enumerator. I'm probably missing something. From the logs that you had posted in JIRA, it appears that all events are processed by the same thread

Re: [PR] [FLINK-33402] Hybrid Source Concurrency Race Condition Fixes and Related Bugs Results in Data Loss [flink]

2023-11-13 Thread via GitHub
tweise commented on code in PR #23687: URL: https://github.com/apache/flink/pull/23687#discussion_r1391323161 ## flink-connectors/flink-connector-base/src/main/java/org/apache/flink/connector/base/source/hybrid/HybridSourceSplitEnumerator.java: ## @@ -361,7 +394,7 @@ public Map

[jira] [Commented] (FLINK-33402) Hybrid Source Concurrency Race Condition Fixes and Related Bugs Results in Data Loss

2023-11-13 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785549#comment-17785549 ] Thomas Weise commented on FLINK-33402: -- [~varun1729dd] thanks for investigating this. It would be

[jira] [Commented] (FLINK-33536) Flink Table API CSV streaming sink fails with "IOException: Stream closed"

2023-11-13 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17785546#comment-17785546 ] Martijn Visser commented on FLINK-33536: Which S3 plugin was used here? > Flink Table API CSV

Re: [PR] [FLINK-33527] Simplify state store cleanup logic [flink-kubernetes-operator]

2023-11-13 Thread via GitHub
1996fanrui commented on code in PR #710: URL: https://github.com/apache/flink-kubernetes-operator/pull/710#discussion_r1391256838 ## flink-kubernetes-operator/src/main/java/org/apache/flink/kubernetes/operator/autoscaler/ConfigMapStore.java: ## @@ -67,19 +67,14 @@ protected

[jira] [Updated] (FLINK-33536) Flink Table API CSV streaming sink fails with "IOException: Stream closed"

2023-11-13 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated FLINK-33536: -- Summary: Flink Table API CSV streaming sink fails with "IOException: Stream closed" (was:

[jira] [Updated] (FLINK-33536) Flink Table API CSV streaming sink fails with "IOException: Stream closed"

2023-11-13 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated FLINK-33536: -- Description: Flink Table API CSV streaming sink fails with "IOException: Stream closed".

[jira] [Assigned] (FLINK-33402) Hybrid Source Concurrency Race Condition Fixes and Related Bugs Results in Data Loss

2023-11-13 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise reassigned FLINK-33402: Assignee: Varun Narayanan Chakravarthy > Hybrid Source Concurrency Race Condition Fixes

[jira] [Created] (FLINK-33536) Flink Table API CSV streaming sink throws "IOException: Stream closed"

2023-11-13 Thread Prabhu Joseph (Jira)
Prabhu Joseph created FLINK-33536: - Summary: Flink Table API CSV streaming sink throws "IOException: Stream closed" Key: FLINK-33536 URL: https://issues.apache.org/jira/browse/FLINK-33536 Project:

Re: [PR] [FLINK-33527] Simplify state store cleanup logic [flink-kubernetes-operator]

2023-11-13 Thread via GitHub
1996fanrui commented on code in PR #710: URL: https://github.com/apache/flink-kubernetes-operator/pull/710#discussion_r1391256838 ## flink-kubernetes-operator/src/main/java/org/apache/flink/kubernetes/operator/autoscaler/ConfigMapStore.java: ## @@ -67,19 +67,14 @@ protected

Re: [PR] [FLINK-33527] Simplify state store cleanup logic [flink-kubernetes-operator]

2023-11-13 Thread via GitHub
1996fanrui commented on code in PR #710: URL: https://github.com/apache/flink-kubernetes-operator/pull/710#discussion_r1391256838 ## flink-kubernetes-operator/src/main/java/org/apache/flink/kubernetes/operator/autoscaler/ConfigMapStore.java: ## @@ -67,19 +67,14 @@ protected

  1   2   >