[jira] [Created] (FLINK-35810) AsyncWaitOperatorTest.testProcessingTimeRepeatedCompleteUnorderedWithRetry fails

Rui Fan created FLINK-35810: --- Summary: AsyncWaitOperatorTest.testProcessingTimeRepeatedCompleteUnorderedWithRetry fails Key: FLINK-35810 URL: https://issues.apache.org/jira/browse/FLINK-35810 Project: Flink

[DISCUSS] FLIP-469: Supports Adaptive Optimization of StreamGraph

Hi devs, Xia Sun, Lei Yang, and I would like to initiate a discussion about FLIP-469: Supports Adaptive Optimization of StreamGraph. This FLIP is the second in the series on adaptive optimization of StreamGraph and follows up on FLIP-468 [1]. As we proposed in FLIP-468 to enable the scheduler to

[DISCUSS] FLIP-468: Introducing StreamGraph-Based Job Submission.

Hi devs, Xia Sun, Lei Yang, and I would like to initiate a discussion about FLIP-468: Introducing StreamGraph-Based Job Submission. Currently, Flink has the capability to adjust the ExecutionGraph in batch processing mode, such as dynamically deciding the parallelism of JobVertex based on the inp

[jira] [Created] (FLINK-35809) Deploying Flink History Server and Flink SQL Gateway via Flink Operator.

钟洋洋 created FLINK-35809: --- Summary: Deploying Flink History Server and Flink SQL Gateway via Flink Operator. Key: FLINK-35809 URL: https://issues.apache.org/jira/browse/FLINK-35809 Project: Flink Issue

Re: Static OpenSSL lib licensing

Hi Martijn, Doh! I was looking at the netty-tcnative-openssl-static module, not the one pulled in by Flink netty-tcnative-boringssl-static, which is of course building BoringSSL not OpenSSL. So the legal issue stands. Maybe there's a possibility to offer netty-tcnative-openssl-static as an option

[jira] [Created] (FLINK-35808) Let ConsumerConfig.VALUE_DESERIALIZER_CLASS_CONFIG be overridable by user in KafkaSourceBuilder

Kevin Lam created FLINK-35808: - Summary: Let ConsumerConfig.VALUE_DESERIALIZER_CLASS_CONFIG be overridable by user in KafkaSourceBuilder Key: FLINK-35808 URL: https://issues.apache.org/jira/browse/FLINK-35808

Re: Potential Kafka Connector FLIP: Large Message Handling

Hey David, Yes my proposal was originally to do this at the connector level, as you mentioned it doesn't make sense in a format. In the end I took the approach in my previous e-mail: I was able to insert our Large Message handling by overriding > value.serializer >

Re: Out of space on connector runner (jdbc)

You can also clean up all unused images like https://github.com/apache/flink-cdc/pull/2978 On Thu, Jul 11, 2024 at 12:20 AM João Boto wrote: > For connectors we need to change this: [1] > > If this is already being done in the main project and it is acceptable, I > can provide a PR with the chan

Re: Out of space on connector runner (jdbc)

For connectors we need to change this: [1] If this is already being done in the main project and it is acceptable, I can provide a PR with the changes without any issue. Additionally, we could make this configurable, allowing each connector to be customized as needed. [1] https://github.com/ap

RE: Potential Kafka Connector FLIP: Large Message Handling

Hi Kevin, You mention the link https://www.conduktor.io/kafka/how-to-send-large-messages-in-apache-kafka/#Option-1:-using-an-external-store-(GB-size-messages)-0 , I assume this is the approach you are considering. And that this is being done at the connector level, as the message could be in any

[jira] [Created] (FLINK-35807) When restoring a task from a savepoint, tables that were previously synchronized but later deleted still exist in a state

zhangkunjie created FLINK-35807: --- Summary: When restoring a task from a savepoint, tables that were previously synchronized but later deleted still exist in a state Key: FLINK-35807 URL: https://issues.apache.org/ji

Re: Out of space on connector runner (jdbc)

FYI: We're doing something similar in the GHA workflow for Apache Flink [1]. [1] https://github.com/apache/flink/blob/master/.github/actions/job_init/action.yml#L54-L69 On Wed, Jul 10, 2024 at 3:53 PM João Boto wrote: > I will send this with better format.. > Sorry for that > > On 2024/07/10 1

Out of space on connector runner (jdbc)

Hi, During the refactor related to FLIP-449, we have started encountering the following errors on CI: - "You are running out of disk space. The runner will stop working when the machine runs out of disk space. Free space left: 0 MB." - "You are running out of disk space. The runner wil

Re: Out of space on connector runner (jdbc)

I will send this with better format.. Sorry for that On 2024/07/10 13:46:43 Joao Boto wrote: > Hi, > > During the refactor related to FLIP-449[1], we start seeing this error on > CI like: > > > - "You are running out of disk space. The runner will stop working when > > the machine runs out of d

Out of space on connector runner (jdbc)

Hi, During the refactor related to FLIP-449[1], we start seeing this error on CI like: > - "You are running out of disk space. The runner will stop working when > the machine runs out of disk space. Free space left: 0 MB" - "Warning: ForkStarter IOException: Unable to create file for report: No

Re: Potential Kafka Connector FLIP: Large Message Handling

Hey all, just a follow-up here. I was able to insert our Large Message handling by overriding value.serializer and value.deserializer in the consu

[jira] [Created] (FLINK-35806) [Flink-CDC][MongoDB] Add friendly reminder if the configured collectionList is wrong

Eason Ye created FLINK-35806: Summary: [Flink-CDC][MongoDB] Add friendly reminder if the configured collectionList is wrong Key: FLINK-35806 URL: https://issues.apache.org/jira/browse/FLINK-35806 Project:

[jira] [Created] (FLINK-35805) Add "OpType" metadata column in transform

yux created FLINK-35805: --- Summary: Add "OpType" metadata column in transform Key: FLINK-35805 URL: https://issues.apache.org/jira/browse/FLINK-35805 Project: Flink Issue Type: Improvement Com

[jira] [Created] (FLINK-35804) Incorrect calc merge generate wrong plan about udtf+join+udf

roncenzhao created FLINK-35804: -- Summary: Incorrect calc merge generate wrong plan about udtf+join+udf Key: FLINK-35804 URL: https://issues.apache.org/jira/browse/FLINK-35804 Project: Flink Iss

[jira] [Created] (FLINK-35803) ResumeCheckpointManuallyITCase fails with checkpoint file merging

Rui Fan created FLINK-35803: --- Summary: ResumeCheckpointManuallyITCase fails with checkpoint file merging Key: FLINK-35803 URL: https://issues.apache.org/jira/browse/FLINK-35803 Project: Flink Issu

Re: Static OpenSSL lib licensing

Hi Rob, While Netty TCNative has upgraded to Openssl 3, there are still references to BoringSSL [1]. Do you know if TCNative still uses BoringSSL as well in this version? Best regards, Martijn [1] https://github.com/netty/netty-tcnative/blob/netty-tcnative-parent-2.0.62.Final/license/LICENSE.bo