[jira] [Created] (FLINK-35867) 99% state lost after task auto restart due to "rocksdb block checksum mismatch" exception

2024-07-18 Thread heiya07 (Jira)
heiya07 created FLINK-35867: --- Summary: 99% state lost after task auto restart due to "rocksdb block checksum mismatch" exception Key: FLINK-35867 URL: https://issues.apache.org/jira/browse/FLINK-35867

[jira] [Created] (FLINK-35866) unsupported type Short for numeric minus

2024-07-18 Thread sucb (Jira)
sucb created FLINK-35866: Summary: unsupported type Short for numeric minus Key: FLINK-35866 URL: https://issues.apache.org/jira/browse/FLINK-35866 Project: Flink Issue Type: Bug

Re: [DISCUSS] FLIP-XXX Apicurio-avro format

2024-07-18 Thread Martijn Visser
Hi David, The FLIP is updated. Cheers, Martijn On Tue, Jul 16, 2024 at 6:33 PM David Radley wrote: > Hello all, > > > > I have prototyped the new design and confirmed it works. I have documented > the design in google doc >

Re: Request to make ContinuousFileReaderOperator public

2024-07-18 Thread Martijn Visser
Hi Darin, Your comment "I think our use case is rather unique and I'm not sure who else would benefit" makes me think then why we should actually support it in Flink, given that you're mentioning the use case is rather unique? Especially since the SourceFunction has many flaws, and has been long

Re: PR review request for sql-gateway feature

2024-07-18 Thread Dongwoo Kim
Hi Martijn, Thanks for the guidance on making a FLIP. Before proceeding, I’d like to gather some initial thoughts from the community to see if we agree on the usefulness of this feature. Could anyone share their opinions on the custom query operation validator for Flink SQL Gateway? Thanks in

RE: Potential Kafka Connector FLIP: Large Message Handling

2024-07-18 Thread David Radley
Hi Kevin, That sounds good, unfortunately the image did not come through in the email for me,kind regards, David From: Kevin Lam Date: Wednesday, 10 July 2024 at 19:20 To: dev@flink.apache.org Subject: [EXTERNAL] Re: Potential Kafka Connector FLIP: Large Message Handling Hey David, Yes my

Re: PR review request for sql-gateway feature

2024-07-18 Thread Martijn Visser
Hi Dongwoo, I think this should first have been a FLIP [1], given that it proposes to make something pluggable with custom interfaces. Best regards, Martijn [1] https://cwiki.apache.org/confluence/display/FLINK/Flink+Improvement+Proposals On Thu, Jul 18, 2024 at 2:50 PM Dongwoo Kim wrote: >

PR review request for sql-gateway feature

2024-07-18 Thread Dongwoo Kim
Hi devs, A month ago, I created a jira issue and pr for a custom query operation validator in Flink SQL Gateway to block unsafe queries. Since there has been no feedback yet, I would appreciate it if someone could review it or provide some feedback. I'm curious if this feature can be added and if

[jira] [Created] (FLINK-35865) When Sync SqlServer table with smallint type as pk

2024-07-18 Thread Zhongqiang Gong (Jira)
Zhongqiang Gong created FLINK-35865: --- Summary: When Sync SqlServer table with smallint type as pk Key: FLINK-35865 URL: https://issues.apache.org/jira/browse/FLINK-35865 Project: Flink

[jira] [Created] (FLINK-35864) Add CONV function

2024-07-18 Thread Dylan He (Jira)
Dylan He created FLINK-35864: Summary: Add CONV function Key: FLINK-35864 URL: https://issues.apache.org/jira/browse/FLINK-35864 Project: Flink Issue Type: Sub-task Components: Table

[DISCUSS] FLIP-470: Support Adaptive Broadcast Join

2024-07-18 Thread Xia Sun
Hi devs, Junrui Lee, Lei Yang, and I would like to initiate a discussion about FLIP-470: Support Adaptive Broadcast Join[1]. In general, Broadcast Hash Join is currently the most efficient join strategy available in Flink. However, its prerequisite is that the input data on one side must be

Re: [VOTE] Release 1.20.0, release candidate #1

2024-07-18 Thread Rui Fan
+1(binding) - Reviewed the flink-web PR (Left some comments) - Checked Github release tag - Verified signatures - Verified sha512 (hashsums) - The source archives don't contain any binaries - Build the source with Maven 3 and java8 (Checked the license as well) - Start the cluster locally with

Re: [DISCUSS] FLIP-XXX: Aligning timeout logic in the AdaptiveScheduler's WaitingForResources and Executing states

2024-07-18 Thread Zdenek Tison
Thanks, Mathias, for your opinions. I see two scenarios where different values for starting and rescaling would be appropriate: 1) Flink serverless providers may prefer the fastest possible job startup time, which can also be achieved by setting a smaller value for the stabilization timeout,

Re: [DISCUSS] FLIP-468: Introducing StreamGraph-Based Job Submission.

2024-07-18 Thread Junrui Lee
Hi all, I would like to follow up on my previous email regarding your feedback. Below is a concise summary of my main points: 1. Compiled Plan: IIUC, the compiled plan is primarily for ensuring execution plan compatibility across job versions (e.g., during upgrades). Eventually, it needs to be

[jira] [Created] (FLINK-35863) Doc build faild due to npm failure

2024-07-18 Thread Samrat Deb (Jira)
Samrat Deb created FLINK-35863: -- Summary: Doc build faild due to npm failure Key: FLINK-35863 URL: https://issues.apache.org/jira/browse/FLINK-35863 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-35862) Chinese and English documents are different

2024-07-18 Thread ye.nova (Jira)
ye.nova created FLINK-35862: --- Summary: Chinese and English documents are different Key: FLINK-35862 URL: https://issues.apache.org/jira/browse/FLINK-35862 Project: Flink Issue Type: Bug