[jira] [Created] (FLINK-35876) mysql cdc may change from snapshot mode to binlog mode failed when cpu load of mysql server is 100%

2024-07-23 Thread Youle (Jira)
Youle created FLINK-35876: - Summary: mysql cdc may change from snapshot mode to binlog mode failed when cpu load of mysql server is 100% Key: FLINK-35876 URL: https://issues.apache.org/jira/browse/FLINK-35876

[jira] [Created] (FLINK-35875) Flink cdc frequently encounters LabelAlreadyExists errors

2024-07-23 Thread Jira
牛一凡 created FLINK-35875: --- Summary: Flink cdc frequently encounters LabelAlreadyExists errors Key: FLINK-35875 URL: https://issues.apache.org/jira/browse/FLINK-35875 Project: Flink Issue Type: Bug

Re: PR review request for sql-gateway feature

2024-07-22 Thread Shengkai Fang
Hi Dongoo, You are right that plan advisor doesn't have ability to block user request. Actually, we add a new REST API in the gateway side to validate the users request is legal or not in our inner branch. Therefore, user can validate their statements before execution or execute their statement

Re: [VOTE] Release 1.20.0, release candidate #1

2024-07-22 Thread weijie guo
Hi everyone, This rc is officially cancelled because of the critical bug of materialized table [1] A new rc will be created recently. [1] https://issues.apache.org/jira/browse/FLINK-35872 Best, Robert, Rui, Ufuk, Weijie Ron Liu 于2024年7月23日周二 09:34写道: > Hi, Weijie > > Sorry about the

Re: [VOTE] Release 1.20.0, release candidate #1

2024-07-22 Thread Ron Liu
Hi, Weijie Sorry about the newly discovered bug affecting the release process. The fix pr of https://issues.apache.org/jira/browse/FLINK-35872 has been merged. Best, Ron Feng Jin 于2024年7月22日周一 10:57写道: > Hi, weijie > > -1 (non-binding) > > During our testing process, we discovered a critical

Re: [VOTE] FLIP-466: Introduce ProcessFunction Attribute in DataStream API V2

2024-07-22 Thread Mingliang Liu
+1 (non-binding) on this. Loving these hint-based attributes to gain "managed" optimizations. On Mon, Jul 22, 2024 at 6:15 AM Li Wang wrote: > +1 (non-binding) from me as well. This would help in multiple use-cases. > > Thanks > > On Mon, Jul 22, 2024 at 11:47 AM Rui Fan <1996fan...@gmail.com>

Re: PR review request for sql-gateway feature

2024-07-22 Thread Dongwoo Kim
Hi Shengkai, Thank you for introducing an interesting concept of plan advice. After reviewing the FLIP, I thought that plan advice cannot fully replace the original intention of the OperationValidator. Similar to the pluggable ResourceValidator[1] in flink k8s operator, the OperationValidator

Re: [VOTE] FLIP-466: Introduce ProcessFunction Attribute in DataStream API V2

2024-07-22 Thread Li Wang
+1 (non-binding) from me as well. This would help in multiple use-cases. Thanks On Mon, Jul 22, 2024 at 11:47 AM Rui Fan <1996fan...@gmail.com> wrote: > Thanks Wencong for driving this proposal! > > +1(binding) > > Best, > Rui > > On Fri, Jul 19, 2024 at 3:58 PM Xintong Song > wrote: > > >

[jira] [Created] (FLINK-35874) Check pureBinlogPhaseTables set before call getBinlogPosition method in BinlogSplitReader

2024-07-22 Thread Zhongmin Qiao (Jira)
Zhongmin Qiao created FLINK-35874: - Summary: Check pureBinlogPhaseTables set before call getBinlogPosition method in BinlogSplitReader Key: FLINK-35874 URL: https://issues.apache.org/jira/browse/FLINK-35874

Re: [DISCUSS] FLIP-XXX Amazon SQS Source Connector

2024-07-22 Thread Saurabh Singh
Hi Yanquan, Yes, you are right about SQS - It is a MessageQueue. https://aws.amazon.com/sqs/features/ Thanks for reviewing the FLIP and valuable suggestions about adding observability. We have reviewed the above-mentioned Standardize Connector Metric FLIP [1] and added a section about it in the

[jira] [Created] (FLINK-35873) Add HashFunctionProvider for Paimon DataSink.

2024-07-22 Thread LvYanquan (Jira)
LvYanquan created FLINK-35873: - Summary: Add HashFunctionProvider for Paimon DataSink. Key: FLINK-35873 URL: https://issues.apache.org/jira/browse/FLINK-35873 Project: Flink Issue Type: New

Re: [VOTE] FLIP-466: Introduce ProcessFunction Attribute in DataStream API V2

2024-07-22 Thread Rui Fan
Thanks Wencong for driving this proposal! +1(binding) Best, Rui On Fri, Jul 19, 2024 at 3:58 PM Xintong Song wrote: > +1(binding) > > Best, > > Xintong > > > > On Thu, Jul 18, 2024 at 9:40 AM weijie guo > wrote: > > > +1(binding) > > > > Best regards, > > > > Weijie > > > > > > Wencong Liu

Re: [DISCUSS] FLIP-XXX Amazon SQS Source Connector

2024-07-21 Thread Yanquan Lv
Hi Dhingra, thanks for driving this. I am not very familiar with SQS, but this should be some kind of message queue. So could we add metric of currentFetchEventTimeLag and currentEmitEventTimeLag from FLIP-33[1] in SQS source? and I want to know what metrics do we provide in SQS source. [1]

Re: [VOTE] Release 1.20.0, release candidate #1

2024-07-21 Thread Feng Jin
Hi, weijie -1 (non-binding) During our testing process, we discovered a critical bug that impacts the correctness of the materialized table. A fix pr [1] is now prepared and will be merged within the next two days. I apologize for any inconvenience during the release process. [1].

Re: [DISCUSS] CLI action deprecation process

2024-07-21 Thread Xintong Song
> > As I think about it, most likely orthogonal to the current > discussion, but this idea seems to be applicable for the > submitted job JARs as well. The same check could be done for all > the submitted files and their deps. IDK if that was your original > thought Xintong or not? > IIUC, you

[jira] [Created] (FLINK-35872) Fix the incorrect partition generation during period refresh in Full Mode

2024-07-21 Thread Feng Jin (Jira)
Feng Jin created FLINK-35872: Summary: Fix the incorrect partition generation during period refresh in Full Mode Key: FLINK-35872 URL: https://issues.apache.org/jira/browse/FLINK-35872 Project: Flink

[jira] [Created] (FLINK-35871) Add document for SNAPSHOT startup option mode

2024-07-20 Thread LvYanquan (Jira)
LvYanquan created FLINK-35871: - Summary: Add document for SNAPSHOT startup option mode Key: FLINK-35871 URL: https://issues.apache.org/jira/browse/FLINK-35871 Project: Flink Issue Type:

[jira] [Created] (FLINK-35870) Change DEFAULT_KAFKA_TRANSACTION_TIMEOUT in KafkaSinkBuilder

2024-07-20 Thread LEE SOMANG (Jira)
LEE SOMANG created FLINK-35870: -- Summary: Change DEFAULT_KAFKA_TRANSACTION_TIMEOUT in KafkaSinkBuilder Key: FLINK-35870 URL: https://issues.apache.org/jira/browse/FLINK-35870 Project: Flink

Re: Potential Kafka Connector FLIP: Large Message Handling

2024-07-19 Thread Kevin Lam
Apologies David, here's a temporary link to the image: https://screenshot.click/19-19-0xwls-jfx7s.png On Thu, Jul 18, 2024 at 9:00 AM David Radley wrote: > Hi Kevin, > That sounds good, unfortunately the image did not come through in the > email for me,kind regards, David > > From: Kevin

Re: [DISCUSS] FLINK-34440 Support Debezium Protobuf Confluent Format

2024-07-19 Thread Kevin Lam
Hi all, I had chimed in on Anupam's PR that we might have some time to look at this issue FLINK-34440. Adding @David Mariassy to this thread, as he's started to work

[DISCUSS] FLIP-XXX Amazon SQS Source Connector

2024-07-19 Thread Saurabh Singh
Hi Fink Devs, Our team has been working on migrating various data pipelines to Flink to leverage the benefits of exactly-once processing, checkpointing, and stateful computing. We have several use cases built around the AWS SQS Service. For this migration, we have developed an SQS Source

[jira] [Created] (FLINK-35869) Right side columns of temporal left join are always null when right side is filtered

2024-07-19 Thread Jira
Grzegorz Kołakowski created FLINK-35869: --- Summary: Right side columns of temporal left join are always null when right side is filtered Key: FLINK-35869 URL:

[jira] [Created] (FLINK-35868) Bump Mongo driver version to support Mongo 7.0+

2024-07-19 Thread yux (Jira)
yux created FLINK-35868: --- Summary: Bump Mongo driver version to support Mongo 7.0+ Key: FLINK-35868 URL: https://issues.apache.org/jira/browse/FLINK-35868 Project: Flink Issue Type: Improvement

Re: [VOTE] Release 1.20.0, release candidate #1

2024-07-19 Thread Xintong Song
+1 (binding) - reviewed flink-web PR - verified checksum and signature - verified source archives don't contain binaries - built from source - tried example jobs on a standalone cluster, and everything looks fine Best, Xintong On Thu, Jul 18, 2024 at 4:25 PM Rui Fan <1996fan...@gmail.com>

Re: [DISCUSS] FLIP-470: Support Adaptive Broadcast Join

2024-07-19 Thread Zhu Zhu
+1 for the FLIP It's a good start to adaptively optimize the logical execution plan with runtime information. Thanks, Zhu Xia Sun 于2024年7月18日周四 18:23写道: > Hi devs, > > Junrui Lee, Lei Yang, and I would like to initiate a discussion about > FLIP-470: Support Adaptive Broadcast Join[1]. > > In

Re: [VOTE] FLIP-466: Introduce ProcessFunction Attribute in DataStream API V2

2024-07-19 Thread Xintong Song
+1(binding) Best, Xintong On Thu, Jul 18, 2024 at 9:40 AM weijie guo wrote: > +1(binding) > > Best regards, > > Weijie > > > Wencong Liu 于2024年7月17日周三 21:31写道: > > > Hi dev, > > > > I'd like to start a vote on FLIP-466. > > > > Discussion thread: > >

Re: PR review request for sql-gateway feature

2024-07-19 Thread Shengkai Fang
Hi Dongwoo, Thanks for your proposal! I think the idea about OperationValidator is similar to the plan advice[1], which can give advice if the statement has problems. I wonder if it would be more beneficial to develop the concept within the existing infrastructure, rather than introducing a new

[RESULT][VOTE] FLIP-460: Display source/sink I/O metrics on Flink Web UI

2024-07-19 Thread Zhanghao Chen
Hi everyone, I'm delighted to announce that FLIP-460 [1] has been accepted. There were 13 votes in favor: - Yong Fang (binding) - Robert Metzger (binding) - Leonard Xu (binding) - Becket Qin (binding) - Ahmed Hamdy (non-binding) - Aleksandr Pilipenko (non-binding) - Xintong Song (binding) - Rui

[jira] [Created] (FLINK-35867) 99% state lost after task auto restart due to "rocksdb block checksum mismatch" exception

2024-07-18 Thread heiya07 (Jira)
heiya07 created FLINK-35867: --- Summary: 99% state lost after task auto restart due to "rocksdb block checksum mismatch" exception Key: FLINK-35867 URL: https://issues.apache.org/jira/browse/FLINK-35867

[jira] [Created] (FLINK-35866) unsupported type Short for numeric minus

2024-07-18 Thread sucb (Jira)
sucb created FLINK-35866: Summary: unsupported type Short for numeric minus Key: FLINK-35866 URL: https://issues.apache.org/jira/browse/FLINK-35866 Project: Flink Issue Type: Bug

Re: [DISCUSS] FLIP-XXX Apicurio-avro format

2024-07-18 Thread Martijn Visser
Hi David, The FLIP is updated. Cheers, Martijn On Tue, Jul 16, 2024 at 6:33 PM David Radley wrote: > Hello all, > > > > I have prototyped the new design and confirmed it works. I have documented > the design in google doc >

Re: Request to make ContinuousFileReaderOperator public

2024-07-18 Thread Martijn Visser
Hi Darin, Your comment "I think our use case is rather unique and I'm not sure who else would benefit" makes me think then why we should actually support it in Flink, given that you're mentioning the use case is rather unique? Especially since the SourceFunction has many flaws, and has been long

Re: PR review request for sql-gateway feature

2024-07-18 Thread Dongwoo Kim
Hi Martijn, Thanks for the guidance on making a FLIP. Before proceeding, I’d like to gather some initial thoughts from the community to see if we agree on the usefulness of this feature. Could anyone share their opinions on the custom query operation validator for Flink SQL Gateway? Thanks in

RE: Potential Kafka Connector FLIP: Large Message Handling

2024-07-18 Thread David Radley
Hi Kevin, That sounds good, unfortunately the image did not come through in the email for me,kind regards, David From: Kevin Lam Date: Wednesday, 10 July 2024 at 19:20 To: dev@flink.apache.org Subject: [EXTERNAL] Re: Potential Kafka Connector FLIP: Large Message Handling Hey David, Yes my

Re: PR review request for sql-gateway feature

2024-07-18 Thread Martijn Visser
Hi Dongwoo, I think this should first have been a FLIP [1], given that it proposes to make something pluggable with custom interfaces. Best regards, Martijn [1] https://cwiki.apache.org/confluence/display/FLINK/Flink+Improvement+Proposals On Thu, Jul 18, 2024 at 2:50 PM Dongwoo Kim wrote: >

PR review request for sql-gateway feature

2024-07-18 Thread Dongwoo Kim
Hi devs, A month ago, I created a jira issue and pr for a custom query operation validator in Flink SQL Gateway to block unsafe queries. Since there has been no feedback yet, I would appreciate it if someone could review it or provide some feedback. I'm curious if this feature can be added and if

[jira] [Created] (FLINK-35865) When Sync SqlServer table with smallint type as pk

2024-07-18 Thread Zhongqiang Gong (Jira)
Zhongqiang Gong created FLINK-35865: --- Summary: When Sync SqlServer table with smallint type as pk Key: FLINK-35865 URL: https://issues.apache.org/jira/browse/FLINK-35865 Project: Flink

[jira] [Created] (FLINK-35864) Add CONV function

2024-07-18 Thread Dylan He (Jira)
Dylan He created FLINK-35864: Summary: Add CONV function Key: FLINK-35864 URL: https://issues.apache.org/jira/browse/FLINK-35864 Project: Flink Issue Type: Sub-task Components: Table

[DISCUSS] FLIP-470: Support Adaptive Broadcast Join

2024-07-18 Thread Xia Sun
Hi devs, Junrui Lee, Lei Yang, and I would like to initiate a discussion about FLIP-470: Support Adaptive Broadcast Join[1]. In general, Broadcast Hash Join is currently the most efficient join strategy available in Flink. However, its prerequisite is that the input data on one side must be

Re: [VOTE] Release 1.20.0, release candidate #1

2024-07-18 Thread Rui Fan
+1(binding) - Reviewed the flink-web PR (Left some comments) - Checked Github release tag - Verified signatures - Verified sha512 (hashsums) - The source archives don't contain any binaries - Build the source with Maven 3 and java8 (Checked the license as well) - Start the cluster locally with

Re: [DISCUSS] FLIP-XXX: Aligning timeout logic in the AdaptiveScheduler's WaitingForResources and Executing states

2024-07-18 Thread Zdenek Tison
Thanks, Mathias, for your opinions. I see two scenarios where different values for starting and rescaling would be appropriate: 1) Flink serverless providers may prefer the fastest possible job startup time, which can also be achieved by setting a smaller value for the stabilization timeout,

Re: [DISCUSS] FLIP-468: Introducing StreamGraph-Based Job Submission.

2024-07-18 Thread Junrui Lee
Hi all, I would like to follow up on my previous email regarding your feedback. Below is a concise summary of my main points: 1. Compiled Plan: IIUC, the compiled plan is primarily for ensuring execution plan compatibility across job versions (e.g., during upgrades). Eventually, it needs to be

[jira] [Created] (FLINK-35863) Doc build faild due to npm failure

2024-07-18 Thread Samrat Deb (Jira)
Samrat Deb created FLINK-35863: -- Summary: Doc build faild due to npm failure Key: FLINK-35863 URL: https://issues.apache.org/jira/browse/FLINK-35863 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-35862) Chinese and English documents are different

2024-07-18 Thread ye.nova (Jira)
ye.nova created FLINK-35862: --- Summary: Chinese and English documents are different Key: FLINK-35862 URL: https://issues.apache.org/jira/browse/FLINK-35862 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-35861) The dependency of kafka sql connector seems wrong

2024-07-17 Thread xuyang (Jira)
xuyang created FLINK-35861: -- Summary: The dependency of kafka sql connector seems wrong Key: FLINK-35861 URL: https://issues.apache.org/jira/browse/FLINK-35861 Project: Flink Issue Type: Bug

Re: [DISCUSS] FLIP-469: Supports Adaptive Optimization of StreamGraph

2024-07-17 Thread Junrui Lee
Hi, Weijie Thanks for your feedback! `StreamGraphOptimizationStrategy` is a reasonable abstract, I'd like to know what built-in strategy implementations you have in mind so far? We will introduce two optimization strategies: AdaptiveBroadcastJoinOptimizeStrategy, which dynamically determines

Re: [DISCUSS]: Flink code generation porting to Calcite

2024-07-17 Thread Jark Wu
Hi James, After reading the comments in CALCITE-3094, I think what you are looking for is the Flink code-splitting tools. Code splitting is a common need for Java code generation and Flink has extracted the code splitting into a separate module "flink-table-code-splitter"[1] with little

[jira] [Created] (FLINK-35860) S5CmdOnMinioITCase failed due to IllegalAccessError

2024-07-17 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-35860: -- Summary: S5CmdOnMinioITCase failed due to IllegalAccessError Key: FLINK-35860 URL: https://issues.apache.org/jira/browse/FLINK-35860 Project: Flink Issue Type:

Re: [VOTE] FLIP-466: Introduce ProcessFunction Attribute in DataStream API V2

2024-07-17 Thread weijie guo
+1(binding) Best regards, Weijie Wencong Liu 于2024年7月17日周三 21:31写道: > Hi dev, > > I'd like to start a vote on FLIP-466. > > Discussion thread: > https://lists.apache.org/thread/sw2or62299w0hw9jm5kdqjqj3j8rnrdt > FLIP: >

[DISCUSS]: Flink code generation porting to Calcite

2024-07-17 Thread James Duong
Hi Flink developer community, I’m contributing to the Apache Calcite project and there’s interest in making use of Flink’s code generation. See the comments on https://issues.apache.org/jira/browse/CALCITE-3094 Would someone be able to point me to where Flink integrates Janino? I originally

Re: Request to make ContinuousFileReaderOperator public

2024-07-17 Thread Darin Amos
I wanted to bump this request from last year. As I understand it the new FileSource is not suitable for my existing use case. The TLDR is that we have extensively customized/extended the file splits and input formats so a single ContinuousFileReaderOperator can handle non-homogenous files and

Supporting fields containing "." in watermark

2024-07-17 Thread David Radley
Hi there, It looks like Flink does not support fields containing a dot character in the watermark. The validation done on Flink code to determine whether the property is "nested", is to check if they contain a dot in the name, so even if the property is not nested, but contains a dot, it is

[VOTE] FLIP-466: Introduce ProcessFunction Attribute in DataStream API V2

2024-07-17 Thread Wencong Liu
Hi dev, I'd like to start a vote on FLIP-466. Discussion thread: https://lists.apache.org/thread/sw2or62299w0hw9jm5kdqjqj3j8rnrdt FLIP: https://cwiki.apache.org/confluence/display/FLINK/FLIP-466%3A+Introduce+ProcessFunction+Attribute+in+DataStream+API+V2 Best regards, Wencong Liu

Re: [DISCUSS] FLIP-469: Supports Adaptive Optimization of StreamGraph

2024-07-17 Thread weijie guo
Thanks for the proposal! I like this idea as it gives Flink's adaptive batching processing more room to imagine and optimize. So, +1 from my side. I just have two questions: 1. `StreamGraphOptimizationStrategy` is a reasonable abstract, I'd like to know what built-in strategy implementations

Re: [DISCUSS] CLI action deprecation process

2024-07-17 Thread Ferenc Csaky
Hi Xintong, Muhammet, Thank you for your thoughts! I agree with Xintong regarding 1), and 2). About making users aware of these compatibility guarantees, documentation and CLI print deprecation is what I already aimed for when I was merging the "run" and "run-application" actions functionality

[jira] [Created] (FLINK-35859) [flink-cdc] Fix: The assigner is not ready to offer finished split information, this should not be called

2024-07-17 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35859: - Summary: [flink-cdc] Fix: The assigner is not ready to offer finished split information, this should not be called Key: FLINK-35859 URL:

Re: [VOTE] FLIP-460: Display source/sink I/O metrics on Flink Web UI

2024-07-17 Thread Yuepeng Pan
+1 (non-binding) Best, Yuepeng Pan At 2024-07-17 05:57:28, "Aleksandr Pilipenko" wrote: >+1 (non-binding) > >Thanks, >Aleksandr > >On Tue, 16 Jul 2024 at 22:56, Ahmed Hamdy wrote: > >> +1 (non-binding) >> >> Best Regards >> Ahmed Hamdy >> >> >> On Tue, 16 Jul 2024 at 21:58,

Re: [DISCUSS] FLIP-469: Supports Adaptive Optimization of StreamGraph

2024-07-17 Thread Zhu Zhu
Thanks Junrui for the updates. The proposal looks good to me. With the stream graph added to the REST API result, I think we are also quite close to enable Flink to expand a job vertex to show its operator-chain topology. Thanks, Zhu Junrui Lee 于2024年7月15日周一 14:58写道: > Hi Zhu, > > Thanks for

[jira] [Created] (FLINK-35858) Namespace support for async state

2024-07-17 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-35858: --- Summary: Namespace support for async state Key: FLINK-35858 URL: https://issues.apache.org/jira/browse/FLINK-35858 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-35857) Operator restart failed job without latest checkpoint

2024-07-17 Thread chenyuzhi (Jira)
chenyuzhi created FLINK-35857: - Summary: Operator restart failed job without latest checkpoint Key: FLINK-35857 URL: https://issues.apache.org/jira/browse/FLINK-35857 Project: Flink Issue Type:

[jira] [Created] (FLINK-35856) Upgrade Calcite version to 1.37.0

2024-07-16 Thread TJ Banghart (Jira)
TJ Banghart created FLINK-35856: --- Summary: Upgrade Calcite version to 1.37.0 Key: FLINK-35856 URL: https://issues.apache.org/jira/browse/FLINK-35856 Project: Flink Issue Type: Technical Debt

[jira] [Created] (FLINK-35855) Upgrade Calcite version to 1.36.0

2024-07-16 Thread TJ Banghart (Jira)
TJ Banghart created FLINK-35855: --- Summary: Upgrade Calcite version to 1.36.0 Key: FLINK-35855 URL: https://issues.apache.org/jira/browse/FLINK-35855 Project: Flink Issue Type: Technical Debt

[jira] [Created] (FLINK-35854) Upgrade Calcite version to 1.35.0

2024-07-16 Thread TJ Banghart (Jira)
TJ Banghart created FLINK-35854: --- Summary: Upgrade Calcite version to 1.35.0 Key: FLINK-35854 URL: https://issues.apache.org/jira/browse/FLINK-35854 Project: Flink Issue Type: Technical Debt

Re: [VOTE] FLIP-460: Display source/sink I/O metrics on Flink Web UI

2024-07-16 Thread Xiqian YU
+1 (non-binding) Regards, Xiqian De : Yanquan Lv Date : mercredi, 17 juillet 2024 à 10:35 À : dev@flink.apache.org Objet : Re: [VOTE] FLIP-460: Display source/sink I/O metrics on Flink Web UI +1 (non-binding) Glad to see a more user-friendly display page. Best, Yanquan Rui Fan

Re: [VOTE] FLIP-460: Display source/sink I/O metrics on Flink Web UI

2024-07-16 Thread Hang Ruan
Thanks for the FLIP. +1(binding) Best, Hang Zakelly Lan 于2024年7月17日周三 10:19写道: > +1 (binding) > > Best, > Zakelly > > On Wed, Jul 17, 2024 at 9:48 AM Rui Fan <1996fan...@gmail.com> wrote: > > > +1 (binding) > > > > Best, > > Rui > > > > On Wed, Jul 17, 2024 at 9:07 AM Xintong Song > > wrote:

Re: [VOTE] FLIP-460: Display source/sink I/O metrics on Flink Web UI

2024-07-16 Thread Yanquan Lv
+1 (non-binding) Glad to see a more user-friendly display page. Best, Yanquan Rui Fan <1996fan...@gmail.com> 于2024年7月17日周三 09:48写道: > +1 (binding) > > Best, > Rui > > On Wed, Jul 17, 2024 at 9:07 AM Xintong Song > wrote: > > > +1 (binding) > > > > Best, > > > > Xintong > > > > > > > > On Wed,

Re: [VOTE] FLIP-460: Display source/sink I/O metrics on Flink Web UI

2024-07-16 Thread Zakelly Lan
+1 (binding) Best, Zakelly On Wed, Jul 17, 2024 at 9:48 AM Rui Fan <1996fan...@gmail.com> wrote: > +1 (binding) > > Best, > Rui > > On Wed, Jul 17, 2024 at 9:07 AM Xintong Song > wrote: > > > +1 (binding) > > > > Best, > > > > Xintong > > > > > > > > On Wed, Jul 17, 2024 at 5:58 AM Aleksandr

Re: [VOTE] FLIP-460: Display source/sink I/O metrics on Flink Web UI

2024-07-16 Thread Rui Fan
+1 (binding) Best, Rui On Wed, Jul 17, 2024 at 9:07 AM Xintong Song wrote: > +1 (binding) > > Best, > > Xintong > > > > On Wed, Jul 17, 2024 at 5:58 AM Aleksandr Pilipenko > wrote: > > > +1 (non-binding) > > > > Thanks, > > Aleksandr > > > > On Tue, 16 Jul 2024 at 22:56, Ahmed Hamdy wrote: >

Re: [VOTE] FLIP-460: Display source/sink I/O metrics on Flink Web UI

2024-07-16 Thread Xintong Song
+1 (binding) Best, Xintong On Wed, Jul 17, 2024 at 5:58 AM Aleksandr Pilipenko wrote: > +1 (non-binding) > > Thanks, > Aleksandr > > On Tue, 16 Jul 2024 at 22:56, Ahmed Hamdy wrote: > > > +1 (non-binding) > > > > Best Regards > > Ahmed Hamdy > > > > > > On Tue, 16 Jul 2024 at 21:58, Becket

Re: [VOTE] FLIP-460: Display source/sink I/O metrics on Flink Web UI

2024-07-16 Thread Aleksandr Pilipenko
+1 (non-binding) Thanks, Aleksandr On Tue, 16 Jul 2024 at 22:56, Ahmed Hamdy wrote: > +1 (non-binding) > > Best Regards > Ahmed Hamdy > > > On Tue, 16 Jul 2024 at 21:58, Becket Qin wrote: > > > +1 (binding) > > > > Thanks, > > > > Jiangjie (Becket) Qin > > > > On Tue, Jul 16, 2024 at 12:19 AM

Re: [VOTE] FLIP-460: Display source/sink I/O metrics on Flink Web UI

2024-07-16 Thread Ahmed Hamdy
+1 (non-binding) Best Regards Ahmed Hamdy On Tue, 16 Jul 2024 at 21:58, Becket Qin wrote: > +1 (binding) > > Thanks, > > Jiangjie (Becket) Qin > > On Tue, Jul 16, 2024 at 12:19 AM Leonard Xu wrote: > > > +1(binding) > > > > Best, > > Leonard > > > > > 2024年7月16日 下午3:15,Robert Metzger 写道: >

Re: [VOTE] FLIP-460: Display source/sink I/O metrics on Flink Web UI

2024-07-16 Thread Becket Qin
+1 (binding) Thanks, Jiangjie (Becket) Qin On Tue, Jul 16, 2024 at 12:19 AM Leonard Xu wrote: > +1(binding) > > Best, > Leonard > > > 2024年7月16日 下午3:15,Robert Metzger 写道: > > > > +1 (binding) > > > > Nice to see this fixed ;) > > > > > > > > On Tue, Jul 16, 2024 at 8:46 AM Yong Fang wrote:

RE: [DISCUSS] FLIP-XXX Apicurio-avro format

2024-07-16 Thread David Radley
Hello all, I have prototyped the new design and confirmed it works. I have documented the design in google doc https://docs.google.com/document/d/1J1E-cE-X2H3-kw4rNjLn71OGPQk_Yl1iGX4-eCHWLgE/edit By copy Martijn: please could you move this content over to replace the content of

Re: [DISCUSS] FLIP-XXX: Aligning timeout logic in the AdaptiveScheduler's WaitingForResources and Executing states

2024-07-16 Thread Matthias Pohl
Thanks Zdenek for your proposal on aligning the resource control logic within the AdaptiveScheduler and cleaning up the rescaling code. Consolidating the parameters and the code as part of the 2.0 release makes sense in my opinion: The proposed change adds consistent behavior to the

Re: [DISCUSS] FLIP-XXX: Aligning timeout logic in the AdaptiveScheduler's WaitingForResources and Executing states

2024-07-16 Thread Zdenek Tison
Hi, I'd like to move a discussion from Google Docs to the mailing list so that it's visible to everyone. *Yuanfeng Hu* brought up two concerns: 1) Related to the resource-stabilization-timeout,he thinks 10s May be too short. In a container environment, if the number of tm added by rest requests

Re:Re: Re: Re: [DISCUSS] FLIP-466: Introduce ProcessFunction Attribute in DataStream API V2

2024-07-16 Thread Wencong Liu
Hi dev, I'd like to start a vote on FLIP-466. Discussion thread: https://lists.apache.org/thread/sw2or62299w0hw9jm5kdqjqj3j8rnrdt FLIP: https://cwiki.apache.org/confluence/display/FLINK/FLIP-466%3A+Introduce+ProcessFunction+Attribute+in+DataStream+API+V2 Best regards, Wencong Liu 在

[jira] [Created] (FLINK-35853) Regression in checkpoint size when performing full checkpointing in RocksDB

2024-07-16 Thread Keith Lee (Jira)
Keith Lee created FLINK-35853: - Summary: Regression in checkpoint size when performing full checkpointing in RocksDB Key: FLINK-35853 URL: https://issues.apache.org/jira/browse/FLINK-35853 Project: Flink

Re: [VOTE] FLIP-460: Display source/sink I/O metrics on Flink Web UI

2024-07-16 Thread Leonard Xu
+1(binding) Best, Leonard > 2024年7月16日 下午3:15,Robert Metzger 写道: > > +1 (binding) > > Nice to see this fixed ;) > > > > On Tue, Jul 16, 2024 at 8:46 AM Yong Fang wrote: > >> +1 (binding) >> >> Best, >> FangYong >> >> >> On Tue, Jul 16, 2024 at 1:14 PM Zhanghao Chen >> wrote: >> >>>

Re: [VOTE] FLIP-460: Display source/sink I/O metrics on Flink Web UI

2024-07-16 Thread Robert Metzger
+1 (binding) Nice to see this fixed ;) On Tue, Jul 16, 2024 at 8:46 AM Yong Fang wrote: > +1 (binding) > > Best, > FangYong > > > On Tue, Jul 16, 2024 at 1:14 PM Zhanghao Chen > wrote: > > > Hi everyone, > > > > > > Thanks for all the feedback about the FLIP-460: Display source/sink I/O > >

Re: [VOTE] FLIP-460: Display source/sink I/O metrics on Flink Web UI

2024-07-16 Thread Yong Fang
+1 (binding) Best, FangYong On Tue, Jul 16, 2024 at 1:14 PM Zhanghao Chen wrote: > Hi everyone, > > > Thanks for all the feedback about the FLIP-460: Display source/sink I/O > metrics on Flink Web UI [1]. The discussion > thread is here [2]. I'd like to start a vote on it. > > The vote will

[jira] [Created] (FLINK-35852) When used through the transform function, the decimal(10,2) type field value in the MySQL source table becomes 100 times the original value after being transferred to th

2024-07-16 Thread zheng_shengsheng (Jira)
zheng_shengsheng created FLINK-35852: Summary: When used through the transform function, the decimal(10,2) type field value in the MySQL source table becomes 100 times the original value after being transferred to the target table.

[jira] [Created] (FLINK-35851) autoscaler standlone mode use `GlobalConfiguration.loadConfiguration` load config

2024-07-16 Thread yuanfenghu (Jira)
yuanfenghu created FLINK-35851: -- Summary: autoscaler standlone mode use `GlobalConfiguration.loadConfiguration` load config Key: FLINK-35851 URL: https://issues.apache.org/jira/browse/FLINK-35851

[VOTE] FLIP-460: Display source/sink I/O metrics on Flink Web UI

2024-07-15 Thread Zhanghao Chen
Hi everyone, Thanks for all the feedback about the FLIP-460: Display source/sink I/O metrics on Flink Web UI [1]. The discussion thread is here [2]. I'd like to start a vote on it. The vote will be open for at least 72 hours unless there is an objection or insufficient votes. [1]

Re: [DISCUSS] FLIP-460: Display source/sink I/O metrics on Flink Web UI

2024-07-15 Thread Zhanghao Chen
Thanks for all. As the discussion is quite concluded, I'll start voting in a separate thread. From: Leonard Xu Sent: Monday, July 15, 2024 11:22 To: dev Subject: Re: [DISCUSS] FLIP-460: Display source/sink I/O metrics on Flink Web UI Thanks for zhanghao for

[VOTE] Release 1.20.0, release candidate #1

2024-07-15 Thread weijie guo
Hi everyone, Please review and vote on the release candidate #1 for the version 1.20.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release

[jira] [Created] (FLINK-35850) Add DATEDIFF function

2024-07-15 Thread Dylan He (Jira)
Dylan He created FLINK-35850: Summary: Add DATEDIFF function Key: FLINK-35850 URL: https://issues.apache.org/jira/browse/FLINK-35850 Project: Flink Issue Type: Sub-task Components:

[jira] [Created] (FLINK-35849) [flink-cdc] Use expose_snapshot to read snapshot of postgres cdc connector.

2024-07-15 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-35849: - Summary: [flink-cdc] Use expose_snapshot to read snapshot of postgres cdc connector. Key: FLINK-35849 URL: https://issues.apache.org/jira/browse/FLINK-35849

[jira] [Created] (FLINK-35845) CLONE - Build and stage Java and Python artifacts

2024-07-15 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-35845: -- Summary: CLONE - Build and stage Java and Python artifacts Key: FLINK-35845 URL: https://issues.apache.org/jira/browse/FLINK-35845 Project: Flink Issue Type:

[jira] [Created] (FLINK-35848) CLONE - Vote on the release candidate

2024-07-15 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-35848: -- Summary: CLONE - Vote on the release candidate Key: FLINK-35848 URL: https://issues.apache.org/jira/browse/FLINK-35848 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-35847) CLONE - Propose a pull request for website updates

2024-07-15 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-35847: -- Summary: CLONE - Propose a pull request for website updates Key: FLINK-35847 URL: https://issues.apache.org/jira/browse/FLINK-35847 Project: Flink Issue Type:

[jira] [Created] (FLINK-35846) CLONE - Stage source and binary releases on dist.apache.org

2024-07-15 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-35846: -- Summary: CLONE - Stage source and binary releases on dist.apache.org Key: FLINK-35846 URL: https://issues.apache.org/jira/browse/FLINK-35846 Project: Flink

[jira] [Created] (FLINK-35844) Build Release Candidate: 1.20.0-rc1

2024-07-15 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-35844: -- Summary: Build Release Candidate: 1.20.0-rc1 Key: FLINK-35844 URL: https://issues.apache.org/jira/browse/FLINK-35844 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-35843) Check cp directory empty may fail in file-merging testing

2024-07-15 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-35843: --- Summary: Check cp directory empty may fail in file-merging testing Key: FLINK-35843 URL: https://issues.apache.org/jira/browse/FLINK-35843 Project: Flink

[jira] [Created] (FLINK-35842) Change the FlinkCDC dependency to 3.1.x

2024-07-15 Thread Di Wu (Jira)
Di Wu created FLINK-35842: - Summary: Change the FlinkCDC dependency to 3.1.x Key: FLINK-35842 URL: https://issues.apache.org/jira/browse/FLINK-35842 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-35841) Change package name to org.apache.flink

2024-07-15 Thread Di Wu (Jira)
Di Wu created FLINK-35841: - Summary: Change package name to org.apache.flink Key: FLINK-35841 URL: https://issues.apache.org/jira/browse/FLINK-35841 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-35839) Migrate repo from apache/doris to apache/flink

2024-07-15 Thread Di Wu (Jira)
Di Wu created FLINK-35839: - Summary: Migrate repo from apache/doris to apache/flink Key: FLINK-35839 URL: https://issues.apache.org/jira/browse/FLINK-35839 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-35840) Add documentation for Doris

2024-07-15 Thread Di Wu (Jira)
Di Wu created FLINK-35840: - Summary: Add documentation for Doris Key: FLINK-35840 URL: https://issues.apache.org/jira/browse/FLINK-35840 Project: Flink Issue Type: Sub-task Reporter: Di

[jira] [Created] (FLINK-35838) FLIP-399: Flink Connector Doris

2024-07-15 Thread Di Wu (Jira)
Di Wu created FLINK-35838: - Summary: FLIP-399: Flink Connector Doris Key: FLINK-35838 URL: https://issues.apache.org/jira/browse/FLINK-35838 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-35837) InitOutputPathTest.testErrorOccursUnSynchronized failed in JDK21

2024-07-15 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-35837: -- Summary: InitOutputPathTest.testErrorOccursUnSynchronized failed in JDK21 Key: FLINK-35837 URL: https://issues.apache.org/jira/browse/FLINK-35837 Project: Flink

Re: [DISCUSS] FLIP-469: Supports Adaptive Optimization of StreamGraph

2024-07-15 Thread Junrui Lee
Hi Zhu, Thanks for your feedback. Following your suggestion, I have updated the public interface section of the FLIP with the following additions: 1. UI: The job topology will display a hybrid of the current JobGraph along with downstream components yet to be converted to a StreamGraph. On the

<    1   2   3   4   5   6   7   8   9   10   >