[jira] [Created] (FLINK-32868) Document the need to backport FLINK-30213 for using autoscaler with older version Flinks

Zhanghao Chen created FLINK-32868: - Summary: Document the need to backport FLINK-30213 for using autoscaler with older version Flinks Key: FLINK-32868 URL: https://issues.apache.org/jira/browse/FLINK-32868

Re: [DISCUSS] Update Flink Roadmap

Thanks for driving this, Jark. The current draft looks good to me. I think it is good to open a PR with it. And if there are other comments, we can discuss them during the PR review. I also added a few minor comments in the draft regarding the feature radar. Those can also be discussed on the

Re: [DISCUSS] FLIP-328: Allow source operators to determine isProcessingBacklog based on watermark lag

Sounds good to me. It is true that, if we are introducing the generalized watermark, there will be other watermark related concepts / configurations that need to be updated anyway. Best, Xintong On Tue, Aug 15, 2023 at 11:30 AM Xuannan Su wrote: > Hi Xingtong, > > Thank you for your

Re: [DISCUSS] FLIP-328: Allow source operators to determine isProcessingBacklog based on watermark lag

Hi Xingtong, Thank you for your suggestion. After considering the idea of using a general configuration key, I think it may not be a good idea for the reasons below. While I agree that using a more general configuration key provides us with the flexibility to switch to other approaches to

Re: [DISCUSS] Update Flink Roadmap

Hi Jark, Sounds good and I would love to, thanks! I will involve you and Xingtong on the document after updating. Best, Shammon FY On Mon, Aug 14, 2023 at 10:39 PM Jark Wu wrote: > Hi Shammon, > > Sure, could you help to draft a subsection about this in the google doc? > > Best, > Jark > >

Re: [ANNOUNCE] New Apache Flink Committer - Hangxiang Yu

Congratulations! Best, Hang Roman Khachatryan 于2023年8月14日周一 22:36写道： > Congratulations, Hangxiang! > > Regards, > Roman > > > On Wed, Aug 9, 2023 at 12:49 PM Benchao Li wrote: > > > Congrats, Hangxiang! > > > > Jing Ge 于2023年8月8日周二 17:44写道： > > > > > Congrats, Hangxiang! > > > > > > Best

Re: [ANNOUNCE] New Apache Flink Committer - Yanfei Lei

Congratulations! Best, Hang Roman Khachatryan 于2023年8月14日周一 22:38写道： > Congratulations, Yanfey! > > Regards, > Roman > > > On Wed, Aug 9, 2023 at 12:49 PM Benchao Li wrote: > > > Congrats, YanFei! > > > > Jing Ge 于2023年8月8日周二 17:41写道： > > > > > Congrats, YanFei! > > > > > > Best regards, > >

Re: request for jira

Sorry I may have misunderstood. I need a jira account. And I have already submitted a jira account request. How long will it take to get approved? My Jira Id is CHLambda. Thank you. liu ron 于 2023年8月15日周二 09:31写道： > Hi, Lambda > > If you're interested in a ticket that doesn't currently have an

Re: request for jira

Hi, Lambda If you're interested in a ticket that doesn't currently have an owner, you can comment directly in the ticket and the committer will assign it to you without assigning special permissions. Best, Ron lambda ch 于2023年8月14日周一 22:42写道： > Hi, > I want to contribute to Apache Flink. >

Re: [DISCUSS] FLIP-330: Support specifying record timestamp requirement

Hi Jark, Thanks for the comments. I agree that at this point SQL is the only API that we can apply this optimization transparently to the users. For the other APIs (DataStream or the new Process Function targeted in 2.0), the hope is that in the future they will evolve so that the framework can

Re: [DISCUSS] Status of Statefun Project

I created a pull request for this: [FLINK-31619] Upgrade Stateful Functions to Flink 1.16.1 by galenwarren · Pull Request #331 · apache/flink-statefun (github.com) . JIRA is here: [FLINK-31619] Upgrade Stateful Functions to Flink 1.16.1 - ASF

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.6.0, release candidate #2

+1 (binding) 1. Downloaded the archives, checksums, and signatures 2. Verified the signatures and checksums 3. Extract and inspect the source code for binaries 4. Compiled and tested the source code via mvn verify 5. Verified license files / headers 6. Deployed helm chart to test cluster 7. Ran

[jira] [Created] (FLINK-32867) Suspending job and triggering savepoint when only updating restartNonce

haiqingchen created FLINK-32867: --- Summary: Suspending job and triggering savepoint when only updating restartNonce Key: FLINK-32867 URL: https://issues.apache.org/jira/browse/FLINK-32867 Project: Flink

[jira] [Created] (FLINK-32866) Clean up the `@ExtendWith(TestLoggerExtension.class)` for modules that added the `TestLoggerExtension` to the `org.junit.jupiter.api.extension.Extension resource` file

Rui Fan created FLINK-32866: --- Summary: Clean up the `@ExtendWith(TestLoggerExtension.class)` for modules that added the `TestLoggerExtension` to the `org.junit.jupiter.api.extension.Extension resource` file Key: FLINK-32866

Re: Plans for Schema Evolution in Table API

Bumping the thread. On Fri, Aug 4, 2023 at 12:51 PM Ashish Khatkar wrote: > Hi all, > > We are using flink-1.17.0 table API and RocksDB as backend to provide a > service to our users to run sql queries. The tables are created using the > avro schema and when the schema is changed in a

request for jira

Hi, I want to contribute to Apache Flink. Would you please give me the contributor permission? My JIRA ID is CHlambda

Re: [DISCUSS] Update Flink Roadmap

Hi Shammon, Sure, could you help to draft a subsection about this in the google doc? Best, Jark > 2023年8月14日 20:30，Shammon FY 写道： > > Thanks @Jark for driving the Flink Roadmap. > > As we discussed olap in the thread [1] and according to the suggestions from > @Xingtong Song, could we add

Re: [ANNOUNCE] New Apache Flink Committer - Yanfei Lei

Congratulations, Yanfey! Regards, Roman On Wed, Aug 9, 2023 at 12:49 PM Benchao Li wrote: > Congrats, YanFei! > > Jing Ge 于2023年8月8日周二 17:41写道： > > > Congrats, YanFei! > > > > Best regards, > > Jing > > > > On Tue, Aug 8, 2023 at 3:04 PM Yangze Guo wrote: > > > > > Congrats, Yanfei! > > > >

Re: [ANNOUNCE] New Apache Flink Committer - Hangxiang Yu

Congratulations, Hangxiang! Regards, Roman On Wed, Aug 9, 2023 at 12:49 PM Benchao Li wrote: > Congrats, Hangxiang! > > Jing Ge 于2023年8月8日周二 17:44写道： > > > Congrats, Hangxiang! > > > > Best regards, > > Jing > > > > On Tue, Aug 8, 2023 at 3:04 PM Yangze Guo wrote: > > > > > Congrats,

Re: [DISCUSS] How about adding OLAP to Flink Roadmap?

Hi, Thanks for all the feedback. I'm so glad that I can see some consensus we have reached from the feedback. I am trying to summarize our consensus as follows and please correct me if I'm wrong or misunderstanding. 1) Batch is a special case of Streaming, while olap is a special case of batch,

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.6.0, release candidate #2

Thank you, team. +1 (binding) - Verified Helm repo works as expected, points to correct image tag, build, version - Verified basic examples + checked operator logs everything looks as expected - Verified hashes, signatures and source release contains no binaries - Ran built-in tests, built jars

Re: [DISCUSS] FLIP-330: Support specifying record timestamp requirement

Hi Becket, > I kind of think that we can restrain the scope to just batch mode, and only for StreamRecord class. That means only in batch mode, the timestamp in the StreamRecord will be dropped when the config is enabled. However, IIUC, dropping timestamp in StreamRecord has been supported. This

Re: [DISCUSS] FLIP-323: Support Attached Execution on Flink Application Completion for Batch Jobs

Hi Ron and Weihua, Thanks for the feedback. There seem three user sensible behaviors that we are talking about: 1. The behavior on the client side, i.e. whether blocking until the job finishes or not. 2. The behavior of the submitted job, whether stop the job execution if the client is

Re: [DISCUSS] Update Flink Roadmap

Thanks @Jark for driving the Flink Roadmap. As we discussed olap in the thread [1] and according to the suggestions from @Xingtong Song, could we add a subsection in `Towards Streaming Warehouses` or `Performance` that the short-lived query in Flink Session Cluster is one of the future directions

Re: [DISCUSS] Update Flink Roadmap

Thank you everyone for helping polish the roadmap [1]. I think I have addressed all the comments and we have included all ongoing parts of Flink. Please feel free to take a last look. I'm going to prepare the pull request if there are no more concerns. Best, Jark [1]:

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.6.0, release candidate #2

Thanks Gyula for the release! +1 (non-binding) - Compiled and tested the source code via mvn verify - Verified the signatures - Downloaded the image - Deployed helm chart to test cluster - Ran example job Best, Rui On Mon, Aug 14, 2023 at 3:58 PM Gyula Fóra wrote: > +1 (binding) > >

[jira] [Created] (FLINK-32865) DynamicFilteringDataCollectorOperator can't chain with the upstream operator when the parallelism is inconsistent

dalongliu created FLINK-32865: - Summary: DynamicFilteringDataCollectorOperator can't chain with the upstream operator when the parallelism is inconsistent Key: FLINK-32865 URL:

[jira] [Created] (FLINK-32864) StreamDependencyTests.test_set_requirements_with_cached_directory fails on AZP

Sergey Nuyanzin created FLINK-32864: --- Summary: StreamDependencyTests.test_set_requirements_with_cached_directory fails on AZP Key: FLINK-32864 URL: https://issues.apache.org/jira/browse/FLINK-32864

Re: [DISCUSS] How about adding OLAP to Flink Roadmap?

Thanks to the guys from ByteDance driving this topic, which could be another big story to extend Flink's ability. In general, I think this is a great idea. However, before we move forward, I think we should first answer the question: which is the target for Flink OLAP? We run Presto/Trino and

Re: [VOTE] Apache Flink Kubernetes Operator Release 1.6.0, release candidate #2

+1 (binding) Verified: - Hashes, signatures, source files contain no binaries - Maven repo contents look good - Verified helm chart, image, deployed stateful and autoscaling examples. Operator logs look good Cheers, Gyula On Thu, Aug 10, 2023 at 3:03 PM Gyula Fóra wrote: > Hi Everyone, > >

[jira] [Created] (FLINK-32863) Improve Flink UI's time precision from second level to milliseconds level

Runkang He created FLINK-32863: -- Summary: Improve Flink UI's time precision from second level to milliseconds level Key: FLINK-32863 URL: https://issues.apache.org/jira/browse/FLINK-32863 Project: Flink

[jira] [Created] (FLINK-32862) Support INIT operation type to be compatible with DTS on Alibaba Cloud

Hang Ruan created FLINK-32862: - Summary: Support INIT operation type to be compatible with DTS on Alibaba Cloud Key: FLINK-32862 URL: https://issues.apache.org/jira/browse/FLINK-32862 Project: Flink

Re: [DISCUSS] FLIP-328: Allow source operators to determine isProcessingBacklog based on watermark lag

Thanks for the explanation. I wonder if it makes sense to not expose this detail via the configuration option. To be specific, I suggest not mentioning the "watermark" keyword in the configuration key and description. - From the users' perspective, I think they only need to know there's a