[jira] [Created] (FLINK-33064) Improve the error message when the lookup source is used as the scan source

2023-09-07 Thread Yunhong Zheng (Jira)
Yunhong Zheng created FLINK-33064: - Summary: Improve the error message when the lookup source is used as the scan source Key: FLINK-33064 URL: https://issues.apache.org/jira/browse/FLINK-33064

[jira] [Created] (FLINK-33063) udaf with user defined pojo object throw error while generate record equaliser

2023-09-07 Thread Yunhong Zheng (Jira)
Yunhong Zheng created FLINK-33063: - Summary: udaf with user defined pojo object throw error while generate record equaliser Key: FLINK-33063 URL: https://issues.apache.org/jira/browse/FLINK-33063

Re: 退订

2023-09-07 Thread liu ron
Hi, Please send email to dev-unsubscr...@flink.apache.org if you want to unsubscribe the mail from dev@flink.apache.org , and you can refer [1][2] for more details. [1] https://flink.apache.org/zh/community/#%e9%82%ae%e4%bb%b6%e5%88%97%e8%a1%a8 [2]

[jira] [Created] (FLINK-33062) Deserialization creates multiple instances of case objects in Scala 2.13

2023-09-07 Thread SmedbergM (Jira)
SmedbergM created FLINK-33062: - Summary: Deserialization creates multiple instances of case objects in Scala 2.13 Key: FLINK-33062 URL: https://issues.apache.org/jira/browse/FLINK-33062 Project: Flink

Re: [NOTICE] Experimental Java 17 support now available on master

2023-09-07 Thread Jing Ge
Hi Matthias, Thanks for the information. Best regards, Jing On Thu, Sep 7, 2023 at 5:36 PM Matthias Pohl wrote: > I don't know about the specifics of the kryo 2.x vs 5.x issues. The > discussion around FLIP-317 [1] seems to have stalled here. But Java 17 is > still considered an experimental

[VOTE] FLIP-323: Support Attached Execution on Flink Application Completion for Batch Jobs

2023-09-07 Thread Allison Chang
Hi everyone, Would like to start the VOTE for FLIP-323 which proposes to introduce attached execution for batch jobs. The discussion thread can be found

Re: [DISCUSS] [FLINK-32873] Add a config to allow disabling Query hints

2023-09-07 Thread Bonnie Arogyam Varghese
Hi Liu, The default will be set to enabled which is the current behavior. The option will allow users/platform providers to disable it if they want to. On Wed, Sep 6, 2023 at 6:39 PM liu ron wrote: > Hi, Boonie > > I'm with Jark on why disable hint is needed if it won't affect security. If >

Re: [DISCUSS] FLIP-328: Allow source operators to determine isProcessingBacklog based on watermark lag

2023-09-07 Thread Leonard Xu
Thanks Xuannan for driving this FLIP ! The proposal generally looks good to me, but I still left some comments: > One more question about the FLIP is that the FLIP says "Note that this > config does not support switching source's isProcessingBacklog from false to > true > for now.” Does that

Re: [DISCUSS] FLIP-307: Flink connector Redshift

2023-09-07 Thread Danny Cranmer
Hello Leonard, > Do we have to rely on the latest version of JDBC Connector here? I understand that as long as the version of flink minor is the same as the JDBC Connector, Could you collect the APIs that Redshift generally needs to use? I agree we do not necessarily need to rely on the latest

Re: [DISCUSS] FLIP-307: Flink connector Redshift

2023-09-07 Thread Leonard Xu
Thanks Samrat and Danny for driving this FLIP. >> an effective approach is to utilize the latest version of >> flink-connector-jdbc > as a Maven dependency > > When we have stable source/sink APIs and the connector versions are > decoupled from Flink this makes sense. But right now this would

Re: [NOTICE] Experimental Java 17 support now available on master

2023-09-07 Thread Matthias Pohl
I don't know about the specifics of the kryo 2.x vs 5.x issues. The discussion around FLIP-317 [1] seems to have stalled here. But Java 17 is still considered an experimental feature as expressed in Flink's roadmap [2]. So, it should be fine to have it in 1.18. I updated the release notes of

[jira] [Created] (FLINK-33061) Translate failure-enricher documentation

2023-09-07 Thread Panagiotis Garefalakis (Jira)
Panagiotis Garefalakis created FLINK-33061: -- Summary: Translate failure-enricher documentation Key: FLINK-33061 URL: https://issues.apache.org/jira/browse/FLINK-33061 Project: Flink

Re: [DISCUSS][FLINK-31788][FLINK-33015] Add back Support emitUpdateWithRetract for TableAggregateFunction

2023-09-07 Thread Lincoln Lee
Thanks to Jane for following up on this issue! +1 for adding it back first. For the deprecation, considering that users aren't usually motivated to upgrade to a major version (1.14, from two years ago, wasn't that old, which may be part of the reason for not receiving more feedback), I'd

Re: How to test "Build snapshot binary release" nightly job against a PR

2023-09-07 Thread Matthias Pohl
You should be able to adapt tools/azure-pipelines/build-apache-repo.yml [1] in your branch as a "debug" commit to add the steps/stages that you're planning to include in a test CI run of your PR (this debug commit should be removed before merging the PR). The ci stage will be executed as part of

Re: [DISCUSS] FLIP-307: Flink connector Redshift

2023-09-07 Thread Danny Cranmer
Hey Samrat, Thanks for driving this. > new FlinkRedshiftSink(prop) One design nit for "new FlinkRedshiftSink(prop)" I would prefer to use first class fields such as database/table-name/url/etc, it makes the API cleaner and easier to use. > an effective approach is to utilize the latest version

Re: [DISCUSS][FLINK-31788][FLINK-33015] Add back Support emitUpdateWithRetract for TableAggregateFunction

2023-09-07 Thread Jark Wu
+1 to fix it first. I also agree to deprecate it if there are few people using it, but this should be another discussion thread within dev+user ML. In the future, we are planning to introduce user-defined-operator based on the TVF functionality which I think can fully subsume the UDTAG, cc @Timo

Re: [DISCUSS] FLIP-328: Allow source operators to determine isProcessingBacklog based on watermark lag

2023-09-07 Thread Jark Wu
Hi Xuannan, I think Hang raised a good question about the competition problem between SplitEnumeratorContext#setIsProcessingBacklog and backlog.watermark-lag-threshold. Yes, you can define a rule for the priority, but there still be some people may misunderstand it (my gut feeling is it's an

退订

2023-09-07 Thread 喻凯
退订

[jira] [Created] (FLINK-33060) Fix the javadoc of ListState.update/addAll about not allowing null value

2023-09-07 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-33060: --- Summary: Fix the javadoc of ListState.update/addAll about not allowing null value Key: FLINK-33060 URL: https://issues.apache.org/jira/browse/FLINK-33060 Project:

Re: [Re-DISCUSS] FLIP-202: Introduce ClickHouse Connector

2023-09-07 Thread ConradJam
Does anyone else have an opinion on this part? If not I will start voting.Comment collection will be open again

[jira] [Created] (FLINK-33059) Support transparent compression for file-connector for all file input formats

2023-09-07 Thread Etienne Chauchot (Jira)
Etienne Chauchot created FLINK-33059: Summary: Support transparent compression for file-connector for all file input formats Key: FLINK-33059 URL: https://issues.apache.org/jira/browse/FLINK-33059

Re: [REQUEST] Edit Permissions for FLIP

2023-09-07 Thread Danny Cranmer
Done, let me know if you have any issues. Thanks, Danny On Thu, Sep 7, 2023 at 10:39 AM Chen Zhanghao wrote: > Hi Danny, > > Could you also help me with the edit permissions for FLIP? > > Best, > Zhanghao Chen > -- > *发件人:* Chen Zhanghao > *发送时间:* 2023年9月5日 20:02 >

[jira] [Created] (FLINK-33058) Support for JSON-encoded Avro

2023-09-07 Thread Dale Lane (Jira)
Dale Lane created FLINK-33058: - Summary: Support for JSON-encoded Avro Key: FLINK-33058 URL: https://issues.apache.org/jira/browse/FLINK-33058 Project: Flink Issue Type: Improvement

Re: [REQUEST] Apply edit permissions for FLIP

2023-09-07 Thread Danny Cranmer
Done, let me know if you have any issues, Thanks, Danny On Thu, Sep 7, 2023 at 10:26 AM xiangyu feng wrote: > Hi devs, > > I would like to request the edit permission for FLIP. I'm currently working > on FLINK-15959 which > need change the

[REQUEST] Apply edit permissions for FLIP

2023-09-07 Thread xiangyu feng
Hi devs, I would like to request the edit permission for FLIP. I'm currently working on FLINK-15959 which need change the ResourceManagerOptions. My wiki username is xiangyu0xf. Thx, Xiangyu

How to test "Build snapshot binary release" nightly job against a PR

2023-09-07 Thread Gabor Somogyi
Hi All, I've created a PR which changes "tools/releasing/create_binary_release.sh" which is called by "Build snapshot binary release" nightly job. Is there a possibility to double check that the PR is not breaking it? The question can be generalized

[jira] [Created] (FLINK-33057) Add options to disable creating job-id subdirectories under the checkpoint directory

2023-09-07 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-33057: --- Summary: Add options to disable creating job-id subdirectories under the checkpoint directory Key: FLINK-33057 URL: https://issues.apache.org/jira/browse/FLINK-33057

[jira] [Created] (FLINK-33056) NettyClientServerSslTest#testValidSslConnection fails on AZP

2023-09-07 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-33056: --- Summary: NettyClientServerSslTest#testValidSslConnection fails on AZP Key: FLINK-33056 URL: https://issues.apache.org/jira/browse/FLINK-33056 Project: Flink

[jira] [Created] (FLINK-33055) Correct the error value about 'state.backend.type' in the document

2023-09-07 Thread Hangxiang Yu (Jira)
Hangxiang Yu created FLINK-33055: Summary: Correct the error value about 'state.backend.type' in the document Key: FLINK-33055 URL: https://issues.apache.org/jira/browse/FLINK-33055 Project: Flink

Re: [DISCUSS] FLIP-334 : Decoupling autoscaler and kubernetes

2023-09-07 Thread Rui Fan
Hi Max, Thanks for your feedback! > We need to go through these phases for the FLIP to be meaningful: > 1. Decouple autoscaler from current autoscaler (generalization) > 2. Ensure 100% functionality and test coverage of Kubernetes implementation > 3. Interface with another backend (e.g. YARN or