[jira] [Created] (FLINK-25697) Support HTTPS for Prometheus Push Gateway

2022-01-18 Thread Mason Chen (Jira)
Mason Chen created FLINK-25697: -- Summary: Support HTTPS for Prometheus Push Gateway Key: FLINK-25697 URL: https://issues.apache.org/jira/browse/FLINK-25697 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-25696) Introduce MetadataPublisher interface to SinkWriter

2022-01-18 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-25696: Summary: Introduce MetadataPublisher interface to SinkWriter Key: FLINK-25696 URL: https://issues.apache.org/jira/browse/FLINK-25696 Project: Flink Issue Typ

Re: [DISCUSS] FLIP-205: Support cache in DataStream for Batch Processing

2022-01-18 Thread Xuannan Su
Hi devs, Thank you all for the discussion. If there are no objections or feedback, I would like to start the vote thread tomorrow. Best, Xuannan On Tue, Jan 18, 2022 at 8:12 PM Xuannan Su wrote: > > Hi Yun, > > Thanks for your questions. > > 1. I think the execute_and_collect is an API on the D

Re: [DISCUSS] Merge flink-connector-testing into flink-connector-test-utils

2022-01-18 Thread Jingsong Li
+1 to merge the two modules. Merging them I don't see any problem, not merging them I feel will only increase the complexity of the dependencies. Best, Jingsong On Wed, Jan 19, 2022 at 11:19 AM Jark Wu wrote: > > +1 to merge the two modules. This can avoid confusion when developers test > conne

Re: [DISCUSS] Merge flink-connector-testing into flink-connector-test-utils

2022-01-18 Thread Jark Wu
+1 to merge the two modules. This can avoid confusion when developers test connectors. Please also remember to add a release note that the "flink-connector-testing" is removed and should use "flink-connector-test-utils" instead. Best, Jark On Tue, 18 Jan 2022 at 21:28, Leonard Xu wrote: > Than

[jira] [Created] (FLINK-25695) TemporalJoin cause state leak in some case

2022-01-18 Thread Lyn Zhang (Jira)
Lyn Zhang created FLINK-25695: - Summary: TemporalJoin cause state leak in some case Key: FLINK-25695 URL: https://issues.apache.org/jira/browse/FLINK-25695 Project: Flink Issue Type: Bug

Re: [VOTE] Release 1.14.3, release candidate #1

2022-01-18 Thread Thomas Weise
Progress: We are waiting for the dockerhub update: https://github.com/docker-library/official-images/pull/11693 Cheers, Thomas On Mon, Jan 17, 2022 at 1:39 PM Thomas Weise wrote: > > Release finalization steps have been completed, except for the Docker images. > > Can someone please approve/merg

Flink 1.13.6 with log4j 2.17.1

2022-01-18 Thread Razin Bouzar
Hello, Is there a plan to roll out Flink 1.13.6 with log4j 2.17.1, per FLINK-25472 ? Thank you, Razin -- RAZIN BOUZAR Senior Engineer - Monitoring Cloud | Salesforce Mobile: 317-502-8995

[jira] [Created] (FLINK-25694) GSON/Alluxio Vulnerability

2022-01-18 Thread David Perkins (Jira)
David Perkins created FLINK-25694: - Summary: GSON/Alluxio Vulnerability Key: FLINK-25694 URL: https://issues.apache.org/jira/browse/FLINK-25694 Project: Flink Issue Type: Bug Compon

Re: [DISCUSS] FLIP-203: Incremental savepoints

2022-01-18 Thread David Morávek
Hi Piotr, thanks for following up on this, Regarding the RocksDB incompatibility, I think we can claim that Flink > version upgrades are/will be supported. If ever we need to break the > backward compatibility via bumping RocksDB version in a such way, that > RocksDB won't be able to provide that

RE: Flink native k8s integration vs. operator

2022-01-18 Thread Alexis Sarda-Espinosa
Hi everyone, Since I see this is getting some traction, I’d like to add a couple things. I had been developing a Kubernetes controller for Flink as a Proof of Concept at my company; I called it Flork because it was to be a Flink Orchestrator for Kubernetes. In the end, we will most likely not u

Re: How to use TableEnvironment in multiple thread environments

2022-01-18 Thread Chang Chen
Thanks Till. If so, how does Flink share Catalog data between threads? I didn't find any synchronized codes in CatalogManager. Does it mean we can only share catalogs through an external hive meta store? BR - Chang Till Rohrmann 于2022年1月17日周一 17:26写道: > Hi Chang, > > Yes, I think this would

[jira] [Created] (FLINK-25693) User property 'auto.offset.reset' doesn't take precedence in case of scan.startup.mode= group-offsets

2022-01-18 Thread Gaurav Miglani (Jira)
Gaurav Miglani created FLINK-25693: -- Summary: User property 'auto.offset.reset' doesn't take precedence in case of scan.startup.mode= group-offsets Key: FLINK-25693 URL: https://issues.apache.org/jira/browse/FLIN

Re: [DISCUSS] FLIP-203: Incremental savepoints

2022-01-18 Thread Piotr Nowojski
Hi All, Yu, sorry I was somehow confused about the configuration. I've changed the FLIP as you sugested. Yu/Yun Tang: Regarding the RocksDB incompatibility, I think we can claim that Flink version upgrades are/will be supported. If ever we need to break the backward compatibility via bumping Roc

[VOTE] Release flink-shaded 15.0, release candidate #2

2022-01-18 Thread Chesnay Schepler
Hi everyone, Please review and vote on the release candidate #2 for the version 15.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes [1], *

Re: [DISCUSS] Merge flink-connector-testing into flink-connector-test-utils

2022-01-18 Thread Leonard Xu
Thanks @Qingsheng for driving this. +1 to use one connector test utils module flink-connector-test-utils. Using single tool module dependency is more friendly to connector developers, especially external connector devs. Putting E2E test utils and units test utils in one module also makes sense

Re: [DISCUSS] FLIP-205: Support cache in DataStream for Batch Processing

2022-01-18 Thread Xuannan Su
Hi Yun, Thanks for your questions. 1. I think the execute_and_collect is an API on the DataStream, which adds a collect sink to the DataStream and invokes StreamExecutionEnvironment#execute. It is a convenient method to execute a job and get an iterator of the result. 2. As our offline discussio

[jira] [Created] (FLINK-25692) Documentation for Kinesis Firehose Sink

2022-01-18 Thread Zichen Liu (Jira)
Zichen Liu created FLINK-25692: -- Summary: Documentation for Kinesis Firehose Sink Key: FLINK-25692 URL: https://issues.apache.org/jira/browse/FLINK-25692 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-25690) RetryRule should allow a callback to be called on exception and failure cases

2022-01-18 Thread Etienne Chauchot (Jira)
Etienne Chauchot created FLINK-25690: Summary: RetryRule should allow a callback to be called on exception and failure cases Key: FLINK-25690 URL: https://issues.apache.org/jira/browse/FLINK-25690

[jira] [Created] (FLINK-25691) ElasticsearchSinkITCase.testElasticsearchSink fails on AZP

2022-01-18 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-25691: - Summary: ElasticsearchSinkITCase.testElasticsearchSink fails on AZP Key: FLINK-25691 URL: https://issues.apache.org/jira/browse/FLINK-25691 Project: Flink

[jira] [Created] (FLINK-25689) Introduce atomic commit

2022-01-18 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-25689: --- Summary: Introduce atomic commit Key: FLINK-25689 URL: https://issues.apache.org/jira/browse/FLINK-25689 Project: Flink Issue Type: Sub-task Componen

[jira] [Created] (FLINK-25688) Resolve performance degradation with high parallelism when using buffer debloating

2022-01-18 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-25688: -- Summary: Resolve performance degradation with high parallelism when using buffer debloating Key: FLINK-25688 URL: https://issues.apache.org/jira/browse/FLINK-25688