Re: [ANNOUNCE] New Flink PMC members: Igal Shilman, Konstantin Knauf and Yun Gao

2022-02-16 Thread Guowei Ma
Congratulations Best, Guowei On Thu, Feb 17, 2022 at 3:29 PM Yang Wang wrote: > Congratulations to all of you! > > Best, > Yang > > Lijie Wang 于2022年2月17日周四 14:20写道: > > > Congratulations to all of you! > > > > Best, > > Lijie > > > > Leonard Xu 于2022年2月17日周四 12:13写道: > > > > >

Re: [ANNOUNCE] New Apache Flink Committers: Feng Wang, Zhipeng Zhang

2022-02-16 Thread Guowei Ma
Congratulations to Feng and Zhipeng! Best, Guowei On Thu, Feb 17, 2022 at 3:30 PM Yang Wang wrote: > Congratulations! > > Best, > Yang > > Lijie Wang 于2022年2月17日周四 14:21写道: > > > Congratulations to all of you! > > > > Best, > > Lijie > > > > Zakelly Lan 于2022年2月17日周四 12:21写道: > > > > >

Re: [ANNOUNCE] New Apache Flink Committers: Feng Wang, Zhipeng Zhang

2022-02-16 Thread Yang Wang
Congratulations! Best, Yang Lijie Wang 于2022年2月17日周四 14:21写道: > Congratulations to all of you! > > Best, > Lijie > > Zakelly Lan 于2022年2月17日周四 12:21写道: > > > Congratulations :-D > > > > On Thu, Feb 17, 2022 at 12:15 PM Leonard Xu wrote: > > > > > Congratulations ! > > > > > > > > > Best, > >

Re: [ANNOUNCE] New Flink PMC members: Igal Shilman, Konstantin Knauf and Yun Gao

2022-02-16 Thread Yang Wang
Congratulations to all of you! Best, Yang Lijie Wang 于2022年2月17日周四 14:20写道: > Congratulations to all of you! > > Best, > Lijie > > Leonard Xu 于2022年2月17日周四 12:13写道: > > > Congratulations ! > > > > Best, > > Leonard > > > > > 2022年2月17日 上午11:09,Yun Tang 写道: > > > > > > Congratulations to all

Re: Re: [DISCUSS] Future of Per-Job Mode

2022-02-16 Thread Yang Wang
I am not sure whether the sql script could also be submitted like python. We will need a sql-runner jar, which plays as the user jar and has the sql script as the argument. ./bin/flink run-application \ --target kubernetes-application \ -Dkubernetes.cluster-id= \

[jira] [Created] (FLINK-26209) Possibility of Command Injection attack

2022-02-16 Thread Iman Sharafaldin (Jira)
Iman Sharafaldin created FLINK-26209: Summary: Possibility of Command Injection attack Key: FLINK-26209 URL: https://issues.apache.org/jira/browse/FLINK-26209 Project: Flink Issue Type:

[jira] [Created] (FLINK-26208) Introduce implementation of ManagedTableFactory

2022-02-16 Thread Jane Chan (Jira)
Jane Chan created FLINK-26208: - Summary: Introduce implementation of ManagedTableFactory Key: FLINK-26208 URL: https://issues.apache.org/jira/browse/FLINK-26208 Project: Flink Issue Type:

[jira] [Created] (FLINK-26207) refactor web ui's components to depend on module's injected config object

2022-02-16 Thread Junhan Yang (Jira)
Junhan Yang created FLINK-26207: --- Summary: refactor web ui's components to depend on module's injected config object Key: FLINK-26207 URL: https://issues.apache.org/jira/browse/FLINK-26207 Project:

Re: [ANNOUNCE] New Apache Flink Committers: Feng Wang, Zhipeng Zhang

2022-02-16 Thread Lijie Wang
Congratulations to all of you! Best, Lijie Zakelly Lan 于2022年2月17日周四 12:21写道: > Congratulations :-D > > On Thu, Feb 17, 2022 at 12:15 PM Leonard Xu wrote: > > > Congratulations ! > > > > > > Best, > > Leonard > > > > > 2022年2月17日 上午11:17,Paul Lam 写道: > > > > > > Congrats! Well deserved! > >

Re: [ANNOUNCE] New Flink PMC members: Igal Shilman, Konstantin Knauf and Yun Gao

2022-02-16 Thread Lijie Wang
Congratulations to all of you! Best, Lijie Leonard Xu 于2022年2月17日周四 12:13写道: > Congratulations ! > > Best, > Leonard > > > 2022年2月17日 上午11:09,Yun Tang 写道: > > > > Congratulations to all of you! > > > > Best, > > Yun Tang > > > > From: Yangze Guo > > Sent:

[jira] [Created] (FLINK-26206) refactor web ui's service layer and app config

2022-02-16 Thread Junhan Yang (Jira)
Junhan Yang created FLINK-26206: --- Summary: refactor web ui's service layer and app config Key: FLINK-26206 URL: https://issues.apache.org/jira/browse/FLINK-26206 Project: Flink Issue Type:

Re: [ANNOUNCE] New Apache Flink Committers: Feng Wang, Zhipeng Zhang

2022-02-16 Thread Zakelly Lan
Congratulations :-D On Thu, Feb 17, 2022 at 12:15 PM Leonard Xu wrote: > Congratulations ! > > > Best, > Leonard > > > 2022年2月17日 上午11:17,Paul Lam 写道: > > > > Congrats! Well deserved! > > > > Best, > > Paul Lam > > > >> 2022年2月16日 21:30,Robert Metzger 写道: > >> > >> Hi everyone, > >> > >> On

Re: [ANNOUNCE] New Apache Flink Committers: Feng Wang, Zhipeng Zhang

2022-02-16 Thread Leonard Xu
Congratulations ! Best, Leonard > 2022年2月17日 上午11:17,Paul Lam 写道: > > Congrats! Well deserved! > > Best, > Paul Lam > >> 2022年2月16日 21:30,Robert Metzger 写道: >> >> Hi everyone, >> >> On behalf of the PMC, I'm very happy to announce two new Flink >> committers: Feng Wang and Zhipeng Zhang!

Re: [ANNOUNCE] New Flink PMC members: Igal Shilman, Konstantin Knauf and Yun Gao

2022-02-16 Thread Leonard Xu
Congratulations ! Best, Leonard > 2022年2月17日 上午11:09,Yun Tang 写道: > > Congratulations to all of you! > > Best, > Yun Tang > > From: Yangze Guo > Sent: Thursday, February 17, 2022 10:44 > To: dev > Cc: ro...@apache.org > Subject: Re: [ANNOUNCE] New Flink PMC

[jira] [Created] (FLINK-26205) Support Online Model Save in FlinkML

2022-02-16 Thread weibo zhao (Jira)
weibo zhao created FLINK-26205: -- Summary: Support Online Model Save in FlinkML Key: FLINK-26205 URL: https://issues.apache.org/jira/browse/FLINK-26205 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-26204) set table.optimizer.distinct-agg.split.enabled to true and using Window TVF CUMULATE to count users, It will appear that the value of the current step window time is gre

2022-02-16 Thread Bo Huang (Jira)
Bo Huang created FLINK-26204: Summary: set table.optimizer.distinct-agg.split.enabled to true and using Window TVF CUMULATE to count users, It will appear that the value of the current step window time is greater than the value of the next step

Re: [ANNOUNCE] New Apache Flink Committers: Feng Wang, Zhipeng Zhang

2022-02-16 Thread Paul Lam
Congrats! Well deserved! Best, Paul Lam > 2022年2月16日 21:30,Robert Metzger 写道: > > Hi everyone, > > On behalf of the PMC, I'm very happy to announce two new Flink > committers: Feng Wang and Zhipeng Zhang! > > Feng is one of the most active Flink evangelists in China, with plenty of > public

Re: [ANNOUNCE] New Flink PMC members: Igal Shilman, Konstantin Knauf and Yun Gao

2022-02-16 Thread Yun Tang
Congratulations to all of you! Best, Yun Tang From: Yangze Guo Sent: Thursday, February 17, 2022 10:44 To: dev Cc: ro...@apache.org Subject: Re: [ANNOUNCE] New Flink PMC members: Igal Shilman, Konstantin Knauf and Yun Gao Congratulations! Well deserved.

Re: [ANNOUNCE] New Apache Flink Committers: Feng Wang, Zhipeng Zhang

2022-02-16 Thread Yun Tang
Congratulations to Feng and Zhipeng! Best, Yun Tang From: Yangze Guo Sent: Thursday, February 17, 2022 10:58 To: dev Subject: Re: [ANNOUNCE] New Apache Flink Committers: Feng Wang, Zhipeng Zhang Congratulations! Well deserved! Best, Yangze Guo On Thu, Feb 17,

[jira] [Created] (FLINK-26203) Support Table API in Pulsar Sink Connector

2022-02-16 Thread Yufei Zhang (Jira)
Yufei Zhang created FLINK-26203: --- Summary: Support Table API in Pulsar Sink Connector Key: FLINK-26203 URL: https://issues.apache.org/jira/browse/FLINK-26203 Project: Flink Issue Type: New

Re: [ANNOUNCE] New Apache Flink Committers: Feng Wang, Zhipeng Zhang

2022-02-16 Thread Yangze Guo
Congratulations! Well deserved! Best, Yangze Guo On Thu, Feb 17, 2022 at 12:22 AM Matthias Pohl wrote: > > Congratulations :-) > > Best, Matthias > > On Wed, Feb 16, 2022 at 4:04 PM Till Rohrmann wrote: > > > Congratulations Feng and Zhipeng :-) > > > > Cheers, > > Till > > > > On Wed, Feb 16,

[jira] [Created] (FLINK-26202) Support Table API in Pulsar Source Connector

2022-02-16 Thread Yufei Zhang (Jira)
Yufei Zhang created FLINK-26202: --- Summary: Support Table API in Pulsar Source Connector Key: FLINK-26202 URL: https://issues.apache.org/jira/browse/FLINK-26202 Project: Flink Issue Type: New

[jira] [Created] (FLINK-26201) FileStoreScanTest is not stable

2022-02-16 Thread Jane Chan (Jira)
Jane Chan created FLINK-26201: - Summary: FileStoreScanTest is not stable Key: FLINK-26201 URL: https://issues.apache.org/jira/browse/FLINK-26201 Project: Flink Issue Type: Bug

Re: [ANNOUNCE] New Flink PMC members: Igal Shilman, Konstantin Knauf and Yun Gao

2022-02-16 Thread Yangze Guo
Congratulations! Well deserved. Best, Yangze Guo On Thu, Feb 17, 2022 at 10:15 AM Paul Lam wrote: > > Congrats to all of you! > > Best, > Paul Lam > > > 2022年2月17日 01:24,Roman Khachatryan 写道: > > > > Congratulations! > > > > Regards, > > Roman > > > > On Wed, Feb 16, 2022 at 5:22 PM Matthias

Re: [ANNOUNCE] New Flink PMC members: Igal Shilman, Konstantin Knauf and Yun Gao

2022-02-16 Thread Paul Lam
Congrats to all of you! Best, Paul Lam > 2022年2月17日 01:24,Roman Khachatryan 写道: > > Congratulations! > > Regards, > Roman > > On Wed, Feb 16, 2022 at 5:22 PM Matthias Pohl wrote: >> >> Congratulations to all of you :) >> >> On Wed, Feb 16, 2022 at 4:04 PM Till Rohrmann wrote: >> >>>

[jira] [Created] (FLINK-26200) Redirect statefun directly to docs

2022-02-16 Thread Seth Wiesman (Jira)
Seth Wiesman created FLINK-26200: Summary: Redirect statefun directly to docs Key: FLINK-26200 URL: https://issues.apache.org/jira/browse/FLINK-26200 Project: Flink Issue Type: Improvement

Discussion: Kafka Consumer and client.id.prefix usage

2022-02-16 Thread Yaroslav Tkachenko
Hey everyone! I'm currently investigating the way Flink configures client.id values for the Kafka consumer and I'd appreciate some help. *Old FlinkKafkaConsumer* It doesn't look like client.id receives any special treatment when using deprecated FlinkKafkaConsumer: if client.id is not specified,

Re: question about StatefunContext in golang Statefun SDK

2022-02-16 Thread Seth Wiesman
Hi Galen, No, that is not currently supported, the current idiomatic way would be to pass those values to the struct implementing the Statefun interface. type MyFunc struct { someRuntimeInfo string } func (m *MyFunc) Invoke(ctx statefun.Context, message statefun.Message) error { } func main() {

Re: question about StatefunContext in golang Statefun SDK

2022-02-16 Thread Galen Warren
Sorry, that should be context.WithValue, not ctx.WithValue ... On Wed, Feb 16, 2022 at 5:35 PM Galen Warren wrote: > When stateful functions are invoked, they are passed an instance of > statefun.Context, which wraps the context.Context received by the HTTP > request. Is there any way to

question about StatefunContext in golang Statefun SDK

2022-02-16 Thread Galen Warren
When stateful functions are invoked, they are passed an instance of statefun.Context, which wraps the context.Context received by the HTTP request. Is there any way to customize that context.Context to, say, hold custom values, using ctx.WithValue()? I don't see a way but I wanted to ask. If not,

[jira] [Created] (FLINK-26199) StatementSet.compilePlan doesn't pass the archiunit tests

2022-02-16 Thread Jira
David Morávek created FLINK-26199: - Summary: StatementSet.compilePlan doesn't pass the archiunit tests Key: FLINK-26199 URL: https://issues.apache.org/jira/browse/FLINK-26199 Project: Flink

[jira] [Created] (FLINK-26198) ArchitectureTest fails on AZP (table.api.StatementSet)

2022-02-16 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-26198: - Summary: ArchitectureTest fails on AZP (table.api.StatementSet) Key: FLINK-26198 URL: https://issues.apache.org/jira/browse/FLINK-26198 Project: Flink

[jira] [Created] (FLINK-26197) Allow playground egress to keep connection open and push messages

2022-02-16 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-26197: - Summary: Allow playground egress to keep connection open and push messages Key: FLINK-26197 URL: https://issues.apache.org/jira/browse/FLINK-26197 Project: Flink

[ANNOUNCE] Flink 1.15 Feature Freeze

2022-02-16 Thread Till Rohrmann
Hi everyone, The deadline for merging new features for Flink 1.15 has passed. * From now on, only bug-fixes and documentation fixes / improvements are allowed to be merged into the master branch. * New features merged after this point can be reverted. If you need an exception to this rule,

Re: [ANNOUNCE] New Flink PMC members: Igal Shilman, Konstantin Knauf and Yun Gao

2022-02-16 Thread Roman Khachatryan
Congratulations! Regards, Roman On Wed, Feb 16, 2022 at 5:22 PM Matthias Pohl wrote: > > Congratulations to all of you :) > > On Wed, Feb 16, 2022 at 4:04 PM Till Rohrmann wrote: > > > Congratulations! Well deserved! > > > > Cheers, > > Till > > > > On Wed, Feb 16, 2022 at 2:51 PM Martijn

[jira] [Created] (FLINK-26196) error when Incremental Checkpoints by RocksDb

2022-02-16 Thread hjw (Jira)
hjw created FLINK-26196: --- Summary: error when Incremental Checkpoints by RocksDb Key: FLINK-26196 URL: https://issues.apache.org/jira/browse/FLINK-26196 Project: Flink Issue Type: Bug

Re: [DISCUSS]Support the merge statement in FlinkSQL

2022-02-16 Thread Francesco Guardiani
> In the theory aspect, incremental data should be carefully considered for streaming data. In this situation, the data flow from target_table to target_table will be a loop, and the incremental data with one key will keep going through the loop. It looks very strange. This is the same concern I

Re: [ANNOUNCE] New Apache Flink Committers: Feng Wang, Zhipeng Zhang

2022-02-16 Thread Matthias Pohl
Congratulations :-) Best, Matthias On Wed, Feb 16, 2022 at 4:04 PM Till Rohrmann wrote: > Congratulations Feng and Zhipeng :-) > > Cheers, > Till > > On Wed, Feb 16, 2022 at 2:51 PM Martijn Visser > wrote: > > > Congratulations Feng and Zhipeng! > > > > Best regards, > > > > Martijn > >

Re: [ANNOUNCE] New Flink PMC members: Igal Shilman, Konstantin Knauf and Yun Gao

2022-02-16 Thread Matthias Pohl
Congratulations to all of you :) On Wed, Feb 16, 2022 at 4:04 PM Till Rohrmann wrote: > Congratulations! Well deserved! > > Cheers, > Till > > On Wed, Feb 16, 2022 at 2:51 PM Martijn Visser > wrote: > > > Congratulations to all of you! > > > > Best regards, > > > > Martijn Visser > >

[jira] [Created] (FLINK-26195) Kafka connector tests are mixing JUnit4 and JUnit5

2022-02-16 Thread Alexander Preuss (Jira)
Alexander Preuss created FLINK-26195: Summary: Kafka connector tests are mixing JUnit4 and JUnit5 Key: FLINK-26195 URL: https://issues.apache.org/jira/browse/FLINK-26195 Project: Flink

[jira] [Created] (FLINK-26194) Deprecate nullCheck in TableConfig

2022-02-16 Thread Marios Trivyzas (Jira)
Marios Trivyzas created FLINK-26194: --- Summary: Deprecate nullCheck in TableConfig Key: FLINK-26194 URL: https://issues.apache.org/jira/browse/FLINK-26194 Project: Flink Issue Type:

Re: [ANNOUNCE] New Apache Flink Committers: Feng Wang, Zhipeng Zhang

2022-02-16 Thread Till Rohrmann
Congratulations Feng and Zhipeng :-) Cheers, Till On Wed, Feb 16, 2022 at 2:51 PM Martijn Visser wrote: > Congratulations Feng and Zhipeng! > > Best regards, > > Martijn > https://twitter.com/MartijnVisser82 > > > On Wed, 16 Feb 2022 at 14:32, Robert Metzger wrote: > > > Hi everyone, > > > >

Re: [ANNOUNCE] New Flink PMC members: Igal Shilman, Konstantin Knauf and Yun Gao

2022-02-16 Thread Till Rohrmann
Congratulations! Well deserved! Cheers, Till On Wed, Feb 16, 2022 at 2:51 PM Martijn Visser wrote: > Congratulations to all of you! > > Best regards, > > Martijn Visser > https://twitter.com/MartijnVisser82 > > > On Wed, 16 Feb 2022 at 14:29, Fabian Paul wrote: > > > Congrats to all three of

[jira] [Created] (FLINK-26193) Commit generated FlinkDeployment resource into Git repo

2022-02-16 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-26193: -- Summary: Commit generated FlinkDeployment resource into Git repo Key: FLINK-26193 URL: https://issues.apache.org/jira/browse/FLINK-26193 Project: Flink Issue

[jira] [Created] (FLINK-26192) PulsarOrderedSourceReaderTest fails with exit code 255

2022-02-16 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-26192: Summary: PulsarOrderedSourceReaderTest fails with exit code 255 Key: FLINK-26192 URL: https://issues.apache.org/jira/browse/FLINK-26192 Project: Flink

Re: [ANNOUNCE] New Apache Flink Committers: Feng Wang, Zhipeng Zhang

2022-02-16 Thread Martijn Visser
Congratulations Feng and Zhipeng! Best regards, Martijn https://twitter.com/MartijnVisser82 On Wed, 16 Feb 2022 at 14:32, Robert Metzger wrote: > Hi everyone, > > On behalf of the PMC, I'm very happy to announce two new Flink > committers: Feng Wang and Zhipeng Zhang! > > Feng is one of the

Re: [ANNOUNCE] New Flink PMC members: Igal Shilman, Konstantin Knauf and Yun Gao

2022-02-16 Thread Martijn Visser
Congratulations to all of you! Best regards, Martijn Visser https://twitter.com/MartijnVisser82 On Wed, 16 Feb 2022 at 14:29, Fabian Paul wrote: > Congrats to all three of you, well deserved. > > Best, > Fabian > > On Wed, Feb 16, 2022 at 2:23 PM Robert Metzger > wrote: > > > > Hi all, > >

[ANNOUNCE] New Apache Flink Committers: Feng Wang, Zhipeng Zhang

2022-02-16 Thread Robert Metzger
Hi everyone, On behalf of the PMC, I'm very happy to announce two new Flink committers: Feng Wang and Zhipeng Zhang! Feng is one of the most active Flink evangelists in China, with plenty of public talks, blog posts and other evangelization activities. The PMC wants to recognize and value these

Re: [ANNOUNCE] New Flink PMC members: Igal Shilman, Konstantin Knauf and Yun Gao

2022-02-16 Thread Fabian Paul
Congrats to all three of you, well deserved. Best, Fabian On Wed, Feb 16, 2022 at 2:23 PM Robert Metzger wrote: > > Hi all, > > I would like to formally announce a few new Flink PMC members on the dev@ > list. The PMC has not done a good job of always announcing new PMC members > (and

[ANNOUNCE] New Flink PMC members: Igal Shilman, Konstantin Knauf and Yun Gao

2022-02-16 Thread Robert Metzger
Hi all, I would like to formally announce a few new Flink PMC members on the dev@ list. The PMC has not done a good job of always announcing new PMC members (and committers) recently. I'll try to keep an eye on this in the future to improve the situation. Nevertheless, I'm very happy to announce

[jira] [Created] (FLINK-26191) Incorrect license in Elasticsearch 7 connector

2022-02-16 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-26191: Summary: Incorrect license in Elasticsearch 7 connector Key: FLINK-26191 URL: https://issues.apache.org/jira/browse/FLINK-26191 Project: Flink Issue

[jira] [Created] (FLINK-26190) Remove TableConfig from ExecNodeConfiguration

2022-02-16 Thread Marios Trivyzas (Jira)
Marios Trivyzas created FLINK-26190: --- Summary: Remove TableConfig from ExecNodeConfiguration Key: FLINK-26190 URL: https://issues.apache.org/jira/browse/FLINK-26190 Project: Flink Issue

[RESULT] [VOTE] Release 1.13.6, release candidate #1

2022-02-16 Thread Konstantin Knauf
Hi everyone, I am pleased to announce that we have unanimously approved this release candidate: There are 4 approving votes, 3 of which are binding: - Chesnay Schepler (binding) - Dawid Wysakowicz (binding) - Anton Kalashnikov (non-binding) - Konstantin Knauf (binding) There are no disapproving

Re: [VOTE] Release 1.13.6, release candidate #1

2022-02-16 Thread Konstantin Knauf
+1 (binding) - checked signatures and checksums of binaries OK - build from sources - run TopSpeedWindowing.jar in standalone application mode - ran examples/python/table/batch/word_count.py in a local mini cluster - ran examples/python/table/batch/word_count.py against standalone session cluster

[jira] [Created] (FLINK-26189) Remove bundling of grizzled-slf4j from rpc-akka

2022-02-16 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-26189: Summary: Remove bundling of grizzled-slf4j from rpc-akka Key: FLINK-26189 URL: https://issues.apache.org/jira/browse/FLINK-26189 Project: Flink

[jira] [Created] (FLINK-26188) Refactor TestingHighAvailabilityServices to properly use the builder pattern.

2022-02-16 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-26188: - Summary: Refactor TestingHighAvailabilityServices to properly use the builder pattern. Key: FLINK-26188 URL: https://issues.apache.org/jira/browse/FLINK-26188

Re: Re: [DISCUSS] Future of Per-Job Mode

2022-02-16 Thread Jark Wu
I think this mode is still limited and maybe not easy to extend. Could the application mode provide an interface to execute? So that clients can implement the interface and pass arbitrary parameters (e.g. SQL scripts) ? Best, Jark On Wed, 16 Feb 2022 at 18:54, Konstantin Knauf wrote: > Hi

[jira] [Created] (FLINK-26187) Chinese docs override english aliases

2022-02-16 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-26187: Summary: Chinese docs override english aliases Key: FLINK-26187 URL: https://issues.apache.org/jira/browse/FLINK-26187 Project: Flink Issue Type:

[jira] [Created] (FLINK-26186) update the API_ANNOTATIONS rule

2022-02-16 Thread Jing Ge (Jira)
Jing Ge created FLINK-26186: --- Summary: update the API_ANNOTATIONS rule Key: FLINK-26186 URL: https://issues.apache.org/jira/browse/FLINK-26186 Project: Flink Issue Type: Improvement

Re: Re: [DISCUSS] Future of Per-Job Mode

2022-02-16 Thread Konstantin Knauf
Hi Jark, I think you are raising a very good point. I think we need an application mode for SQL that would work along the lines of executing a SQL script (incl. init scripts) located in a particular directory in the Docker Image. Details to be discussed. Do you think Zeppelin/SQL CLI could work

Re: [DISCUSS] FLIP-212: Introduce Flink Kubernetes Operator

2022-02-16 Thread Gyula Fóra
Hi Konstantin, I completely agree with the general philosophy that if a resource exists it should be "running" or I would rather say "do it's thing" whatever that means for a particular resource. We followed this design principle when we decided to have only 2 "desired states" running and

[jira] [Created] (FLINK-26185) E2E Elasticsearch Tests should use the new Sink interface

2022-02-16 Thread Alexander Preuss (Jira)
Alexander Preuss created FLINK-26185: Summary: E2E Elasticsearch Tests should use the new Sink interface Key: FLINK-26185 URL: https://issues.apache.org/jira/browse/FLINK-26185 Project: Flink

Re: [DISCUSS] FLIP-212: Introduce Flink Kubernetes Operator

2022-02-16 Thread Konstantin Knauf
Hi Gyula, sorry for joining late. One comment on the API design for consideration: we are using the job.state as kind of a "desired state", right? This is quite uncommon in Kubernetes to my knowledge. In Kubernetes almost always the fact that a resource exists means that it should be "running".

Re: [DISCUSS] FLIP-212: Introduce Flink Kubernetes Operator

2022-02-16 Thread Gyula Fóra
Hi All! Thank you all for reviewing the PR and already helping to make it better. I have opened a bunch of jira tickets under https://issues.apache.org/jira/browse/FLINK-25963 based on some comments and incomplete features in general. Given that there were no major objections about the

[jira] [Created] (FLINK-26184) Migrate StoreSink to Sink V2

2022-02-16 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-26184: Summary: Migrate StoreSink to Sink V2 Key: FLINK-26184 URL: https://issues.apache.org/jira/browse/FLINK-26184 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-26183) Support kubernetes-operator metrics using the Flink metric system

2022-02-16 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-26183: -- Summary: Support kubernetes-operator metrics using the Flink metric system Key: FLINK-26183 URL: https://issues.apache.org/jira/browse/FLINK-26183 Project: Flink

[jira] [Created] (FLINK-26182) E2E test for PulsarSink on new Flink sink testing tools

2022-02-16 Thread Yufan Sheng (Jira)
Yufan Sheng created FLINK-26182: --- Summary: E2E test for PulsarSink on new Flink sink testing tools Key: FLINK-26182 URL: https://issues.apache.org/jira/browse/FLINK-26182 Project: Flink Issue

[jira] [Created] (FLINK-26181) Support manual savepoint triggering in the operator

2022-02-16 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-26181: -- Summary: Support manual savepoint triggering in the operator Key: FLINK-26181 URL: https://issues.apache.org/jira/browse/FLINK-26181 Project: Flink Issue Type:

[jira] [Created] (FLINK-26180) Update docs to introduce the compaction for FileSink

2022-02-16 Thread Gen Luo (Jira)
Gen Luo created FLINK-26180: --- Summary: Update docs to introduce the compaction for FileSink Key: FLINK-26180 URL: https://issues.apache.org/jira/browse/FLINK-26180 Project: Flink Issue Type:

[jira] [Created] (FLINK-26179) Support periodic savepointing in the operator

2022-02-16 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-26179: -- Summary: Support periodic savepointing in the operator Key: FLINK-26179 URL: https://issues.apache.org/jira/browse/FLINK-26179 Project: Flink Issue Type:

[jira] [Created] (FLINK-26178) Use the same enum for expected and observed jobstate (JobState / JobStatus.state)

2022-02-16 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-26178: -- Summary: Use the same enum for expected and observed jobstate (JobState / JobStatus.state) Key: FLINK-26178 URL: https://issues.apache.org/jira/browse/FLINK-26178

[jira] [Created] (FLINK-26177) PulsarSourceITCase.testScaleDown fails with timeout

2022-02-16 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-26177: - Summary: PulsarSourceITCase.testScaleDown fails with timeout Key: FLINK-26177 URL: https://issues.apache.org/jira/browse/FLINK-26177 Project: Flink Issue

[jira] [Created] (FLINK-26176) Scala savepoint migration tests don't run as configured (not testing RocksDB savepoints)

2022-02-16 Thread Sebastian Mattheis (Jira)
Sebastian Mattheis created FLINK-26176: -- Summary: Scala savepoint migration tests don't run as configured (not testing RocksDB savepoints) Key: FLINK-26176 URL: