[jira] [Created] (FLINK-27611) ConcurrentModificationException during Flink-Pulsar checkpoint notification

2022-05-13 Thread Jason Kania (Jira)
Jason Kania created FLINK-27611: --- Summary: ConcurrentModificationException during Flink-Pulsar checkpoint notification Key: FLINK-27611 URL: https://issues.apache.org/jira/browse/FLINK-27611 Project:

Re: [Discuss] Creating an Apache Flink slack workspace

2022-05-13 Thread Austin Cawley-Edwards
Nice, cool to hear Kyle! How do you all approach moderation? Is there anything specific you feel like you've "gotten right"/ other tips? (as a side note, I also love slack). Austin On Fri, May 13, 2022 at 2:27 PM Kyle Bendickson wrote: > Hi all, > > Chiming in as I work in the Iceberg space

[jira] [Created] (FLINK-27610) PrometheusPushGatewayReporter doesn't support basic authentication

2022-05-13 Thread Qihong Jiang (Jira)
Qihong Jiang created FLINK-27610: Summary: PrometheusPushGatewayReporter doesn't support basic authentication Key: FLINK-27610 URL: https://issues.apache.org/jira/browse/FLINK-27610 Project: Flink

Re: [Discuss] Creating an Apache Flink slack workspace

2022-05-13 Thread Kyle Bendickson
Hi all, Chiming in as I work in the Iceberg space and we have our own slack as well, that I am admittedly proud of. We don’t necessarily encounter issues with vendors, though of course we do get some noise now and again. Overall, our slack workspace has been cited in multiple blogs and things

Re: [Discuss] Creating an Apache Flink slack workspace

2022-05-13 Thread Austin Cawley-Edwards
Hi all, Would just like to share an interesting article from the dbt community[1], which in part describes some of their challenges in managing Slack in a large community. The biggest point it seems to make is that their Slack has become a marketing tool for dbt/data vendors instead of a

Re: [DISCUSS] FLIP-231: Introduce SupportStatisticReport to support reporting statistics from source connectors

2022-05-13 Thread Jingsong Li
Thank Godfrey for driving. Looks very good~ This will undoubtedly greatly enhance the various batch mode connectors. I left some comments: ## FileBasedStatisticsReportableDecodingFormat One concern I have is that we read the footer for each file, and this may be a bit costly in some cases. Is

[jira] [Created] (FLINK-27609) Tracking flink-version and flink-revision in FlinkDeploymentStatus

2022-05-13 Thread Matyas Orhidi (Jira)
Matyas Orhidi created FLINK-27609: - Summary: Tracking flink-version and flink-revision in FlinkDeploymentStatus Key: FLINK-27609 URL: https://issues.apache.org/jira/browse/FLINK-27609 Project: Flink

[jira] [Created] (FLINK-27608) Flink may throw PartitionNotFound Exception if the downstream task reached Running state earlier than it's upstream task

2022-05-13 Thread zlzhang0122 (Jira)
zlzhang0122 created FLINK-27608: --- Summary: Flink may throw PartitionNotFound Exception if the downstream task reached Running state earlier than it's upstream task Key: FLINK-27608 URL:

Re: [DISCUSS] FLIP-221 Abstraction for lookup source cache and metric

2022-05-13 Thread Qingsheng Ren
Hi Alexander and devs, Thank you very much for the in-depth discussion! As Jark mentioned we were inspired by Alexander's idea and made a refactor on our design. FLIP-221 [1] has been updated to reflect our design now and we are happy to hear more suggestions from you! Compared to the previous

[jira] [Created] (FLINK-27607) [JUnit5 Migration] Module: flink-connector-files

2022-05-13 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-27607: --- Summary: [JUnit5 Migration] Module: flink-connector-files Key: FLINK-27607 URL: https://issues.apache.org/jira/browse/FLINK-27607 Project: Flink Issue

[jira] [Created] (FLINK-27606) Fix code generator exception when using imperative udaf that is introduced for planner scala-free

2022-05-13 Thread dalongliu (Jira)
dalongliu created FLINK-27606: - Summary: Fix code generator exception when using imperative udaf that is introduced for planner scala-free Key: FLINK-27606 URL: https://issues.apache.org/jira/browse/FLINK-27606

Re: [ANNOUNCE] Problems with build due to tests using too much disk space

2022-05-13 Thread Konstantin Knauf
Thanks a lot for taking care of this, Martijn! Am Fr., 13. Mai 2022 um 12:59 Uhr schrieb Martijn Visser < martijnvis...@apache.org>: > Hi everyone, > > I noticed that multiple e2e tests had debugging logged enabled. Quite a few > of them have done that for a long time; however, since we are

Re: [ANNOUNCE] Problems with build due to tests using too much disk space

2022-05-13 Thread Martijn Visser
Hi everyone, I noticed that multiple e2e tests had debugging logged enabled. Quite a few of them have done that for a long time; however, since we are adding more and more tests, it also seems that this caused the bucket to overflood. I've disabled the debugging logging for all tests; this has

[DISCUSS] FLIP-231: Introduce SupportStatisticReport to support reporting statistics from source connectors

2022-05-13 Thread godfrey he
Hi all, I would like to open a discussion on FLIP-231: Introduce SupportStatisticReport to support reporting statistics from source connectors. Statistics are one of the most important inputs to the optimizer. Accurate and complete statistics allows the optimizer to be more powerful. Currently,

[jira] [Created] (FLINK-27605) Upgrade mockito to a version where static function mocking is possible

2022-05-13 Thread Gabor Somogyi (Jira)
Gabor Somogyi created FLINK-27605: - Summary: Upgrade mockito to a version where static function mocking is possible Key: FLINK-27605 URL: https://issues.apache.org/jira/browse/FLINK-27605 Project:

[jira] [Created] (FLINK-27604) flink sql read hive on hbase throw NPE

2022-05-13 Thread zhangsan (Jira)
zhangsan created FLINK-27604: Summary: flink sql read hive on hbase throw NPE Key: FLINK-27604 URL: https://issues.apache.org/jira/browse/FLINK-27604 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-27603) Hive dialect support "reload function"

2022-05-13 Thread luoyuxia (Jira)
luoyuxia created FLINK-27603: Summary: Hive dialect support "reload function" Key: FLINK-27603 URL: https://issues.apache.org/jira/browse/FLINK-27603 Project: Flink Issue Type: Sub-task

Split string flatmap -> Arraylist/List

2022-05-13 Thread Zain Haider Nemati
Hi, I have a comma separated string of the format x,y,z \n a,b,c ... I want to split the string on the basis of '\n' and insert each string into the data stream separately using *flatmap*. Any example on how to do that? If I add the chunks into an Arralist or List and return that from the flatmap

[jira] [Created] (FLINK-27602) Add docs in Python ML

2022-05-13 Thread Huang Xingbo (Jira)
Huang Xingbo created FLINK-27602: Summary: Add docs in Python ML Key: FLINK-27602 URL: https://issues.apache.org/jira/browse/FLINK-27602 Project: Flink Issue Type: Sub-task

Re: [DISCUSS] FLIP-224: Blacklist Mechanism

2022-05-13 Thread Konstantin Knauf
Hi Lijie, wouldn't the REST API-idiomatic way for an update/replace be a PUT on the resource? PUT: http://{jm_rest_address:port}/blocklist/taskmanagers/{id} Best, Konstantin Am Fr., 13. Mai 2022 um 11:01 Uhr schrieb Lijie Wang < wangdachui9...@gmail.com>: > Hi everyone, > > I've had an

[jira] [Created] (FLINK-27601) Translation in Korean

2022-05-13 Thread Kwang-in (Dennis) JUNG (Jira)
Kwang-in (Dennis) JUNG created FLINK-27601: -- Summary: Translation in Korean Key: FLINK-27601 URL: https://issues.apache.org/jira/browse/FLINK-27601 Project: Flink Issue Type:

Re: [DISCUSS] FLIP-224: Blacklist Mechanism

2022-05-13 Thread Lijie Wang
Hi everyone, I've had an offline discussion with Becket Qin and Zhu Zhu, and made the following changes on REST API: 1. To avoid ambiguity, *timeout* and *endTimestamp* can only choose one. If both are specified, will return error. 2. If the specified item is already there, the *ADD* operation

Re: Split string flatmap -> Arraylist/List

2022-05-13 Thread Alexander Preuß
Hi Zain, There are different options to achieve this. You can take a look at the WordCount example [1] to get some inspiration. [1] https://github.com/apache/flink/blob/master/flink-examples/flink-examples-streaming/src/main/java/org/apache/flink/streaming/examples/wordcount/WordCount.java Best

[jira] [Created] (FLINK-27600) Add basic logs for coping and deleting jars

2022-05-13 Thread Xin Hao (Jira)
Xin Hao created FLINK-27600: --- Summary: Add basic logs for coping and deleting jars Key: FLINK-27600 URL: https://issues.apache.org/jira/browse/FLINK-27600 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-27599) Setup flink-connector-rabbitmq repository

2022-05-13 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-27599: -- Summary: Setup flink-connector-rabbitmq repository Key: FLINK-27599 URL: https://issues.apache.org/jira/browse/FLINK-27599 Project: Flink Issue Type:

[jira] [Created] (FLINK-27598) Improve the exception message when mixing use Python UDF and Pandas UDF

2022-05-13 Thread Dian Fu (Jira)
Dian Fu created FLINK-27598: --- Summary: Improve the exception message when mixing use Python UDF and Pandas UDF Key: FLINK-27598 URL: https://issues.apache.org/jira/browse/FLINK-27598 Project: Flink