Re: [VOTE] Drop Gelly

2022-10-17 Thread Dong Lin
+1 On Thu, Oct 13, 2022 at 4:59 AM Martijn Visser wrote: > Hi everyone, > > I would like to open a vote for dropping Gelly, which was discussed a long > time ago but never put to a vote [1]. > > Voting will be open for at least 72 hours. > > Best regards, > > Martijn >

[jira] [Created] (FLINK-29674) Apache Kafka 连接器的“ setBounded”不生效

2022-10-17 Thread jiangwei (Jira)
jiangwei created FLINK-29674: Summary: Apache Kafka 连接器的“ setBounded”不生效 Key: FLINK-29674 URL: https://issues.apache.org/jira/browse/FLINK-29674 Project: Flink Issue Type: Bug

Re: SplitEnumerator for Bigquery Source.

2022-10-17 Thread yuxia
I'm familiar with Hive source but have no much knowledge about Bigquery. But from my side, the apprach number three sounds more reasonable. option1 sounds a llitte of complex and may time-counsuming during generateing splits . option2 seems isnot flexible and is too coarse-grained. option4 need

[jira] [Created] (FLINK-29673) Support sqlserver catalog

2022-10-17 Thread waywtdcc (Jira)
waywtdcc created FLINK-29673: Summary: Support sqlserver catalog Key: FLINK-29673 URL: https://issues.apache.org/jira/browse/FLINK-29673 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-29672) Support oracle catalog

2022-10-17 Thread waywtdcc (Jira)
waywtdcc created FLINK-29672: Summary: Support oracle catalog Key: FLINK-29672 URL: https://issues.apache.org/jira/browse/FLINK-29672 Project: Flink Issue Type: Improvement

Re: Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-17 Thread Steven Wu
I was one of the maintainers for the Flink Iceberg connector in Iceberg repo. I can volunteer as one of the initial maintainers if we decide to move forward. On Mon, Oct 17, 2022 at 3:26 PM wrote: > Hi Martijn, > > Yes, It is considered a connector in Flink terms. > > We wanted to join the

RE: Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-17 Thread abmo . work
Hi Martijn, Yes, It is considered a connector in Flink terms. We wanted to join the Flink connector externalization effort so that we can bring the Iceberg connector closer to the Flink community. We are hoping any issues with the APIs for Iceberg connector will surface sooner and get more

Re: [Discuss]- Donate Iceberg Flink Connector

2022-10-17 Thread Péter Váry
Hi all, I think the main advantage of having the Flink-Iceberg connector in its own repo is that we could release it independently of both the Iceberg and Flink releases. Previously having the Flink connector in the Iceberg repo made sense, since the Iceberg project was rapidly moving forward

[jira] [Created] (FLINK-29671) Kubernetes e2e test fails during test initialization

2022-10-17 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-29671: - Summary: Kubernetes e2e test fails during test initialization Key: FLINK-29671 URL: https://issues.apache.org/jira/browse/FLINK-29671 Project: Flink Issue

[jira] [Created] (FLINK-29670) Add CRD compatibility check against 1.2.0

2022-10-17 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-29670: -- Summary: Add CRD compatibility check against 1.2.0 Key: FLINK-29670 URL: https://issues.apache.org/jira/browse/FLINK-29670 Project: Flink Issue Type:

SplitEnumerator for Bigquery Source.

2022-10-17 Thread Lavkesh Lahngir
Hii Everybody, we are trying to implement a google bigquery source on flink. We were thinking of taking time partition and column information as config. I was thinking of how to parallelize the source and how to generate splits. I read the code of Hive source, where we could generate hadoop file

Re: [DISCUSS] FLIP-263: Improve resolving schema compatibility

2022-10-17 Thread Dawid Wysakowicz
Hi Han, I think in principle your proposal makes sense and the compatibility check indeed should be done in the opposite direction. However, I have two suggestions: 1. Should we introduce the new method to the TypeSerializerSnapshot instead? E.g.    TypeSerializerSnapshot {       

Re: [VOTE] FLIP-265 Deprecate and remove Scala API support

2022-10-17 Thread Márton Balassi
+1 (binding) On Mon, Oct 17, 2022 at 3:39 PM Martijn Visser wrote: > Hi everyone, > > I'm hereby opening a vote for FLIP-265 Deprecate and remove Scala API > support. The related discussion can be found here [1]. > > Voting will be open for at least 72 hours. > > Best regards, > > Martijn >

[VOTE] FLIP-265 Deprecate and remove Scala API support

2022-10-17 Thread Martijn Visser
Hi everyone, I'm hereby opening a vote for FLIP-265 Deprecate and remove Scala API support. The related discussion can be found here [1]. Voting will be open for at least 72 hours. Best regards, Martijn https://twitter.com/MartijnVisser82 https://github.com/MartijnVisser [1]

[jira] [Created] (FLINK-29669) Remove HCatalog

2022-10-17 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-29669: -- Summary: Remove HCatalog Key: FLINK-29669 URL: https://issues.apache.org/jira/browse/FLINK-29669 Project: Flink Issue Type: Technical Debt

[RESULT][VOTE] Remove HCatalog

2022-10-17 Thread Martijn Visser
Hi everyone, Happy to announce that the vote to remove HCatalog has passed [1] +1 votes: - Jingsong Li (binding) - Hang Ruan (non-binding) - yuxia (non-binding) - Gyula Fóra (binding) - Leonard Xu (binding) - Qingsheng Ren (binding) - Sergey Nuyanzin (non-binding) - Chesnay Schepler (binding) -

[jira] [Created] (FLINK-29668) Remove Gelly

2022-10-17 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-29668: -- Summary: Remove Gelly Key: FLINK-29668 URL: https://issues.apache.org/jira/browse/FLINK-29668 Project: Flink Issue Type: Technical Debt

[RESULT][VOTE] Drop Gelly

2022-10-17 Thread Martijn Visser
Hi everyone, Happy to announce that the vote to drop Gelly has passed [1]. +1 Votes: - Yun Gao (binding) - Gyula Fóra (binding) - Niels Basjes (binding) - Konstantin Knauf (binding) - Maximilian Michels (binding) - Yu Li (binding) - Sergey Nuyanzin (non-binding) - Yun Tang (binding) Best

Re: [VOTE] Externalized connector release details​

2022-10-17 Thread Chesnay Schepler
https://cwiki.apache.org/confluence/display/FLINK/Externalized+Connector+development On 17/10/2022 13:13, Chesnay Schepler wrote: The vote has passed unanimously. +1 Votes: - Danny (binding) - Martijn (binding) - Ferenc (non-binding) - Thomas (binding) - Ryan (non-binding) - Jing (non-binding)

[jira] [Created] (FLINK-29667) Upgrade DynamoDB Connector dependencies from SNAPSHOT to release 1.16

2022-10-17 Thread Daren Wong (Jira)
Daren Wong created FLINK-29667: -- Summary: Upgrade DynamoDB Connector dependencies from SNAPSHOT to release 1.16 Key: FLINK-29667 URL: https://issues.apache.org/jira/browse/FLINK-29667 Project: Flink

[jira] [Created] (FLINK-29666) Let adaptive batch scheduler divide subpartition range according to amount of data

2022-10-17 Thread Lijie Wang (Jira)
Lijie Wang created FLINK-29666: -- Summary: Let adaptive batch scheduler divide subpartition range according to amount of data Key: FLINK-29666 URL: https://issues.apache.org/jira/browse/FLINK-29666

[jira] [Created] (FLINK-29665) Support flexible subpartition range divisions

2022-10-17 Thread Lijie Wang (Jira)
Lijie Wang created FLINK-29665: -- Summary: Support flexible subpartition range divisions Key: FLINK-29665 URL: https://issues.apache.org/jira/browse/FLINK-29665 Project: Flink Issue Type:

[jira] [Created] (FLINK-29664) Collect subpartition sizes of BLOCKING result partitions

2022-10-17 Thread Lijie Wang (Jira)
Lijie Wang created FLINK-29664: -- Summary: Collect subpartition sizes of BLOCKING result partitions Key: FLINK-29664 URL: https://issues.apache.org/jira/browse/FLINK-29664 Project: Flink Issue

[jira] [Created] (FLINK-29663) Further improvements of adaptive batch scheduler

2022-10-17 Thread Lijie Wang (Jira)
Lijie Wang created FLINK-29663: -- Summary: Further improvements of adaptive batch scheduler Key: FLINK-29663 URL: https://issues.apache.org/jira/browse/FLINK-29663 Project: Flink Issue Type:

[jira] [Created] (FLINK-29662) PojoSerializerSnapshot is using incorrect ExecutionConfig when restoring serializer

2022-10-17 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-29662: -- Summary: PojoSerializerSnapshot is using incorrect ExecutionConfig when restoring serializer Key: FLINK-29662 URL: https://issues.apache.org/jira/browse/FLINK-29662

Re: [VOTE] Externalized connector release details​

2022-10-17 Thread Chesnay Schepler
The vote has passed unanimously. +1 Votes: - Danny (binding) - Martijn (binding) - Ferenc (non-binding) - Thomas (binding) - Ryan (non-binding) - Jing (non-binding) - Matthias (binding) I will now document this in the wiki and start working on the release scripts. On 12/10/2022 15:12,

[jira] [Created] (FLINK-29661) DatabaseCalciteSchema$getTable() cannot get statistics for partition table

2022-10-17 Thread Yunhong Zheng (Jira)
Yunhong Zheng created FLINK-29661: - Summary: DatabaseCalciteSchema$getTable() cannot get statistics for partition table Key: FLINK-29661 URL: https://issues.apache.org/jira/browse/FLINK-29661

[jira] [Created] (FLINK-29660) Show all attempts of subtasks in WebUI

2022-10-17 Thread LI Mingkun (Jira)
LI Mingkun created FLINK-29660: -- Summary: Show all attempts of subtasks in WebUI Key: FLINK-29660 URL: https://issues.apache.org/jira/browse/FLINK-29660 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-29659) Deduplicate SavepointWriter factory method code

2022-10-17 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-29659: Summary: Deduplicate SavepointWriter factory method code Key: FLINK-29659 URL: https://issues.apache.org/jira/browse/FLINK-29659 Project: Flink

[jira] [Created] (FLINK-29658) LocalTimeTypeInfo support in DataStream API in PyFlink

2022-10-17 Thread Juntao Hu (Jira)
Juntao Hu created FLINK-29658: - Summary: LocalTimeTypeInfo support in DataStream API in PyFlink Key: FLINK-29658 URL: https://issues.apache.org/jira/browse/FLINK-29658 Project: Flink Issue Type:

Re: [VOTE] Reverting sink metric name changes made in 1.15

2022-10-17 Thread Yun Tang
+1 and thanks for Qingsheng's driving. BTW, shall we consider to create a ticket to ensure backward compatibility of the metric names? Best, Yun Tang From: Jing Ge Sent: Friday, October 14, 2022 16:55 To: dev@flink.apache.org Cc: Chesnay Schepler Subject:

Re: [VOTE] Drop Gelly

2022-10-17 Thread Yun Tang
+1 for dropping Gelly as a prerequisite for dropping deprecated DataSet API. Apart from asking contributors to join the flink-ML development, I'm not sure whether some old repo [1], which is already based on Flink's DataStream API, also wants to join the migration guide. cc @Vasia [1]

Re: [DISCUSS] Changing the minimal supported version of Hadoop to 2.10.2

2022-10-17 Thread Márton Balassi
Hi Martjin, +1 for 2.10.2. Do you expect to have bandwidth in the near term to implement the bump? On Wed, Oct 5, 2022 at 5:00 PM Gabor Somogyi wrote: > Hi Martin, > > Thanks for bringing this up! Lately I was thinking about to bump the hadoop > version to at least 2.6.1 to clean up issues

[jira] [Created] (FLINK-29657) Hive SQL

2022-10-17 Thread Runkang He (Jira)
Runkang He created FLINK-29657: -- Summary: Hive SQL Key: FLINK-29657 URL: https://issues.apache.org/jira/browse/FLINK-29657 Project: Flink Issue Type: Sub-task Reporter: Runkang He

[jira] [Created] (FLINK-29656) Modify all join-related sql tests to make having statistics as the default choice

2022-10-17 Thread Yunhong Zheng (Jira)
Yunhong Zheng created FLINK-29656: - Summary: Modify all join-related sql tests to make having statistics as the default choice Key: FLINK-29656 URL: https://issues.apache.org/jira/browse/FLINK-29656

[jira] [Created] (FLINK-29655) Split Flink CRD from flink-kubernates-operator module

2022-10-17 Thread Zhenqiu Huang (Jira)
Zhenqiu Huang created FLINK-29655: - Summary: Split Flink CRD from flink-kubernates-operator module Key: FLINK-29655 URL: https://issues.apache.org/jira/browse/FLINK-29655 Project: Flink

Re: [VOTE] Drop Gelly

2022-10-17 Thread Sergey Nuyanzin
+1 (non-binding) On Mon, Oct 17, 2022 at 5:50 AM Yun Gao wrote: > Hi Yu, > Very thanks for the suggestions and I also strongly > agree with that. Perhaps we could update the Gelly > documentation pages to also express the information. > Best, > Yun Gao >