[jira] [Created] (FLINK-22844) Add doc to introduce ExplainDetails for EXPLAIN sytnax

WeiNan Zhao created FLINK-22844: --- Summary: Add doc to introduce ExplainDetails for EXPLAIN sytnax Key: FLINK-22844 URL: https://issues.apache.org/jira/browse/FLINK-22844 Project: Flink Issue

[jira] [Created] (FLINK-22843) Document and code are inconsistent.

xiaozilong created FLINK-22843: -- Summary: Document and code are inconsistent. Key: FLINK-22843 URL: https://issues.apache.org/jira/browse/FLINK-22843 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-22842) Streaming File Sink end-to-end test fail due to not finish after 900s

Xintong Song created FLINK-22842: Summary: Streaming File Sink end-to-end test fail due to not finish after 900s Key: FLINK-22842 URL: https://issues.apache.org/jira/browse/FLINK-22842 Project: Flink

[jira] [Created] (FLINK-22841) how to update configuration of the native kubernetes deployment model flink cluster?

lukehua created FLINK-22841: --- Summary: how to update configuration of the native kubernetes deployment model flink cluster? Key: FLINK-22841 URL: https://issues.apache.org/jira/browse/FLINK-22841 Project:

[jira] [Created] (FLINK-22839) Assign-evenly kafkaTopicPartitions of multiple topics to flinkKafkaConsumer subtask

Xu xiaolong created FLINK-22839: --- Summary: Assign-evenly kafkaTopicPartitions of multiple topics to flinkKafkaConsumer subtask Key: FLINK-22839 URL: https://issues.apache.org/jira/browse/FLINK-22839

[jira] [Created] (FLINK-22840) Assign-evenly kafkaTopicPartitions of multiple topics to flinkKafkaConsumer subtask

Xu xiaolong created FLINK-22840: --- Summary: Assign-evenly kafkaTopicPartitions of multiple topics to flinkKafkaConsumer subtask Key: FLINK-22840 URL: https://issues.apache.org/jira/browse/FLINK-22840

Re: [DISCUSS][Statebackend][Runtime] Changelog Statebackend Configuration Proposal

Hi Yuan, thanks for launching this discussion. I prefer option-3 as this is the easiest to understand for users. Best Yun Tang From: Roman Khachatryan Sent: Monday, May 31, 2021 16:53 To: dev Subject: Re: [DISCUSS][Statebackend][Runtime] Changelog Statebackend

[jira] [Created] (FLINK-22838) Flink Dashboard display incorrect Version in 1.13，actual display 1.12.2

Gao Fei created FLINK-22838: --- Summary: Flink Dashboard display incorrect Version in 1.13，actual display 1.12.2 Key: FLINK-22838 URL: https://issues.apache.org/jira/browse/FLINK-22838 Project: Flink

[jira] [Created] (FLINK-22837) Assign-evenly kafkaTopicPartitions of multiple topics to flinkKafkaConsumer subtask

Xu xiaolong created FLINK-22837: --- Summary: Assign-evenly kafkaTopicPartitions of multiple topics to flinkKafkaConsumer subtask Key: FLINK-22837 URL: https://issues.apache.org/jira/browse/FLINK-22837

[jira] [Created] (FLINK-22836) OffsetsInitializerTest.testTimestampOffsetsInitializer fails on azure

Xintong Song created FLINK-22836: Summary: OffsetsInitializerTest.testTimestampOffsetsInitializer fails on azure Key: FLINK-22836 URL: https://issues.apache.org/jira/browse/FLINK-22836 Project: Flink

Re: [DISCUSS]FLIP-150: Introduce Hybrid Source

discussed the PR with Thosmas offline. Thomas, please correct me if I missed anything. Right now, the PR differs from the FLIP-150 doc regarding the converter. * Current PR uses the enumerator checkpoint state type as the input for the converter * FLIP-150 defines a new EndStateT interface. It

[VOTE] Watermark propagation with Sink API

After some good discussion about how to enhance the Sink API to process watermarks, I believe we're ready to proceed with a vote. Voting will be open until at least Friday, June 4th, 2021. Reference: https://cwiki.apache.org/confluence/display/FLINK/FLIP-167%3A+Watermarks+for+Sink+API

[jira] [Created] (FLINK-22835) ChangelogStateBackend tests use nested backend on recovery

Roman Khachatryan created FLINK-22835: - Summary: ChangelogStateBackend tests use nested backend on recovery Key: FLINK-22835 URL: https://issues.apache.org/jira/browse/FLINK-22835 Project: Flink

Re: The partition tracker should support remote shuffle properly

Hi, Till ~ Thanks for your comments. Yes, I think we are on the same page – we are discussing how should JMPartitionTracker manage partitions properly ~ > If the ShuffleMaster should lose a result partition, then a reading task should fail with a PartitionException which will invalidate the

[jira] [Created] (FLINK-22834) KafkaITCase.testBigRecordJob times out on azure

Dawid Wysakowicz created FLINK-22834: Summary: KafkaITCase.testBigRecordJob times out on azure Key: FLINK-22834 URL: https://issues.apache.org/jira/browse/FLINK-22834 Project: Flink

[jira] [Created] (FLINK-22833) Source tasks (both old and new) are not reporting checkpointStartDelay via CheckpointMetrics

Piotr Nowojski created FLINK-22833: -- Summary: Source tasks (both old and new) are not reporting checkpointStartDelay via CheckpointMetrics Key: FLINK-22833 URL: https://issues.apache.org/jira/browse/FLINK-22833

Re: recover from svaepoint

The error message says that we are trying to reuse a transaction id that is currently being used or has expired. I am not 100% sure how this can happen. My suspicion is that you have resumed a job multiple times from the same savepoint. Have you checked that there is no other job which has been

Re: Getting Abstract method Error with flink 1.13.0 and 1.12.0

Thanks Till will do so ... On Tuesday, June 1, 2021, 06:22:32 PM GMT+5:30, Till Rohrmann wrote: Hi Dipanjan, this type of question is best sent to Flink's user mailing list because there are a lot more people using Flink who could help you. The dev mailing list is intended to be used

[jira] [Created] (FLINK-22832) Drop usages of legacy planner in SQL Client

Timo Walther created FLINK-22832: Summary: Drop usages of legacy planner in SQL Client Key: FLINK-22832 URL: https://issues.apache.org/jira/browse/FLINK-22832 Project: Flink Issue Type:

Re: Getting Abstract method Error with flink 1.13.0 and 1.12.0

Hi Dipanjan, this type of question is best sent to Flink's user mailing list because there are a lot more people using Flink who could help you. The dev mailing list is intended to be used for development discussions. Cheers, Till On Tue, Jun 1, 2021 at 1:31 PM Dipanjan Mazumder wrote: > Hi ,

[jira] [Created] (FLINK-22831) Drop usages of legacy planner in Scala shell

Timo Walther created FLINK-22831: Summary: Drop usages of legacy planner in Scala shell Key: FLINK-22831 URL: https://issues.apache.org/jira/browse/FLINK-22831 Project: Flink Issue Type:

[jira] [Created] (FLINK-22830) DataSet API to allow to collect and do the bulk upload in DB

Ravi created FLINK-22830: Summary: DataSet API to allow to collect and do the bulk upload in DB Key: FLINK-22830 URL: https://issues.apache.org/jira/browse/FLINK-22830 Project: Flink Issue Type:

Getting Abstract method Error with flink 1.13.0 and 1.12.0

Hi ,    I have integrated flink-siddhi library ([com.github.haoch/flink-siddhi_2.11 "0.2.2-SNAPSHOT"]) and i tried to configure and implement control stream from flink-siddh and it broke with AbstractMethodError. When i tried running the same with flink 1.11.0 it worked. More Details is given

Re: How to use or configure flink checkpointing with siddhi internal state

Hi Till,     Thanks so that means it should work will try and see .. RegardsDipanjan On Tuesday, June 1, 2021, 01:48:19 PM GMT+5:30, Till Rohrmann wrote: Hi Dipanjan, I am assuming that you are using the flink-siddhi library [1]. I am not an expert but it looks as if the

[jira] [Created] (FLINK-22829) Drop usages of legacy planner in Hbase modules

Timo Walther created FLINK-22829: Summary: Drop usages of legacy planner in Hbase modules Key: FLINK-22829 URL: https://issues.apache.org/jira/browse/FLINK-22829 Project: Flink Issue Type:

Re: [DISCUSS] SQL CTAS Syntax

Thanks Danny for starting the discussion. +1 for this feature. I like schema evolution. A question: Can we support multiple pipelines? For example, I have three source tables and just one sink table. So, I will write three CTAS: - CTAS IF NOT EXISTS 1 - CTAS IF NOT EXISTS 2 - CTAS IF NOT

[jira] [Created] (FLINK-22828) Allow using a custom AWS credentials provider for the Kinesis Connector

Arvid Heise created FLINK-22828: --- Summary: Allow using a custom AWS credentials provider for the Kinesis Connector Key: FLINK-22828 URL: https://issues.apache.org/jira/browse/FLINK-22828 Project: Flink

Re: [DISCUSS] Dashboard/HistoryServer authentication

There's a related effort: https://issues.apache.org/jira/browse/FLINK-21108 On 6/1/2021 10:14 AM, Till Rohrmann wrote: Hi Gabor, welcome to the Flink community! Thanks for sharing this proposal with the community Márton. In general, I agree that authentication is missing and that this is

[jira] [Created] (FLINK-22827) Hive CREATE TABLE Support CLUSTERED BY

Ma Jun created FLINK-22827: -- Summary: Hive CREATE TABLE Support CLUSTERED BY Key: FLINK-22827 URL: https://issues.apache.org/jira/browse/FLINK-22827 Project: Flink Issue Type: New Feature

Re: The partition tracker should support remote shuffle properly

Hi Jin, thanks for starting this discussion and the initiative to implement a remote shuffle service. It has always been the idea of the ShuffleService abstraction to make this possible and we probably have overlooked some details. What I have understood from your description, you would like to

[jira] [Created] (FLINK-22826) link sql1.13.1基于change log流数据join导致数据丢失

徐州州 created FLINK-22826: --- Summary: link sql1.13.1基于change log流数据join导致数据丢失 Key: FLINK-22826 URL: https://issues.apache.org/jira/browse/FLINK-22826 Project: Flink Issue Type: Bug Components:

[jira] [Created] (FLINK-22825) link sql1.13.1基于change log流数据join导致数据丢失

徐州州 created FLINK-22825: --- Summary: link sql1.13.1基于change log流数据join导致数据丢失 Key: FLINK-22825 URL: https://issues.apache.org/jira/browse/FLINK-22825 Project: Flink Issue Type: Bug Components:

[jira] [Created] (FLINK-22824) Drop usages of legacy planner in Kafka modules

Timo Walther created FLINK-22824: Summary: Drop usages of legacy planner in Kafka modules Key: FLINK-22824 URL: https://issues.apache.org/jira/browse/FLINK-22824 Project: Flink Issue Type:

[jira] [Created] (FLINK-22823) Add Basic and SPNEGO authentication support

Gabor Somogyi created FLINK-22823: - Summary: Add Basic and SPNEGO authentication support Key: FLINK-22823 URL: https://issues.apache.org/jira/browse/FLINK-22823 Project: Flink Issue Type:

Re: How to use or configure flink checkpointing with siddhi internal state

Hi Dipanjan, I am assuming that you are using the flink-siddhi library [1]. I am not an expert but it looks as if the AbstractSiddhiOperator overrides the snapshotState [2] method to store the Siddhi state in Flink. [1] https://github.com/haoch/flink-siddhi [2]

Re: [DISCUSS] Dashboard/HistoryServer authentication

Hi Gabor, welcome to the Flink community! Thanks for sharing this proposal with the community Márton. In general, I agree that authentication is missing and that this is required for using Flink within an enterprise. The thing I am wondering is whether this feature strictly needs to be

[jira] [Created] (FLINK-22822) Drop usages of legacy planner in JDBC module

Timo Walther created FLINK-22822: Summary: Drop usages of legacy planner in JDBC module Key: FLINK-22822 URL: https://issues.apache.org/jira/browse/FLINK-22822 Project: Flink Issue Type:

[jira] [Created] (FLINK-22821) FlinkKafkaProducerMigrationTest fails with "Address already in use"

Dawid Wysakowicz created FLINK-22821: Summary: FlinkKafkaProducerMigrationTest fails with "Address already in use" Key: FLINK-22821 URL: https://issues.apache.org/jira/browse/FLINK-22821 Project:

[jira] [Created] (FLINK-22820) Stopping Yarn session cluster will cause fatal error

Yang Wang created FLINK-22820: - Summary: Stopping Yarn session cluster will cause fatal error Key: FLINK-22820 URL: https://issues.apache.org/jira/browse/FLINK-22820 Project: Flink Issue Type:

[jira] [Created] (FLINK-22819) YARNFileReplicationITCase fails with "The YARN application unexpectedly switched to state FAILED during deployment"

Dawid Wysakowicz created FLINK-22819: Summary: YARNFileReplicationITCase fails with "The YARN application unexpectedly switched to state FAILED during deployment" Key: FLINK-22819 URL:

[jira] [Created] (FLINK-22818) IgnoreInFlightDataITCase fails on azure

Dawid Wysakowicz created FLINK-22818: Summary: IgnoreInFlightDataITCase fails on azure Key: FLINK-22818 URL: https://issues.apache.org/jira/browse/FLINK-22818 Project: Flink Issue Type:

[jira] [Created] (FLINK-22817) About flink1.13 hive integration Kafka SQL

xingyuan cheng created FLINK-22817: -- Summary: About flink1.13 hive integration Kafka SQL Key: FLINK-22817 URL: https://issues.apache.org/jira/browse/FLINK-22817 Project: Flink Issue Type: