[jira] [Created] (FLINK-30094) Flink Table Sotre's Lookup Join document may needs left table DDL example.

2022-11-18 Thread Hang HOU (Jira)
Hang HOU created FLINK-30094: Summary: Flink Table Sotre's Lookup Join document may needs left table DDL example. Key: FLINK-30094 URL: https://issues.apache.org/jira/browse/FLINK-30094 Project: Flink

Re: [DISCUSS]Introduce a time-segment based restart strategy

2022-11-18 Thread Dong Lin
Hey Weihua, Thanks for proposing the new strategy! If I understand correctly, the main issue is that different failover regions can be restarted independently, but they share the same counter when counting the number of failures in an interval. So the number of failures for a given region is

Re: Re: [DISCUSS] FLIP-269: Properly Handling the Processing Timers on Job Termination

2022-11-18 Thread Divye Kapoor
Hi Folks, I raised the initial issue with Yun and others (apologies for the long email below, I promise it's worth the read). Speaking as someone who has hit this issue in a practical way, Dawid's first solution is the simplest and easiest way to fix the problem without introducing additional

Re: Could not connect Amazon S3 file system with different creds at runtime.

2022-11-18 Thread Martijn Visser
Hi, Like I mentioned in Stackoverflow, it's currently not possible. See https://issues.apache.org/jira/browse/FLINK-19589 Best regards, Martijn On Fri, Nov 18, 2022 at 8:13 PM kursat kursatkurt.com wrote: > Hi; > > > > I am new to Flink development. > > Is there any way to set S3 credentials

Could not connect Amazon S3 file system with different creds at runtime.

2022-11-18 Thread kursat kursatkurt . com
Hi; I am new to Flink development. Is there any way to set S3 credentials at runtime? How can we connect 3 or more different s3 buckets (with different creds)? Lets say you have 3 csv file on AWS S3, and you want to join them with their id fields. How can we do this? I don't want to use

[jira] [Created] (FLINK-30093) [Flink SQL][Protobuf] CompileException when querying Kafka topic using google.protobuf.Timestamp

2022-11-18 Thread James Mcguire (Jira)
James Mcguire created FLINK-30093: - Summary: [Flink SQL][Protobuf] CompileException when querying Kafka topic using google.protobuf.Timestamp Key: FLINK-30093 URL:

[jira] [Created] (FLINK-30092) Improve Table API experience for Flink DOUBLE type

2022-11-18 Thread Hong Liang Teoh (Jira)
Hong Liang Teoh created FLINK-30092: --- Summary: Improve Table API experience for Flink DOUBLE type Key: FLINK-30092 URL: https://issues.apache.org/jira/browse/FLINK-30092 Project: Flink

[jira] [Created] (FLINK-30091) mvn package verify fails with "Error creating shaded jar: duplicate entry"

2022-11-18 Thread Alex Sorokoumov (Jira)
Alex Sorokoumov created FLINK-30091: --- Summary: mvn package verify fails with "Error creating shaded jar: duplicate entry" Key: FLINK-30091 URL: https://issues.apache.org/jira/browse/FLINK-30091

[jira] [Created] (FLINK-30090) Support timespan for TimerGauges

2022-11-18 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-30090: -- Summary: Support timespan for TimerGauges Key: FLINK-30090 URL: https://issues.apache.org/jira/browse/FLINK-30090 Project: Flink Issue Type: Improvement

Re: [VOTE] FLIP-272: Generalized delegation token support

2022-11-18 Thread Márton Balassi
+1 (binding) On Thu, Nov 17, 2022 at 9:06 AM Gabor Somogyi wrote: > Hi All, > > I'm hereby opening a vote for FLIP-272 Generalized delegation token > support. > The related documents can be found here: > - FLIP on wiki: [1] > - Discussion thread: [2] > > Voting will be open for at least 72

Re: Env Vars in the Flink Web UI

2022-11-18 Thread Danny Cranmer
+1 for d) don't print any env vars in the web UI In the longer term, instead of a flag to hide/show certain variables, I would be more inclined to move towards role based access for the Flink dashboard. Thanks, On Wed, Nov 16, 2022 at 10:22 PM Thomas Weise wrote: > +1 for d) don't print any

[jira] [Created] (FLINK-30089) Remove dependency promotion from kinesis connector

2022-11-18 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-30089: Summary: Remove dependency promotion from kinesis connector Key: FLINK-30089 URL: https://issues.apache.org/jira/browse/FLINK-30089 Project: Flink

[jira] [Created] (FLINK-30088) Excessive state updates for TtlMapState and TtlListState

2022-11-18 Thread Roman Boyko (Jira)
Roman Boyko created FLINK-30088: --- Summary: Excessive state updates for TtlMapState and TtlListState Key: FLINK-30088 URL: https://issues.apache.org/jira/browse/FLINK-30088 Project: Flink Issue

[jira] [Created] (FLINK-30087) sql-gateway-api is bundled twice in the distribution

2022-11-18 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-30087: Summary: sql-gateway-api is bundled twice in the distribution Key: FLINK-30087 URL: https://issues.apache.org/jira/browse/FLINK-30087 Project: Flink

Re: [DISCUSS] FLIP-271: Autoscaling

2022-11-18 Thread Dong Lin
Hi Gyula! Thanks for all the explanations! Personally, I would like to see a full story of how the algorithm works (e.g. how it determines the estimated time for scale), how users can get the basic information needed to monitor the health/effectiveness of autoscaler (e.g. metrics), and how the

[jira] [Created] (FLINK-30086) Include classifier in DependencyTree tree

2022-11-18 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-30086: Summary: Include classifier in DependencyTree tree Key: FLINK-30086 URL: https://issues.apache.org/jira/browse/FLINK-30086 Project: Flink Issue

Re: [DISCUSS] FLIP-271: Autoscaling

2022-11-18 Thread Gyula Fóra
Hi Dong! Could you please confirm that your main concerns have been addressed? Some other minor details that might not have been fully clarified: - The prototype has been validated on some production workloads yes - We are only planning to use metrics that are generally available and are

[jira] [Created] (FLINK-30085) JVM hanging after executing YARNSessionCapacitySchedulerITCase.testNonexistingQueueWARNmessage

2022-11-18 Thread Gabor Somogyi (Jira)
Gabor Somogyi created FLINK-30085: - Summary: JVM hanging after executing YARNSessionCapacitySchedulerITCase.testNonexistingQueueWARNmessage Key: FLINK-30085 URL: https://issues.apache.org/jira/browse/FLINK-30085

[jira] [Created] (FLINK-30084) Remove unused ResourceActions.notifyAllocationFailure

2022-11-18 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-30084: - Summary: Remove unused ResourceActions.notifyAllocationFailure Key: FLINK-30084 URL: https://issues.apache.org/jira/browse/FLINK-30084 Project: Flink Issue Type:

[jira] [Created] (FLINK-30083) Bump maven-shade-plugin to 3.4.0

2022-11-18 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-30083: -- Summary: Bump maven-shade-plugin to 3.4.0 Key: FLINK-30083 URL: https://issues.apache.org/jira/browse/FLINK-30083 Project: Flink Issue Type: Improvement