Re: [VOTE] FLIP-447: Upgrade FRocksDB from 6.20.3 to 8.10.0

+1 (binding) This will be a good addition. G On Mon, May 6, 2024 at 4:54 AM yue ma wrote: > Hi everyone, > > Thanks for all the feedback, I'd like to start a vote on the FLIP-447: > Upgrade FRocksDB from 6.20.3 to 8.10.0 [1]. The discussion thread is here > [2]. > > The vote will be open for

Re: [VOTE] FLIP-439: Externalize Kudu Connector from Bahir

+1 (binding) G On Wed, Mar 20, 2024 at 3:59 PM Gyula Fóra wrote: > +1 (binding) > > Thanks! > Gyula > > On Wed, Mar 20, 2024 at 3:36 PM Mate Czagany wrote: > > > +1 (non-binding) > > > > Thank you, > > Mate > > > > Ferenc Csaky ezt írta (időpont: 2024. márc. > > 20., Sze, 15:11): > > > > >

[jira] [Created] (FLINK-34574) Add CPU and memory size autoscaler quota

Gabor Somogyi created FLINK-34574: - Summary: Add CPU and memory size autoscaler quota Key: FLINK-34574 URL: https://issues.apache.org/jira/browse/FLINK-34574 Project: Flink Issue Type: New

[jira] [Created] (FLINK-34198) Remove e2e test operator log error check

Gabor Somogyi created FLINK-34198: - Summary: Remove e2e test operator log error check Key: FLINK-34198 URL: https://issues.apache.org/jira/browse/FLINK-34198 Project: Flink Issue Type

Re: [VOTE] FLIP-372: Allow TwoPhaseCommittingSink WithPreCommitTopology to alter the type of the Committable

+1 (binding) G On Mon, Dec 18, 2023 at 9:34 AM Péter Váry wrote: > Hi everyone, > > Since there were no further comments on the discussion thread [1], I would > like to start the vote for FLIP-372 [2]. > > The FLIP started as a small new feature, but in the discussion thread and > in a

[RESULT][VOTE] FLIP-401: REST API JSON response deserialization unknown field tolerance

Hi All, FLIP-401: REST API JSON response deserialization unknown field tolerance [1] has been accepted and voted through this thread [2]. The proposal received 4 binding approval votes and there is no disapproval: - Gyula Fora (binding) - Mátyás Őrhidi (binding) - Peter Huang (non-binding) -

Re: [DISCUSS] FLIP-401: REST API JSON response deserialization unknown field tolerance

Fóra wrote: > > > Thanks Gabor! > > > > +1 from my side, this sounds like a reasonable change that will > > improve integration and backward compatibility. > > > > Let's keep this open for at least another day before starting the vote. > > > >

[VOTE] FLIP-401: REST API JSON response deserialization unknown field tolerance

Hi All, I'd like to start a vote on FLIP-401: REST API JSON response deserialization unknown field tolerance [1] which has been discussed in this thread [2]. The vote will be open for at least 72 hours unless there is an objection or not enough votes. BR, G [1]

[DISCUSS] FLIP-401: REST API JSON response deserialization unknown field tolerance

Hi All, I'd like to start a discussion of FLIP-401: REST API JSON response deserialization unknown field tolerance[1]. *Problem statement:* At the moment Flink is not ignoring unknown fields when parsing REST responses. An example for such a class is *JobDetailsInfo* but this applies to all

Re: [DISCUSS] REST API response parsing throws exception on new fields

Switching to the new thread... G On Thu, Dec 7, 2023 at 10:25 AM Gyula Fóra wrote: > You should start a new discussion thread according to the FLIP guidelines, > so that it's identifiable that this is a FLIP discussion. > > Gyula > > On Thu, Dec 7, 2023 at 10:22 AM Gabo

Re: [DISCUSS] REST API response parsing throws exception on new fields

ly warrants a FLIP and a proper vote. > > Cheers, > Gyula > > On Wed, Dec 6, 2023 at 10:53 AM Gabor Somogyi > wrote: > > > Hi All, > > > > Since the possible solution can have effect on all the REST response > > deserialization I would like > >

[DISCUSS] REST API response parsing throws exception on new fields

Hi All, Since the possible solution can have effect on all the REST response deserialization I would like ask for opinions. *Problem statement:* At the moment Flink is not ignoring unknown fields when parsing REST responses. An example for such a class is JobDetailsInfo but this applies to all

Re: Python connector question

Hi Peter, Thanks for picking this up! Please find my thoughts inline. BR, G On Mon, Nov 27, 2023 at 4:05 PM Péter Váry wrote: > Hi Team, > > During some, mostly unrelated work we come to realize that during the > externalization of the connector's python modules and the related tests are >

[jira] [Created] (FLINK-33515) PythonDriver need to stream python process output to log instead of collecting it in memory

Gabor Somogyi created FLINK-33515: - Summary: PythonDriver need to stream python process output to log instead of collecting it in memory Key: FLINK-33515 URL: https://issues.apache.org/jira/browse/FLINK-33515

Re: [VOTE] FLIP-371: Provide initialization context for Committer creation in TwoPhaseCommittingSink

+1 (binding) On Mon, Oct 16, 2023 at 12:20 PM Péter Váry wrote: > Any more comments? > > Leonard Xu ezt írta (időpont: 2023. okt. 16., H, > 8:22): > >> Thanks Peter for driving this work. >> >> >> +1(binding) >> >> Best, >> Leonard >> >> > 2023年10月12日 下午10:58，Márton Balassi 写道： >> > >> > +1

[jira] [Created] (FLINK-33268) Flink REST API response parsing should support backward compatible changes like new fields

Gabor Somogyi created FLINK-33268: - Summary: Flink REST API response parsing should support backward compatible changes like new fields Key: FLINK-33268 URL: https://issues.apache.org/jira/browse/FLINK-33268

Re: [DISCUSS] FLIP-371: SinkV2 Committer imporvements

Thanks for the efforts Peter! I've just analyzed it through and I think it's useful feature. +1 from my side. G On Thu, Oct 5, 2023 at 12:35 PM Péter Váry wrote: > For the record, after the rename, the new FLIP link is: > >

[jira] [Created] (FLINK-33172) Bump numpy version

Gabor Somogyi created FLINK-33172: - Summary: Bump numpy version Key: FLINK-33172 URL: https://issues.apache.org/jira/browse/FLINK-33172 Project: Flink Issue Type: Improvement

Re: [ANNOUNCE] Release 1.18.0, release candidate #1

Thanks for the efforts! +1 (non-binding) * Verified versions in the poms * Built from source * Verified checksums and signatures * Started basic workloads with kubernetes operator * Verified NOTICE and LICENSE files G On Fri, Sep 29, 2023, 18:16 Matthias Pohl wrote: > Thanks for creating

[jira] [Created] (FLINK-33108) Error during error status handling

Gabor Somogyi created FLINK-33108: - Summary: Error during error status handling Key: FLINK-33108 URL: https://issues.apache.org/jira/browse/FLINK-33108 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-33105) Evaluate operator log entry: Exception while fetching cluster info

Gabor Somogyi created FLINK-33105: - Summary: Evaluate operator log entry: Exception while fetching cluster info Key: FLINK-33105 URL: https://issues.apache.org/jira/browse/FLINK-33105 Project: Flink

Re: [DISCUSS] Drop python 3.7 support in 1.19

Gabor Somogyi wrote: > Hi Xingbo, > > Thanks for your support! > > I agree that multi-platform in general is a good idea. We start with ARM > but this opens the door for all others. > > G > > > On Wed, Sep 6, 2023 at 10:46 AM Xingbo Huang wrote: > >> Hi

Re: How to test "Build snapshot binary release" nightly job against a PR

/flink/blob/master/tools/azure-pipelines/build-apache-repo.yml > > On Thu, Sep 7, 2023 at 10:54 AM Gabor Somogyi > wrote: > > > Hi All, > > > > I've created a PR <https://github.com/apache/flink/pull/23359> which > > changes "tools/releasing/creat

How to test "Build snapshot binary release" nightly job against a PR

Hi All, I've created a PR which changes "tools/releasing/create_binary_release.sh" which is called by "Build snapshot binary release" nightly job. Is there a possibility to double check that the PR is not breaking it? The question can be generalized

Re: [DISCUSS] Drop python 3.7 support in 1.19

1 for drop 3.7 support in 1.19 > > [1] https://github.com/actions/runner-images/issues/2187 > [2] https://github.com/github/roadmap/issues/528 > > Best, > Xingbo > > Gabor Somogyi 于2023年9月6日周三 16:07写道： > > > Hi Xingbo, > > > > > So I guess you want to r

Re: [DISCUSS] Drop python 3.7 support in 1.19

ent version of miniconda cannot meet this > requirement, so there is a pre-step that must drop python 3.7? > > [1] https://pypi.org/project/apache-flink/1.16.2/#files > [2] > > https://github.com/apache/flink/blob/master/tools/azure-pipelines/build-python-wheels.yml#L30 > > Best, >

Re: [DISCUSS] Drop python 3.7 support in 1.19

[2] https://issues.apache.org/jira/browse/FLINK-28195 > > [3] https://issues.apache.org/jira/browse/FLINK-27929 > > > > Best, > > Xingbo > > > > Jing Ge 于2023年9月5日周二 04:10写道： > > > > > +1 > > > > > > @Dian should

Re: [DISCUSS] Drop python 3.7 support in 1.19

10) in Flink 1.17 [1,2], it makes sense > to > > > > proceed to remove 3.7 and add 3.11 instead. > > > > > > > > +1. > > > > > > > > [1] https://issues.apache.org/jira/browse/FLINK-27929 > > > > [2] https://github.com/apache

[jira] [Created] (FLINK-33030) Add python 3.11 support

Gabor Somogyi created FLINK-33030: - Summary: Add python 3.11 support Key: FLINK-33030 URL: https://issues.apache.org/jira/browse/FLINK-33030 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-33029) Drop python 3.7 support

Gabor Somogyi created FLINK-33029: - Summary: Drop python 3.7 support Key: FLINK-33029 URL: https://issues.apache.org/jira/browse/FLINK-33029 Project: Flink Issue Type: New Feature

[DISCUSS] Drop python 3.7 support in 1.19

Hi All, I've analyzed through part of the pyflink code and found some improvement possibilities. I would like to hear voices on the idea. Intention: * upgrade several python related versions to eliminate end-of-life issues and keep up with bugfixes * start to add python arm64 support Actual

[jira] [Created] (FLINK-32981) Add python dynamic Flink home detection

Gabor Somogyi created FLINK-32981: - Summary: Add python dynamic Flink home detection Key: FLINK-32981 URL: https://issues.apache.org/jira/browse/FLINK-32981 Project: Flink Issue Type

[jira] [Created] (FLINK-32971) Add pyflink proper development version support

Gabor Somogyi created FLINK-32971: - Summary: Add pyflink proper development version support Key: FLINK-32971 URL: https://issues.apache.org/jira/browse/FLINK-32971 Project: Flink Issue Type

[jira] [Created] (FLINK-32465) KerberosLoginProvider.isLoginPossible does accidental login with keytab

Gabor Somogyi created FLINK-32465: - Summary: KerberosLoginProvider.isLoginPossible does accidental login with keytab Key: FLINK-32465 URL: https://issues.apache.org/jira/browse/FLINK-32465 Project

[jira] [Created] (FLINK-32415) Add maven wrapper to benchmark to avoid maven version issues

Gabor Somogyi created FLINK-32415: - Summary: Add maven wrapper to benchmark to avoid maven version issues Key: FLINK-32415 URL: https://issues.apache.org/jira/browse/FLINK-32415 Project: Flink

[jira] [Created] (FLINK-31839) It's not possible to add flink-s3-fs-hadoop and flink-s3-fs-presto plugins at the same time

Gabor Somogyi created FLINK-31839: - Summary: It's not possible to add flink-s3-fs-hadoop and flink-s3-fs-presto plugins at the same time Key: FLINK-31839 URL: https://issues.apache.org/jira/browse/FLINK-31839

[jira] [Created] (FLINK-31656) Obtain delegation tokens early to support external file system usage in blob server

Gabor Somogyi created FLINK-31656: - Summary: Obtain delegation tokens early to support external file system usage in blob server Key: FLINK-31656 URL: https://issues.apache.org/jira/browse/FLINK-31656

[jira] [Created] (FLINK-31284) Increase KerberosLoginProvider test coverage

Gabor Somogyi created FLINK-31284: - Summary: Increase KerberosLoginProvider test coverage Key: FLINK-31284 URL: https://issues.apache.org/jira/browse/FLINK-31284 Project: Flink Issue Type

[jira] [Created] (FLINK-30928) Use temurin JRE in test hadoop docker image

Gabor Somogyi created FLINK-30928: - Summary: Use temurin JRE in test hadoop docker image Key: FLINK-30928 URL: https://issues.apache.org/jira/browse/FLINK-30928 Project: Flink Issue Type

[jira] [Created] (FLINK-30800) Add doc entry how to re-generate java doc

Gabor Somogyi created FLINK-30800: - Summary: Add doc entry how to re-generate java doc Key: FLINK-30800 URL: https://issues.apache.org/jira/browse/FLINK-30800 Project: Flink Issue Type: New

Re: [VOTE] Release 1.16.1, release candidate #1

+1 (non-binding) * Verified versions in the poms * Built from source * Verified checksums and signatures * Started basic workloads with kubernetes operator * Verified NOTICE and LICENSE files G On Thu, Jan 26, 2023 at 2:28 PM Dawid Wysakowicz wrote: > +1 (binding) > >- verified checksums

[jira] [Created] (FLINK-30781) Add completed checkpoint check to cluster health check

Gabor Somogyi created FLINK-30781: - Summary: Add completed checkpoint check to cluster health check Key: FLINK-30781 URL: https://issues.apache.org/jira/browse/FLINK-30781 Project: Flink

[jira] [Created] (FLINK-30764) Include generic delegation token params in the main config page

Gabor Somogyi created FLINK-30764: - Summary: Include generic delegation token params in the main config page Key: FLINK-30764 URL: https://issues.apache.org/jira/browse/FLINK-30764 Project: Flink

[jira] [Created] (FLINK-30757) Ugrade busybox version to a pinned version for operator

Gabor Somogyi created FLINK-30757: - Summary: Ugrade busybox version to a pinned version for operator Key: FLINK-30757 URL: https://issues.apache.org/jira/browse/FLINK-30757 Project: Flink

[jira] [Created] (FLINK-30754) Fix ExceptionThrowingDelegationTokenProvider/Receiver multi-threaded test issues

Gabor Somogyi created FLINK-30754: - Summary: Fix ExceptionThrowingDelegationTokenProvider/Receiver multi-threaded test issues Key: FLINK-30754 URL: https://issues.apache.org/jira/browse/FLINK-30754

[jira] [Created] (FLINK-30749) Delegation token provider enabled flag documentation is wrong

Gabor Somogyi created FLINK-30749: - Summary: Delegation token provider enabled flag documentation is wrong Key: FLINK-30749 URL: https://issues.apache.org/jira/browse/FLINK-30749 Project: Flink

[jira] [Created] (FLINK-30713) Add Hadoop related k8s decorators exclude possibility

Gabor Somogyi created FLINK-30713: - Summary: Add Hadoop related k8s decorators exclude possibility Key: FLINK-30713 URL: https://issues.apache.org/jira/browse/FLINK-30713 Project: Flink

[jira] [Created] (FLINK-30704) Add S3 delegation token support

Gabor Somogyi created FLINK-30704: - Summary: Add S3 delegation token support Key: FLINK-30704 URL: https://issues.apache.org/jira/browse/FLINK-30704 Project: Flink Issue Type: New Feature

Re: [NOTICE] Parallel compilation should no longer lock up

Hi Chesnay, Thanks for the efforts! During development I've seen some of the tests are not multi-threaded compliant. Intended to fix what I'm aware of... G On Mon, Jan 16, 2023 at 2:19 PM Chesnay Schepler wrote: > Hello, > > with FLINK-30083 being merged it should now be possible to safely

Re: [DISCUSS] Enabling dynamic partition discovery by default in Kafka source

+1 on the overall direction, it's an important feature. I've had a look on the latest master and looks like removed partition handling is not yet added but I think this is essential.

[jira] [Created] (FLINK-30594) Update Java version because of JDK bug in the operator

Gabor Somogyi created FLINK-30594: - Summary: Update Java version because of JDK bug in the operator Key: FLINK-30594 URL: https://issues.apache.org/jira/browse/FLINK-30594 Project: Flink

[jira] [Created] (FLINK-30429) Flink command stops with IllegalArgumentException

Gabor Somogyi created FLINK-30429: - Summary: Flink command stops with IllegalArgumentException Key: FLINK-30429 URL: https://issues.apache.org/jira/browse/FLINK-30429 Project: Flink Issue

[jira] [Created] (FLINK-30425) Generalize token receive side

Gabor Somogyi created FLINK-30425: - Summary: Generalize token receive side Key: FLINK-30425 URL: https://issues.apache.org/jira/browse/FLINK-30425 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-30422) Generalize token framework provider API

Gabor Somogyi created FLINK-30422: - Summary: Generalize token framework provider API Key: FLINK-30422 URL: https://issues.apache.org/jira/browse/FLINK-30422 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-30421) Move TGT renewal to hadoop module

Gabor Somogyi created FLINK-30421: - Summary: Move TGT renewal to hadoop module Key: FLINK-30421 URL: https://issues.apache.org/jira/browse/FLINK-30421 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-30402) Separate token framework generic and hadoop specific parts

Gabor Somogyi created FLINK-30402: - Summary: Separate token framework generic and hadoop specific parts Key: FLINK-30402 URL: https://issues.apache.org/jira/browse/FLINK-30402 Project: Flink

[jira] [Created] (FLINK-30381) Bump minikube kubernetes version for operator

Gabor Somogyi created FLINK-30381: - Summary: Bump minikube kubernetes version for operator Key: FLINK-30381 URL: https://issues.apache.org/jira/browse/FLINK-30381 Project: Flink Issue Type

[jira] [Created] (FLINK-30370) Move existing delegation token framework authentication to providers

Gabor Somogyi created FLINK-30370: - Summary: Move existing delegation token framework authentication to providers Key: FLINK-30370 URL: https://issues.apache.org/jira/browse/FLINK-30370 Project

[jira] [Created] (FLINK-30339) Add a unified deleagation token manager

Gabor Somogyi created FLINK-30339: - Summary: Add a unified deleagation token manager Key: FLINK-30339 URL: https://issues.apache.org/jira/browse/FLINK-30339 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-30310) Re-enable e2e test error check

Gabor Somogyi created FLINK-30310: - Summary: Re-enable e2e test error check Key: FLINK-30310 URL: https://issues.apache.org/jira/browse/FLINK-30310 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-30307) Turn off e2e test error check temporarily

Gabor Somogyi created FLINK-30307: - Summary: Turn off e2e test error check temporarily Key: FLINK-30307 URL: https://issues.apache.org/jira/browse/FLINK-30307 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-30283) Evaluate operator error log entry: Error while patching status

Gabor Somogyi created FLINK-30283: - Summary: Evaluate operator error log entry: Error while patching status Key: FLINK-30283 URL: https://issues.apache.org/jira/browse/FLINK-30283 Project: Flink

[jira] [Created] (FLINK-30281) Turn off operator metrics for e2e tests

Gabor Somogyi created FLINK-30281: - Summary: Turn off operator metrics for e2e tests Key: FLINK-30281 URL: https://issues.apache.org/jira/browse/FLINK-30281 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-30265) Turn on debug logs for k8s operator e2e tests in CI when tests failing

Gabor Somogyi created FLINK-30265: - Summary: Turn on debug logs for k8s operator e2e tests in CI when tests failing Key: FLINK-30265 URL: https://issues.apache.org/jira/browse/FLINK-30265 Project

[jira] [Created] (FLINK-30194) Rename DelegationTokenProvider to HadoopDelegationTokenProvider

Gabor Somogyi created FLINK-30194: - Summary: Rename DelegationTokenProvider to HadoopDelegationTokenProvider Key: FLINK-30194 URL: https://issues.apache.org/jira/browse/FLINK-30194 Project: Flink

[jira] [Created] (FLINK-30187) Multi session job test is silently not checking the operator log for errors

Gabor Somogyi created FLINK-30187: - Summary: Multi session job test is silently not checking the operator log for errors Key: FLINK-30187 URL: https://issues.apache.org/jira/browse/FLINK-30187

[jira] [Created] (FLINK-30176) assert_available_slots is passing even if curl is timing out

Gabor Somogyi created FLINK-30176: - Summary: assert_available_slots is passing even if curl is timing out Key: FLINK-30176 URL: https://issues.apache.org/jira/browse/FLINK-30176 Project: Flink

[RESULT][VOTE] FLIP-272: Generalized delegation token support

Hi All, The proposal [1] has been accepted. Binding votes in favour: Marton Balassi Danny Cranmer Gyula Fora Non-binding: Ferenc Csaky there were no votes against. BR, G [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-272%3A+Generalized+delegation+token+support

[jira] [Created] (FLINK-30149) Evaluate operator error log entry: Error during event processing

Gabor Somogyi created FLINK-30149: - Summary: Evaluate operator error log entry: Error during event processing Key: FLINK-30149 URL: https://issues.apache.org/jira/browse/FLINK-30149 Project: Flink

[jira] [Created] (FLINK-30150) Evaluate operator error log entry: REST service in session cluster is bad now

Gabor Somogyi created FLINK-30150: - Summary: Evaluate operator error log entry: REST service in session cluster is bad now Key: FLINK-30150 URL: https://issues.apache.org/jira/browse/FLINK-30150

[jira] [Created] (FLINK-30151) Evaluate operator error log entry: AuditUtils

Gabor Somogyi created FLINK-30151: - Summary: Evaluate operator error log entry: AuditUtils Key: FLINK-30151 URL: https://issues.apache.org/jira/browse/FLINK-30151 Project: Flink Issue Type

[jira] [Created] (FLINK-30148) Evaluate operator error log entry: Failed to submit job to session cluster

Gabor Somogyi created FLINK-30148: - Summary: Evaluate operator error log entry: Failed to submit job to session cluster Key: FLINK-30148 URL: https://issues.apache.org/jira/browse/FLINK-30148 Project

[jira] [Created] (FLINK-30147) Evaluate operator error log entry: Failed to submit a listener notification task

Gabor Somogyi created FLINK-30147: - Summary: Evaluate operator error log entry: Failed to submit a listener notification task Key: FLINK-30147 URL: https://issues.apache.org/jira/browse/FLINK-30147

[jira] [Created] (FLINK-30146) Evaluate operator error log entry: Exception while listing jobs

Gabor Somogyi created FLINK-30146: - Summary: Evaluate operator error log entry: Exception while listing jobs Key: FLINK-30146 URL: https://issues.apache.org/jira/browse/FLINK-30146 Project: Flink

[jira] [Created] (FLINK-30145) Evaluate operator error log entry: JmDeploymentStatus.ERROR.Count

Gabor Somogyi created FLINK-30145: - Summary: Evaluate operator error log entry: JmDeploymentStatus.ERROR.Count Key: FLINK-30145 URL: https://issues.apache.org/jira/browse/FLINK-30145 Project: Flink

Re: [DISCUSS] FLIP-272: Generalized delegation token support

ease things :) > > [1] > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-196%3A+Source+API+stability+guarantees > > Thanks, > Danny > > On Mon, Nov 21, 2022 at 5:45 PM Gabor Somogyi > wrote: > > > Hi Danny, > > > > Thanks for spending y

[jira] [Created] (FLINK-30134) Annotate all the public classes for the delegation token framework

Gabor Somogyi created FLINK-30134: - Summary: Annotate all the public classes for the delegation token framework Key: FLINK-30134 URL: https://issues.apache.org/jira/browse/FLINK-30134 Project: Flink

Re: [DISCUSS] FLIP-272: Generalized delegation token support

/apache/flink/blob/master/flink-runtime/src/main/java/org/apache/flink/runtime/security/token/DelegationTokenManager.java > [3] > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-196%3A+Source+API+stability+guarantees > [4] > > https://cwiki.apache.org/confluence/display/FLINK/

[jira] [Created] (FLINK-30117) Evaluate error whitelist entries added in FLINK-29475

Gabor Somogyi created FLINK-30117: - Summary: Evaluate error whitelist entries added in FLINK-29475 Key: FLINK-30117 URL: https://issues.apache.org/jira/browse/FLINK-30117 Project: Flink

Re: [ANNOUNCE] New Apache Flink Committer - Matyas Orhidi

Congrats! :) G On Mon, Nov 21, 2022 at 3:18 PM Márton Balassi wrote: > Hi everyone, > > On behalf of the PMC, I'm very happy to announce Matyas Orhidi as a new > Flink > committer. > > Matyas has over a decade of experience of the Big Data ecosystem and has > been working with Flink full time

[jira] [Created] (FLINK-30085) JVM hanging after executing YARNSessionCapacitySchedulerITCase.testNonexistingQueueWARNmessage

Gabor Somogyi created FLINK-30085: - Summary: JVM hanging after executing YARNSessionCapacitySchedulerITCase.testNonexistingQueueWARNmessage Key: FLINK-30085 URL: https://issues.apache.org/jira/browse/FLINK-30085

Re: [DISCUSS] Updating Flink HBase Connectors

Hi All, +1 to go. Since we are refurbishing the HBase area maybe we can move the token provider into HBase base project. This would fit into the high level effort to extract everything into external connectors. If you do this and facing any issues just ping me :) BR, G On Thu, Nov 17, 2022 at

[VOTE] FLIP-272: Generalized delegation token support

Hi All, I'm hereby opening a vote for FLIP-272 Generalized delegation token support. The related documents can be found here: - FLIP on wiki: [1] - Discussion thread: [2] Voting will be open for at least 72 hours (since weekend is involved EOB Monday is planned). BR, G [1]

[jira] [Created] (FLINK-30024) Secure e2e tests are using a super old kerberos docker image

Gabor Somogyi created FLINK-30024: - Summary: Secure e2e tests are using a super old kerberos docker image Key: FLINK-30024 URL: https://issues.apache.org/jira/browse/FLINK-30024 Project: Flink

Re: [DISCUSS] FLIP-272: Generalized delegation token support

OK, removed the fallback part. Thanks for the help! G On Wed, Nov 9, 2022 at 5:03 PM Őrhidi Mátyás wrote: > looks better! no further concerns > > Cheers, > Matyas > > On Mon, Nov 7, 2022 at 9:21 AM Gabor Somogyi > wrote: > > > Oh gosh, copied wrong con

Re: [DISCUSS] FLIP-272: Generalized delegation token support

Oh gosh, copied wrong config keys so fixed my last mail with green. On Mon, Nov 7, 2022 at 6:07 PM Gabor Somogyi wrote: > Hi Matyas, > > In the meantime I was thinking about the per provider re-obtain feature > and here are my thoughts related that: > * I think it's a good fea

Re: [DISCUSS] FLIP-272: Generalized delegation token support

nd non-hadoop providers on the API level Waiting on your opinion. G On Mon, Nov 7, 2022 at 4:17 PM Gabor Somogyi wrote: > Hi Matyas, > > Thanks for your comments, answered inline. > > G > > > On Mon, Nov 7, 2022 at 2:58 PM Őrhidi Mátyás > wrote: > >> Hi Gabor, &

Re: [DISCUSS] FLIP-272: Generalized delegation token support

t would end-up in synchronization and performance hell. I've made some experiments in my Spark era and this would be the same here :) > Thanks, > Matyas > > > > On Mon, Nov 7, 2022 at 5:10 AM Gabor Somogyi > wrote: > > > Hi team, > > > > Delegation token

[DISCUSS] FLIP-272: Generalized delegation token support

Hi team, Delegation token framework is going to be finished soon (added in FLIP-211 ). Previously there were concerns that the current implementation is bound to Hadoop

[jira] [Created] (FLINK-29918) Generalized delegation token support

Gabor Somogyi created FLINK-29918: - Summary: Generalized delegation token support Key: FLINK-29918 URL: https://issues.apache.org/jira/browse/FLINK-29918 Project: Flink Issue Type: New

[jira] [Created] (FLINK-29783) Flaky test: KafkaShuffleExactlyOnceITCase.testAssignedToPartitionFailureRecoveryEventTime

Gabor Somogyi created FLINK-29783: - Summary: Flaky test: KafkaShuffleExactlyOnceITCase.testAssignedToPartitionFailureRecoveryEventTime Key: FLINK-29783 URL: https://issues.apache.org/jira/browse/FLINK-29783

Re: flink-s3-fs-hadoop dependencies

ntially someone's time: first by creating a bandaid which would > then need to be replaced with a more permanent solution. Could be fine, but > it all depends on how much effort & errorprone the bandaid is vs creating a > structural solution. > > Thanks, > > Martijn >

Re: flink-s3-fs-hadoop dependencies

od somewhere without using the > > dependencies, and reading the files as plain Configuration files > > - Start using the new way of accessing these Configurations everywhere in > > the Flink code? > > > > Thanks, > > Peter > > > > Gabor Somogyi

[jira] [Created] (FLINK-29761) Simplify HadoopModule

Gabor Somogyi created FLINK-29761: - Summary: Simplify HadoopModule Key: FLINK-29761 URL: https://issues.apache.org/jira/browse/FLINK-29761 Project: Flink Issue Type: Sub-task

Re: flink-s3-fs-hadoop dependencies

Hi Peter, > would this cause issues for the users? I think yes, it is going to make trouble for users who want to use S3 without HDFS client. Adding HDFS client may happen but enforcing it is not a good direction. As mentioned I've realized that we have 6 different ways how Hadoop conf is

Re: [DISCUSS] Changing the minimal supported version of Hadoop to 2.10.2

Hi Martin, Thanks for bringing this up! Lately I was thinking about to bump the hadoop version to at least 2.6.1 to clean up issues like this:

[jira] [Created] (FLINK-29507) Make e2e tests independent of the current directory

Gabor Somogyi created FLINK-29507: - Summary: Make e2e tests independent of the current directory Key: FLINK-29507 URL: https://issues.apache.org/jira/browse/FLINK-29507 Project: Flink Issue

Re: [VOTE] Release flink-shaded 16.0, release candidate #1

+1 (non-binding) * compiled from source * downloaded the artifacts * verified signatures * verified that the source archives do not contain any binaries G On Wed, Sep 28, 2022 at 8:58 AM Matthias Pohl wrote: > +1 (non-binding) > > * downloaded the artifacts > * compiled from source > *

[jira] [Created] (FLINK-29394) Flink k8s operator observe Flink job restart count

Gabor Somogyi created FLINK-29394: - Summary: Flink k8s operator observe Flink job restart count Key: FLINK-29394 URL: https://issues.apache.org/jira/browse/FLINK-29394 Project: Flink Issue

[DISCUSS] Stale PR action for flink and flink-kubernetes-operator repos

Hi All, As I see there is no action for stale PRs for flink and flink-kubernetes-operator repos however almost 1k PRs are open. I would like to suggest to add new stale PR action based on the following github plugin: https://github.com/marketplace/actions/close-stale-issues I think the default

  1   2   >