[jira] [Created] (FLINK-21123) Upgrade Beanutils 1.9.x to 1.9.4

Chesnay Schepler created FLINK-21123: Summary: Upgrade Beanutils 1.9.x to 1.9.4 Key: FLINK-21123 URL: https://issues.apache.org/jira/browse/FLINK-21123 Project: Flink Issue Type

Re: [DISCUSS] FLIP-161: Configuration through environment variables

The FLIP seems to disregard the existence of dynamic properties, and I'm wondering why that is the case. Don't they fulfill similar roles, in that they allow config options to be set on the command-line? What use-case do they currently not support? I assume it's something along the lines of

[jira] [Created] (FLINK-21095) Remove legacy slotmanagement profile

Chesnay Schepler created FLINK-21095: Summary: Remove legacy slotmanagement profile Key: FLINK-21095 URL: https://issues.apache.org/jira/browse/FLINK-21095 Project: Flink Issue Type

Re: [DISCUSS] FLIP-156: Runtime Interfaces for Fine-Grained Resource Requirements

. If the user specifies the resource requirements for a single operator, then he probably will assume that the other operators will get the default share of resources and not nothing. Cheers, Till On Thu, Jan 21, 2021 at 3:25 AM Chesnay Schepler <mailto:ches...@apache.org>> wrote: Is t

Re: [DISCUSS] FLIP-156: Runtime Interfaces for Fine-Grained Resource Requirements

are not that experienced. Thank you~ Xintong Song On Thu, Jan 7, 2021 at 9:55 PM Chesnay Schepler < ches...@apache.org> wrote: Will declaring them on slot sharing groups not also waste resources if the parallelism of operators within that group are different? It also seems like quit

[jira] [Created] (FLINK-21038) jobmanager.sh may misinterpret webui-port argument

Chesnay Schepler created FLINK-21038: Summary: jobmanager.sh may misinterpret webui-port argument Key: FLINK-21038 URL: https://issues.apache.org/jira/browse/FLINK-21038 Project: Flink

[jira] [Created] (FLINK-21037) Deduplicate configuration logic in docker entrypoint

Chesnay Schepler created FLINK-21037: Summary: Deduplicate configuration logic in docker entrypoint Key: FLINK-21037 URL: https://issues.apache.org/jira/browse/FLINK-21037 Project: Flink

[jira] [Created] (FLINK-21036) Consider removing automatic configuration fo number of slots from docker

Chesnay Schepler created FLINK-21036: Summary: Consider removing automatic configuration fo number of slots from docker Key: FLINK-21036 URL: https://issues.apache.org/jira/browse/FLINK-21036

[jira] [Created] (FLINK-21035) Deduplicate copy_plugins_if_required calls

Chesnay Schepler created FLINK-21035: Summary: Deduplicate copy_plugins_if_required calls Key: FLINK-21035 URL: https://issues.apache.org/jira/browse/FLINK-21035 Project: Flink Issue

[jira] [Created] (FLINK-21034) Rework jemalloc switch to use an environment variable

Chesnay Schepler created FLINK-21034: Summary: Rework jemalloc switch to use an environment variable Key: FLINK-21034 URL: https://issues.apache.org/jira/browse/FLINK-21034 Project: Flink

[jira] [Created] (FLINK-21031) JobMasterStopWithSavepointIT test is not run due to wrong name

Chesnay Schepler created FLINK-21031: Summary: JobMasterStopWithSavepointIT test is not run due to wrong name Key: FLINK-21031 URL: https://issues.apache.org/jira/browse/FLINK-21031 Project

Re: [Vote] FLIP-157 Migrate Flink Documentation from Jekyll to Hugo

+1 On 1/18/2021 3:50 PM, Seth Wiesman wrote: Addendum, 72 hours from now is Thursday the 21st :) sorry for the mistake. Seth On Mon, Jan 18, 2021 at 8:41 AM Timo Walther wrote: +1 Thanks for upgrading our docs infrastructure. Regards, Timo On 18.01.21 15:29, Seth Wiesman wrote: Hi

[jira] [Created] (FLINK-20981) ArchivedExecutionGraph#createFromInitializingJob should support SUSPENDED as final state

Chesnay Schepler created FLINK-20981: Summary: ArchivedExecutionGraph#createFromInitializingJob should support SUSPENDED as final state Key: FLINK-20981 URL: https://issues.apache.org/jira/browse/FLINK-20981

[jira] [Created] (FLINK-20980) ResourceCounter#withResources accepts negative count

Chesnay Schepler created FLINK-20980: Summary: ResourceCounter#withResources accepts negative count Key: FLINK-20980 URL: https://issues.apache.org/jira/browse/FLINK-20980 Project: Flink

Re: [DISCUSS] FLIP-157 Migrate Flink Documentation from Jekyll to Hugo

Did you already try to set this up on buildbot? I assume that we'd have to ask infra to set this up for us? On 1/13/2021 5:14 PM, Seth Wiesman wrote: Hi All, I would like to start a discussion for FLIP-157: Migrating the Flink docs from Jekyll to Hugo. This will allow us: - Proper

Re: [VOTE] Release 1.12.1, release candidate #2

+1 - no dependencies have been changed requiring license updates - nothing seems to be missing from the maven repository - verified checksums/signatures On 1/10/2021 2:23 AM, Xintong Song wrote: Hi everyone, Please review and vote on the release candidate #2 for the version 1.12.1, as

Re: Compiling flink-runtime module of Flink

The fastest way to replace the bits of flink-runtime within flink-dist is to build everything once (via mvn install), and then for each modification in flink-runtime, run mvn install -pl flink-runtime,flink-dist.This will recompile flink-runtime, and repackage flink-dist, but it will use the

[jira] [Created] (FLINK-20915) Move docker-entrypoint.sh logic into disrtibution

Chesnay Schepler created FLINK-20915: Summary: Move docker-entrypoint.sh logic into disrtibution Key: FLINK-20915 URL: https://issues.apache.org/jira/browse/FLINK-20915 Project: Flink

Re: About JobMananger metrics scope

The only workaround is to add some constant to this option before deploying a Flink cluster. Relevant JIRA: https://issues.apache.org/jira/browse/FLINK-9543 On 1/7/2021 11:58 PM, Lu Niu wrote: Hi, Flink Dev First of all, Happy New Year! I have a question about JM monitoring. According to

Re: [DISCUSS] FLIP-156: Runtime Interfaces for Fine-Grained Resource Requirements

Will declaring them on slot sharing groups not also waste resources if the parallelism of operators within that group are different? It also seems like quite a hassle for users having to recalculate the resource requirements if they change the slot sharing. I'd think that it's not really

[jira] [Created] (FLINK-20882) Add better error message for illegal import checks

Chesnay Schepler created FLINK-20882: Summary: Add better error message for illegal import checks Key: FLINK-20882 URL: https://issues.apache.org/jira/browse/FLINK-20882 Project: Flink

[ANNOUNCE] Changes to generated avro files

Hello, in FLINK-20790 we have changed where generated Avro files are placed.Until then they were put directly under the src/ tree, with some committed to git, other being ignored via .gitignore. This has caused issues when switching branches (specifically, not being able to compile 1.11

[jira] [Created] (FLINK-20820) Rename o.a.f.table.runtime.generated package in blink runtime

Chesnay Schepler created FLINK-20820: Summary: Rename o.a.f.table.runtime.generated package in blink runtime Key: FLINK-20820 URL: https://issues.apache.org/jira/browse/FLINK-20820 Project: Flink

Re: [ANNOUNCE] New formatting rules are now in effect

ster/flink-table/flink-table-runtime-blink/src/main/java/org/apache/flink/table/data/conversion/StructuredObjectConverter.java#L170 [3]: https://flink.apache.org/contributing/code-style-and-quality-formatting.html#breaking-the-lines-of-too-long-statements On Tue, 29 Dec 2020 at 19:19, Chesnay Sch

[jira] [Created] (FLINK-20808) Remove redundant checkstyle rules

Chesnay Schepler created FLINK-20808: Summary: Remove redundant checkstyle rules Key: FLINK-20808 URL: https://issues.apache.org/jira/browse/FLINK-20808 Project: Flink Issue Type

[jira] [Created] (FLINK-20807) Cleanup checkstyle suppressions files

Chesnay Schepler created FLINK-20807: Summary: Cleanup checkstyle suppressions files Key: FLINK-20807 URL: https://issues.apache.org/jira/browse/FLINK-20807 Project: Flink Issue Type

[jira] [Created] (FLINK-20805) Blink runtime classes partially ignored by spotless

Chesnay Schepler created FLINK-20805: Summary: Blink runtime classes partially ignored by spotless Key: FLINK-20805 URL: https://issues.apache.org/jira/browse/FLINK-20805 Project: Flink

[jira] [Created] (FLINK-20804) Add SwiftFS end-to-end test

Chesnay Schepler created FLINK-20804: Summary: Add SwiftFS end-to-end test Key: FLINK-20804 URL: https://issues.apache.org/jira/browse/FLINK-20804 Project: Flink Issue Type: Improvement

Re: [ANNOUNCE] New formatting rules are now in effect

Tue, Dec 29, 2020 at 1:28 AM Chesnay Schepler < ches...@apache.org wrote: Hello everyone, I have just merged the commits for FLINK-20651 <https://issues.apache.org/jira/browse/FLINK-20651> to master, release-1.12 and release-11, which enforces new formatting rules using the spotl

[jira] [Created] (FLINK-20803) Version nismatch between spotless-maven-plugin and google-java-format plugin

Chesnay Schepler created FLINK-20803: Summary: Version nismatch between spotless-maven-plugin and google-java-format plugin Key: FLINK-20803 URL: https://issues.apache.org/jira/browse/FLINK-20803

[jira] [Created] (FLINK-20802) force-shading does not declare flink-parent as it's parent

Chesnay Schepler created FLINK-20802: Summary: force-shading does not declare flink-parent as it's parent Key: FLINK-20802 URL: https://issues.apache.org/jira/browse/FLINK-20802 Project: Flink

Re: [VOTE] Release 1.12.1, release candidate #1

Should we maybe wait with this release until we have the docker issue sorted out? On 12/28/2020 1:51 PM, Xintong Song wrote: @Becket, Thanks for the clarification. Sorry, I misunderstood what you meant on the jira. Seems it's not necessary to cancel this vote. WDYT, @Matthias? Thank you~

[jira] [Created] (FLINK-20792) Allow shorthand invocation of spotless

Chesnay Schepler created FLINK-20792: Summary: Allow shorthand invocation of spotless Key: FLINK-20792 URL: https://issues.apache.org/jira/browse/FLINK-20792 Project: Flink Issue Type

[ANNOUNCE] New formatting rules are now in effect

Hello everyone, I have just merged the commits for FLINK-20651 to master, release-1.12 and release-11, which enforces new formatting rules using the spotless plugin, following the google-java-format. This change touched every single java

[jira] [Created] (FLINK-20790) Generated classes should not be put under src/ directory

Chesnay Schepler created FLINK-20790: Summary: Generated classes should not be put under src/ directory Key: FLINK-20790 URL: https://issues.apache.org/jira/browse/FLINK-20790 Project: Flink

[jira] [Created] (FLINK-20752) FailureRateRestartBackoffTimeStrategy allows one less restart than configured

Chesnay Schepler created FLINK-20752: Summary: FailureRateRestartBackoffTimeStrategy allows one less restart than configured Key: FLINK-20752 URL: https://issues.apache.org/jira/browse/FLINK-20752

[jira] [Created] (FLINK-20748) Remap excess slots to outstanding requirements

Chesnay Schepler created FLINK-20748: Summary: Remap excess slots to outstanding requirements Key: FLINK-20748 URL: https://issues.apache.org/jira/browse/FLINK-20748 Project: Flink Issue

Re: [DISCUSS] Enforce common opinionated coding style using Spotless

oring. As for the actual format, I like the google-java-format but again, if the community agrees on a different one I would not oppose that (as long as it does not use the same amount of indentation for method args and method body :P). Cheers, Kostas On Wed, Oct 7, 2020 at 10:26 AM Chesnay Schepler

[jira] [Created] (FLINK-20627) Cancel Job button overlaps text in smaller windows

Chesnay Schepler created FLINK-20627: Summary: Cancel Job button overlaps text in smaller windows Key: FLINK-20627 URL: https://issues.apache.org/jira/browse/FLINK-20627 Project: Flink

[jira] [Created] (FLINK-20605) DeclarativeSlotManager crashes if slot allocation notification is processed after taskexecutor shutdown

Chesnay Schepler created FLINK-20605: Summary: DeclarativeSlotManager crashes if slot allocation notification is processed after taskexecutor shutdown Key: FLINK-20605 URL: https://issues.apache.org/jira

[jira] [Created] (FLINK-20533) Add histogram support to Datadog reporter

Chesnay Schepler created FLINK-20533: Summary: Add histogram support to Datadog reporter Key: FLINK-20533 URL: https://issues.apache.org/jira/browse/FLINK-20533 Project: Flink Issue Type

[jira] [Created] (FLINK-20520) Document that metric names can contain characters that need to be escaped

Chesnay Schepler created FLINK-20520: Summary: Document that metric names can contain characters that need to be escaped Key: FLINK-20520 URL: https://issues.apache.org/jira/browse/FLINK-20520

Re: [VOTE] Release 1.12.0, release candidate #3

I've filed https://issues.apache.org/jira/browse/FLINK-20519 for the hbase issue. Since we still ship the protobuf license I don't think this is a blocker. On 12/7/2020 10:52 AM, Dawid Wysakowicz wrote: +1 (binding) * Verified the checksums * Verified that the source archives do not contain

[jira] [Created] (FLINK-20519) Extend HBase notice with transitively bundled dependencies

Chesnay Schepler created FLINK-20519: Summary: Extend HBase notice with transitively bundled dependencies Key: FLINK-20519 URL: https://issues.apache.org/jira/browse/FLINK-20519 Project: Flink

[jira] [Created] (FLINK-20518) WebUI should escape characters in metric names

Chesnay Schepler created FLINK-20518: Summary: WebUI should escape characters in metric names Key: FLINK-20518 URL: https://issues.apache.org/jira/browse/FLINK-20518 Project: Flink Issue

[jira] [Created] (FLINK-20510) Enable log4j2 monitor interval by default

Chesnay Schepler created FLINK-20510: Summary: Enable log4j2 monitor interval by default Key: FLINK-20510 URL: https://issues.apache.org/jira/browse/FLINK-20510 Project: Flink Issue Type

Re: Running Flink job as a rest

What you are asking for is an HTTP(s) source. This currently does not exist for Flink, so you would have to implement it yourself. Additionally you would have to figure out the host on which the source runs on yourself. It may be easier to setup a separate HTTP(s) server that accepts data,

Re: [VOTE] Release 1.12.0, release candidate #2

-1 -The flink-python jar contains 2 license files in the root directory and another 2 in the META-INF directory. This should be reduced down to 1 under META-INF. I'm inclined to block the release on this because the root license is BSD. - The flink-python jar appears to bundle lz4 (native

Re: [DISCUSS] Moving to JUnit5

I presume we cannot do the migration module-wise due to shared test utilities that rely on JUnit interfaces? On 11/30/2020 1:30 PM, Chesnay Schepler wrote: Is it feasible that 2 people can do the migration within a short time-frame (say, a week)? Must the migration of a test be done in one go

Re: [DISCUSS] Moving to JUnit5

Is it feasible that 2 people can do the migration within a short time-frame (say, a week)? Must the migration of a test be done in one go, or can we for example first rename all the Before/After annotations and then to the rest? Are there any issues with other test dependencies (i.e., hamcrest,

[jira] [Created] (FLINK-20025) Add flink-docker and flink-statefun-docker to repository overview page

Chesnay Schepler created FLINK-20025: Summary: Add flink-docker and flink-statefun-docker to repository overview page Key: FLINK-20025 URL: https://issues.apache.org/jira/browse/FLINK-20025

[jira] [Created] (FLINK-20024) Link to flink-docker repository in the docker documentation

Chesnay Schepler created FLINK-20024: Summary: Link to flink-docker repository in the docker documentation Key: FLINK-20024 URL: https://issues.apache.org/jira/browse/FLINK-20024 Project: Flink

[jira] [Created] (FLINK-20023) Remove note about matching hadoop version from standalone setup docs

Chesnay Schepler created FLINK-20023: Summary: Remove note about matching hadoop version from standalone setup docs Key: FLINK-20023 URL: https://issues.apache.org/jira/browse/FLINK-20023 Project

[jira] [Created] (FLINK-20022) Move statebackend tradeoffs to from production readiness checklist to statebackend page

Chesnay Schepler created FLINK-20022: Summary: Move statebackend tradeoffs to from production readiness checklist to statebackend page Key: FLINK-20022 URL: https://issues.apache.org/jira/browse/FLINK-20022

[jira] [Created] (FLINK-20021) Cleanup several "Dispatcher"/"Jobmanager" misuses in the docs

Chesnay Schepler created FLINK-20021: Summary: Cleanup several "Dispatcher"/"Jobmanager" misuses in the docs Key: FLINK-20021 URL: https://issues.apache.org/jira/browse/FLINK-20021

Re: Investigating flinK

Are you referring to the log files of Flink? On 11/5/2020 7:01 PM, Diana El-Masri wrote: Hi, I am starting my PhD at "Ecole Polytechnique of Montreal" on IoT log management. I am considering using Flink for my edge layer processing. Could please advise if there is a possibility to write a

[jira] [Created] (FLINK-20003) Improve slot report logging messages

Chesnay Schepler created FLINK-20003: Summary: Improve slot report logging messages Key: FLINK-20003 URL: https://issues.apache.org/jira/browse/FLINK-20003 Project: Flink Issue Type

[jira] [Created] (FLINK-19964) Gelly ITCase stuck on Azure

Chesnay Schepler created FLINK-19964: Summary: Gelly ITCase stuck on Azure Key: FLINK-19964 URL: https://issues.apache.org/jira/browse/FLINK-19964 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-19930) Upgrade cassandra-driver-core to 4.X

Chesnay Schepler created FLINK-19930: Summary: Upgrade cassandra-driver-core to 4.X Key: FLINK-19930 URL: https://issues.apache.org/jira/browse/FLINK-19930 Project: Flink Issue Type

[jira] [Created] (FLINK-19929) Upgrade Kinesis dependencies to avoid protobuf 2.6.1

Chesnay Schepler created FLINK-19929: Summary: Upgrade Kinesis dependencies to avoid protobuf 2.6.1 Key: FLINK-19929 URL: https://issues.apache.org/jira/browse/FLINK-19929 Project: Flink

[jira] [Created] (FLINK-19902) Adjust JobMasterTest to be compatible

Chesnay Schepler created FLINK-19902: Summary: Adjust JobMasterTest to be compatible Key: FLINK-19902 URL: https://issues.apache.org/jira/browse/FLINK-19902 Project: Flink Issue Type

Re: [VOTE] Remove flink-connector-filesystem module.

+1 On 10/29/2020 9:18 AM, Kostas Kloudas wrote: Hi all, Following the discussion in [1], I would like to start a vote on removing the flink-connector-filesystem module which includes the BucketingSink. The vote will be open till November 3rd (72h, excluding the weekend) unless there is an

[jira] [Created] (FLINK-19862) DeclarativeSlotManager#suspend can fail with NPE

Chesnay Schepler created FLINK-19862: Summary: DeclarativeSlotManager#suspend can fail with NPE Key: FLINK-19862 URL: https://issues.apache.org/jira/browse/FLINK-19862 Project: Flink

Re: [DISCUSS] Remove flink-connector-filesystem module.

ing it, we should remove it and not leave unmaintained code around. On Wed, Oct 28, 2020 at 12:11 PM Chesnay Schepler wrote: The alternative could also be to use a different argument than "no one uses it", e.g., we are fine with removing it at the cost of friction for some users beca

Re: [DISCUSS] Remove flink-connector-filesystem module.

we can do and I would say that they seem to be working pretty well (e.g. the recent Mesos discussion). Of course they are not perfect but the alternative would be to never remove anything user facing until the next major release, which I find pretty strict. On Wed, Oct 28, 2020 at 10:04 AM Chesna

Re: [DISCUSS] Remove flink-connector-filesystem module.

cannot remove it before trying to provide a smooth migration path. Thanks, Kostas [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-143%3A+Unified+Sink+API On Fri, Oct 16, 2020 at 4:36 PM Chesnay Schepler wrote: @Seth: Earlier in this discussion it was said that the BucketingSink would

Re: Need help in creating Flink Streaming s3 Job for multiple path reader one by one

data. > > Thanks, > Satya > > On Thu, Oct 15, 2020 at 3:29 PM Chesnay Schepler mailto:ches...@apache.org>> wrote: > >> hmm...I don't see an easy way. >> You may have to replicated StreamExecutionEnvir

[jira] [Created] (FLINK-19831) Support grace period for not enough resources being available at cluster startup

Chesnay Schepler created FLINK-19831: Summary: Support grace period for not enough resources being available at cluster startup Key: FLINK-19831 URL: https://issues.apache.org/jira/browse/FLINK-19831

[jira] [Created] (FLINK-19809) Add ServiceConnectionManager

Chesnay Schepler created FLINK-19809: Summary: Add ServiceConnectionManager Key: FLINK-19809 URL: https://issues.apache.org/jira/browse/FLINK-19809 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-19772) Add utility for retrying sync operations with exponential timeout

Chesnay Schepler created FLINK-19772: Summary: Add utility for retrying sync operations with exponential timeout Key: FLINK-19772 URL: https://issues.apache.org/jira/browse/FLINK-19772 Project

Re: Need help in creating Flink Streaming s3 Job for multiple path reader one by one

in order to avoid duplicate data. Thanks, Satya On Thu, Oct 15, 2020 at 3:29 PM Chesnay Schepler wrote: hmm...I don't see an easy way. You may have to replicated StreamExecutionEnvironment#createFileInput and create a custom ContinuousFileMonitoringFunction that ignores missing files in it's run

[jira] [Created] (FLINK-19767) Add AbstractSlotPoolFactory

Chesnay Schepler created FLINK-19767: Summary: Add AbstractSlotPoolFactory Key: FLINK-19767 URL: https://issues.apache.org/jira/browse/FLINK-19767 Project: Flink Issue Type: Task

[jira] [Created] (FLINK-19715) Optimize re-assignment of excess resources

Chesnay Schepler created FLINK-19715: Summary: Optimize re-assignment of excess resources Key: FLINK-19715 URL: https://issues.apache.org/jira/browse/FLINK-19715 Project: Flink Issue

Re: [DISCUSS] Remove flink-connector-filesystem module.

is also suffering from bad memory). Did we manage to add them in the meantime? If not, then it feels rushed to remove it at this point. On Tue, Oct 13, 2020 at 2:33 PM Kostas Kloudas wrote: @Chesnay Schepler Off the top of my head, I cannot find an easy way to migrate from the BucketingSink

Re: [DISCUSS][docker] Adopt Jemalloc as default memory allocator for debian based Flink docker image

If it is possible to support both allocators in a single image then we should definitely go with that option. On 10/16/2020 12:21 PM, Yun Tang wrote: Thanks for Yang's suggestion. I think this could be a better choice. We could install jemalloc and only enable it in LD_PRELOAD when user pass

[jira] [Created] (FLINK-19656) Automatically replace delimiter in metric name components

Chesnay Schepler created FLINK-19656: Summary: Automatically replace delimiter in metric name components Key: FLINK-19656 URL: https://issues.apache.org/jira/browse/FLINK-19656 Project: Flink

Re: Need help in creating Flink Streaming s3 Job for multiple path reader one by one

heck it out. On Mon, Oct 12, 2020 at 1:29 PM Chesnay Schepler wrote: 1) There's no mechanism in the API to restrict the number of number of readers across several sources. I can't quite think of a way to achieve this; maybe Kostas has an idea. 2) You're mixing up the Java Streams and Finks

[jira] [Created] (FLINK-19637) Remove AllocationIdsExposingResourceManagerGateway

Chesnay Schepler created FLINK-19637: Summary: Remove AllocationIdsExposingResourceManagerGateway Key: FLINK-19637 URL: https://issues.apache.org/jira/browse/FLINK-19637 Project: Flink

[jira] [Created] (FLINK-19636) Add declarative SlotPool

Chesnay Schepler created FLINK-19636: Summary: Add declarative SlotPool Key: FLINK-19636 URL: https://issues.apache.org/jira/browse/FLINK-19636 Project: Flink Issue Type: Task

Re: [DISCUSS] Remove flink-connector-filesystem module.

How easy is the migration to the StreamingFileSink? On 10/13/2020 1:01 PM, Aljoscha Krettek wrote: On 13.10.20 11:18, David Anderson wrote: I think the pertinent question is whether there are interesting cases where the BucketingSink is still a better choice. One case I'm not sure about is

Re: [DISCUSS] Remove flink-connector-filesystem module.

opening a discussion. I think that if we supported backwards compatibility, this would have been an easier process. Kostas On Mon, Oct 12, 2020 at 4:32 PM Chesnay Schepler wrote: Are older versions of the module compatible with 1.12+? On 10/12/2020 4:30 PM, Kostas Kloudas wrote: Hi all

Re: [DISCUSS] Remove flink-connector-filesystem module.

Are older versions of the module compatible with 1.12+? On 10/12/2020 4:30 PM, Kostas Kloudas wrote: Hi all, As the title suggests, this thread is to discuss the removal of the flink-connector-filesystem module which contains (only) the deprecated BucketingSink. The BucketingSin is deprecated

[jira] [Created] (FLINK-19569) Upgrade ICU4J to 67.1+

Chesnay Schepler created FLINK-19569: Summary: Upgrade ICU4J to 67.1+ Key: FLINK-19569 URL: https://issues.apache.org/jira/browse/FLINK-19569 Project: Flink Issue Type: Improvement

Re: Need help in creating Flink Streaming s3 Job for multiple path reader one by one

at 7:46 PM Satyaa Dixit mailto:satyaadi...@gmail.com>> wrote: Thank you @Chesnay let me try this change . On Thu, Oct 1, 2020 at 1:21 PM Chesnay Schepler mailto:ches...@apache.org>> wrote: You could also try using streams to m

Re: [DISCUSS] Enforce common opinionated coding style using Spotless

ll quickly become more reliable again. Btw I completely don't care about the code style as long as it plays well with IntelliJ (it used to be different, but things change :p). On Tue, Oct 6, 2020 at 5:23 PM Chesnay Schepler wrote: We shouldn't switch to spaces _now_; cutting this bit from your

Re: [DISCUSS] Enforce common opinionated coding style using Spotless

We shouldn't switch to spaces _now_; cutting this bit from your proposal will massively simplify things and there's hardly any value in changing it. Also I'm getting rather tired of this constant idea of "gradual application". We've been doing this for 2-3 years now since we introduced

Re: [VOTE] Release flink-shaded 12.0

+1 Checked signatures, license files, and that the listed changes are in the release. On 9/30/2020 4:55 PM, Robert Metzger wrote: Hi everyone, Please review and vote on the release candidate #1 for the version 12.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release

[jira] [Created] (FLINK-19490) Document SOMAXCONN OS limit on blob server backlog

Chesnay Schepler created FLINK-19490: Summary: Document SOMAXCONN OS limit on blob server backlog Key: FLINK-19490 URL: https://issues.apache.org/jira/browse/FLINK-19490 Project: Flink

Re: Need help in creating Flink Streaming s3 Job for multiple path reader one by one

You could also try using streams to make it a little more concise: directories.stream() .map(directory ->createInputStream(environment, directory)) .reduce(DataStream::union) .map(joinedStream -> joinedStream.addSink(kafka)); On 10/1/2020 9:48 AM, Chesnay Schepler wrote: Do yo

Re: Need help in creating Flink Streaming s3 Job for multiple path reader one by one

Do you know the list of directories when you submit the job? If so, then you can iterate over them, create a source for each directory, union them, and apply the sink to the union. private static DataStreamcreateInputStream(StreamExecutionEnvironment environment, String directory) {

[jira] [Created] (FLINK-19360) Flink fails if JAVA_HOME contains spaces

Chesnay Schepler created FLINK-19360: Summary: Flink fails if JAVA_HOME contains spaces Key: FLINK-19360 URL: https://issues.apache.org/jira/browse/FLINK-19360 Project: Flink Issue Type

[jira] [Created] (FLINK-19315) Move slot-bookkeeping into separate component

Chesnay Schepler created FLINK-19315: Summary: Move slot-bookkeeping into separate component Key: FLINK-19315 URL: https://issues.apache.org/jira/browse/FLINK-19315 Project: Flink Issue

[jira] [Created] (FLINK-19314) Add compatibility layer

Chesnay Schepler created FLINK-19314: Summary: Add compatibility layer Key: FLINK-19314 URL: https://issues.apache.org/jira/browse/FLINK-19314 Project: Flink Issue Type: Task

[jira] [Created] (FLINK-19313) Implement declarative SlotPool

Chesnay Schepler created FLINK-19313: Summary: Implement declarative SlotPool Key: FLINK-19313 URL: https://issues.apache.org/jira/browse/FLINK-19313 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-19311) Add ResourceRequirement(s)

Chesnay Schepler created FLINK-19311: Summary: Add ResourceRequirement(s) Key: FLINK-19311 URL: https://issues.apache.org/jira/browse/FLINK-19311 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-19310) Add new TaskManagerSlot implementation

Chesnay Schepler created FLINK-19310: Summary: Add new TaskManagerSlot implementation Key: FLINK-19310 URL: https://issues.apache.org/jira/browse/FLINK-19310 Project: Flink Issue Type

[jira] [Created] (FLINK-19309) Add TaskExecutorAllocator

Chesnay Schepler created FLINK-19309: Summary: Add TaskExecutorAllocator Key: FLINK-19309 URL: https://issues.apache.org/jira/browse/FLINK-19309 Project: Flink Issue Type: Task

[jira] [Created] (FLINK-19308) Add SlotTracker

Chesnay Schepler created FLINK-19308: Summary: Add SlotTracker Key: FLINK-19308 URL: https://issues.apache.org/jira/browse/FLINK-19308 Project: Flink Issue Type: Task

[jira] [Created] (FLINK-19307) Add RequirementsTracker

Chesnay Schepler created FLINK-19307: Summary: Add RequirementsTracker Key: FLINK-19307 URL: https://issues.apache.org/jira/browse/FLINK-19307 Project: Flink Issue Type: Task

[jira] [Created] (FLINK-19306) Implement DeclarativeSlotManager

Chesnay Schepler created FLINK-19306: Summary: Implement DeclarativeSlotManager Key: FLINK-19306 URL: https://issues.apache.org/jira/browse/FLINK-19306 Project: Flink Issue Type: Sub

<    8   9   10   11   12   13   14   15   16   17   >