[jira] [Created] (FLINK-8700) Port tests from FlinkMiniCluster to MiniClusterResource

Aljoscha Krettek created FLINK-8700: --- Summary: Port tests from FlinkMiniCluster to MiniClusterResource Key: FLINK-8700 URL: https://issues.apache.org/jira/browse/FLINK-8700 Project: Flink

Re: Multiple windows on a single stream

Hi Carsten, If you're using event-time windowing you can do something like this: souce = env.addSource(...) window1 = source .keyBy() .window(10 sec) .aggregate()/reduce() window1.addSink(...) window2 = window1 .keyBy() .windwo(30 sec) .aggregate()/reduce() window2.addSink(...)

[jira] [Created] (FLINK-8672) Support continuous processing in CSV table source

Aljoscha Krettek created FLINK-8672: --- Summary: Support continuous processing in CSV table source Key: FLINK-8672 URL: https://issues.apache.org/jira/browse/FLINK-8672 Project: Flink Issue

Re: Why are checkpoint failures so serious?

Hi Ron, Keep in mind, though, that this feature will only be available with the upcoming Flink 1.5. Just making sure you don't go looking for this and are surprised if you don't find it. Best, Aljoscha > On 14. Feb 2018, at 10:20, Till Rohrmann wrote: > > Hi Ron, > >

Re: [DISCUSS] Releasing Flink 1.5.0

t; >>>>>>> from feature completeness but will be a great tool for Flink >>>>>>> beginners. >>>>>>> >>>>>>> In order to use the SQL client we would need to also add some table >>>>>>> sources with

Re: Terminating streaming test

ividual job is > terminated after the expected results are in? Also, CheckingRestoringSource > will run until cancelled, is there a way where the source can trigger > pipeline termination? > > Thanks, > Thomas > > > On Wed, Feb 7, 2018 at 7

Re: Timestamp/watermark support in Kinesis consumer

Hi, That last point is very valid. For a while now I've wanted to generalise the pattern of our file source to other sources. (This is related to how Beam sources are being refactored to use Splittable DoFn.) I'm very eager for design work to start on this once 1.5 is out the door. There are

Re: Terminating streaming test

There is StatefulJobSavepointMigrationITCase, which executes a proper unbounded pipeline on a locally started cluster and "listens" for some criteria via accumulators before cancelling the job and shutting down the cluster. The communication with the cluster is quite custom here, but I would

[jira] [Created] (FLINK-8596) Custom command line code does not correctly catch errors

Aljoscha Krettek created FLINK-8596: --- Summary: Custom command line code does not correctly catch errors Key: FLINK-8596 URL: https://issues.apache.org/jira/browse/FLINK-8596 Project: Flink

[DISCUSS] Releasing Flink 1.5.0

Hi Everyone, When we decided to do the 1.4.0 release a while back we did that to get a stable release out before putting in a couple of new features. Back then, some of those new features (FLIP-6, network stack changes, local state recovery) were almost ready and we wanted to do a shortened

Re: Ordering in ProcessFunction after emitting multiple events from WindowFunction

Hi, I think if you're keying by the same key the order should be preserved. If not, then events from different upstream operations can arrive in arbitrary order. Best, Aljoscha > On 12. Jan 2018, at 12:57, Michał Stępień > wrote: > > Hello, > > I have dev

Re: Dynamic SessionWindow gaps

Hi, This sounds good! Could you please open a Jira Issue for this and then open a PR against that Jira issue? Btw, I would suggest to implement this as a new type of assigner, something like DynamicSessionWindows. Best, Aljoscha > On 29. Dec 2017, at 20:54, Dyana Rose

Re: Issues in migrating code from 1.3.2 to 1.4.0

Hi, Could you please provide a bit of context. From your second email I gather that you're using the Table API, is that right? Best, Aljoscha > On 14. Dec 2017, at 07:08, Shivam Sharma <28shivamsha...@gmail.com> wrote: > > Basically I am registering one scalarfunction in my code. Is there any

Re: Storing large lists into state per key

> suggests, that the correct implementation *should* behave exactly as the > current implementation does - serialize the list into one field and store as > key-value. Do you think there would be any major issues with this? > > Many thanks, > > Jan > > > On 12/13/2017 0

Re: Storing large lists into state per key

Hi, If I remember correctly, there was actually an effort to change the RocksDB list state the way you described. I'm cc'ing Stephan, who was involved in that and this is the Jira issue: https://issues.apache.org/jira/browse/FLINK-5756 Best,

[ANNOUNCE] Apache Flink 1.4.0 released

The Apache Flink community is very happy to announce the release of Apache Flink 1.4.0. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streaming applications. The release is available for download at:

Re: [RESULT][VOTE] Release 1.4.0, release candidate #3

gt; > Maybe 1.4.0, because 1.3.2 already exist =) > > > 2017-12-12 13:58 GMT+04:00 Aljoscha Krettek <aljos...@apache.org>: > >> The voting time has passed and I'm happy to announce that we've collected >> enough votes to release this RC as Flink 1.3.2. >> >&

[RESULT][VOTE] Release 1.4.0, release candidate #3

binding. No 0 or -1 votes. Thanks a lot, everyone, for testing and making sure that this will be a good release! I'll send out a separate announcement mail and push out the release artefacts and update the website now. > On 12. Dec 2017, at 10:48, Aljoscha Krettek <aljos...@apache.org&

Re: [VOTE] Release 1.4.0, release candidate #3

t;>>> properly and that Quickstart docs are ok >>>>> >>>>>> - verified that ChildFirstClassloader allows user to run his >>>>>> application >>>>>> >>>>> with some custom akka version >>>>>

Re: TaskManager job lifecycle hooks

Hi Ben, I think that's a good question but I also think that Erons answer is sufficient for an initial implementation. We suggest more and more to use a single "cluster" per job (either a single per-job YARN cluster or in Kubernetes or in Mesos), thus we don't really have to solve the problem

Re: [VOTE] Release 1.4.0, release candidate #3

't think we (Dell EMC) > consider it a blocker but it will mean that the connector is Flink 1.4+. > > Eron > > > On Thu, Dec 7, 2017 at 12:25 PM, Aljoscha Krettek <aljos...@apache.org> > wrote: > >> I just noticed that I did a copy-and-paste error and the

Re: [VOTE] Release 1.4.0, release candidate #3

;bowen...@offerupnow.com> wrote: > > I agree that it shouldn't block the release. The doc website part is even > better! > > On Thu, Dec 7, 2017 at 1:09 AM, Aljoscha Krettek <aljos...@apache.org> > wrote: > >> Good catch, yes. This shouldn't block the release, tho

Re: [VOTE] Release 1.4.0, release candidate #3

nk/pull/5129 > > Thanks, > Bowen > > > On Wed, Dec 6, 2017 at 5:56 AM, Aljoscha Krettek <aljos...@apache.org> > wrote: > >> Hi everyone, >> >> Please review and vote on release candidate #3 for the version 1.4.0, as >> follows: >> [ ] +1

[VOTE] Release 1.4.0, release candidate #3

Hi everyone, Please review and vote on release candidate #3 for the version 1.4.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes [1], *

[CANCEL] [VOTE] Release 1.4.0, release candidate #2

Canceling this vote in favour of a new RC that will come once the discovered blocker issues are resolved. > On 4. Dec 2017, at 10:17, Aljoscha Krettek <aljos...@apache.org> wrote: > > Neat! I wil try and make sure that we get the fix in ASAP. > >> On 3. Dec 2017, at 12:

Re: Flink 1.4.0-RC2 Hadoop Build

Hi, The behaviour with Flink 1.4 is that we will always include Hadoop dependencies unless we explicitly exclude them via "-DwithoutHadoop". If you build without any flags you will get the default Hadoop version which currently is 2.4.1. Regarding the issue you discovered, I think we have to

Re: [VOTE] Release 1.4.0, release candidate #2

;>> setter. >>>>>>> By adding the methods, we can compile Flink for Hadoop 2.9.0. >> However, >>>>>>> the >>>>>>> getter/setter add a dependency on a class that was also added in >>> Hadoop >>>>>>> 2

Re: [VOTE] Release 1.4.0, release candidate #2

gt;> +1 (non-binding) >> >> I tested Flink in a cluster setup on Google Cloud, YARN-per-job, checked >> that for all backends that HA, recovery, at-least-once, end-to-end exactly >> once (with Kafka11 Producer), savepoints, externalized checkpoints, and >> rescaling work

Re: [VOTE] Release 1.4.0, release candidate #2

+1 Verified: - NOTICE and LICENSE are correct - source doesn't contain binaries - verified signatures - verified hashes - cluster testing on AWS and Cloudera VM (with Kerberos) (see release-testing doc) > On 28. Nov 2017, at 11:20, Aljoscha Krettek <aljos...@apache.org> wrote:

Re: [VOTE] Release 1.4.0, release candidate #2

hade-hadoop) on >> project flink-shaded-hadoop2-uber: Error creating shaded jar: invalid LOC >> header (bad signature) -> [Help 1] >> >> (Apache Maven 3.3.9) >> >> Any idea what I am missing? >> >> Thanks, >> Gyula >> >>

Re: Updated checkstyle version

Thanks for the update! > On 27. Nov 2017, at 22:14, Greg Hogan wrote: > > Hi devs, > > Recent commits to the master and release-1.4 branches updated the checkstyle > version from 6.19 to 8.4 and if using the checkstyle plugin for IntelliJ you > will need to manually

[VOTE] Release 1.4.0, release candidate #2

Hi everyone, Please review and vote on release candidate #2 for the version 1.4.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes [1], *

Re: [VOTE] Release 1.4.0, release candidate #1

be open for at least 72 hours > > As you are aware, it is long weekend in US. > > Is it possible to extend by 24 hours so that developers in US can > participate in validation ? > > Cheers > > On Fri, Nov 24, 2017 at 2:57 AM, Aljoscha Krettek <aljos...@apache

[VOTE] Release 1.4.0, release candidate #1

Hi everyone, Please review and vote on release candidate #1 for the version 1.4.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes [1], *

[jira] [Created] (FLINK-8131) Update to Kafka 0.11.0.2

Aljoscha Krettek created FLINK-8131: --- Summary: Update to Kafka 0.11.0.2 Key: FLINK-8131 URL: https://issues.apache.org/jira/browse/FLINK-8131 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-8130) Javadocs link for snapshot release is not correct

Aljoscha Krettek created FLINK-8130: --- Summary: Javadocs link for snapshot release is not correct Key: FLINK-8130 URL: https://issues.apache.org/jira/browse/FLINK-8130 Project: Flink Issue

[PREVIEW] Release 1.4.0, release candidate #0

Hi everyone, To aid with testing and to enable everyone to get a preview of what will likely be the next Flink release I created an RC0. This has all the artefacts that we would normally have for a release except a source-code tag and a PR for the release announcement, we just don't vote. I'm

Adding a blog post about the 1.4/1.5 timeline and features

Hi everyone, Mike, Stephan and I wrote a blog post outlining the big new features scheduled for Flink 1.5 and also quickly describing the features of the soon-to-be-released Flink 1.4. The post also summarizes why some of the big features where pushed back to 1.5 (hint: it's all about

[jira] [Created] (FLINK-8099) Reduce default restart delay to 1 second

Aljoscha Krettek created FLINK-8099: --- Summary: Reduce default restart delay to 1 second Key: FLINK-8099 URL: https://issues.apache.org/jira/browse/FLINK-8099 Project: Flink Issue Type: Bug

Re: The right approach to store intermediate value

Hi, You should use the State API [1] for this if you want your program to be fault-tolerant. Flink will checkpoint state and make sure that it is restored in case of failures. [1] https://ci.apache.org/projects/flink/flink-docs-release-1.4/dev/stream/state/state.html

[jira] [Created] (FLINK-8053) Default to asynchronous snapshots for FsStateBackend

Aljoscha Krettek created FLINK-8053: --- Summary: Default to asynchronous snapshots for FsStateBackend Key: FLINK-8053 URL: https://issues.apache.org/jira/browse/FLINK-8053 Project: Flink

[jira] [Created] (FLINK-8051) Reactivate Scaladoc aggregation using genjavadoc

Aljoscha Krettek created FLINK-8051: --- Summary: Reactivate Scaladoc aggregation using genjavadoc Key: FLINK-8051 URL: https://issues.apache.org/jira/browse/FLINK-8051 Project: Flink Issue

[jira] [Created] (FLINK-8023) User proper AvroSerializer for Avro types

Aljoscha Krettek created FLINK-8023: --- Summary: User proper AvroSerializer for Avro types Key: FLINK-8023 URL: https://issues.apache.org/jira/browse/FLINK-8023 Project: Flink Issue Type

Re: Remove the HDFS directory in org.apache.flink.util.FileUtils.deletePathIfEmpty

Hi, You images did not make it through to the mailing list. Best, Aljoscha > On 8. Nov 2017, at 05:25, 马庆祥 wrote: > > Hi,all, > > I enable checkpoint with the configuration in the below figure . > > > it works, but keep getting the below exception: > > > I

[ANNOUNCE] Flink 1.4 Release-Branch Fork

Hi Everyone, I finally branched of the release-1.4 branch and opened a PR to update the master version to 1.5-SNAPSHOT [1]. Thanks a lot to everyone for working very hard on quickly burning down remaining blockers and getting last features in! There are a few remaining issues but I'm positive

[jira] [Created] (FLINK-8001) Mark Kafka Consumer as idle if it doesn't have partitions

Aljoscha Krettek created FLINK-8001: --- Summary: Mark Kafka Consumer as idle if it doesn't have partitions Key: FLINK-8001 URL: https://issues.apache.org/jira/browse/FLINK-8001 Project: Flink

Re: [ANNOUNCE] Flink 1.4 feature-freeze date and release burn-down

d when will we open master branch > for PRs of 1.5 features? > > Thanks! > Bowen > > > > > On Thu, Oct 19, 2017 at 2:17 AM, Aljoscha Krettek <aljos...@apache.org> > wrote: > >> Hi Everyone, >> >> It seems everyone agrees on releasing 1.4 s

Re: Get Window Time

@Kostas, could you maybe have a look? The title says "window" but it's actually about CEP. > On 2. Nov 2017, at 07:33, Erdem erdfem wrote: > > FlinkKafkaConsumer010 myConsumer = new > FlinkKafkaConsumer010<>("demo", new JSONDeserializationSchema(), >

Re: [ANNOUNCE] New committer: Haohui Mai

Congratulations!  > On 1. Nov 2017, at 10:13, Shaoxuan Wang wrote: > > Congratulations! > > On Wed, Nov 1, 2017 at 4:36 PM, Till Rohrmann wrote: > >> Congrats and welcome on board :-) >> >> On Wed, Nov 1, 2017 at 9:14 AM, Fabian Hueske

[jira] [Created] (FLINK-7944) Allow configuring Hadoop Classpath

Aljoscha Krettek created FLINK-7944: --- Summary: Allow configuring Hadoop Classpath Key: FLINK-7944 URL: https://issues.apache.org/jira/browse/FLINK-7944 Project: Flink Issue Type

[jira] [Created] (FLINK-7931) FlinkKinesisProducer violates at-least-once guarantees (1.3 branch)

Aljoscha Krettek created FLINK-7931: --- Summary: FlinkKinesisProducer violates at-least-once guarantees (1.3 branch) Key: FLINK-7931 URL: https://issues.apache.org/jira/browse/FLINK-7931 Project

Re: [VOTE] Release Apache Flink-shaded 2.0 (RC1)

+1 - I went through ALL new commits since the 1.0 release and verified them - verified signature and hashes Out of curiosity, we don't have source jars in maven for these, right? > On 25. Oct 2017, at 09:15, Chesnay Schepler wrote: > > Dear Flink community, > > Please

Re: Pattern change on runtime

Hi, Yes, currently the pattern of a CEP operator cannot be changed. You could manually implement this by using a ConnectedStream with a CoProcessFunction where the first input carries events and the second input carries commands that change the patterns that you monitor. Best, Aljoscha > On

[jira] [Created] (FLINK-7902) TwoPhaseCommitSinkFunctions should use custom TypeSerializer

Aljoscha Krettek created FLINK-7902: --- Summary: TwoPhaseCommitSinkFunctions should use custom TypeSerializer Key: FLINK-7902 URL: https://issues.apache.org/jira/browse/FLINK-7902 Project: Flink

Re: Improving Javadocs

The problem with that is that simple hotfix PRs are sometimes not noticed (at least by me). My workflow is roughly: - scan every "Jira Issue created" mail - "watch" those that I find interesting/important - monitor mail on the "watched" issues and react if necessary I don't have a stream of

[ANNOUNCE] Flink 1.4 feature-freeze date and release burn-down

Hi Everyone, It seems everyone agrees on releasing 1.4 soon (see "Releasing Flink 1.4" thread). As discussed we will set a tight feature-freeze date of October 31st, after that I will cut a release branch and we we will only merge bug fixes to the release branch starting from that. This will

[jira] [Created] (FLINK-7864) Support side-outputs in CoProcessFunction

Aljoscha Krettek created FLINK-7864: --- Summary: Support side-outputs in CoProcessFunction Key: FLINK-7864 URL: https://issues.apache.org/jira/browse/FLINK-7864 Project: Flink Issue Type

Re: [DISCUSS] Releasing Flink 1.4

or issue that I'd like to include in 1.4.0 which is a >>> refactoring of the TableSource interface. >>> This effort has already started and is currently waiting for reviews / >>> comments. >>> I'm quite confident that we can get it in within the next two weeks. >>

Re: [DISCUSS] Releasing Flink 1.4

t;> were flagged for release 1.4, the users were planning to have them rather >> soon. >> >> Stephan >> >> >> On Fri, Oct 13, 2017 at 2:35 PM, Aljoscha Krettek <aljos...@apache.org> >> wrote: >> >>> +1 Excellent >>> >&

[jira] [Created] (FLINK-7837) AggregatingFunction does not work with immutable types

Aljoscha Krettek created FLINK-7837: --- Summary: AggregatingFunction does not work with immutable types Key: FLINK-7837 URL: https://issues.apache.org/jira/browse/FLINK-7837 Project: Flink

[jira] [Created] (FLINK-7830) Problematic interaction of CEP and asynchronous snapshots

Aljoscha Krettek created FLINK-7830: --- Summary: Problematic interaction of CEP and asynchronous snapshots Key: FLINK-7830 URL: https://issues.apache.org/jira/browse/FLINK-7830 Project: Flink

[jira] [Created] (FLINK-7829) Remove (or at least deprecate) DataStream.writeToFile/Csv

Aljoscha Krettek created FLINK-7829: --- Summary: Remove (or at least deprecate) DataStream.writeToFile/Csv Key: FLINK-7829 URL: https://issues.apache.org/jira/browse/FLINK-7829 Project: Flink

[jira] [Created] (FLINK-7828) Improve object copying/reuse mode for streaming runtime

Aljoscha Krettek created FLINK-7828: --- Summary: Improve object copying/reuse mode for streaming runtime Key: FLINK-7828 URL: https://issues.apache.org/jira/browse/FLINK-7828 Project: Flink

[jira] [Created] (FLINK-7816) Support Scala 2.12 closures and Java 8 lambdas in ClosureCleaner

Aljoscha Krettek created FLINK-7816: --- Summary: Support Scala 2.12 closures and Java 8 lambdas in ClosureCleaner Key: FLINK-7816 URL: https://issues.apache.org/jira/browse/FLINK-7816 Project: Flink

[jira] [Created] (FLINK-7811) Add support for Scala 2.12

Aljoscha Krettek created FLINK-7811: --- Summary: Add support for Scala 2.12 Key: FLINK-7811 URL: https://issues.apache.org/jira/browse/FLINK-7811 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-7810) Switch from custom Flakka to Akka 2.4.x

Aljoscha Krettek created FLINK-7810: --- Summary: Switch from custom Flakka to Akka 2.4.x Key: FLINK-7810 URL: https://issues.apache.org/jira/browse/FLINK-7810 Project: Flink Issue Type

[jira] [Created] (FLINK-7809) Drop support for Scala 2.10

Aljoscha Krettek created FLINK-7809: --- Summary: Drop support for Scala 2.10 Key: FLINK-7809 URL: https://issues.apache.org/jira/browse/FLINK-7809 Project: Flink Issue Type: Sub-task

Re: Unable to write snapshots to S3 on EMR

Hi Andy, I remember that I was testing a job with almost exactly the same setup as part of the Flink 1.3.2 release testing. The command I used to start my job is roughly this: HADOOP_CONF_DIR=/etc/hadoop/conf bin/flink run -c my.main.Class -m yarn-cluster -yn 5 -ys 2 ... i.e. I export the

[jira] [Created] (FLINK-7784) Don't fail TwoPhaseCommitSinkFunction when failing to commit

Aljoscha Krettek created FLINK-7784: --- Summary: Don't fail TwoPhaseCommitSinkFunction when failing to commit Key: FLINK-7784 URL: https://issues.apache.org/jira/browse/FLINK-7784 Project: Flink

[jira] [Created] (FLINK-7783) Don't always remove checkpoints ZooKeeperCompletedCheckpointStore#recover()

Aljoscha Krettek created FLINK-7783: --- Summary: Don't always remove checkpoints ZooKeeperCompletedCheckpointStore#recover() Key: FLINK-7783 URL: https://issues.apache.org/jira/browse/FLINK-7783

Re: Dependency convergence

+2 ;-) > On 5. Oct 2017, at 11:26, Till Rohrmann wrote: > > +1 for pulling our dependencies straight and guarding it via the > maven-enforcer-plugin. > > On Wed, Oct 4, 2017 at 8:58 PM, Piotr Nowojski > wrote: > >> I meant for whole flink

[jira] [Created] (FLINK-7763) TableSinkITCase fails with "object reuse" enabled

Aljoscha Krettek created FLINK-7763: --- Summary: TableSinkITCase fails with "object reuse" enabled Key: FLINK-7763 URL: https://issues.apache.org/jira/browse/FLINK-7763 Project: Flink

[jira] [Created] (FLINK-7762) Make WikipediaEditsSourceTest a proper test

Aljoscha Krettek created FLINK-7762: --- Summary: Make WikipediaEditsSourceTest a proper test Key: FLINK-7762 URL: https://issues.apache.org/jira/browse/FLINK-7762 Project: Flink Issue Type

[jira] [Created] (FLINK-7729) Remove Scala 2.10 support; add Scala 2.12 support

Aljoscha Krettek created FLINK-7729: --- Summary: Remove Scala 2.10 support; add Scala 2.12 support Key: FLINK-7729 URL: https://issues.apache.org/jira/browse/FLINK-7729 Project: Flink Issue

[jira] [Created] (FLINK-7700) State merging in RocksDB backend leaves old state

Aljoscha Krettek created FLINK-7700: --- Summary: State merging in RocksDB backend leaves old state Key: FLINK-7700 URL: https://issues.apache.org/jira/browse/FLINK-7700 Project: Flink Issue

Re: [DISCUSS] FLIP-21 - Improve object Copying/Reuse Mode for Streaming Runtime

e reply and for the support! >>> >>> @Greg, controlling object reuse on a per-operator base is definitely a >> good >>> way to follow up. My first thought would be to keep this proposal slim >> and >>> deal with the "default" logic,

Re: [DISCUSS] Dropping Scala 2.10

Ted Yu <yuzhih...@gmail.com > <mailto:yuzhih...@gmail.com>>: > +1 > > Original message > From: Hai Zhou <yew...@gmail.com <mailto:yew...@gmail.com>> > Date: 9/20/17 12:44 AM (GMT-08:00) > To: Aljoscha Krettek <aljos...@apache.org <

[DISCUSS] Dropping Scala 2.10

Hi, Talking to some people I get the impression that Scala 2.10 is quite outdated by now. I would like to drop support for Scala 2.10 and my main motivation is that this would allow us to drop our custom Flakka build of Akka that we use because newer Akka versions only support Scala 2.11/2.12

Re: Question about Flink's savepoint

Hi, What is the source you're using in your Job and what filesystem (if any) is it writing to? Best, Aljoscha > On 5. Sep 2017, at 03:06, Mu Kong wrote: > > Hi all, > > I have some questions about the experience I had with the save point. > So, last night I found my

[jira] [Created] (FLINK-7623) Detecting whether an operator is restored doesn't work with chained state

Aljoscha Krettek created FLINK-7623: --- Summary: Detecting whether an operator is restored doesn't work with chained state Key: FLINK-7623 URL: https://issues.apache.org/jira/browse/FLINK-7623

[jira] [Created] (FLINK-7586) Report Watermark metrics in all operators

Aljoscha Krettek created FLINK-7586: --- Summary: Report Watermark metrics in all operators Key: FLINK-7586 URL: https://issues.apache.org/jira/browse/FLINK-7586 Project: Flink Issue Type

Re: Sync Flink

. I’ll be > grateful if you explain why using watermarks as you showed in notion of time > cant help here. > > Thanks. > > > > From: Aljoscha Krettek-2 [via Apache Flink Mailing List archive.] > [mailto:ml+s1008284n19405...@n3.nabble.com > <mailto:ml+s1008284

Re: Quick start guide

Hi, Yes, I think this is wrong in the doc and should refer to the TaskManager logs. Best, Aljoscha > On 4. Sep 2017, at 03:56, Michael Fong wrote: > > Hi, > > I was following the quick start guide on official documents >

[jira] [Created] (FLINK-7568) Bring window documentation up-to-date with latest changes and improve

Aljoscha Krettek created FLINK-7568: --- Summary: Bring window documentation up-to-date with latest changes and improve Key: FLINK-7568 URL: https://issues.apache.org/jira/browse/FLINK-7568 Project

[jira] [Created] (FLINK-7564) Fix Watermark semantics in Table API

Aljoscha Krettek created FLINK-7564: --- Summary: Fix Watermark semantics in Table API Key: FLINK-7564 URL: https://issues.apache.org/jira/browse/FLINK-7564 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-7563) Fix watermark semantics in CEP operators

Aljoscha Krettek created FLINK-7563: --- Summary: Fix watermark semantics in CEP operators Key: FLINK-7563 URL: https://issues.apache.org/jira/browse/FLINK-7563 Project: Flink Issue Type: Bug

Re: [DISCUSS] Watermark boundary condition

Hi, Excellent, thanks for pointing this out! The definition in Watermark.java, which is used by HeapInternalTimerService.java, WindowOperator.isWindowLate() and WindowOperator.isElementLate() and is also documented in [1] is the definitive (ha!) definition. I created Jira issues for fixing

[jira] [Created] (FLINK-7553) Use new SinkFunction interface in FlinkKafkaProducer010

Aljoscha Krettek created FLINK-7553: --- Summary: Use new SinkFunction interface in FlinkKafkaProducer010 Key: FLINK-7553 URL: https://issues.apache.org/jira/browse/FLINK-7553 Project: Flink

[jira] [Created] (FLINK-7552) Extend SinkFunction interface with SinkContext

Aljoscha Krettek created FLINK-7552: --- Summary: Extend SinkFunction interface with SinkContext Key: FLINK-7552 URL: https://issues.apache.org/jira/browse/FLINK-7552 Project: Flink Issue

Re: Sync Flink

Hi, This is not possible out-of-box, but you could use a ProcessFunction (or rather CoProcessFunction) to buffer elements and set a timer so that you only emit when the watermarks advances on both inputs. Best, Aljoscha > On 28. Aug 2017, at 08:10, ziv wrote: > >

Re: Serialization Issue

Hi, TypeInformationKeyValueSerializationSchema uses Flink TypeSerializers to serialize those Strings. What you're seeing is the binary representation of those Strings which, admittedly, resembles the original Strings. If you want to have the data in Kafka with real Strings, I think you need to

[jira] [Created] (FLINK-7480) Set HADOOP_CONF_DIR to sane default if not set

Aljoscha Krettek created FLINK-7480: --- Summary: Set HADOOP_CONF_DIR to sane default if not set Key: FLINK-7480 URL: https://issues.apache.org/jira/browse/FLINK-7480 Project: Flink Issue

[jira] [Created] (FLINK-7477) Use "hadoop classpath" to augment classpath when available

Aljoscha Krettek created FLINK-7477: --- Summary: Use "hadoop classpath" to augment classpath when available Key: FLINK-7477 URL: https://issues.apache.org/jira/browse/FLINK-7477 Proj

[jira] [Created] (FLINK-7442) Add option for using a child-first classloader for loading user code

Aljoscha Krettek created FLINK-7442: --- Summary: Add option for using a child-first classloader for loading user code Key: FLINK-7442 URL: https://issues.apache.org/jira/browse/FLINK-7442 Project

Re: Which branch should I build for Flink 1.3.2

Hi, The release-1.3 branch is the general 1.3.x branch from which we cut specific releases. You can build that to basically get the latest 1.3.x SNAPSHOT. If you specifically want to build 1.3.2 I suggest checking out the release-1.3.2 tag and building from that. Best, Aljoscha > On 12. Aug

Re: How to access HDFS file from flink

Hi, Unfortunately. Inline images do not work on these mailing lists. Also, could you please use the user mailing lists in the future, since the dev mailing lists are meant for discussing the development of Flink. Best, Aljoscha > On 11. Aug 2017, at 11:31, P. Ramanjaneya Reddy

[jira] [Created] (FLINK-7414) Hardcode scala.version to 2.11 in flink-quickstart-scala

Aljoscha Krettek created FLINK-7414: --- Summary: Hardcode scala.version to 2.11 in flink-quickstart-scala Key: FLINK-7414 URL: https://issues.apache.org/jira/browse/FLINK-7414 Project: Flink

[jira] [Created] (FLINK-7413) Release Hadoop 2.8.x convenience binaries for 1.3.x

Aljoscha Krettek created FLINK-7413: --- Summary: Release Hadoop 2.8.x convenience binaries for 1.3.x Key: FLINK-7413 URL: https://issues.apache.org/jira/browse/FLINK-7413 Project: Flink

[jira] [Created] (FLINK-7398) Table API operators/UDFs must not store Logger

Aljoscha Krettek created FLINK-7398: --- Summary: Table API operators/UDFs must not store Logger Key: FLINK-7398 URL: https://issues.apache.org/jira/browse/FLINK-7398 Project: Flink Issue

[jira] [Created] (FLINK-7396) Don't put multiple directories in HADOOP_CONF_DIR in config.sh

Aljoscha Krettek created FLINK-7396: --- Summary: Don't put multiple directories in HADOOP_CONF_DIR in config.sh Key: FLINK-7396 URL: https://issues.apache.org/jira/browse/FLINK-7396 Project: Flink

<    2   3   4   5   6   7   8   9   10   11   >