EventTime in streaming

2015-09-17 Thread Martin Neumann
After some work experience with the current solution I want to give some feedback and maybe start a discussion about event time in streaming. This is not about watermarks or any of the incoming improvements just some observations from the current code. *Starttime for EventTime:* In the current

Tests - Unit Tests versus Integration Tests

2015-09-17 Thread Stephan Ewen
Hi all! The build time of Flink with all tests is nearing 1h on Travis for the shortest run. It is good that we do excessive testing, there are many mechanisms that need that. I have also seen that a lot of fixes that could be tested in a UnitTest style are actually tested as a full Flink

[jira] [Created] (FLINK-2693) Refactor InvalidTypesException to be checked

2015-09-17 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-2693: --- Summary: Refactor InvalidTypesException to be checked Key: FLINK-2693 URL: https://issues.apache.org/jira/browse/FLINK-2693 Project: Flink Issue Type:

Flink ML linear regression issue

2015-09-17 Thread Hanan Meyer
Hi I'm using Flink ML 9.2.1 in order to perform a multiple linear regression with a csv data file. The Scala sample code for it is pretty straightforward: val mlr = MultipleLinearRegression() val parameters = ParameterMap() parameters.add(MultipleLinearRegression.Stepsize, 2.0)

[jira] [Created] (FLINK-2697) Deadlock in StreamDiscretizer

2015-09-17 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-2697: Summary: Deadlock in StreamDiscretizer Key: FLINK-2697 URL: https://issues.apache.org/jira/browse/FLINK-2697 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-2696) ZookeeperOffsetHandlerTest.runOffsetManipulationinZooKeeperTest failed on Travis

2015-09-17 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-2696: Summary: ZookeeperOffsetHandlerTest.runOffsetManipulationinZooKeeperTest failed on Travis Key: FLINK-2696 URL: https://issues.apache.org/jira/browse/FLINK-2696

[jira] [Created] (FLINK-2694) JobManagerProcessReapingTest.testReapProcessOnFailure failed on Travis

2015-09-17 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-2694: Summary: JobManagerProcessReapingTest.testReapProcessOnFailure failed on Travis Key: FLINK-2694 URL: https://issues.apache.org/jira/browse/FLINK-2694 Project: Flink

[jira] [Created] (FLINK-2695) KafkaITCase.testConcurrentProducerConsumerTopology failed on Travis

2015-09-17 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-2695: Summary: KafkaITCase.testConcurrentProducerConsumerTopology failed on Travis Key: FLINK-2695 URL: https://issues.apache.org/jira/browse/FLINK-2695 Project: Flink

[jira] [Created] (FLINK-2698) Add trailing newline to flink-conf.yaml

2015-09-17 Thread Greg Hogan (JIRA)
Greg Hogan created FLINK-2698: - Summary: Add trailing newline to flink-conf.yaml Key: FLINK-2698 URL: https://issues.apache.org/jira/browse/FLINK-2698 Project: Flink Issue Type: Improvement

Re: Flink ML linear regression issue

2015-09-17 Thread Alexey Sapozhnikov
Hello everyone. Do you have a sample in Java how to implement Flink MultipleLinearRegression example? Scala is great, however we would like to see the exact example we could invoke it from Java if it is possible. Thanks and sorry for the interrupt. On Thu, Sep 17, 2015 at 4:27 PM, Hanan Meyer

Java type erasure and object reuse

2015-09-17 Thread Greg Hogan
What is best practice for handling Java type erasure in user defined functions? Is there a means by which the TypeInformation can be accessed from a RichFunction? My temporary solution was to add a "T copy()" method to the CopyableValue interface. A common use case is a GroupReduceFunction that

[jira] [Created] (FLINK-2699) Flink is filling Spark JIRA with incorrect PR links

2015-09-17 Thread Patrick Wendell (JIRA)
Patrick Wendell created FLINK-2699: -- Summary: Flink is filling Spark JIRA with incorrect PR links Key: FLINK-2699 URL: https://issues.apache.org/jira/browse/FLINK-2699 Project: Flink Issue