[jira] [Created] (FLINK-3969) Log Exceptions Thrown by Invokable

2016-05-25 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-3969: --- Summary: Log Exceptions Thrown by Invokable Key: FLINK-3969 URL: https://issues.apache.org/jira/browse/FLINK-3969 Project: Flink Issue Type: Improvemen

[jira] [Created] (FLINK-3970) How to deal with "resouce isolation" problem

2016-05-25 Thread ZhengBowen (JIRA)
ZhengBowen created FLINK-3970: - Summary: How to deal with "resouce isolation" problem Key: FLINK-3970 URL: https://issues.apache.org/jira/browse/FLINK-3970 Project: Flink Issue Type: Wish

Re: Error related to JMX and metrics

2016-05-25 Thread Simone Robutti
I forgot to say that the version is 1.1-SNAPSHOT. 2016-05-25 14:22 GMT+02:00 Simone Robutti : > Running a job I encounter the following error that leads the job to > failure in the end. > > 14:09:34,722 ERROR org.apache.flink.metrics.reporter.JMXReporter > - A metric with the name > org.apa

Error related to JMX and metrics

2016-05-25 Thread Simone Robutti
Running a job I encounter the following error that leads the job to failure in the end. 14:09:34,722 ERROR org.apache.flink.metrics.reporter.JMXReporter - A metric with the name org.apache.flink.metrics:key0=localhost,key1=taskmanager,key2=04a8fea67d01fbbdab5bba8c7e9a73d8,key3=Flink_Java_Job

Re: buffering in operators, implementing statistics

2016-05-25 Thread Aljoscha Krettek
Hi, that link was interesting, thanks! As I said though, it's probably not a good fit for Flink right now. The things that I feel are important right now are: - dynamic scaling: the ability of a streaming pipeline to adapt to changes in the amount of incoming data. This is tricky with stateful o

Re: Error related to JMX and metrics

2016-05-25 Thread Stephan Ewen
Hi! This can be an issue in the latest master (because the test infrastructure was broken, it was not detected) https://issues.apache.org/jira/browse/FLINK-3962 Will be fixed soon. Stephan On Wed, May 25, 2016 at 2:22 PM, Simone Robutti < simone.robu...@radicalbit.io> wrote: > Running a job I

Re: Error related to JMX and metrics

2016-05-25 Thread Simone Robutti
Ok, I will wait then. Thank you. 2016-05-25 15:06 GMT+02:00 Stephan Ewen : > Hi! > > This can be an issue in the latest master (because the test infrastructure > was broken, it was not detected) > https://issues.apache.org/jira/browse/FLINK-3962 > > Will be fixed soon. > > Stephan > > > On Wed,

Re: Error related to JMX and metrics

2016-05-25 Thread Maximilian Michels
Hi Simone, If you don't want to wait, you could also revert these commits and rebuild: git revert 5b9872492394026f3e6ac31b9937141ebedb1481 git revert 707606ac40dbbbd497fcbbb5442870fec5468bf3 git revert 003ce18efc0249fae874e56c3df6acf19f5f2429 This will remove the newly added metrics reporting fe

[jira] [Created] (FLINK-3971) Aggregates handle null values incorrectly.

2016-05-25 Thread Fabian Hueske (JIRA)
Fabian Hueske created FLINK-3971: Summary: Aggregates handle null values incorrectly. Key: FLINK-3971 URL: https://issues.apache.org/jira/browse/FLINK-3971 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-3972) Subclasses of ResourceID may not to be serializable

2016-05-25 Thread Maximilian Michels (JIRA)
Maximilian Michels created FLINK-3972: - Summary: Subclasses of ResourceID may not to be serializable Key: FLINK-3972 URL: https://issues.apache.org/jira/browse/FLINK-3972 Project: Flink I

Re: Preparing Table API & SQL for Flink 1.1.0

2016-05-25 Thread Fabian Hueske
Hi everybody, thanks for the feedback so far. I just went over JIRA and increased the priority of some of the issues I listed (the TOP 6, out of which 1 is fixed, + FLINK-3723) to CRITICAL to distinguish them from the rest. I found two more critical issue that should be fixed: - FLINK-3971: Inco

Re: Preparing Table API & SQL for Flink 1.1.0

2016-05-25 Thread Flavio Pompermaier
If it's ok for you I'd need also to merge FLINK-3901[1] and FLINK-3908[2] [1] https://github.com/apache/flink/pull/1989 [2] https://github.com/apache/flink/pull/2007 Best, Flavio On Wed, May 25, 2016 at 5:04 PM, Fabian Hueske wrote: > Hi everybody, > > thanks for the feedback so far. > > I jus

Re: Error related to JMX and metrics

2016-05-25 Thread Stephan Ewen
Hi! I am curious why that actually fails the job. While it is true, these errors need to be solved, they should only be logged, never cause a failure. Stephan On Wed, May 25, 2016 at 3:49 PM, Maximilian Michels wrote: > Hi Simone, > > If you don't want to wait, you could also revert these com

Junit Issue while testing Kafka Source

2016-05-25 Thread Vinay Patil
Hi, I am able to read from a topic using FlinkKafkaConsumer and return the result, however when I am testing this scenario in Junit the result is getting printed(kafkaStream.print()) but I am not able to exit the Job, env.execute keeps running, I tried to return env.execute from method but that

Re: Preparing Table API & SQL for Flink 1.1.0

2016-05-25 Thread Fabian Hueske
Hi Flavio, shouldn't be a problem to include these issues in the release. Cheers, Fabian 2016-05-25 17:42 GMT+02:00 Flavio Pompermaier : > If it's ok for you I'd need also to merge FLINK-3901[1] and FLINK-3908[2] > > [1] https://github.com/apache/flink/pull/1989 > [2] https://github.com/apache/

[jira] [Created] (FLINK-3973) Table API documentation is "hidden" in Programming Guide menu list

2016-05-25 Thread Fabian Hueske (JIRA)
Fabian Hueske created FLINK-3973: Summary: Table API documentation is "hidden" in Programming Guide menu list Key: FLINK-3973 URL: https://issues.apache.org/jira/browse/FLINK-3973 Project: Flink

[jira] [Created] (FLINK-3974) enableObjectReuse fails when an operator chains to multiple downstream operators

2016-05-25 Thread B Wyatt (JIRA)
B Wyatt created FLINK-3974: -- Summary: enableObjectReuse fails when an operator chains to multiple downstream operators Key: FLINK-3974 URL: https://issues.apache.org/jira/browse/FLINK-3974 Project: Flink

Re: Error related to JMX and metrics

2016-05-25 Thread Simone Robutti
There were many errors after these (null pointers among them) so I assumed they were a consequence. If you say this shouldn't be the primary cause of the failure, tomorrow I will retry and post the complete log. 2016-05-25 18:09 GMT+02:00 Stephan Ewen : > Hi! > > I am curious why that actually fa

[jira] [Created] (FLINK-3975) docs build script isn't serving the preview on the correct base url

2016-05-25 Thread Dyana Rose (JIRA)
Dyana Rose created FLINK-3975: - Summary: docs build script isn't serving the preview on the correct base url Key: FLINK-3975 URL: https://issues.apache.org/jira/browse/FLINK-3975 Project: Flink

Motivation for Delta Iterations

2016-05-25 Thread Trevor Grant
I was wondering where the idea for delta iterations came from. Many of the features in Flink have some sort of academic foundation, maybe someone could point me to a paper? I checked the JIRA and mailing list but couldn't find any relevant discussion, so I apologize if I missed it. Thanks in adv

Re: Junit Issue while testing Kafka Source

2016-05-25 Thread Nick Dimiduk
I'm also curious for a solution here. My test code executes the flow from a separate thread. Once i've joined on all my producer threads and I've verified the output, I simply interrupt the flow thread. This spews exceptions, but it all appears to be harmless. Maybe there's a better way? I think y

[jira] [Created] (FLINK-3976) Alias fields of physical plan node to avoid name collision with Calcite protected fields

2016-05-25 Thread Yijie Shen (JIRA)
Yijie Shen created FLINK-3976: - Summary: Alias fields of physical plan node to avoid name collision with Calcite protected fields Key: FLINK-3976 URL: https://issues.apache.org/jira/browse/FLINK-3976 Proj