Task slot data

2017-08-08 Thread Govindarajan Srinivasaraghavan
Hi, I have a complex algorithm running on a flatmap operator and it requires cache and metrics instances to be passed to various classes. Since the task slots run on the same JVM, I'm not sure if I will be able to use static members or singleton classes. Can I use ThreadLocal variables to isolate

Re: a lot of connections in state "CLOSE_WAIT"

2017-08-08 Thread XiangWei Huang
It seems so,thanks for your reply Chesnay. > 在 2017年8月8日,22:23,Chesnay Schepler [via Apache Flink User Mailing List > archive.] 写道: > > FLINK-7368 may be the reason for this behavior. > > On 31.07.2017 03:54, XiangWei Huang wrote: >> 1. yes and yes.

Re: Flink CEP issues

2017-08-08 Thread Kostas Kloudas
Hi Daiqing, Is it possible to share your job in order to reproduce the problem? Or at least a minimal example. If you see from the JIRA, there is another user in https://issues.apache.org/jira/browse/FLINK-6321 who had a similar problem but we

Advice on debugging state back end...

2017-08-08 Thread Steve Jerman
Hi Folks, I have a stream application which is running out of heap space - looks like there might be something up with state storage I'm having trouble determining if it just needs a lot of memory or there is a memory leak. Are there any tips/best practice for this? I've looked at heap

Re: Writing on Cassandra

2017-08-08 Thread AndreaKinn
I probably solved import issue, but still need help to find some examples of use. Please let me know if someone has experience with Flink and Cassandra together -- View this message in context:

Writing on Cassandra

2017-08-08 Thread AndreaKinn
Hi, I'm trying to integrate a Cassandra sink in my project but honestly I'm a bit confused because I don't find any examples of use. I want just to populate a table and query it on a single node instance of Cassandra. The only one link I found is:

Re: WaterMark & Eventwindow not fired correctly

2017-08-08 Thread Aljoscha Krettek
Hi, So I understood that you have roughly this pipeline: Input 1 --\ |- CoFlatMap - TimestampAndWatermarkAssigner - KeyBy - Window Input 2 --/ If the timestamp assigner is after the CoFlatMap the processInput() method of the extractor should still be called. Not by the

Re: a lot of connections in state "CLOSE_WAIT"

2017-08-08 Thread Chesnay Schepler
FLINK-7368 may be the reason for this behavior. On 31.07.2017 03:54, XiangWei Huang wrote: 1. yes and yes. 2. Yes,it was shown correctly. 3.I wasn’t modify this setting. 在 2017年7月26日,18:06,Chesnay Schepler [via Apache Flink User Mailing List archive.] <[hidden email] > 写道: So

Re: Flink REST API async?

2017-08-08 Thread Aljoscha Krettek
I quickly talked to Till about this. The new JobManager, once FLIP-6 is implemented, will have a new REST endpoint that allows submitting a JobGraph directly. With this, we no longer have to execute the user main() method in the WebRuntimeMonitor (which is a component that the current

Re: Flink REST API async?

2017-08-08 Thread Francisco Gonzalez Barea
Aha ok… Thanks for your answer Eron. Regards On 7 Aug 2017, at 19:04, Eron Wright > wrote: When you submit a program via the REST API, the main method executes inside the JobManager process.Unfortunately a static variable is used to

Re: Experiencing long latency while using sockets

2017-08-08 Thread Fabian Hueske
One pointer is the StreamExecutionEnvironment.setBufferTimeout() parameter. Flink's network stack collects records in buffers to send them over the network. A buffer is sent when it is completely filled or after a configurable timeout. So if your program does not process many records, these