Re: ContinuousEventTimeTrigger breaks coGrouped windowed streams?

2016-11-24 Thread William Saar
Thanks a lot! Your patched window at least causes events to be fired when the window expires, but I think I may be better off with a custom trigger that always fires when a new event arrives in the window (I figured out how to write one of those). One more question about grouping streams from diff

Re: JobManager shows TaskManager was lost/killed while TaskManger Process is still running and the network is OK.

2016-11-24 Thread Renkai
some additional logs I found in jobManager. 2016-11-25 07:19:57,958 WARN akka.remote.RemoteWatcher - Detected unreachable: [akka.tcp://flink@10.17.123.56:59247] 2016-11-25 07:19:57,962 INFO org.apache.flink.runtime.jobmanager.JobManager - Task

JobManager shows TaskManager was lost/killed while TaskManger Process is still running and the network is OK.

2016-11-24 Thread Renkai
I use the newest snapshot of Flink, all jobs failed since a TaskManager was lost/killed.There is a sample of jobmanager and taskmanager logs //job manager java.lang.Exception: TaskManager was lost/killed: ResourceID{resourceId='8f4b98897b1cbdbb576cbf298ac1339f'} @ 10.17.123.56 (dataPort=626

Re: What is the best way to load/add patterns dynamically (at runtime) with Flink?

2016-11-24 Thread PedroMrChaves
The best answer I can give you is the one given in the post. Currently, there is no way of dynamically changing the patterns. The only way would be to dive into Flink's core code and change the way operators are shipped to the cluster. On Thu, Nov 24, 2016 at 3:34 PM, kaelumania [via Apache Flink

Container JMX port setting / discovery for Flink on YARN

2016-11-24 Thread Yury Ruchin
Hi, I want to enable JMX for my Flink streaming app running in YARN session. How can I specify which ports containers will listen to? If I cannot control it (e. g. they will be chosen randomly) - how can I detect which ports were picked by containers: inspecting logs, looking at the Web UI etc.?

Re: What is the best way to load/add patterns dynamically (at runtime) with Flink?

2016-11-24 Thread Stephan Epping
I also found this really interesting post http://stackoverflow.com/questions/40018199/flink-and-dynamic-templates-recognition

Re: What is the best way to load/add patterns dynamically (at runtime) with Flink?

2016-11-24 Thread kaelumania
Hey, the javascript solution seems very limited. Is there a solution with compiling new patterns to native Flink CEP Patterns and add them to a stream dynamically? best Stephan -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/What-is-the-bes

Re: Enforce an operation to run in an exact host in flink

2016-11-24 Thread Eranga Heshan
Thank you Aijosha. 😃 I understood the concept. Eranga Heshan *Undergraduate* Computer Science & Engineering University of Moratuwa Mobile: +94 71 138 2686 <%2B94%2071%20552%202087> Email: era...@wso2.com

Re: S3 checkpointing in AWS in Frankfurt

2016-11-24 Thread Stephan Ewen
We have been looking for a while for some way to decouple the S3 filesystem support from Hadoop. Does anyone know a good S3 connector library that works independent of Hadoop and EMRFS? Best, Stephan On Wed, Nov 23, 2016 at 7:57 PM, Greg Hogan wrote: > EMRFS looks to *add* cost (and consisten

Re: Cannot connect to the JobManager - Flink 1.1.3 cluster mode

2016-11-24 Thread Stefan Richter
Hi, I think share the logs would be helpful to figure out the problem. Best, Stefan > Am 23.11.2016 um 22:05 schrieb Dominik Safaric : > > Hi all, > > As I’ve been setting up a cluster comprised of three worker nodes and a > master node, I’ve encountered the problem that the JobManager althou