optimal deployment model for Flink Streaming programs

2015-07-29 Thread Dipl.-Inf. Rico Bergmann
Hi! We want to build an infrastructure for automated deployment of Flink Streaming programs to a dedicated environment. This includes automated tests (unit and integration) via Jenkins and in case of a successful build&test the program should be deployed to the execution environment. Since s

Re: Flink Kafka cannot find org/I0Itec/zkclient/serialize/ZkSerializer

2015-07-29 Thread Wendong
Thanks for the example code! I'll try it out. Wendong -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-Kafka-cannot-find-org-I0Itec-zkclient-serialize-ZkSerializer-tp2199p2294.html Sent from the Apache Flink User Mailing List archive. m

thread model issue in TaskManager

2015-07-29 Thread wangzhijiang999
As I know, flink uses thread model in TaskManager, that means one taskmanager process may run many different operator threads,and these threads will compete the memory of the process. I know that flink has memoryManage component in each taskManager, and it will control the localBufferPool of Inp

Re: Options for the JVM in the TaskManagers

2015-07-29 Thread Robert Metzger
Hi Juan, there is a configuration option which is not documented in the 0.9 documentation: - env.java.opts: Set custom JVM options. This value is respected by Flink’s start scripts and Flink’s YARN client. This can be used to set different garbage collectors or to include remote deb

Options for the JVM in the TaskManagers

2015-07-29 Thread Juan Fumero
Hi, is there any option where I can start the VM with preconfigured values? Something similar to env.java.home: "/path/to/jdk" But java.bootstrap: "-Xbootclasspath " and more options. Thanks Juan