Re: Presented Flink use case in Japan

2016-10-05 Thread Hironori Ogibayashi
Fabian, Thanks for adding! Regards, Hironori 2016-10-05 21:41 GMT+09:00 Fabian Hueske : > Hi Hironori, > > thanks for getting the approval! > Your sentence is perfect. > I've add it to the Wiki page [1]. > > Best, Fabian > > [1] https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink

Re: Exception while running Flink jobs (1.0.0)

2016-10-05 Thread Tarandeep Singh
@Stephan my flink cluster setup- 5 nodes, each running 1 TaskManager. Slots per task manager: 2-4 (I tried varying this to see if this has any impact). Network buffers: 5k - 20k (tried different values for it). @Ufuk: Thank you for creating a branch with checksum. I will use this build to test the

Re: Flink job throws ClassNotFoundException on job restart

2016-10-05 Thread static-max
I went back to commit 2afc092461cf68cf0f3c26a3ab4c58a7bd68cf71 on MASTER, seems to work. 2016-10-05 15:48 GMT+02:00 static-max : > Hi Stephan, > > thanks for the quick answer! I try to go to an older revision, > > Best, > Max > > 2016-10-05 12:10 GMT+02:00 Stephan Ewen : > >> Hi! >> >> The master

Re: Flink job throws ClassNotFoundException on job restart

2016-10-05 Thread static-max
Hi Stephan, thanks for the quick answer! I try to go to an older revision, Best, Max 2016-10-05 12:10 GMT+02:00 Stephan Ewen : > Hi! > > The master has a temporary regression due to the Work In Progress for the > "changing parallelism of savepoints" feature. > We'll try and complete the change

Re: Presented Flink use case in Japan

2016-10-05 Thread Fabian Hueske
Hi Hironori, thanks for getting the approval! Your sentence is perfect. I've add it to the Wiki page [1]. Best, Fabian [1] https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink 2016-10-05 14:31 GMT+02:00 Hironori Ogibayashi : > Hi. > > Yes, I am really looking forward to the next

Re: Presented Flink use case in Japan

2016-10-05 Thread Hironori Ogibayashi
Hi. Yes, I am really looking forward to the next major release. By the way, I got OK from our PR department about adding our company name to the Powered-By page. Do I need to provide some information? Maybe the line will be: LINE(https://line.me/en/) uses Apache Flink for real-time log aggregati

Re: Exception while running Flink jobs (1.0.0)

2016-10-05 Thread Ufuk Celebi
@Tarandeep and Flavio: +1 to Stephan's question. Furthermore, I've created a branch which adds a simple CRC32 checksum calculation over the network buffer content here: https://github.com/uce/flink/tree/checksum It would be great if you could run your job with a build from this branch. It's based

Re: Flink job throws ClassNotFoundException on job restart

2016-10-05 Thread Stephan Ewen
Hi! The master has a temporary regression due to the Work In Progress for the "changing parallelism of savepoints" feature. We'll try and complete the change today, then it should work again. Sorry for the inconvenience. Can you work with a revision from last week for today? Stephan On Wed, Oc

Flink job throws ClassNotFoundException on job restart

2016-10-05 Thread none none
I'm running Flink on YARN with two taskmanagers. I wrote a simple job that consumes messages from Kafka. The job runs on taskmanager 1. When I kill taskmanager 1 (via *kill PID*), the job gets restarted on taskmanager 2. So far so good. But right after starting the consumer the execution fails: ja

Re: Presented Flink use case in Japan

2016-10-05 Thread Stephan Ewen
Hi! Thanks for sharing this. I am happy to say that many of the "weak point" issues are actually being addressed right now, for the next major release, such as: - Change of parallelism via savepoints - Compatibility of savepoints across versions Greetings, Stephan On Tue, Oct 4, 2016 at 1

Re: Processing events through web socket

2016-10-05 Thread Fabian Hueske
Hi, the TextSocketSink is rather meant for demo purposes than to be used in an actual applications. I am not aware of any other built-in source that would provide what you are looking for. You can implement a custom SourceFunction that does what you need. Best, Fabian 2016-10-05 9:48 GMT+02:00 A

Processing events through web socket

2016-10-05 Thread Abdul Salam Shaikh
I am trying to read data over a websocket from a source(For example wss:// brisbane.unipulse.com.au:443/OutboundInterfaces/outbound/statements). But at the moment the implementation of env.socketTextStream only supports plain TCP and has no support for TLS or higher level protocols​. Is there any o