Re: Is Flink able to do real time stock market analysis?

2018-04-13 Thread Fabian Hueske
- > Thanks > Ivan > *From: *TechnoMage > *Date: *Thursday, 12 April 2018 at 3:21 AM > *To: *Ivan Wang > *Cc: *"user@flink.apache.org" > *Subject: *Re: Is Flink able to do real time stock market analysis? > > I am new to Flink so others may have more complete answer or

Re: Is Flink able to do real time stock market analysis?

2018-04-12 Thread TechnoMage
e code hard to read. I’m thinking about > watermark, but not sure how to do this. > > > -- > Thanks > Ivan > From: TechnoMage > Date: Thursday, 12 April 2018 at 3:21 AM > To: Ivan Wang > Cc: "user@flink.apache.org" > Subject: Re: Is Flink able to do

Re: Is Flink able to do real time stock market analysis?

2018-04-12 Thread Ivan Wang
code hard to read. I’m thinking about watermark, but not sure how to do this. -- Thanks Ivan From: TechnoMage Date: Thursday, 12 April 2018 at 3:21 AM To: Ivan Wang Cc: "user@flink.apache.org" Subject: Re: Is Flink able to do real time stock market analysis? I am new to Flink so

Re: Is Flink able to do real time stock market analysis?

2018-04-11 Thread TechnoMage
I am new to Flink so others may have more complete answer or correct me. If you are counting the events in a tumbling window you will get output at the end of each tumbling window, so a running count of events/window. It sounds like you want to compare the raw data to the smoothed data? You ca

Is Flink able to do real time stock market analysis?

2018-04-10 Thread Ivan Wang
Hi all, I've spent nearly 2 weeks trying to figure a solution to my requirement as below. If anyone can advise, that would be great. 1. There're going to be 2000 transactions per second as StreamRaw, I'm going to tumbleWindow them as StreamA, let's say every 15 seconds. Then I'm going to countWin