How to output a Table to Kafka?

2018-04-08 Thread chi ma
Hi, I'm a newbie to Flink. I'm trying to load data from HDFS and analyze it using Flink Table APIs. I created a TableSource, and registered it into the StreamTableEnvironment as a table, and ran a SQL on that table through streamTableEnvironment.sqlQuery, and finally I called writeToSink to write

assign time attribute after first window group when using Flink SQL

2018-04-08 Thread Ivan Wang
Hi all, I'd like to use 2 window group in a chain in my program as below. Table myTable = cTable .window(Tumble.*over*("15.seconds").on("timeMill").as("w1")) .groupBy("symbol, w1").select("w1.start as start, w1.end as end, symbol, price.max as p_max, price.min as p_min")

Re: sharebuffer prune code

2018-04-08 Thread aitozi
OK, i will post a jira later. and i am foucs on cep library recently, and run into a little bug, and can you share some progress about the community of cep library and what feature you are working on thanks -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Re: java.lang.Exception: TaskManager was lost/killed

2018-04-08 Thread TechnoMage
I have seen this when my task manager ran out of RAM. Increase the heap size. flink-conf.yaml: taskmanager.heap.mb jobmanager.heap.mb Michael > On Apr 8, 2018, at 2:36 AM, 王凯 wrote: > > > hi all, recently, i found a problem,it runs well when start. But after long > run,the exception displa

Re: Tracking deserialization errors

2018-04-08 Thread Alexander Smirnov
I have the same question. In case of kafka source, it would be good to know topic name and offset of the corrupted message for further investigation. Looks like the only option is to write messages into a log file On Fri, Apr 6, 2018 at 9:12 PM Elias Levy wrote: > I was wondering how are folks t

java.lang.Exception: TaskManager was lost/killed

2018-04-08 Thread 王凯
hi all, recently, i found a problem,it runs well when start. But after long run,the exception display as above,how can resolve it?