Re: [flink-cep] Flick CEP support for the group By operator

Hey, As a matter of fact, you do not need a Flink's CEP library to run the same query. The same functionality can be achieved by simple tumbling window with a “median” aggregate (“median" you would have to implement by your self).

Window is not working in streaming

Hello Team, I'm new to Flink and I don't know why window is not working DataStream> window2 = stream2.assignTimestampsAndWatermarks( new AscendingTimestampExtractor>() { public long

Re: understadning kafka connector - rebalance

Hi Avi, No, rebalance is not changing the number of kafka partitions. Lets say you have 6 kafka partitions and your flink parallelism is 8, in this case using rebalance will send records to all downstream operators in a round robin fashion. Regards, Taher Koitawala GS Lab Pune +91

understadning kafka connector - rebalance

Hi Looking at this example , doing the "rebalance" (e.g messageStream.rebalance().map(...) ) operation on heavy load stream wouldn't slow the stream ? is the rebalancing action occurs only

回复：Flink job failing due to "Container is running beyond physical memory limits" error.

I think it is probably related with rockdb memory usage if you have not found OutOfMemory issue before. There already existed a jira ticket [1] for fixing this issue, and you can watch it for updates. :) [1] https://issues.apache.org/jira/browse/FLINK-10884 Best, Zhijiang

Re: Flink Exception - assigned slot container was removed

Hi, It looks that some of your slots were freed during the job execution (possibly due to idle for too long). AFAIK the exception was thrown when a pending Slot request was removed. You can try increase the “Slot.idle.timeout” to mitigate this issue (default is 5, try 360 or higher).

Re: Reset kafka offets to latest on restart

Hi Vishal, Sorry, I didn't notice this requirement, but I can't come up with another solution, unless disable checkpointing or customize your own kafka source function. For the first case, you may have to give up storing states in flink's state backend. For the second one, write your own

Flink Exception - assigned slot container was removed

Hi, I have a Flink application sourcing from a topic in Kafka (400 partitions) and sinking to S3 using bucketingsink and using RocksDb for checkpointing every 2 mins. The Flink app runs with parallelism 400 so that each worker handles a partition. This is using Flink 1.5.2. The Flink cluster

Re: where can I see logs from code

Hi Miki, Thanks for your reply. However I do not see the log written from the code (I do use logback) On Sun, Nov 25, 2018 at 12:30 PM miki haiat wrote: > > You can see the logs in the webUI. > If you click on the Task manager tab you can find the logs > >

Flink with YARN: Error while calling YARN Node Manager to stop container

Hi, I get the follow WARN and Exception in the Job Manager Logs (the job continues). Why do I get this exception and what do I have to consider? I have a flink streaming job which write the data via OutputFormat to Hbase. 2018-11-25 12:08:34,721 WARN org.apache.hadoop.util.NativeCodeLoader

Re: where can I see logs from code

You can see the logs in the webUI. If you click on the Task manager tab you can find the logs http://SERVERADD/#/taskmanager/TM_ID/log On Sun, Nov 25, 2018 at 12:11 PM Avi Levi wrote: > Hi, > Where can I see the logs written by the app code (i.e by the app > developer) ? > > BR > Avi >

where can I see logs from code

Hi, Where can I see the logs written by the app code (i.e by the app developer) ? BR Avi