Cool, thanks!
I am able to verify the Execution Query Plan on this example:
https://github.com/felipegutierrez/flink-first/blob/master/src/main/java/flink/example/streaming/SocketWindowWordCountFilterJava.java
I am also going to build a little POC like you said.
Thanks,
Felipe
*--*
*-- Felipe Gut
Hi Felipe,
You can define TableSources (for SQL, Table API) that support filter
push-down.
The optimizer will figure out this opportunity and hand filters to a custom
TableSource.
I should add that AFAIK this feature is not used very often (expect some
rough edges) and that the API is likely to c
I guess this message from 2016 is very related of what I am looking for (
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-Execution-Plan-td4290.html).
I am posting here for future references.
I am going to implement a toy example to visualize this. Do you guys see
this de
thanks Kostas for the quick reply,
yes. It is related to my previous question.
When you said "But if you know what operation to push down" -> This is what
I am trying to search on Flink code. I want to know the operation on the
fly.
The component on Flink that will say to me that there is a filte
Hi again,
I forgot to say that, unfortunately, I am not familiar with Apache Edgent,
but if you can write your filter in Edgent's programming model,
Then you can push your data from Edgent to a third party storage system
(e.g. Kafka, HDFS, etc) and use Flink's connectors, instead of
having to impl
Hi Felipe,
This seems related to your previous question about a custom scheduler that
knows which task to run on which machine.
As Chesnay said, this is a rather involved and laborious task, if you want
to do it as a general framework.
But if you know what operation to push down, then why not dec
Hi,
I am trying to design a little prototype with Flink and Apache Edgent (
http://edgent.apache.org/) and I would like some help on the direction for
it. I am running Flink at my laptop and Edgent on my Raspberry Pi with a
simple filter for a proximity sensor (
https://github.com/felipegutierrez/
