[ https://issues.apache.org/jira/browse/SPARK-14745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251353#comment-15251353 ]
Mario Briggs commented on SPARK-14745: -------------------------------------- Hi Sean, thanks for 'fixing' the target. To answer you question, right now the code contains a first cut minimal implementation that i am hoping others can comment on if there are more efficient approaches to implement (a). Then there is the task of seeing how to fit in with structured streaming, now that quite a bit of info is available on this topic (b). Both b and a would led us to be in a better position to answer your question. For example with b, would that be a UDF or not and if so what that means for the implementation and users w.r.t to perf and/or ease of use. Also in the initial structured streaming proposal (https://issues.apache.org/jira/secure/attachment/12793419/StreamingDataFrameProposal.pdf) the 'Event- trigger' section kind of left the impression to me that it was aiming at pattern matching ( I am not yet up-todate on the new one), so curious on that. Finally if 'a' leads to some more options, those might lead to looking at some changes that make sense. Sorry for the slightly long-winded answer, but i hope it gives an idea of current options. > CEP support in Spark Streaming > ------------------------------ > > Key: SPARK-14745 > URL: https://issues.apache.org/jira/browse/SPARK-14745 > Project: Spark > Issue Type: New Feature > Components: Streaming > Reporter: Mario Briggs > Attachments: SparkStreamingCEP.pdf > > > Complex Event Processing is a often used feature in Streaming applications. > Spark Streaming current does not have a DSL/API for it. This JIRA is about > how/what can we add in Spark Streaming to support CEP out of the box -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org