Re: FlinkCEP and SQL?
The documentation should say which parts are supported and which are not. I would say the majority of important features works. Best, Dawid On 11/04/2019 12:40, Esa Heikkinen (TAU) wrote: > > Hi > > > > Thank you. I need to read them. Does this all work in Flink 1.8 now ? > > > > BR Esa > > > > *From:*Dawid Wysakowicz > *Sent:* Thursday, April 11, 2019 12:59 PM > *To:* Esa Heikkinen (TAU) ; Fabian Hueske > > *Cc:* Dian Fu ; jincheng sun > ; user@flink.apache.org > *Subject:* Re: FlinkCEP and SQL? > > > > Hi Esa, > > Have you checked out the flink documentation for this topic[1]? Is > there something you are missing from there? Also the MATCH_RECOGNIZE > is described in the SQL:2016 standard[2]. > > For the Flink CEP library, yes it is inspired by the paper you mentioned. > > Best, > > Dawid > > > > [1] > https://ci.apache.org/projects/flink/flink-docs-release-1.8/dev/table/streaming/match_recognize.html > > [2] > https://standards.iso.org/ittf/PubliclyAvailableStandards/c065143_ISO_IEC_TR_19075-5_2016.zip > > On 11/04/2019 10:52, Esa Heikkinen (TAU) wrote: > > Hi > > > > Is there any good scientific papers about using SQL > MATCH_RECOGNIZE in Flink and CEP ? > > > > The only one good paper about Flink and CEP that I have received > was “Efficient Pattern Matching over Event Streams” (SIGMOD 2008). > Its SASE+ Event Pattern Language (EPL) is best I have met. I have > been told that FlinkCEP is based on this. > > > > BR Esa > > > > *From:*Fabian Hueske <mailto:fhue...@gmail.com> > *Sent:* Thursday, April 11, 2019 11:33 AM > *To:* Esa Heikkinen (TAU) > <mailto:esa.heikki...@tuni.fi> > *Cc:* Dian Fu > <mailto:dian0511...@gmail.com>; jincheng sun > <mailto:sunjincheng...@gmail.com>; > user@flink.apache.org <mailto:user@flink.apache.org> > *Subject:* Re: FlinkCEP and SQL? > > > > Hi Esa, > > > > Flink's implementation of SQL MATCH_RECOGNIZE is based on it's CEP > library, i.e., they share the same implementation. > > > > Best, Fabian > > > > Am Do., 11. Apr. 2019 um 10:29 Uhr schrieb Esa Heikkinen (TAU) > mailto:esa.heikki...@tuni.fi>>: > > Hi > > > > Is SQL CEP based (old) FlinkCEP at all and are SQL CEP and > FlinkCEP completely separate ? > > > > BR Esa > > > > *From:*Dian Fu <mailto:dian0511...@gmail.com>> > *Sent:* Thursday, April 4, 2019 2:37 PM > *To:* Esa Heikkinen (TAU) <mailto:esa.heikki...@tuni.fi>> > *Cc:* jincheng sun <mailto:sunjincheng...@gmail.com>>; user@flink.apache.org > <mailto:user@flink.apache.org> > *Subject:* Re: FlinkCEP and SQL? > > > > Should the all sources be combined into one big table > before operations with SQL CEP? > > > > Yes, you should combine them into one table/stream. > > > > Regards, > > Dian > > > > 在 2019年4月4日，下午7:11，Esa Heikkinen (TAU) > mailto:esa.heikki...@tuni.fi>> 写道： > > > > Hi > > > > Thank you for the information. How this SQL CEP is > applicable for situation where there are many sources with > different type of events ? Should the all sources be > combined into one big table before operations with SQL CEP? > > > > BR Esa > > > > *From:* jincheng sun <mailto:sunjincheng...@gmail.com>> > *Sent:* Thursday, April 4, 2019 1:05 PM > *To:* Esa Heikkinen (TAU) <mailto:esa.heikki...@tuni.fi>> > *Cc:* user@flink.apache.org <mailto:user@flink.apache.org> > *Subject:* Re: FlinkCEP and SQL? > > > > Hi BR Esa, > > CEP is available in Flink SQL, Please the detail > here: > https://ci.apache.org/projects/flink/flink-docs-release-1.7/dev/table/sql.html#pattern-recognition > > Best, > > Jincheng > > > > Esa Heikkinen (TAU) <mailto:esa.heikki...@tuni.fi>> 于2019年4月4日周四 下午4:44写道： > > Hi > > > > What is the situation of FlinkCEP and SQL? > > > > Is it already possible to use SQL in CEP? > > > > Is there any example cases where SQL is used in CEP? > > > > BR Esa > > > signature.asc Description: OpenPGP digital signature
RE: FlinkCEP and SQL?
Hi Thank you. I need to read them. Does this all work in Flink 1.8 now ? BR Esa From: Dawid Wysakowicz Sent: Thursday, April 11, 2019 12:59 PM To: Esa Heikkinen (TAU) ; Fabian Hueske Cc: Dian Fu ; jincheng sun ; user@flink.apache.org Subject: Re: FlinkCEP and SQL? Hi Esa, Have you checked out the flink documentation for this topic[1]? Is there something you are missing from there? Also the MATCH_RECOGNIZE is described in the SQL:2016 standard[2]. For the Flink CEP library, yes it is inspired by the paper you mentioned. Best, Dawid [1] https://ci.apache.org/projects/flink/flink-docs-release-1.8/dev/table/streaming/match_recognize.html [2] https://standards.iso.org/ittf/PubliclyAvailableStandards/c065143_ISO_IEC_TR_19075-5_2016.zip On 11/04/2019 10:52, Esa Heikkinen (TAU) wrote: Hi Is there any good scientific papers about using SQL MATCH_RECOGNIZE in Flink and CEP ? The only one good paper about Flink and CEP that I have received was “Efficient Pattern Matching over Event Streams” (SIGMOD 2008). Its SASE+ Event Pattern Language (EPL) is best I have met. I have been told that FlinkCEP is based on this. BR Esa From: Fabian Hueske <mailto:fhue...@gmail.com> Sent: Thursday, April 11, 2019 11:33 AM To: Esa Heikkinen (TAU) <mailto:esa.heikki...@tuni.fi> Cc: Dian Fu <mailto:dian0511...@gmail.com>; jincheng sun <mailto:sunjincheng...@gmail.com>; user@flink.apache.org<mailto:user@flink.apache.org> Subject: Re: FlinkCEP and SQL? Hi Esa, Flink's implementation of SQL MATCH_RECOGNIZE is based on it's CEP library, i.e., they share the same implementation. Best, Fabian Am Do., 11. Apr. 2019 um 10:29 Uhr schrieb Esa Heikkinen (TAU) mailto:esa.heikki...@tuni.fi>>: Hi Is SQL CEP based (old) FlinkCEP at all and are SQL CEP and FlinkCEP completely separate ? BR Esa From: Dian Fu mailto:dian0511...@gmail.com>> Sent: Thursday, April 4, 2019 2:37 PM To: Esa Heikkinen (TAU) mailto:esa.heikki...@tuni.fi>> Cc: jincheng sun mailto:sunjincheng...@gmail.com>>; user@flink.apache.org<mailto:user@flink.apache.org> Subject: Re: FlinkCEP and SQL? Should the all sources be combined into one big table before operations with SQL CEP? Yes, you should combine them into one table/stream. Regards, Dian 在 2019年4月4日，下午7:11，Esa Heikkinen (TAU) mailto:esa.heikki...@tuni.fi>> 写道： Hi Thank you for the information. How this SQL CEP is applicable for situation where there are many sources with different type of events ? Should the all sources be combined into one big table before operations with SQL CEP? BR Esa From: jincheng sun mailto:sunjincheng...@gmail.com>> Sent: Thursday, April 4, 2019 1:05 PM To: Esa Heikkinen (TAU) mailto:esa.heikki...@tuni.fi>> Cc: user@flink.apache.org<mailto:user@flink.apache.org> Subject: Re: FlinkCEP and SQL? Hi BR Esa, CEP is available in Flink SQL, Please the detail here: https://ci.apache.org/projects/flink/flink-docs-release-1.7/dev/table/sql.html#pattern-recognition Best, Jincheng Esa Heikkinen (TAU) mailto:esa.heikki...@tuni.fi>> 于2019年4月4日周四 下午4:44写道： Hi What is the situation of FlinkCEP and SQL? Is it already possible to use SQL in CEP? Is there any example cases where SQL is used in CEP? BR Esa
Re: FlinkCEP and SQL?
Hi Esa, Have you checked out the flink documentation for this topic[1]? Is there something you are missing from there? Also the MATCH_RECOGNIZE is described in the SQL:2016 standard[2]. For the Flink CEP library, yes it is inspired by the paper you mentioned. Best, Dawid [1] https://ci.apache.org/projects/flink/flink-docs-release-1.8/dev/table/streaming/match_recognize.html [2] https://standards.iso.org/ittf/PubliclyAvailableStandards/c065143_ISO_IEC_TR_19075-5_2016.zip On 11/04/2019 10:52, Esa Heikkinen (TAU) wrote: > > Hi > > > > Is there any good scientific papers about using SQL MATCH_RECOGNIZE in > Flink and CEP ? > > > > The only one good paper about Flink and CEP that I have received was > “Efficient Pattern Matching over Event Streams” (SIGMOD 2008). Its > SASE+ Event Pattern Language (EPL) is best I have met. I have been > told that FlinkCEP is based on this. > > > > BR Esa > > > > *From:*Fabian Hueske > *Sent:* Thursday, April 11, 2019 11:33 AM > *To:* Esa Heikkinen (TAU) > *Cc:* Dian Fu ; jincheng sun > ; user@flink.apache.org > *Subject:* Re: FlinkCEP and SQL? > > > > Hi Esa, > > > > Flink's implementation of SQL MATCH_RECOGNIZE is based on it's CEP > library, i.e., they share the same implementation. > > > > Best, Fabian > > > > Am Do., 11. Apr. 2019 um 10:29 Uhr schrieb Esa Heikkinen (TAU) > mailto:esa.heikki...@tuni.fi>>: > > Hi > > > > Is SQL CEP based (old) FlinkCEP at all and are SQL CEP and > FlinkCEP completely separate ? > > > > BR Esa > > > > *From:*Dian Fu mailto:dian0511...@gmail.com>> > *Sent:* Thursday, April 4, 2019 2:37 PM > *To:* Esa Heikkinen (TAU) <mailto:esa.heikki...@tuni.fi>> > *Cc:* jincheng sun <mailto:sunjincheng...@gmail.com>>; user@flink.apache.org > <mailto:user@flink.apache.org> > *Subject:* Re: FlinkCEP and SQL? > > > > Should the all sources be combined into one big table before > operations with SQL CEP? > > > > Yes, you should combine them into one table/stream. > > > > Regards, > > Dian > > > > 在 2019年4月4日，下午7:11，Esa Heikkinen (TAU) > mailto:esa.heikki...@tuni.fi>> 写道： > > > > Hi > > > > Thank you for the information. How this SQL CEP is applicable > for situation where there are many sources with different type > of events ? Should the all sources be combined into one big > table before operations with SQL CEP? > > > > BR Esa > > > > *From:* jincheng sun <mailto:sunjincheng...@gmail.com>> > *Sent:* Thursday, April 4, 2019 1:05 PM > *To:* Esa Heikkinen (TAU) <mailto:esa.heikki...@tuni.fi>> > *Cc:* user@flink.apache.org <mailto:user@flink.apache.org> > *Subject:* Re: FlinkCEP and SQL? > > > > Hi BR Esa, > > CEP is available in Flink SQL, Please the detail > here: > https://ci.apache.org/projects/flink/flink-docs-release-1.7/dev/table/sql.html#pattern-recognition > > Best, > > Jincheng > > > > Esa Heikkinen (TAU) <mailto:esa.heikki...@tuni.fi>> 于2019年4月4日周四 下午4:44写道： > > Hi > > > > What is the situation of FlinkCEP and SQL? > > > > Is it already possible to use SQL in CEP? > > > > Is there any example cases where SQL is used in CEP? > > > > BR Esa > > > signature.asc Description: OpenPGP digital signature
RE: FlinkCEP and SQL?
Hi Is there any good scientific papers about using SQL MATCH_RECOGNIZE in Flink and CEP ? The only one good paper about Flink and CEP that I have received was “Efficient Pattern Matching over Event Streams” (SIGMOD 2008). Its SASE+ Event Pattern Language (EPL) is best I have met. I have been told that FlinkCEP is based on this. BR Esa From: Fabian Hueske Sent: Thursday, April 11, 2019 11:33 AM To: Esa Heikkinen (TAU) Cc: Dian Fu ; jincheng sun ; user@flink.apache.org Subject: Re: FlinkCEP and SQL? Hi Esa, Flink's implementation of SQL MATCH_RECOGNIZE is based on it's CEP library, i.e., they share the same implementation. Best, Fabian Am Do., 11. Apr. 2019 um 10:29 Uhr schrieb Esa Heikkinen (TAU) mailto:esa.heikki...@tuni.fi>>: Hi Is SQL CEP based (old) FlinkCEP at all and are SQL CEP and FlinkCEP completely separate ? BR Esa From: Dian Fu mailto:dian0511...@gmail.com>> Sent: Thursday, April 4, 2019 2:37 PM To: Esa Heikkinen (TAU) mailto:esa.heikki...@tuni.fi>> Cc: jincheng sun mailto:sunjincheng...@gmail.com>>; user@flink.apache.org<mailto:user@flink.apache.org> Subject: Re: FlinkCEP and SQL? Should the all sources be combined into one big table before operations with SQL CEP? Yes, you should combine them into one table/stream. Regards, Dian 在 2019年4月4日，下午7:11，Esa Heikkinen (TAU) mailto:esa.heikki...@tuni.fi>> 写道： Hi Thank you for the information. How this SQL CEP is applicable for situation where there are many sources with different type of events ? Should the all sources be combined into one big table before operations with SQL CEP? BR Esa From: jincheng sun mailto:sunjincheng...@gmail.com>> Sent: Thursday, April 4, 2019 1:05 PM To: Esa Heikkinen (TAU) mailto:esa.heikki...@tuni.fi>> Cc: user@flink.apache.org<mailto:user@flink.apache.org> Subject: Re: FlinkCEP and SQL? Hi BR Esa, CEP is available in Flink SQL, Please the detail here: https://ci.apache.org/projects/flink/flink-docs-release-1.7/dev/table/sql.html#pattern-recognition Best, Jincheng Esa Heikkinen (TAU) mailto:esa.heikki...@tuni.fi>> 于2019年4月4日周四 下午4:44写道： Hi What is the situation of FlinkCEP and SQL? Is it already possible to use SQL in CEP? Is there any example cases where SQL is used in CEP? BR Esa
Re: FlinkCEP and SQL?
Hi Esa, Flink's implementation of SQL MATCH_RECOGNIZE is based on it's CEP library, i.e., they share the same implementation. Best, Fabian Am Do., 11. Apr. 2019 um 10:29 Uhr schrieb Esa Heikkinen (TAU) < esa.heikki...@tuni.fi>: > Hi > > > > Is SQL CEP based (old) FlinkCEP at all and are SQL CEP and FlinkCEP > completely separate ? > > > > BR Esa > > > > *From:* Dian Fu > *Sent:* Thursday, April 4, 2019 2:37 PM > *To:* Esa Heikkinen (TAU) > *Cc:* jincheng sun ; user@flink.apache.org > *Subject:* Re: FlinkCEP and SQL? > > > > Should the all sources be combined into one big table before operations > with SQL CEP? > > > > Yes, you should combine them into one table/stream. > > > > Regards, > > Dian > > > > 在 2019年4月4日，下午7:11，Esa Heikkinen (TAU) 写道： > > > > Hi > > > > Thank you for the information. How this SQL CEP is applicable for > situation where there are many sources with different type of events ? Should > the all sources be combined into one big table before operations with SQL > CEP? > > > > BR Esa > > > > *From:* jincheng sun > *Sent:* Thursday, April 4, 2019 1:05 PM > *To:* Esa Heikkinen (TAU) > *Cc:* user@flink.apache.org > *Subject:* Re: FlinkCEP and SQL? > > > > Hi BR Esa, > > CEP is available in Flink SQL, Please the detail here: > https://ci.apache.org/projects/flink/flink-docs-release-1.7/dev/table/sql.html#pattern-recognition > > Best, > > Jincheng > > > > Esa Heikkinen (TAU) 于2019年4月4日周四 下午4:44写道： > > Hi > > > > What is the situation of FlinkCEP and SQL? > > > > Is it already possible to use SQL in CEP? > > > > Is there any example cases where SQL is used in CEP? > > > > BR Esa > > >
RE: FlinkCEP and SQL?
Hi Is SQL CEP based (old) FlinkCEP at all and are SQL CEP and FlinkCEP completely separate ? BR Esa From: Dian Fu Sent: Thursday, April 4, 2019 2:37 PM To: Esa Heikkinen (TAU) Cc: jincheng sun ; user@flink.apache.org Subject: Re: FlinkCEP and SQL? Should the all sources be combined into one big table before operations with SQL CEP? Yes, you should combine them into one table/stream. Regards, Dian 在 2019年4月4日，下午7:11，Esa Heikkinen (TAU) mailto:esa.heikki...@tuni.fi>> 写道： Hi Thank you for the information. How this SQL CEP is applicable for situation where there are many sources with different type of events ? Should the all sources be combined into one big table before operations with SQL CEP? BR Esa From: jincheng sun mailto:sunjincheng...@gmail.com>> Sent: Thursday, April 4, 2019 1:05 PM To: Esa Heikkinen (TAU) mailto:esa.heikki...@tuni.fi>> Cc: user@flink.apache.org<mailto:user@flink.apache.org> Subject: Re: FlinkCEP and SQL? Hi BR Esa, CEP is available in Flink SQL, Please the detail here: https://ci.apache.org/projects/flink/flink-docs-release-1.7/dev/table/sql.html#pattern-recognition Best, Jincheng Esa Heikkinen (TAU) mailto:esa.heikki...@tuni.fi>> 于2019年4月4日周四 下午4:44写道： Hi What is the situation of FlinkCEP and SQL? Is it already possible to use SQL in CEP? Is there any example cases where SQL is used in CEP? BR Esa
Re: FlinkCEP and SQL?
> Should the all sources be combined into one big table before operations with > SQL CEP? Yes, you should combine them into one table/stream. Regards, Dian > 在 2019年4月4日，下午7:11，Esa Heikkinen (TAU) 写道： > > Hi > > Thank you for the information. How this SQL CEP is applicable for situation > where there are many sources with different type of events ? Should the all > sources be combined into one big table before operations with SQL CEP? > > BR Esa > > From: jincheng sun > Sent: Thursday, April 4, 2019 1:05 PM > To: Esa Heikkinen (TAU) > Cc: user@flink.apache.org > Subject: Re: FlinkCEP and SQL? > > Hi BR Esa, > CEP is available in Flink SQL, Please the detail here: > https://ci.apache.org/projects/flink/flink-docs-release-1.7/dev/table/sql.html#pattern-recognition > > <https://ci.apache.org/projects/flink/flink-docs-release-1.7/dev/table/sql.html#pattern-recognition> > Best, > Jincheng > > Esa Heikkinen (TAU) mailto:esa.heikki...@tuni.fi>> > 于2019年4月4日周四 下午4:44写道： > Hi > > > > What is the situation of FlinkCEP and SQL? > > > > Is it already possible to use SQL in CEP? > > > > Is there any example cases where SQL is used in CEP? > > > > BR Esa >
RE: FlinkCEP and SQL?
Hi Thank you for the information. How this SQL CEP is applicable for situation where there are many sources with different type of events ? Should the all sources be combined into one big table before operations with SQL CEP? BR Esa From: jincheng sun Sent: Thursday, April 4, 2019 1:05 PM To: Esa Heikkinen (TAU) Cc: user@flink.apache.org Subject: Re: FlinkCEP and SQL? Hi BR Esa, CEP is available in Flink SQL, Please the detail here: https://ci.apache.org/projects/flink/flink-docs-release-1.7/dev/table/sql.html#pattern-recognition Best, Jincheng Esa Heikkinen (TAU) mailto:esa.heikki...@tuni.fi>> 于2019年4月4日周四 下午4:44写道： Hi What is the situation of FlinkCEP and SQL? Is it already possible to use SQL in CEP? Is there any example cases where SQL is used in CEP? BR Esa
Re: FlinkCEP and SQL?
Hi BR Esa, CEP is available in Flink SQL, Please the detail here: https://ci.apache.org/projects/flink/flink-docs-release-1.7/dev/table/sql.html#pattern-recognition Best, Jincheng Esa Heikkinen (TAU) 于2019年4月4日周四 下午4:44写道： > Hi > > > > What is the situation of FlinkCEP and SQL? > > > > Is it already possible to use SQL in CEP? > > > > Is there any example cases where SQL is used in CEP? > > > > BR Esa > > >
FlinkCEP and SQL?
Hi What is the situation of FlinkCEP and SQL? Is it already possible to use SQL in CEP? Is there any example cases where SQL is used in CEP? BR Esa
