Re: What's the current status of pattern matching with Beam SQL?
I do not think anyone plans to work on these issues in the near future. On Sun, Mar 24, 2024 at 6:59 PM Jaehyeon Kim wrote: > Hi XQ > > Thanks for your reply. I had a quick check and there seem to be two > streams of discussions. > > 1. (BEAM-9543) BeamSQL Pattern Recognization Functionality - > https://issues.apache.org/jira/browse/BEAM-9543 > > I see the code is merged but the ticket indicates it is partially > supported due to the time limit for Google Summer of Code 2020. It also > indicates full functionality would be via constructing a CEP (Complex Event > Processing) library, which is discussed in BEAM- 3767 . > > 2. (BEAM-3767) A Complex Event Processing (CEP) library/extension for > Apache Beam - https://issues.apache.org/jira/browse/BEAM-3767 > > The goal is to implement an efficient pattern matching library inspired by > eg) Apache Flink CEP. > > Both the tickets have an associating GitHub issue and no update for more > than 1 year, which means they are not likely to be completed in the near > future? > > Cheers, > Jaehyeon > > > On Sun, 24 Mar 2024 at 12:02, XQ Hu via user wrote: > >> https://beam.apache.org/documentation/dsls/sql/zetasql/overview/ >> and >> >> https://github.com/apache/beam/blob/master/sdks/java/extensions/sql/zetasql/src/main/java/org/apache/beam/sdk/extensions/sql/zetasql/SupportedZetaSqlBuiltinFunctions.java >> for the supported functions. >> >> On Sat, Mar 23, 2024 at 5:50 AM Jaehyeon Kim wrote: >> >>> Hello, >>> >>> I found a blog article about pattern matching with Beam SQL - >>> https://beam.apache.org/blog/pattern-match-beam-sql/. All of the PRs >>> and commits that are included in the post are merged. >>> >>> On the other hand, the Beam Calcite SQL overview page indicates >>> MATCH_RECOGNIZE is not supported ( >>> https://beam.apache.org/documentation/dsls/sql/calcite/overview/). I >>> haven't found a section whether ZetaSQL supports it or not. >>> >>> Can you please inform me if it is supported and relevant resources if so? >>> >>> Cheers, >>> Jaehyeon >>> >>
Re: What's the current status of pattern matching with Beam SQL?
Hi XQ Thanks for your reply. I had a quick check and there seem to be two streams of discussions. 1. (BEAM-9543) BeamSQL Pattern Recognization Functionality - https://issues.apache.org/jira/browse/BEAM-9543 I see the code is merged but the ticket indicates it is partially supported due to the time limit for Google Summer of Code 2020. It also indicates full functionality would be via constructing a CEP (Complex Event Processing) library, which is discussed in BEAM- 3767 . 2. (BEAM-3767) A Complex Event Processing (CEP) library/extension for Apache Beam - https://issues.apache.org/jira/browse/BEAM-3767 The goal is to implement an efficient pattern matching library inspired by eg) Apache Flink CEP. Both the tickets have an associating GitHub issue and no update for more than 1 year, which means they are not likely to be completed in the near future? Cheers, Jaehyeon On Sun, 24 Mar 2024 at 12:02, XQ Hu via user wrote: > https://beam.apache.org/documentation/dsls/sql/zetasql/overview/ > and > > https://github.com/apache/beam/blob/master/sdks/java/extensions/sql/zetasql/src/main/java/org/apache/beam/sdk/extensions/sql/zetasql/SupportedZetaSqlBuiltinFunctions.java > for the supported functions. > > On Sat, Mar 23, 2024 at 5:50 AM Jaehyeon Kim wrote: > >> Hello, >> >> I found a blog article about pattern matching with Beam SQL - >> https://beam.apache.org/blog/pattern-match-beam-sql/. All of the PRs and >> commits that are included in the post are merged. >> >> On the other hand, the Beam Calcite SQL overview page indicates >> MATCH_RECOGNIZE is not supported ( >> https://beam.apache.org/documentation/dsls/sql/calcite/overview/). I >> haven't found a section whether ZetaSQL supports it or not. >> >> Can you please inform me if it is supported and relevant resources if so? >> >> Cheers, >> Jaehyeon >> >
Re: What's the current status of pattern matching with Beam SQL?
https://beam.apache.org/documentation/dsls/sql/zetasql/overview/ and https://github.com/apache/beam/blob/master/sdks/java/extensions/sql/zetasql/src/main/java/org/apache/beam/sdk/extensions/sql/zetasql/SupportedZetaSqlBuiltinFunctions.java for the supported functions. On Sat, Mar 23, 2024 at 5:50 AM Jaehyeon Kim wrote: > Hello, > > I found a blog article about pattern matching with Beam SQL - > https://beam.apache.org/blog/pattern-match-beam-sql/. All of the PRs and > commits that are included in the post are merged. > > On the other hand, the Beam Calcite SQL overview page indicates > MATCH_RECOGNIZE is not supported ( > https://beam.apache.org/documentation/dsls/sql/calcite/overview/). I > haven't found a section whether ZetaSQL supports it or not. > > Can you please inform me if it is supported and relevant resources if so? > > Cheers, > Jaehyeon >
