Re: [DISCUSS] Apache Calcite Online Meetup January 2021
*Talk duration*: 30 min. ср, 13 янв. 2021 г. в 10:27, Vladimir Ozerov : > Hi Stamatis, Julian, > > Thank you for releasing the slot. Just to be crystal clear - I was very > late with my proposal, and have no urge to present in January. Both January > and April are perfectly fine with me. So please prioritize this talk over > others only if you see a really good reason to do so. In any case, I > confirm that I can present in January. Please find the talk details below. > > *Speaker:* Vladimir Ozerov > *Title:* Apache Calcite integration in Hazelcast IMDG > *Abstract: * > Hazelcast IMDG is a distributed in-memory key-value store. In this talk, I > will present how we used Apache Calcite to create a new distributed SQL > engine that queries Hazelcast IMDG data. > We start with motivation and general design. Then we examine how Hazelcast > IMDG leverages Apache Calcite for query parsing, validation, and > optimization, and why we decided not to use Apache Calcite for JDBC and > query execution. We also discuss several Apache Calcite problems that > negatively affect the integration and propose possible future improvements. > > Regards, > Vladimir. > > ср, 13 янв. 2021 г. в 02:48, Stamatis Zampetakis : > >> Yesterday, I updated our website to also include Vladimir's talk about >> Hazelcast so I think it is better to keep it that way. >> Initially I had in mind something between 2 and 4 talks for this meetup >> (2-3h) so I think we are good to go. >> >> Let's now freeze the agenda to avoid changing it till the last minute. >> I will open up the discussion for the next meetup in another email so we >> start filling the slots for April. >> >> It's definitely useful to have the talks on camera. I will record them via >> Zoom and split them after the meetup. >> If the presenters give their consent I can upload them afterwards to >> Youtube/Vimeo. >> >> Best, >> Stamatis >> >> >> On Wed, Jan 13, 2021 at 12:15 AM Julian Hyde wrote: >> >> > I'm happy to yield my spot (and speak instead in April) if Vladimir is >> > still prepared to talk. I'd love to get his work on Hazelcast >> > integration on the record! >> > >> > By the way, will it be possible to record these talks and post them >> > *as separate items* to (say) YouTube or Vimeo? I think it's important >> > that they are separate, so that people can find the particular talk >> > they are interested in. >> > >> > Julian >> > >> > On Tue, Jan 12, 2021 at 12:17 AM Vladimir Ozerov >> > wrote: >> > > >> > > Hi Stamatis, >> > > >> > > Sorry, my previous email was not clear enough. To clarify - I was >> > thinking >> > > about the mentioned next meetup in April because the schedule for the >> > > January meetup appears to be too packed already (3 talks in 1:30h). I >> > > I am ready to talk in both January and April. Just want to ensure >> that we >> > > do not overwhelm our attendees. >> > > >> > > I'll provide the talk details in the nearest day. >> > > >> > > Regards, >> > > Vladimir. >> > > >> > > вт, 12 янв. 2021 г. в 01:41, Stamatis Zampetakis : >> > > >> > > > That would be great Vladimir, I will update the agenda. >> > > > >> > > > If possible please provide a title, duration, and abstract. >> > > > >> > > > Best, >> > > > Stamatis >> > > > >> > > > On Mon, Jan 11, 2021 at 8:35 PM Vladimir Ozerov > > >> > > > wrote: >> > > > >> > > > > Hi, >> > > > > >> > > > > I can share our experience with Apache Calcite integration into >> > > > Hazelcast >> > > > > distributed SQL engine. >> > > > > >> > > > > Regards, >> > > > > Vladimir >> > > > > >> > > > > Вт, 5 янв. 2021 г. в 00:48, Vineet G : >> > > > > >> > > > > > Hi Stamatis, >> > > > > > >> > > > > > Something has come up and unfortunately I will not be able to >> > present >> > > > the >> > > > > > talk. >> > > > > > >> > > > > > Vineet >> > > > > > >> > > > > > > On Jan 3, 2021, at 1:37 PM, Stamatis Zampetakis < >> > zabe...@gmail.com> >> > > > > > wrote: >> > > > > > > >> > > > > > > I updated the agenda on meetup to include Julian's talk around >> > > > spatial >> > > > > > > queries. >> > > > > > > >> > > > > > > So far we have four presentations lasting approximately 1h45 >> so I >> > > > still >> > > > > > > find the duration reasonable. >> > > > > > > >> > > > > > > Of course if there are more people interested to present >> > something we >> > > > > can >> > > > > > > schedule another meetup in April as Julian suggested. >> > > > > > > I am always happy to see what other people are working on and >> > more >> > > > > > Calcite >> > > > > > > use-cases. >> > > > > > > >> > > > > > > Best, >> > > > > > > Stamatis >> > > > > > > >> > > > > > > On Sun, Jan 3, 2021 at 2:09 AM Julian Hyde < >> > jhyde.apa...@gmail.com> >> > > > > > wrote: >> > > > > > > >> > > > > > >> In other news I’ll be co-presenting (with Mosha >> Pasumansky) >> > a >> > > > talk >> > > > > > >> “Open source SQL - beyond parsers: ZetaSQL and Apache >> Calcite” >> > at >> > > > the >> > > > > > >> Northwest Database Society Annual M
Re: [DISCUSS] Apache Calcite Online Meetup January 2021
Hi Stamatis, Julian, Thank you for releasing the slot. Just to be crystal clear - I was very late with my proposal, and have no urge to present in January. Both January and April are perfectly fine with me. So please prioritize this talk over others only if you see a really good reason to do so. In any case, I confirm that I can present in January. Please find the talk details below. *Speaker:* Vladimir Ozerov *Title:* Apache Calcite integration in Hazelcast IMDG *Abstract: * Hazelcast IMDG is a distributed in-memory key-value store. In this talk, I will present how we used Apache Calcite to create a new distributed SQL engine that queries Hazelcast IMDG data. We start with motivation and general design. Then we examine how Hazelcast IMDG leverages Apache Calcite for query parsing, validation, and optimization, and why we decided not to use Apache Calcite for JDBC and query execution. We also discuss several Apache Calcite problems that negatively affect the integration and propose possible future improvements. Regards, Vladimir. ср, 13 янв. 2021 г. в 02:48, Stamatis Zampetakis : > Yesterday, I updated our website to also include Vladimir's talk about > Hazelcast so I think it is better to keep it that way. > Initially I had in mind something between 2 and 4 talks for this meetup > (2-3h) so I think we are good to go. > > Let's now freeze the agenda to avoid changing it till the last minute. > I will open up the discussion for the next meetup in another email so we > start filling the slots for April. > > It's definitely useful to have the talks on camera. I will record them via > Zoom and split them after the meetup. > If the presenters give their consent I can upload them afterwards to > Youtube/Vimeo. > > Best, > Stamatis > > > On Wed, Jan 13, 2021 at 12:15 AM Julian Hyde wrote: > > > I'm happy to yield my spot (and speak instead in April) if Vladimir is > > still prepared to talk. I'd love to get his work on Hazelcast > > integration on the record! > > > > By the way, will it be possible to record these talks and post them > > *as separate items* to (say) YouTube or Vimeo? I think it's important > > that they are separate, so that people can find the particular talk > > they are interested in. > > > > Julian > > > > On Tue, Jan 12, 2021 at 12:17 AM Vladimir Ozerov > > wrote: > > > > > > Hi Stamatis, > > > > > > Sorry, my previous email was not clear enough. To clarify - I was > > thinking > > > about the mentioned next meetup in April because the schedule for the > > > January meetup appears to be too packed already (3 talks in 1:30h). I > > > I am ready to talk in both January and April. Just want to ensure that > we > > > do not overwhelm our attendees. > > > > > > I'll provide the talk details in the nearest day. > > > > > > Regards, > > > Vladimir. > > > > > > вт, 12 янв. 2021 г. в 01:41, Stamatis Zampetakis : > > > > > > > That would be great Vladimir, I will update the agenda. > > > > > > > > If possible please provide a title, duration, and abstract. > > > > > > > > Best, > > > > Stamatis > > > > > > > > On Mon, Jan 11, 2021 at 8:35 PM Vladimir Ozerov > > > > wrote: > > > > > > > > > Hi, > > > > > > > > > > I can share our experience with Apache Calcite integration into > > > > Hazelcast > > > > > distributed SQL engine. > > > > > > > > > > Regards, > > > > > Vladimir > > > > > > > > > > Вт, 5 янв. 2021 г. в 00:48, Vineet G : > > > > > > > > > > > Hi Stamatis, > > > > > > > > > > > > Something has come up and unfortunately I will not be able to > > present > > > > the > > > > > > talk. > > > > > > > > > > > > Vineet > > > > > > > > > > > > > On Jan 3, 2021, at 1:37 PM, Stamatis Zampetakis < > > zabe...@gmail.com> > > > > > > wrote: > > > > > > > > > > > > > > I updated the agenda on meetup to include Julian's talk around > > > > spatial > > > > > > > queries. > > > > > > > > > > > > > > So far we have four presentations lasting approximately 1h45 > so I > > > > still > > > > > > > find the duration reasonable. > > > > > > > > > > > > > > Of course if there are more people interested to present > > something we > > > > > can > > > > > > > schedule another meetup in April as Julian suggested. > > > > > > > I am always happy to see what other people are working on and > > more > > > > > > Calcite > > > > > > > use-cases. > > > > > > > > > > > > > > Best, > > > > > > > Stamatis > > > > > > > > > > > > > > On Sun, Jan 3, 2021 at 2:09 AM Julian Hyde < > > jhyde.apa...@gmail.com> > > > > > > wrote: > > > > > > > > > > > > > >> In other news I’ll be co-presenting (with Mosha > Pasumansky) > > a > > > > talk > > > > > > >> “Open source SQL - beyond parsers: ZetaSQL and Apache Calcite” > > at > > > > the > > > > > > >> Northwest Database Society Annual Meeting on January 29th. > It’s > > > > > virtual > > > > > > and > > > > > > >> free, but you must sign up to attend. > > > > > > >> > > > > > > >> Julian > > > > > > >> > > > > > > >> [1] https://sites.google.com/view/nwds2021 > > > > > > >>
Re: [DISCUSS] Draft board report for Jan 2021
This draft looks good overall! Thanks Haisheng for your work! -Rui On Tue, Jan 12, 2021 at 3:48 PM Haisheng Yuan wrote: > Stamatis, > Thanks a lot for the numbers you collected, I will add them into the > report. > > Julian, > Thanks for the remind, I will add the mention of new chair and our > tradition of annual rotation. > > Haisheng > > On 2021/01/12 23:29:05, Stamatis Zampetakis wrote: > > Thanks for putting this together Haisheng, looks good. Some minor > comments: > > > > Project activity: possibly mention the usage of Calcite in LinkedIn and > > the Coral project > > Community health: include the new metrics that we discussed during the > > previous board report > > > > If I didn't do any mistake the numbers/names for the period between > > 2020-10-01 and 2021-01-01 are as follows: > > > > "commits by non-committers" (used the query provided by Vladimir) > > +--+++-+ > > | quarter_date | committers | non_committers |total| > > +--+++-+ > > | 2020-10-01 | 118| 36 | 154 | > > > > "top-5 reviewers" > > +-+---+ > > | reviews | committer | > > +-+---+ > > | 7 | Julian Hyde | > > | 7 | Stamatis Zampetakis | > > | 6 | Chunwei Lei | > > | 6 | Ruben Quesada Lopez | > > | 4 | Danny Chan | > > | 4 | Wang Yanlin | > > > > Best, > > Stamatis > > > > On Wed, Jan 13, 2021 at 12:23 AM Francis Chuang < > francischu...@apache.org> > > wrote: > > > > > +1 Thanks for sorting this out, Haisheng! > > > > > > Francis > > > > > > On 13/01/2021 10:20 am, Julian Hyde wrote: > > > > Looks good. I'd add a mention of the new chair, and the fact that we > > > > are continuing our tradition of annual rotation. (And our annual > > > > tradition of talking about the tradition, per > > > > https://whimsy.apache.org/board/minutes/Calcite.html#2020-01-15.) > > > > > > > > On Tue, Jan 12, 2021 at 2:01 PM Haisheng Yuan > wrote: > > > >> > > > >> Attached below is a draft of this month's board report. I plan to > > > submit it on > > > >> Jan 13 (Sorry for the late email). Please let me know if you have > any > > > additions or corrections. > > > >> > > > >> ## Description: > > > >> Apache Calcite is a highly customizable framework for parsing and > > > planning > > > >> queries on data in a wide variety of formats. It allows > database-like > > > access, > > > >> and in particular a SQL interface and advanced query optimization, > for > > > data not > > > >> residing in a traditional database. > > > >> > > > >> Avatica is a sub-project within Calcite and provides a framework for > > > building > > > >> local and remote JDBC and ODBC database drivers. Avatica has an > > > independent > > > >> release schedule and its own repository. > > > >> > > > >> ## Issues: > > > >> There are no issues requiring board attention. > > > >> > > > >> ## Membership Data: > > > >> There are currently 51 committers and 23 PMC members in > > > >> this project. The Committer-to-PMC ratio is roughly 7:3. > > > >> No new committers or PMC members were added in the last 3 months. > > > >> > > > >> ## Project Activity: > > > >> Calcite 1.26.0 was released on 2020-10-06, with important features > such > > > as > > > >> supporting SEARCH operator and Sarg literal, adding PIVOT operator > in > > > SQL, > > > >> adding support for JDK 15 and Guava version 29.0-jre. > > > >> > > > >> On Jan 20th, there will be online meetup for Calcite community with > > > >> presentations covering Calcite concepts, recent work on streams, > > > spatial query > > > >> implementation. > > > >> > > > >> ## Community Health: > > > >> The overall activity in the community has slightly decreased in the > > > past few > > > >> months without this being worrisome. > > > >> > > > >> 153 JIRA tickets created and 94 JIRA tickets closed/resolved in the > > > last 3 > > > >> months, 20% decrease comparing with last quarter. > > > >> > > > >> The fewer number of design discussions and JIRA activities can be > > > explained by > > > >> the holiday season and low number of active committers. > > > >> > > > >> > > > > > >
Re: [DISCUSS] Draft board report for Jan 2021
Stamatis, Thanks a lot for the numbers you collected, I will add them into the report. Julian, Thanks for the remind, I will add the mention of new chair and our tradition of annual rotation. Haisheng On 2021/01/12 23:29:05, Stamatis Zampetakis wrote: > Thanks for putting this together Haisheng, looks good. Some minor comments: > > Project activity: possibly mention the usage of Calcite in LinkedIn and > the Coral project > Community health: include the new metrics that we discussed during the > previous board report > > If I didn't do any mistake the numbers/names for the period between > 2020-10-01 and 2021-01-01 are as follows: > > "commits by non-committers" (used the query provided by Vladimir) > +--+++-+ > | quarter_date | committers | non_committers |total| > +--+++-+ > | 2020-10-01 | 118| 36 | 154 | > > "top-5 reviewers" > +-+---+ > | reviews | committer | > +-+---+ > | 7 | Julian Hyde | > | 7 | Stamatis Zampetakis | > | 6 | Chunwei Lei | > | 6 | Ruben Quesada Lopez | > | 4 | Danny Chan | > | 4 | Wang Yanlin | > > Best, > Stamatis > > On Wed, Jan 13, 2021 at 12:23 AM Francis Chuang > wrote: > > > +1 Thanks for sorting this out, Haisheng! > > > > Francis > > > > On 13/01/2021 10:20 am, Julian Hyde wrote: > > > Looks good. I'd add a mention of the new chair, and the fact that we > > > are continuing our tradition of annual rotation. (And our annual > > > tradition of talking about the tradition, per > > > https://whimsy.apache.org/board/minutes/Calcite.html#2020-01-15.) > > > > > > On Tue, Jan 12, 2021 at 2:01 PM Haisheng Yuan wrote: > > >> > > >> Attached below is a draft of this month's board report. I plan to > > submit it on > > >> Jan 13 (Sorry for the late email). Please let me know if you have any > > additions or corrections. > > >> > > >> ## Description: > > >> Apache Calcite is a highly customizable framework for parsing and > > planning > > >> queries on data in a wide variety of formats. It allows database-like > > access, > > >> and in particular a SQL interface and advanced query optimization, for > > data not > > >> residing in a traditional database. > > >> > > >> Avatica is a sub-project within Calcite and provides a framework for > > building > > >> local and remote JDBC and ODBC database drivers. Avatica has an > > independent > > >> release schedule and its own repository. > > >> > > >> ## Issues: > > >> There are no issues requiring board attention. > > >> > > >> ## Membership Data: > > >> There are currently 51 committers and 23 PMC members in > > >> this project. The Committer-to-PMC ratio is roughly 7:3. > > >> No new committers or PMC members were added in the last 3 months. > > >> > > >> ## Project Activity: > > >> Calcite 1.26.0 was released on 2020-10-06, with important features such > > as > > >> supporting SEARCH operator and Sarg literal, adding PIVOT operator in > > SQL, > > >> adding support for JDK 15 and Guava version 29.0-jre. > > >> > > >> On Jan 20th, there will be online meetup for Calcite community with > > >> presentations covering Calcite concepts, recent work on streams, > > spatial query > > >> implementation. > > >> > > >> ## Community Health: > > >> The overall activity in the community has slightly decreased in the > > past few > > >> months without this being worrisome. > > >> > > >> 153 JIRA tickets created and 94 JIRA tickets closed/resolved in the > > last 3 > > >> months, 20% decrease comparing with last quarter. > > >> > > >> The fewer number of design discussions and JIRA activities can be > > explained by > > >> the holiday season and low number of active committers. > > >> > > >> > > >
Re: [DISCUSS] Apache Calcite Online Meetup January 2021
Yesterday, I updated our website to also include Vladimir's talk about Hazelcast so I think it is better to keep it that way. Initially I had in mind something between 2 and 4 talks for this meetup (2-3h) so I think we are good to go. Let's now freeze the agenda to avoid changing it till the last minute. I will open up the discussion for the next meetup in another email so we start filling the slots for April. It's definitely useful to have the talks on camera. I will record them via Zoom and split them after the meetup. If the presenters give their consent I can upload them afterwards to Youtube/Vimeo. Best, Stamatis On Wed, Jan 13, 2021 at 12:15 AM Julian Hyde wrote: > I'm happy to yield my spot (and speak instead in April) if Vladimir is > still prepared to talk. I'd love to get his work on Hazelcast > integration on the record! > > By the way, will it be possible to record these talks and post them > *as separate items* to (say) YouTube or Vimeo? I think it's important > that they are separate, so that people can find the particular talk > they are interested in. > > Julian > > On Tue, Jan 12, 2021 at 12:17 AM Vladimir Ozerov > wrote: > > > > Hi Stamatis, > > > > Sorry, my previous email was not clear enough. To clarify - I was > thinking > > about the mentioned next meetup in April because the schedule for the > > January meetup appears to be too packed already (3 talks in 1:30h). I > > I am ready to talk in both January and April. Just want to ensure that we > > do not overwhelm our attendees. > > > > I'll provide the talk details in the nearest day. > > > > Regards, > > Vladimir. > > > > вт, 12 янв. 2021 г. в 01:41, Stamatis Zampetakis : > > > > > That would be great Vladimir, I will update the agenda. > > > > > > If possible please provide a title, duration, and abstract. > > > > > > Best, > > > Stamatis > > > > > > On Mon, Jan 11, 2021 at 8:35 PM Vladimir Ozerov > > > wrote: > > > > > > > Hi, > > > > > > > > I can share our experience with Apache Calcite integration into > > > Hazelcast > > > > distributed SQL engine. > > > > > > > > Regards, > > > > Vladimir > > > > > > > > Вт, 5 янв. 2021 г. в 00:48, Vineet G : > > > > > > > > > Hi Stamatis, > > > > > > > > > > Something has come up and unfortunately I will not be able to > present > > > the > > > > > talk. > > > > > > > > > > Vineet > > > > > > > > > > > On Jan 3, 2021, at 1:37 PM, Stamatis Zampetakis < > zabe...@gmail.com> > > > > > wrote: > > > > > > > > > > > > I updated the agenda on meetup to include Julian's talk around > > > spatial > > > > > > queries. > > > > > > > > > > > > So far we have four presentations lasting approximately 1h45 so I > > > still > > > > > > find the duration reasonable. > > > > > > > > > > > > Of course if there are more people interested to present > something we > > > > can > > > > > > schedule another meetup in April as Julian suggested. > > > > > > I am always happy to see what other people are working on and > more > > > > > Calcite > > > > > > use-cases. > > > > > > > > > > > > Best, > > > > > > Stamatis > > > > > > > > > > > > On Sun, Jan 3, 2021 at 2:09 AM Julian Hyde < > jhyde.apa...@gmail.com> > > > > > wrote: > > > > > > > > > > > >> In other news I’ll be co-presenting (with Mosha Pasumansky) > a > > > talk > > > > > >> “Open source SQL - beyond parsers: ZetaSQL and Apache Calcite” > at > > > the > > > > > >> Northwest Database Society Annual Meeting on January 29th. It’s > > > > virtual > > > > > and > > > > > >> free, but you must sign up to attend. > > > > > >> > > > > > >> Julian > > > > > >> > > > > > >> [1] https://sites.google.com/view/nwds2021 > > > > > >> > > > > > >>> On Jan 2, 2021, at 12:47 PM, Julian Hyde < > jhyde.apa...@gmail.com> > > > > > wrote: > > > > > >>> > > > > > >>> I can give a talk “Implementing spatial queries using algebra > > > > > >> rewrites”, 20 minutes. > > > > > >>> > > > > > >>> But if that makes the meetup too long, I am equally happy to > > > postpone > > > > > >> the talk. How about scheduling another meetup in say April? > > > > > >>> > > > > > >>> Julian > > > > > >>> > > > > > On Dec 31, 2020, at 3:10 AM, Stamatis Zampetakis < > > > zabe...@gmail.com > > > > > > > > > > >> wrote: > > > > > > > > > > I just published the event on Meetup [1]. > > > > > > > > > > The agenda is not yet finalized so if there are people who > would > > > > like > > > > > to > > > > > give a talk or add/remove things from the agenda please reply > to > > > > this > > > > > thread. > > > > > > > > > > Best, > > > > > Stamatis > > > > > > > > > > [1] https://www.meetup.com/Apache-Calcite/events/275461117/ > > > > > > > > > > >> On Mon, Nov 30, 2020 at 12:37 AM Rui Wang < > amaliu...@apache.org > > > > > > > > > >> wrote: > > > > > > > > > > > > Title: event timestamp semantic based streaming SQL > > > > > > Abstract: this talk will cover in Calcite Streaming SQL > case, how > > > > to > > >
Re: [DISCUSS] Draft board report for Jan 2021
Thanks for putting this together Haisheng, looks good. Some minor comments: Project activity: possibly mention the usage of Calcite in LinkedIn and the Coral project Community health: include the new metrics that we discussed during the previous board report If I didn't do any mistake the numbers/names for the period between 2020-10-01 and 2021-01-01 are as follows: "commits by non-committers" (used the query provided by Vladimir) +--+++-+ | quarter_date | committers | non_committers |total| +--+++-+ | 2020-10-01 | 118| 36 | 154 | "top-5 reviewers" +-+---+ | reviews | committer | +-+---+ | 7 | Julian Hyde | | 7 | Stamatis Zampetakis | | 6 | Chunwei Lei | | 6 | Ruben Quesada Lopez | | 4 | Danny Chan | | 4 | Wang Yanlin | Best, Stamatis On Wed, Jan 13, 2021 at 12:23 AM Francis Chuang wrote: > +1 Thanks for sorting this out, Haisheng! > > Francis > > On 13/01/2021 10:20 am, Julian Hyde wrote: > > Looks good. I'd add a mention of the new chair, and the fact that we > > are continuing our tradition of annual rotation. (And our annual > > tradition of talking about the tradition, per > > https://whimsy.apache.org/board/minutes/Calcite.html#2020-01-15.) > > > > On Tue, Jan 12, 2021 at 2:01 PM Haisheng Yuan wrote: > >> > >> Attached below is a draft of this month's board report. I plan to > submit it on > >> Jan 13 (Sorry for the late email). Please let me know if you have any > additions or corrections. > >> > >> ## Description: > >> Apache Calcite is a highly customizable framework for parsing and > planning > >> queries on data in a wide variety of formats. It allows database-like > access, > >> and in particular a SQL interface and advanced query optimization, for > data not > >> residing in a traditional database. > >> > >> Avatica is a sub-project within Calcite and provides a framework for > building > >> local and remote JDBC and ODBC database drivers. Avatica has an > independent > >> release schedule and its own repository. > >> > >> ## Issues: > >> There are no issues requiring board attention. > >> > >> ## Membership Data: > >> There are currently 51 committers and 23 PMC members in > >> this project. The Committer-to-PMC ratio is roughly 7:3. > >> No new committers or PMC members were added in the last 3 months. > >> > >> ## Project Activity: > >> Calcite 1.26.0 was released on 2020-10-06, with important features such > as > >> supporting SEARCH operator and Sarg literal, adding PIVOT operator in > SQL, > >> adding support for JDK 15 and Guava version 29.0-jre. > >> > >> On Jan 20th, there will be online meetup for Calcite community with > >> presentations covering Calcite concepts, recent work on streams, > spatial query > >> implementation. > >> > >> ## Community Health: > >> The overall activity in the community has slightly decreased in the > past few > >> months without this being worrisome. > >> > >> 153 JIRA tickets created and 94 JIRA tickets closed/resolved in the > last 3 > >> months, 20% decrease comparing with last quarter. > >> > >> The fewer number of design discussions and JIRA activities can be > explained by > >> the holiday season and low number of active committers. > >> > >> >
Re: [DISCUSS] Draft board report for Jan 2021
+1 Thanks for sorting this out, Haisheng! Francis On 13/01/2021 10:20 am, Julian Hyde wrote: Looks good. I'd add a mention of the new chair, and the fact that we are continuing our tradition of annual rotation. (And our annual tradition of talking about the tradition, per https://whimsy.apache.org/board/minutes/Calcite.html#2020-01-15.) On Tue, Jan 12, 2021 at 2:01 PM Haisheng Yuan wrote: Attached below is a draft of this month's board report. I plan to submit it on Jan 13 (Sorry for the late email). Please let me know if you have any additions or corrections. ## Description: Apache Calcite is a highly customizable framework for parsing and planning queries on data in a wide variety of formats. It allows database-like access, and in particular a SQL interface and advanced query optimization, for data not residing in a traditional database. Avatica is a sub-project within Calcite and provides a framework for building local and remote JDBC and ODBC database drivers. Avatica has an independent release schedule and its own repository. ## Issues: There are no issues requiring board attention. ## Membership Data: There are currently 51 committers and 23 PMC members in this project. The Committer-to-PMC ratio is roughly 7:3. No new committers or PMC members were added in the last 3 months. ## Project Activity: Calcite 1.26.0 was released on 2020-10-06, with important features such as supporting SEARCH operator and Sarg literal, adding PIVOT operator in SQL, adding support for JDK 15 and Guava version 29.0-jre. On Jan 20th, there will be online meetup for Calcite community with presentations covering Calcite concepts, recent work on streams, spatial query implementation. ## Community Health: The overall activity in the community has slightly decreased in the past few months without this being worrisome. 153 JIRA tickets created and 94 JIRA tickets closed/resolved in the last 3 months, 20% decrease comparing with last quarter. The fewer number of design discussions and JIRA activities can be explained by the holiday season and low number of active committers.
Re: [DISCUSS] Draft board report for Jan 2021
Looks good. I'd add a mention of the new chair, and the fact that we are continuing our tradition of annual rotation. (And our annual tradition of talking about the tradition, per https://whimsy.apache.org/board/minutes/Calcite.html#2020-01-15.) On Tue, Jan 12, 2021 at 2:01 PM Haisheng Yuan wrote: > > Attached below is a draft of this month's board report. I plan to submit it on > Jan 13 (Sorry for the late email). Please let me know if you have any > additions or corrections. > > ## Description: > Apache Calcite is a highly customizable framework for parsing and planning > queries on data in a wide variety of formats. It allows database-like access, > and in particular a SQL interface and advanced query optimization, for data > not > residing in a traditional database. > > Avatica is a sub-project within Calcite and provides a framework for building > local and remote JDBC and ODBC database drivers. Avatica has an independent > release schedule and its own repository. > > ## Issues: > There are no issues requiring board attention. > > ## Membership Data: > There are currently 51 committers and 23 PMC members in > this project. The Committer-to-PMC ratio is roughly 7:3. > No new committers or PMC members were added in the last 3 months. > > ## Project Activity: > Calcite 1.26.0 was released on 2020-10-06, with important features such as > supporting SEARCH operator and Sarg literal, adding PIVOT operator in SQL, > adding support for JDK 15 and Guava version 29.0-jre. > > On Jan 20th, there will be online meetup for Calcite community with > presentations covering Calcite concepts, recent work on streams, spatial query > implementation. > > ## Community Health: > The overall activity in the community has slightly decreased in the past few > months without this being worrisome. > > 153 JIRA tickets created and 94 JIRA tickets closed/resolved in the last 3 > months, 20% decrease comparing with last quarter. > > The fewer number of design discussions and JIRA activities can be explained by > the holiday season and low number of active committers. > >
Re: [DISCUSS] Apache Calcite Online Meetup January 2021
I'm happy to yield my spot (and speak instead in April) if Vladimir is still prepared to talk. I'd love to get his work on Hazelcast integration on the record! By the way, will it be possible to record these talks and post them *as separate items* to (say) YouTube or Vimeo? I think it's important that they are separate, so that people can find the particular talk they are interested in. Julian On Tue, Jan 12, 2021 at 12:17 AM Vladimir Ozerov wrote: > > Hi Stamatis, > > Sorry, my previous email was not clear enough. To clarify - I was thinking > about the mentioned next meetup in April because the schedule for the > January meetup appears to be too packed already (3 talks in 1:30h). I > I am ready to talk in both January and April. Just want to ensure that we > do not overwhelm our attendees. > > I'll provide the talk details in the nearest day. > > Regards, > Vladimir. > > вт, 12 янв. 2021 г. в 01:41, Stamatis Zampetakis : > > > That would be great Vladimir, I will update the agenda. > > > > If possible please provide a title, duration, and abstract. > > > > Best, > > Stamatis > > > > On Mon, Jan 11, 2021 at 8:35 PM Vladimir Ozerov > > wrote: > > > > > Hi, > > > > > > I can share our experience with Apache Calcite integration into > > Hazelcast > > > distributed SQL engine. > > > > > > Regards, > > > Vladimir > > > > > > Вт, 5 янв. 2021 г. в 00:48, Vineet G : > > > > > > > Hi Stamatis, > > > > > > > > Something has come up and unfortunately I will not be able to present > > the > > > > talk. > > > > > > > > Vineet > > > > > > > > > On Jan 3, 2021, at 1:37 PM, Stamatis Zampetakis > > > > wrote: > > > > > > > > > > I updated the agenda on meetup to include Julian's talk around > > spatial > > > > > queries. > > > > > > > > > > So far we have four presentations lasting approximately 1h45 so I > > still > > > > > find the duration reasonable. > > > > > > > > > > Of course if there are more people interested to present something we > > > can > > > > > schedule another meetup in April as Julian suggested. > > > > > I am always happy to see what other people are working on and more > > > > Calcite > > > > > use-cases. > > > > > > > > > > Best, > > > > > Stamatis > > > > > > > > > > On Sun, Jan 3, 2021 at 2:09 AM Julian Hyde > > > > wrote: > > > > > > > > > >> In other news I’ll be co-presenting (with Mosha Pasumansky) a > > talk > > > > >> “Open source SQL - beyond parsers: ZetaSQL and Apache Calcite” at > > the > > > > >> Northwest Database Society Annual Meeting on January 29th. It’s > > > virtual > > > > and > > > > >> free, but you must sign up to attend. > > > > >> > > > > >> Julian > > > > >> > > > > >> [1] https://sites.google.com/view/nwds2021 > > > > >> > > > > >>> On Jan 2, 2021, at 12:47 PM, Julian Hyde > > > > wrote: > > > > >>> > > > > >>> I can give a talk “Implementing spatial queries using algebra > > > > >> rewrites”, 20 minutes. > > > > >>> > > > > >>> But if that makes the meetup too long, I am equally happy to > > postpone > > > > >> the talk. How about scheduling another meetup in say April? > > > > >>> > > > > >>> Julian > > > > >>> > > > > On Dec 31, 2020, at 3:10 AM, Stamatis Zampetakis < > > zabe...@gmail.com > > > > > > > > >> wrote: > > > > > > > > I just published the event on Meetup [1]. > > > > > > > > The agenda is not yet finalized so if there are people who would > > > like > > > > to > > > > give a talk or add/remove things from the agenda please reply to > > > this > > > > thread. > > > > > > > > Best, > > > > Stamatis > > > > > > > > [1] https://www.meetup.com/Apache-Calcite/events/275461117/ > > > > > > > > >> On Mon, Nov 30, 2020 at 12:37 AM Rui Wang > > > > > > >> wrote: > > > > > > > > > > Title: event timestamp semantic based streaming SQL > > > > > Abstract: this talk will cover in Calcite Streaming SQL case, how > > > to > > > > >> reason > > > > > data completeness in terms of event timestamp semantic and how to > > > > >> control > > > > > materialization latency given unbounded input data (in Calcite > > > > roadmap > > > > >> but > > > > > not implemented yet). > > > > > > > > > > Duration: 20~30 mins > > > > > > > > > >> On Tue, Nov 24, 2020 at 8:56 AM Slim Bouguerra < > > bs...@apache.org> > > > > >> wrote: > > > > >> > > > > >> this is a great idea thanks @Statmatis looking forward to > > learning > > > > >> more > > > > >> about Calcite especially the Streaming work. > > > > >> > > > > >>> On Mon, Nov 23, 2020 at 2:19 PM Rui Wang > > > > > > >> wrote: > > > > >> > > > > >>> Sorry for the late reply Statmatis. I have recently been pretty > > > > busy > > > > >> on > > > > >>> work as it is approaching the end of the year. > > > > >>> > > > > >>> The time in [1] works perfectly for me. I will share the > > abstract > > > > and > > > > >>> expected duration soon (should within this week). > > > > >
[DISCUSS] Draft board report for Jan 2021
Attached below is a draft of this month's board report. I plan to submit it on Jan 13 (Sorry for the late email). Please let me know if you have any additions or corrections. ## Description: Apache Calcite is a highly customizable framework for parsing and planning queries on data in a wide variety of formats. It allows database-like access, and in particular a SQL interface and advanced query optimization, for data not residing in a traditional database. Avatica is a sub-project within Calcite and provides a framework for building local and remote JDBC and ODBC database drivers. Avatica has an independent release schedule and its own repository. ## Issues: There are no issues requiring board attention. ## Membership Data: There are currently 51 committers and 23 PMC members in this project. The Committer-to-PMC ratio is roughly 7:3. No new committers or PMC members were added in the last 3 months. ## Project Activity: Calcite 1.26.0 was released on 2020-10-06, with important features such as supporting SEARCH operator and Sarg literal, adding PIVOT operator in SQL, adding support for JDK 15 and Guava version 29.0-jre. On Jan 20th, there will be online meetup for Calcite community with presentations covering Calcite concepts, recent work on streams, spatial query implementation. ## Community Health: The overall activity in the community has slightly decreased in the past few months without this being worrisome. 153 JIRA tickets created and 94 JIRA tickets closed/resolved in the last 3 months, 20% decrease comparing with last quarter. The fewer number of design discussions and JIRA activities can be explained by the holiday season and low number of active committers.
[jira] [Created] (CALCITE-4465) Estimate the number of distinct values by filter condition
Liya Fan created CALCITE-4465:
-
Summary: Estimate the number of distinct values by filter condition
Key: CALCITE-4465
URL: https://issues.apache.org/jira/browse/CALCITE-4465
Project: Calcite
Issue Type: Improvement
Components: core
Reporter: Liya Fan
Assignee: Liya Fan
According to our current implementation ({{RelMdDistinctRowCount}}), estimating
the number of distinctive values (NDV) does not make good use of the filter
condition. It simply forwards the call to its input operator with the fiter
condition attached.
In fact, more information can be obtained for some special but commonly used
conditions. For example, given condition {{x = 'a'}}, we can deduce that
{{NDV(x) <= 1}}. Given condition {{x in ('a', 'b')}}, we can deduce that
{{NDV(x) <= 2}}.
More generally, if we have {{x in ('a', 'b') AND y in ('c', 'd', 'e')}}, we
have {{NDV(x, y) <= 2 * 3 = 6}}.
Thoughts?
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
Re: [DISCUSS] Apache Calcite Online Meetup January 2021
Hi Stamatis, Sorry, my previous email was not clear enough. To clarify - I was thinking about the mentioned next meetup in April because the schedule for the January meetup appears to be too packed already (3 talks in 1:30h). I I am ready to talk in both January and April. Just want to ensure that we do not overwhelm our attendees. I'll provide the talk details in the nearest day. Regards, Vladimir. вт, 12 янв. 2021 г. в 01:41, Stamatis Zampetakis : > That would be great Vladimir, I will update the agenda. > > If possible please provide a title, duration, and abstract. > > Best, > Stamatis > > On Mon, Jan 11, 2021 at 8:35 PM Vladimir Ozerov > wrote: > > > Hi, > > > > I can share our experience with Apache Calcite integration into > Hazelcast > > distributed SQL engine. > > > > Regards, > > Vladimir > > > > Вт, 5 янв. 2021 г. в 00:48, Vineet G : > > > > > Hi Stamatis, > > > > > > Something has come up and unfortunately I will not be able to present > the > > > talk. > > > > > > Vineet > > > > > > > On Jan 3, 2021, at 1:37 PM, Stamatis Zampetakis > > > wrote: > > > > > > > > I updated the agenda on meetup to include Julian's talk around > spatial > > > > queries. > > > > > > > > So far we have four presentations lasting approximately 1h45 so I > still > > > > find the duration reasonable. > > > > > > > > Of course if there are more people interested to present something we > > can > > > > schedule another meetup in April as Julian suggested. > > > > I am always happy to see what other people are working on and more > > > Calcite > > > > use-cases. > > > > > > > > Best, > > > > Stamatis > > > > > > > > On Sun, Jan 3, 2021 at 2:09 AM Julian Hyde > > > wrote: > > > > > > > >> In other news I’ll be co-presenting (with Mosha Pasumansky) a > talk > > > >> “Open source SQL - beyond parsers: ZetaSQL and Apache Calcite” at > the > > > >> Northwest Database Society Annual Meeting on January 29th. It’s > > virtual > > > and > > > >> free, but you must sign up to attend. > > > >> > > > >> Julian > > > >> > > > >> [1] https://sites.google.com/view/nwds2021 > > > >> > > > >>> On Jan 2, 2021, at 12:47 PM, Julian Hyde > > > wrote: > > > >>> > > > >>> I can give a talk “Implementing spatial queries using algebra > > > >> rewrites”, 20 minutes. > > > >>> > > > >>> But if that makes the meetup too long, I am equally happy to > postpone > > > >> the talk. How about scheduling another meetup in say April? > > > >>> > > > >>> Julian > > > >>> > > > On Dec 31, 2020, at 3:10 AM, Stamatis Zampetakis < > zabe...@gmail.com > > > > > > >> wrote: > > > > > > I just published the event on Meetup [1]. > > > > > > The agenda is not yet finalized so if there are people who would > > like > > > to > > > give a talk or add/remove things from the agenda please reply to > > this > > > thread. > > > > > > Best, > > > Stamatis > > > > > > [1] https://www.meetup.com/Apache-Calcite/events/275461117/ > > > > > > >> On Mon, Nov 30, 2020 at 12:37 AM Rui Wang > > > > >> wrote: > > > > > > > > Title: event timestamp semantic based streaming SQL > > > > Abstract: this talk will cover in Calcite Streaming SQL case, how > > to > > > >> reason > > > > data completeness in terms of event timestamp semantic and how to > > > >> control > > > > materialization latency given unbounded input data (in Calcite > > > roadmap > > > >> but > > > > not implemented yet). > > > > > > > > Duration: 20~30 mins > > > > > > > >> On Tue, Nov 24, 2020 at 8:56 AM Slim Bouguerra < > bs...@apache.org> > > > >> wrote: > > > >> > > > >> this is a great idea thanks @Statmatis looking forward to > learning > > > >> more > > > >> about Calcite especially the Streaming work. > > > >> > > > >>> On Mon, Nov 23, 2020 at 2:19 PM Rui Wang > > > > >> wrote: > > > >> > > > >>> Sorry for the late reply Statmatis. I have recently been pretty > > > busy > > > >> on > > > >>> work as it is approaching the end of the year. > > > >>> > > > >>> The time in [1] works perfectly for me. I will share the > abstract > > > and > > > >>> expected duration soon (should within this week). > > > >>> > > > >>> > > > >>> -Rui > > > >>> > > > >>> On Fri, Nov 20, 2020 at 2:11 AM Stamatis Zampetakis < > > > >> zabe...@gmail.com > > > >> > > > >>> wrote: > > > >>> > > > That would be great Vineet! > > > > > > @Julian, @Rui, @Vineet: > > > Can you share a small abstract (2-3 sentences) and expected > > > >> duration? > > > Can you check if the date/times proposed previously [1] work > for > > > >> you. > > > >> If > > > not feel free to propose another slot. > > > > > > Best, > > > Stamatis > > > > > > [1] https://s.apache.org/uhrzo > > > > > > On Thu, Nov 19, 2020 at 6:18 PM Vineet Garg > > > >
