Re: [DISCUSS] Towards Calcite 1.35.0

2023-07-04 Thread Guillaume Masse
I finished CALCITE-5701 Add NAMED_STRUCT function (enabled in Spark library)
I hope it's not too late for the release:
https://github.com/apache/calcite/pull/3295

The CI passes, it just needs a re-run on the last commit.

On Fri, Jun 30, 2023 at 5:26 PM Gian Merlino  wrote:

> Of the open tickets, I reviewed CALCITE-5708 and CALCITE-5727, which are
> two I felt I understood well enough to review.
>
> On 2023/06/28 19:36:16 Julian Hyde wrote:
> > I have taken care of 1, 2, 3, 4.
> >
> > Tanner, can you do 5.
> >
> > Of the 12 open issues that are open and have fixVersion = 1.35, most
> have PRs ready for review [1]. Can a few committers each take say 3 cases
> each and review their PRs?
> >
> > Julian
> >
> > [1]
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20CALCITE%20AND%20fixVersion%20%3D%201.35.0%20and%20status%20%3D%20open
> >
> > > On Jun 28, 2023, at 6:25 AM, Ruben Q L  wrote:
> > >
> > > Hello,
> > >
> > > Thanks for checking Xiong Duan, I have taken care of 6,7,8.
> > >
> > > Contributors, please remember that after completing a ticket, the Jira
> > > needs to be set to "Resolved", not "Closed" (they will be moved to
> Closed
> > > by the Release Manager, once the next release is produced).
> > >
> > > Apart from that, our dashboard [1] still shows 22 unresolved tickets
> with
> > > fixVersion=1.35
> > > Except from the blocker ones, I guess the rest would need to be
> resolved
> > > shortly or otherwise moved to fixVersion=1.36 (or no fixVersion).
> > > As a general rule, please do not set a fixVersion unless it is a
> blocker
> > > issue, or you're reasonably sure that the issue will be done for the
> next
> > > release.
> > >
> > > Best,
> > > Ruben
> > >
> > > [1]
> > >
> https://issues.apache.org/jira/secure/Dashboard.jspa?selectPageId=12333950
> > >
> > >
> > >
> > >
> > > On Wed, Jun 28, 2023 at 1:47 PM xiong duan 
> wrote:
> > >
> > >> In order to release 1.35.0, I reviewed all the fixed issues in this
> > >> version, Here are some issue statuses that need to be resolved:
> > >>
> > >>
> > >>   1. https://issues.apache.org/jira/browse/CALCITE-5764(The PR has
> > >>   merge.But issue is IN PROGRESS). (Assigine Julian Hyde)
> > >>   2. https://issues.apache.org/jira/browse/CALCITE-5706(The PR has
> > >>   merge.But issue is IN PROGRESS). (Assigine Julian Hyde)
> > >>   3. https://issues.apache.org/jira/browse/CALCITE-5765(The PR has
> > >>   merge.But issue is IN PROGRESS). (Assigine Julian Hyde)
> > >>   4. https://issues.apache.org/jira/browse/CALCITE-5762(The PR has
> > >>   merge.But issue is IN PROGRESS). (Assigine Julian Hyde)
> > >>   5. https://issues.apache.org/jira/browse/CALCITE-5747(The PR has
> > >>   merge.But issue is NOT Resolve). (Assigine Tanner Clary)
> > >>   6. https://issues.apache.org/jira/browse/CALCITE-5771(The Fix
> Version
> > >> is
> > >>   NONE, Need set it to 1.35.0)
> > >>   7. https://issues.apache.org/jira/browse/CALCITE-5757(The Fix
> Version
> > >> is
> > >>   NONE, Need set it to 1.35.0)
> > >>   8. https://issues.apache.org/jira/browse/CALCITE-4679(Resolution
> should
> > >>   be Fixed. But is Resolved)
> > >>
> > >> If you are busy, Please tell me the real status of the ISSUE, and I
> will
> > >> handle it. (6,7,8 need one PMC to handle it).Thanks.
> > >>
> > >>
> > >> Jacky Lau  于2023年6月26日周一 14:24写道:
> > >>
> > >>> hi @xiong duan:
> > >>>thanks for your review and merged very much, and i forgot there
> are
> > >>> also have one pr https://github.com/apache/calcite/pull/3262
> > >>>do you also have time to have a look?
> > >>>
> > >>>
> > >>> xiong duan  于2023年6月25日周日 19:45写道:
> > >>>
> >  I have reviewed:
> >  https://github.com/apache/calcite/pull/3238
> >  https://github.com/apache/calcite/pull/3263
> >  If no other problem, I will merge it tomorrow.
> > 
> >  Ruben Q L  于2023年6月25日周日 17:20写道:
> > 
> > > I'd like to include CALCITE-5789 in 1.35. I'll try to finalize it
> > > today/tomorrow.
> > >
> > >
> > >
> > > El dom, 25 jun 2023, 6:33, Jacky Lau 
> > >> escribió:
> > >
> > >> could we review this pr, so that it could be merged in 1.35. then
> > >> the
> > > 1.35
> > >> will almost have the full spark  collection function.
> > >> I would very appreciate a review. if someone has time.
> > >>
> > >> https://github.com/apache/calcite/pull/3238
> > >> https://github.com/apache/calcite/pull/3263
> > >>
> > >> xiong duan  于2023年6月25日周日 10:31写道:
> > >>
> > >>> I have created CALCITE-5797 to release 1.35.0. If there are no
> > >> objections,
> > >>> I will create an RC in the following days.
> > >>>
> > >>> [1]:https://issues.apache.org/jira/browse/CALCITE-5797
> > >>>
> > >>> If there are other must fix for 1.35.0 please let us know so that
> > >>> we
> > > can
> > >>> plan accordingly.
> > >>>
> > >>> Julian Hyde  于2023年6月24日周六 01:58写道:
> > >>>
> >  We said ‘mid-June’. Time to get 

Re: [ANNOUNCE] New committer: Dan Zou

2023-07-04 Thread Jiajun Xie
Congratulations, Dan!

On Tue, 4 Jul 2023 at 19:48, Runkang He  wrote:

> Congratulations, Dan!
>
> Best,
> Runkang He
>
> Jacky Lau  于2023年7月4日周二 18:56写道:
>
> > Congratulations, Dan!
> >
> > Best Jacky!
> >
> > Benchao Li  于2023年7月4日周二 17:55写道:
> >
> > > Congratulations, Dan!
> > >
> > > Zhe Hu  于2023年7月4日周二 17:26写道:
> > >
> > > > Congrats! Dan.
> > > >  Replied Message 
> > > > | From | Francis Chuang |
> > > > | Date | 07/04/2023 15:18 |
> > > > | To | dev |
> > > > | Subject | Re: [ANNOUNCE] New committer: Dan Zou |
> > > > Congrats, Dan!
> > > >
> > > > On 4/07/2023 5:16 pm, Stamatis Zampetakis wrote:
> > > > > Apache Calcite's Project Management Committee (PMC) has invited Dan
> > Zou
> > > > to
> > > > > become a committer, and we are pleased to announce that they have
> > > > accepted.
> > > > >
> > > > > Dan has been doing some great work for the project over the past
> few
> > > > > months. They implemented and enabled multiple new SQL functions for
> > > > > BigQuery and MSSQL dialects, fixed some optimization rules, and
> > > > > improved documentation and test code.
> > > > >
> > > > > Dan, welcome, thank you for your contributions, and we look forward
> > to
> > > > your
> > > > > further interactions with the community! If you wish, please feel
> > free
> > > > to tell
> > > > > us more about yourself and what you are working on.
> > > > >
> > > > > As your first commit, please add yourself to the contributors list
> > [1]
> > > > > and the community page will re-generate [2].
> > > > >
> > > > > Stamatis (on behalf of the Apache Calcite PMC)
> > > > >
> > > > > [1]
> > > >
> > https://github.com/apache/calcite/blob/main/site/_data/contributors.yml
> > > > > [2] https://calcite.apache.org/community/#project-members
> > > >
> > >
> > >
> > > --
> > >
> > > Best,
> > > Benchao Li
> > >
> >
>


Re: [ANNOUNCE] New committer: TJ Banghart

2023-07-04 Thread Jiajun Xie
Congratulations, TJ!

On Wed, 5 Jul 2023 at 01:03, Tanner Clary 
wrote:

> Congrats and welcome, TJ!!
> On Tue, Jul 4, 2023 at 8:26 AM Runkang He  wrote:
>
> > Congratulations, TJ!
> >
> > Best, Runkang He
> >
> > xiong duan  于2023年7月4日周二 19:39写道:
> >
> > > Congratulations, TJ! Welcome!
> > >
> > > Jacky Lau  于2023年7月4日周二 18:56写道:
> > >
> > > > Congratulations, TJ!
> > > >
> > > > Best Jacky!
> > > >
> > > > Benchao Li  于2023年7月4日周二 17:55写道:
> > > >
> > > > > Congratulations, TJ!
> > > > >
> > > > > Zhe Hu  于2023年7月4日周二 17:26写道:
> > > > >
> > > > > > Congrats! TJ.
> > > > > >  Replied Message 
> > > > > > | From | Francis Chuang |
> > > > > > | Date | 07/04/2023 15:18 |
> > > > > > | To | dev |
> > > > > > | Subject | Re: [ANNOUNCE] New committer: TJ Banghart |
> > > > > > Congrats, TJ!
> > > > > >
> > > > > > On 4/07/2023 5:17 pm, Stamatis Zampetakis wrote:
> > > > > > > Apache Calcite's Project Management Committee (PMC) has invited
> > TJ
> > > > > > Banghart to
> > > > > > > become a committer, and we are pleased to announce that they
> have
> > > > > > accepted.
> > > > > > >
> > > > > > > TJ has been contributing to the community for about a year now.
> > > They
> > > > > > > introduced many new SQL functions for parsing and formatting
> > dates,
> > > > > > > times, and timestamps extending the capabilities of the
> BigQuery
> > > > > > > dialect. Furthermore, they pushed various improvements around
> > JSON
> > > > > > > serialization and deserialization, JDBC metadata, and lexical
> > > > > > > policies.
> > > > > > >
> > > > > > > TJ, welcome, thank you for your contributions, and we look
> > forward
> > > to
> > > > > > your
> > > > > > > further interactions with the community! If you wish, please
> feel
> > > > free
> > > > > > to tell
> > > > > > > us more about yourself and what you are working on.
> > > > > > >
> > > > > > > As your first commit, please add yourself to the contributors
> > list
> > > > [1]
> > > > > > > and the community page will re-generate [2].
> > > > > > >
> > > > > > > Stamatis (on behalf of the Apache Calcite PMC)
> > > > > > >
> > > > > > > [1]
> > > > > >
> > > >
> > https://github.com/apache/calcite/blob/main/site/_data/contributors.yml
> > > > > > > [2] https://calcite.apache.org/community/#project-members
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > >
> > > > > Best,
> > > > > Benchao Li
> > > > >
> > > >
> > >
> >
>


Jenkins build is back to normal : Calcite » Calcite-snapshots #514

2023-07-04 Thread Apache Jenkins Server
See 




Re: [ANNOUNCE] New committer: TJ Banghart

2023-07-04 Thread Tanner Clary
Congrats and welcome, TJ!!
On Tue, Jul 4, 2023 at 8:26 AM Runkang He  wrote:

> Congratulations, TJ!
>
> Best, Runkang He
>
> xiong duan  于2023年7月4日周二 19:39写道:
>
> > Congratulations, TJ! Welcome!
> >
> > Jacky Lau  于2023年7月4日周二 18:56写道:
> >
> > > Congratulations, TJ!
> > >
> > > Best Jacky!
> > >
> > > Benchao Li  于2023年7月4日周二 17:55写道:
> > >
> > > > Congratulations, TJ!
> > > >
> > > > Zhe Hu  于2023年7月4日周二 17:26写道:
> > > >
> > > > > Congrats! TJ.
> > > > >  Replied Message 
> > > > > | From | Francis Chuang |
> > > > > | Date | 07/04/2023 15:18 |
> > > > > | To | dev |
> > > > > | Subject | Re: [ANNOUNCE] New committer: TJ Banghart |
> > > > > Congrats, TJ!
> > > > >
> > > > > On 4/07/2023 5:17 pm, Stamatis Zampetakis wrote:
> > > > > > Apache Calcite's Project Management Committee (PMC) has invited
> TJ
> > > > > Banghart to
> > > > > > become a committer, and we are pleased to announce that they have
> > > > > accepted.
> > > > > >
> > > > > > TJ has been contributing to the community for about a year now.
> > They
> > > > > > introduced many new SQL functions for parsing and formatting
> dates,
> > > > > > times, and timestamps extending the capabilities of the BigQuery
> > > > > > dialect. Furthermore, they pushed various improvements around
> JSON
> > > > > > serialization and deserialization, JDBC metadata, and lexical
> > > > > > policies.
> > > > > >
> > > > > > TJ, welcome, thank you for your contributions, and we look
> forward
> > to
> > > > > your
> > > > > > further interactions with the community! If you wish, please feel
> > > free
> > > > > to tell
> > > > > > us more about yourself and what you are working on.
> > > > > >
> > > > > > As your first commit, please add yourself to the contributors
> list
> > > [1]
> > > > > > and the community page will re-generate [2].
> > > > > >
> > > > > > Stamatis (on behalf of the Apache Calcite PMC)
> > > > > >
> > > > > > [1]
> > > > >
> > >
> https://github.com/apache/calcite/blob/main/site/_data/contributors.yml
> > > > > > [2] https://calcite.apache.org/community/#project-members
> > > > >
> > > >
> > > >
> > > > --
> > > >
> > > > Best,
> > > > Benchao Li
> > > >
> > >
> >
>


Re: [ANNOUNCE] New committer: TJ Banghart

2023-07-04 Thread Runkang He
Congratulations, TJ!

Best, Runkang He

xiong duan  于2023年7月4日周二 19:39写道:

> Congratulations, TJ! Welcome!
>
> Jacky Lau  于2023年7月4日周二 18:56写道:
>
> > Congratulations, TJ!
> >
> > Best Jacky!
> >
> > Benchao Li  于2023年7月4日周二 17:55写道:
> >
> > > Congratulations, TJ!
> > >
> > > Zhe Hu  于2023年7月4日周二 17:26写道:
> > >
> > > > Congrats! TJ.
> > > >  Replied Message 
> > > > | From | Francis Chuang |
> > > > | Date | 07/04/2023 15:18 |
> > > > | To | dev |
> > > > | Subject | Re: [ANNOUNCE] New committer: TJ Banghart |
> > > > Congrats, TJ!
> > > >
> > > > On 4/07/2023 5:17 pm, Stamatis Zampetakis wrote:
> > > > > Apache Calcite's Project Management Committee (PMC) has invited TJ
> > > > Banghart to
> > > > > become a committer, and we are pleased to announce that they have
> > > > accepted.
> > > > >
> > > > > TJ has been contributing to the community for about a year now.
> They
> > > > > introduced many new SQL functions for parsing and formatting dates,
> > > > > times, and timestamps extending the capabilities of the BigQuery
> > > > > dialect. Furthermore, they pushed various improvements around JSON
> > > > > serialization and deserialization, JDBC metadata, and lexical
> > > > > policies.
> > > > >
> > > > > TJ, welcome, thank you for your contributions, and we look forward
> to
> > > > your
> > > > > further interactions with the community! If you wish, please feel
> > free
> > > > to tell
> > > > > us more about yourself and what you are working on.
> > > > >
> > > > > As your first commit, please add yourself to the contributors list
> > [1]
> > > > > and the community page will re-generate [2].
> > > > >
> > > > > Stamatis (on behalf of the Apache Calcite PMC)
> > > > >
> > > > > [1]
> > > >
> > https://github.com/apache/calcite/blob/main/site/_data/contributors.yml
> > > > > [2] https://calcite.apache.org/community/#project-members
> > > >
> > >
> > >
> > > --
> > >
> > > Best,
> > > Benchao Li
> > >
> >
>


Re: [ANNOUNCE] New committer: Dan Zou

2023-07-04 Thread Runkang He
Congratulations, Dan!

Best,
Runkang He

Jacky Lau  于2023年7月4日周二 18:56写道:

> Congratulations, Dan!
>
> Best Jacky!
>
> Benchao Li  于2023年7月4日周二 17:55写道:
>
> > Congratulations, Dan!
> >
> > Zhe Hu  于2023年7月4日周二 17:26写道:
> >
> > > Congrats! Dan.
> > >  Replied Message 
> > > | From | Francis Chuang |
> > > | Date | 07/04/2023 15:18 |
> > > | To | dev |
> > > | Subject | Re: [ANNOUNCE] New committer: Dan Zou |
> > > Congrats, Dan!
> > >
> > > On 4/07/2023 5:16 pm, Stamatis Zampetakis wrote:
> > > > Apache Calcite's Project Management Committee (PMC) has invited Dan
> Zou
> > > to
> > > > become a committer, and we are pleased to announce that they have
> > > accepted.
> > > >
> > > > Dan has been doing some great work for the project over the past few
> > > > months. They implemented and enabled multiple new SQL functions for
> > > > BigQuery and MSSQL dialects, fixed some optimization rules, and
> > > > improved documentation and test code.
> > > >
> > > > Dan, welcome, thank you for your contributions, and we look forward
> to
> > > your
> > > > further interactions with the community! If you wish, please feel
> free
> > > to tell
> > > > us more about yourself and what you are working on.
> > > >
> > > > As your first commit, please add yourself to the contributors list
> [1]
> > > > and the community page will re-generate [2].
> > > >
> > > > Stamatis (on behalf of the Apache Calcite PMC)
> > > >
> > > > [1]
> > >
> https://github.com/apache/calcite/blob/main/site/_data/contributors.yml
> > > > [2] https://calcite.apache.org/community/#project-members
> > >
> >
> >
> > --
> >
> > Best,
> > Benchao Li
> >
>


Re: [ANNOUNCE] New committer: TJ Banghart

2023-07-04 Thread xiong duan
Congratulations, TJ! Welcome!

Jacky Lau  于2023年7月4日周二 18:56写道:

> Congratulations, TJ!
>
> Best Jacky!
>
> Benchao Li  于2023年7月4日周二 17:55写道:
>
> > Congratulations, TJ!
> >
> > Zhe Hu  于2023年7月4日周二 17:26写道:
> >
> > > Congrats! TJ.
> > >  Replied Message 
> > > | From | Francis Chuang |
> > > | Date | 07/04/2023 15:18 |
> > > | To | dev |
> > > | Subject | Re: [ANNOUNCE] New committer: TJ Banghart |
> > > Congrats, TJ!
> > >
> > > On 4/07/2023 5:17 pm, Stamatis Zampetakis wrote:
> > > > Apache Calcite's Project Management Committee (PMC) has invited TJ
> > > Banghart to
> > > > become a committer, and we are pleased to announce that they have
> > > accepted.
> > > >
> > > > TJ has been contributing to the community for about a year now. They
> > > > introduced many new SQL functions for parsing and formatting dates,
> > > > times, and timestamps extending the capabilities of the BigQuery
> > > > dialect. Furthermore, they pushed various improvements around JSON
> > > > serialization and deserialization, JDBC metadata, and lexical
> > > > policies.
> > > >
> > > > TJ, welcome, thank you for your contributions, and we look forward to
> > > your
> > > > further interactions with the community! If you wish, please feel
> free
> > > to tell
> > > > us more about yourself and what you are working on.
> > > >
> > > > As your first commit, please add yourself to the contributors list
> [1]
> > > > and the community page will re-generate [2].
> > > >
> > > > Stamatis (on behalf of the Apache Calcite PMC)
> > > >
> > > > [1]
> > >
> https://github.com/apache/calcite/blob/main/site/_data/contributors.yml
> > > > [2] https://calcite.apache.org/community/#project-members
> > >
> >
> >
> > --
> >
> > Best,
> > Benchao Li
> >
>


Re: [ANNOUNCE] New committer: Dan Zou

2023-07-04 Thread xiong duan
Congratulations, Dan! Welcome.

Jacky Lau  于2023年7月4日周二 18:56写道:

> Congratulations, Dan!
>
> Best Jacky!
>
> Benchao Li  于2023年7月4日周二 17:55写道:
>
> > Congratulations, Dan!
> >
> > Zhe Hu  于2023年7月4日周二 17:26写道:
> >
> > > Congrats! Dan.
> > >  Replied Message 
> > > | From | Francis Chuang |
> > > | Date | 07/04/2023 15:18 |
> > > | To | dev |
> > > | Subject | Re: [ANNOUNCE] New committer: Dan Zou |
> > > Congrats, Dan!
> > >
> > > On 4/07/2023 5:16 pm, Stamatis Zampetakis wrote:
> > > > Apache Calcite's Project Management Committee (PMC) has invited Dan
> Zou
> > > to
> > > > become a committer, and we are pleased to announce that they have
> > > accepted.
> > > >
> > > > Dan has been doing some great work for the project over the past few
> > > > months. They implemented and enabled multiple new SQL functions for
> > > > BigQuery and MSSQL dialects, fixed some optimization rules, and
> > > > improved documentation and test code.
> > > >
> > > > Dan, welcome, thank you for your contributions, and we look forward
> to
> > > your
> > > > further interactions with the community! If you wish, please feel
> free
> > > to tell
> > > > us more about yourself and what you are working on.
> > > >
> > > > As your first commit, please add yourself to the contributors list
> [1]
> > > > and the community page will re-generate [2].
> > > >
> > > > Stamatis (on behalf of the Apache Calcite PMC)
> > > >
> > > > [1]
> > >
> https://github.com/apache/calcite/blob/main/site/_data/contributors.yml
> > > > [2] https://calcite.apache.org/community/#project-members
> > >
> >
> >
> > --
> >
> > Best,
> > Benchao Li
> >
>


Re: Draft: board report for 2023 Q2

2023-07-04 Thread Ruben Q L
+1
Thanks Stamatis for preparing it!

On Tue, Jul 4, 2023 at 10:18 AM Stamatis Zampetakis 
wrote:

> Hello,
>
> Below you can find a draft of this quarter's board report. I plan to
> submit it next Tuesday (July 11, 2023).
> Please let me know if you have any additions or corrections.
>
> Best regards,
> Stamatis
> -
>
> ## Description:
> Apache Calcite is a highly customizable framework for parsing and planning
> queries on data in a wide variety of formats. It allows database-like
> access,
> and in particular a SQL interface and advanced query optimization, for data
> not residing in a traditional database.
>
> Avatica is a sub-project within Calcite and provides a framework for
> building
> local and remote JDBC and ODBC database drivers. Avatica has an independent
> release schedule and its own repository.
>
> ## Project Status:
> Current project status: ongoing
> Issues for the board: none
>
> ## Membership Data:
> Apache Calcite was founded 2015-10-22 (8 years ago)
> There are currently 67 committers and 27 PMC members in this project.
> The Committer-to-PMC ratio is roughly 2:1.
>
> Community changes, past quarter:
> - No new PMC members. Last addition was Benchao Li on 2023-01-27.
> - Jacky Lau was added as committer on 2023-06-28
> - Oliver Lee was added as committer on 2023-06-13
> - Tanner Clary was added as committer on 2023-05-25
> - Zhe Hu was added as committer on 2023-06-28
>
> ## Project Activity:
> There were no releases during this quarter. The last release was Apache
> Calcite 1.34.0 on 2023-03-14.
>
> We are actively working towards Apache Calcite 1.35.0 and we plan to
> release
> the new version during July 2023.
>
> On 2023-06-29, the Calcite community organised a Virtual key signing party
> for
> expanding the Web of trust and empowering the cryptographic signatures of
> our
> members and future release managers. 4 PMC members and 2 committers
> attended
> the event.
>
> ## Community Health:
> The project remains super healthy.
>
> The traffic in JIRA, GitHub, issues@, commits, has increased overall,
> while
> dev@ has dropped by 18%. During this quarter there were more discussions
> and
> exchanges under specific issues/tickets shifting the traffic from dev@ to
> issues@ and other places.
>
> The number of non-committer (contributor) commits per month:
> +-+-+-+
> |year |month| contributor_commits |
> +-+-+-+
> | 2023| 4   | 17  |
> | 2023| 5   | 21  |
> | 2023| 6   | 35  |
> +-+-+-+
>
> The number of active reviewers per month:
> +-+-+-+
> |year |month|  active_reviewers   |
> +-+-+-+
> | 2023| 4   | 6   |
> | 2023| 5   | 6   |
> | 2023| 6   | 11  |
> +-+-+-+
>
> Top-3 reviewers in the last quarter:
> +---+-+
> | committer |   reviews   |
> +---+-+
> | Julian Hyde  | 28  |
> | Benchao Li  | 12  |
> | rubenada  | 8   |
> | Jiajun  | 8   |
> +---+-+
>
> The number of non-committer commits has increased roughly by 43% from the
> last
> quarter (51 commits in Q1 vs. 73 commits in Q2) which is promising for
> inviting new committers in the near term.
>
> The number of active reviewers increased slightly compared to the last
> quarter
> with June being the most active month for everyone. The preparation for the
> 1.35.0 release and the call for action did help in bringing those numbers
> up
> during June.
>
> In terms of sharing the review load, things are a bit better this quarter
> but
> still far from being completely balanced. There have been discussions
> around
> the topic in the last quarter but we obviously need more involvement from
> the
> community members.
>


Re: [ANNOUNCE] New committer: TJ Banghart

2023-07-04 Thread Jacky Lau
Congratulations, TJ!

Best Jacky!

Benchao Li  于2023年7月4日周二 17:55写道:

> Congratulations, TJ!
>
> Zhe Hu  于2023年7月4日周二 17:26写道:
>
> > Congrats! TJ.
> >  Replied Message 
> > | From | Francis Chuang |
> > | Date | 07/04/2023 15:18 |
> > | To | dev |
> > | Subject | Re: [ANNOUNCE] New committer: TJ Banghart |
> > Congrats, TJ!
> >
> > On 4/07/2023 5:17 pm, Stamatis Zampetakis wrote:
> > > Apache Calcite's Project Management Committee (PMC) has invited TJ
> > Banghart to
> > > become a committer, and we are pleased to announce that they have
> > accepted.
> > >
> > > TJ has been contributing to the community for about a year now. They
> > > introduced many new SQL functions for parsing and formatting dates,
> > > times, and timestamps extending the capabilities of the BigQuery
> > > dialect. Furthermore, they pushed various improvements around JSON
> > > serialization and deserialization, JDBC metadata, and lexical
> > > policies.
> > >
> > > TJ, welcome, thank you for your contributions, and we look forward to
> > your
> > > further interactions with the community! If you wish, please feel free
> > to tell
> > > us more about yourself and what you are working on.
> > >
> > > As your first commit, please add yourself to the contributors list [1]
> > > and the community page will re-generate [2].
> > >
> > > Stamatis (on behalf of the Apache Calcite PMC)
> > >
> > > [1]
> > https://github.com/apache/calcite/blob/main/site/_data/contributors.yml
> > > [2] https://calcite.apache.org/community/#project-members
> >
>
>
> --
>
> Best,
> Benchao Li
>


Re: [ANNOUNCE] New committer: Dan Zou

2023-07-04 Thread Jacky Lau
Congratulations, Dan!

Best Jacky!

Benchao Li  于2023年7月4日周二 17:55写道:

> Congratulations, Dan!
>
> Zhe Hu  于2023年7月4日周二 17:26写道:
>
> > Congrats! Dan.
> >  Replied Message 
> > | From | Francis Chuang |
> > | Date | 07/04/2023 15:18 |
> > | To | dev |
> > | Subject | Re: [ANNOUNCE] New committer: Dan Zou |
> > Congrats, Dan!
> >
> > On 4/07/2023 5:16 pm, Stamatis Zampetakis wrote:
> > > Apache Calcite's Project Management Committee (PMC) has invited Dan Zou
> > to
> > > become a committer, and we are pleased to announce that they have
> > accepted.
> > >
> > > Dan has been doing some great work for the project over the past few
> > > months. They implemented and enabled multiple new SQL functions for
> > > BigQuery and MSSQL dialects, fixed some optimization rules, and
> > > improved documentation and test code.
> > >
> > > Dan, welcome, thank you for your contributions, and we look forward to
> > your
> > > further interactions with the community! If you wish, please feel free
> > to tell
> > > us more about yourself and what you are working on.
> > >
> > > As your first commit, please add yourself to the contributors list [1]
> > > and the community page will re-generate [2].
> > >
> > > Stamatis (on behalf of the Apache Calcite PMC)
> > >
> > > [1]
> > https://github.com/apache/calcite/blob/main/site/_data/contributors.yml
> > > [2] https://calcite.apache.org/community/#project-members
> >
>
>
> --
>
> Best,
> Benchao Li
>


Re: [ANNOUNCE] New committer: Dan Zou

2023-07-04 Thread Benchao Li
Congratulations, Dan!

Zhe Hu  于2023年7月4日周二 17:26写道:

> Congrats! Dan.
>  Replied Message 
> | From | Francis Chuang |
> | Date | 07/04/2023 15:18 |
> | To | dev |
> | Subject | Re: [ANNOUNCE] New committer: Dan Zou |
> Congrats, Dan!
>
> On 4/07/2023 5:16 pm, Stamatis Zampetakis wrote:
> > Apache Calcite's Project Management Committee (PMC) has invited Dan Zou
> to
> > become a committer, and we are pleased to announce that they have
> accepted.
> >
> > Dan has been doing some great work for the project over the past few
> > months. They implemented and enabled multiple new SQL functions for
> > BigQuery and MSSQL dialects, fixed some optimization rules, and
> > improved documentation and test code.
> >
> > Dan, welcome, thank you for your contributions, and we look forward to
> your
> > further interactions with the community! If you wish, please feel free
> to tell
> > us more about yourself and what you are working on.
> >
> > As your first commit, please add yourself to the contributors list [1]
> > and the community page will re-generate [2].
> >
> > Stamatis (on behalf of the Apache Calcite PMC)
> >
> > [1]
> https://github.com/apache/calcite/blob/main/site/_data/contributors.yml
> > [2] https://calcite.apache.org/community/#project-members
>


-- 

Best,
Benchao Li


Re: [ANNOUNCE] New committer: TJ Banghart

2023-07-04 Thread Benchao Li
Congratulations, TJ!

Zhe Hu  于2023年7月4日周二 17:26写道:

> Congrats! TJ.
>  Replied Message 
> | From | Francis Chuang |
> | Date | 07/04/2023 15:18 |
> | To | dev |
> | Subject | Re: [ANNOUNCE] New committer: TJ Banghart |
> Congrats, TJ!
>
> On 4/07/2023 5:17 pm, Stamatis Zampetakis wrote:
> > Apache Calcite's Project Management Committee (PMC) has invited TJ
> Banghart to
> > become a committer, and we are pleased to announce that they have
> accepted.
> >
> > TJ has been contributing to the community for about a year now. They
> > introduced many new SQL functions for parsing and formatting dates,
> > times, and timestamps extending the capabilities of the BigQuery
> > dialect. Furthermore, they pushed various improvements around JSON
> > serialization and deserialization, JDBC metadata, and lexical
> > policies.
> >
> > TJ, welcome, thank you for your contributions, and we look forward to
> your
> > further interactions with the community! If you wish, please feel free
> to tell
> > us more about yourself and what you are working on.
> >
> > As your first commit, please add yourself to the contributors list [1]
> > and the community page will re-generate [2].
> >
> > Stamatis (on behalf of the Apache Calcite PMC)
> >
> > [1]
> https://github.com/apache/calcite/blob/main/site/_data/contributors.yml
> > [2] https://calcite.apache.org/community/#project-members
>


-- 

Best,
Benchao Li


Re: [DISCUSS] Sharing the load of reviewing PRs

2023-07-04 Thread Stamatis Zampetakis
Here are some stats around PRs merged in the calcite main branch in
the last quarter [2023-04-01, 2023-07-01). The stats are not 100%
accurate to cover reviews done under PRs/jira etc but clearly show
that we are quite far from what we have been discussing here.

+---+-+
| committer |   reviews   |
+---+-+
| Julian Hyde  | 28  |
| Benchao Li  | 12  |
| rubenada  | 8   |
| Jiajun  | 8   |
| Stamatis Zampetakis  | 3   |
| Tanner Clary <116591231+tancl...@users.noreply.github.com> | 3
|
| Jacky Lau  | 2   |
| Tanner Clary  | 2   |
| NobiGo  | 2   |
| Feng Zhu  | 1   |
| dssysolyatin  | 1   |
| olivrlee <114513231+olivr...@users.noreply.github.com> | 1   |
| Alessandro Solimando  | 1   |
| ILuffZhe <37180946+iluff...@users.noreply.github.com> | 1   |

I would encourage everyone to set some personal goals in terms of
weekly/monthly reviews so that we collectively improve the numbers.

I will send another update in this thread when I submit the report for
the next quarter Q3 to see if we are making progress or not.

Best,
Stamatis

On Thu, Apr 13, 2023 at 6:51 PM Chapuis Bertil  wrote:
>
> +1
>
> I will likely participate in the effort of reviewing PRs when my schedule 
> allows it.
>
> As pointed out in previous comments, some of us have a limited amount of time 
> available and few experience with certain areas of the codebase. One thing we 
> may experiment with is a shadow review process, similar to what is done with 
> shadow program committees at conferences (e.g., S [1]). For instance, I 
> recently reviewed CALCITE-5160 [2] and asked someone else to accept the PR. 
> Frank Zou provided additional feedback, and I learned new things along the 
> way. I think such a mechanism would really help non-committers and new 
> committers to onboard.
>
> [1] https://www.ieee-security.org/TC/SP2021/shadowpc.html
> [2] https://github.com/apache/calcite/pull/2854
>
>
> > On 12 Apr 2023, at 11:51, Stamatis Zampetakis  wrote:
> >
> > For a long time this has been one of the main issues of the project
> > and I am happy to see discussions to address this issue.
> >
> > I would like to mention that as a contributor, I am, and always have
> > been very grateful to people reviewing my work.
> > The fact that I became a committer of this project is mainly due to
> > Julian and Vladimir Sitnikov who reviewed and merged many of my PRs.
> > I would definitely like to help and make other contributors feel the
> > same but I cannot really commit to specific volume and deadlines
> > spanning several months.
> >
> > I have the feeling that we don't need the PR manager role. The
> > assignment work can be done by bots (e.g., [1]) if needed and we
> > already have our quarterly stats for reporting purposes.
> > If we want to put a human behind this then it makes more sense for
> > this person to be the release manager; this should be the one nagging
> > people for advancing the work and moving towards the release.
> >
> > Regarding reviews coming from non-committers, I am not sure it's
> > possible to do the assignment in GitHub. It's not a big deal though;
> > for me a simple comment that I am going to review would be sufficient.
> > Alternatively, we could consider adopting an equivalent workflow in
> > JIRA and potentially introducing a new state "IN REVIEW"; don't think
> > it is necessary.
> > No matter the choice we should ensure that we have a trackable way to
> > recognise "non-committer" reviewers but I think both GitHub (e.g.,
> > "is:pr reviewed-by:julianhyde is:closed") and JIRA offer the necessary
> > filters;
> > Others projects tend to include such info in the commit message we
> > could also opt for this if we deem necessary.
> >
> > As an immediate action I would encourage everyone willing to help to
> > go to the open PRs on GitHub and either assign some PRs to themselves
> > (in case of committers) or leave a comment about their intention
> > (non-committers).
> >
> > In the meantime we can iterate on this till we reach consensus.
> >
> > Best,
> > Stamatis
> >
> > [1] https://github.com/apps/auto-assign
> >
> >
> > On Wed, Apr 12, 2023 at 10:49 AM Ruben Q L  wrote:
> >>
> >> Hello,
> >>
> >> I understand Julian's frustration. We all know that reviewing PRs is a
> >> recurring problem, and it is not the first time we discuss potential
> >> solutions, see e.g. the discussion a year ago [1] (also started by Julian)
> >> where several ideas were mentioned: automatic assignment, emulate the RM
> >> process onto the reviewing process (quite similar to the current proposal),
> >> ...but in the end no change was implemented, and the problem remains.
> >>
> >> I agree that something must be done in order to revert the situation.
> >>
> >> In my 

Re: [ANNOUNCE] New committer: TJ Banghart

2023-07-04 Thread Zhe Hu
Congrats! TJ.
 Replied Message 
| From | Francis Chuang |
| Date | 07/04/2023 15:18 |
| To | dev |
| Subject | Re: [ANNOUNCE] New committer: TJ Banghart |
Congrats, TJ!

On 4/07/2023 5:17 pm, Stamatis Zampetakis wrote:
> Apache Calcite's Project Management Committee (PMC) has invited TJ Banghart to
> become a committer, and we are pleased to announce that they have accepted.
>
> TJ has been contributing to the community for about a year now. They
> introduced many new SQL functions for parsing and formatting dates,
> times, and timestamps extending the capabilities of the BigQuery
> dialect. Furthermore, they pushed various improvements around JSON
> serialization and deserialization, JDBC metadata, and lexical
> policies.
>
> TJ, welcome, thank you for your contributions, and we look forward to your
> further interactions with the community! If you wish, please feel free to tell
> us more about yourself and what you are working on.
>
> As your first commit, please add yourself to the contributors list [1]
> and the community page will re-generate [2].
>
> Stamatis (on behalf of the Apache Calcite PMC)
>
> [1] https://github.com/apache/calcite/blob/main/site/_data/contributors.yml
> [2] https://calcite.apache.org/community/#project-members


Re: [ANNOUNCE] New committer: Dan Zou

2023-07-04 Thread Zhe Hu
Congrats! Dan.
 Replied Message 
| From | Francis Chuang |
| Date | 07/04/2023 15:18 |
| To | dev |
| Subject | Re: [ANNOUNCE] New committer: Dan Zou |
Congrats, Dan!

On 4/07/2023 5:16 pm, Stamatis Zampetakis wrote:
> Apache Calcite's Project Management Committee (PMC) has invited Dan Zou to
> become a committer, and we are pleased to announce that they have accepted.
>
> Dan has been doing some great work for the project over the past few
> months. They implemented and enabled multiple new SQL functions for
> BigQuery and MSSQL dialects, fixed some optimization rules, and
> improved documentation and test code.
>
> Dan, welcome, thank you for your contributions, and we look forward to your
> further interactions with the community! If you wish, please feel free to tell
> us more about yourself and what you are working on.
>
> As your first commit, please add yourself to the contributors list [1]
> and the community page will re-generate [2].
>
> Stamatis (on behalf of the Apache Calcite PMC)
>
> [1] https://github.com/apache/calcite/blob/main/site/_data/contributors.yml
> [2] https://calcite.apache.org/community/#project-members


Draft: board report for 2023 Q2

2023-07-04 Thread Stamatis Zampetakis
Hello,

Below you can find a draft of this quarter's board report. I plan to
submit it next Tuesday (July 11, 2023).
Please let me know if you have any additions or corrections.

Best regards,
Stamatis
-

## Description:
Apache Calcite is a highly customizable framework for parsing and planning
queries on data in a wide variety of formats. It allows database-like
access,
and in particular a SQL interface and advanced query optimization, for data
not residing in a traditional database.

Avatica is a sub-project within Calcite and provides a framework for
building
local and remote JDBC and ODBC database drivers. Avatica has an independent
release schedule and its own repository.

## Project Status:
Current project status: ongoing
Issues for the board: none

## Membership Data:
Apache Calcite was founded 2015-10-22 (8 years ago)
There are currently 67 committers and 27 PMC members in this project.
The Committer-to-PMC ratio is roughly 2:1.

Community changes, past quarter:
- No new PMC members. Last addition was Benchao Li on 2023-01-27.
- Jacky Lau was added as committer on 2023-06-28
- Oliver Lee was added as committer on 2023-06-13
- Tanner Clary was added as committer on 2023-05-25
- Zhe Hu was added as committer on 2023-06-28

## Project Activity:
There were no releases during this quarter. The last release was Apache
Calcite 1.34.0 on 2023-03-14.

We are actively working towards Apache Calcite 1.35.0 and we plan to release
the new version during July 2023.

On 2023-06-29, the Calcite community organised a Virtual key signing party for
expanding the Web of trust and empowering the cryptographic signatures of our
members and future release managers. 4 PMC members and 2 committers attended
the event.

## Community Health:
The project remains super healthy.

The traffic in JIRA, GitHub, issues@, commits, has increased overall, while
dev@ has dropped by 18%. During this quarter there were more discussions and
exchanges under specific issues/tickets shifting the traffic from dev@ to
issues@ and other places.

The number of non-committer (contributor) commits per month:
+-+-+-+
|year |month| contributor_commits |
+-+-+-+
| 2023| 4   | 17  |
| 2023| 5   | 21  |
| 2023| 6   | 35  |
+-+-+-+

The number of active reviewers per month:
+-+-+-+
|year |month|  active_reviewers   |
+-+-+-+
| 2023| 4   | 6   |
| 2023| 5   | 6   |
| 2023| 6   | 11  |
+-+-+-+

Top-3 reviewers in the last quarter:
+---+-+
| committer |   reviews   |
+---+-+
| Julian Hyde  | 28  |
| Benchao Li  | 12  |
| rubenada  | 8   |
| Jiajun  | 8   |
+---+-+

The number of non-committer commits has increased roughly by 43% from the last
quarter (51 commits in Q1 vs. 73 commits in Q2) which is promising for
inviting new committers in the near term.

The number of active reviewers increased slightly compared to the last quarter
with June being the most active month for everyone. The preparation for the
1.35.0 release and the call for action did help in bringing those numbers up
during June.

In terms of sharing the review load, things are a bit better this quarter but
still far from being completely balanced. There have been discussions around
the topic in the last quarter but we obviously need more involvement from the
community members.


[jira] [Created] (CALCITE-5817) The lead field for the interval type should not be validated

2023-07-04 Thread hongyu guo (Jira)
hongyu guo created CALCITE-5817:
---

 Summary: The lead field for the interval type should not be 
validated
 Key: CALCITE-5817
 URL: https://issues.apache.org/jira/browse/CALCITE-5817
 Project: Calcite
  Issue Type: Bug
  Components: core
Affects Versions: 1.34.0
Reporter: hongyu guo
Assignee: hongyu guo


Calcite restricts the lead field of the interval type to a maximum of three 
digits through the 
[SqlIntervalQualifier#checkLeadFieldInRange|https://github.com/apache/calcite/blob/main/core/src/main/java/org/apache/calcite/sql/SqlIntervalQualifier.java#L472].

There are some example
{code:sql}
0: jdbc:calcite:model=model.json> select interval '100' day;
Error: Error while executing SQL "select interval '100' day": From line 1, 
column 8 to line 1, column 25: Interval field value 100 exceeds precision of 
DAY(2) field (state=,code=0)

0: jdbc:calcite:model=model.json> select INTERVAL '100:50' HOUR TO MINUTE;
Error: Error while executing SQL "select INTERVAL '100:50' HOUR TO MINUTE": 
From line 1, column 8 to line 1, column 39: Interval field value 100 exceeds 
precision of HOUR(2) field (state=,code=0)
{code}
In postgres and spark-sql, this restriction does not exist.
{code:sql}
-- postgres
postgres=# select INTERVAL '100' second;
 interval 
--
 00:01:40
(1 row)

postgres=# select INTERVAL '100:5' HOUR TO MINUTE;
 interval  
---
 100:05:00
(1 row)

-- mysql (In mysql, directly using the INTERVAL keyword with a string value 
cannot be executed)
mysql> select current_date +  INTERVAL '100' HOUR;
+-+
| current_date +  INTERVAL '100' HOUR |
+-+
| 2023-07-08 04:00:00 |
+-+
1 row in set (0.00 sec)

-- spark-sql
spark-sql> select INTERVAL '100:5' HOUR TO MINUTE;
INTERVAL '100:05' HOUR TO MINUTE
4 04:05:00.0
Time taken: 0.041 seconds, Fetched 1 row(s)
{code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


Re: [ANNOUNCE] New committer: TJ Banghart

2023-07-04 Thread Francis Chuang

Congrats, TJ!

On 4/07/2023 5:17 pm, Stamatis Zampetakis wrote:

Apache Calcite's Project Management Committee (PMC) has invited TJ Banghart to
become a committer, and we are pleased to announce that they have accepted.

TJ has been contributing to the community for about a year now. They
introduced many new SQL functions for parsing and formatting dates,
times, and timestamps extending the capabilities of the BigQuery
dialect. Furthermore, they pushed various improvements around JSON
serialization and deserialization, JDBC metadata, and lexical
policies.

TJ, welcome, thank you for your contributions, and we look forward to your
further interactions with the community! If you wish, please feel free to tell
us more about yourself and what you are working on.

As your first commit, please add yourself to the contributors list [1]
and the community page will re-generate [2].

Stamatis (on behalf of the Apache Calcite PMC)

[1] https://github.com/apache/calcite/blob/main/site/_data/contributors.yml
[2] https://calcite.apache.org/community/#project-members


[ANNOUNCE] New committer: TJ Banghart

2023-07-04 Thread Stamatis Zampetakis
Apache Calcite's Project Management Committee (PMC) has invited TJ Banghart to
become a committer, and we are pleased to announce that they have accepted.

TJ has been contributing to the community for about a year now. They
introduced many new SQL functions for parsing and formatting dates,
times, and timestamps extending the capabilities of the BigQuery
dialect. Furthermore, they pushed various improvements around JSON
serialization and deserialization, JDBC metadata, and lexical
policies.

TJ, welcome, thank you for your contributions, and we look forward to your
further interactions with the community! If you wish, please feel free to tell
us more about yourself and what you are working on.

As your first commit, please add yourself to the contributors list [1]
and the community page will re-generate [2].

Stamatis (on behalf of the Apache Calcite PMC)

[1] https://github.com/apache/calcite/blob/main/site/_data/contributors.yml
[2] https://calcite.apache.org/community/#project-members


Re: [ANNOUNCE] New committer: Dan Zou

2023-07-04 Thread Francis Chuang

Congrats, Dan!

On 4/07/2023 5:16 pm, Stamatis Zampetakis wrote:

Apache Calcite's Project Management Committee (PMC) has invited Dan Zou to
become a committer, and we are pleased to announce that they have accepted.

Dan has been doing some great work for the project over the past few
months. They implemented and enabled multiple new SQL functions for
BigQuery and MSSQL dialects, fixed some optimization rules, and
improved documentation and test code.

Dan, welcome, thank you for your contributions, and we look forward to your
further interactions with the community! If you wish, please feel free to tell
us more about yourself and what you are working on.

As your first commit, please add yourself to the contributors list [1]
and the community page will re-generate [2].

Stamatis (on behalf of the Apache Calcite PMC)

[1] https://github.com/apache/calcite/blob/main/site/_data/contributors.yml
[2] https://calcite.apache.org/community/#project-members


[ANNOUNCE] New committer: Dan Zou

2023-07-04 Thread Stamatis Zampetakis
Apache Calcite's Project Management Committee (PMC) has invited Dan Zou to
become a committer, and we are pleased to announce that they have accepted.

Dan has been doing some great work for the project over the past few
months. They implemented and enabled multiple new SQL functions for
BigQuery and MSSQL dialects, fixed some optimization rules, and
improved documentation and test code.

Dan, welcome, thank you for your contributions, and we look forward to your
further interactions with the community! If you wish, please feel free to tell
us more about yourself and what you are working on.

As your first commit, please add yourself to the contributors list [1]
and the community page will re-generate [2].

Stamatis (on behalf of the Apache Calcite PMC)

[1] https://github.com/apache/calcite/blob/main/site/_data/contributors.yml
[2] https://calcite.apache.org/community/#project-members


Re: Optimal way to organize Joins in Calcite

2023-07-04 Thread Roman Kondakov

Hi Jonathan,

1. As Julian mentioned, it's better to use heuristic join order for 
large amount of joins


2. LoptOptimizeJoinRule and MultiJoinOptimizeBushyRule AFAIK always 
produce tree of joins, not a MultiJoin.


3. Yes, your understanding is correct. You can check the default join 
order program [1]


[1] 
https://github.com/apache/calcite/blob/2dba40e7a0a5651eac5a30d9e0a72f178bd9bff2/core/src/main/java/org/apache/calcite/tools/Programs.java#L186


Thanks,

Roman.

On 03.07.2023 22:48, Julian Hyde wrote:

The reason that there are two strategies is because of large joins. If your 
query joins 10 tables, the number of possible join orders is large (bounded by 
10 factorial I believe) and therefore would overwhelm the Volcano planner, 
which must construct each possibility.

Therefore we have a heuristic algorithm that you should use for large joins. We 
gather the entire FROM clause into a data structure called MultiJoin, and a 
single rule call applies heuristics and spits out a join order that is probably 
close to optimal.

When you are optimizing a query, you need to know whether you are in danger of 
being swallowed by the monster that is the complexity of large joins. If your 
query only joins 2 or 3 tables (and in some other situations too) you are not 
in danger and can safely exhaustively enumerate plans.


On Jul 3, 2023, at 7:58 AM, Jonathan Sternberg  wrote:

Hi,

I'm presently working on optimizing the ordering of joins for queries and
had a few questions about the optimal way to do that with Calcite.

I watched this meetup video (https://www.youtube.com/watch?v=5wQojihyJDs)
and spent some time experimenting with JoinAssociateRule, JoinCommuteRule,
and the rules related to MultiJoins. We're utilizing the volcano planner
for optimization at the present moment but also have the freedom to
customize the order and phases for the planner phases.

1. Is MultiJoin generally suggested over JoinAssociate and JoinCommute
rules? Or are JoinAssociate and JoinCommute still recommended as the
standard way to handle reordering of joins?
2. Our system only supports performing the join over two inputs and we
can't support MultiJoin as a physical operation. My understanding is that
the LoptOptimizeJoinRule and MultiJoinOptimizeBushyRule will rearrange the
join but will still produce a MultiJoin. What's the appropriate way to
convert a MultiJoin back to a set of joins?
3. My understanding is that MultiJoin rules aren't compatible with the
volcano planner and should be run as part of a stage using the heuristic
planner. Is this understanding correct?

Thank you for any help.

--Jonathan Sternberg