Re: [DISCUSS] Does anybody think this is debuging unfriendly: "call.transformTo(relBuilder.build())"

Agree with Jiatao, I had the same experience and feeling. But it mainly depends on the rule creator's preference. On 2020/11/23 02:42:21, Danny Chan wrote: > I kind of agree, but it's more like a programming specification, we can > tell people how to write codes but they may not follow those ru

Re: Decouple core from linq4j and Avatica

> I would like to propose to decouple the "core" module from "ling4j" and > Avatica. I like the idea. Moving Enumerable out of core may be time consuming and disruptive, because many core tests are using Enumerable to verify plan quality and correctness. Best, Haisheng On 2020/11/24 23:42:19,

Re: [CALCITE-4431] Use requireNonNull(var, "var") instead of requireNonNull(var) for better error messages

Makes sense. On 2020/12/09 22:44:35, Stamatis Zampetakis wrote: > Sounds reasonable and shares some goals with JEP358 [1] so why not. > > [1] https://openjdk.java.net/jeps/358 > > On Wed, Dec 9, 2020 at 8:26 AM Vladimir Sitnikov < > sitnikov.vladi...@gmail.com> wrote: > > > Hi, > > > > I sug

Re: [ANNOUNCE] New Calcite PMC chair: Haisheng Yuan

Thanks everyone. It is my great honor to be appointed to serve as the community's PMC chair, and thanks Stamatis for your hard work and contribution you have done for the Calcite community. Regards, Haisheng Yuan On 2020/12/18 09:07:07, Ruben Q L wrote: > Congratulations Haisheng!

[DISCUSS] Draft board report for Jan 2021

Attached below is a draft of this month's board report. I plan to submit it on Jan 13 (Sorry for the late email). Please let me know if you have any additions or corrections. ## Description: Apache Calcite is a highly customizable framework for parsing and planning queries on data in a wide vari

Re: [DISCUSS] Draft board report for Jan 2021

ention of the new chair, and the fact that we > > > are continuing our tradition of annual rotation. (And our annual > > > tradition of talking about the tradition, per > > > https://whimsy.apache.org/board/minutes/Calcite.html#2020-01-15.) > > > > > > On Tu

Agg Call in CountSplitter / SumSplitter

by b) t2 on t1.b=t2.b; Am I missing something? Correct me if I am wrong. Thanks~ Haisheng Yuan

Re: Re: JoinPushThroughJoinRule not applied on plan

The associativity rule only applies for inner join. In your case, you have an outer join. Check this out:https://github.com/apache/calcite/blob/master/core/src/main/java/org/apache/calcite/rel/rules/JoinPushThroughJoinRule.java#L139 Thanks ~Haisheng Yuan

Needs review: [CALCITE-2278]

Hi Calcite commitors, Issue CALCITE-2278 needs review, please kindly take a look at pull request:https://github.com/apache/calcite/pull/676 [CALCITE-2278] Fix bug that AggregateJoinTransposeRule fails to split aggcall  for unique input with agg call. Thanks ~Haisheng Yuan

Re: Order of fields in select statement

It has nothing to do with aliases. The type should match. As the message said, you are trying to insert varchar type into integer field, which doesn’t pass Calcite’s validation. Thanks ~ Haisheng Yuan -- 发件人：Aditya 日　期：2018年08月09日

Re: 回复： count(distinct col) can't recognize distinct

and version, then group by channel. the count will be the number of distinct versions. It is an optimization for single aggregation with count distinct. Thanks ~ Haisheng Yuan -- 发件人：大明 日　期：2018年11月14日 11:20:41 收件人：dev 主　题：回复： count

Re: Two problems recently reported in Flink

r side still can work, with correlatoin variable. I have opened a pull request to finish the first task below to push down filter of lateral join, and it should be able to resolve this issue: https://github.com/apache/calcite/pull/1096 Thanks, Haisheng Yuan On 2017/10/11 09:07:56, Fabian Hues

回复：Apply for JIRA contributors permission

There is no need to get a permission to contribute to calcite. Feel free to make a contribution, either open a JIRA or pull request. Enjoy! Thanks~ Haisheng Yuan-- 发件人：YuZhao Chan 日　期：2019年03月10日 10:20:35 收件人： 主　题：Apply for JIRA

Re: Re: Join, SemiJoin, Correlate

Calcite, or SubPlan in Postgres’s terminology, but it can’t be implemented as HashJoin or MergeJoin. Thanks ~ Haisheng Yuan -- 发件人：Stamatis Zampetakis 日　期：2019年03月21日 07:13:15 收件人： 主　题：Re: Join, SemiJoin, Correlate I have bumped into this

Re: Re: Re: Join, SemiJoin, Correlate

SubPlan (in Postgres’ term) is a Postgres physical relational node to evaluate correlated subquery. What I mean is correlated subquery that can’t be decorrelated can’t be implemented by hashjoin or mergejoin. But it is off topic. Thanks ~ Haisheng Yuan

Re: Re: Join, SemiJoin, Correlate

also can do it in SubqueryRemoveRule. Should we unify them all in the rules and keep SqlToRelConverter simple? Thanks ~ Haisheng Yuan -- 发件人：Stamatis Zampetakis 日　期：2019年03月23日 07:31:35 收件人： 主　题：Re: Join, SemiJoin, Correlate Since we

Re: [ANNOUNCE] New committers: Haisheng Yuan

working with you all to make more contributions to Calcite project. Thanks ~ Haisheng Yuan -- 发件人：Francis Chuang 日　期：2019年03月26日 05:24:21 收件人： 主　题：[ANNOUNCE] New committers: Haisheng Yuan Apache Calcite's Project Management Comm

Re: Re: [ANNOUNCE] New committers: Haisheng Yuan

Thank you, Stamatis! Thanks ~ Haisheng Yuan -- 发件人：Stamatis Zampetakis 日　期：2019年03月26日 07:45:51 收件人： 抄　送：Francis Chuang 主　题：Re: [ANNOUNCE] New committers: Haisheng Yuan Congrats Haiseng! Its great to have you with us in this new

回复： Site branch

+1 Thanks~ Haisheng Yuan-- 发件人：Francis Chuang 日　期：2019年03月28日 06:49:44 收件人： 主　题：Re: Site branch +1 I think this should reduce the number of "commits ahead" in the site branch compared to master to 0. On 28/03/20

[DISCUSS] RelCompositeTrait

n the beginning? Seems like it gives us more pain than gain. Thanks ~ Haisheng Yuan

回复： Join, SemiJoin, Correlate

I share the same concern with you. Thanks~ Haisheng Yuan-- 发件人：Stamatis Zampetakis 日　期：2019年04月14日 05:37:29 收件人： 主　题：Re: Join, SemiJoin, Correlate Hi Danny, Thanks a lot for taking this on, it is a great start! I didn't

Re: Re: [DISCUSS] RelCompositeTrait

s, it is definitely not worth the optimization, because sort removal rule and empty rel removal rule should do the work. Thanks ~ Haisheng Yuan -- 发件人：Jacques Nadeau 日　期：2019年04月15日 07:36:51 收件人： 主　题：Re: [DISCUSS] RelCompositeTrait T

Re: Re: [DISCUSS] RelCompositeTrait

nter the same issue with Values. Thanks ~ Haisheng Yuan -- 发件人：Hongze Zhang 日　期：2019年04月16日 18:10:17 收件人： 主　题：Re: [DISCUSS] RelCompositeTrait If we minimize the issue scope to Calcite itself, I think the 3 JIRA tickets: CALCITE

Re: Re: How to rewrite <>ANY subqueries

IN subquery. For ALL subqueries, those can be transformed into the equivalence of ANY subquery, provided that there is corresponding inverse operator: x ALL (SQ) <==> NOT(x ANY (SQ)) Thanks ~ Haisheng Yuan -- 发件人：Julian Hyde

Re: Re: Function sets (aka flavor and dialect)

Catalog or Namespace? Thanks ~ Haisheng Yuan -- 发件人：Michael Mior 日　期：2019年04月27日 02:47:37 收件人： 主　题：Re: Function sets (aka flavor and dialect) I think "function set" sounds like a reasonable name. My current interpretation

Re: [ANNOUNCE] New committers: Zhiwei Peng

Congratulations, Zhiwei! Thanks ~ Haisheng Yuan -- 发件人：Francis Chuang 日　期：2019年04月27日 10:37:11 收件人： 主　题：[ANNOUNCE] New committers: Zhiwei Peng Apache Calcite's Project Management Committee (PMC) has invited Zhiwei Peng to bec

Re: [ANNOUNCE] New committers: Ruben Quesada Lopez

Congratulations, Ruben! I am impressed by your contributions. Thanks ~ Haisheng Yuan -- 发件人：Francis Chuang 日　期：2019年04月27日 10:39:18 收件人： 主　题：[ANNOUNCE] New committers: Ruben Quesada Lopez Apache Calcite's Project Manag

Re: [ANNOUNCE] Stamatis Zampetakis joins Calcite PMC

Congrats, Stamatis. You are really helpful to Calcite community. Keep up the good work. Thanks ~ Haisheng Yuan -- 发件人：Francis Chuang 日　期：2019年04月27日 10:44:04 收件人： 主　题：[ANNOUNCE] Stamatis Zampetakis joins Calcite PMC I'm pleas

Re: [ANNOUNCE] New committers: Chunwei Lei

Congratulations, Chunwei! Thanks ~ Haisheng Yuan -- 发件人：Francis Chuang 日　期：2019年04月27日 10:34:43 收件人： 主　题：[ANNOUNCE] New committers: Chunwei Lei Apache Calcite's Project Management Committee (PMC) has invited Chunwei Lei to bec

Re: Re: [VOTE] Release apache-calcite-avatica-1.14.0 (release candidate 0)

Environment: Mac OS X 10.13.4, JDK 1.8.0_162, Maven 3.5.2 - Checked signatures and checksums, OK - Checked release note, OK - Ran unit tests (mvn clean install), OK - Ran unit tests on Calcite master with Avatica 1.14.0 rc0, OK +1 (non-binding) Thanks ~ Haisheng Yuan

Re: Re: Virtual key signing party

Hi, I'd like to attend the party. pub rsa4096 2019-05-01 [SC] [expires: 2024-04-29] ECA9 CF33 AF2C EC28 F3B6 6A5C 3CD2 2ABA C50D DCEF uid [ultimate] Haisheng Yuan sub rsa4096 2019-05-01 [E] [expires: 2024-

Re: Re: Virtual key signing party

Hi Stamatis, I use pgp.mit.edu. Can you try again? Thanks ~ Haisheng Yuan -- 发件人：Stamatis Zampetakis 日　期：2019年05月02日 15:27:29 收件人： 主　题：Re: Virtual key signing party Hi again, @Francis: Thanks for sharing the instructions, they are

Re: Re: Re: Virtual key signing party

Sorry, I missed the call. Converted to wrong time. Will join next party. Thanks ~ Haisheng Yuan -- 发件人：Haisheng Yuan 日　期：2019年05月03日 01:02:14 收件人：Stamatis Zampetakis; Apache Calcite dev list 主　题：Re: Re: Virtual key signing party Hi

Re: [ANNOUNCE] New committer: Danny Chan

Congratulations, Danny! Well deserved. Thanks ~ Haisheng Yuan -- 发件人：Francis Chuang 日　期：2019年05月14日 06:40:44 收件人： 主　题：[ANNOUNCE] New committer: Danny Chan Apache Calcite's Project Management Committee (PMC) has invited Danny

Re: Support complete implicit type coercion (DISCUSSION)

Thanks Danny for bringing it up. This is a useful feature, we should push it forward. I went through the design doc, looks good in general. I will also spend some time on the pull request 706. Thanks ~ Haisheng Yuan -- 发件人：Yuzhao

Re: Re: CyclicMetadataException in testPushDownJoinConditionsWithExpandedIsNotDistinctUsingCase

The test suite stuck on my laptop for ever. macOS 10.14.4, JDK 8. Ignoring test case EnumerableRepeatUnionHierarchyTest makes the whole test pass again. Thanks ~ Haisheng Yuan -- 发件人：Stamatis Zampetakis 日　期：2019年05月30日 22:49:22 收件人

回复： Re: CyclicMetadataException in testPushDownJoinConditionsWithExpandedIsNotDistinctUsingCase

just run that single test would not reproduce. It also passes on my machine if run it separately. mvn clean install can repro every time. Thanks~ Haisheng Yuan-- 发件人：Ruben Q L 日　期：2019年05月31日 14:03:44 收件人： 抄　送：Stamatis

Re: Re: Re: CyclicMetadataException in testPushDownJoinConditionsWithExpandedIsNotDistinctUsingCase

Locked ownable synchronizers: - None "VM Thread" os_prio=31 tid=0x7ff819809000 nid=0x2d03 runnable "GC task thread#0 (ParallelGC)" os_prio=31 tid=0x7ff81a003800 nid=0x2207 runnable "GC task thread#1 (ParallelGC)

Re: Re: [DISCUSS] Parallel parameterized unit tests

> Am I correct that this problem only shows up on machines with 1 CPU? No, my laptop has 2 CPUs, it still shows up. Thanks ~ Haisheng Yuan -- 发件人：Julian Hyde 日　期：2019年06月04日 01:56:56 收件人：dev 主　题：Re: [DISCUSS] Parallel parameteri

Re: Re: Re: [DISCUSS] Parallel parameterized unit tests

I am inclining to change threadCount to 4, then see how it works in CI, at least it solves the problem on my laptop. If the problem still shows up in CI, or it solves the problem but makes the CI test much slower, I would rather tear up the parameterized test case. - Haisheng Yuan

Correlate Join SemiJoin transformation

InnerJoin(Agg, rel) (Join reorder rule) SemiJoin/InnerJoin -> HashJoin/MergeJoin/NLJ (Join implementation rule) This is a long shot, and will involve tons of changes. Any thoughts? - Haisheng Yuan

Re: Re: Extracting all columns used in a query

Hi Adam, Calcite defintely can do this. But can you first clarify what do you mean by all the columns in a query? e.g. R(r1, r2,r3), S(s1,s2,s3) SELECT r1+s1 FROM R,S WHERE r3=s3; What do you want to extract from this query? r1,r3 for R and s1, s3 for S? And why do you want do that? - Haisheng

Re: Re: Re: Re: [DISCUSS] Parallel parameterized unit tests

parameterized test to be able to pass the whole test suite. - Haisheng Yuan-- 发件人：Stamatis Zampetakis 日　期：2019年06月04日 07:13:00 收件人： 主　题：Re: Re: Re: [DISCUSS] Parallel parameterized unit tests It seems that we can disable parallel execution

Re: Re: Re: Re: Re: [DISCUSS] Parallel parameterized unit tests

Yes, I will do it. - Haisheng Yuan-- 发件人：Julian Hyde 日　期：2019年06月05日 02:23:24 收件人：dev@calcite.apache.org 抄　送：Stamatis Zampetakis 主　题：Re: Re: Re: Re: [DISCUSS] Parallel parameterized unit tests I think we have quorum. Can someone

Re: Re: Re: Re: Re: Re: [DISCUSS] Parallel parameterized unit tests

Looks like we already used https://github.com/stephenc/jcip-annotations in pom.xml, I will keep pom.xml untouched. - Haisheng Yuan-- 发件人：Julian Hyde 日　期：2019年06月05日 02:39:43 收件人：dev@calcite.apache.org 主　题：Re: Re: Re: Re: Re

Re: Linq expressions to RexNode

Hi Khai, I don't think there is such kind of utility function in Calcite. - Haisheng Yuan-- 发件人：Khai Tran 日　期：2019年06月05日 01:28:21 收件人：dev@calcite.apache.org (dev@calcite.apache.org) 主　题：Linq expressions to RexNode Just

[DISCUSS] IS NOT DISTINCT FROM rewrite

I see INDF is rewritten to OR, and FilterRemoveIsNotDistinctFromRule rewrites INDF to CASE expression. Why do we want to do that? To simplify expression like "a is not distinct from b or a = b"? Then we spend a lot effort to convert OR/CASE back to INDF. I am curious what is the motivation to

Re: Re: [DISCUSS] IS NOT DISTINCT FROM rewrite

probably makes sense to rewrite “x IS NOT DISTINCT FROM y” to “x = y”, because the latter is more common and no less simple. Julian > On Jun 5, 2019, at 1:46 PM, Haisheng Yuan wrote: > > I see INDF is rewritten to OR, and FilterRemoveIsNotDistinctFromRule rewrites > INDF to CA

Re: How to avoid SUM0 or disable a rule ?

Hi Gelbana, You can construct your own AggregateReduceFunctionsRule instance by specifying the functions you want to reduce: public AggregateReduceFunctionsRule(Class aggregateClass, RelBuilderFactory relBuilderFactory, EnumSet functionsToReduce) { But I think the issue you described might

Re: Re: How to avoid SUM0 or disable a rule ?

Cool, can you create an issue for this bug? - Haisheng -- 发件人：Muhammad Gelbana 日　期：2019年06月12日 02:39:20 收件人：dev@calcite.apache.org (dev@calcite.apache.org) 抄　送：Haisheng Yuan 主　题：Re: How to avoid SUM0 or disable a rule ? I believe

Re: Re: Select into Temporary Table

For historical reasons, perhaps. We need to parse and translate into CREATE TABLE AS SELECT... if we are going to support this syntax for Postgres and SQL Server. - Haisheng -- 发件人：Julian Hyde 日　期：2019年06月12日 05:41:38 收件人： 主　题：Re:

Re: Re: Joining two tables while each table returns a single row of nulls

Even if there is no bug about EnumerableHashJoin, since there is no equi condition, why generate HashJoin? Should it be NestedLoopJoin? - Haisheng -- 发件人：Muhammad Gelbana 日　期：2019年06月14日 22:58:28 收件人：dev@calcite.apache.org (dev@calc

Re: Re: [VOTE] Release apache-calcite-1.20.0 (release candidate 0)

Environment: Mac OS X 10.14.4, JDK 1.8.0_162, Maven 3.5.2 - Checked signatures and checksums, OK - Checked release note, OK - Ran unit tests (mvn clean install), OK ​ +1 (non-binding) - Haisheng -- 发件人：Michael Mior 日　期：2019年06月21日 0

Re: [DISCUSSION] Problem caused by flattening of struct fields

Consider creating ObjectSqlType like Fixture.addressType, which is STRUCTURED type. typeFactory.createStructType() actually creates a ROW type, which is not supported to reconstruct fields at the moment, see method RelStructuredTypeFlattener.restructureFields. But even with ObjectSqlType, you

Re: Re: [DISCUSSION] Problem caused by flattening of struct fields

I have created 2 JIRA tickets to track the issues: https://issues.apache.org/jira/browse/CALCITE-3137 https://issues.apache.org/jira/browse/CALCITE-3138 - Haisheng -- 发件人：Haisheng Yuan 日　期：2019年06月21日 08:54:55 收件人：Igor Guzenko

Re: Re: Re: [DISCUSSION] Problem caused by flattening of struct fields

9年06月21日 22:21:44 收件人：Haisheng Yuan 抄　送：Apache Calcite dev list 主　题：Re: Re: [DISCUSSION] Problem caused by flattening of struct fields Thanks for quick answer, I'll work on the CALCITE-3138 jira. If I'm not wrong this collection of fields back after flatten supposed to be done like re

回复：Subquery

Try semiJoin in RelBuilder. Maybe that is what you want. Thanks~ Haisheng Yuan-- 发件人： 日　期：2019年06月24日 06:29:38 收件人：Dev 主　题：Subquery Although I can build a query which looks like val query = builder.scan("table1&quo

Re: Re: Giving the Calcite logo some love

I like the design of 5b too, but with the font of 4a. Changing the background color of the website should be easy. - Haisheng -- 发件人：Stamatis Zampetakis 日　期：2019年06月26日 06:15:57 收件人： 主　题：Re: Giving the Calcite logo some love Here is

Re: How to do SemiJoin?

The input parameter of semiJoin method should be join conditions, not just fields. Check the example usage in RelMetadataTest.java#checkPredicates L1435. - Haisheng -- 发件人：Chia-Hung Lin 日　期：2019年06月26日 05:38:30 收件人： 主　题：How to do S

回复：Modify Calcite Planner in Hive to remove GROUP BY

Calcite has the rule that does the work. But you can't remove the group by clause if the constant is the only group key. The semantic is different without group key. Try it on empty relation, you will see the difference. Thanks~ Haisheng

回复：[VOTE] Calcite logo selection

Vote for 5B. Thanks~ Haisheng Yuan-- 发件人：Michael Mior 日　期：2019年06月28日 21:28:25 收件人： 主　题：[VOTE] Calcite logo selection Based on the previous thread[0], many have weighed in on their preference. There were two clear front runners

Re: Calcite-Master - Build # 1226 - Still Failing

The failure is with JDK 1.9 only: /home/jenkins/tools/java/latest1.9/bin/java: error while loading shared libraries: libjli.so: cannot open shared object file: No such file or directory Any idea? - Haisheng -- 发件人：Apache Jenkins Se

Re: CALCITE-3158, Avatica: migrate build system to Gradle

The performance improvement with Gradle is appealing. I would like to give it a try. - Haisheng -- 发件人：Vladimir Sitnikov 日　期：2019年07月01日 21:11:41 收件人：Apache Calcite dev list 主　题：CALCITE-3158, Avatica: migrate build system to Gradle

Re: Re: CALCITE-3158, Avatica: migrate build system to Gradle

> Gradle makes that possible with virtually zero configuration. Can't agree more. In the long term, Gradle has lower maitainence cost than Maven (look at the gradle scripts and Maven pom file), let alone the performance improvement. - Haisheng ---

Re: Re: Add "IN REVIEW" state in JIRA Workflow

The intention of Stamatis's proposal is to just add a new state in JIRA workflow, to help clarify that the pull request is opened and under review. It does help monitor the working progress, especially for a release manager, IMHO. But I don't think having an assigned reviewer is necessary. - H

[DISCUSS] Draft board report for Apr 2021

d and 55 JIRA tickets closed/resolved in the last 3 months, and 80 commits in the past quarter, slight decrease comparing with last quarter. Thanks, Haisheng Yuan

Re: [DISCUSS] Draft board report for Apr 2021

quot;? Do you know the tool or query that I can use to collect these metrics? Thanks! Haisheng Yuan On 2021/04/18 22:50:54, Francis Chuang wrote: > +1 looks great! > I second Stamatis' suggestion to include the more detailed description > of the project that we used pre

Re: Trait propagation in heterogeneous plans

. But in practice, it should be decided by the operator inventor and the underlying physical implementation. Hope that answers your question. Feel free to ask if you have more questions. Thanks, Haisheng Yuan On 2021/03/27 08:43:15, Vladimir Ozerov wrote: > Hi, > > Apache Calcite suppo

Re: How to match root node in a HEP Rule?

Hi Ian, Is there any specific reason or use case that you have to match the root node and find the parent node in your customized rule? Thanks, Haisheng Yuan On 2021/05/03 20:20:22, Julian Hyde wrote: > > Is there a way to identify a node as being a root node during RelRule.match? &g

Re: Using Calcite as a Distributed Optimizer

Yes, definitely. Many distributed big data systems use Apache Calcite to optimize queries and generate distributed plans. On 2021/05/13 23:16:10, Atri Sharma wrote: > Thank you. > > So my use case is such that I wish to use Calcite as a two phase optimizer > -- Get a SQL query, compile it and

Re: Enumerable rules lost hint info

The hint can be used to specify the degree of parallelism (DOP), MIN/MAX memory allocated for the operator. In that case, we need to keep them in the physical operators. But I am not sure whether there are downstream projects that are using hints for physical resource. On 2021/05/19 17:05:44, J

Re: Exposing multiple values of a trait from the operator

pping, we also need to take equivalent keys into consideration. Some of the work need to be done in Calcite core framework. Greenplum Orca optimizer has similar strategy: https://github.com/greenplum-db/gporca/blob/master/libgpopt/include/gpopt/base/CDistributionSpecHashed.h#L44 Regards, Haisheng

Re: Exposing multiple values of a trait from the operator

some pain, if you happen to use Calcite's default distribution/collation implementation. Regards, Haisheng Yuan On 2021/05/25 17:45:32, Vladimir Ozerov wrote: > Hi Haisheng, > > Thank you for the advice. This is exactly how I designed distribution at > the moment (the a

Re: Trait propagation guidelines

e's logical/physical nodes contains traitset. With regard to the latter question, can you give an example? Regards, Haisheng Yuan On 2021/05/26 20:11:57, Vladimir Ozerov wrote: > Hi, > > I tried to optimize a certain combination of operators for the distributed > engine and

Re: Trait propagation guidelines

of TableScan to return an IndexScan instead of a TableScan. Regards, Haisheng Yuan On 2021/05/26 22:45:20, Haisheng Yuan wrote: > Hi Vladimir, > > 1. You need a logical rule to split the aggregate into a local aggregate and > global aggregate, for example: > https

Re: Trait propagation guidelines

whether alternative approaches could better > fit the requirements of the distributed engine? This is a purely > theoretical question. I am currently looking deeper at CockroachDB. They > have very different architecture: no separation between logical and > physical nodes, physical pro

Re: Trait propagation guidelines

ed some time ago with the exact idea. Regards, Haisheng Yuan On 2021/05/27 17:44:23, Haisheng Yuan wrote: > >In distributed systems, an implementation rule may produce different > >physical operators depending on the input traits. Examples are Aggregate, > >Sort,

Re: Introduction

Hi Andras, Thank you for introducing yourself and dianemo DB to us. Welcome to Calcite community and look forward to conference to know more about your algorithm. Thanks, Haisheng Yuan On 2021/05/27 16:59:00, András Gerlits wrote: > Hello everyone, > > I've been asked

Re: Top-down optimizer cannot explore the search space because physical rule is treated as transformation rule

Great, that is the correct way to change it and that should be the default implementation. On 2021/05/28 17:41:15, Vladimir Ozerov wrote: > BTW, I tried to change the implementation to: > > 1: protected boolean isTransformationRule(VolcanoRuleCall match) { > 2:return match.getRule() inst

Re: Trait propagation guidelines

treamAgg[a DESC, b ASC, c ASC] by request, but I don't think that will make much difference, the bottleneck relies on the join order enumeration and the Project related operation. Regards, Haisheng Yuan [1] https://github.com/greenplum-db/gporca/blob/master/libgpopt/src/xforms/CXformS

Re: Trait propagation guidelines

rate enforcer between Hash[a] and Hash[b]Sort[c], which is not actually what we want. I think it is definitely worth trying to optimize. Regards, Haisheng Yuan On 2021/05/28 19:15:03, Haisheng Yuan wrote: > Hi Vladimir, > > The top-down optimizer does NOT require implementation ru

Re: [VOTE] Release apache-calcite-1.27.0 (release candidate 0)

Thank you for pushing the new release forward, Stamatis. 1. Checked checksum and signature: OK 2. Ran Gradle test: OK 3. Checked release notes: OK Gradle 6.8.3, Java env: openjdk version "1.8.0_292", MacOS 10.15.7 (19H1030). +1 (binding) Thanks, Haisheng Yuan On 2021/06/01 22:28:

Re: Minified javascript in source releases

+1 for removing them entirely. Thanks, Haisheng Yuan On 2021/06/02 13:36:05, Alessandro Solimando wrote: > Hi all, > +1 for removing them as well, all the mentioned sw versions in [5,6] > are extremely, extremely old. > > Best regards, > Alessandro > > On Wed, 2 Ju

[DISCUSS] Release Managers

1.29.0 ~ 1.31.0. Thanks, Haisheng Yuan

Re: [ANNOUNCE] Apache Calcite 1.27.0 released

Thank you Stamatis and all Calciters involved for leading the effort. Haisheng Yuan On 2021/06/04 22:16:21, Stamatis Zampetakis wrote: > The Apache Calcite team is pleased to announce the release of Apache > Calcite 1.27.0. > > Calcite is a dynamic data management framework. It

Re: [DISCUSS] Release Managers

Thanks, Rui. Now we have release managers: Rui Wang for 1.29.0 Liya Fan for 1.30.0 Thanks, Haisheng Yuan On 2021/06/04 22:05:34, Rui Wang wrote: > In another related thread I volunteered for releasing 1.29.0. I think I can > still do it. > > > -Rui > > On Thu, Jun 3

Re: [DISCUSS] Release Managers

Hi Andrei, thanks for letting me know, Liya can do for 1.31.0 instead. Here is the new list: Rui Wang for 1.29.0 Andrei Sereda for 1.30.0 Liya Fan for 1.31.0 Thanks everyone. Haisheng Yuan On 2021/06/05 00:27:48, Andrei Sereda wrote: > I volunteered for 1.30 but happy to release a differ

Re: Possibly incorrect assertion in the TopDownRuleDriver.DeriveTrait.derive

> Shouldn't we remove the assertion above? Perhaps. Or perhaps the rel2Subset mapping is not up to date. Regards, Haisheng Yuan On 2021/06/06 13:09:16, Vladimir Ozerov wrote: > Hi, > > When doing a trait derivation in the non-OMAKASE mode, the following lines > of c

Re: JIRA account as a contributor

Hi Dmitry, I have added you as contributor. Thanks, Haisheng Yuan On 2021/06/08 13:55:58, Dmitry Sysolyatin wrote: > Hi ! > I would like to join to calcite team. I already fixed a small bug > https://issues.apache.org/jira/browse/CALCITE-4630. But I can not do > anything with JIR

Re: Optimizer (Hep) NOT scanning RelNodes of Subqqueries

Did you include the subquery related rules in the HepPlanner? Haisheng On 2021/06/09 17:59:44, Krishnakant Agrawal wrote: > Hi All, > > When running a HepOptimizer on top of a RelNode which has a subquery > embedded in it, The Optimizer does not take the RelNode representing the > subquery up

Re: Joining JIRA as a contributor

Hi Nick, I have added you to the contributor list. Haisheng On 2021/06/11 01:37:59, Nick Riasanovsky wrote: > Hi I'd like to join the JIRA contributor list. My Jira username is njriasan. >

Re: Requesting a Review on a PR

Hi Nick, I believe it is https://github.com/apache/calcite/pull/2435, right? People are reviewing now. Thanks, Haisheng Yuan On 2021/06/11 17:12:26, Nick Riasanovsky wrote: > I am a new contributor who opened a PR for an issue I opened on JIRA. Could > I get some clarity on the proce

Re: Trait propagation guidelines

,c]. You don't need the involvement of "derive". Haisheng Yuan On 2021/06/13 16:58:53, Vladimir Ozerov wrote: > Hi, > > I tried to apply different approaches, but eventually, I failed to achieve > my goals. It seems that the current implementation cannot han

Re: Possibly incorrect assertion in the TopDownRuleDriver.DeriveTrait.derive

rowse/CALCITE-3981 On 2021/06/13 18:35:02, Vladimir Ozerov wrote: > Thanks, I created an issue [1] to improve the assertion. > > [1] https://issues.apache.org/jira/browse/CALCITE-4650 > > пн, 7 июн. 2021 г. в 23:30, Haisheng Yuan : > > > > Shouldn't we remove the ass

Re: Trait propagation guidelines

it all depends on whether you design the operator "passthrough" and "derive" strategy correctly. [1] https://lists.apache.org/thread.html/r36b25cbe4ca05fb1262c432ad9103f4126b654698481fca0d2a01fe7%40%3Cdev.calcite.apache.org%3E Thanks, Haisheng Yuan On 2021/06/14 08:26:31, V

Re: [ANNOUNCE] New committer: Vladimir Ozerov

Congratulations and thanks for your contributions, Vladimir! Regards, Haisheng On 2021/06/23 21:34:40, Stamatis Zampetakis wrote: > Apache Calcite's Project Management Committee (PMC) has invited Vladimir > Ozerov to > become a committer, and we are pleased to announce that he has accepted. >

Re: Trait propagation guidelines

the TopDownRuleDriver cannot handle the case I described? > If not, how would you design the "passThrough" and "derive" routines to > find the optimal plan described? Does MaxCompute handle such cases? I > apologize if you already answered this, but I really cannot unde

Re: Contributor rights

Hi Evgeniy, I have added you to the contributor list. Thanks, Haisheng Yuan On 2021/06/30 14:26:43, "stanilovsky evgeny" wrote: > Hi, > > Could you please grant me contributor rights in Calcite JIRA? My username > is "zstan". > > Thank you. > Evgeniy. >

[DISCUSS] Draft board report for Jul 2021

| 5 | | rubenada | 1 | | amaliujia | 1 | | ForwardXu | 1 | | yuzhao.cyz | 1 | | liyafan82 | 1 | +---+-+ Thanks, Haisheng Yuan

Re: Proposal to extend Calcite into a incremental query optimizer

Hi Botong, We haven't heard from you for a while. Feel free to reach out if you get stuck or need help on rebasing code. Thanks, Haisheng On 2021/05/15 00:54:02, Botong Huang wrote: > Hi all, > > Thank you all for the interest, and thanks Julian for the update! > > I am having problems uploa

<    1   2   3   4   5   >