Use spark as Calcite execution engine

2017-06-19 Thread JD Zheng
Hi, We are using calcite druid adaptor to query data stored in druid. But lots of operations are not pushed down to druid, the built-in enumerable execution engine becomes the bottleneck for some of the queries that’s not pushed down. As we also have some use-case to join data in druid from ou

Re: Question regarding "select * from" behavior with RelRecordType(PEEK_FIELDS, ...)

2017-06-19 Thread Shuyi Chen
Can we add an option in StructKind, say, PEEK_FIELDS_NO_STAR_EXPANSION? And modify SqlValidatorImpl.java to disable star expansion optionally? Thanks a lot. Shuyi On Sun, Jun 18, 2017 at 11:59 PM, Shuyi Chen wrote: > We do want to use the PEEK_FIELDS behavior as Flink does support > RecordType.

[jira] [Created] (CALCITE-1851) Decorrelation should get rid of correlated predicates while decorrelation filter condition

2017-06-19 Thread Vineet Garg (JIRA)
Vineet Garg created CALCITE-1851: Summary: Decorrelation should get rid of correlated predicates while decorrelation filter condition Key: CALCITE-1851 URL: https://issues.apache.org/jira/browse/CALCITE-1851

The use of CalciteConnectionConfigImpl within the Druid Adapter

2017-06-19 Thread Zain Humayun
Hi, I see that the class CalciteConnectionConfigImpl has several useful methods to retrieve information about whether approximate results are acceptable. For example, the approximateDistinctCount method was added in CALCITE-1587. As far as I can see, the Druid adapter doesn't use this method to

[jira] [Created] (CALCITE-1850) Extend UnionMergeRule to deal with more than 2 branches

2017-06-19 Thread Pengcheng Xiong (JIRA)
Pengcheng Xiong created CALCITE-1850: Summary: Extend UnionMergeRule to deal with more than 2 branches Key: CALCITE-1850 URL: https://issues.apache.org/jira/browse/CALCITE-1850 Project: Calcite

Rule to eliminate a redundant LogicalSort

2017-06-19 Thread Michael Alexeev
Hi All, I am trying to write a rule to eliminate a potentially redundant LogicalSort node. Consider SELECT I FROM R1 ORDER BY I; The initial tree is LogicalSort(sort0=[$0], dir0=[DESC]) LogicalProject(I=[$0]) MyTableScan(table=[[R1]], expr#0..5=[{inputs}], proj#0..5=[{exprs}]) and after

Creating a Rule operand that can get both children of a multi-input Rel

2017-06-19 Thread James Duong
Hi, I'm trying to write a rule for a subclass of Join where I need to check the properties of the two children of the node. How might I write a rule operand to capture this scenario? Thanks

Re: Broken VM

2017-06-19 Thread Michael Mior
Just pinging this thread as well that the issue with the VM should be fixed now. For some reason the version of Java the VM was trying to load was no longer valid upstream. If you pull from the repo and rebuild the VM things should be ok now. -- Michael Mior mm...@apache.org 2017-06-07 14:05 GMT-

Re: [ANNOUNCE] New committer: Kevin Liew

2017-06-19 Thread James Taylor
Welcome, Kevin! On Mon, Jun 19, 2017 at 6:34 AM Michael Mior wrote: > Congratulations Kevin and thanks for your continued contributions! > > -- > Michael Mior > mm...@apache.org > > 2017-06-18 11:58 GMT-04:00 Julian Hyde : > > > Apache Calcite's Project Management Committee (PMC) has invited > >

Re: Understanding checkPlanning method

2017-06-19 Thread Jesus Camacho Rodriguez
Hi Atri, You will need to change the expected plan accordingly in RelOptRulesTest.xml. https://github.com/apache/calcite/blob/master/core/src/test/resources/org/apache/calcite/test/RelOptRulesTest.xml -Jesús On 6/18/17, 7:05 PM, "Atri Sharma" wrote: >Hi All, > >I am trying to understand t

Re: [ANNOUNCE] New committer: Slim Bouguerra

2017-06-19 Thread Michael Mior
Congratulations Slim! Looking forward to continued improvements to the Druid adapter. -- Michael Mior mm...@apache.org 2017-06-18 12:04 GMT-04:00 Julian Hyde : > Apache Calcite's Project Management Committee (PMC) has invited > Slim Bouguerra to become a committer, and we are pleased to > announ

Re: [ANNOUNCE] New committer: Kevin Liew

2017-06-19 Thread Michael Mior
Congratulations Kevin and thanks for your continued contributions! -- Michael Mior mm...@apache.org 2017-06-18 11:58 GMT-04:00 Julian Hyde : > Apache Calcite's Project Management Committee (PMC) has invited > Kevin Liew to become a committer, and we are pleased to announce > that he has accepted

Table Alias in TableScan

2017-06-19 Thread Abbas Gadhia
Hi,I'm trying to build a Hive query adapter using Calcite.My source system can be anything SQL, NoSQL etc. Since the source systems typically have business names/alias given to their tables in the queries, I would like to preserve them in the Hive Adapter layer, so that the translated query cont

[jira] [Created] (CALCITE-1849) SubQuery in not support in reltosql when SqlToRelConverter.Config.expand = false

2017-06-19 Thread Zhiqiang He (JIRA)
Zhiqiang He created CALCITE-1849: Summary: SubQuery in not support in reltosql when SqlToRelConverter.Config.expand = false Key: CALCITE-1849 URL: https://issues.apache.org/jira/browse/CALCITE-1849 Pr

Re: [ANNOUNCE] New committer: Slim Bouguerra

2017-06-19 Thread Jesus Camacho Rodriguez
Congrats Slim, welcome! -Jesús On 6/19/17, 2:34 AM, "zhiqiang" wrote: >Congratulations and welcome! > > > > >zhiqiang > > > > > > > >On Mon, Jun 19, 2017 at 12:04 AM +0800, "Julian" wrote: > > > > > > > > > > >Apache Calcite's Project Management Committee (PMC) has invited >Slim Bouguerra

Re: [ANNOUNCE] New committer: Kevin Liew

2017-06-19 Thread Jesus Camacho Rodriguez
Congrats Kevin, welcome! -Jesús On 6/19/17, 2:34 AM, "zhiqiang" wrote: >Congratulations and welcome! > > > > >zhiqiang > > > > > > > >On Sun, Jun 18, 2017 at 11:58 PM +0800, "Julian" wrote: > > > > > > > > > > >Apache Calcite's Project Management Committee (PMC) has invited >Kevin Liew to b