Thank you for your introduction, Siyuan.
Quicksql is an interesting project and full of potential. I'd like to learn
more about it.
Best,
Chunwei
On Tue, Mar 3, 2020 at 3:26 AM Siyuan Liu wrote:
> Hi, everyone:
>
> Glad to see a lot of old friends here. Quicksql is a project born
Hi, everyone:
Glad to see a lot of old friends here. Quicksql is a project born in early
2019. It was designed to solve the problem of long and complex work flow in
the big data field with many data sources, many compute engines, and many
types of syntax. The core idea is `Connect All Data
Hi everyone:
Allow me to introduce my good friend Siyuan Liu, who is the leader of
Quicksql project.
I CC to him and ask him to introduce the project to us.Here is the
documentation link for
Quicksql [1].
[1]. https://quicksql.readthedocs.io/en/latest/
Regards,
Francis
Juan Pan 于2019年12月23
urce.
Although it copies many classes from Calcite, the idea of QuickSQL seems
some of interests, and code is succinct.
Best,
Trista
Juan Pan (Trista)
Senior DBA & PPMC of Apache ShardingSphere(Incubating)
E-mail: panj...@apache.org
On 12/13/2019 17:16，Juan Pan wrote：
Yes, indeed.
ponding query for single datasource.
>
>
> Although it copies many classes from Calcite, the idea of QuickSQL seems
> some of interests, and code is succinct.
>
>
> Best,
> Trista
>
>
> Juan Pan (Trista)
>
> Senior DBA & PPMC of Apache ShardingSphere(Incubati
it copies many classes from Calcite, the idea of QuickSQL seems some
of interests, and code is succinct.
Best,
Trista
Juan Pan (Trista)
Senior DBA & PPMC of Apache ShardingSphere(Incubating)
E-mail: panj...@apache.org
On 12/13/2019 17:16，Juan Pan wrote：
Yes, in
nt data source will then be registered as temp spark tables
(with filter or join pushed in), the whole query is rewritten as SQL text over
these temp tables and submitted to Spark.
Does it mean QuickSQL also need adaptors to make query executed on different
data source?
Yes, virtualization is one of Calcite’s
se temp tables and submitted to Spark.
Does it mean QuickSQL also need adaptors to make query executed on
different data source?
Yes, virtualization is one of Calcite’s goals. In fact, when I created
Calcite I was thinking about virtualization + in-memory materialized views.
Not only the Spark conv
gt; > Hi Haisheng,
> >
> >
> > > The query on different data source will then be registered as temp
> spark tables (with filter or join pushed in), the whole query is rewritten
> as SQL text over these temp tables and submitted to Spark.
> >
> >
>
and submitted to Spark.
>
>
> Does it mean QuickSQL also need adaptors to make query executed on different
> data source?
>
>
> > Yes, virtualization is one of Calcite’s goals. In fact, when I created
> > Calcite I was thinking about virtualization + in-me
Hi Haisheng,
> The query on different data source will then be registered as temp spark
> tables (with filter or join pushed in), the whole query is rewritten as SQL
> text over these temp tables and submitted to Spark.
Does it mean QuickSQL also need adaptors to make query
As far as I know, users still need to register tables from other data sources
before querying it. QuickSQL uses Calcite for parsing queries and optimizing
logical expressions with several transformation rules. The query on different
data source will then be registered as temp spark tables
bout Optiq (precursor to Calcite)
> https://www.slideshare.net/julianhyde/optiq-a-dynamic-data-management-framework
> <
> https://www.slideshare.net/julianhyde/optiq-a-dynamic-data-management-framework
> >.
> > >
> > > Julian
> > >
> > >
> > >
>
rk
> >
> > <https://www.slideshare.net/julianhyde/optiq-a-dynamic-data-management-framework>.
> >
> > Julian
> >
> >
> >
> >> On Dec 9, 2019, at 2:29 PM, Muhammad Gelbana wrote:
> >>
> >> I recently contacted one of the ac
julianhyde/optiq-a-dynamic-data-management-framework>.
>
> Julian
>
>
>
>> On Dec 9, 2019, at 2:29 PM, Muhammad Gelbana wrote:
>>
>> I recently contacted one of the active contributors asking about the
>> purpose of the project and here's his rep
hammad Gelbana
> wrote:
> >
> > I recently contacted one of the active contributors asking about the
> > purpose of the project and here's his reply:
> >
> > From my understanding, Quicksql is a data virtualization platform. It can
> >> query multiple data s
na wrote:
>
> I recently contacted one of the active contributors asking about the
> purpose of the project and here's his reply:
>
> From my understanding, Quicksql is a data virtualization platform. It can
>> query multiple data sources altogether and in a distributed wa
I recently contacted one of the active contributors asking about the
purpose of the project and here's his reply:
>From my understanding, Quicksql is a data virtualization platform. It can
> query multiple data sources altogether and in a distributed way; Say, you
> can write a SQL wit
Anyone know anything about Quicksql? It seems to be quite a popular project,
and they have an internal fork of Calcite.
https://github.com/Qihoo360/ <https://github.com/Qihoo360/>
https://github.com/Qihoo360/Quicksql/tree/master/analysis/src/main/java/org/apache/calcite
<https://g
19 matches
Mail list logo
