Re: Integrate Calcite in IoTDB

2019-03-20 Thread Julian Feinauer
> > I can tell you something about the structure of Calcite
> Integratioons (or make a walkthrough through the Plc4x integration 
I’ve
> done).
> >
> > What do the others think?
> >
> > Julian
    > >
    > > Von: 李天安 
> > Datum: Montag, 25. Februar 2019 um 17:01
> > An: "jfeina...@apache.org" 
> > Betreff: Fwd: Integrate Calcite in IoTDB
> >
> >
> >
> >
> > 下面是被转发的邮件:
> >
> > 发件人: 李天安  lt...@mails.tsinghua.edu.cn>>
> > 主题: Integrate Calcite in IoTDB
> > 日期: 2019年2月25日 GMT+8 下午2:56:56
> > 收件人: dev@iotdb.apache.org<mailto:dev@iotdb.apache.org>
> > 回复-收件人: dev@iotdb.apache.org<mailto:dev@iotdb.apache.org>
> >
> > Hi Julian,
> >
> > My name is Tianan Li, one of the initial committers of IoTDB
> project. Over the past few months, we have optimized the structure and
> content of the IoTDB project and basically completed it. Now we hope 
to
> integrate with Calcite. I wonder if you would like to instruct us to
> complete the Calcite-IoTDB Adapter.
> >
> > Best
> > Tianan Li
> >
> >
> > 在 2018年12月3日,上午5:25,Julian Feinauer 
 jfeina...@apache.org>> 写道:
> >
> > Hi,
> >
> > my name is Julian Feinauer and I come from Apache Calcite, 
Edgent
> and PLC4X. My interest is mostly in time series processing at the 
edge. In
> my daytime job I work for two companies called pragmatic minds and
> pragmatic industries which we founded nearly 3 years ago in South 
Germany.
> > I love the idea behind iotDB as it is realy the materialization 
of
> many of my thoughts about what we really need for efficient storage 
of ts
> data.
> > I would love to get my hands dirty on the query and filter api 
and
> perhaps even write a small Calcite Adapter, when I find some time in 
the
> next weeks.
> >
> > We have many "IoT" projects with practical use cases in the 
industry
> so I'll try to bring my perspective in as best as possible.
> >
> > Best
> > Julian
> >
> >
>
>
>
>






Re: Integrate Calcite in IoTDB

2019-03-20 Thread Julian Feinauer
Hi Gaofei,

well it seems from the first message indeed as if you simply should build the 
local Calicte snapshot.
Calcite is currently about to do the 1.19 release so their build should work.

Let me see if we can simply downgrade everything on 1.18 release of calcite. If 
so, everything should be fine : )

Sorry for this snapshot dependency, I forgot that others could also use the 
code.

Julian

Am 20.03.19, 15:04 schrieb "Gaofei Cao" :

Hi Julian,

I cloned your repo https://github.com/JulianFeinauer/incubator-iotdb/tree/
calcite-integration, but an error appeared as below.

Could not resolve dependencies for project
>> org.apache.iotdb:iotdb-calcite:jar:0.8.0-SNAPSHOT: Failure to find
>> org.apache.calcite:calcite-core:jar:1.19.0-SNAPSHOT in
>> https://repository.apache.org/snapshots was cached in the local
>> repository, resolution will not be reattempted until the update interval 
of
>> apache.snapshots has elapsed or updates are forced -> [Help 1]
>
>
>
And I cloned Apache-Calcite, checkout to the branch branch-1.19, executed
`mvn clean install -Dmaven.test.skip=true`, but an error appeared as below.

[ERROR] Failed to execute goal
>> org.apache.maven.plugins:maven-dependency-plugin:3.1.1:analyze-only
>> (analyze) on project calcite-linq4j: Dependency problems found -> [Help 
1]
>
> [ERROR]
>
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
>> -e switch.
>
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>
> [ERROR]
>
> [ERROR] For more information about the errors and possible solutions,
>> please read the following articles:
>
> [ERROR] [Help 1]
>> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
>
> [ERROR]
>
> [ERROR] After correcting the problems, you can resume the build with the
>> command
>
> [ERROR]   mvn  -rf :calcite-linq4j
>
>
> So how to solve this problem. And maybe i think it's better to ask this
problem in Calcite community haha. 😂

Thanks & Best Regards
Gaofei

Julian Feinauer  于2019年2月28日周四 上午12:23写道:

> Hi Tianan,
>
> personally I found it difficould to learn Calcite from the Documentation,
> but the csv Examples are quite okay to follow.
> I also filed a Jira for this issue [1] and prepared a minimal working
> example for Calcite on top of a tsfile in my fork [2].
>
> The Example in the Repo is fully functional and maps each device from a
> tsfile to one Table and each measurement to a column (+ timestamp).
> It supports basically all SQL Queries.
>
> Of course there is no efficiency yet like predicate pushdown or path
> selection pushdown or so... this is the fun work for the future : )
>
> Best
> Julian
>
> [1] https://issues.apache.org/jira/browse/IOTDB-28
> [2]
> https://github.com/JulianFeinauer/incubator-iotdb/tree/calcite-integration
>
> Am 27.02.19, 16:12 schrieb "李天安" :
>
> Hi Julian,
> Nice to hear from you.
> I’m very glad to hear that you’d like to help us with the
> integration.
> We want to proceed the integration  as follows:
> Firstly, we will learn how you integrate calcite with other
> products from official website.
> After that, we discuss the structure of Calcite Integration with
> you.
>
> Tianan Li
>
> > 在 2019年2月26日,上午4:39,Julian Feinauer 
> 写道:
> >
> > Hi Tianan,
> >
> > nice to hear from you!
> > I just recently recognized how far you have come and how less time I
> commited to IoTDB.
> > I would really love to participate in this effort and help you with
> the Calcite Adapter.
> > What do you think is the best way to proceed?
> > I can tell you something about the structure of Calcite
    > Integratioons (or make a walkthrough through the Plc4x integration I’ve
> done).
> >
> > What do the others think?
    > >
    >     > Julian
> >
> > Von: 李天安 
> > Datum: Montag, 25. Februar 2019 um 17:01
> > An: "jfeina...@apache.org" 
> > Betreff: Fwd: Integrate Calcite in IoTDB
> >
> >
> >
> >
> > 下面是被转发的邮件:
> >
> > 发件人: 李天安  lt...@mails.tsinghua.ed

Re: Integrate Calcite in IoTDB

2019-03-20 Thread Gaofei Cao
Hi Julian,

I cloned your repo https://github.com/JulianFeinauer/incubator-iotdb/tree/
calcite-integration, but an error appeared as below.

Could not resolve dependencies for project
>> org.apache.iotdb:iotdb-calcite:jar:0.8.0-SNAPSHOT: Failure to find
>> org.apache.calcite:calcite-core:jar:1.19.0-SNAPSHOT in
>> https://repository.apache.org/snapshots was cached in the local
>> repository, resolution will not be reattempted until the update interval of
>> apache.snapshots has elapsed or updates are forced -> [Help 1]
>
>
>
And I cloned Apache-Calcite, checkout to the branch branch-1.19, executed
`mvn clean install -Dmaven.test.skip=true`, but an error appeared as below.

[ERROR] Failed to execute goal
>> org.apache.maven.plugins:maven-dependency-plugin:3.1.1:analyze-only
>> (analyze) on project calcite-linq4j: Dependency problems found -> [Help 1]
>
> [ERROR]
>
> [ERROR] To see the full stack trace of the errors, re-run Maven with the
>> -e switch.
>
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
>
> [ERROR]
>
> [ERROR] For more information about the errors and possible solutions,
>> please read the following articles:
>
> [ERROR] [Help 1]
>> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
>
> [ERROR]
>
> [ERROR] After correcting the problems, you can resume the build with the
>> command
>
> [ERROR]   mvn  -rf :calcite-linq4j
>
>
> So how to solve this problem. And maybe i think it's better to ask this
problem in Calcite community haha. 😂

Thanks & Best Regards
Gaofei

Julian Feinauer  于2019年2月28日周四 上午12:23写道:

> Hi Tianan,
>
> personally I found it difficould to learn Calcite from the Documentation,
> but the csv Examples are quite okay to follow.
> I also filed a Jira for this issue [1] and prepared a minimal working
> example for Calcite on top of a tsfile in my fork [2].
>
> The Example in the Repo is fully functional and maps each device from a
> tsfile to one Table and each measurement to a column (+ timestamp).
> It supports basically all SQL Queries.
>
> Of course there is no efficiency yet like predicate pushdown or path
> selection pushdown or so... this is the fun work for the future : )
>
> Best
> Julian
>
> [1] https://issues.apache.org/jira/browse/IOTDB-28
> [2]
> https://github.com/JulianFeinauer/incubator-iotdb/tree/calcite-integration
>
> Am 27.02.19, 16:12 schrieb "李天安" :
>
> Hi Julian,
> Nice to hear from you.
> I’m very glad to hear that you’d like to help us with the
> integration.
> We want to proceed the integration  as follows:
> Firstly, we will learn how you integrate calcite with other
> products from official website.
> After that, we discuss the structure of Calcite Integration with
> you.
>
> Tianan Li
>
> > 在 2019年2月26日,上午4:39,Julian Feinauer 
> 写道:
> >
> > Hi Tianan,
> >
> > nice to hear from you!
> > I just recently recognized how far you have come and how less time I
> commited to IoTDB.
> > I would really love to participate in this effort and help you with
> the Calcite Adapter.
> > What do you think is the best way to proceed?
> > I can tell you something about the structure of Calcite
> Integratioons (or make a walkthrough through the Plc4x integration I’ve
> done).
>     >
> > What do the others think?
> >
> > Julian
> >
> > Von: 李天安 
> > Datum: Montag, 25. Februar 2019 um 17:01
> > An: "jfeina...@apache.org" 
> > Betreff: Fwd: Integrate Calcite in IoTDB
> >
> >
> >
> >
> > 下面是被转发的邮件:
> >
> > 发件人: 李天安  lt...@mails.tsinghua.edu.cn>>
> > 主题: Integrate Calcite in IoTDB
> > 日期: 2019年2月25日 GMT+8 下午2:56:56
> > 收件人: dev@iotdb.apache.org<mailto:dev@iotdb.apache.org>
> > 回复-收件人: dev@iotdb.apache.org<mailto:dev@iotdb.apache.org>
> >
> > Hi Julian,
> >
> > My name is Tianan Li, one of the initial committers of IoTDB
> project. Over the past few months, we have optimized the structure and
> content of the IoTDB project and basically completed it. Now we hope to
> integrate with Calcite. I wonder if you would like to instruct us to
> complete the Calcite-IoTDB Adapter.
> >
> > Best
> > Tianan Li
> >
> >
> > 在 2018年12月3日,上午5:25,Julian Feinauer  jfeina...@apache.org>> 写道:
> >
> > Hi,
> >
> > my name is Julian Feinauer and I come from Apach

Re: Integrate Calcite in IoTDB

2019-02-27 Thread Julian Feinauer
Hi Tianan,

personally I found it difficould to learn Calcite from the Documentation, but 
the csv Examples are quite okay to follow.
I also filed a Jira for this issue [1] and prepared a minimal working example 
for Calcite on top of a tsfile in my fork [2].

The Example in the Repo is fully functional and maps each device from a tsfile 
to one Table and each measurement to a column (+ timestamp).
It supports basically all SQL Queries.

Of course there is no efficiency yet like predicate pushdown or path selection 
pushdown or so... this is the fun work for the future : )

Best
Julian

[1] https://issues.apache.org/jira/browse/IOTDB-28
[2] https://github.com/JulianFeinauer/incubator-iotdb/tree/calcite-integration

Am 27.02.19, 16:12 schrieb "李天安" :

Hi Julian,
Nice to hear from you.
I’m very glad to hear that you’d like to help us with the integration.
We want to proceed the integration  as follows: 
Firstly, we will learn how you integrate calcite with other products 
from official website.
After that, we discuss the structure of Calcite Integration with you.

Tianan Li

> 在 2019年2月26日,上午4:39,Julian Feinauer  写道:
> 
> Hi Tianan,
> 
> nice to hear from you!
> I just recently recognized how far you have come and how less time I 
commited to IoTDB.
> I would really love to participate in this effort and help you with the 
Calcite Adapter.
> What do you think is the best way to proceed?
> I can tell you something about the structure of Calcite Integratioons (or 
make a walkthrough through the Plc4x integration I’ve done).
> 
> What do the others think?
> 
> Julian
> 
> Von: 李天安 
> Datum: Montag, 25. Februar 2019 um 17:01
> An: "jfeina...@apache.org" 
> Betreff: Fwd: Integrate Calcite in IoTDB
> 
> 
> 
> 
> 下面是被转发的邮件:
    > 
> 发件人: 李天安 mailto:lt...@mails.tsinghua.edu.cn>>
> 主题: Integrate Calcite in IoTDB
> 日期: 2019年2月25日 GMT+8 下午2:56:56
> 收件人: dev@iotdb.apache.org<mailto:dev@iotdb.apache.org>
> 回复-收件人: dev@iotdb.apache.org<mailto:dev@iotdb.apache.org>
> 
> Hi Julian,
> 
> My name is Tianan Li, one of the initial committers of IoTDB project. 
Over the past few months, we have optimized the structure and content of the 
IoTDB project and basically completed it. Now we hope to integrate with 
Calcite. I wonder if you would like to instruct us to complete the 
Calcite-IoTDB Adapter.
> 
> Best
> Tianan Li
> 
> 
> 在 2018年12月3日,上午5:25,Julian Feinauer 
mailto:jfeina...@apache.org>> 写道:
> 
> Hi,
> 
> my name is Julian Feinauer and I come from Apache Calcite, Edgent and 
PLC4X. My interest is mostly in time series processing at the edge. In my 
daytime job I work for two companies called pragmatic minds and pragmatic 
industries which we founded nearly 3 years ago in South Germany.
> I love the idea behind iotDB as it is realy the materialization of many 
of my thoughts about what we really need for efficient storage of ts data.
> I would love to get my hands dirty on the query and filter api and 
perhaps even write a small Calcite Adapter, when I find some time in the next 
weeks.
> 
> We have many "IoT" projects with practical use cases in the industry so 
I'll try to bring my perspective in as best as possible.
> 
> Best
> Julian
> 
> 





Re: Integrate Calcite in IoTDB

2019-02-27 Thread 李天安
Hi Julian,
Nice to hear from you.
I’m very glad to hear that you’d like to help us with the integration.
We want to proceed the integration  as follows: 
Firstly, we will learn how you integrate calcite with other products from 
official website.
After that, we discuss the structure of Calcite Integration with you.

Tianan Li

> 在 2019年2月26日,上午4:39,Julian Feinauer  写道:
> 
> Hi Tianan,
> 
> nice to hear from you!
> I just recently recognized how far you have come and how less time I commited 
> to IoTDB.
> I would really love to participate in this effort and help you with the 
> Calcite Adapter.
> What do you think is the best way to proceed?
> I can tell you something about the structure of Calcite Integratioons (or 
> make a walkthrough through the Plc4x integration I’ve done).
> 
> What do the others think?
> 
> Julian
> 
> Von: 李天安 
> Datum: Montag, 25. Februar 2019 um 17:01
> An: "jfeina...@apache.org" 
> Betreff: Fwd: Integrate Calcite in IoTDB
> 
> 
> 
> 
> 下面是被转发的邮件:
> 
> 发件人: 李天安 mailto:lt...@mails.tsinghua.edu.cn>>
> 主题: Integrate Calcite in IoTDB
> 日期: 2019年2月25日 GMT+8 下午2:56:56
> 收件人: dev@iotdb.apache.org<mailto:dev@iotdb.apache.org>
> 回复-收件人: dev@iotdb.apache.org<mailto:dev@iotdb.apache.org>
> 
> Hi Julian,
> 
> My name is Tianan Li, one of the initial committers of IoTDB project. Over 
> the past few months, we have optimized the structure and content of the IoTDB 
> project and basically completed it. Now we hope to integrate with Calcite. I 
> wonder if you would like to instruct us to complete the Calcite-IoTDB Adapter.
> 
> Best
> Tianan Li
> 
> 
> 在 2018年12月3日,上午5:25,Julian Feinauer 
> mailto:jfeina...@apache.org>> 写道:
> 
> Hi,
> 
> my name is Julian Feinauer and I come from Apache Calcite, Edgent and PLC4X. 
> My interest is mostly in time series processing at the edge. In my daytime 
> job I work for two companies called pragmatic minds and pragmatic industries 
> which we founded nearly 3 years ago in South Germany.
> I love the idea behind iotDB as it is realy the materialization of many of my 
> thoughts about what we really need for efficient storage of ts data.
> I would love to get my hands dirty on the query and filter api and perhaps 
> even write a small Calcite Adapter, when I find some time in the next weeks.
> 
> We have many "IoT" projects with practical use cases in the industry so I'll 
> try to bring my perspective in as best as possible.
> 
> Best
> Julian
> 
> 



Re: Integrate Calcite in IoTDB

2019-02-25 Thread Julian Feinauer
Hi Tianan,

nice to hear from you!
I just recently recognized how far you have come and how less time I commited 
to IoTDB.
I would really love to participate in this effort and help you with the Calcite 
Adapter.
What do you think is the best way to proceed?
I can tell you something about the structure of Calcite Integratioons (or make 
a walkthrough through the Plc4x integration I’ve done).

What do the others think?

Julian

Von: 李天安 
Datum: Montag, 25. Februar 2019 um 17:01
An: "jfeina...@apache.org" 
Betreff: Fwd: Integrate Calcite in IoTDB




下面是被转发的邮件:

发件人: 李天安 mailto:lt...@mails.tsinghua.edu.cn>>
主题: Integrate Calcite in IoTDB
日期: 2019年2月25日 GMT+8 下午2:56:56
收件人: dev@iotdb.apache.org<mailto:dev@iotdb.apache.org>
回复-收件人: dev@iotdb.apache.org<mailto:dev@iotdb.apache.org>

Hi Julian,

My name is Tianan Li, one of the initial committers of IoTDB project. Over the 
past few months, we have optimized the structure and content of the IoTDB 
project and basically completed it. Now we hope to integrate with Calcite. I 
wonder if you would like to instruct us to complete the Calcite-IoTDB Adapter.

Best
Tianan Li


在 2018年12月3日,上午5:25,Julian Feinauer 
mailto:jfeina...@apache.org>> 写道:

Hi,

my name is Julian Feinauer and I come from Apache Calcite, Edgent and PLC4X. My 
interest is mostly in time series processing at the edge. In my daytime job I 
work for two companies called pragmatic minds and pragmatic industries which we 
founded nearly 3 years ago in South Germany.
I love the idea behind iotDB as it is realy the materialization of many of my 
thoughts about what we really need for efficient storage of ts data.
I would love to get my hands dirty on the query and filter api and perhaps even 
write a small Calcite Adapter, when I find some time in the next weeks.

We have many "IoT" projects with practical use cases in the industry so I'll 
try to bring my perspective in as best as possible.

Best
Julian




Integrate Calcite in IoTDB

2019-02-24 Thread 李天安
Hi Julian,

My name is Tianan Li, one of the initial committers of IoTDB project. Over the 
past few months, we have optimized the structure and content of the IoTDB 
project and basically completed it. Now we hope to integrate with Calcite. I 
wonder if you would like to instruct us to complete the Calcite-IoTDB Adapter. 

Best
Tianan Li

> 在 2018年12月3日,上午5:25,Julian Feinauer  写道:
> 
> Hi,
> 
> my name is Julian Feinauer and I come from Apache Calcite, Edgent and PLC4X. 
> My interest is mostly in time series processing at the edge. In my daytime 
> job I work for two companies called pragmatic minds and pragmatic industries 
> which we founded nearly 3 years ago in South Germany.
> I love the idea behind iotDB as it is realy the materialization of many of my 
> thoughts about what we really need for efficient storage of ts data.
> I would love to get my hands dirty on the query and filter api and perhaps 
> even write a small Calcite Adapter, when I find some time in the next weeks.
> 
> We have many "IoT" projects with practical use cases in the industry so I'll 
> try to bring my perspective in as best as possible.
> 
> Best
> Julian