Re: Does someone want to maintain the TsFile Golang version

2020-10-11 Thread Xiangdong Huang
Hi Giorgio,

If just IDL (Interface description language), then we still implement these
interfaces using different languages.

I do not think protobuf works. It can describe the format of TsFile, but
using protobuf to serialize data maybe not a good idea,
as we then are hard to know the meaning of each byte.

Besides, I am not sure protobuf can provide the best compression.

e.g., the first 12 bytes are magic string + version. If using protobuf, how
to constrain that?

Maybe many fields will have to be defined as bytes (define them as string
will waste space as we know the length of the string).

But maybe we can do some experiments.

Best,
---
Xiangdong Huang
School of Software, Tsinghua University

 黄向东
清华大学 软件学院


Giorgio Zoppi  于2020年10月11日周日 下午4:19写道:

> Hello,
> We definitely need an IDL for the TsFile, from the IDL we can define use a
> serialization mechanism that is not language dependent.
> Can TsFile be described with protobuf for example?
> BR,
> Giorgio
>


Re: Does someone want to maintain the TsFile Golang version

2020-10-11 Thread Giorgio Zoppi
Hello,
We definitely need an IDL for the TsFile, from the IDL we can define use a
serialization mechanism that is not language dependent.
Can TsFile be described with protobuf for example?
BR,
Giorgio


Re: Does someone want to maintain the TsFile Golang version

2020-10-10 Thread Jialin Qiao
Hi Chris,

Recently we found that there is a lot room for improvement in the 
TsFile(version 02) [1].

We could design the new TsFile structure (version 03) together and then 
consider the go version.

[1] http://iotdb.apache.org/SystemDesign/TsFile/Format.html

Thanks,
--
Jialin Qiao
School of Software, Tsinghua University

乔嘉林
清华大学 软件学院

> -原始邮件-
> 发件人: "Xiangdong Huang" 
> 发送时间: 2020-10-10 15:55:46 (星期六)
> 收件人: "Christofer Dutz" 
> 抄送: dev 
> 主题: Re: Does someone want to maintain the TsFile Golang version
> 
> Hi Chris,
> 
> Nice!
> 
> > But as I started learning go on Tuesday, I wouldn't call myself s senor
> go developer.
> 
> More senior than me. :D
> 
> By the way, tools/tsfileToolSet/print-tsfile-sketch.sh will provide help to
> understand the format of TsFile.
> 
> Best,
> ---
> Xiangdong Huang
> School of Software, Tsinghua University
> 
>  黄向东
> 清华大学 软件学院
> 
> 
> Christofer Dutz  于2020年10月10日周六 下午3:49写道:
> 
> > As I'm currently working on plc4go I could possibly join in :-)
> >
> > But as I started learning go on Tuesday, I wouldn't call myself s senor go
> > developer.
> >
> > Chris
> >
> > --
> > *Von:* Xiangdong Huang 
> > *Gesendet:* Samstag, 10. Oktober 2020 09:40
> > *An:* dev 
> > *Betreff:* Does someone want to maintain the TsFile Golang version
> >
> > Hi,
> >
> > Last year... someone (as far as I know, from Lenovo) proposed a Tsfile
> > read/write API implementation with GoLang[1].
> >
> > The file format is consistent with v0.8.0, but we have upgraded to v0.11
> > (the file format is the same with 0.10, version 02).
> >
> > Does someone want to maintain this PR?
> > The new TsFile format is here [2].
> >
> > [1] https://github.com/apache/iotdb/pull/124
> > [2] https://iotdb.apache.org/SystemDesign/TsFile/Format.html
> >
> > Best,
> > ---
> > Xiangdong Huang
> > School of Software, Tsinghua University
> >
> >  黄向东
> > 清华大学 软件学院
> >


Re: Does someone want to maintain the TsFile Golang version

2020-10-10 Thread Xiangdong Huang
Hi Chris,

Nice!

> But as I started learning go on Tuesday, I wouldn't call myself s senor
go developer.

More senior than me. :D

By the way, tools/tsfileToolSet/print-tsfile-sketch.sh will provide help to
understand the format of TsFile.

Best,
---
Xiangdong Huang
School of Software, Tsinghua University

 黄向东
清华大学 软件学院


Christofer Dutz  于2020年10月10日周六 下午3:49写道:

> As I'm currently working on plc4go I could possibly join in :-)
>
> But as I started learning go on Tuesday, I wouldn't call myself s senor go
> developer.
>
> Chris
>
> --
> *Von:* Xiangdong Huang 
> *Gesendet:* Samstag, 10. Oktober 2020 09:40
> *An:* dev 
> *Betreff:* Does someone want to maintain the TsFile Golang version
>
> Hi,
>
> Last year... someone (as far as I know, from Lenovo) proposed a Tsfile
> read/write API implementation with GoLang[1].
>
> The file format is consistent with v0.8.0, but we have upgraded to v0.11
> (the file format is the same with 0.10, version 02).
>
> Does someone want to maintain this PR?
> The new TsFile format is here [2].
>
> [1] https://github.com/apache/iotdb/pull/124
> [2] https://iotdb.apache.org/SystemDesign/TsFile/Format.html
>
> Best,
> ---
> Xiangdong Huang
> School of Software, Tsinghua University
>
>  黄向东
> 清华大学 软件学院
>


Re: Does someone want to maintain the TsFile Golang version

2020-10-10 Thread Christofer Dutz
As I'm currently working on plc4go I could possibly join in :-)

But as I started learning go on Tuesday, I wouldn't call myself s senor go 
developer.

Chris


Von: Xiangdong Huang 
Gesendet: Samstag, 10. Oktober 2020 09:40
An: dev 
Betreff: Does someone want to maintain the TsFile Golang version

Hi,

Last year... someone (as far as I know, from Lenovo) proposed a Tsfile
read/write API implementation with GoLang[1].

The file format is consistent with v0.8.0, but we have upgraded to v0.11
(the file format is the same with 0.10, version 02).

Does someone want to maintain this PR?
The new TsFile format is here [2].

[1] https://github.com/apache/iotdb/pull/124
[2] https://iotdb.apache.org/SystemDesign/TsFile/Format.html

Best,
---
Xiangdong Huang
School of Software, Tsinghua University

 黄向东
清华大学 软件学院