Re: Does someone want to maintain the TsFile Golang version
Hi Giorgio, If just IDL (Interface description language), then we still implement these interfaces using different languages. I do not think protobuf works. It can describe the format of TsFile, but using protobuf to serialize data maybe not a good idea, as we then are hard to know the meaning of each byte. Besides, I am not sure protobuf can provide the best compression. e.g., the first 12 bytes are magic string + version. If using protobuf, how to constrain that? Maybe many fields will have to be defined as bytes (define them as string will waste space as we know the length of the string). But maybe we can do some experiments. Best, --- Xiangdong Huang School of Software, Tsinghua University 黄向东 清华大学 软件学院 Giorgio Zoppi 于2020年10月11日周日 下午4:19写道: > Hello, > We definitely need an IDL for the TsFile, from the IDL we can define use a > serialization mechanism that is not language dependent. > Can TsFile be described with protobuf for example? > BR, > Giorgio >
Re: Does someone want to maintain the TsFile Golang version
Hello, We definitely need an IDL for the TsFile, from the IDL we can define use a serialization mechanism that is not language dependent. Can TsFile be described with protobuf for example? BR, Giorgio
Re: Does someone want to maintain the TsFile Golang version
Hi Chris, Recently we found that there is a lot room for improvement in the TsFile(version 02) [1]. We could design the new TsFile structure (version 03) together and then consider the go version. [1] http://iotdb.apache.org/SystemDesign/TsFile/Format.html Thanks, -- Jialin Qiao School of Software, Tsinghua University 乔嘉林 清华大学 软件学院 > -原始邮件- > 发件人: "Xiangdong Huang" > 发送时间: 2020-10-10 15:55:46 (星期六) > 收件人: "Christofer Dutz" > 抄送: dev > 主题: Re: Does someone want to maintain the TsFile Golang version > > Hi Chris, > > Nice! > > > But as I started learning go on Tuesday, I wouldn't call myself s senor > go developer. > > More senior than me. :D > > By the way, tools/tsfileToolSet/print-tsfile-sketch.sh will provide help to > understand the format of TsFile. > > Best, > --- > Xiangdong Huang > School of Software, Tsinghua University > > 黄向东 > 清华大学 软件学院 > > > Christofer Dutz 于2020年10月10日周六 下午3:49写道: > > > As I'm currently working on plc4go I could possibly join in :-) > > > > But as I started learning go on Tuesday, I wouldn't call myself s senor go > > developer. > > > > Chris > > > > -- > > *Von:* Xiangdong Huang > > *Gesendet:* Samstag, 10. Oktober 2020 09:40 > > *An:* dev > > *Betreff:* Does someone want to maintain the TsFile Golang version > > > > Hi, > > > > Last year... someone (as far as I know, from Lenovo) proposed a Tsfile > > read/write API implementation with GoLang[1]. > > > > The file format is consistent with v0.8.0, but we have upgraded to v0.11 > > (the file format is the same with 0.10, version 02). > > > > Does someone want to maintain this PR? > > The new TsFile format is here [2]. > > > > [1] https://github.com/apache/iotdb/pull/124 > > [2] https://iotdb.apache.org/SystemDesign/TsFile/Format.html > > > > Best, > > --- > > Xiangdong Huang > > School of Software, Tsinghua University > > > > 黄向东 > > 清华大学 软件学院 > >
Re: Does someone want to maintain the TsFile Golang version
Hi Chris, Nice! > But as I started learning go on Tuesday, I wouldn't call myself s senor go developer. More senior than me. :D By the way, tools/tsfileToolSet/print-tsfile-sketch.sh will provide help to understand the format of TsFile. Best, --- Xiangdong Huang School of Software, Tsinghua University 黄向东 清华大学 软件学院 Christofer Dutz 于2020年10月10日周六 下午3:49写道: > As I'm currently working on plc4go I could possibly join in :-) > > But as I started learning go on Tuesday, I wouldn't call myself s senor go > developer. > > Chris > > -- > *Von:* Xiangdong Huang > *Gesendet:* Samstag, 10. Oktober 2020 09:40 > *An:* dev > *Betreff:* Does someone want to maintain the TsFile Golang version > > Hi, > > Last year... someone (as far as I know, from Lenovo) proposed a Tsfile > read/write API implementation with GoLang[1]. > > The file format is consistent with v0.8.0, but we have upgraded to v0.11 > (the file format is the same with 0.10, version 02). > > Does someone want to maintain this PR? > The new TsFile format is here [2]. > > [1] https://github.com/apache/iotdb/pull/124 > [2] https://iotdb.apache.org/SystemDesign/TsFile/Format.html > > Best, > --- > Xiangdong Huang > School of Software, Tsinghua University > > 黄向东 > 清华大学 软件学院 >
Re: Does someone want to maintain the TsFile Golang version
As I'm currently working on plc4go I could possibly join in :-) But as I started learning go on Tuesday, I wouldn't call myself s senor go developer. Chris Von: Xiangdong Huang Gesendet: Samstag, 10. Oktober 2020 09:40 An: dev Betreff: Does someone want to maintain the TsFile Golang version Hi, Last year... someone (as far as I know, from Lenovo) proposed a Tsfile read/write API implementation with GoLang[1]. The file format is consistent with v0.8.0, but we have upgraded to v0.11 (the file format is the same with 0.10, version 02). Does someone want to maintain this PR? The new TsFile format is here [2]. [1] https://github.com/apache/iotdb/pull/124 [2] https://iotdb.apache.org/SystemDesign/TsFile/Format.html Best, --- Xiangdong Huang School of Software, Tsinghua University 黄向东 清华大学 软件学院