Re: [DISCUSS] Incubating TsFile as an independent Apache project?
It seems many contributor are interested in the rust api for TsFile Giorgio Zoppi 于2023年10月19日周四 04:27写道: > Hey, > If we're planning to port it native rust/go, I can help also as PMC if it's > needed or whatever. > Best regards, > Giorgio > > Il giorno mar 10 ott 2023 alle ore 22:37 Christofer Dutz < > christofer.d...@c-ware.de> ha scritto: > > > I'd say, just as a board resolution to the board meeting. > > > > Chris > > > > Gesendet von Outlook für Android<https://aka.ms/AAb9ysg> > > > > From: Justin Mclean > > Sent: Tuesday, October 10, 2023 6:34:08 PM > > To: dev@iotdb.apache.org > > Subject: Re: [DISCUSS] Incubating TsFile as an independent Apache > project? > > > > Hi, > > > > If enough people on the initial PMC know the ASF process well, there > would > > be no need to go through the Incubator but go straight to TLP. > > > > Kind Regards, > > Justin > > > > > -- > Life is a chess game - Anonymous. >
Re: [DISCUSS] Incubating TsFile as an independent Apache project?
Hey, If we're planning to port it native rust/go, I can help also as PMC if it's needed or whatever. Best regards, Giorgio Il giorno mar 10 ott 2023 alle ore 22:37 Christofer Dutz < christofer.d...@c-ware.de> ha scritto: > I'd say, just as a board resolution to the board meeting. > > Chris > > Gesendet von Outlook für Android<https://aka.ms/AAb9ysg> > > From: Justin Mclean > Sent: Tuesday, October 10, 2023 6:34:08 PM > To: dev@iotdb.apache.org > Subject: Re: [DISCUSS] Incubating TsFile as an independent Apache project? > > Hi, > > If enough people on the initial PMC know the ASF process well, there would > be no need to go through the Incubator but go straight to TLP. > > Kind Regards, > Justin > -- Life is a chess game - Anonymous.
Re: [DISCUSS] Incubating TsFile as an independent Apache project?
I'd say, just as a board resolution to the board meeting. Chris Gesendet von Outlook für Android<https://aka.ms/AAb9ysg> From: Justin Mclean Sent: Tuesday, October 10, 2023 6:34:08 PM To: dev@iotdb.apache.org Subject: Re: [DISCUSS] Incubating TsFile as an independent Apache project? Hi, If enough people on the initial PMC know the ASF process well, there would be no need to go through the Incubator but go straight to TLP. Kind Regards, Justin
Re: [DISCUSS] Incubating TsFile as an independent Apache project?
Hi, If enough people on the initial PMC know the ASF process well, there would be no need to go through the Incubator but go straight to TLP. Kind Regards, Justin
Re: [DISCUSS] Incubating TsFile as an independent Apache project?
Hi all, I'm glad that we have reached a consensus to donate TsFile as an independent Apache project. TsFile aims to be a universal file structure for managing time series data in IoT scenarios. So the next step is the actual process of driving it to be an Apache top-level project. Is the process the same as becoming an incubator project? Does anyone know? Thanks, — Jialin Qiao Apache IoTDB PMC Jialin Qiao 于2023年10月8日周日 13:34写道: > > Hi, > > Code is not the blocking thing, it could be done before release. > > Thanks, > — > Jialin Qiao > Apache IoTDB PMC > > Yuan Tian 于2023年10月8日周日 08:27写道: > > > > Hi, > > > > +1. > > > > However, before we do that, I think there are lots of work that we need to > > do, like extracting some read and write public interface for TsFile, > > otherwise it will be confusing for users and they don't know which > > methods to use. And with these interfaces, it will be beneficial to our > > subsequent iterations. > > > > Best, > > - > > Yuan Tian
Re: [DISCUSS] Incubating TsFile as an independent Apache project?
Hi, Code is not the blocking thing, it could be done before release. Thanks, — Jialin Qiao Apache IoTDB PMC Yuan Tian 于2023年10月8日周日 08:27写道: > > Hi, > > +1. > > However, before we do that, I think there are lots of work that we need to > do, like extracting some read and write public interface for TsFile, > otherwise it will be confusing for users and they don't know which > methods to use. And with these interfaces, it will be beneficial to our > subsequent iterations. > > Best, > - > Yuan Tian
Re: [DISCUSS] Incubating TsFile as an independent Apache project?
Hi, +1. However, before we do that, I think there are lots of work that we need to do, like extracting some read and write public interface for TsFile, otherwise it will be confusing for users and they don't know which methods to use. And with these interfaces, it will be beneficial to our subsequent iterations. Best, - Yuan Tian
Re: [DISCUSS] Incubating TsFile as an independent Apache project?
+1 i'd like to have the core tsfile library in Rust and extend in Python.I am not sure if i have enough capacity to do that. Il giorno sab 7 ott 2023 alle ore 15:35 Xiangdong Huang ha scritto: > Hi, > +1 for make TsFile independent and then it will be reasonable for having > multiple TsFile language implementation. > > > If there are enough seasoned and experienced Apache forlks in the PMC, > I’d even support. A direct to TLP route. > +1, too. And, I think there are really enough forlks :D. > > Best, > --- > Xiangdong Huang > > > > Christofer Dutz 于2023年10月7日周六 19:47写道: > > > Hi all, > > > > not even sure we’d need to go the route throught the incubator. > > If there are enough seasoned and experienced Apache forlks in the PMC, > I’d > > even support. A direct to TLP route. > > > > Chris > > > > Von: Jialin Qiao > > Datum: Samstag, 7. Oktober 2023 um 03:59 > > An: dev@iotdb.apache.org > > Betreff: Re: [DISCUSS] Incubating TsFile as an independent Apache > project? > > Hi, > > > > +1 for Apache TsFile. > > > > 1. Industrial time series data management is becoming more and more > > important, so a file format project for time series data is necessary. > > 2. When TsFile becomes an independent project, it could be developed > > and released without impact the upgrading of IoTDB. > > > > Thanks, > > — > > Jialin Qiao > > Apache IoTDB PMC > > > > 冯 庆新 于2023年10月7日周六 10:22写道: > > > > > > Hi Steve Su > > > > > > I think this is a great idea and I fully support it. > > > I believe Tsfile can generate greater influence and value. > > > > > > Thanks > > > B.R. > > > Qingxin Feng > > > > > > > > > 从 Windows 版邮件<https://go.microsoft.com/fwlink/?LinkId=550986>发送 > > > > > > 发件人: Steve Yurong Su<mailto:r...@apache.org> > > > 发送时间: 2023年10月7日 0:53 > > > 收件人: dev@iotdb.apache.org<mailto:dev@iotdb.apache.org> > > > 主题: [DISCUSS] Incubating TsFile as an independent Apache project? > > > > > > Hi folks, > > > > > > Recently, I've been thinking about something that has been on my mind: > > > I believe TsFile has the potential to develop as an independent Apache > > > project (note, not a subproject like apache-iotdb-tsfile), just like > > > ORC, Parquet, and Arrow. How about incubating TsFile as an independent > > > Apache project? > > > > > > The main reason I came up with this idea is because I realized that > > > TsFile is not just the data file format of IoTDB, but it can also be a > > > standard format in the IoT field. It provides excellent support for > > > time series data, offering various encoding and compression methods. > > > It can be easily self-parsed and its statistical information enables > > > fast data querying by big data software. I believe that every IoT > > > software could benefit directly by supporting TsFile as a storage > > > format. > > > > > > On the other hand, I hope to leverage the power of the community to > > > drive the development of the TsFile file format. Just imagine, TsFile > > > could have its own independent ecosystem: parsing tools in various > > > languages, connectors to various big data software, and so on. By > > > separating TsFile from IoTDB, we have the opportunity to attract more > > > community contributors and introduce more ideas, thus refining the > > > functionality and performance of TsFile. > > > > > > What do you think about this idea? > > > > > > In addition, how can TsFile, as a part of the current IoTDB project, > > > become an independent Apache project? Should it go through the Apache > > > Foundation incubation process again, or can it directly become a > > > top-level project? It may be too early to ask this question now, but I > > > would also like to hear your opinions. > > > > > > Thanks, > > > Steve Su > > > > > > -- Life is a chess game - Anonymous.
Re: [DISCUSS] Incubating TsFile as an independent Apache project?
Hi, +1 for make TsFile independent and then it will be reasonable for having multiple TsFile language implementation. > If there are enough seasoned and experienced Apache forlks in the PMC, I’d even support. A direct to TLP route. +1, too. And, I think there are really enough forlks :D. Best, --- Xiangdong Huang Christofer Dutz 于2023年10月7日周六 19:47写道: > Hi all, > > not even sure we’d need to go the route throught the incubator. > If there are enough seasoned and experienced Apache forlks in the PMC, I’d > even support. A direct to TLP route. > > Chris > > Von: Jialin Qiao > Datum: Samstag, 7. Oktober 2023 um 03:59 > An: dev@iotdb.apache.org > Betreff: Re: [DISCUSS] Incubating TsFile as an independent Apache project? > Hi, > > +1 for Apache TsFile. > > 1. Industrial time series data management is becoming more and more > important, so a file format project for time series data is necessary. > 2. When TsFile becomes an independent project, it could be developed > and released without impact the upgrading of IoTDB. > > Thanks, > — > Jialin Qiao > Apache IoTDB PMC > > 冯 庆新 于2023年10月7日周六 10:22写道: > > > > Hi Steve Su > > > > I think this is a great idea and I fully support it. > > I believe Tsfile can generate greater influence and value. > > > > Thanks > > B.R. > > Qingxin Feng > > > > > > 从 Windows 版邮件<https://go.microsoft.com/fwlink/?LinkId=550986>发送 > > > > 发件人: Steve Yurong Su<mailto:r...@apache.org> > > 发送时间: 2023年10月7日 0:53 > > 收件人: dev@iotdb.apache.org<mailto:dev@iotdb.apache.org> > > 主题: [DISCUSS] Incubating TsFile as an independent Apache project? > > > > Hi folks, > > > > Recently, I've been thinking about something that has been on my mind: > > I believe TsFile has the potential to develop as an independent Apache > > project (note, not a subproject like apache-iotdb-tsfile), just like > > ORC, Parquet, and Arrow. How about incubating TsFile as an independent > > Apache project? > > > > The main reason I came up with this idea is because I realized that > > TsFile is not just the data file format of IoTDB, but it can also be a > > standard format in the IoT field. It provides excellent support for > > time series data, offering various encoding and compression methods. > > It can be easily self-parsed and its statistical information enables > > fast data querying by big data software. I believe that every IoT > > software could benefit directly by supporting TsFile as a storage > > format. > > > > On the other hand, I hope to leverage the power of the community to > > drive the development of the TsFile file format. Just imagine, TsFile > > could have its own independent ecosystem: parsing tools in various > > languages, connectors to various big data software, and so on. By > > separating TsFile from IoTDB, we have the opportunity to attract more > > community contributors and introduce more ideas, thus refining the > > functionality and performance of TsFile. > > > > What do you think about this idea? > > > > In addition, how can TsFile, as a part of the current IoTDB project, > > become an independent Apache project? Should it go through the Apache > > Foundation incubation process again, or can it directly become a > > top-level project? It may be too early to ask this question now, but I > > would also like to hear your opinions. > > > > Thanks, > > Steve Su > > >
AW: [DISCUSS] Incubating TsFile as an independent Apache project?
Hi all, not even sure we’d need to go the route throught the incubator. If there are enough seasoned and experienced Apache forlks in the PMC, I’d even support. A direct to TLP route. Chris Von: Jialin Qiao Datum: Samstag, 7. Oktober 2023 um 03:59 An: dev@iotdb.apache.org Betreff: Re: [DISCUSS] Incubating TsFile as an independent Apache project? Hi, +1 for Apache TsFile. 1. Industrial time series data management is becoming more and more important, so a file format project for time series data is necessary. 2. When TsFile becomes an independent project, it could be developed and released without impact the upgrading of IoTDB. Thanks, ― Jialin Qiao Apache IoTDB PMC 冯 庆新 于2023年10月7日周六 10:22写道: > > Hi Steve Su > > I think this is a great idea and I fully support it. > I believe Tsfile can generate greater influence and value. > > Thanks > B.R. > Qingxin Feng > > > 从 Windows 版邮件<https://go.microsoft.com/fwlink/?LinkId=550986>发送 > > 发件人: Steve Yurong Su<mailto:r...@apache.org> > 发送时间: 2023年10月7日 0:53 > 收件人: dev@iotdb.apache.org<mailto:dev@iotdb.apache.org> > 主题: [DISCUSS] Incubating TsFile as an independent Apache project? > > Hi folks, > > Recently, I've been thinking about something that has been on my mind: > I believe TsFile has the potential to develop as an independent Apache > project (note, not a subproject like apache-iotdb-tsfile), just like > ORC, Parquet, and Arrow. How about incubating TsFile as an independent > Apache project? > > The main reason I came up with this idea is because I realized that > TsFile is not just the data file format of IoTDB, but it can also be a > standard format in the IoT field. It provides excellent support for > time series data, offering various encoding and compression methods. > It can be easily self-parsed and its statistical information enables > fast data querying by big data software. I believe that every IoT > software could benefit directly by supporting TsFile as a storage > format. > > On the other hand, I hope to leverage the power of the community to > drive the development of the TsFile file format. Just imagine, TsFile > could have its own independent ecosystem: parsing tools in various > languages, connectors to various big data software, and so on. By > separating TsFile from IoTDB, we have the opportunity to attract more > community contributors and introduce more ideas, thus refining the > functionality and performance of TsFile. > > What do you think about this idea? > > In addition, how can TsFile, as a part of the current IoTDB project, > become an independent Apache project? Should it go through the Apache > Foundation incubation process again, or can it directly become a > top-level project? It may be too early to ask this question now, but I > would also like to hear your opinions. > > Thanks, > Steve Su >
Re: [DISCUSS] Incubating TsFile as an independent Apache project?
Hi, +1 for Apache TsFile. 1. Industrial time series data management is becoming more and more important, so a file format project for time series data is necessary. 2. When TsFile becomes an independent project, it could be developed and released without impact the upgrading of IoTDB. Thanks, — Jialin Qiao Apache IoTDB PMC 冯 庆新 于2023年10月7日周六 10:22写道: > > Hi Steve Su > > I think this is a great idea and I fully support it. > I believe Tsfile can generate greater influence and value. > > Thanks > B.R. > Qingxin Feng > > > 从 Windows 版邮件<https://go.microsoft.com/fwlink/?LinkId=550986>发送 > > 发件人: Steve Yurong Su<mailto:r...@apache.org> > 发送时间: 2023年10月7日 0:53 > 收件人: dev@iotdb.apache.org<mailto:dev@iotdb.apache.org> > 主题: [DISCUSS] Incubating TsFile as an independent Apache project? > > Hi folks, > > Recently, I've been thinking about something that has been on my mind: > I believe TsFile has the potential to develop as an independent Apache > project (note, not a subproject like apache-iotdb-tsfile), just like > ORC, Parquet, and Arrow. How about incubating TsFile as an independent > Apache project? > > The main reason I came up with this idea is because I realized that > TsFile is not just the data file format of IoTDB, but it can also be a > standard format in the IoT field. It provides excellent support for > time series data, offering various encoding and compression methods. > It can be easily self-parsed and its statistical information enables > fast data querying by big data software. I believe that every IoT > software could benefit directly by supporting TsFile as a storage > format. > > On the other hand, I hope to leverage the power of the community to > drive the development of the TsFile file format. Just imagine, TsFile > could have its own independent ecosystem: parsing tools in various > languages, connectors to various big data software, and so on. By > separating TsFile from IoTDB, we have the opportunity to attract more > community contributors and introduce more ideas, thus refining the > functionality and performance of TsFile. > > What do you think about this idea? > > In addition, how can TsFile, as a part of the current IoTDB project, > become an independent Apache project? Should it go through the Apache > Foundation incubation process again, or can it directly become a > top-level project? It may be too early to ask this question now, but I > would also like to hear your opinions. > > Thanks, > Steve Su >
回复: [DISCUSS] Incubating TsFile as an independent Apache project?
Hi Steve Su I think this is a great idea and I fully support it. I believe Tsfile can generate greater influence and value. Thanks B.R. Qingxin Feng 从 Windows 版邮件<https://go.microsoft.com/fwlink/?LinkId=550986>发送 发件人: Steve Yurong Su<mailto:r...@apache.org> 发送时间: 2023年10月7日 0:53 收件人: dev@iotdb.apache.org<mailto:dev@iotdb.apache.org> 主题: [DISCUSS] Incubating TsFile as an independent Apache project? Hi folks, Recently, I've been thinking about something that has been on my mind: I believe TsFile has the potential to develop as an independent Apache project (note, not a subproject like apache-iotdb-tsfile), just like ORC, Parquet, and Arrow. How about incubating TsFile as an independent Apache project? The main reason I came up with this idea is because I realized that TsFile is not just the data file format of IoTDB, but it can also be a standard format in the IoT field. It provides excellent support for time series data, offering various encoding and compression methods. It can be easily self-parsed and its statistical information enables fast data querying by big data software. I believe that every IoT software could benefit directly by supporting TsFile as a storage format. On the other hand, I hope to leverage the power of the community to drive the development of the TsFile file format. Just imagine, TsFile could have its own independent ecosystem: parsing tools in various languages, connectors to various big data software, and so on. By separating TsFile from IoTDB, we have the opportunity to attract more community contributors and introduce more ideas, thus refining the functionality and performance of TsFile. What do you think about this idea? In addition, how can TsFile, as a part of the current IoTDB project, become an independent Apache project? Should it go through the Apache Foundation incubation process again, or can it directly become a top-level project? It may be too early to ask this question now, but I would also like to hear your opinions. Thanks, Steve Su
[DISCUSS] Incubating TsFile as an independent Apache project?
Hi folks, Recently, I've been thinking about something that has been on my mind: I believe TsFile has the potential to develop as an independent Apache project (note, not a subproject like apache-iotdb-tsfile), just like ORC, Parquet, and Arrow. How about incubating TsFile as an independent Apache project? The main reason I came up with this idea is because I realized that TsFile is not just the data file format of IoTDB, but it can also be a standard format in the IoT field. It provides excellent support for time series data, offering various encoding and compression methods. It can be easily self-parsed and its statistical information enables fast data querying by big data software. I believe that every IoT software could benefit directly by supporting TsFile as a storage format. On the other hand, I hope to leverage the power of the community to drive the development of the TsFile file format. Just imagine, TsFile could have its own independent ecosystem: parsing tools in various languages, connectors to various big data software, and so on. By separating TsFile from IoTDB, we have the opportunity to attract more community contributors and introduce more ideas, thus refining the functionality and performance of TsFile. What do you think about this idea? In addition, how can TsFile, as a part of the current IoTDB project, become an independent Apache project? Should it go through the Apache Foundation incubation process again, or can it directly become a top-level project? It may be too early to ask this question now, but I would also like to hear your opinions. Thanks, Steve Su