Re: [DISCUSS] Incubating TsFile as an independent Apache project?

2023-10-07 Thread Jialin Qiao
Hi,

Code is not the blocking thing, it could be done before release.

Thanks,
—
Jialin Qiao
Apache IoTDB PMC

Yuan Tian  于2023年10月8日周日 08:27写道:
>
> Hi,
>
> +1.
>
> However, before we do that, I think there are lots of work that we need to
> do, like extracting some read and write public interface for TsFile,
> otherwise it will be confusing for users and they don't know which
> methods to use. And with these interfaces, it will be beneficial to our
> subsequent iterations.
>
> Best,
> -
> Yuan Tian


Re: [DISCUSS] Incubating TsFile as an independent Apache project?

2023-10-07 Thread Yuan Tian
Hi,

+1.

However, before we do that, I think there are lots of work that we need to
do, like extracting some read and write public interface for TsFile,
otherwise it will be confusing for users and they don't know which
methods to use. And with these interfaces, it will be beneficial to our
subsequent iterations.

Best,
-
Yuan Tian


Re: [DISCUSS] Incubating TsFile as an independent Apache project?

2023-10-07 Thread Giorgio Zoppi
+1 i'd like to have the core tsfile library in Rust and extend in Python.I
am not sure if i have enough capacity to do that.

Il giorno sab 7 ott 2023 alle ore 15:35 Xiangdong Huang 
ha scritto:

> Hi,
> +1 for make TsFile independent and then it will be reasonable for having
> multiple TsFile language implementation.
>
> > If there are enough seasoned and experienced Apache forlks in the PMC,
> I’d even support. A direct to TLP route.
> +1, too. And, I think there are really enough forlks :D.
>
> Best,
> ---
> Xiangdong Huang
>
>
>
> Christofer Dutz  于2023年10月7日周六 19:47写道:
>
> > Hi all,
> >
> > not even sure we’d need to go the route throught the incubator.
> > If there are enough seasoned and experienced Apache forlks in the PMC,
> I’d
> > even support. A direct to TLP route.
> >
> > Chris
> >
> > Von: Jialin Qiao 
> > Datum: Samstag, 7. Oktober 2023 um 03:59
> > An: dev@iotdb.apache.org 
> > Betreff: Re: [DISCUSS] Incubating TsFile as an independent Apache
> project?
> > Hi,
> >
> > +1 for Apache TsFile.
> >
> > 1. Industrial time series data management is becoming more and more
> > important, so a file format project for time series data is necessary.
> > 2. When TsFile becomes an independent project, it could be developed
> > and released without impact the upgrading of IoTDB.
> >
> > Thanks,
> > —
> > Jialin Qiao
> > Apache IoTDB PMC
> >
> > 冯 庆新  于2023年10月7日周六 10:22写道:
> > >
> > > Hi Steve Su
> > >
> > > I think this is a great idea and I fully support it.
> > > I believe Tsfile can generate greater influence and value.
> > >
> > > Thanks
> > > B.R.
> > > Qingxin Feng
> > >
> > >
> > > 从 Windows 版邮件发送
> > >
> > > 发件人: Steve Yurong Su
> > > 发送时间: 2023年10月7日 0:53
> > > 收件人: dev@iotdb.apache.org
> > > 主题: [DISCUSS] Incubating TsFile as an independent Apache project?
> > >
> > > Hi folks,
> > >
> > > Recently, I've been thinking about something that has been on my mind:
> > > I believe TsFile has the potential to develop as an independent Apache
> > > project (note, not a subproject like apache-iotdb-tsfile), just like
> > > ORC, Parquet, and Arrow. How about incubating TsFile as an independent
> > > Apache project?
> > >
> > > The main reason I came up with this idea is because I realized that
> > > TsFile is not just the data file format of IoTDB, but it can also be a
> > > standard format in the IoT field. It provides excellent support for
> > > time series data, offering various encoding and compression methods.
> > > It can be easily self-parsed and its statistical information enables
> > > fast data querying by big data software. I believe that every IoT
> > > software could benefit directly by supporting TsFile as a storage
> > > format.
> > >
> > > On the other hand, I hope to leverage the power of the community to
> > > drive the development of the TsFile file format. Just imagine, TsFile
> > > could have its own independent ecosystem: parsing tools in various
> > > languages, connectors to various big data software, and so on. By
> > > separating TsFile from IoTDB, we have the opportunity to attract more
> > > community contributors and introduce more ideas, thus refining the
> > > functionality and performance of TsFile.
> > >
> > > What do you think about this idea?
> > >
> > > In addition, how can TsFile, as a part of the current IoTDB project,
> > > become an independent Apache project? Should it go through the Apache
> > > Foundation incubation process again, or can it directly become a
> > > top-level project? It may be too early to ask this question now, but I
> > > would also like to hear your opinions.
> > >
> > > Thanks,
> > > Steve Su
> > >
> >
>


-- 
Life is a chess game - Anonymous.


Re: [DISCUSS] Incubating TsFile as an independent Apache project?

2023-10-07 Thread Xiangdong Huang
Hi,
+1 for make TsFile independent and then it will be reasonable for having
multiple TsFile language implementation.

> If there are enough seasoned and experienced Apache forlks in the PMC,
I’d even support. A direct to TLP route.
+1, too. And, I think there are really enough forlks :D.

Best,
---
Xiangdong Huang



Christofer Dutz  于2023年10月7日周六 19:47写道:

> Hi all,
>
> not even sure we’d need to go the route throught the incubator.
> If there are enough seasoned and experienced Apache forlks in the PMC, I’d
> even support. A direct to TLP route.
>
> Chris
>
> Von: Jialin Qiao 
> Datum: Samstag, 7. Oktober 2023 um 03:59
> An: dev@iotdb.apache.org 
> Betreff: Re: [DISCUSS] Incubating TsFile as an independent Apache project?
> Hi,
>
> +1 for Apache TsFile.
>
> 1. Industrial time series data management is becoming more and more
> important, so a file format project for time series data is necessary.
> 2. When TsFile becomes an independent project, it could be developed
> and released without impact the upgrading of IoTDB.
>
> Thanks,
> —
> Jialin Qiao
> Apache IoTDB PMC
>
> 冯 庆新  于2023年10月7日周六 10:22写道:
> >
> > Hi Steve Su
> >
> > I think this is a great idea and I fully support it.
> > I believe Tsfile can generate greater influence and value.
> >
> > Thanks
> > B.R.
> > Qingxin Feng
> >
> >
> > 从 Windows 版邮件发送
> >
> > 发件人: Steve Yurong Su
> > 发送时间: 2023年10月7日 0:53
> > 收件人: dev@iotdb.apache.org
> > 主题: [DISCUSS] Incubating TsFile as an independent Apache project?
> >
> > Hi folks,
> >
> > Recently, I've been thinking about something that has been on my mind:
> > I believe TsFile has the potential to develop as an independent Apache
> > project (note, not a subproject like apache-iotdb-tsfile), just like
> > ORC, Parquet, and Arrow. How about incubating TsFile as an independent
> > Apache project?
> >
> > The main reason I came up with this idea is because I realized that
> > TsFile is not just the data file format of IoTDB, but it can also be a
> > standard format in the IoT field. It provides excellent support for
> > time series data, offering various encoding and compression methods.
> > It can be easily self-parsed and its statistical information enables
> > fast data querying by big data software. I believe that every IoT
> > software could benefit directly by supporting TsFile as a storage
> > format.
> >
> > On the other hand, I hope to leverage the power of the community to
> > drive the development of the TsFile file format. Just imagine, TsFile
> > could have its own independent ecosystem: parsing tools in various
> > languages, connectors to various big data software, and so on. By
> > separating TsFile from IoTDB, we have the opportunity to attract more
> > community contributors and introduce more ideas, thus refining the
> > functionality and performance of TsFile.
> >
> > What do you think about this idea?
> >
> > In addition, how can TsFile, as a part of the current IoTDB project,
> > become an independent Apache project? Should it go through the Apache
> > Foundation incubation process again, or can it directly become a
> > top-level project? It may be too early to ask this question now, but I
> > would also like to hear your opinions.
> >
> > Thanks,
> > Steve Su
> >
>


AW: [DISCUSS] Incubating TsFile as an independent Apache project?

2023-10-07 Thread Christofer Dutz
Hi all,

not even sure we’d need to go the route throught the incubator.
If there are enough seasoned and experienced Apache forlks in the PMC, I’d even 
support. A direct to TLP route.

Chris

Von: Jialin Qiao 
Datum: Samstag, 7. Oktober 2023 um 03:59
An: dev@iotdb.apache.org 
Betreff: Re: [DISCUSS] Incubating TsFile as an independent Apache project?
Hi,

+1 for Apache TsFile.

1. Industrial time series data management is becoming more and more
important, so a file format project for time series data is necessary.
2. When TsFile becomes an independent project, it could be developed
and released without impact the upgrading of IoTDB.

Thanks,
―
Jialin Qiao
Apache IoTDB PMC

冯 庆新  于2023年10月7日周六 10:22写道:
>
> Hi Steve Su
>
> I think this is a great idea and I fully support it.
> I believe Tsfile can generate greater influence and value.
>
> Thanks
> B.R.
> Qingxin Feng
>
>
> 从 Windows 版邮件发送
>
> 发件人: Steve Yurong Su
> 发送时间: 2023年10月7日 0:53
> 收件人: dev@iotdb.apache.org
> 主题: [DISCUSS] Incubating TsFile as an independent Apache project?
>
> Hi folks,
>
> Recently, I've been thinking about something that has been on my mind:
> I believe TsFile has the potential to develop as an independent Apache
> project (note, not a subproject like apache-iotdb-tsfile), just like
> ORC, Parquet, and Arrow. How about incubating TsFile as an independent
> Apache project?
>
> The main reason I came up with this idea is because I realized that
> TsFile is not just the data file format of IoTDB, but it can also be a
> standard format in the IoT field. It provides excellent support for
> time series data, offering various encoding and compression methods.
> It can be easily self-parsed and its statistical information enables
> fast data querying by big data software. I believe that every IoT
> software could benefit directly by supporting TsFile as a storage
> format.
>
> On the other hand, I hope to leverage the power of the community to
> drive the development of the TsFile file format. Just imagine, TsFile
> could have its own independent ecosystem: parsing tools in various
> languages, connectors to various big data software, and so on. By
> separating TsFile from IoTDB, we have the opportunity to attract more
> community contributors and introduce more ideas, thus refining the
> functionality and performance of TsFile.
>
> What do you think about this idea?
>
> In addition, how can TsFile, as a part of the current IoTDB project,
> become an independent Apache project? Should it go through the Apache
> Foundation incubation process again, or can it directly become a
> top-level project? It may be too early to ask this question now, but I
> would also like to hear your opinions.
>
> Thanks,
> Steve Su
>


Re: [DISCUSS] Incubating TsFile as an independent Apache project?

2023-10-07 Thread Jialin Qiao
Hi,

+1 for Apache TsFile.

1. Industrial time series data management is becoming more and more
important, so a file format project for time series data is necessary.
2. When TsFile becomes an independent project, it could be developed
and released without impact the upgrading of IoTDB.

Thanks,
—
Jialin Qiao
Apache IoTDB PMC

冯 庆新  于2023年10月7日周六 10:22写道:
>
> Hi Steve Su
>
> I think this is a great idea and I fully support it.
> I believe Tsfile can generate greater influence and value.
>
> Thanks
> B.R.
> Qingxin Feng
>
>
> 从 Windows 版邮件发送
>
> 发件人: Steve Yurong Su
> 发送时间: 2023年10月7日 0:53
> 收件人: dev@iotdb.apache.org
> 主题: [DISCUSS] Incubating TsFile as an independent Apache project?
>
> Hi folks,
>
> Recently, I've been thinking about something that has been on my mind:
> I believe TsFile has the potential to develop as an independent Apache
> project (note, not a subproject like apache-iotdb-tsfile), just like
> ORC, Parquet, and Arrow. How about incubating TsFile as an independent
> Apache project?
>
> The main reason I came up with this idea is because I realized that
> TsFile is not just the data file format of IoTDB, but it can also be a
> standard format in the IoT field. It provides excellent support for
> time series data, offering various encoding and compression methods.
> It can be easily self-parsed and its statistical information enables
> fast data querying by big data software. I believe that every IoT
> software could benefit directly by supporting TsFile as a storage
> format.
>
> On the other hand, I hope to leverage the power of the community to
> drive the development of the TsFile file format. Just imagine, TsFile
> could have its own independent ecosystem: parsing tools in various
> languages, connectors to various big data software, and so on. By
> separating TsFile from IoTDB, we have the opportunity to attract more
> community contributors and introduce more ideas, thus refining the
> functionality and performance of TsFile.
>
> What do you think about this idea?
>
> In addition, how can TsFile, as a part of the current IoTDB project,
> become an independent Apache project? Should it go through the Apache
> Foundation incubation process again, or can it directly become a
> top-level project? It may be too early to ask this question now, but I
> would also like to hear your opinions.
>
> Thanks,
> Steve Su
>