Re: [DISCUSS] Incubating TsFile as an independent Apache project?

2023-10-20 Thread Kun Liu
It seems many contributor are interested in the rust api for TsFile




Giorgio Zoppi  于2023年10月19日周四 04:27写道:

> Hey,
> If we're planning to port it native rust/go, I can help also as PMC if it's
> needed or whatever.
> Best regards,
> Giorgio
>
> Il giorno mar 10 ott 2023 alle ore 22:37 Christofer Dutz <
> christofer.d...@c-ware.de> ha scritto:
>
> > I'd say, just as a board resolution to the board meeting.
> >
> > Chris
> >
> > Gesendet von Outlook für Android<https://aka.ms/AAb9ysg>
> > 
> > From: Justin Mclean 
> > Sent: Tuesday, October 10, 2023 6:34:08 PM
> > To: dev@iotdb.apache.org 
> > Subject: Re: [DISCUSS] Incubating TsFile as an independent Apache
> project?
> >
> > Hi,
> >
> > If enough people on the initial PMC know the ASF process well, there
> would
> > be no need to go through the Incubator but go straight to TLP.
> >
> > Kind Regards,
> > Justin
> >
>
>
> --
> Life is a chess game - Anonymous.
>


Re: [DISCUSS] Incubating TsFile as an independent Apache project?

2023-10-18 Thread Giorgio Zoppi
Hey,
If we're planning to port it native rust/go, I can help also as PMC if it's
needed or whatever.
Best regards,
Giorgio

Il giorno mar 10 ott 2023 alle ore 22:37 Christofer Dutz <
christofer.d...@c-ware.de> ha scritto:

> I'd say, just as a board resolution to the board meeting.
>
> Chris
>
> Gesendet von Outlook für Android<https://aka.ms/AAb9ysg>
> 
> From: Justin Mclean 
> Sent: Tuesday, October 10, 2023 6:34:08 PM
> To: dev@iotdb.apache.org 
> Subject: Re: [DISCUSS] Incubating TsFile as an independent Apache project?
>
> Hi,
>
> If enough people on the initial PMC know the ASF process well, there would
> be no need to go through the Incubator but go straight to TLP.
>
> Kind Regards,
> Justin
>


-- 
Life is a chess game - Anonymous.


Re: [DISCUSS] Incubating TsFile as an independent Apache project?

2023-10-10 Thread Christofer Dutz
I'd say, just as a board resolution to the board meeting.

Chris

Gesendet von Outlook für Android<https://aka.ms/AAb9ysg>

From: Justin Mclean 
Sent: Tuesday, October 10, 2023 6:34:08 PM
To: dev@iotdb.apache.org 
Subject: Re: [DISCUSS] Incubating TsFile as an independent Apache project?

Hi,

If enough people on the initial PMC know the ASF process well, there would be 
no need to go through the Incubator but go straight to TLP.

Kind Regards,
Justin


Re: [DISCUSS] Incubating TsFile as an independent Apache project?

2023-10-10 Thread Justin Mclean
Hi,

If enough people on the initial PMC know the ASF process well, there would be 
no need to go through the Incubator but go straight to TLP.

Kind Regards,
Justin


Re: [DISCUSS] Incubating TsFile as an independent Apache project?

2023-10-10 Thread Jialin Qiao
Hi all,

I'm glad that we have reached a consensus to donate TsFile as an
independent Apache project.
TsFile aims to be a universal file structure for managing time series
data in IoT scenarios.
So the next step is the actual process of driving it to be an Apache
top-level project. Is the process the same as becoming an incubator
project? Does anyone know?

Thanks,
—
Jialin Qiao
Apache IoTDB PMC

Jialin Qiao  于2023年10月8日周日 13:34写道:
>
> Hi,
>
> Code is not the blocking thing, it could be done before release.
>
> Thanks,
> —
> Jialin Qiao
> Apache IoTDB PMC
>
> Yuan Tian  于2023年10月8日周日 08:27写道:
> >
> > Hi,
> >
> > +1.
> >
> > However, before we do that, I think there are lots of work that we need to
> > do, like extracting some read and write public interface for TsFile,
> > otherwise it will be confusing for users and they don't know which
> > methods to use. And with these interfaces, it will be beneficial to our
> > subsequent iterations.
> >
> > Best,
> > -
> > Yuan Tian


Re: [DISCUSS] Incubating TsFile as an independent Apache project?

2023-10-07 Thread Jialin Qiao
Hi,

Code is not the blocking thing, it could be done before release.

Thanks,
—
Jialin Qiao
Apache IoTDB PMC

Yuan Tian  于2023年10月8日周日 08:27写道:
>
> Hi,
>
> +1.
>
> However, before we do that, I think there are lots of work that we need to
> do, like extracting some read and write public interface for TsFile,
> otherwise it will be confusing for users and they don't know which
> methods to use. And with these interfaces, it will be beneficial to our
> subsequent iterations.
>
> Best,
> -
> Yuan Tian


Re: [DISCUSS] Incubating TsFile as an independent Apache project?

2023-10-07 Thread Yuan Tian
Hi,

+1.

However, before we do that, I think there are lots of work that we need to
do, like extracting some read and write public interface for TsFile,
otherwise it will be confusing for users and they don't know which
methods to use. And with these interfaces, it will be beneficial to our
subsequent iterations.

Best,
-
Yuan Tian


Re: [DISCUSS] Incubating TsFile as an independent Apache project?

2023-10-07 Thread Giorgio Zoppi
+1 i'd like to have the core tsfile library in Rust and extend in Python.I
am not sure if i have enough capacity to do that.

Il giorno sab 7 ott 2023 alle ore 15:35 Xiangdong Huang 
ha scritto:

> Hi,
> +1 for make TsFile independent and then it will be reasonable for having
> multiple TsFile language implementation.
>
> > If there are enough seasoned and experienced Apache forlks in the PMC,
> I’d even support. A direct to TLP route.
> +1, too. And, I think there are really enough forlks :D.
>
> Best,
> ---
> Xiangdong Huang
>
>
>
> Christofer Dutz  于2023年10月7日周六 19:47写道:
>
> > Hi all,
> >
> > not even sure we’d need to go the route throught the incubator.
> > If there are enough seasoned and experienced Apache forlks in the PMC,
> I’d
> > even support. A direct to TLP route.
> >
> > Chris
> >
> > Von: Jialin Qiao 
> > Datum: Samstag, 7. Oktober 2023 um 03:59
> > An: dev@iotdb.apache.org 
> > Betreff: Re: [DISCUSS] Incubating TsFile as an independent Apache
> project?
> > Hi,
> >
> > +1 for Apache TsFile.
> >
> > 1. Industrial time series data management is becoming more and more
> > important, so a file format project for time series data is necessary.
> > 2. When TsFile becomes an independent project, it could be developed
> > and released without impact the upgrading of IoTDB.
> >
> > Thanks,
> > —
> > Jialin Qiao
> > Apache IoTDB PMC
> >
> > 冯 庆新  于2023年10月7日周六 10:22写道:
> > >
> > > Hi Steve Su
> > >
> > > I think this is a great idea and I fully support it.
> > > I believe Tsfile can generate greater influence and value.
> > >
> > > Thanks
> > > B.R.
> > > Qingxin Feng
> > >
> > >
> > > 从 Windows 版邮件<https://go.microsoft.com/fwlink/?LinkId=550986>发送
> > >
> > > 发件人: Steve Yurong Su<mailto:r...@apache.org>
> > > 发送时间: 2023年10月7日 0:53
> > > 收件人: dev@iotdb.apache.org<mailto:dev@iotdb.apache.org>
> > > 主题: [DISCUSS] Incubating TsFile as an independent Apache project?
> > >
> > > Hi folks,
> > >
> > > Recently, I've been thinking about something that has been on my mind:
> > > I believe TsFile has the potential to develop as an independent Apache
> > > project (note, not a subproject like apache-iotdb-tsfile), just like
> > > ORC, Parquet, and Arrow. How about incubating TsFile as an independent
> > > Apache project?
> > >
> > > The main reason I came up with this idea is because I realized that
> > > TsFile is not just the data file format of IoTDB, but it can also be a
> > > standard format in the IoT field. It provides excellent support for
> > > time series data, offering various encoding and compression methods.
> > > It can be easily self-parsed and its statistical information enables
> > > fast data querying by big data software. I believe that every IoT
> > > software could benefit directly by supporting TsFile as a storage
> > > format.
> > >
> > > On the other hand, I hope to leverage the power of the community to
> > > drive the development of the TsFile file format. Just imagine, TsFile
> > > could have its own independent ecosystem: parsing tools in various
> > > languages, connectors to various big data software, and so on. By
> > > separating TsFile from IoTDB, we have the opportunity to attract more
> > > community contributors and introduce more ideas, thus refining the
> > > functionality and performance of TsFile.
> > >
> > > What do you think about this idea?
> > >
> > > In addition, how can TsFile, as a part of the current IoTDB project,
> > > become an independent Apache project? Should it go through the Apache
> > > Foundation incubation process again, or can it directly become a
> > > top-level project? It may be too early to ask this question now, but I
> > > would also like to hear your opinions.
> > >
> > > Thanks,
> > > Steve Su
> > >
> >
>


-- 
Life is a chess game - Anonymous.


Re: [DISCUSS] Incubating TsFile as an independent Apache project?

2023-10-07 Thread Xiangdong Huang
Hi,
+1 for make TsFile independent and then it will be reasonable for having
multiple TsFile language implementation.

> If there are enough seasoned and experienced Apache forlks in the PMC,
I’d even support. A direct to TLP route.
+1, too. And, I think there are really enough forlks :D.

Best,
---
Xiangdong Huang



Christofer Dutz  于2023年10月7日周六 19:47写道:

> Hi all,
>
> not even sure we’d need to go the route throught the incubator.
> If there are enough seasoned and experienced Apache forlks in the PMC, I’d
> even support. A direct to TLP route.
>
> Chris
>
> Von: Jialin Qiao 
> Datum: Samstag, 7. Oktober 2023 um 03:59
> An: dev@iotdb.apache.org 
> Betreff: Re: [DISCUSS] Incubating TsFile as an independent Apache project?
> Hi,
>
> +1 for Apache TsFile.
>
> 1. Industrial time series data management is becoming more and more
> important, so a file format project for time series data is necessary.
> 2. When TsFile becomes an independent project, it could be developed
> and released without impact the upgrading of IoTDB.
>
> Thanks,
> —
> Jialin Qiao
> Apache IoTDB PMC
>
> 冯 庆新  于2023年10月7日周六 10:22写道:
> >
> > Hi Steve Su
> >
> > I think this is a great idea and I fully support it.
> > I believe Tsfile can generate greater influence and value.
> >
> > Thanks
> > B.R.
> > Qingxin Feng
> >
> >
> > 从 Windows 版邮件<https://go.microsoft.com/fwlink/?LinkId=550986>发送
> >
> > 发件人: Steve Yurong Su<mailto:r...@apache.org>
> > 发送时间: 2023年10月7日 0:53
> > 收件人: dev@iotdb.apache.org<mailto:dev@iotdb.apache.org>
> > 主题: [DISCUSS] Incubating TsFile as an independent Apache project?
> >
> > Hi folks,
> >
> > Recently, I've been thinking about something that has been on my mind:
> > I believe TsFile has the potential to develop as an independent Apache
> > project (note, not a subproject like apache-iotdb-tsfile), just like
> > ORC, Parquet, and Arrow. How about incubating TsFile as an independent
> > Apache project?
> >
> > The main reason I came up with this idea is because I realized that
> > TsFile is not just the data file format of IoTDB, but it can also be a
> > standard format in the IoT field. It provides excellent support for
> > time series data, offering various encoding and compression methods.
> > It can be easily self-parsed and its statistical information enables
> > fast data querying by big data software. I believe that every IoT
> > software could benefit directly by supporting TsFile as a storage
> > format.
> >
> > On the other hand, I hope to leverage the power of the community to
> > drive the development of the TsFile file format. Just imagine, TsFile
> > could have its own independent ecosystem: parsing tools in various
> > languages, connectors to various big data software, and so on. By
> > separating TsFile from IoTDB, we have the opportunity to attract more
> > community contributors and introduce more ideas, thus refining the
> > functionality and performance of TsFile.
> >
> > What do you think about this idea?
> >
> > In addition, how can TsFile, as a part of the current IoTDB project,
> > become an independent Apache project? Should it go through the Apache
> > Foundation incubation process again, or can it directly become a
> > top-level project? It may be too early to ask this question now, but I
> > would also like to hear your opinions.
> >
> > Thanks,
> > Steve Su
> >
>


AW: [DISCUSS] Incubating TsFile as an independent Apache project?

2023-10-07 Thread Christofer Dutz
Hi all,

not even sure we’d need to go the route throught the incubator.
If there are enough seasoned and experienced Apache forlks in the PMC, I’d even 
support. A direct to TLP route.

Chris

Von: Jialin Qiao 
Datum: Samstag, 7. Oktober 2023 um 03:59
An: dev@iotdb.apache.org 
Betreff: Re: [DISCUSS] Incubating TsFile as an independent Apache project?
Hi,

+1 for Apache TsFile.

1. Industrial time series data management is becoming more and more
important, so a file format project for time series data is necessary.
2. When TsFile becomes an independent project, it could be developed
and released without impact the upgrading of IoTDB.

Thanks,
―
Jialin Qiao
Apache IoTDB PMC

冯 庆新  于2023年10月7日周六 10:22写道:
>
> Hi Steve Su
>
> I think this is a great idea and I fully support it.
> I believe Tsfile can generate greater influence and value.
>
> Thanks
> B.R.
> Qingxin Feng
>
>
> 从 Windows 版邮件<https://go.microsoft.com/fwlink/?LinkId=550986>发送
>
> 发件人: Steve Yurong Su<mailto:r...@apache.org>
> 发送时间: 2023年10月7日 0:53
> 收件人: dev@iotdb.apache.org<mailto:dev@iotdb.apache.org>
> 主题: [DISCUSS] Incubating TsFile as an independent Apache project?
>
> Hi folks,
>
> Recently, I've been thinking about something that has been on my mind:
> I believe TsFile has the potential to develop as an independent Apache
> project (note, not a subproject like apache-iotdb-tsfile), just like
> ORC, Parquet, and Arrow. How about incubating TsFile as an independent
> Apache project?
>
> The main reason I came up with this idea is because I realized that
> TsFile is not just the data file format of IoTDB, but it can also be a
> standard format in the IoT field. It provides excellent support for
> time series data, offering various encoding and compression methods.
> It can be easily self-parsed and its statistical information enables
> fast data querying by big data software. I believe that every IoT
> software could benefit directly by supporting TsFile as a storage
> format.
>
> On the other hand, I hope to leverage the power of the community to
> drive the development of the TsFile file format. Just imagine, TsFile
> could have its own independent ecosystem: parsing tools in various
> languages, connectors to various big data software, and so on. By
> separating TsFile from IoTDB, we have the opportunity to attract more
> community contributors and introduce more ideas, thus refining the
> functionality and performance of TsFile.
>
> What do you think about this idea?
>
> In addition, how can TsFile, as a part of the current IoTDB project,
> become an independent Apache project? Should it go through the Apache
> Foundation incubation process again, or can it directly become a
> top-level project? It may be too early to ask this question now, but I
> would also like to hear your opinions.
>
> Thanks,
> Steve Su
>


Re: [DISCUSS] Incubating TsFile as an independent Apache project?

2023-10-07 Thread Jialin Qiao
Hi,

+1 for Apache TsFile.

1. Industrial time series data management is becoming more and more
important, so a file format project for time series data is necessary.
2. When TsFile becomes an independent project, it could be developed
and released without impact the upgrading of IoTDB.

Thanks,
—
Jialin Qiao
Apache IoTDB PMC

冯 庆新  于2023年10月7日周六 10:22写道:
>
> Hi Steve Su
>
> I think this is a great idea and I fully support it.
> I believe Tsfile can generate greater influence and value.
>
> Thanks
> B.R.
> Qingxin Feng
>
>
> 从 Windows 版邮件<https://go.microsoft.com/fwlink/?LinkId=550986>发送
>
> 发件人: Steve Yurong Su<mailto:r...@apache.org>
> 发送时间: 2023年10月7日 0:53
> 收件人: dev@iotdb.apache.org<mailto:dev@iotdb.apache.org>
> 主题: [DISCUSS] Incubating TsFile as an independent Apache project?
>
> Hi folks,
>
> Recently, I've been thinking about something that has been on my mind:
> I believe TsFile has the potential to develop as an independent Apache
> project (note, not a subproject like apache-iotdb-tsfile), just like
> ORC, Parquet, and Arrow. How about incubating TsFile as an independent
> Apache project?
>
> The main reason I came up with this idea is because I realized that
> TsFile is not just the data file format of IoTDB, but it can also be a
> standard format in the IoT field. It provides excellent support for
> time series data, offering various encoding and compression methods.
> It can be easily self-parsed and its statistical information enables
> fast data querying by big data software. I believe that every IoT
> software could benefit directly by supporting TsFile as a storage
> format.
>
> On the other hand, I hope to leverage the power of the community to
> drive the development of the TsFile file format. Just imagine, TsFile
> could have its own independent ecosystem: parsing tools in various
> languages, connectors to various big data software, and so on. By
> separating TsFile from IoTDB, we have the opportunity to attract more
> community contributors and introduce more ideas, thus refining the
> functionality and performance of TsFile.
>
> What do you think about this idea?
>
> In addition, how can TsFile, as a part of the current IoTDB project,
> become an independent Apache project? Should it go through the Apache
> Foundation incubation process again, or can it directly become a
> top-level project? It may be too early to ask this question now, but I
> would also like to hear your opinions.
>
> Thanks,
> Steve Su
>


回复: [DISCUSS] Incubating TsFile as an independent Apache project?

2023-10-06 Thread 冯 庆新
Hi Steve Su

I think this is a great idea and I fully support it.
I believe Tsfile can generate greater influence and value.

Thanks
B.R.
Qingxin Feng


从 Windows 版邮件<https://go.microsoft.com/fwlink/?LinkId=550986>发送

发件人: Steve Yurong Su<mailto:r...@apache.org>
发送时间: 2023年10月7日 0:53
收件人: dev@iotdb.apache.org<mailto:dev@iotdb.apache.org>
主题: [DISCUSS] Incubating TsFile as an independent Apache project?

Hi folks,

Recently, I've been thinking about something that has been on my mind:
I believe TsFile has the potential to develop as an independent Apache
project (note, not a subproject like apache-iotdb-tsfile), just like
ORC, Parquet, and Arrow. How about incubating TsFile as an independent
Apache project?

The main reason I came up with this idea is because I realized that
TsFile is not just the data file format of IoTDB, but it can also be a
standard format in the IoT field. It provides excellent support for
time series data, offering various encoding and compression methods.
It can be easily self-parsed and its statistical information enables
fast data querying by big data software. I believe that every IoT
software could benefit directly by supporting TsFile as a storage
format.

On the other hand, I hope to leverage the power of the community to
drive the development of the TsFile file format. Just imagine, TsFile
could have its own independent ecosystem: parsing tools in various
languages, connectors to various big data software, and so on. By
separating TsFile from IoTDB, we have the opportunity to attract more
community contributors and introduce more ideas, thus refining the
functionality and performance of TsFile.

What do you think about this idea?

In addition, how can TsFile, as a part of the current IoTDB project,
become an independent Apache project? Should it go through the Apache
Foundation incubation process again, or can it directly become a
top-level project? It may be too early to ask this question now, but I
would also like to hear your opinions.

Thanks,
Steve Su



[DISCUSS] Incubating TsFile as an independent Apache project?

2023-10-06 Thread Steve Yurong Su
Hi folks,

Recently, I've been thinking about something that has been on my mind:
I believe TsFile has the potential to develop as an independent Apache
project (note, not a subproject like apache-iotdb-tsfile), just like
ORC, Parquet, and Arrow. How about incubating TsFile as an independent
Apache project?

The main reason I came up with this idea is because I realized that
TsFile is not just the data file format of IoTDB, but it can also be a
standard format in the IoT field. It provides excellent support for
time series data, offering various encoding and compression methods.
It can be easily self-parsed and its statistical information enables
fast data querying by big data software. I believe that every IoT
software could benefit directly by supporting TsFile as a storage
format.

On the other hand, I hope to leverage the power of the community to
drive the development of the TsFile file format. Just imagine, TsFile
could have its own independent ecosystem: parsing tools in various
languages, connectors to various big data software, and so on. By
separating TsFile from IoTDB, we have the opportunity to attract more
community contributors and introduce more ideas, thus refining the
functionality and performance of TsFile.

What do you think about this idea?

In addition, how can TsFile, as a part of the current IoTDB project,
become an independent Apache project? Should it go through the Apache
Foundation incubation process again, or can it directly become a
top-level project? It may be too early to ask this question now, but I
would also like to hear your opinions.

Thanks,
Steve Su