回复: Add SQL create data/schema region

[Zhou Yifu]

Hi,

I am confused about why our current algorithm cannot expand RegionGroup 
automatically and had to add region manually by DBA? Is it possible to set a  
threshold when SeriesPartitionSlot is coming filled and execute the logic you 
create a region automatically?

Thanks,
Yifu Zhou

从 Windows 版邮件发送

发件人: Yongzao Dan
发送时间: 2022年8月18日 10:50
收件人: dev
主题: Add SQL create data/schema region

Hi,
 I'm planning to add a SQL for IoTDB cluster version. Here are the 
details of this SQL:


 Motivation:We don't have enough evidence to design an 
optimalRegionGroupexpansion algorithm yet.
If a large number of devices are created in a StorageGroup and the 
SeriesPartitionSlot is filled, the current algorithm cannot 
expandRegionGroupanymore.
Therefore, we need a special SQL to enable DBA 
expandRegionGroupmanually.


 Syntax Definition: create (data | schema) region on prefixPath(Represent 
a specific StorageGroup)


 Function Definition: Create a new data/schema RegionGroup for the 
specific StorageGroup.





Yongzao Dan,
School of Software, Tsinghua University

Re: Add SQL create data/schema region

[Eric Pai]

Then there could be some opportunities that one SG belongs to many regions (for 
adding regions for existed SG). If so, I think the following design may be more 
formal. What do you think?

ALTER STORAGE GROUP  ADD (DATA | SCHEMA) REGION

And I think we should also display the region count in SHOW STROAGE GROUP;

在 2022/8/18 11:06，“Jialin Qiao” 写入:

Hi,

We will create a  region for this storage group, and allocate all replicas
of this region to datanodes. Then, newly created data partition could be
routed to  this region.

1. Does the exist data under the prefixPath will be automatically migrated
to the new region?

Currently, no.
But we could also migrate some existing data by some sql.

2. Does the prefixPath must be a storage group name, or any arbitrary
prefix path?

Yes.

Thanks,
Jialin Qiao


Eric Pai  于2022年8月18日周四 11:00写道：

> Hi,
>
> Could you explain what will happen after a region being created manually
> in detail? And I have some questions about this SQL
> 1. Does the exist data under the prefixPath will be automatically migrated
> to the new region?
> 2. Does the prefixPath must be a storage group name, or any arbitrary
> prefix path?
>
> 在 2022/8/18 10:50，“Yongzao Dan”<532741...@qq.com.INVALID> 写入:
>
> Hi,
>  I'm planning to add a SQL for IoTDB cluster version. Here are
> the details of this SQL:
>
>
>  Motivation:We don't have enough evidence to design an
> optimalRegionGroupexpansion algorithm yet.
> If a large number of devices are created in a StorageGroup and the
> SeriesPartitionSlot is filled, the current algorithm cannot
> expandRegionGroupanymore.
> Therefore, we need a special SQL to enable DBA
> expandRegionGroupmanually.
>
>
>  Syntax Definition: create (data | schema) region on
> prefixPath(Represent a specific StorageGroup)
>
>
>  Function Definition: Create a new data/schema RegionGroup for
> the specific StorageGroup.
>
>
>
> 

>
>
> Yongzao Dan,
> School of Software, Tsinghua University
>
>

Re: Add SQL create data/schema region

[Jialin Qiao]

Hi,

We will create a  region for this storage group, and allocate all replicas
of this region to datanodes. Then, newly created data partition could be
routed to  this region.

1. Does the exist data under the prefixPath will be automatically migrated
to the new region?

Currently, no.
But we could also migrate some existing data by some sql.

2. Does the prefixPath must be a storage group name, or any arbitrary
prefix path?

Yes.

Thanks,
Jialin Qiao


Eric Pai  于2022年8月18日周四 11:00写道：

> Hi,
>
> Could you explain what will happen after a region being created manually
> in detail? And I have some questions about this SQL
> 1. Does the exist data under the prefixPath will be automatically migrated
> to the new region?
> 2. Does the prefixPath must be a storage group name, or any arbitrary
> prefix path?
>
> 在 2022/8/18 10:50，“Yongzao Dan”<532741...@qq.com.INVALID> 写入:
>
> Hi,
>  I'm planning to add a SQL for IoTDB cluster version. Here are
> the details of this SQL:
>
>
>  Motivation:We don't have enough evidence to design an
> optimalRegionGroupexpansion algorithm yet.
> If a large number of devices are created in a StorageGroup and the
> SeriesPartitionSlot is filled, the current algorithm cannot
> expandRegionGroupanymore.
> Therefore, we need a special SQL to enable DBA
> expandRegionGroupmanually.
>
>
>  Syntax Definition: create (data | schema) region on
> prefixPath(Represent a specific StorageGroup)
>
>
>  Function Definition: Create a new data/schema RegionGroup for
> the specific StorageGroup.
>
>
>
> 
>
>
> Yongzao Dan,
> School of Software, Tsinghua University
>
>

Re: Apply to join IotDB

[Gaofei Cao]

Welcome!
—
Gaofei Cao
Apache IoTDB PMC

Jialin Qiao  于2022年8月16日周二 16:02写道：

>
> Welcome! Added to Jira.
> —
> Jialin Qiao
> Apache IoTDB PMC
>
>
> 曹志佳  于2022年8月16日周二 14:11写道：
>
> > Hi, I'm Cao Zhijia,from Timecho!
> >
> >
> > Confluence id:Zhijia Cao
> > Jira id:caozhijia1

Re: Add SQL create data/schema region

[Eric Pai]

Hi,

Could you explain what will happen after a region being created manually in 
detail? And I have some questions about this SQL
1. Does the exist data under the prefixPath will be automatically migrated to 
the new region?
2. Does the prefixPath must be a storage group name, or any arbitrary prefix 
path?

在 2022/8/18 10:50，“Yongzao Dan”<532741...@qq.com.INVALID> 写入:

Hi,
 I'm planning to add a SQL for IoTDB cluster version. Here are the 
details of this SQL:


 Motivation:We don't have enough evidence to design an 
optimalRegionGroupexpansion algorithm yet.
If a large number of devices are created in a StorageGroup and the 
SeriesPartitionSlot is filled, the current algorithm cannot 
expandRegionGroupanymore.
Therefore, we need a special SQL to enable DBA 
expandRegionGroupmanually.


 Syntax Definition: create (data | schema) region on 
prefixPath(Represent a specific StorageGroup)


 Function Definition: Create a new data/schema RegionGroup for the 
specific StorageGroup.






Yongzao Dan,
School of Software, Tsinghua University

Add SQL create data/schema region

[Yongzao Dan]

Hi,
 I'm planning to add a SQL for IoTDB cluster version. Here are the 
details of this SQL:


 Motivation:We don't have enough evidence to design an 
optimalRegionGroupexpansion algorithm yet.
If a large number of devices are created in a StorageGroup and the 
SeriesPartitionSlot is filled, the current algorithm cannot 
expandRegionGroupanymore.
Therefore, we need a special SQL to enable DBA 
expandRegionGroupmanually.


 Syntax Definition: create (data | schema) region on prefixPath(Represent 
a specific StorageGroup)


 Function Definition: Create a new data/schema RegionGroup for the 
specific StorageGroup.





Yongzao Dan,
School of Software, Tsinghua University

[BUILD-STABLE]: Job 'IoTDB/IoTDB-Pipe/master [master] [680]'

[Apache Jenkins Server]

BUILD-STABLE: Job 'IoTDB/IoTDB-Pipe/master [master] [680]':

Is back to normal.