This is an automated email from the ASF dual-hosted git repository.
tuhaihe pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/cloudberry-site.git
The following commit(s) were added to refs/heads/main by this push:
new 33b63d2963 add clouddm and bladepipe (#397)
33b63d2963 is described below
commit 33b63d29639102bc9dfd9b6a3f43a6c2c3bbede3
Author: ChocZoe <[email protected]>
AuthorDate: Tue Aug 25 17:18:15 2026 +0800
add clouddm and bladepipe (#397)
---
docs/ecosystem/data-integration/bladepipe.md | 62 +++++++++++++++++++++
docs/ecosystem/sql-clients/clouddm.md | 60 ++++++++++++++++++++
docs/media/bladepipe1.png | Bin 0 -> 31551 bytes
docs/media/bladepipe10.png | Bin 0 -> 42977 bytes
docs/media/bladepipe2.png | Bin 0 -> 89317 bytes
docs/media/bladepipe3.png | Bin 0 -> 90855 bytes
docs/media/bladepipe4.png | Bin 0 -> 42235 bytes
docs/media/bladepipe5.png | Bin 0 -> 133504 bytes
docs/media/bladepipe6.png | Bin 0 -> 63760 bytes
docs/media/bladepipe7.png | Bin 0 -> 88104 bytes
docs/media/bladepipe8.png | Bin 0 -> 175215 bytes
docs/media/bladepipe9.png | Bin 0 -> 99491 bytes
docs/media/clouddm1.png | Bin 0 -> 72690 bytes
docs/media/clouddm2.png | Bin 0 -> 87021 bytes
docs/media/clouddm3.png | Bin 0 -> 63244 bytes
docs/media/clouddm4.png | Bin 0 -> 79890 bytes
docs/media/clouddm5.png | Bin 0 -> 137276 bytes
docs/media/clouddm6.png | Bin 0 -> 106182 bytes
docs/media/clouddm7.png | Bin 0 -> 85822 bytes
docs/media/clouddm8.png | Bin 0 -> 130336 bytes
sidebars.ts | 4 +-
.../ecosystem/data-integration/bladepipe.md | 62 +++++++++++++++++++++
.../version-2.x/ecosystem/sql-clients/clouddm.md | 60 ++++++++++++++++++++
versioned_docs/version-2.x/media/bladepipe1.png | Bin 0 -> 31551 bytes
versioned_docs/version-2.x/media/bladepipe10.png | Bin 0 -> 42977 bytes
versioned_docs/version-2.x/media/bladepipe2.png | Bin 0 -> 89317 bytes
versioned_docs/version-2.x/media/bladepipe3.png | Bin 0 -> 90855 bytes
versioned_docs/version-2.x/media/bladepipe4.png | Bin 0 -> 42235 bytes
versioned_docs/version-2.x/media/bladepipe5.png | Bin 0 -> 133504 bytes
versioned_docs/version-2.x/media/bladepipe6.png | Bin 0 -> 63760 bytes
versioned_docs/version-2.x/media/bladepipe7.png | Bin 0 -> 88104 bytes
versioned_docs/version-2.x/media/bladepipe8.png | Bin 0 -> 175215 bytes
versioned_docs/version-2.x/media/bladepipe9.png | Bin 0 -> 99491 bytes
versioned_docs/version-2.x/media/clouddm1.png | Bin 0 -> 72690 bytes
versioned_docs/version-2.x/media/clouddm2.png | Bin 0 -> 87021 bytes
versioned_docs/version-2.x/media/clouddm3.png | Bin 0 -> 63244 bytes
versioned_docs/version-2.x/media/clouddm4.png | Bin 0 -> 79890 bytes
versioned_docs/version-2.x/media/clouddm5.png | Bin 0 -> 137276 bytes
versioned_docs/version-2.x/media/clouddm6.png | Bin 0 -> 106182 bytes
versioned_docs/version-2.x/media/clouddm7.png | Bin 0 -> 85822 bytes
versioned_docs/version-2.x/media/clouddm8.png | Bin 0 -> 130336 bytes
versioned_sidebars/version-2.x-sidebars.json | 8 ++-
42 files changed, 251 insertions(+), 5 deletions(-)
diff --git a/docs/ecosystem/data-integration/bladepipe.md
b/docs/ecosystem/data-integration/bladepipe.md
new file mode 100644
index 0000000000..e86cf76fd5
--- /dev/null
+++ b/docs/ecosystem/data-integration/bladepipe.md
@@ -0,0 +1,62 @@
+---
+title: BladePipe
+---
+
+# BladePipe
+
+[BladePipe](https://www.bladepipe.com/) is a real-time data integration and
CDC platform. It helps you build data pipelines in a no-code way between
different databases, data warehouses and data lakes, including Apache
Cloudberry.
+
+BladePipe supports data movement from PostgreSQL/Greenplum to Apache
Cloudberry, including:
+
+- Schema migration.
+- Full data migration.
+- Incremental data synchronization.
+- Data verification and correction.
+- DDL synchronization for common schema changes.
+
+This document will show how to synchronize data from PostgreSQL to Apache
Cloudberry.
+
+## Prerequisites
+
+- Make sure the PostgreSQL account has the [required
permissions](https://www.bladepipe.com/docs/dataMigrationAndSync/datasource_func/PostgreSQL/privs_for_pg/).
+- Apache Cloudberry is deployed and running.
+- [BladePipe (v1.6.0 or
higher)](https://www.bladepipe.com/docs/productOP/onPremise/installation/install_all_in_one_docker/)
is installed and accessible.
+
+## Steps
+
+### Step 1: Add DataSources
+
+1. Log in to BladePipe. Go to **DataSource** > **Add DataSource**.
+
+
+2. Add Apache Cloudberry and PostgreSQL separately as a DataSource:
+ - **Deployment**: Select **Self-managed**.
+ - **Type**: Select **Cloudberry** / **PostgreSQL**.
+ - **Host**: Enter the database host and port.
+ - **Account & Password**: Enter the username and password of Cloudberry /
PostgreSQL.
+
+3. Click **Test Connection**. Then click **Add DataSource**.
+
+
+### Step 2: Create a DataJob
+
+1. Go to **DataJob** > **Create DataJob**.
+
+
+2. Select PostgreSQL as the source DataSource and Cloudberry as the target
DataSource.
+
+
+3. Choose the DataJob type. For synchronization tasks, select **Incremental**
with **Initial Load**. The initial load migrates existing data. Incremental
sync keeps Cloudberry updated after the initial load finishes.
+
+
+4. Select which tables to sync. You can include everything or pick specific
ones.
+
+
+5. Select the columns to sync. Here you can process data, like filtering and
transformation.
+
+
+6. Click **Create DataJob** to start the DataJob.
+
+
+7. You can check the pipeline status and progress on the DataJob page.
+
\ No newline at end of file
diff --git a/docs/ecosystem/sql-clients/clouddm.md
b/docs/ecosystem/sql-clients/clouddm.md
new file mode 100644
index 0000000000..f16942ec4f
--- /dev/null
+++ b/docs/ecosystem/sql-clients/clouddm.md
@@ -0,0 +1,60 @@
+---
+title: CloudDM
+---
+
+# CloudDM
+
+CloudDM is an open-source database management tool for teams. It provides a
web console for SQL queries, database management, access control, SQL auditing,
approval workflows, and database CI/CD. It supports multiple databases,
including MySQL, Oracle, StarRocks, and Apache Cloudberry.
+
+This document shows how to connect CloudDM to Apache Cloudberry and run SQL
queries.
+
+
+## Prerequisites
+
+- Apache Cloudberry is deployed and running.
+- Database access permissions are properly configured in `pg_hba.conf`.
+- [CloudDM (v4.1.0 or higher)](https://github.com/ClouGence/open-cdm) is
installed and accessible.
+
+## Steps
+
+1. Log in to the CloudDM console, and click **Back to Workspace**.
+
+2. In the left panel, click **Instances**, and then click **New** to add a
database connection.
+
+
+3. Select Cloudberry and click **Submit**.
+
+
+4. Enter the Cloudberry connection information:
+ - **Host**: Enter the hostname or IP address of your Cloudberry instance.
+ - **Port**: Enter the port.
+ - **Authentication**: Select an authentication method and enter the
required information (for example, username and password)
+
+ 
+
+5. Test the connection. Once Cloudberry is connected to CloudDM, click **Add
DataSource**.
+
+ If the test fails, check the Cloudberry address, port, database user,
password, network access, and `pg_hba.conf` rules.
+
+6. Go to **SQL Query**.
+
+
+7. The added Cloudberry instance is shown in the left panel. Now you can start
running a query.
+
+
+## Other features
+
+### Work orders
+
+CloudDM supports work orders for production database changes. Teams can
submit, approve, and execute changes through a controlled workflow.
+
+
+### CI/CD
+
+CloudDM can trigger database CI/CD workflows through Git Push, Web Hook, and
HttpCall. Teams can include SQL checks, approvals, and execution in application
release processes, and manage database change scripts in one place.
+
+
+### User access control
+
+CloudDM supports role-based access control (RBAC) for team collaboration.
Teams can grant access by role and control which data sources and operations
each user can use.
+
\ No newline at end of file
diff --git a/docs/media/bladepipe1.png b/docs/media/bladepipe1.png
new file mode 100644
index 0000000000..037f5e7b69
Binary files /dev/null and b/docs/media/bladepipe1.png differ
diff --git a/docs/media/bladepipe10.png b/docs/media/bladepipe10.png
new file mode 100644
index 0000000000..9cd0b5d119
Binary files /dev/null and b/docs/media/bladepipe10.png differ
diff --git a/docs/media/bladepipe2.png b/docs/media/bladepipe2.png
new file mode 100644
index 0000000000..ceafded09f
Binary files /dev/null and b/docs/media/bladepipe2.png differ
diff --git a/docs/media/bladepipe3.png b/docs/media/bladepipe3.png
new file mode 100644
index 0000000000..ee1e94af2d
Binary files /dev/null and b/docs/media/bladepipe3.png differ
diff --git a/docs/media/bladepipe4.png b/docs/media/bladepipe4.png
new file mode 100644
index 0000000000..45863397ec
Binary files /dev/null and b/docs/media/bladepipe4.png differ
diff --git a/docs/media/bladepipe5.png b/docs/media/bladepipe5.png
new file mode 100644
index 0000000000..070f5cce4d
Binary files /dev/null and b/docs/media/bladepipe5.png differ
diff --git a/docs/media/bladepipe6.png b/docs/media/bladepipe6.png
new file mode 100644
index 0000000000..22f4c61f0c
Binary files /dev/null and b/docs/media/bladepipe6.png differ
diff --git a/docs/media/bladepipe7.png b/docs/media/bladepipe7.png
new file mode 100644
index 0000000000..9cc57f4985
Binary files /dev/null and b/docs/media/bladepipe7.png differ
diff --git a/docs/media/bladepipe8.png b/docs/media/bladepipe8.png
new file mode 100644
index 0000000000..8941786315
Binary files /dev/null and b/docs/media/bladepipe8.png differ
diff --git a/docs/media/bladepipe9.png b/docs/media/bladepipe9.png
new file mode 100644
index 0000000000..64c5ddf695
Binary files /dev/null and b/docs/media/bladepipe9.png differ
diff --git a/docs/media/clouddm1.png b/docs/media/clouddm1.png
new file mode 100644
index 0000000000..3b11306d67
Binary files /dev/null and b/docs/media/clouddm1.png differ
diff --git a/docs/media/clouddm2.png b/docs/media/clouddm2.png
new file mode 100644
index 0000000000..9b228f6562
Binary files /dev/null and b/docs/media/clouddm2.png differ
diff --git a/docs/media/clouddm3.png b/docs/media/clouddm3.png
new file mode 100644
index 0000000000..d3af6b7f48
Binary files /dev/null and b/docs/media/clouddm3.png differ
diff --git a/docs/media/clouddm4.png b/docs/media/clouddm4.png
new file mode 100644
index 0000000000..74214ec71f
Binary files /dev/null and b/docs/media/clouddm4.png differ
diff --git a/docs/media/clouddm5.png b/docs/media/clouddm5.png
new file mode 100644
index 0000000000..53def963d4
Binary files /dev/null and b/docs/media/clouddm5.png differ
diff --git a/docs/media/clouddm6.png b/docs/media/clouddm6.png
new file mode 100644
index 0000000000..d513a70520
Binary files /dev/null and b/docs/media/clouddm6.png differ
diff --git a/docs/media/clouddm7.png b/docs/media/clouddm7.png
new file mode 100644
index 0000000000..514249169d
Binary files /dev/null and b/docs/media/clouddm7.png differ
diff --git a/docs/media/clouddm8.png b/docs/media/clouddm8.png
new file mode 100644
index 0000000000..a1b28704c0
Binary files /dev/null and b/docs/media/clouddm8.png differ
diff --git a/sidebars.ts b/sidebars.ts
index f2beed0145..bd6e562ffd 100644
--- a/sidebars.ts
+++ b/sidebars.ts
@@ -308,12 +308,12 @@ const sidebars: SidebarsConfig = {
{
type: 'category',
label: 'SQL Clients',
- items: ['ecosystem/sql-clients/dbeaver']
+ items: ['ecosystem/sql-clients/dbeaver',
'ecosystem/sql-clients/clouddm']
},
{
type: 'category',
label: 'Data Integration',
- items: ['ecosystem/data-integration/seatunnel']
+ items: ['ecosystem/data-integration/seatunnel',
'ecosystem/data-integration/bladepipe']
},
{
type: 'category',
diff --git a/versioned_docs/version-2.x/ecosystem/data-integration/bladepipe.md
b/versioned_docs/version-2.x/ecosystem/data-integration/bladepipe.md
new file mode 100644
index 0000000000..e86cf76fd5
--- /dev/null
+++ b/versioned_docs/version-2.x/ecosystem/data-integration/bladepipe.md
@@ -0,0 +1,62 @@
+---
+title: BladePipe
+---
+
+# BladePipe
+
+[BladePipe](https://www.bladepipe.com/) is a real-time data integration and
CDC platform. It helps you build data pipelines in a no-code way between
different databases, data warehouses and data lakes, including Apache
Cloudberry.
+
+BladePipe supports data movement from PostgreSQL/Greenplum to Apache
Cloudberry, including:
+
+- Schema migration.
+- Full data migration.
+- Incremental data synchronization.
+- Data verification and correction.
+- DDL synchronization for common schema changes.
+
+This document will show how to synchronize data from PostgreSQL to Apache
Cloudberry.
+
+## Prerequisites
+
+- Make sure the PostgreSQL account has the [required
permissions](https://www.bladepipe.com/docs/dataMigrationAndSync/datasource_func/PostgreSQL/privs_for_pg/).
+- Apache Cloudberry is deployed and running.
+- [BladePipe (v1.6.0 or
higher)](https://www.bladepipe.com/docs/productOP/onPremise/installation/install_all_in_one_docker/)
is installed and accessible.
+
+## Steps
+
+### Step 1: Add DataSources
+
+1. Log in to BladePipe. Go to **DataSource** > **Add DataSource**.
+
+
+2. Add Apache Cloudberry and PostgreSQL separately as a DataSource:
+ - **Deployment**: Select **Self-managed**.
+ - **Type**: Select **Cloudberry** / **PostgreSQL**.
+ - **Host**: Enter the database host and port.
+ - **Account & Password**: Enter the username and password of Cloudberry /
PostgreSQL.
+
+3. Click **Test Connection**. Then click **Add DataSource**.
+
+
+### Step 2: Create a DataJob
+
+1. Go to **DataJob** > **Create DataJob**.
+
+
+2. Select PostgreSQL as the source DataSource and Cloudberry as the target
DataSource.
+
+
+3. Choose the DataJob type. For synchronization tasks, select **Incremental**
with **Initial Load**. The initial load migrates existing data. Incremental
sync keeps Cloudberry updated after the initial load finishes.
+
+
+4. Select which tables to sync. You can include everything or pick specific
ones.
+
+
+5. Select the columns to sync. Here you can process data, like filtering and
transformation.
+
+
+6. Click **Create DataJob** to start the DataJob.
+
+
+7. You can check the pipeline status and progress on the DataJob page.
+
\ No newline at end of file
diff --git a/versioned_docs/version-2.x/ecosystem/sql-clients/clouddm.md
b/versioned_docs/version-2.x/ecosystem/sql-clients/clouddm.md
new file mode 100644
index 0000000000..f16942ec4f
--- /dev/null
+++ b/versioned_docs/version-2.x/ecosystem/sql-clients/clouddm.md
@@ -0,0 +1,60 @@
+---
+title: CloudDM
+---
+
+# CloudDM
+
+CloudDM is an open-source database management tool for teams. It provides a
web console for SQL queries, database management, access control, SQL auditing,
approval workflows, and database CI/CD. It supports multiple databases,
including MySQL, Oracle, StarRocks, and Apache Cloudberry.
+
+This document shows how to connect CloudDM to Apache Cloudberry and run SQL
queries.
+
+
+## Prerequisites
+
+- Apache Cloudberry is deployed and running.
+- Database access permissions are properly configured in `pg_hba.conf`.
+- [CloudDM (v4.1.0 or higher)](https://github.com/ClouGence/open-cdm) is
installed and accessible.
+
+## Steps
+
+1. Log in to the CloudDM console, and click **Back to Workspace**.
+
+2. In the left panel, click **Instances**, and then click **New** to add a
database connection.
+
+
+3. Select Cloudberry and click **Submit**.
+
+
+4. Enter the Cloudberry connection information:
+ - **Host**: Enter the hostname or IP address of your Cloudberry instance.
+ - **Port**: Enter the port.
+ - **Authentication**: Select an authentication method and enter the
required information (for example, username and password)
+
+ 
+
+5. Test the connection. Once Cloudberry is connected to CloudDM, click **Add
DataSource**.
+
+ If the test fails, check the Cloudberry address, port, database user,
password, network access, and `pg_hba.conf` rules.
+
+6. Go to **SQL Query**.
+
+
+7. The added Cloudberry instance is shown in the left panel. Now you can start
running a query.
+
+
+## Other features
+
+### Work orders
+
+CloudDM supports work orders for production database changes. Teams can
submit, approve, and execute changes through a controlled workflow.
+
+
+### CI/CD
+
+CloudDM can trigger database CI/CD workflows through Git Push, Web Hook, and
HttpCall. Teams can include SQL checks, approvals, and execution in application
release processes, and manage database change scripts in one place.
+
+
+### User access control
+
+CloudDM supports role-based access control (RBAC) for team collaboration.
Teams can grant access by role and control which data sources and operations
each user can use.
+
\ No newline at end of file
diff --git a/versioned_docs/version-2.x/media/bladepipe1.png
b/versioned_docs/version-2.x/media/bladepipe1.png
new file mode 100644
index 0000000000..037f5e7b69
Binary files /dev/null and b/versioned_docs/version-2.x/media/bladepipe1.png
differ
diff --git a/versioned_docs/version-2.x/media/bladepipe10.png
b/versioned_docs/version-2.x/media/bladepipe10.png
new file mode 100644
index 0000000000..9cd0b5d119
Binary files /dev/null and b/versioned_docs/version-2.x/media/bladepipe10.png
differ
diff --git a/versioned_docs/version-2.x/media/bladepipe2.png
b/versioned_docs/version-2.x/media/bladepipe2.png
new file mode 100644
index 0000000000..ceafded09f
Binary files /dev/null and b/versioned_docs/version-2.x/media/bladepipe2.png
differ
diff --git a/versioned_docs/version-2.x/media/bladepipe3.png
b/versioned_docs/version-2.x/media/bladepipe3.png
new file mode 100644
index 0000000000..ee1e94af2d
Binary files /dev/null and b/versioned_docs/version-2.x/media/bladepipe3.png
differ
diff --git a/versioned_docs/version-2.x/media/bladepipe4.png
b/versioned_docs/version-2.x/media/bladepipe4.png
new file mode 100644
index 0000000000..45863397ec
Binary files /dev/null and b/versioned_docs/version-2.x/media/bladepipe4.png
differ
diff --git a/versioned_docs/version-2.x/media/bladepipe5.png
b/versioned_docs/version-2.x/media/bladepipe5.png
new file mode 100644
index 0000000000..070f5cce4d
Binary files /dev/null and b/versioned_docs/version-2.x/media/bladepipe5.png
differ
diff --git a/versioned_docs/version-2.x/media/bladepipe6.png
b/versioned_docs/version-2.x/media/bladepipe6.png
new file mode 100644
index 0000000000..22f4c61f0c
Binary files /dev/null and b/versioned_docs/version-2.x/media/bladepipe6.png
differ
diff --git a/versioned_docs/version-2.x/media/bladepipe7.png
b/versioned_docs/version-2.x/media/bladepipe7.png
new file mode 100644
index 0000000000..9cc57f4985
Binary files /dev/null and b/versioned_docs/version-2.x/media/bladepipe7.png
differ
diff --git a/versioned_docs/version-2.x/media/bladepipe8.png
b/versioned_docs/version-2.x/media/bladepipe8.png
new file mode 100644
index 0000000000..8941786315
Binary files /dev/null and b/versioned_docs/version-2.x/media/bladepipe8.png
differ
diff --git a/versioned_docs/version-2.x/media/bladepipe9.png
b/versioned_docs/version-2.x/media/bladepipe9.png
new file mode 100644
index 0000000000..64c5ddf695
Binary files /dev/null and b/versioned_docs/version-2.x/media/bladepipe9.png
differ
diff --git a/versioned_docs/version-2.x/media/clouddm1.png
b/versioned_docs/version-2.x/media/clouddm1.png
new file mode 100644
index 0000000000..3b11306d67
Binary files /dev/null and b/versioned_docs/version-2.x/media/clouddm1.png
differ
diff --git a/versioned_docs/version-2.x/media/clouddm2.png
b/versioned_docs/version-2.x/media/clouddm2.png
new file mode 100644
index 0000000000..9b228f6562
Binary files /dev/null and b/versioned_docs/version-2.x/media/clouddm2.png
differ
diff --git a/versioned_docs/version-2.x/media/clouddm3.png
b/versioned_docs/version-2.x/media/clouddm3.png
new file mode 100644
index 0000000000..d3af6b7f48
Binary files /dev/null and b/versioned_docs/version-2.x/media/clouddm3.png
differ
diff --git a/versioned_docs/version-2.x/media/clouddm4.png
b/versioned_docs/version-2.x/media/clouddm4.png
new file mode 100644
index 0000000000..74214ec71f
Binary files /dev/null and b/versioned_docs/version-2.x/media/clouddm4.png
differ
diff --git a/versioned_docs/version-2.x/media/clouddm5.png
b/versioned_docs/version-2.x/media/clouddm5.png
new file mode 100644
index 0000000000..53def963d4
Binary files /dev/null and b/versioned_docs/version-2.x/media/clouddm5.png
differ
diff --git a/versioned_docs/version-2.x/media/clouddm6.png
b/versioned_docs/version-2.x/media/clouddm6.png
new file mode 100644
index 0000000000..d513a70520
Binary files /dev/null and b/versioned_docs/version-2.x/media/clouddm6.png
differ
diff --git a/versioned_docs/version-2.x/media/clouddm7.png
b/versioned_docs/version-2.x/media/clouddm7.png
new file mode 100644
index 0000000000..514249169d
Binary files /dev/null and b/versioned_docs/version-2.x/media/clouddm7.png
differ
diff --git a/versioned_docs/version-2.x/media/clouddm8.png
b/versioned_docs/version-2.x/media/clouddm8.png
new file mode 100644
index 0000000000..a1b28704c0
Binary files /dev/null and b/versioned_docs/version-2.x/media/clouddm8.png
differ
diff --git a/versioned_sidebars/version-2.x-sidebars.json
b/versioned_sidebars/version-2.x-sidebars.json
index 679340dd58..2f38e7af4c 100644
--- a/versioned_sidebars/version-2.x-sidebars.json
+++ b/versioned_sidebars/version-2.x-sidebars.json
@@ -372,14 +372,16 @@
"type": "category",
"label": "SQL Clients",
"items": [
- "ecosystem/sql-clients/dbeaver"
+ "ecosystem/sql-clients/dbeaver",
+ "ecosystem/sql-clients/clouddm"
]
},
{
"type": "category",
"label": "Data Integration",
"items": [
- "ecosystem/data-integration/seatunnel"
+ "ecosystem/data-integration/seatunnel",
+ "ecosystem/data-integration/bladepipe"
]
},
{
@@ -819,4 +821,4 @@
"href": "/pxf/"
}
]
-}
\ No newline at end of file
+}
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
