This is an automated email from the ASF dual-hosted git repository. yihua pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/asf-site by this push: new 09a8207f65 [DOCS] Add support for Apache Doris and StarRocks (#6570) 09a8207f65 is described below commit 09a8207f65a678cd825ecc06e6810f2221b545e1 Author: Bhavani Sudha Saktheeswaran <2179254+bhasu...@users.noreply.github.com> AuthorDate: Fri Sep 2 17:43:32 2022 -0700 [DOCS] Add support for Apache Doris and StarRocks (#6570) --- website/docs/query_engine_setup.md | 15 +++++++++++++++ website/docs/querying_data.md | 7 +++++++ website/static/assets/images/hudi-lake.png | Bin 152033 -> 356832 bytes .../version-0.10.0/query_engine_setup.md | 14 ++++++++++++++ .../versioned_docs/version-0.10.0/querying_data.md | 8 ++++++++ .../version-0.10.1/query_engine_setup.md | 6 ++++++ .../versioned_docs/version-0.10.1/querying_data.md | 4 ++++ .../version-0.11.0/query_engine_setup.md | 6 ++++++ .../versioned_docs/version-0.11.0/querying_data.md | 4 ++++ .../version-0.11.1/query_engine_setup.md | 6 ++++++ .../versioned_docs/version-0.11.1/querying_data.md | 5 +++++ .../version-0.12.0/query_engine_setup.md | 6 ++++++ .../versioned_docs/version-0.12.0/querying_data.md | 4 ++++ 13 files changed, 85 insertions(+) diff --git a/website/docs/query_engine_setup.md b/website/docs/query_engine_setup.md index 63978797a6..b73e8a9d4a 100644 --- a/website/docs/query_engine_setup.md +++ b/website/docs/query_engine_setup.md @@ -99,3 +99,18 @@ Hudi tables are supported only when AWS Glue Data Catalog is used. It's not supp Please refer to [Redshift Spectrum Integration with Apache Hudi](https://docs.aws.amazon.com/redshift/latest/dg/c-spectrum-external-tables.html#c-spectrum-column-mapping-hudi) for more details. + +## Doris +Copy on Write Tables in Hudi version 0.10.0 can be queried via Doris external tables starting from Doris version 1.1. +Please refer to [Doris Hudi external table](https://doris.apache.org/docs/ecosystem/external-table/hudi-external-table/ ) +for more details on the setup. + +:::note +The current default supported version of Hudi is 0.10.0 and has not been tested in other versions. More versions will be supported in the future. +::: + +## StarRocks +Copy on Write tables in Apache Hudi 0.10.0 and above can be queried via StarRocks external tables from StarRocks version 2.2.0. +Only snapshot queries are supported currently. In future releases Merge on Read tables will also be supported. +Please refer to [StarRocks Hudi external table](https://docs.starrocks.com/en-us/2.2/using_starrocks/External_table#hudi-external-table) +for more details on the setup. diff --git a/website/docs/querying_data.md b/website/docs/querying_data.md index 024c84f5df..27551e5235 100644 --- a/website/docs/querying_data.md +++ b/website/docs/querying_data.md @@ -269,6 +269,11 @@ REFRESH database.table_name ## Redshift Spectrum To set up Redshift Spectrum for querying Hudi, see the [Query Engine Setup](/docs/next/query_engine_setup#redshift-spectrum) page. +## Doris +To set up Doris for querying Hudi, see the [Query Engine Setup](/docs/next/query_engine_setup#doris) page. + +## StarRocks +To set up StarRocks for querying Hudi, see the [Query Engine Setup](/docs/next/query_engine_setup#starrocks) page. ## Support Matrix @@ -286,6 +291,8 @@ Following tables show whether a given query is supported on specific query engin | **Trino** |Y|N| | **Impala** |Y|N| | **Redshift Spectrum** |Y|N| +| **Doris** |Y|N| +| **StarRocks** |Y|N| diff --git a/website/static/assets/images/hudi-lake.png b/website/static/assets/images/hudi-lake.png index 4e6f9cf0f3..82e628125c 100644 Binary files a/website/static/assets/images/hudi-lake.png and b/website/static/assets/images/hudi-lake.png differ diff --git a/website/versioned_docs/version-0.10.0/query_engine_setup.md b/website/versioned_docs/version-0.10.0/query_engine_setup.md index 6e4f60b496..80197ea528 100644 --- a/website/versioned_docs/version-0.10.0/query_engine_setup.md +++ b/website/versioned_docs/version-0.10.0/query_engine_setup.md @@ -81,3 +81,17 @@ Hudi tables are supported only when AWS Glue Data Catalog is used. It's not supp Please refer to [Redshift Spectrum Integration with Apache Hudi](https://docs.aws.amazon.com/redshift/latest/dg/c-spectrum-external-tables.html#c-spectrum-column-mapping-hudi) for more details. +## Doris +Copy on Write Tables in Hudi version 0.10.0 can be queried via Doris external tables starting from Doris version 1.1. +Please refer to [Doris Hudi external table](https://doris.apache.org/docs/ecosystem/external-table/hudi-external-table/ ) +for more details on the setup. + +:::note +The current default supported version of Hudi is 0.10.0 and has not been tested in other versions. More versions will be supported in the future. +::: + +## StarRocks +Copy on Write tables in Apache Hudi 0.10.0 and above can be queried via StarRocks external tables from StarRocks version 2.2.0. +Only snapshot queries are supported currently. In future releases Merge on Read tables will also be supported. +Please refer to [StarRocks Hudi external table](https://docs.starrocks.com/en-us/2.2/using_starrocks/External_table#hudi-external-table) +for more details on the setup. \ No newline at end of file diff --git a/website/versioned_docs/version-0.10.0/querying_data.md b/website/versioned_docs/version-0.10.0/querying_data.md index 6e1c15aa71..15b5ff3436 100644 --- a/website/versioned_docs/version-0.10.0/querying_data.md +++ b/website/versioned_docs/version-0.10.0/querying_data.md @@ -207,6 +207,12 @@ REFRESH database.table_name ## Redshift Spectrum To set up Redshift Spectrum for querying Hudi, see the [Query Engine Setup](/docs/0.10.0/query_engine_setup#redshift-spectrum) page. +## Doris +To set up Doris for querying Hudi, see the [Query Engine Setup](/docs/0.10.0/query_engine_setup#doris) page. + +## StarRocks +To set up StarRocks for querying Hudi, see the [Query Engine Setup](/docs/0.10.0/query_engine_setup#starrocks) page. + ## Support Matrix Following tables show whether a given query is supported on specific query engine. @@ -223,6 +229,8 @@ Following tables show whether a given query is supported on specific query engin |**Trino**|Y|N| |**Impala**|Y|N| |**Redshift Spectrum** |Y|N| +| **Doris** |Y|N| +| **StarRocks** |Y|N| Note that `Read Optimized` queries are not applicable for COPY_ON_WRITE tables. diff --git a/website/versioned_docs/version-0.10.1/query_engine_setup.md b/website/versioned_docs/version-0.10.1/query_engine_setup.md index ffff7401a9..6195f1e0a0 100644 --- a/website/versioned_docs/version-0.10.1/query_engine_setup.md +++ b/website/versioned_docs/version-0.10.1/query_engine_setup.md @@ -61,3 +61,9 @@ In order for Hive to recognize Hudi tables and query correctly, In addition to setup above, for beeline cli access, the `hive.input.format` variable needs to be set to the fully qualified path name of the inputformat `org.apache.hudi.hadoop.HoodieParquetInputFormat`. For Tez, additionally the `hive.tez.input.format` needs to be set to `org.apache.hadoop.hive.ql.io.HiveInputFormat`. Then proceed to query the table like any other Hive table. + +## StarRocks +Copy on Write tables in Apache Hudi 0.10.0 and above can be queried via StarRocks external tables from StarRocks version 2.2.0. +Only snapshot queries are supported currently. In future releases Merge on Read tables will also be supported. +Please refer to [StarRocks Hudi external table](https://docs.starrocks.com/en-us/2.2/using_starrocks/External_table#hudi-external-table) +for more details on the setup. \ No newline at end of file diff --git a/website/versioned_docs/version-0.10.1/querying_data.md b/website/versioned_docs/version-0.10.1/querying_data.md index c516708e7d..620581eb16 100644 --- a/website/versioned_docs/version-0.10.1/querying_data.md +++ b/website/versioned_docs/version-0.10.1/querying_data.md @@ -205,6 +205,9 @@ After Hudi made a new commit, refresh the Impala table to get the latest results REFRESH database.table_name ``` +## StarRocks +To set up StarRocks for querying Hudi, see the [Query Engine Setup](/docs/0.10.1/query_engine_setup#starrocks) page. + ## Support Matrix Following tables show whether a given query is supported on specific query engine. @@ -220,6 +223,7 @@ Following tables show whether a given query is supported on specific query engin |**PrestoDB**|Y|N| |**Trino**|Y|N| |**Impala**|Y|N| +| **StarRocks** |Y|N| Note that `Read Optimized` queries are not applicable for COPY_ON_WRITE tables. diff --git a/website/versioned_docs/version-0.11.0/query_engine_setup.md b/website/versioned_docs/version-0.11.0/query_engine_setup.md index 157e6daca6..10d1bb18e7 100644 --- a/website/versioned_docs/version-0.11.0/query_engine_setup.md +++ b/website/versioned_docs/version-0.11.0/query_engine_setup.md @@ -71,3 +71,9 @@ In order for Hive to recognize Hudi tables and query correctly, In addition to setup above, for beeline cli access, the `hive.input.format` variable needs to be set to the fully qualified path name of the inputformat `org.apache.hudi.hadoop.HoodieParquetInputFormat`. For Tez, additionally the `hive.tez.input.format` needs to be set to `org.apache.hadoop.hive.ql.io.HiveInputFormat`. Then proceed to query the table like any other Hive table. + +## StarRocks +Copy on Write tables in Apache Hudi 0.10.0 and above can be queried via StarRocks external tables from StarRocks version 2.2.0. +Only snapshot queries are supported currently. In future releases Merge on Read tables will also be supported. +Please refer to [StarRocks Hudi external table](https://docs.starrocks.com/en-us/2.2/using_starrocks/External_table#hudi-external-table) +for more details on the setup. \ No newline at end of file diff --git a/website/versioned_docs/version-0.11.0/querying_data.md b/website/versioned_docs/version-0.11.0/querying_data.md index 1b5cee0d5b..aa4b252f82 100644 --- a/website/versioned_docs/version-0.11.0/querying_data.md +++ b/website/versioned_docs/version-0.11.0/querying_data.md @@ -205,6 +205,9 @@ After Hudi made a new commit, refresh the Impala table to get the latest results REFRESH database.table_name ``` +## StarRocks +To set up StarRocks for querying Hudi, see the [Query Engine Setup](/docs/0.11.0/query_engine_setup#starrocks) page. + ## Support Matrix Following tables show whether a given query is supported on specific query engine. @@ -220,6 +223,7 @@ Following tables show whether a given query is supported on specific query engin |**PrestoDB**|Y|N| |**Trino**|Y|N| |**Impala**|Y|N| +| **StarRocks** |Y|N| Note that `Read Optimized` queries are not applicable for COPY_ON_WRITE tables. diff --git a/website/versioned_docs/version-0.11.1/query_engine_setup.md b/website/versioned_docs/version-0.11.1/query_engine_setup.md index 157e6daca6..10d1bb18e7 100644 --- a/website/versioned_docs/version-0.11.1/query_engine_setup.md +++ b/website/versioned_docs/version-0.11.1/query_engine_setup.md @@ -71,3 +71,9 @@ In order for Hive to recognize Hudi tables and query correctly, In addition to setup above, for beeline cli access, the `hive.input.format` variable needs to be set to the fully qualified path name of the inputformat `org.apache.hudi.hadoop.HoodieParquetInputFormat`. For Tez, additionally the `hive.tez.input.format` needs to be set to `org.apache.hadoop.hive.ql.io.HiveInputFormat`. Then proceed to query the table like any other Hive table. + +## StarRocks +Copy on Write tables in Apache Hudi 0.10.0 and above can be queried via StarRocks external tables from StarRocks version 2.2.0. +Only snapshot queries are supported currently. In future releases Merge on Read tables will also be supported. +Please refer to [StarRocks Hudi external table](https://docs.starrocks.com/en-us/2.2/using_starrocks/External_table#hudi-external-table) +for more details on the setup. \ No newline at end of file diff --git a/website/versioned_docs/version-0.11.1/querying_data.md b/website/versioned_docs/version-0.11.1/querying_data.md index 1b5cee0d5b..c9778c6b0e 100644 --- a/website/versioned_docs/version-0.11.1/querying_data.md +++ b/website/versioned_docs/version-0.11.1/querying_data.md @@ -205,6 +205,10 @@ After Hudi made a new commit, refresh the Impala table to get the latest results REFRESH database.table_name ``` + +## StarRocks +To set up StarRocks for querying Hudi, see the [Query Engine Setup](/docs/0.11.1/query_engine_setup#starrocks) page. + ## Support Matrix Following tables show whether a given query is supported on specific query engine. @@ -220,6 +224,7 @@ Following tables show whether a given query is supported on specific query engin |**PrestoDB**|Y|N| |**Trino**|Y|N| |**Impala**|Y|N| +| **StarRocks** |Y|N| Note that `Read Optimized` queries are not applicable for COPY_ON_WRITE tables. diff --git a/website/versioned_docs/version-0.12.0/query_engine_setup.md b/website/versioned_docs/version-0.12.0/query_engine_setup.md index 619ec17ca1..c6b472e513 100644 --- a/website/versioned_docs/version-0.12.0/query_engine_setup.md +++ b/website/versioned_docs/version-0.12.0/query_engine_setup.md @@ -99,3 +99,9 @@ Hudi tables are supported only when AWS Glue Data Catalog is used. It's not supp Please refer to [Redshift Spectrum Integration with Apache Hudi](https://docs.aws.amazon.com/redshift/latest/dg/c-spectrum-external-tables.html#c-spectrum-column-mapping-hudi) for more details. + +## StarRocks +Copy on Write tables in Apache Hudi 0.10.0 and above can be queried via StarRocks external tables from StarRocks version 2.2.0. +Only snapshot queries are supported currently. In future releases Merge on Read tables will also be supported. +Please refer to [StarRocks Hudi external table](https://docs.starrocks.com/en-us/2.2/using_starrocks/External_table#hudi-external-table) +for more details on the setup. \ No newline at end of file diff --git a/website/versioned_docs/version-0.12.0/querying_data.md b/website/versioned_docs/version-0.12.0/querying_data.md index 024c84f5df..215a56d507 100644 --- a/website/versioned_docs/version-0.12.0/querying_data.md +++ b/website/versioned_docs/version-0.12.0/querying_data.md @@ -270,6 +270,9 @@ REFRESH database.table_name To set up Redshift Spectrum for querying Hudi, see the [Query Engine Setup](/docs/next/query_engine_setup#redshift-spectrum) page. +## StarRocks +To set up StarRocks for querying Hudi, see the [Query Engine Setup](/docs/query_engine_setup#starrocks) page. + ## Support Matrix Following tables show whether a given query is supported on specific query engine. @@ -286,6 +289,7 @@ Following tables show whether a given query is supported on specific query engin | **Trino** |Y|N| | **Impala** |Y|N| | **Redshift Spectrum** |Y|N| +| **StarRocks** |Y|N|