[
https://issues.apache.org/jira/browse/KYLIN-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17930264#comment-17930264
]
Guoliang Sun commented on KYLIN-6072:
-------------------------------------
h4. Dev Design
Spark already supports multi-catalog functionality, and Storage V3 will use
Delta's native catalog.
- Add the following configurations:
{code:java}
kylin.engine.spark-conf.spark.sql.catalog.delta=org.apache.spark.sql.delta.catalog.DeltaCatalog
kylin.storage.columnar.spark-conf.spark.sql.catalog.delta=org.apache.spark.sql.delta.catalog.DeltaCatalog{code}
- Queries can simultaneously access Storage V3 models and Iceberg data.
During build validation, invoking Delta's table creation method resulted in an
exception after adding the configuration. However, writing data directly to
Delta automatically creates the table successfully. To resolve this, simply
remove the explicit table creation operation.
> StorageV3 Catalog Refactoring to Avoid Conflicts with Iceberg Catalog
> ---------------------------------------------------------------------
>
> Key: KYLIN-6072
> URL: https://issues.apache.org/jira/browse/KYLIN-6072
> Project: Kylin
> Issue Type: Improvement
> Affects Versions: 5.0.0
> Reporter: Guoliang Sun
> Assignee: Guoliang Sun
> Priority: Major
> Fix For: 5.0.2
>
>
> It is desired that Storage V3 and Iceberg data sources do not conflict and
> can coexist.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
