davidzollo commented on code in PR #9894: URL: https://github.com/apache/seatunnel/pull/9894#discussion_r2652966019
########## docs/en/connector-v2/sink/Lance.md: ########## @@ -0,0 +1,119 @@ +import ChangeLog from '../changelog/connector-lance.md'; + +# Lance + +> Lance sink connector + +## Support Those Engines + +> Spark(not support version under spark 3.4, reference https://lance.org/integrations/spark/install/#scala)<br/> +> Flink(not support, reference https://github.com/lance-format/lance-flink)<br/> +> SeaTunnel Zeta<br/> + +## Description + +Sink connector for Lance format. It can support create and write dataset 、lance namespace manage schema and version. + +## Key features + +- [] [exactly-once](../../concept/connector-v2-features.md) + +## Using Dependency + <dependency> + <groupId>com.lancedb</groupId> + <artifactId>lance-core</artifactId> + <version>0.33.0</version> + </dependency> + + <dependency> + <groupId>com.lancedb</groupId> + <artifactId>lance-namespace-core</artifactId> + <version>0.0.14</version> + </dependency> + +## Sink Options + +| Name | Type | Required | Default | Description | +|-----------------|--------|----------|---------|-------------------------------------------------------------------------------------------------------------------| +| dataset_path | string | yes | /tmp | The dataset path for the Lance sink connection. | +| namespace_type | string | yes | dir | The namespace type of Lance dataset, now only support DirectoryNamespace, the type will be set default with "dir" | +| table | string | yes | test | The name of Lance dataset, If not set, the dataset name will be set default with test | +| namespace_id | string | no | - | The id of the lance namespace. Please refer to https://lance.org/format/namespace/ | + + +## Data Type Mapping +The data type of lance depends on the Arrow data type system + +| StarRocks Data type | Lance Data type | +|---------------------|-----------------| Review Comment: ```suggestion | SeaTunnel Data type | Lance Data type | |---------------------|-----------------| ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
