morningman opened a new pull request, #4050:
URL: https://github.com/apache/doris-website/pull/4050

   ## Summary
   
   Adds user documentation for the ADBC Catalog introduced in 
apache/doris#66331.
   
   An ADBC Catalog reads an external data source through an [Arrow Database 
Connectivity](https://arrow.apache.org/adbc/) driver. Data is transferred in 
Arrow format instead of being converted value by value as in a JDBC catalog, 
and one scan is split by the driver's own result partitions so several BE nodes 
read it in parallel. Phase one targets Arrow Flight SQL sources, including 
another Doris cluster.
   
   The feature is experimental and ships in 5.0.0.
   
   ## What the doc covers
   
   - Overview, differences from a JDBC Catalog, applicable scenarios and a 
feature matrix
   - Driver deployment. Doris ships no ADBC driver, and the FE resolves 
`driver_url` into an absolute path that it sends to the BEs unchanged, so the 
same driver build must sit at the same absolute path on the FE and on every BE. 
The `adbc.conf` settings (`drivers_dir`, `driver_secure_path`) are documented 
alongside.
   - Catalog properties, organized as an unordered list in the same style as 
the Iceberg doc: `driver_url`, `uri`, `{DriverProperties}`, 
`{ConnectionProperties}`, `{ReadProperties}`, `{DriverOptions}`, 
`{CommonProperties}`
   - Examples: querying another Doris cluster, pinning the driver build with 
`driver_checksum`, requiring parallel reads, disabling parallel reads
   - Namespace mapping from ADBC's three naming levels onto the two a Doris 
external table has
   - Column type mapping from Arrow types, including unsigned widening and the 
behavior for unmappable types
   - Query operations: column pruning, predicate pushdown, `LIMIT` pushdown, 
`COUNT(*)`, inspecting the generated remote SQL, parallel reads
   - Metadata cache (`meta.cache.adbc.metadata.*`), manual refresh and 
observability
   - Limitations and FAQ
   
   ## Notes
   
   - Both the English page and the Chinese translation are included, and only 
the `current` version is touched.
   - `sidebars.ts` lists the new page after `doris-catalog`, since the ADBC 
catalog is the intended replacement for it.
   - Content was verified against the source on the feature branch rather than 
the PR description alone. Two places where the two disagree follow the code: 
`user` and `password` are documented as optional, because only `driver_url` and 
`uri` are actually required; and `drivers_dir` / `driver_secure_path` are 
documented as `adbc.conf` settings rather than `fe.conf` keys.
   
   🤖 Generated with [Claude Code](https://claude.com/claude-code)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to