JingsongLi commented on code in PR #511: URL: https://github.com/apache/paimon-rust/pull/511#discussion_r3701193197
########## docs/src/sql.md: ########## @@ -1169,6 +1169,72 @@ CROSS JOIN LATERAL vector_search( ) AS r; ``` +## Incremental Query + +Paimon supports batch incremental reads between snapshot IDs via the +`paimon_incremental_query` table-valued function. This aligns with Spark's +`paimon_incremental_query` TVF: results are returned as `RecordBatch` streams +within a single SQL query (not a long-running CDC stream). + +### Registration + +When you use a `SQLContext`, `paimon_incremental_query` is registered +automatically for every catalog you register — no extra setup is needed. + +With a raw DataFusion `SessionContext`, register it explicitly: + +```rust +use paimon_datafusion::register_incremental_query; + +register_incremental_query(&ctx, catalog.clone(), "default"); Review Comment: register by default? so user don't need to register this again. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
