kentkwu opened a new pull request, #4125: URL: https://github.com/apache/arrow-adbc/pull/4125
Adds streaming ingest support to the Node.js ADBC driver manager. **`AdbcConnection`:** - `ingestStream(tableName, reader, options?)` — streams a `RecordBatchReader` into a table, handling the full ingest lifecycle **`AdbcStatement`:** - `bindStream(reader)` — streams a `RecordBatchReader` as bound parameters and leaves execution to the caller **Implementation:** `ingestStream` uses a Rust `mpsc` channel to bridge the JS push loop and the ADBC `execute_update` call running on the thread pool. JS serializes each batch to Arrow IPC and sends it to the `ChannelBatchReader` on the Rust side which deserializes it. The channel is unbounded to avoid blocking the JS event loop. **Test Plan** ``` npm run test ``` Closes #4117 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
